A portion of the disclosure of this patent document contains material that is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or patent disclosure as it appears in the Patent and Trademark Office, patent file or records, but otherwise reserves all copyright rights whatsoever.
The present disclosure is generally related to touchscreen features on electronic computing devices, such as smartphones, that assist a user in viewing and editing a document.
The advent of touchscreens has made the user experience on electronic computing devices, such as on mobile and GPS devices, much more closely integrated to human experience. This is as opposed to the user experience being a purely digital and electronic machine-driven experience. One of the main ways touch screens do this humanization is through the use of fingertip controls rather than mouse or mouse pad controls. Specifically, related to the present disclosure, is the common non-digital experience of using one's fingers to occasionally point to the text in a hardback or paperback book. The advent of prior art systems that allow the use of human fingers to replace mouse actions on touchscreens has provided a major leap forward in this closer-to-reality experience.
However, in many ways, prior art touch controls for highlighting text remain unnatural to normal human functioning. For example, when placing a finger over text in a non-digital situation, such as when reading a paperback or hardback book, the text will be blocked and thus hidden by the finger. So the user will typically point just “below” the text they are reading in a paperback or hardback book.
However, rather than mimicking the way the finger is used for this type of non-digital reading, prior art touchscreens displayed on electronic computing devices commonly employ the appearance of a miniature window above the text and above where the finger is touching to show the text the finger is hiding (e.g. see
This is unnatural because without the finger over that portion of text, the user can see the entire continuous visual display of text. However, with the finger over that portion of text, the continuity of the visual display is disrupted by the finger and by the miniature window that appears containing the blocked text. Visual perception is an ongoing process involving selecting, grouping, and interpreting visual information. Because the window containing the blocked text is typically very small, the user has to observe text that often has just portions of words in it, making it even more unnatural for the user's visual cortex to process.
A much more natural and native system to the way the human visual cortex reads and processes text is to employ the user's finger to point to the text in the same manner the user would point to text in a non-digital medium. As described, this more natural pointing method is typically accomplished by having the user's finger point just below the text being viewed.
The present disclosure describes such a digital pointing method whereby the text above (or, in some instances, below or to the side depending upon the preference selected) may be highlighted. This solves the disruption of visual continuity caused by prior art pointing methods for touchscreens. Although the various embodiments of the present disclosure pertain to improving the visibility of selected text, it may also include images and other screen elements in addition to text.
Also described in this disclosure is a control for regulating the distance the pointer (e.g. user's finger) may be from the highlighted text. (The text highlighted will more commonly appear above the user's finger). This distance control may be very helpful, for example, for users with very large fingers. These users may need more space between their finger and the text their finger is highlighting or reading than a user with much smaller fingers. This is because larger fingers may have a greater tendency to cover up more text than smaller fingers.
Also described in this disclosure is a method of creating a bounding box and/or highlighting user selected text without impeding the visibility of the selected text. If the selected text is within an editable document (e.g. a Microsoft® Word document), then a cursor is displayed that enables a user to edit the selected text (e.g. cut, paste, add, delete, etc.).
Also described in the present disclosure is a feature that automatically creates a margin if the page does not natively contain a margin. This margin, for example at the bottom of a page of text, would be created if there were no space for the user's finger at the bottom of a touchscreen to highlight the text just above it. According to another user preference control, the margin may or may not disappear after the reader is no longer touching the screen at that point.
The above and other features, aspects, and advantages of the present disclosure will become better understood with regard to the following description, appended claims, and accompanying drawings where:
Various embodiments of the presently disclosed subject matter may include or be embodied in the form of computer-implemented methods or processes and apparatuses or electronic computing devices for practicing those methods or processes; and, in the form of a computer program product having computer program code containing instructions embodied in non-transitory and/or tangible media, such as floppy diskettes, CD-ROMs, hard drives, USB (universal serial bus) drives, or any other machine readable storage medium, wherein, when the computer program code is loaded into and executed by a computer, the computer becomes an apparatus for practicing embodiments of the disclosed subject matter. As such, a computing device operates as a machine and the inner workings of that machine are determined by instructions executed by a processing unit, hardware switches and/or a combination of both.
The various embodiments of the present disclosure may also be in the form of computer program code, for example, whether stored in a storage medium, loaded into and/or executed by a computer, or transmitted over some transmission medium, such as over electrical wiring or cabling, through fiber optics, or via electromagnetic radiation, wherein when the computer program code is loaded into and executed by a computer the computer becomes an apparatus for practicing embodiments of the disclosed subject matter. When implemented on a general-purpose microprocessor, the computer program code segments configure the microprocessor to create specific logic circuits. In some configurations, a set of computer-readable instructions stored on a computer-readable storage medium may be implemented by a general-purpose processor, which may transform the general-purpose processor or a device containing the general-purpose processor into a special-purpose device configured to implement or carry out the instructions.
And, the various embodiments may be implemented using hardware that may include a processor, such as a general purpose microprocessor and/or an Application Specific Integrated Circuit (ASIC) that embodies all or part of the techniques according to embodiments of the disclosed subject matter in hardware and/or firmware. The processor may be coupled to memory, such as RAM, ROM, flash memory, a hard disk or any other device capable of storing electronic information. The memory may store instructions adapted to be executed by the processor to perform the techniques according to embodiments of the disclosed subject matter.
Various embodiments may also be implemented as a state-machine comprised of software, hardware (such as electronic, mechanical or electromechanical switches) or a combination of both, and include one or more inputs and one or more outputs, wherein actuation of the inputs result in a particular output. The inputs may be interfaced to a variety of elements such as buttons, other hardware/software components, touch screens or other input devices and the outputs likewise may be interfaced to a variety of elements such as displays, buzzers, other hardware/software components, LEDs, etc.
The processor 112 together with a suitable operating system may operate to execute instructions in the form of computer code and produce and use data. By way of example and not by way of limitation, the operating system may be Windows-based, Mac-based, OSX, ANDROID, or Unix or Linux-based, among other suitable operating systems. Operating systems are generally well known and will not be described in further detail here.
Memory 114 encompasses one or more storage mediums and generally provides a place to store computer code (e.g., software and/or firmware) and data that are used by the device 10. The memory 114 may comprise, for example, electronic, optical, magnetic, or any other storage or transmission device capable of providing the processor 112 with program instructions. Memory 114 may further include a floppy disk, CD-ROM, DVD, magnetic disk, memory chip, ASIC, FPGA, EEPROM, EPROM, flash memory, optical media, or any other suitable memory from which processor 112 can read instructions in computer programming languages.
Memory 114 may include various other tangible, non-transitory computer-readable media including Read-Only Memory (ROM) and/or Random-Access Memory (RAM). As is well known in the art, ROM acts to transfer data and instructions uni-directionally to the processor 112, and RAM is used typically to transfer data and instructions in a bi-directional manner. In the various embodiments disclosed herein, various components of the memory 114 may include computer program instructions that when executed by the processor 112 cause the processor 112 to, among other things, recognize certain actions or status changes, such as Touch Event Modules (e.g. Finger Control Window), such as pointer contact events on a touchscreen 12 of the computing device 10.
Processor 112 is generally coupled to a variety of interfaces such as graphics control (e.g. graphical processing unit (GPU)), video interface, audio interface, input interface (e.g. touchscreen data input and/or keypad), and other interfaces, such as camera hardware and software components housed within and/or connected to device 10 for recording and transmitting content. Processor 112 may also be coupled to a network interface that allows the processor to be coupled to another computer or telecommunications network (e.g., internet). More particularly, the network interface generally allows processor 112 to receive information from and to output information to the network in the course of performing various method steps described in the embodiments herein.
In particular, device 10 includes a video adapter, which is an input/output adapter specially designed for graphic output to touchscreen 12. The video interface-graphics adapter may be connected to processor 112 through a high-speed video bus, a bus adapter, and the front side bus, which is also a high speed bus. Additionally, touchscreen 12 may comprises a display screen, such as a Liquid Crystal Display (LCD), that may display a virtual keyboard, roller, and/or four touch arrows, and that includes a touchscreen adapter for translating touches to the screen to commands. The term “touchscreen”, as used herein, is an electronic visual display that can detect the presence and location of a touch (e.g. pointer contact) within the display area and generate signals that identify the type and location of the touching activity. The term generally refers to touching the display of the device with a finger or stylus to enable a user to interact directly with what is displayed.
Device 10 may further have installed within the device's memory, computer instructions for executing the various embodiments of the disclosure (e.g. Finger Control Window display) comprising a native application, a web application, or a widget type application to carry out the methods of the embodiments disclosed herein. In a preferred embodiment, a native application (e.g. computer program product) is installed on the device, wherein it is either pre-installed on the device or it is downloaded from the Internet and activated, such as with a code generated by the system server as a non-limiting example. The native application may be written in a language to run on a variety of different types of devices; or it may be written in a device-specific computer programming language for a specific type of device.
In some embodiments, a web application may reside on a remote server accessed via a network. It may perform basically all the same tasks as a native application, and is usually downloaded in whole or in part to the end user's device 10 for local processing once until deleted, periodically or each time it is used. The web application software can be written as Web pages in HTML and CSS or other language serving the same purpose, with the interactive parts in JavaScript or other language. Or the web application may comprise a widget as a packaged/downloadable/installable web application; making it more like a traditional application than a web application; but like a web application uses HTML/CSS/JavaScript and access to the Internet. And/or device 10 may include a web browser running applications (e.g. Java applets or other like applications), comprising application programming interfaces (“APIs”) to other software applications running on remote servers that provide, for example, cloud based services and comment posting.
The user may setup their preferences, as disclosed in the flowchart depicting various computer actions in
As per the exemplary flowchart of computer actions that may be included in one or more embodiments and as shown in
An exemplification of the touchscreen is shown in
Options for the distance may also be displayed on the device touchscreen. For example, a matrix listing distances by different units of measurement may be shown as per
In alternative embodiments, other user input mechanisms for a user to designate the distance are envisioned within the present disclosure, such as the user inputting the distance and units on a virtual keypad or physical keyboard.
In the absence of the user designating a direction relative to the text 90 and a distance from the text 92, the device 10 will default to its settings.
The present disclosure comprises various embodiments for assisting a user in viewing legible text on a digital touchscreen of an electronic computing device, such as creating a bounding box that permits a user to edit the text, zoom in or enlarge the text and/or to highlight the text.
Bounding Box:
If the user is holding their position, then the device displays a bounding box 120 around the selected text 132 (the word(s) that lie the pre-designated distance and direction from the user's pointer) (step 350). In one embodiment, the length of the bounding box is pre-set or designated, and may be a function of the size of the screen. The bounding box of the present disclosure may comprise any border that partially or fully encloses the selected text temporarily. (For example, the bounding box 140 illustrated in
In step 350, in addition to the bounding box 140, a control box 150 may appear (see
Additionally after the bounding box appears in step 350, the device will determine in step 370 if the selected text is a document that may be edited—such as a Microsoft® Word document, a rich text format document, a plain text document, etc. If it is editable, then in step 370 the device 10 displays a cursor or other user input mechanisms to assist in directing the device and its user in how to edit the document (e.g. cut, paste, delete, add to the selected text).
Highlighting:
The device 10 highlights the selected text when either: the user selects the “Highlight” display element from the control box 150, or the user slides their pointer along the text (step 360). In either case and as illustrated in
Bounding Box:
Highlighting:
If the user selects the “Highlight” key from the control box 150 in
The Highlight control box 160 may comprise a plurality of functions, such as those shown in
In some embodiments of the disclosure, if the device 10 detects that the user's selected text 100 is tangent to, or lies along the border of, the touchscreen (i.e. far left, right, top or bottom of the screen), then it will create a margin of sufficient size to accommodate the user's pointer. This feature is particularly useful when the user wishes that device 10 detects the user's touch input for any text that may be adjacent to any left, right, top or bottom text border (see controls in
As shown in the computer flowchart of
If so, then device 10 displays a margin on the border of the touchscreen most closely aligned with the selected text, or alternatively around the entire border of the touchscreen (step 420). The margin may also be permanent (e.g. as long as the user is reading from the same document, each page of the document will have the border), or the margin may be temporary such that it disappears along with the bounding box and/or highlighting of the selected text, for example when the user's moves their pointer. The margin is also of sufficient width to accommodate the user's pointer.
By way of comparison,
The space for the bottom margin comes from the top line of text (see
As non-limiting examples, possible user actions causing the margin(s) to disappear and return to the state prior to the margin-generating actions described in
A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made. For example, elements of one or more implementations may be combined, deleted, modified, or supplemented to form further implementations. As yet another example, the logic flows depicted in the figures do not require the particular order shown, or sequential order, to achieve desirable results. In addition, other steps may be provided, or steps may be eliminated, from the described flows, and other components may be added to, or removed from, the described systems. Accordingly, other implementations are within the scope of the following claims.
This is a utility patent application being filed in the United States as a non-provisional application for patent under Title 35 U.S.C. §100 et seq. and 37 C.F.R. §1.53(b) and, claiming the priority under 35 U.S.C. §119(e) to the provisional application for patent filed in the United States on Jan. 29, 2014, bearing the title of “Computer System and Method to View and Edit Documents from an Electronic Computing Device Touchscreen”, and assigned application Ser. No. 61/932,783, which is hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
61932783 | Jan 2014 | US |