Patent Application
20090089705
Computers include displays that provide a limited space to show objects including documents, virtual environments and images. One way to show objects that are larger then the display of a computing device is to use scroll bars to navigate the object. For example, the scroll bars may be used to manipulate the object horizontally and vertically within the display. Manipulation of the object using the scroll bars, however, can be cumbersome and disorienting for a user.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
Objects that are larger than a computer's display are navigated by manipulating the display itself. Sensing devices that are associated with the display detect movement of the device and/or physical interaction with the display. When the movement and/or the physical interaction with the display is sensed, the display of the object is updated accordingly. For example, moving the display to the left may move the area of the object currently being displayed to the left, whereas pressing down on the device may cause the display to zoom the current area of the object being displayed.
Referring now to the drawings, in which like numerals represent like elements, various embodiment will be described. In particular,
Generally, program modules include routines, programs, components, data structures, and other types of structures that perform particular tasks or implement particular abstract data types. Other computer system configurations may also be used, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like. Distributed computing environments may also be used where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
Referring now to
A basic input/output system containing the basic routines that help to transfer information between elements within the computer, such as during startup, is stored in the ROM 10. The computer 100 further includes a mass storage device 14 for storing an operating system 16, a display manager 30, a navigation manager 32, and applications 24, which are described in greater detail below.
The mass storage device 14 is connected to the CPU 5 through a mass storage controller (not shown) connected to the bus 12. The mass storage device 14 and its associated computer-readable media provide non-volatile storage for the computer 100. Although the description of computer-readable media contained herein refers to a mass storage device, such as a hard disk or CD-ROM drive, the computer-readable media can be any available media that can be accessed by the computer 100.
By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, Erasable Programmable Read Only Memory (“EPROM”), Electrically Erasable Programmable Read Only Memory (“EEPROM”), flash memory or other solid state memory technology, CD-ROM, digital versatile disks (“DVD”), or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer 100.
According to various embodiments, computer 100 may operate in a networked environment using logical connections to remote computers through a network 18, such as the Internet. The computer 100 may connect to the network 18 through a network interface unit 20 connected to the bus 12. The network connection may be wireless and/or wired. The network interface unit 20 may also be utilized to connect to other types of networks and remote computer systems. The computer 100 may also include an input/output controller 22 for receiving and processing input from a number of other devices, including a keyboard, mouse, or electronic stylus (not shown in
As mentioned briefly above, a number of program modules and data files may be stored in the mass storage device 14 and RAM 9 of the computer 100, including an operating system 16 suitable for controlling the operation of a networked personal computer, such as the WINDOWS® VISTA® operating system from MICROSOFT® CORPORATION of Redmond, Wash. The operating system utilizes a display manager 30 that is configured to draw to the display 23 of the computing device 100. Generally, display manager 30 draws the pixels that are associated with one or more objects to display 23. Navigation manager 32 is configured to process and evaluate information received by sensing device(s) 34 and interact with display manager 30. While navigation manager 32 is shown within display manager 30, navigation manager 32 may be separated from display manager. The mass storage device 14 and RAM 9 may also store one or more program modules. In particular, the mass storage device 14 and the RAM 9 may store one or more motion integrated application programs 24 and legacy applications 25.
Generally, navigation manager 32 is configured to receive and evaluate sensing information from sensing devices 34 and instruct display manager 30 what portion of an object (or what object to select) to render on display 23 based on the sensed information when the device is in the navigation mode. For example, when the device is in navigation mode and navigation manager 32 senses that device 100 has been physically moved, then display of the object is adjusted accordingly within display 23. Similarly, when a sensing device detects pressure on the device, a zoom factor of the object may be adjusted and then the object displayed within display 23 according to the zoom factor.
The device may enter navigation mode either manually or automatically. For example, a user may explicitly enter the navigation mode by pressing and/or holding a button or performing some other action. The device may also automatically enter the navigation mode. For example, when a device detects physical movement while an object is being displayed the navigation mode may be entered. Other ways of automatically entering the navigation mode may also be used.
The object being displayed (such as object 25) may be any type of object that is displayable. The object may be a document, an image, a virtual environment or some other display item. For example, the object could be a large map, a word processing document, a picture and the like. By using the navigation mode to display an object such as a map, a user would not have to struggle with scroll bars or get confused about where on the map the user is viewing since displaying another portion of the map may be caused by moving the device in the direction the user wants to view.
To move more efficiently while in the navigation mode a multiplier and reducer may be attached to the movement based on the sensed information. For example, to view images much larger than the space that the physical display could comfortably be moved, a multiplier may be attached to the movement such that moving the display a small distance causes a greater amount of distance to be moved in the display. Similarly, a reducer may be attached to the movement such that moving the display a large distance does not cause the object to move off of the display. Additional details regarding the display manager and motion manager will be provided below.
Display manager 30 is configured to control the drawing of the display. Display manager 30 coordinates with navigation manager 32 in order to determine what object and/or portion of an object to display within display area 220. As discusses above, navigation manager 32 is configured to receive information from sensing devices, such as one or more cameras 212, a pressure sensing device, such as from sensor frame 210, GPS device 214, or some other sensing device 216 (i.e. an accelerometer) and evaluate the sensed information to determine how to navigate an object. This sensed information (navigation event) is used in determining what portion of an object to draw to a the display area 220 of display 23. According to another embodiment, the navigation event may cause a different object to be displayed within display area 220.
According to one embodiment, a pressure sensing device, such as sensor frame 210, is used to detect pressure. When a user presses on sensor frame 210, navigation manager 32 may interpret this pressure to indicate that the display of the object is to be zoomed. Zooming of the object may also be adjusted based on the Z position of the device. For example, when the device is lifted along the Z-axis the zooming of the object may be decreased.
Alternatively, a pressure that is applied in a particular area of sensor frame 210 may be interpreted to pan/tilt the object in the direction of the pressure. According to another embodiment, the pressure may be used to advance/decrement the display within a set of images. For example, pressing on the right hand side of the sensor frame 210 on a digital camera may advance to the next stored picture, whereas pressing on the left side of sensor frame 210 may move to the previous picture. Similarly, tilting the camera to the right or left (or some other movement) may cause the image to advance to the next stored picture or move to the previous picture.
Movement of the device/display itself is also used to adjust the display of the object within display area 220. For example, when a camera 212 senses movement, or when some other sensor that is associated with the display and/or computing device detects movement (e.g. GPS 214) of the device, navigation manager 32 adjusts the display of the object in proportion to the amount of movement. For example, moving the display to the left exposes a portion of the object that is left of the display area 220.
According to one embodiment, a multiplier factor may be applied to the sensed information such that the movement of the display of the object is increased by some multiplier. For example, a 5× factor may be applied such that it takes a smaller amount of physical movement of the device to manipulate the display of the object within display area 220. This multiplier factor may be set manually and/or automatically entered. For example, a multiplier factor may be based on the size of an object. When the object is larger, then the multiplier factor is increased and when the object is smaller, then the multiplier is decreased. Similarly, the multiplier factor may be adjusted based on the density of the data within the object. When the data is dense, then the multiplier remains low, when the data is sparse then the multiplier increases. As discussed above, a reducer may also be applied.
Initially, when device 305 is located at position 340, display 315 shows area 320 within object 310. When device is moved from position 340 to position 350, area 330 of object 310 is displayed within display 315 of the device. The dashed boxes indicate a potential movement pattern and display while moving device 305 from position 340 to position 350. While the amount of movement of the device correlates directly to the change in the area being displayed of the object in the current example, the correlation between the movement and the display may not be directly proportional. For example, as discussed above, a smaller amount of device movement may result in a greater area being navigated within object 310 or a larger amount of device movement may result in the movement being reduced by a predetermined amount. For instance, if a user moved the device down and to the right beyond object 310, then area 340 may be displayed rather then moving beyond the end of the image.
In the present example, which is for illustrative purposes only and is not intended to be limiting, when camera 410 senses movement along camera 410 plane of detection the area shown within the object moves horizontally along object 430. For example, if the current area being displayed is Area 2 and camera 410 senses movement of device 20 to the right, then Area 3 may be shown within the display. Similarly if camera 420 senses movement along camera 420 plane of detection the movement is vertical within object 430. For example, if the current area being displayed is Area 2 and the movement is vertically down then Area 5 or Area 8 may be displayed depending on the movement. While object 430 is shown in discrete areas, the area shown within the display is not so limited. For example, a movement, may show part of multiple areas (as illustrated by window 440) of object 430.
Referring now to
When reading the discussion of the routines presented herein, it should be appreciated that the logical operations of various embodiments are implemented (1) as a sequence of computer implemented acts or program modules running on a computing system and/or (2) as interconnected machine logic circuits or circuit modules within the computing system. The implementation is a matter of choice dependent on the performance requirements of the computing system implementing the invention. Accordingly, the logical operations illustrated and making up the embodiments described herein are referred to variously as operations, structural devices, acts or modules. These operations, structural devices, acts and modules may be implemented in software, in firmware, in special purpose digital logic, and any combination thereof.
Referring now to
Moving to operation 520, the navigation sensors are evaluated. For example, the navigation sensor information is received and determined what type of physical interaction with the device and/or movement of the device has occurred.
Flowing to operation 530, the area to display is determined. According to one embodiment, the area to display is an area within an object that is larger then the display. According to another embodiment, the area may be another object. For example, the area may be another image (such as in the digital camera example described above).
Moving to operation 540, the new view is displayed within the display. The process the moves to an end block.
The above specification, examples and data provide a complete description of the manufacture and use of the composition of the invention. Since many embodiments of the invention can be made without departing from the spirit and scope of the invention, the invention resides in the claims hereinafter appended.
