Patent Application
20150058801
The subject matter disclosed herein relates to computer system user interfaces, and more particularly, to an inspection tool for a multi-touch computer system.
When viewing a large quantity of data on a chart, varying levels of granularity may be desired. Identifying trends in data can be performed with respect to different time scales. For example, data samples collected one or more times per second can accumulate over hours, days, weeks, months, and years. Patterns may not be discernible when the data is viewed on an hourly basis but can become apparent when viewed over the course of multiple months. Other trends may appear as a pattern at a certain time of day or day of the week. Data analysts may also desire to zoom in to look at data values surrounding particular events, as well as add or remove signals under analysis to assist in determining causal relationships.
Computer mouse-based tools for viewing data charts and trends may include zoom controls to change scaling in conjunction with keyboard-based data entry. A combination of mouse clicks and typing in specific desired numerical ranges can be used to customize granularity for viewing data; however, this is typically a slow and cumbersome process. In touch-based user interfaces, a pinch-zoom gesture is often used to zoom in and out. Pinch-zoom gestures can be effective for rescaling a particular view but do not typically provide the desired level of precision for trend analysis.
One aspect of the invention is a system for providing a multi-touch inspection tool. The system includes a multi-touch display and processing circuitry coupled to the multi-touch display. The processing circuitry is configured to display an inspection tool for a chart on a user interface on the multi-touch display. The inspection tool includes a multiplier-scale control and a precision control. The processing circuitry is also configured to determine a base level of scaling to apply to the chart based on a current value of the multiplier-scale control. The multiplier-scale control defines steps between multiplier-scaling values. The processing circuitry is further configured to detect a touch-based input on the precision control for a precision adjustment of the chart. The precision adjustment is based on linear steps dynamically defined with respect to the base level of scaling. The chart is adjusted in response to the touch-based input on the precision control as a combination of the base level of scaling determined by the multiplier-scale control and the precision adjustment of the precision control.
Another aspect of the invention is a method for providing a multi-touch inspection tool. The method includes displaying an inspection tool for a chart on a user interface on a multi-touch display. The inspection tool includes a multiplier-scale control and a precision control. The method also includes determining, by processing circuitry coupled to the multi-touch display, a base level of scaling to apply to the chart based on a current value of the multiplier-scale control. The multiplier-scale control defines steps between multiplier-scaling values. The method further includes detecting, by the processing circuitry, a touch-based input on the precision control for a precision adjustment of the chart. The precision adjustment is based on linear steps dynamically defined with respect to the base level of scaling. The method additionally includes adjusting the chart, by the processing circuitry, in response to the touch-based input on the precision control as a combination of the base level of scaling determined by the multiplier-scale control and the precision adjustment of the precision control.
Another aspect of the invention is a computer program product for providing a multi-touch inspection tool. The computer program product includes a non-transitory computer readable medium storing instructions for causing processing circuitry coupled to a multi-touch display to implement a method. The method includes displaying an inspection tool for a chart on a user interface on the multi-touch display. The inspection tool includes a multiplier-scale control and a precision control. A base level of scaling to apply to the chart is determined based on a current value of the multiplier-scale control. The multiplier-scale control defines steps between multiplier-scaling values. A touch-based input is detected on the precision control for a precision adjustment of the chart. The precision adjustment is based on linear steps dynamically defined with respect to the base level of scaling. The chart is adjusted in response to the touch-based input on the precision control as a combination of the base level of scaling determined by the multiplier-scale control and the precision adjustment of the precision control.
These and other advantages and features will become more apparent from the following description taken in conjunction with the drawings.
The subject matter, which is regarded as the invention, is particularly pointed out and distinctly claimed in the claims at the conclusion of the specification. The foregoing and other features, and advantages of the invention are apparent from the following detailed description taken in conjunction with the accompanying drawings in which:
The detailed description explains embodiments of the invention, together with advantages and features, by way of example with reference to the drawings.
Exemplary embodiments provide an inspection tool for a multi-touch display. The inspection tool is configured to provide a base level of scaling defined by multiplier steps and precision adjustments as linear steps dynamically defined with respect to the base level of scaling. The inspection tool is configured to detect scaling change requests as touch-based gestures or movements. The inspection tool is sized such that multiplier-scaling values and precision adjustment requests can be provided by separate fingers of a same user hand without typing in specific numerical values for scaling adjustments. Accordingly, a user may perform rescaling by multiplier factors in combination with precise linear adjustments on the inspection tool at about the same time by making a combination of gestures using the same hand.
In exemplary embodiments, in terms of hardware architecture, as shown in
The processing circuitry 105 is hardware for executing software, particularly software stored in memory 110. The processing circuitry 105 can include any custom made or commercially available processor, a central processing unit (CPU), an auxiliary processor among several processors associated with the processing system 101, a semiconductor based microprocessor (in the form of a microchip or chip set), a macroprocessor, or generally any device for executing software instructions.
The memory 110 can include any one or combination of volatile memory elements (e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, etc.)) and nonvolatile memory elements (e.g., ROM, erasable programmable read only memory (EPROM), electronically erasable programmable read only memory (EEPROM), flash memory, memory card, programmable read only memory (PROM), tape, compact disc read only memory (CD-ROM), digital versatile disc (DVD), disk, diskette, cartridge, cassette or the like, etc.). Moreover, the memory 110 may incorporate electronic, magnetic, optical, and/or other types of storage media. The memory 110 can have a distributed architecture, where various components are situated remote from one another but can be accessed by the processing circuitry 105.
Software in memory 110 may include one or more separate programs, each of which includes an ordered listing of executable instructions for implementing logical functions. In the example of
The inspection tool 102 may be implemented in the form of a source program, executable program (object code), script, or any other entity comprising a set of instructions to be performed. When a source program, then the program may be translated via a compiler, assembler, interpreter, or the like, which may or may not be included within the memory 110, so as to operate properly in conjunction with the chart viewer 104, the OS 111 and/or the applications 112. Furthermore, the inspection tool 102 can be written in an object oriented programming language, which has classes of data and methods, or a procedure programming language, which has routines, subroutines, and/or functions.
In exemplary embodiments, the input/output controller 135 receives touch-based inputs from the multi-touch display 126 as detected touches, gestures, and/or movements. The multi-touch display 126 can detect input from one finger 136, multiple fingers 137, a stylus 138, and/or other sources (not depicted). The multiple fingers 137 can include a thumb 139 in combination with another finger 141, such as an index finger, on a same user hand 143. Multiple inputs can be received contemporaneously or sequentially from one or more users. In one example, the multi-touch display 126 includes infrared (IR) sensing capabilities to detect touches, shapes, and/or scannable code labels.
Other output devices such as the I/O devices 140, 145 may include input or output devices, for example but not limited to a printer, a scanner, a microphone, speakers, a secondary display, and the like. The I/O devices 140, 145 may further include devices that communicate both inputs and outputs, for instance but not limited to, components of a wireless interface such as a network interface card (NIC) or modulator/demodulator (for accessing other files, devices, systems, or a network), a radio frequency (RF) or other transceiver, a telephonic interface, a bridge, a router, a mobile device, a portable memory storage device, and the like.
In exemplary embodiments, the system 100 can further include a network interface 160 for coupling to a network 114. The network 114 can be an IP-based network for communication between the processing system 101 and any external server, client and the like via a broadband connection. The network 114 transmits and receives data between the processing system 101 and external systems. In exemplary embodiments, network 114 can be a managed IP network administered by a service provider. The network 114 may be implemented in a wireless fashion, e.g., using wireless protocols and technologies, such as WiFi, WiMax, etc. The network 114 can also be a packet-switched network such as a local area network, wide area network, metropolitan area network, Internet network, or other similar type of network environment. The network 114 may be a fixed wireless network, a wireless local area network (LAN), a wireless wide area network (WAN), a personal area network (PAN), a virtual private network (VPN), intranet or other suitable network system and includes equipment for receiving and transmitting signals.
If the processing system 101 is a PC, workstation, intelligent device or the like, software in the memory 110 may further include a basic input output system (BIOS) (omitted for simplicity). The BIOS is a set of essential software routines that initialize and test hardware at startup, start the OS 111, and support the transfer of data among the hardware devices. The BIOS is stored in ROM so that the BIOS can be executed when the processing system 101 is activated.
When the processing system 101 is in operation, the processing circuitry 105 is configured to execute software stored within the memory 110, to communicate data to and from the memory 110, and to generally control operations of the processing system 101 pursuant to the software. The inspection tool 102, the chart viewer 104, the OS 111, and the applications 112 in whole or in part, but typically the latter, are read by the processing circuitry 105, perhaps buffered within the processing circuitry 105, and then executed.
When the systems and methods described herein are implemented in software, as is shown in
In the example of
The inspection tool 102 of
The dial control 304 is responsive to a dial turning gesture 308 that can be detected on the multi-touch display 126. Applying the dial turning gesture 308 to the dial control 304 in a clockwise or counter-clockwise direction results in a linear ratio change of the chart 202 of
The slider control 306 is responsive to a sliding gesture 312 that can be detected on the multi-touch display 126. Applying the sliding gesture 312 to the slider control 306 in an up-down motion results in a ratio change to the base level of scaling for the dial control 304. For example, if the chart 202 of
As can be seen in
The zoom control 300 may also provide relative zoom level feedback using, for instance, a temporary popup indication such as a tooltip 315. The tooltip 315 can appear for a brief period of time during and/or after scaling adjustments to inform the user of a current base level of scaling. The zoom control 300 may also include a value viewer 316 configured to display a data value associated with the current location 302 of the zoom control 300. Tapping the value viewer 316 can enable displaying of the data value associated with the current location 302. The zoom control 300 can also include a lock/unlock control 318 configured to prevent movement of the zoom control 300 when locked and to allow movement of the zoom control 300 when unlocked. A close command 320 can be included on the zoom control 300 to remove the zoom control 300 from the user interface 200 of
Similar to the zoom control 300 of
The process 1000 begins at block 1002 and transitions to block 1004. At block 1004, the processing circuitry 105 displays the inspection tool 102 of
At block 1006, the processing circuitry 105 determines a base level of scaling to apply to the chart 202 based on a current value of the multiplier-scale control 306, 906. The multiplier-scale control 306, 906 defines steps between multiplier-scaling values, such as the series of discrete steps 314 of
At block 1008, the processing circuitry 105 detects a touch-based input on the precision control 304, 904 for a precision adjustment of the chart 202. The precision adjustment is based on linear steps dynamically defined with respect to the base level of scaling.
At block 1010, the processing circuitry 105 adjusts the chart 202 in response to the touch-based input on the precision control 304, 904 as a combination of the base level of scaling determined by the multiplier-scale control 306, 906 and the precision adjustment of the precision control 304, 904. The process 1000 ends at block 1012.
The blocks of process 1000 need not be performed in the exact sequence as depicted in
Multiple instances of the process 1000 can operate in parallel such that multiple instances of the inspection tool 102 can be contemporaneously displayed including both the zoom control 300 and the pan control 900, where the processing circuitry 105 of
In exemplary embodiments, a technical effect is providing rescaling of a chart using an inspection tool on a multi-touch display. Supporting a multiplier-scale base level of scaling in combination with precision adjustment based on linear steps dynamically defined with respect to the base level of scaling enables rapid view modification when zooming or panning to identify trends and relationships between multiple signals displayed on a chart of a user interface. The signals can be, for example, related to operation of a power plant or other physical system. While the inspection tool is described relative to a chart of signals, the term “chart” as used herein can refer to any type of a graph, image, flowchart or any displayable data comprising at least two dimensions. For example, the inspection tool can be used on a map, an image viewer, or a graphical software development tool.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized including a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contains, or stores a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium as a non-transitory computer program product may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
Aspects are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which includes one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the Figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In exemplary embodiments, where the inspection tool 102 of
While the invention has been described in detail in connection with only a limited number of embodiments, it should be readily understood that the invention is not limited to such disclosed embodiments. Rather, modifications can incorporate any number of variations, alterations, substitutions or equivalent arrangements not heretofore described, but which are commensurate with the spirit and scope of the invention. Additionally, while various embodiments have been described, it is to be understood that aspects may include only some of the described embodiments. Accordingly, the invention is not to be seen as limited by the foregoing description, but is only limited by the scope of the appended claims.
