The present invention generally relates to aircraft display systems, and more particularly relates to avionics touchscreen systems.
Various types of avionics equipment are being upgraded in the aircraft cockpit of older aircraft. As an example, multi-function control and display units (MCDUs), which interface with flight deck equipment such as the flight management system on the aircraft, are being replaced by touchscreen systems for displaying flight data to the flight crew. Often data needs to be copied from one location on the touchscreen and pasted into another location.
Hence, it is desirable to provide systems and methods for providing a clipboard cut and paste operation in an avionics touchscreen system. Furthermore, other desirable features and characteristics of the present invention will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and the foregoing technical field and background.
This summary is provided to describe select concepts in a simplified form that are further described in the Detailed Description. This summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
A keyboard module configured for use in an avionics touchscreen system is disclosed. The keyboard module is configured to display, via a visual display in an avionics touchscreen system and responsive to a selection of an application program generated widget for focus via a touchscreen surface in the avionics touchscreen system, a virtual keyboard. The virtual keyboard includes a text box widget configured to display clip data stored in clipboard memory provided by the avionics touchscreen system, a copy widget configured to cause data in a first widget provided by the application program that is in focus to be copied to the clipboard memory, and a paste widget configured to cause the clip data in the clipboard memory and displayed in the text box widget to be pasted to a second widget provided by the application program that is in focus.
An avionics touchscreen system is disclosed. The avionics touchscreen system is configured for use in an aircraft cockpit and comprises a touchscreen surface layered over a visual display and one or more processors configured by programming instructions encoded in non-transient computer readable media. The avionics touchscreen system is configured to receive aircraft flight data via an aircraft data transfer system, display the flight data from an executing avionics application on the visual display, receive the selection of a widget for focus via the touchscreen surface, and display a virtual keyboard on the visual display responsive to the selection of the widget wherein the virtual keyboard includes a clipboard widget on the visual display that is configured to display clip data stored in clip data memory.
Furthermore, other desirable features and characteristics will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and the preceding background.
The present invention will hereinafter be described in conjunction with the following drawing figures, wherein like numerals denote like elements, and wherein:
The following detailed description is merely exemplary in nature and is not intended to limit the application and uses. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, summary, or the following detailed description. As used herein, the term “module” refers to any hardware, software, firmware, electronic control component, processing logic, and/or processor device, individually or in any combination, including without limitation: application specific integrated circuit (ASIC), a field-programmable gate-array (FPGA), an electronic circuit, a processor (shared, dedicated, or group) and memory that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
Embodiments of the present disclosure may be described herein in terms of functional and/or logical block components and various processing steps. It should be appreciated that such block components may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions. For example, an embodiment of the present disclosure may employ various integrated circuit components, e.g., memory elements, digital signal processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices. In addition, those skilled in the art will appreciate that embodiments of the present disclosure may be practiced in conjunction with any number of systems, and that the systems described herein is merely exemplary embodiments of the present disclosure.
For the sake of brevity, conventional techniques related to signal processing, data transmission, signaling, control, touchscreens, and other functional aspects of the systems (and the individual operating components of the systems) may not be described in detail herein. Furthermore, the connecting lines shown in the various figures contained herein are intended to represent example functional relationships and/or physical couplings between the various elements. It should be noted that many alternative or additional functional relationships or physical connections may be present in an embodiment of the present disclosure.
The example touchscreen system 102 includes a touchscreen device 110 and a touchscreen controller 112. The example touchscreen device 110 includes a touchscreen surface layered over a visual display. The touchscreen surface is configured to receive user input through single-touch or multi-touch gestures. The visual display is configured to display a graphical user interface (GUI) generated by the controller 112 during the execution of an application program. The GUI may provide one or more widgets 114 for display that may allow for displaying, entering and/or editing data.
The example controller 112 includes at least one processor and a computer-readable storage device or media. The processor may be any custom-made or commercially available processor, a central processing unit (CPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), an auxiliary processor among several processors associated with the controller 112, a semiconductor-based microprocessor (in the form of a microchip or chip set), any combination thereof, or generally any device for executing instructions. The computer readable storage device or media may include volatile and nonvolatile storage in read-only memory (ROM), random-access memory (RAM), and keep-alive memory (KAM), for example. KAM is a persistent or non-volatile memory that may be used to store various operating variables while the processor is powered down. The computer-readable storage device or media may be implemented using any of a number of known memory devices such as PROMs (programmable read-only memory), EPROMs (electrically PROM), EEPROMs (electrically erasable PROM), flash memory, or any other electric, magnetic, optical, or combination memory devices capable of storing data, some of which represent executable instructions, used by the controller 112. The processors and memory of the example controller 112 are configured by the executable programming instructions to provide one or more executable applications programs 116. The example application programs 116 when executing may cause the generation of a GUI containing widgets 114 and other graphical elements on the display of the touchscreen device 110.
The processors and memory of the example controller 112 are also configured by programming instructions to provide a keyboard module 118. The keyboard module 118 when enabled is configured to cause the generation and display of a virtual keyboard on the visual display of the touchscreen device 110. The virtual keyboard may be displayed as an overlay over a GUI displayed on the visual display. The virtual keyboard may be enabled in response to the selection of a widget 114. A widget 114 may be selected or put in focus by a touch gesture on the touchscreen surface of the touchscreen device 110.
The example touchscreen controller 112 may be configured by programming instructions encoded on non-transient computer readable media 120 and loaded into local memory in the controller 112. The local memory in the controller 112 may also include clipboard memory into which data may copied for use, among other things, in transferring the data from one widget to another.
The example touchscreen system 102 also includes an avionics interface 122 for interfacing the touchscreen system 102 to flight deck systems 106 in the aircraft. The example avionics interface 122 is configured to couple to and interface with an ARINC Specification 429, digital information transfer system (DITS). In other examples, the avionics interface 122 may be configured to communicate with the flight deck systems 106 via other aircraft data transfer systems such as an ARINC 661 system, a wireless data transfer system, a proprietary aircraft data transfer system or some other standard or non-standard aircraft data transfer system.
Through the use of the letter and number keys module 502, the textbox widget module 504, the copy widget module 506, the paste widget module 508, and the control module 510, the example keyboard module 500 is configured to display, via a visual display in the avionics touchscreen system and responsive to a selection of an application program generated widget for focus via a touchscreen surface in the avionics touchscreen system, a virtual keyboard wherein the virtual keyboard includes a text box widget configured to display clip data stored in clipboard memory provided by the avionics touchscreen system, a copy widget configured to cause data in a first widget provided by the application program that is in focus to be copied to the clipboard memory, and a paste widget configured to cause the clip data in the clipboard memory and displayed in the text box widget to be pasted to a second widget provided by the application program that is in focus.
The example keyboard module 500 is configured to copy data from the first widget to both the clipboard memory and the text box widget when the copy widget is engaged via a touch gesture. The example keyboard module 500 is configured to receive changes to the clip data displayed in the text box widget responsive to touch gestures with the virtual keyboard and update the clip data stored in the clipboard memory and displayed in the text box widget with the changes to the clip data. The example keyboard module 500 is configured to paste the clip data stored in the clipboard memory and displayed in the text box widget to the second widget when the paste widget is engaged via a touch gesture. The first widget and the second widget may be different widgets and no more than one of the first widget and the second widget may be in focus at a time. The text box widget, the paste widget, and the copy widget may be positioned in a row above all other keys or widgets in the virtual keyboard.
The example process 600 includes displaying a graphical user interface (GUI) from an avionics application on an avionics touchscreen display (operation 602). Displaying the GUI may involve receiving aircraft flight data via a standard or non-standard aircraft interface (operation 604) and display the aircraft flight data via the GUI.
The example process 600 further includes receiving the selection of a first widget for focus via the avionics touchscreen (operation 608). Responsive to the selection of the first widget, the example process 600 includes displaying a virtual keyboard on the avionics touchscreen (operation 610). Displaying a virtual keyboard on the avionics touchscreen may include overlaying a virtual keyboard over the application GUI (operation 612) wherein the virtual keyboard includes a clipboard widget, a copy widget, and a paste widget (operation 614).
The example process 600 further includes receiving the selection of a copy widget via the avionics touchscreen (operation 616). The copy widget may be selected by a touch gesture on a touchscreen surface of the avionics touchscreen. Responsive to receiving the selection of the copy widget, the example process 600 includes copying data from the first widget to clip data memory (operation 618) and displaying the contents of the clip data memory (i.e., the clip data) using the clipboard widget on the avionics touchscreen (operation 620).
The example process 600 further includes receiving, via the keyboard displayed on the avionics touchscreen, changes to the clip data displayed in the clipboard widget (operation 622). The selection of a paste widget via the avionics touchscreen (e.g., by a touch gesture) is received (operation 624). Responsive to the selection of the paste widget, the edited clip data displayed in the clipboard widget is pasted to a second widget that is in focus (operation 626).
Described herein are techniques for implementing a copy and paste function on a touchscreen system utilized in an aircraft cockpit to display flight data from flight deck equipment. The techniques can provide the flight crew with the ability to copy, modify and enter flight data to flight deck equipment while maintaining a visual display of the data being copied, modified, and entered to reduce the chances of error or flight crew overload.
In one embodiment, an avionics touchscreen system configured for use in an aircraft cockpit and configured to communicate with an aircraft flight deck equipment is disclosed. The touchscreen system comprises an aircraft data transfer system interface for connecting the avionics touchscreen system with flight deck equipment via an aircraft data transfer system, a touchscreen device comprising a touchscreen surface layered over a visual display wherein the touchscreen surface is configured to receive input through single-touch or multi-touch gestures, and a touchscreen controller comprising one or more processors configured by programming instructions encoded on non-transient computer readable media to execute one or more application programs configured to display data received over the aircraft data transfer system interface from the flight deck equipment on the visual display wherein the touchscreen controller further comprises memory media configured to provide clipboard memory for use with the one or more application programs. The touchscreen system further comprises a keyboard module configured by the touchscreen controller to display, via the visual display and responsive to a selection of a widget generated by the application program for focus via the touchscreen surface, a virtual keyboard wherein the virtual keyboard includes a text box widget configured to display clip data stored in the clipboard memory, a copy widget configured to cause data in a first widget that is in focus to be copied to the clipboard memory, and a paste widget configured to cause the clip data in the clipboard memory and displayed in the text box widget to be pasted to a second widget that is in focus.
These aspects and other embodiments may include one or more of the following features. The aircraft data transfer system may comprise a standard aircraft data transfer system. The keyboard module may be configured to copy data from the first widget to both the clipboard memory and the text box widget when the copy widget is engaged via a touch gesture. The keyboard module may be configured to receive changes to the clip data displayed in the text box widget responsive to touch gestures with the virtual keyboard and update the clip data stored in the clipboard memory and displayed in the text box widget with the changes to the clip data. The keyboard module may be configured to paste the clip data stored in the clipboard memory and displayed in the text box widget to the second widget when the paste widget is engaged via a touch gesture. The first widget and the second widget may be the same widget. The first widget and the second widget may be different widgets and no more than one of the first widget and the second widget may be in focus at a time. The text box widget, the paste widget, and the copy widget may be positioned in a row above all other widgets in the virtual keyboard.
In another embodiment disclosed is a keyboard module configured for use in an avionics touchscreen system coupled to flight deck equipment in an aircraft cockpit via an aircraft data transfer system connection. The keyboard module comprises one or more processors configured by programming instructions encoded in non-transient computer readable media. The keyboard module is configured to display, via a visual display in the avionics touchscreen system and responsive to a selection of an application program generated widget for focus via a touchscreen surface in the avionics touchscreen system, a virtual keyboard. The virtual keyboard includes a text box widget configured to display clip data stored in clipboard memory provided by the avionics touchscreen system, a copy widget configured to cause data in a first widget provided by the application program that is in focus to be copied to the clipboard memory, and a paste widget configured to cause the clip data in the clipboard memory and displayed in the text box widget to be pasted to a second widget provided by the application program that is in focus.
These aspects and other embodiments may include one or more of the following features. The keyboard module may be configured to copy data from the first widget to both the clipboard memory and the text box widget when the copy widget is engaged via a touch gesture. The keyboard module may be configured to receive changes to the clip data displayed in the text box widget responsive to touch gestures with the virtual keyboard and update the clip data stored in the clipboard memory and displayed in the text box widget with the changes to the clip data. The keyboard module may be configured to paste the clip data stored in the clipboard memory and displayed in the text box widget to the second widget when the paste widget is engaged via a touch gesture. The first widget and the second widget may be different widgets and no more than one of the first widget and the second widget may be in focus at a time.
In another embodiment disclosed is an avionics touchscreen system configured for use in an aircraft cockpit. The avionics touchscreen system comprises a touchscreen surface layered over a visual display and one or more processors configured by programming instructions encoded in non-transient computer readable media. The avionics touchscreen system is configured to receive aircraft flight data via an aircraft data transfer system, display the flight data from an executing avionics application on the visual display, receive the selection of a widget for focus via the touchscreen surface, and display a virtual keyboard on the visual display responsive to the selection of the widget wherein the virtual keyboard includes a clipboard widget on the visual display that is configured to display clip data stored in clip data memory.
These aspects and other embodiments may include one or more of the following features. The avionics touchscreen system may be further configured to display a copy widget on the visual display as part of the virtual keyboard and copy data from the widget that is in focus to both the clip data memory and the clipboard widget when the copy widget is engaged via a touch gesture. The avionics touchscreen may be further configured to receive the selection of a second widget for focus via a touch gesture sensed by the touchscreen surface and paste data from the clipboard widget to the second widget when a paste widget is engaged via a touch gesture. The avionics touchscreen system may be further configured to display a paste widget on the visual display as part of the virtual keyboard and paste data from the clipboard widget to the widget that is in focus when the paste widget is engaged via a touch gesture. The avionics touchscreen system may be further configured to receive, via the virtual keyboard, changes to the clip data displayed in the clipboard widget and enter the changed clip data to the clip data memory. The avionics touchscreen system may be further configured to paste data from the clipboard widget to the widget that is in focus when a paste widget is engaged via a touch gesture. The avionics touchscreen system may be further configured to receive the selection of a second widget for focus via a touch gesture sensed by the touchscreen surface and paste data from the clipboard widget to the second widget when a paste widget is engaged via a touch gesture.
Those of skill in the art will appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. Some of the embodiments and implementations are described above in terms of functional and/or logical block components (or modules) and various processing steps. However, it should be appreciated that such block components (or modules) may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention. For example, an embodiment of a system or a component may employ various integrated circuit components, e.g., memory elements, digital signal processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices. In addition, those skilled in the art will appreciate that embodiments described herein are merely exemplary implementations.
The various illustrative logical blocks, modules, and circuits described in connection with the embodiments disclosed herein may be implemented or performed with a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal
In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Numerical ordinals such as “first,” “second,” “third,” etc. simply denote different singles of a plurality and do not imply any order or sequence unless specifically defined by the claim language. The sequence of the text in any of the claims does not imply that process steps must be performed in a temporal or logical order according to such sequence unless it is specifically defined by the language of the claim. The process steps may be interchanged in any order without departing from the scope of the invention as long as such an interchange does not contradict the claim language and is not logically nonsensical.
Furthermore, depending on the context, words such as “connect” or “coupled to” used in describing a relationship between different elements do not imply that a direct physical connection must be made between these elements. For example, two elements may be connected to each other physically, electronically, logically, or in any other manner, through one or more additional elements.
While at least one exemplary embodiment has been presented in the foregoing detailed description of the invention, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or exemplary embodiments are only examples, and are not intended to limit the scope, applicability, or configuration of the invention in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing an exemplary embodiment of the invention. It being understood that various changes may be made in the function and arrangement of elements described in an exemplary embodiment without departing from the scope of the invention as set forth in the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
8832578 | Shah et al. | Sep 2014 | B1 |
8924858 | Mistry et al. | Dec 2014 | B2 |
9003283 | Xu | Apr 2015 | B2 |
9032319 | Hammack et al. | May 2015 | B1 |
9703476 | Pappas | Jul 2017 | B1 |
20070143382 | Luster | Jun 2007 | A1 |
20130120271 | Lee et al. | May 2013 | A1 |
20130191769 | Park et al. | Jul 2013 | A1 |
20140160049 | Shin | Jun 2014 | A1 |
20140285438 | Kawalkar | Sep 2014 | A1 |
Number | Date | Country |
---|---|---|
2012128548 | Sep 2012 | WO |