Patent Application
20080140306
This invention relates to the field of avionic controls and more specifically, to a voice recognition method and system for displaying charts and maps.
Pilots use maps and charts to help them navigate during flight. These maps and charts show the features of the airspace through which the pilot flies. For example, certain maps and charts are used for visual flying. These maps provide details about the terrain features such as rivers, lakes and the like, which the pilot can use to assist in navigation. Additionally, certain maps and charts are used for flying under instrument flight rules. Multiple maps and charts are needed when the aircraft is flying further than the coverage of a single map or chart. Therefore, the collection of maps and charts used for navigation can be extensive. Additionally, the pilot may need to search for the correct map or chart and then determine the aircraft's position relative to the map or chart. All of this activity can distract the pilot from other flying duties.
To help alleviate this problem, digital maps and charts have been developed. Digital maps and charts can be stored in a database and retrieved by the pilot when needed. The digital maps and charts can be displayed on a display unit in the aircraft. The use of digital maps and charts eliminates the need to carry a collection of heavy and bulky paper maps. However, the pilot may still rely on an interface in the cockpit to recall specific maps and charts. The pilot may also use an interface to enter commands to zoom in and out of a map, pan across a map, select or recall different maps. This results in the pilot spending time locating and manipulating digital maps that may distract from other flying duties.
In view of the foregoing, it is desirable to provide a system and method for displaying and controlling charts and maps that addresses one or more of the foregoing deficiencies or other deficiencies not implicitly or expressly described. Furthermore, other desirable factors and characteristics of the present invention will become apparent from the subsequent detailed description and the appended claims, taken in conjunction with the accompanying drawings and the foregoing technical field and background.
A method for requesting information for viewing on a display comprises a first step of receiving a voice recognition pattern. Next, a digitized speech request to display information is received. The digitized speech is converted to an interpreted command using the voice recognition pattern and the information is retrieved from a database using the interpreted command.
An aircraft information retrieval system comprises an audio panel operable to receive an analog voice signal representing a request for the display of graphical information and convert the analog voice signal to a digital voice signal. The system further comprises an audio processor coupled to the audio panel, the audio processor configured to receive the digital voice signal. The audio processor is further operable to determine an information request from the digital voice signal and retrieve the graphical information.
In another embodiment, a device for recognizing a request for display of a navigational map for an airplane comprises a database containing the navigational map. The device also comprises a remote audio processor configured to receive a digital voice request for display of the navigational map, to recognize the digital voice request as a request to retrieve the navigational map, and to retrieve the navigational map from the database
A more complete understanding of the present invention may be derived by referring to the detailed description and claims when considered in conjunction with the following figures, wherein like reference numbers refer to similar elements throughout the figures:
The following detailed description is merely illustrative in nature and is not intended to limit the invention or the application and uses of the invention. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the preceding technical field, background, brief summary or the following detailed description. While the following exemplary embodiment discusses the retrieval of maps and charts, the present invention can be used to retrieve any displayable information. The terms map and chart can be used interchangeably to mean displayable graphical information. Additionally, maps and charts can be referred to as graphical navigational information.
An exemplary voice activated map display system 100 is illustrated in
Audio panel 102 can be any device that can be used to provide speech signals to aircraft systems. The audio panel 102, in one exemplary embodiment, receives analog speech from, for example, a user speaking into headset 103 or similar device and converts the analog speech signal into digital speech signals using an analog to digital converter 105. In one exemplary embodiment, the audio panel 102 digitizes analog speech to allow the digital speech signals to be routed to various communication systems (not pictured). In an alternative embodiment, analog speech from a user can be digitized before presentation to the audio panel. For example, the headset 103 may digitize the user's speech. Thus, in this embodiment, the audio panel 102 can accept digitized signals. The speech input in this case would bypass the analog-to-digital converter 105.
Voice recognizer 104 receives digitized speech from, in an exemplary embodiment, audio panel 102, performs voice recognition of the digitized speech, and provides for the display and manipulation of maps and charts. Voice recognizer 104 is configured to execute voice recognition software to convert the vocalized instructions spoken by the pilots to interpreted commands useable to retrieve, in one exemplary embodiment, maps and charts from the database 106. While voice recognizer 104 is illustrated in
Because voice patterns differ among people, and because it is possible that different pilots could use the same aircraft, the voice recognition program by itself may have trouble in translating the digitized commands. For example, an airline could have pilots with different accents that fly the same aircraft at different times. The difference in the voice patterns of the pilots could be such that voice recognition would be difficult. To alleviate this potential problem and to increase the overall accuracy of the voice recognition software, the voice pattern of all potential users of an aircraft is preferably obtained and stored for use with the voice recognition software.
In one exemplary embodiment, the voice patterns of a user are obtained for use with the voice recognition software. In this exemplary embodiment, the audio panel 102 can include a memory device input 110 configured to receive a memory device 112 that stores the voice pattern of a pilot. The memory device 112 can be inserted into the memory device input 110 of the audio panel 102 and so that the stored voice pattern is provided to the voice recognition software executed, in one exemplary embodiment at the voice recognizer 104. In one exemplary embodiment, each user of the present invention prerecords their voice patterns onto memory devices 112 for use with the voice recognition software and inserts the memory device 112 into the memory device input 110 of an aircraft before flying the aircraft. In an alternative embodiment, all members of a flight crew can have their voice patterns placed on a single memory device 112, simplifying the downloading of voice patterns.
In one exemplary embodiment, the memory device input 110 is located on the audio panel 102, although any suitable location can be used. The memory devices 112 can be any memory such as a compact flash card, a smart media card, and the like. A voice pattern can be any information or data for use with voice recognition software. If an aircraft does not have a large number of different pilots, the voice pattern of all potential pilots can be recorded and stored in the aircraft with the voice recognition software and memory device 112 would not be needed.
A switch 116 can be optionally provided to allow a user to select a communication path. For example, in one exemplary embodiment, switch 116 can be in a first position, which sends the digitized voice from the audio panel 102 to the voice recognizer 104 for voice recognition, and, in a second position, which sends the digitized voice to other airplane systems, such as a UHF radio. In one exemplary embodiment, the switch 116 is located on the audio panel 102, although other suitable locations for switch 116 can be used. Switch 116, in one exemplary embodiment, is held down while the user speaks map and chart commands into the headset 103.
Once a proper map or chart is retrieved, the user of the system 100 can then manipulate the map using voice commands that can be converted into interpreted commands by the voice recognition program. Voice commands can be used to replace any map or chart operation a pilot can do manually. For example, the user might request that the map image be zoomed in or out in order to see more or less detail about an area. Additionally, the user may request that the map image be panned left, right, up and down to locate a specific area on the map.
The design of the system 100, as discussed above, is an exemplary embodiment of a system to convert analog speech to a computer usable form to retrieve and display maps and charts. The functionality of the individual components in
A flowchart, as shown in
Next, in optional step 204, a signal indicative of a request to voice recognize digitized speech is received, in one exemplary embodiment, at the voice recognizer 104. In one exemplary embodiment, the signal is produced by switch 116, although the signal can be generated in several different ways.
Next, in step 206, digitized speech is received, in one exemplary embodiment, at the voice recognizer 104. The digitized speech represents a spoken request for, in an exemplary embodiment, the display of a chart or a map.
In step 208, a speech recognition program, along with the voice pattern received in step 202, converts the digitized speech into an interpreted command for retrieval or manipulation of a map or a chart. In one exemplary embodiment, this can be done at the voice recognizer 104. In the event the digitized speech can not be converted into an interpreted command, the user would receive feedback indicating failure in recognizing the user's voice command.
In step 210, the commands generated in step 208 can be executed. The command can be a command to retrieve a chart or map, which results in the requested map or chart being retrieved from the map database 106. Additionally, the command can be a command to manipulate a displayed image which causes the manipulation of the displayed image on the display 108.
After retrieving the requested map or chart, the map image can be sent to a display 108 for use by the pilot or other flight crew member, in step 212. In step 214, the map can be manipulated via voice commands in order to allow the user to zoom in and out, pan left, right, up and down, page through multi-page maps and charts, and perform any other map or chart related function.
The exemplary embodiment or embodiments described herein are not intended to limit the scope, applicability, or configuration of the invention in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the described embodiment or embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope of the invention as set forth in the appended claims and the legal equivalents thereof.
