Patent Application
20070088467
1. Field of the Invention
The present invention relates generally to aviation systems, and particularly to a ground-based advisory system to provide real time assistance to pilots.
2. Technical Background
A pilot or aircrew may become task-saturated and stressed for a variety of reasons. Equipment malfunction, hazy and disorienting conditions, relative inexperience, and adverse weather conditions are some of the reasons that may cause pilot distress. Cockpit emergencies are usually not the result of a single isolated event, but come about because of a series of events and decisions that occur over an extended period of time. Some individuals react slowly and do not perform their tasks adequately when they find themselves in an emergency situation. They often fail to prioritize and neglect to do the most obvious things. As the stress increases, the pilot's effectiveness may decrease proportionately. A snow balling effect may occur as one bad decision follows another. The challenge for the pilot and/or aircrew is to react and make the proper decision in response to each event. However, when problems occur at a rapid rate, it may become difficult for the pilot and/or aircrew to react in an appropriate and timely manner. In other words, the pilot/aircrew become task saturated.
For example, it is well known that spatial disorientation resulting from Visual Flight Rules (VFR) flight into adverse weather conditions is a regular cause of fatal aircraft accidents. In another example, a night time descent over water in dark and hazy conditions also may result in spatial disorientation. In such cases, inexperienced pilots may not trust their instruments and decide to trust their instincts, often with fatal results. In yet another example, an experienced pilot and/or aircrew may be faced with an equipment malfunction that requires an emergency landing. These situations are particularly frequent when pilots are flying in a single pilot aircraft and do not have the assistance of a knowledgeable aviator to assist with the aircraft control tasks, navigation, communication, and other procedures required to safely land the aircraft.
On the other hand, a catastrophe may be averted if the pilot and/or aircrew has access to assistance from a ground-based advisor that is fully apprised of the challenges facing the aircraft. Accordingly, what is needed in each of these situations is a trained ground-based advisor that fully understands the aircraft's operational status and is in two-way communication with the crew. Referring to the first two examples provided above, a system is needed that would provide an advisor with the means to knowledgably talk the pilot through the proper procedures for executing a safe approach and landing. In the last example, a system is needed that would provide an advisor with the means to knowledgably direct the aircrew to a nearby airport or airfield. To put it more succinctly, what is needed is a real-time virtual co-piloting system that may be easily accessed by a pilot and/or aircrew to help them arrive safely at their destination. SUMMARY OF THE INVENTION
The present invention addresses the needs described above. The present invention is directed to a virtual co-pilot system that provides a pilot or aircrew with informed real-time assistance. The present invention provides a ground-based advisor with a full operational understanding of the aircraft's status, allowing the advisor to provide informed assistance to the crew by way of a two-way communication system.
One aspect of the present invention is directed to a virtual copilot system that includes a subscriber aircraft system configured to obtain at least one aircraft sensor parameter from the aircraft. The system also is configured to transmit an aircraft identifier and the at least one aircraft sensor parameter via a subscriber data link on a real-time basis. The aircraft system is further configured to provide two-way voice communications to an on-board user via a predetermined channel. A ground-based system includes a ground communications component configured to receive the aircraft identifier and the at least one aircraft sensor parameter from the subscriber data link. The ground communications component is also configured to provide voice communications to a ground-based user via the predetermined channel. A computer system is coupled to the ground communications component. The computer system is configured to integrate cockpit instrument panel display data corresponding to the subscriber aircraft and the at least one sensor parameter to obtain a real-time simulation of the subscriber aircraft instrument panel. At least one display is coupled to the computer system and configured to display the real-time simulation to the ground-based advisor.
In another embodiment, the present invention is directed to a method for providing assistance from a ground-based system to an aircrew disposed on a subscriber aircraft. The subscriber aircraft is equipped with an aircraft instrumentation panel. The method includes transmitting an aircraft identifier and at least one sensor parameter from the subscriber aircraft to the ground-based system on a real-time basis. Cockpit instrument panel data is provided to the ground-based system, the cockpit instrument panel data corresponding to the aircraft identifier. The cockpit instrument panel data and the at least one sensor parameter are integrated to obtain a real-time status of the subscriber aircraft instrumentation panel in real-time. The real-time status is displayed to a ground-based user. A two-way voice communication channel is established between the aircrew and the ground-based user, whereby the ground-based user provides co-piloting services to the aircrew via the two-way voice communication channel based on the displayed real-time status.
In yet another embodiment, the present invention is directed to a subscriber aircraft copiloting system that includes an aircraft systems interface configured to obtain aircraft sensor parameters from the aircraft. The sensor parameters include a subscriber aircraft position, a subscriber aircraft pitch attitude, a subscriber aircraft roll attitude, a subscriber aircraft airspeed, a subscriber aircraft altitude, and/or a subscriber aircraft heading. A data transmission facility is configured to transmit an aircraft identifier and the aircraft sensor parameters to a ground-based station on a real-time basis via a subscriber data link, wherein the subscriber data link transmits the aircraft sensor parameters at a 1 Hz rate. A voice communications system is configured to provide two-way voice communications between an on-board user and a ground-based user via a predetermined channel.
In yet another embodiment, the present invention is directed to a ground-based copiloting system that includes a ground-based communications system (GBCS) configured to receive an aircraft identifier and aircraft sensor parameters from a subscriber aircraft by way of a subscriber data link. The GBCS is also configured to provide voice communications between a ground-based user and a user aboard the subscriber aircraft via a predetermined channel. A computer system is coupled to the GBCS, the computer system being configured to integrate cockpit instrument panel display data corresponding to the subscriber aircraft and the aircraft sensor parameters to obtain a real-time representation of the subscriber aircraft instrument panel. At least one display is coupled to the computer system and configured to display the real-time representation to the ground-based user.
Additional features and advantages of the invention will be set forth in the detailed description which follows, and in part will be readily apparent to those skilled in the art from that description or recognized by practicing the invention as described herein, including the detailed description which follows, the claims, as well as the appended drawings.
It is to be understood that both the foregoing general description and the following detailed description are merely exemplary of the invention, and are intended to provide an overview or framework for understanding the nature and character of the invention as it is claimed. The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate various embodiments of the invention, and together with the description serve to explain the principles and operation of the invention.
Reference will now be made in detail to the present embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts. An exemplary embodiment of the system of the present invention is shown in
As embodied herein, and depicted in
It will be apparent to those of ordinary skill in the pertinent art that modifications and variations can be made to ACPS 20 of the present invention depending on the cost and sophistication of the on-board equipment package. For example, ACPS 20 may be configured to communicate with GBCS via HF/UHF/VHF analog radio, wireless/cellular telephony, air phone, digital radio, wi-fi, digital satellite radio, and/or any other wireless communication method. Those of ordinary skill in the art will understand that system 10 may employ any one of the communication systems (12, 14, 16, 18) alone, or in combination, in providing voice and data communications between ACPS 20 and GBCS 30.
Radio system 12 is configured to transmit and receive voice and data to/from ACPS 20 by way of radio signals. In one embodiment, radio system 12 is implemented as an analog system that includes one or more facilities configured to transmit/receive via HF/UHF/VHF analog radio. For example, radio system 12 may be configured to transmit/receive voice and data by way of AM or FM radio transmission facilities. Radio system 12 may also be configured to transmit and receive digital audio signals in the S band (approved for use in the U.S.) and L band (used in Europe and Canada). Radio system 12 may also include a digital radio broadcasting system that is employed as a signal repeater for satellite system 14.
Digital radio communications may also be established by implementing a time division multiple access (TDMA) frame format or a code division multiple access (CDMA) format, both of which may be configured to accommodate both voice and data in a single data structure. The present invention may be implemented using the global system for mobile communication (GSM) or spread spectrum techniques may also be employed. In other words, a wide variety of aircraft systems 20, while differing in sophistication because of the differing communication formats, may take full advantage of the system. The present invention may also be adapted to any new form of communication technologies that may develop over time. These technologies may employ electromagnetic waves, such as radio frequency (RF), optical and etc. GBCS 30, on the other hand, is configured to accommodate all of the various communication equipments. As new technologies develop and come on-line, GBCS 30 will be modified and adapted to accommodate these technologies.
Those of ordinary skill in the pertinent art will understand that any suitable type of wireless network 16 may be used to implement voice and data communications between ACPS 20 and GBCS 30. For example, wireless network 16 may be a wireless communications carrier such as a mobile cellular telephone system that is adapted to transmit and receive signals to/from one or more ACPS 20. Wireless communication system 16 may incorporate any type of wireless telecommunication network in which electromagnetic waves propagate voice and data signals over at least a portion of the communication path between the ACPS 20 and the GBCS 30. Wireless network 16 may be an analog mobile telephone system operating over existing mobile frequency bands, such as those operating at or near 800 MHz. In another embodiment, the wireless network 16 providing all or a portion of the communication path between the ACPS 20 and the GBCS 30 may be a digital mobile telephone system. Those of ordinary skill in the art will understand that these wireless networks may operate over pre-existing channels in the 800 MHz, 900 MHz, and/or 1900 MHz regions of the frequency spectrum. On the other hand, any suitable band capable of carrying mobile communications may be employed in implementing the present invention. Those skilled in the art will also recognize that wireless network 16 may be configured to provide short messaging services, based on established protocols such as IS-637 SMS standards, IS-136 air interface standards for SMS, and GSM 03.40 and 09.02 standards. Wireless network 16 may also be compliant with other systems types, such as 802.11 (e.g., wi-fi) compliant systems and Bluetooth systems. Wireless network 16 may also be configured to operate using a Dedicated Short Range Communications standard (DSRC).
Those of ordinary skill in the pertinent art will understand that any suitable type of satellite communication network 14 may be used to implement voice and data communications between ACPS 20 and GBCS 30. In one embodiment, satellite system 14 may operate over pre-existing channels in the 2.3 GHz region of the frequency spectrum (S-band). This portion of the spectrum has been allocated by the U.S. Federal Communications Commission (FCC) for nationwide broadcasting of satellite-based Digital Audio Radio Service (DARS).
Again, those of ordinary skill in the pertinent art will understand that communications network 18 may be comprised of any suitable means for coupling radio network 12 and/or wireless network 16 to GBCS 30. As such, network 18 may, in fact, be comprised of a single network system or a combination of network systems. For example, communications network 18 may include a mobile switching center and provide voice and data services from one or more wireless communications companies. As those of ordinary skill in the art will understand, wireless networks are coupled to wire line networks to provide seamless communications between a wireless telephony set and a wire line telephony set. Of course, the wire line voice and data communications may be supported by way of a circuit-switched networks such as the public-switched telephone network (PSTN), cable-television networks, packet switched networks and/or any combination thereof. Examples of a packet switched network include internet protocol (IP) networks. Those skilled in the pertinent arts will also understand that network 18 may be implemented using legacy copper-cable systems, fiber-optic based systems, optical networks, other wireless networks, and/or any combination thereof. As alluded to previously, system 10 of the present invention may employ all or part of radio network 12, satellite network 14, wireless network 16, as well as communication network 18 in providing voice and data communications between ACPS 20 and GBCS 30.
Of course, GBCS 30 is implemented as a call center, as known in the art. In an example, GBCS 30 is implemented as a voice call center, providing verbal communications between an advisor in the call center and a subscriber aircraft.
As embodied herein and depicted in
Referring back to
If a one-way data link is implemented, system 20 may be configured to broadcast aircraft parameters over a predefined channel. Link operability may be confirmed by way of voice communications. When system 20 employs a two-way link, ground system 30 may be configured to interrogate system 20 using the link. This approach allows the ground-based advisor to obtain more information from the aircraft without further burdening the task-saturated crew. For example, the advisor may employ a user-interface to transmit diagnostic codes to the aircraft to gain a better understanding of the aircraft status. This status information may better inform the advisor of the aircraft's capabilities.
Two-way digital voice is provided to processor unit 204 by digital voice interface 210 via data bus 218. System 20 may include a display configured to provide the pilot and/or aircrew with system status information. Finally, memory 214 is coupled to processor unit 204. Alternately, memory 214 may be incorporated with the processors 204. As noted above, the present invention is quite versatile in that voice communications may be implemented in a variety of ways. In an analog radio implementation, transceiver 202 may receive an analog base band signal from either processor unit 204 or from analog voice interface 216, depending on the implementation of system 20. In the simplest approach, two-way analog voice communications may be implemented directly using analog interface 216. If the system does not include interface 216 and the standard HF/UHF/VHF analog radio is employed, processor unit 204 includes both D/A converters and A/D converters to effect the two-way analog/digital conversions. Alternatively, if digital radio is used, digital voice and data may be exchanged between processor unit 204 and transceiver 202.
A high level description of system 20 has been provided in the preceding paragraphs. A more detailed description of the system 20 components is provided below, along with their alternative embodiments.
In one embodiment, voice interface (210/216), processor 204, transceiver 202, and antenna 200 are implemented using an analog or digital phone with suitable hardware and software for transmitting and receiving data communications. Transceiver 202 may also be equipped with a wireless modem for transmitting and receiving data. Of course, processor may be implemented using a digital signal processor with software and additional hardware to enable communications between ACPS 20 and wireless network 16. Wireless communications employing code division multiple access (CDMA) technology may also be employed by the present invention.
Transceiver 202 may also be implemented using a standard VHF radio that may be used by the aircrew to establish two-way voice communications with GBCS 30. This implementation takes advantage of the fact that civilian aircraft often operate in the VHF band. On the other hand, military applications or those applications that include both military and civilian units may operate in the UHF bands. Other applications employ HF bands. Accordingly, transceiver 202 may also employ HF or UHF radio systems compatible with such applications. In alternate implementations of the present invention, transceiver 202 may be configured to communicate in all three (and other) frequency bands to provide redundancy.
The operation of standard analog HF/UHF/UHF radio voice communications is well known in the art. Many HF/UHF and/or VHF radios provide voice communications using AM, FM or variants thereof (SSB, VSB, DSBSC, and etc.). On the receiver side, an RF signal is directed from the antenna 200 into a low noise amplifier (LNA) and a band pass filter before being demodulated by the receiver. Of course, the demodulation is carried out in accordance with the modulation format employed by system 10.
If standard HF/UHF/VHF radios are used to implement voice communications, transceiver 202 must also include data link transceiver equipment for sending and receiving data via a data link between the aircraft and GBCS 30. In an alternate embodiment of the present invention, the data link may be implemented by way of a one-way link from the aircraft 20 to GBCS 30. The data link may employ a digital encoding technique such as pulse code modulation (PCM). Of course, analog encoding techniques, such as amplitude, frequency, and phase modulation may also be employed. Standard modulation techniques for voice/audio communications were identified above. Band pass data transmissions may be implemented using any suitable technique such as ASK, FSK, PSK, QPSK, etc.
In another embodiment of the present invention, transceiver 202 may be implemented as part of a digital radio. The digital radio of the present invention may support any modulation scheme, or combination of formats, for supporting both voice communications and data communications. Of course, a good part of the functionality of the digital radio is implemented in software residing in processor unit 204.
As noted above, voice and data communications may be implemented in a unified digital format. One way to accomplish this is by employing a frame structure. System 20 may be configured to decode a synchronization pattern from a GBCS 30 transmission. Once in synchronization, two way communications are maintained by way of a time-division multiplexed frame structure that includes a voice payload and data payload. In practice, processor unit 204 decodes a GBCS preamble that is used to provide timing for every bit position in the GBCS 30 data burst. In similar fashion, system 20 responds with a similarly formatted data frame. GBCS decodes the preamble and recovers voice and sensor data based on their position with the system 20 data burst. This implementation may be advantageous in a satellite system covering a wide geographical area. As those of ordinary skill in the art will understand, a satellite communication network may be advantageous because it eliminates many of the problems associated with line-of-sight radio systems.
Referring to processing block 204 in
Memory 214 includes both random access memory (RAM), read only memory (ROM), as well as any computer-readable media. The term “computer-readable media” as used herein refers to any medium that may be used to provide data and instructions to processor(s) 204. Computer readable media may be implemented in many different forms, including but not limited to non-volatile media, volatile media, and/or transmission media. As those of ordinary skill in the art will understand, RAM is configured to store system data, digital audio, sensor data, status information, instructions for use and execution by the processors, and temporary variables or other intermediate data used by the processor while executing instructions. ROM, or other static storage devices, may be employed to store programming instructions for the processor. Those skilled in the art will also understand that ROM may be implemented using PROM, EPROM, E2PROM, FLASH-EPROM and/or any other suitable static storage device. Any other memory chip or cartridge may be used as well. Other forms of computer-readable media include floppy-disks, flexible disks, hard disks, magnetic tape or any other type of magnetic media, CD-ROM, CDR/W, DVD, as well as other forms of optical media such as punch cards, paper tape, optical mark sheets, or any other physical medium with hole patterns or other optically recognizable media. The present invention also defines any wireless or wired media from which a computer may access as computer-readable media.
Interface 216 typically includes audio speakers, a microphone, a voice output, an audio channel, and performs any buffering, amplification, or filtering required by audio channel. Of course, in addition to digitizing analog voice and converting digital data into analog electrical voice signals, digital voice unit 210 performs many of the same buffering and amplification functions provided by analog voice interface 216 including the synthesizing of the voice. Of course, if voice communications and sensor communications are combined in a multiplexed format by processor unit 204, analog voice interface 216 would not be an option since the data line between processor 204 and transceiver 202 would include both digital voice data as well as digital sensor data.
Those skilled in the art will also understand that transmission media employed between any of the units depicted in
As embodied herein and depicted in
A ground-based advisor may communicate with subscriber aircraft system 20 by way of workstation 314 and headset 318. Each work station 314 is coupled to a display system 316. Headset 318 is coupled to workstation 314 by way of an interface card disposed in workstation 314. The headset provides an audio interface with the voice communications channel established between GBCS 30 and subscriber aircraft 20. Workstation 314 is also coupled to telephony handset 320. The telephony headset 320 provides the ground-based advisor with the ability to communicate with air traffic control. Workstation 314 is also configured to patch air traffic control (ATC) 40, headset 318 and subscriber system 20 in a teleconferencing mode that enables N - way conversation including the aircrew/pilot, the advisor(s), and ATC, wherein N is an integer value. Voice communications are directed from the interface card disposed in workstation 314 to processing unit 308 via LAN 300. In the opposite direction, voice and sensor data are directed from processing unit 308 to the appropriate workstation 314.
With regard to signal processing unit 308 and transceiver equipment 310, the various aircraft subscribing to system 10 may employ different voice and data communication packages because of cost and design issues. As noted above, smaller and less expensive aircraft may use analog HF/UHF/VHF radio to implement voice communications. Another more sophisticated subscriber aircraft system 20 may employ the integrated digital voice and data approach. Yet another may employ a satellite communications channel for both voice and data. Signal processing unit 308 and RF transceiver equipment 310 must accommodate all of the aforementioned systems. Because the transceiver and processing systems were described in the discussion of system 20, any further discussion would be redundant and unnecessary. Of course, the ground-based advisor disposed on workstation 314 and communicating by way of headset 318 may also communicate with the ACPS 20 via interface 306.
As shown in
Work station 314 includes a processor unit coupled to a data bus system. Those skilled in the art will understand that some or all of the signal processing functionality in system 30 may be distributed among the workstations 314. As such, workstation may include a processor programmed to support an operating system and application programming as well as a DSP device for performing signal processing. The data bus system is configured to transmit address, data, and control information to other processing components disposed in the work station 314. Work station 314 includes random access memory (RAM), or other dynamic storage devices, coupled to the data bus. The RAM is used to store data and instructions for execution by the processor. RAM may also be used for storing temporary variables or other intermediate information during execution of instructions by the CPU. The work station computer system may further include read only memory (ROM) or other static storage devices. Once again, those skilled in the art will also understand that ROM may be implemented using PROM, EPROM, E2PROM, FLASH-EPROM and/or any other suitable static storage device. Storage devices such as a magnetic disks or optical disks may also be included.
Workstation typically includes input devices such as a keyboard, mouse, and/or trackball. The keyboard, of course, includes alphanumeric keys as well as cursor control keys, as commonly found on personal computers. The input devices, of course, are used to communicate information and command selections to the processor unit in workstation 314.
Each work station 314 typically includes a communication interface coupled internally to the data bus. The communication interface provides a two-way data communication with LAN/WAN 300. The communication interface may typically be a local area network (LAN) card (e.g. for Ethernet™ or an Asynchronous Transfer Model (ATM) network) configured to provide a data communication connection to a compatible LAN. As another example, the communication interface may be a digital subscriber line (DSL) card or modem, an integrated services digital network (ISDN) card, a cable modem, a telephone modem, or any other communication interface to provide a data communication connection to a corresponding type of communication line. Wireless links may also be implemented. In any such implementation, the communication interface transmits and receives electrical, electromagnetic, or optical data signals. The communication interface may also include peripheral interface devices, such as a Universal Serial Bus (USB) interface, a PCMCIA (Personal Computer Memory Card International Association) interface, etc. Although the aforementioned description refers to a single communication interface, multiple communication interfaces may be employed herein.
Display 316 may be implemented using a cathode ray tube (CRT), liquid crystal display, active matrix display, plasma display, or digital light processing (DLP). As shown in
Telephone sets 320 may be of any suitable type including the traditional wire line telephone sets, cordless telephone sets, and/or voice over internet protocol (VoIP) sets.
The network interface 306 may be implemented as a PBX or by way of a telephony gateway. Interface 306 may also be configured to provide both voice and data communication between workstations 314 and telephone sets 320, and one or more networks for communication with remote devices. For example, the network link 306 may provide a connection between a workstation 314 and a wide area network (WAN), or the global packet data communication network now commonly referred to as the “Internet”, by way of LAN 300.
Referring to
In step 404, system 20 is turned ON and a request for assistance is transmitted to the GBCS 30 by way of the data link. The signal processing unit 308 in the GBCS interprets the message as a request for assistance and directs the request to an available workstation 314. If the data link is a two-way link, processing unit 308 may be programmed to provide an acknowledge signal back to system 20. In this case, system 20 is configured to retransmit the request for assistance until an acknowledge signal is provided by the GBCS. Once received, the acknowledgement may be provided to display 212 as a visual or audible acknowledgement to the aircrew. If system 20 supports a one way data link, processing proceeds to step 408.
In step 408, processor unit 204 (
Referring to
Simultaneous with step 504, the workstation processor provides the subscriber aircraft database (shown generally in
Again, virtually simultaneous with step 504, the workstation processor obtains a digital map from a geographical database (shown generally in
In step 526, yet again virtually simultaneous with step 504, the workstation processor obtains electronic checklists of various subscriber aircraft procedures from a procedure database (again, shown generally in
Once the displays are in place, the ground-based advisor is empowered to evaluate the real-time data and provide the aircrew with assistance via the voice communication channel. Referring to the examples provided in the Background Section, the ground-based advisor is well equipped by the present invention to provide advice during an instrument landing based on the simulated IPD. The present invention may also be used to directing the pilot to the nearest airfield during an emergency. The present invention may be used to provide the subscriber aircraft with an alternative flight path to avoid adverse weather conditions. The ground-based advisor may also relay certain aircraft procedures in the event of some other flight emergency, such as an equipment malfunction. As part of the process, the ground-based advisor may be in contact with an ATC or some other ground-based authority. GBCS 30 also provides the advisor with other information. For example, the ground-based advisor may retrieve and display a weather radar input corresponding to the flight path of the subscriber aircraft. The advisor may also obtain the latest weather forecast for the destination.
Referring to
Referring to
In the example shown in
As noted previously, workstation 314 integrates sensor data with the mapping information to superimpose a symbol 702, representing the subscriber aircraft, over the mapping data. In another embodiment, a cursor may be positioned over the symbol 702 by the work station operator. If the operator uses a mouse, or other such device, to “click” the symbol 702, additional data be displayed as a pop-up. For example, the pop-up may provide a call sign, altitude, speed, and/or any of the data provided via the data link.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
