The subject matter described herein relates generally to aircraft systems management. More particularly, the subject matter disclosed herein relates to methods, systems and computer readable media for managing one or more aircraft systems through a management interface.
The management of a plurality of aircraft systems in current configurations, including fuel, hydrocarbon fuels, electric, engines, and orders of flight is performed using three devices. First, a screen displays some information about these systems, gathering various parameters measured by sensors, as well as the state of the equipment composing each system of the plane. Secondly, an order-system overhead panel equipped with a plurality of buttons, chokes, and switches that act on the various systems allows an aircraft operator to control these various systems, with an increased level of confusion associated with the significant number of such control buttons, chokes, and switches available on the panel. Thirdly, a screen displays any breakdowns detected by the systems as well as the procedure to limit the impact of these breakdowns on the safety of the flight and the other flight operations.
There is a need to simplify these systems and reduce the possibility for errors made by the operator when responding to situations that arise during flight operations.
According to one aspect, the subject matter described herein comprises a method for managing an aircraft system. The method includes at at least one interactive interface configured for managing an aircraft system, displaying at least one or more graphic object representing at least one or more system component, displaying at least one or more energy flow icon representing a direction of circulation of an energy flow, and interacting with the at least one or more system component by a user action on the at least one or more graphic object.
According to another aspect, the subject matter described herein comprises a system for managing an aircraft system. The system includes an interactive interface configured for managing one or more aircraft system and comprising a hardware processor. The system also includes at least one or more graphic object representing at least one or more system component, at least one or more energy flow icon representing a direction of circulation of an energy flow, and at least one or more graphic object representing an automated task procedure.
According to yet another aspect, the subject matter described herein comprises a non-transitory computer readable medium having stored thereon executable instructions that when executed by the processor of a computer control the computer performs, at an interactive interface configured for managing an aircraft system, displaying at least one or more graphic object representing at least one or more system component, displaying at least one or more energy flow icon representing a direction of circulation of an energy flow, and interacting with the at least one or more system component by a user action on the at least one or more graphic object.
The subject matter described herein can be implemented in software in combination with hardware and/or firmware. For example, the subject matter described herein may be implemented in software executed by one or more processors. In one exemplary implementation, the subject matter described herein may be implemented using a non-transitory computer readable medium having stored thereon computer executable instructions that when executed by the processor of a computer control the computer to perform steps. Exemplary computer readable media suitable for implementing the subject matter described herein can include non-transitory computer readable media such as, for example and without limitation, disk memory devices, chip memory devices, programmable logic devices, and application specific integrated circuits. In addition, a computer readable medium that implements the subject matter described herein may be located on a single device or computing platform or may be distributed across multiple devices or computing platforms.
The subject matter described herein will now be explained with reference to the accompanying drawings, of which:
In accordance with the description herein and exemplary, associated drawings, novel methods, systems, and computer readable media are disclosed for simulating user interactions with a simulated aircraft cockpit. Such methods, systems and computer readable media are particularly suitable for use, for example and without limitation, for 3D modeling of a cockpit associated with an emulation of aircraft systems.
Notably, the subject matter described herein provides an integrated interface system for the simplification of the management of systems of an aircraft for use during either a prescribed situation or a non-prescribed situation that may occur during flight operations. A prescribed flight situation includes flight operations situations when the aircraft operating systems indicate or emit a diagnosis of breakdown, or when an operator detects a breakdown not detected by the aircraft operating systems. In this case, a known procedure is applied in response to the detected breakdown. Prescribed flight situations occur when the aircraft operating systems require an operator to configure a setting in a particular configuration in response to the detected breakdown, or for the operator to pay attention to a particular aircraft operating system or operating parameter. A prescribed flight situation could include, for example, the detection of an unknown source of smoke, detected by either the operator or operating systems onboard the aircraft.
A non-prescribed flight situation occurs when the aircraft operating systems indicate that the aircraft operating systems do not detect any abnormal situation or condition, whereas the aircraft is in a situation recognized by the operator as dangerous or abnormal for the given flight conditions. In this non-prescribed flight situation, a coherent action plan cannot be formulated by the aircraft operating systems, or no procedure exists for the current flight situation for the operator to follow in order to resolve the abnormality in the flight conditions. Non-prescribed flight situations occur, for example, when the operator wishes to put the plane in a particular configuration or to visualize particular parameters not required by a procedure outlined by standard flight operating procedures. A non-prescribed flight situation could include the investigation of managing remaining fuel onboard the aircraft by the operator.
In some aspects, an aircraft's various systems are managed through an unique device with dedicated interfaces.
In some aspects, an aircraft operator interacts with an aircraft system by using, for example, tactile features such as a touchscreen display, or interactive devices such as a computer mouse or track-wheel selector. When selected, each of the graphic objects gives access to a local view of a management system about the associated aircraft system.
In some aspects, the aircraft systems as displayed on the global visualization interface 100 are connected to other systems by various graphical icons representing energy flows. For example,
In some aspects, contextual and/or supplemental information are displayed along sides of the graphic objects representing aircraft systems to provide additional systems data to aircraft operators.
In some aspects, the inserts are also useful to display, for each system, breakdown diagnoses when a system failure has occurred, as illustrated in
In some aspects, a system management interface configured for managing at least one or more aircraft system is accessible by interacting with an insert or a graphic object representing one or more functions realized by the considered system. The interface can be that can be a local system management interface for local control on an aircraft. A user or operator interacts with the insert or the graphic object through any suitable technique, for example such as by tapping the insert on a tactile screen, or selecting the insert using an interactive device such as a computer mouse. Selecting an insert or the graphic object representing an aircraft system grants the operator access to a local system management interface of that system. For example, as illustrated in
In some aspects, an operator is capable of accessing and/or managing an aircraft system through a dedicated management interface. For example,
In some aspects, system function sequences are activated following one or more prescribed sequences. For example, the fuel carburizing system is configured to operate in an AUTO FEED 514 mode by default, which gives an operator full authority to configure the fuel supply according to procedures determined by priorities set by a flight database onboard the aircraft or in standard operating procedure guidelines. The determination of priorities takes into consideration factors such as different flight phases, the operating aircraft systems, and/or any breakdowns or aircraft system failures. Under the AUTO FEED mode, the CENTER 506 fuel tank would be exhausted first, followed by the LEFT WING 502 and RIGHT WING 504 tanks, thereby reducing stresses undergone by aircraft wing structures during cruising.
In some aspects, an aircraft operator is fully authorized to activate or deactivate a system component through user interaction with a graphic object on the management interface. For example, by tapping on the graphic object representing a fuel tank, an operator is manually selecting and/or deselecting the tank independently of other system components, and the FUEL 500 management system will reconfigure the pumps 508 and valves 510 automatically in order to adequately supply fuel to all aircraft systems, starting from the activated fuel tank. This configuration is referred to as the “functional interaction”, as it is abstracted from the equipment which is programmed to execute the settings as configured in a strict manner, such as open and close valves 510, or start and/or stop the fuel pumps 508. Functional interaction is an improvement over current systems, where an aircraft operator is required to toggle multiple switches in a prescribed order to configure valves and pumps to reroute the fuel supply. Centralizing the controls in the FUEL management interface 500 not only lightens the workload of the operator, but also reduces overall risk due to human errors. In some aspects, as illustrated in
In some aspects, inappropriate configuration commands or operating procedures that would put an aircraft in potential danger is prevented by a safeguard mechanism. For example, as illustrated in
In some aspects, the FUEL 500 management interface is also configured to manage abnormal system configurations and failures. For example, under AUTO FEED mode, the difference in the amount of fuel in the left and right wing tanks is automatically maintained at or below a threshold level (e.g. 300 kg), such as for example by activating a rebalancing mechanism at convenient times throughout a flight. However, when an operator disables the AUTO FEED mode and puts the fuel system in a different configuration, an imbalance of amount of fuel between the tanks can develop. When the imbalance exceeds a threshold level (e.g. 300 kg), a contextual icon will appear to indicate the imbalance and ask for rebalancing of aircraft fuel between the two tanks. For example, as illustrated in
In some aspects, under certain operational conditions, when a fuel tank fails to function, it is possible to still draw fuel from that tank using gravity. For example, as illustrated in
In some aspects, an aircraft operator has the option to directly control the pumps 508 and valves 510 of the fuel system for managing an unprescribed emergency situation such as a fuel leak not detected by onboard sensors. However, the safeguard mechanism is still present as a safety net, preventing the operator from executing potentially disastrous commands. For example, as illustrated in
In addition, in some aspects, command icons such as JETTISON 532 and REFUEL 534 are also placed on the FUEL management interface 500, allowing quick configuration and execution of refueling the plane on the ground or jettison fuel in the air. It should be noted that other quick access command icons can be conveniently placed on a system management interface for fast execution of prescribed configuration commands. In addition, in some aspects, system function sequences such as JETTISON 532 and REFUEL 534 require a configuration phase before execution. For example, aircraft fuel balancing parameters need to be collected and analyzed before adding or jettisoning fuel to or from the aircraft.
In some aspects a prescribed situation can occur when onboard sensors detect a smoke source and responses are prescribed for an aircraft operator to resolve the fault. In current practice, task-specific action sequences such as smoke source troubleshooting or assessment procedures are performed through several onboard interfaces, including a task-specific action sequence presented in a printed Quick Reference Handbook, a series of “ON/OFF” commands for potential sources disposed in an overhead panel, systems reconfiguration controls disposed across the cockpit for reallocating communication frequencies on non-shutdown radio controls, and a display of potential sources on a plurality of system pages and overhead panel lights. In this situation of a smoke source, the interactive system provides an integrated task view that supports the execution of a simplified procedure for troubleshooting the smoke source while providing direct “ON/OFF” commands on potential smoke sources, displaying current states of these potential sources, and automatically reallocating system resources. This advantageously allows the operator to have a better understanding of the troubleshooting or assessment process, to be more efficient at finding the smoke source, and to be exposed to a reduced risk of command error, thereby improving the safety of the aircraft when a non-sensed smoke source is identified. In some aspects, performing an action sequence comprises reconfiguring a shutdown system to another resource and providing a backup capability. For example, during a smoke source troubleshooting sequence, the sequence shuts down one electrical generator while keeping the other generators operational.
In some aspects, the interactive system described in the present subject matter prescribes a task to be performed by the operator and then illustrate a task view at an appropriate time. In addition, the operator has the option to activate a particular task view from a pre-defined list when the operator detects an event not picked by the aircraft's sensors. For example, as illustrated in
In some aspects, to determine or pin point the source of the smoke, as illustrated in
When the first macro action step did not alleviate the smoke issue, the smoke troubleshooting sequence then proceeds automatically to the next step, which is isolating the left side of the aircraft as shown in
This exemplary response method for troubleshooting a smoke source in a reduced number of steps advantageously enables the operating crew members to methodically check the source of the smoke while maintaining a safe and operable aircraft as long as possible. There is also an advantageous reduction in potential errors due to the macro-actions taken that combine potential sources in combinations that will have little detrimental effect to other aircraft operations systems and do not require the operating crew members to memorize a long series of steps to be performed manually in emergency situations. Additionally, the representation of potential smoke source systems gathered on the same view below macro action enable the crew to have an overview of the effect of macro-action on individual systems.
In some aspects, instead of going through a task-specific action sequence such as the smoke troubleshooting sequence, the operator is aware of the possible sources of the smoke and is fully authorized to interact directly with the displayed aircraft systems, and the safeguard mechanism is in place to protect against abnormal and/or dangerous systems commands. For example, as shown in
In some aspects, which operator command would set the aircraft in danger is determined dynamically by the safeguard mechanism. For example, as illustrated in
In another aspect, some of the aircraft's systems cannot be directly controlled by an aircraft operator through the TROUBLESHOOTING 600 interface. For example, systems such as AVNCS 1646 and AVNCS 2648 cannot be turned off by the operator on this aircraft architecture. When an operator attempts to disable a system such as the AVNCS 1646 on the TROUBLESHOOTING 600 interface, as illustrated in
In some aspects, an interface system includes graphic objects representing principal elements (e.g. tanks, valves, generators, pumps, etc.) of an aircraft according to their physical locations on the aircraft (e.g. right wing, left wing, cabin, etc.). The systems are connected by various energy flows (e.g. fuel electricity, air, water, etc.) according to the energy flow's direction of circulation as configured in the aircraft. For example, aircraft fuel can be directed from the wing tanks to the engines, and air can be directed by generators to the cabin. Important consumer systems such as fire & smoke systems, or cockpit & avionics systems, are to be displayed either by default and/or by aircraft operator preference, and descriptive information about a system is also displayed. Furthermore, system failures and emergency functions (e.g. fuel imbalance, smoke source troubleshooting, etc.) are also displayed and accessible from the interface.
In some aspects, the graphic objects also inform the aircraft operator as to the state of the associated aircraft system. For example, a system can be shown to be operational or degraded, locked or active, and/or deployment in progress. The graphic object also gives the operator access and control to that system.
Furthermore, multiple interfaces are to be integrated into a centralized platform configured to include several tactile devices. For example, in the event of a system failure, an ABNORMAL MISSION MANAGEMENT interface will pop up automatically or at a pilot's request, to a screen next to the global management interface, or even share the same screen as the management interface.
It will be understood that various details of the subject matter described herein may be changed without departing from the scope of the subject matter described herein. Furthermore, the foregoing description is for the purpose of illustration only, and not for the purpose of limitation, as the subject matter described herein is defined by the claims as set forth hereinafter.
Number | Name | Date | Kind |
---|---|---|---|
4819183 | O'Brien | Apr 1989 | A |
5152146 | Butler | Oct 1992 | A |
5241814 | Butler | Sep 1993 | A |
5499784 | Crabere | Mar 1996 | A |
5904729 | Ruzicka | May 1999 | A |
6633801 | Durlacher et al. | Oct 2003 | B1 |
6636786 | Partel | Oct 2003 | B2 |
6946976 | Langner | Sep 2005 | B1 |
7142131 | Sikora | Nov 2006 | B2 |
7148814 | Sikora | Dec 2006 | B2 |
7260453 | Poier | Aug 2007 | B2 |
7295135 | Younkin | Nov 2007 | B2 |
7309048 | von Thal | Dec 2007 | B2 |
7321318 | Crane | Jan 2008 | B2 |
D590409 | Shibata | Apr 2009 | S |
D600702 | Osborne | Sep 2009 | S |
7772995 | Cabaret De Alberti et al. | Aug 2010 | B2 |
7868785 | Wang | Jan 2011 | B1 |
7873446 | Shehi | Jan 2011 | B2 |
7880597 | Uchida | Feb 2011 | B2 |
8188972 | Krenz et al. | May 2012 | B1 |
8359542 | Dingeman | Jan 2013 | B2 |
8378853 | Smith et al. | Feb 2013 | B2 |
8421649 | Marstall | Apr 2013 | B2 |
D682314 | Lau | May 2013 | S |
8630752 | Gurusamy | Jan 2014 | B2 |
8633913 | Raghu | Jan 2014 | B1 |
8788138 | Yogesha et al. | Jul 2014 | B1 |
D717819 | Lee | Nov 2014 | S |
D722081 | Gerber | Feb 2015 | S |
D726758 | Bourret | Apr 2015 | S |
9058742 | Conrardy et al. | Jun 2015 | B2 |
9205929 | Conner et al. | Dec 2015 | B2 |
20020120375 | Draoullec et al. | Aug 2002 | A1 |
20030078704 | Partel | Apr 2003 | A1 |
20030156137 | Von Essen et al. | Aug 2003 | A1 |
20040073571 | Kumhyr | Apr 2004 | A1 |
20050004723 | Duggan | Jan 2005 | A1 |
20090002764 | Atkins et al. | Jan 2009 | A1 |
20110040470 | Qiu et al. | Feb 2011 | A1 |
20110296340 | Nakagawa | Dec 2011 | A1 |
20120072098 | Righi et al. | Mar 2012 | A1 |
20120209468 | Thomas | Aug 2012 | A1 |
20150217856 | Mesguen et al. | Aug 2015 | A1 |
20150217874 | Mesguen et al. | Aug 2015 | A1 |
Number | Date | Country |
---|---|---|
2 985 069 | Jun 2013 | FR |
WO 2006066702 | Jun 2006 | WO |
Entry |
---|
PMDG 747-400 Aircraft Operating Manual Revision 1.0, Aircraft Operating Manual & Flight Management Computer Handbook, Revisions Jun. 10, 2005 and Jul. 26, 2005, 2005, Precision Manuals Development Group, PMDG 747-400—AOM, pages Cover, 0-2, 7-28 thru 7-30, 11-7 thru 11-9, 11-12 thru 11-19, 11-44 thru 11-55, and 11-65 thru 11-67. |
U.S. Appl. No. 14/171,411, filed Feb. 3, 2014. |
U.S. Appl. No. 14/171,425, filed Feb. 3, 2014, same as pending application. |
U.S. Appl. No. 29/841,235, filed Feb. 3, 2014. |
U.S. Appl. No. 29/481,238, filed Feb. 3, 2014. |
U.S. Appl. No. 29/481,240, filed Feb. 3, 2014. |
U.S. Appl. No. 29/481,251, filed Feb. 3, 2014. |
Non-Final Office Action for U.S. Appl. No. 14/171,411 dated Feb. 13, 2015. |
Applicant Initiated Interview Summary for U.S. Appl. No. 14/171,411 dated May 12, 2015. |
Norris G., “Flying smart the spread of technology such as laptop computers is pushing cockpit advances”, Flight International, Reed Business Information, Sutton Surrey, GB, vol. 157, No. 4718, Mar. 7, 2000, p. 34/35. |
Learmount D: “Cognitive Cockpit End of Human Pilot Could Be in Sight”, Flight International, Reed Business Information, Sutton Surrey, GB, vol. 158, No. 4748, Sep. 26, 2000 pp. 43/44, 46, XP000959525, ISSN: 0015-3710. |
Non-Final Office Action for U.S. Appl. No. 14/171,444 dated May 22, 2015. |
Extended European Search Report for Application No. EP 15 15 3441 dated Jun. 29, 2015. |
Extended European Search Report for Application No. EP 15 15 3439 dated Jun. 30, 2015. |
Final Office Action for U.S. Appl. No. 14/171,411 dated Jun. 30, 2015. |
Advisory Action for U.S. Appl. No. 14/171,411 dated Sep. 18, 2015. |
Notice of Allowance for U.S. Appl. No. 14/171,444 dated Oct. 13, 2015. |
Non-Final Office Action for U.S. Appl. No. 14/171,411 dated Oct. 16, 2015. |
Non-Final Office Action for U.S. Appl. No. 29/841,235 dated Oct. 19, 2015. |
Non-Final Office Action for U.S. Appl. No. 29/481,238 dated Oct. 19, 2015. |
Non-Final Office Action for U.S. Appl. No. 29/481,240 dated Oct. 19, 2015. |
Non-Final Office Action for U.S. Appl. No. 29/481,251dated Oct. 19, 2015. |
Final Office Action for U.S. Appl. No. 14/171,411 dated Feb. 1, 2016. |
Final Office Action for U.S. Appl. No. 29/841,235 dated Feb. 26, 2016. |
Notice of Allowance for U.S. Appl. No. 14/171,444 dated Mar. 1, 2016. |
Number | Date | Country | |
---|---|---|---|
20150217857 A1 | Aug 2015 | US |