Existing systems for communicating with devices often require traditional data entry methods to communicate with the device. For example, a user may use multiple data entry fields on a display device to input commands to be communicated to the device. However, the likelihood of data entry errors is high when there is an abstract level of symbolism used during data entry (e.g., numbers and symbols) and, while missing a keystroke during data entry is easy, noticing the error may not be, thus error correction may not occur fast enough to prevent accidents.
Embodiments of the invention, described herein, address these and other problems individually and collectively.
Embodiments provide techniques for illustrating and manipulating aircraft flight parameters communicated to multiple aircraft. According to various embodiments, a graphical user interface (GUI) is provided to display and enable easy adjustment of aircraft flight parameters. The GUI may be animated and include graphical representations of aircraft, a compass rose, flight parameters, and related information displayed over (e.g., laid over) a moveable scalable map (e.g., capable of being panned and zoomed) representing the area over which an aircraft is flying. According to various embodiments, the aircraft controlled via GUI may include an autonomous aircraft, such as an autonomous vertical takeoff landing (VTOL) aircraft. In some embodiments, the aircraft may include an electric vertical takeoff landing (eVTOL) aircraft.
According to various embodiments, a method is provided which comprises displaying, using a computing device, a GUI on a display device, and representing an aircraft with a first icon of a plurality of icons on the GUI. The method further includes receiving, at the computing device, an input manipulating a second icon representing a flight parameter associated with the aircraft, wherein the input manipulating the second icon moves the second icon from a first position to a second position on the GUI. The method further includes transmitting, to the aircraft represented by the first icon, a command based at least in part on manipulation of the second icon representing the flight parameter.
In various embodiments, the method further comprises displaying one or more flight parameters associated with the aircraft, the one or more flight parameters including at least one of a heading, a speed, or an altitude associated with the aircraft, and, in response to detecting selection of the first icon, displaying, over the first icon, the second icon and a third icon of the plurality of icons, wherein the third icon represents a compass rose.
In various embodiments, at least the first, second, and third icons of the plurality of icons are overlaid on a map displayed on the GUI.
In various embodiments, at least the first, second, and third icons of the plurality of icons are transparent.
In various embodiments, the method further comprises displaying a third icon in response to detecting, at the computing device, manipulation of the second icon representing the flight parameters, the third icon representing a change in the flight parameter of one or more parameters associated with the aircraft.
In various embodiments, the third icon converges with the second icon as the aircraft executes the command based at least in part on the manipulation of the second icon.
In various embodiments, the third icon snaps to a location, the location representing a predetermined increment of the flight parameter.
In various embodiments, the method further comprises displaying a first visual cue indicating transmission of the command to the aircraft and displaying a second visual cue indicating receipt of the command by the aircraft.
In various embodiments, the method further comprises receiving one or more prohibited flight parameters and displaying a visual cue indicating the second icon is prohibited from being manipulated to a location in the GUI, the location representing a prohibited flight parameter of the one or more prohibited flight parameters.
In various embodiments, the method further comprises, in response to receiving a location selected for landing the aircraft, transmitting the command to the aircraft, the command triggering at least one or more flight procedures associated with landing the aircraft.
In various embodiments, one or more non-transitory computer-readable storage medium storing instructions are provided that, upon execution of a computer system, cause the computer system to perform the methods described above.
In various embodiments a system is provided to perform the methods described above.
To better understand the nature and advantages of the present disclosure, reference should be made to the following description and the accompanying figures. It is to be understood, however, that each of the figures is provided for the purpose of illustration only and is not intended as a definition of the limits of the scope of the present disclosure. Also, as a general rule, and unless it is evident to the contrary from the description, where elements in different figures use identical reference numbers, the elements are generally either identical or at least similar in function or purpose.
Techniques disclosed herein are related to an animated GUI for illustrating and manipulating aircraft flight information and/or commands communicated to multiple aircraft. According to various embodiment(s), the aircraft are autonomous aircraft that are configured to receive commands from a controller (e.g., supervising pilot, on-ground controller, onboard controller, etc.). The controller commands may be conveyed to the aircraft through the GUI. More specifically, techniques disclosed herein provide a GUI that enables the selection of an aircraft among one or more aircraft on a flight map, the adjustment of flight parameters of the selected aircraft via a translucent or transparent icon (e.g., a compass rose icon) overlaid on the flight map, to intuitively select, detect, transmit, and/or execute commands at the aircraft. For example, the controller may adjust one or more flight parameters, such as speed, heading, direction, and/or altitude, by dragging an arrow icon around a compass rose icon. Various inventive embodiments are described herein, including methods, processes, systems, devices, and the like.
The flight control system(s) described herein may simultaneously be used to complete other important flight tasks, such as monitoring the flight progress of an aircraft, information associated with the aircraft, and the location of nearby geographical hazards. However, using a display device to monitor and control multiple aircraft and a corresponding flight map can lead to a cluttered display where important information can easily be obscured by various data entry fields and icons. Such crowded displays can lead to increased likelihood that important information is missed and can lead to errors and accidents. Embodiments provide techniques, methods and systems for displaying command entry means without cluttering the display device such that important and/or relevant flight information displayed on the display device is not obscured by command entry means described herein.
Several illustrative embodiments will now be described with respect to the accompanying drawings, which form a part hereof. The ensuing description provides embodiment(s) only and is not intended to limit the scope, applicability, or configuration of the disclosure. Rather, the ensuing description of the embodiment(s) will provide those skilled in the art with an enabling description for implementing one or more embodiments. It is understood that various changes may be made in the function and arrangement of elements without departing from the spirit and scope of this disclosure. In the following description, for the purposes of explanation, specific details are set forth in order to provide a thorough understanding of certain inventive embodiments. However, it will be apparent that various embodiments may be practiced without these specific details. The figures and description are not intended to be restrictive. The word “example” or “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any embodiment or design described herein as “exemplary,” or “example” is not necessarily to be construed as preferred or advantageous over other embodiments or designs.
Embodiments are directed to, among other things, techniques, methods and systems including an animated GUI for illustrating and communicating flight characteristics, flight parameters and/or commands to one or more aircraft. A controller (e.g., a user) may be in charge of monitoring, and controlling, one or more aircraft at a given time. Therefore, it is crucial for the controller to be aware of flight parameters associated with an aircraft, and/or relay commands and/or information to the correct aircraft in a timely and efficient manner. For example, the controller may command an aircraft to change a particular flight parameter using an animated GUI displaying interactive flight parameters.
In some embodiments, alphanumerical representations of one or more flight parameters (e.g., heading 104, speed 101, and/or altitude) corresponding to an aircraft may be depicted proximate to the aircraft icon 103 representing the aircraft. For example, an aircraft with a heading 104 of 250 degrees may be depicted as an aircraft icon 103 overlaid on the flight map 102 and adjacent to an alphanumerical representation displaying the heading 104 as 250 degrees. In some embodiments, the one or more flight parameters 101, 104 may be stuck to the aircraft icon 103 and may move along the flight map 102 with the aircraft icon 103. For example, the one or more flight parameters 101, 104 may remain proximal to aircraft icon 103 even as the aircraft icon 103 appears to move across the flight map 102. By illustrating an aircraft icon 103 near one or more flight parameters 101, 104, where the one or more flight parameters 101, 104 correspond to the aircraft represented by the aircraft icon 103, pertinent information relevant to the aircraft may be easily viewed and considered by a controller when using the GUI 100. In turn, the GUI 100 can provide a minimally distracting display allowing a controller to quickly glean information from the GUI 100 and promptly relay commands and/or information to a desired aircraft in a timely and efficient manner.
According to various embodiments, the aircraft may be an autonomous aircraft. For example, the aircraft may include an autonomous electric vertical takeoff and landing (eVTOL) aircraft that is monitored and/or controlled via the animated GUI 100.
Selection of an aircraft may occur by a controller's use of an input device such as a mouse or a pointer, by touch on a touchscreen, or from an asynchronous condition by the system when it is determined that an aircraft requires attention. Upon selection of the aircraft icon 103 depicted on the GUI 100, one or more icons (e.g., compass rose icon 202, first arrow icon 203, ball icon 204, and/or second arrow icon 301) used to convey flight parameters 101, 104 may appear overlaid on the flight map 102. In some embodiments, the one or more icons (e.g., compass rose icon 202, first arrow icon 203, ball icon 204, second arrow icon 301) may include the FGC as a compass rose icon 202, as illustrated in
The compass rose icon 202 may be displayed such that it does not wholly obscure the flight map 102 or a particular area of interest on the GUI 100. For example, the compass rose icon 202 may appear transparent (e.g., a see-through shape as opposed to an opaque shape allowing objects behind the transparent shape to be distinctly seen) or translucent (e.g., a see-through shape which is not fully transparent allowing partial view of objects behind the shape) so as not to obscure the underlying information (e.g., flight map 102, or nearby objects). As a result, the compass rose icon 202 can be spatially oriented on the GUI 100 to correspond to a particular aircraft, as well as appear visually light weight such that the compass rose icon 202 does not clutter or obscure the flight map 102. In this manner, pertinent details concerning the aircraft represented by the aircraft icon 103 may be depicted proximate to the aircraft icon 103 without making it difficult to see the flight map 102. For example, if the compass rose icon 202 appears transparent, images behind the compass rose icon 202, such as details on a map depicted on the GUI 100, may be easily discerned by the viewer. If the compass rose icon 202 appears translucent, images behind the compass rose icon 202 may appear less detailed, but images overlayed on the compass rose icon 202, such as text, may be easier to discern by the viewer.
As previously discussed with respect to
According to various embodiments, the first arrow icon 203 may be depicted with one or more visual cues (e.g., change in arrow length, change in arrow color, change in arrow opacity, etc.) to illustrate one or more flight parameters 101, 104 (e.g., speed 101, altitude, and/or heading 104). For example, the length of the first arrow icon 203 may be used to illustrate a first flight parameter, such as speed, as further discussed below in connection with
In some embodiments, the first arrow icon 203 may include a ball icon 204 with which a controller may use to interact with the flight parameters 101, 104. In some embodiments, the ball icon 204 may be displayed outside of the compass rose icon 202. For example, the ball icon 204 may appear at the tip of the first arrow icon 203, which, when selected, may enable a controller to alter the flight parameters 101, 104 by dragging the ball icon 204 along a pane of the GUI 100. The ball icon 204 may be shown with one or more visual cues, such as a change in color, indicating that the ball icon 204 has been selected or deselected. For example, a ball icon 204 may be illustrated in a first color as attached to a first arrow icon 203 on the GUI 100. Upon selection of the ball icon 204, the ball icon 204 may be illustrated in a second color. Furthermore, when the ball icon 204 is deselected, the icon 204 may return to the first color.
Furthermore, instead of dragging the ball 204 and second arrow icons 301, the icons 204, 301 may be manipulated in alternative ways. In an example, the icons 204, 301 may be manipulated such that dragging the ball icon 204 parallel to the second arrow icon 301 changes the length of the second arrow icon 301. Increasing and decreasing the vector of the second arrow icon 301 may correlate to a change in a flight parameter 302, 303, such as the speed parameter 302. For example, a controller may drag the icons 204, 301 away from the center of the compass rose icon 202, such that the second arrow icon 301 lengthens. The longer second arrow icon 301 may represent the selection of an increase in the speed parameter 302 proportionate to the lengthening of the icon 301. In further embodiments, various methods of manipulating the ball 204 and second arrow icons 301 may be combined to change more than one flight parameter 302, 303 at once (e.g., GUI 100 may be used to generate simultaneous commands to modify two or more flight parameters).
In some embodiments, after dragging the ball 204 and second arrow icons 301 to a new location on the compass rose icon 202, releasing the ball icon 204 may place the icons 204, 301 at the new location. The new location on the compass rose icon 202 may depict one or more selected flight parameters 302, 303. For example, the ball 204 and second arrow icons 301 may be dragged from a heading 104 of 240 degrees, as shown on the compass rose icon 202, to a heading 303 of 120 degrees, as shown on the compass rose icon 202. Thus, by dragging the ball 204 and second arrow icons 301 around the compass rose icon 202, a controller may be able to select one or more flight parameters 302, 303 by releasing the icons 204, 301 at a new location.
In some embodiments, one or more flight parameters 302, 303 may be selected by releasing the ball icon 204 at a new location on the compass rose icon 202, where the new location is associated with the one or more selected flight parameters 302, 303. When the one or more selected flight parameters 302, 303 are chosen, a command to execute the one or more selected flight parameters 302, 303 may be detected, generated, and transmitted to an aircraft associated with the aircraft icon 103. For example, releasing the ball icon 204 at a location on the compass rose icon 202 representing a heading 303 of 240 degrees, may result in a command being detected, generated, and/or transmitted to the aircraft to change the aircraft's heading 303 to 240 degrees. Therefore, in some embodiments, the manipulation of the ball 204 and second arrow icons 301 to a new location on the compass rose icon 202 may enable a controller to choose one or more selected flight parameters 302, 303 for the aircraft to execute. Thus, the GUI 100 on the display device can provide an easy-to-understand visual representation of flight parameters 101, 104 that a controller can intuitively change by dragging an arrow icon (e.g., second arrow icon 301) around a compass rose icon 202.
Alphanumerical representations of one or more selected flight parameters 302, 303 may be illustrated on the GUI 100. In some embodiments, when the ball icon 204 is selected, one or more representations of the selected flight parameters 302, 303 may appear proximate to the ball 204 and second arrow icons 301. The selected flight parameters 302, 303 may correspond to the location of the ball 204 and second arrow icons 301 with respect to the compass rose icon 202. For example, when the ball icon 204 is selected and the second arrow icon 301 appears, one or more flight parameters 302,303 may also appear proximate to the two icons 204, 301. In some embodiments, as the icons 204, 301 are manipulated, the one or more alphanumerical representations may change corresponding to the changing flight parameters 302, 303. For example, when the ball icon 204 is dragged from a heading of 315 degrees to 258 degrees, as depicted on the compass rose icon 202, the displayed heading flight parameter 303 may also change from a value of 315 to a value of 258. The direct manipulation of the icons 204, 301 may show increasing or decreasing speed 302 or the directional change of the heading 303, which is conveyed by the movement and new position of the icons 204, 301, as well as the value corresponding to flight parameters 302, 303 displayed adjacent to the icons 204, 301.
By depicting the changing flight parameters 302, 303, the GUI 100 can provide a controller immediate, continuous, and precise feedback, while avoiding ambiguity. For example, when a controller enters a heading 303 using the icons 204, 301, the controller's movement of the icons 204, 301 may direct the turn of the aircraft. In turn, the GUI 100 can display an informative representation of the direction of the aircraft's turn (e.g., right, or left), while the numerical representation of the heading 303 proximate to the icons 204, 301 can furnish the controller with relevant detailed information.
Additionally, the illustration and manipulation of flight parameters 302, 303 via the GUI 100 can reduce the probability of data entry errors. The likelihood of data entry errors is high when there is an abstract level of symbolism (e.g., symbols and/or letters) in which the data is entered. For example, when a controller, via traditional data entry, attempts to command an aircraft to descend to an altitude of 10,000 ft but misses a keystroke and enters the value 1,000 ft, the ramifications could be significant and detrimental. While missing a keystroke during data entry is extremely easy, noticing the error may not be, thus error correction may not occur fast enough to prevent accidents. To avoid such errors, the GUI 100 presents a controller using the display device with concrete visual elements including, but not limited to, manipulatable icons (e.g., ball 204 and second arrow icons 301) and alphanumerical representations of current flight parameters 101, 104 and/or selected flight parameters 302, 303. Moreover, the GUI 100 is capable of supplying a controller with immediate and proportional feedback. For example, if a controller attempts to alter the heading 303 to 325 degrees, but inadvertently inputs 200 degrees, the visual representation on the GUI 100 can clearly depict the proportionally significant discrepancy between the selected and intended heading flight parameters 303 enabling the controller to promptly correct the error.
Flight parameters 101, 104 may also be adjusted via a sidebar present on the GUI 100. In further embodiments, one or more flight parameter 101, 104 (e.g., altitude) may be adjusted via controller input on at least a sidebar of the GUI 100. For example, a controller may command an aircraft to change altitude by selecting a sidebar on the GUI 100 and inputting a new altitude. Based on the controller input via the sidebar, a command to execute the selected one or more flight parameters 302, 303 may be detected, generated, and transmitted to the aircraft associated with the aircraft icon 103.
In some embodiments, when one or more flight parameters 101, 104 are manipulated, the flight parameters 101, 104 may also “stick” to the current values until the flight parameters 101, 104 are manipulated beyond a threshold. When the selected flight parameter 302, 303 values exceed the threshold, the values become freely adjustable. For example, a GUI 100 may depict information illustrating that the heading 104 of a particular aircraft is currently 315 degree, while the speed 101 is 100 knots. When a controller attempts to manipulate the ball 204 and second arrow icons 301 to a location on the compass rose icon 202 showing a heading 303 of 258 degrees, the icons 204, 301 may ‘stick’ to the current heading 104 of 315 degrees and the current speed 101 of 100 knots. Once the icons 204, 301 are manipulated beyond a particular threshold for the heading 104, but not the speed 101, the icons 204, 301 may become freely adjustable with respect to the heading flight parameter 104, but not the speed flight parameter 101. In this way, the controller may be able to select the desired heading 303 of 258 degrees while the speed flight parameter 101 remains unchanged. Thus, it can be easier to manipulate one flight parameter 302, 303, while keeping a different flight parameter 101, 104 value constant.
After a predetermined time period has elapsed, the ball icon 204 may be depicted with one or more visual cues to convey various events. For example, the ball icon 204 may turn magenta first color after 10 seconds to convey that flight landing procedure has been initiated for the aircraft associated with the aircraft icon 103. In some embodiments, the predetermined period of time may be associated with a controller interaction with the GUI 100 and/or the ball icon 204. Particularly the depiction of one or more visual cues may convey that the ball icon 204 and/or one or more locations on the GUI have not been interacted with for a predetermined period of time. For example, if a controller has not interacted with the ball icon 204 for 10 seconds, the ball icon 204 may change colors, change opacity, disappear, etc. In another embodiment, the depiction of the ball icon 204 with one or more visual cues after a predetermined period of time may be associated with one or more commands detected, generated, and/or transmitted to an aircraft associated with an aircraft icon 103. For example, a controller may select a ball icon 204 and drag the ball icon 204 to a location on the compass rose icon 202 indicating a heading 303 of 245 degrees. The ball icon 204 may then remain visible on the pane of the GUI 100 while a command, associated with changing the heading 303 to 245 degrees, is generated and transmitted to the aircraft. When the command is received by the aircraft, the ball icon 204 may then change colors, disappear, turn opaque/transparent/translucent, etc. Additionally or alternatively, once the command is executed by the aircraft (e.g., the aircraft executes the command completing the transition from its current heading 104 to a heading 303 of 245 degrees), the ball icon 204 may change colors, disappear, turn opaque/transparent/translucent, etc. In another embodiment, the predetermined period of time may be associated with a preset value or a controller input value. For example, once a controller has dragged the ball icon 204 to a location on the compass rose icon 202 indicating a heading 303 of 245, the ball icon 204 may disappear, turn opaque/transparent/translucent, etc. after a preset period of 10 seconds. If a controller wishes to change the period of time, the controller may customize the period of time, such as 20 seconds, after which, the ball icon 204 will disappear turn opaque/transparent/translucent, etc.
Additional steps/tasks/actions may be required to complete a confirmation process. In some embodiments, one or more additional selections may be required to confirm the detection, generation, transmission, and/or execution of a command by an aircraft. For example, if a heading 303 of 270 degrees is selected, before generating the command, an additional pop-up may appear at a location on the GUI 100 requesting the controller to confirm the input. If the controller selects to confirm the input, then the command corresponding to changing the heading 303 to 270 degrees may then be generated and transmitted to an aircraft for execution. This multi-step selection for sending and executing commands by an aircraft may ensure that commands are being sent intentionally. In some embodiments, if one or more additional selections are not made for a predetermined period of time, then a selected command may be cancelled. For example, if a heading 303 of 270 degrees is selected and, after a pop-up appears requesting confirmation of the command, the controller does not confirm the command for 20 seconds, the command may be cancelled. One of ordinary skill in the art will appreciate that the confirmation processes described herein are for exemplary purposes only and are not to be construed as limiting. Various additional steps/tasks/actions/operations, etc. may be enacted to complete a confirmation process.
In various embodiments, the aircraft includes one or more sensors and/or flight computer. The one or more sensors and/or flight computer may communicate with a computer system (e.g., computing device) executing the GUI 100, such that the current flight parameters 101, 104 of the aircraft are continuously obtained from the aircraft in real time. Thus, as the aircraft executes a command, a controller can be provided with up-to-date information concerning the aircraft via the GUI 100.
In some embodiments, the first arrow icon 203 may converge with the second arrow icon 301, indicating that the aircraft has completed execution of the command. One or more visual cues may be displayed when the first and second arrow icons 203, 301 come together (e.g., converges). For example, when the first arrow icon 203 converges with the second arrow icon 301, the second arrow icon 301 may disappear and/or the ball icon 204 may change colors. Furthermore, in an embodiment when the second arrow icon 301 converges with the first arrow icon 203, the ball icon 204 may remain on the GUI 100, appearing at the tip of the first arrow icon 203. In another embodiment, the ball icon 204 may disappear when the second arrow icon 301 and the first arrow icon 203 converge. Once the first arrow icon 203 and the second arrow icon 301 converge, the first arrow icon 203 may disappear such that the GUI 100 only depicts the second arrow icon 301. The remaining second arrow icon 301 may indicate that the command sent to the aircraft has been executed and, in turn, the GUI 100 may illustrate the new flight parameters 302, 303. For example, a controller may select and drag a second arrow icon 301 to a location on the compass rose icon 202 representing a selected heading 303 of 258 degrees and a selected speed 302 of 100 knots. When the first arrow icon 203 converges with the second arrow icon 301, an aircraft has completed execution of a command to change the heading to 258 degrees and the speed to 100 knots. The GUI will then reflect the new flight parameters 302, 303 as a heading of 258 degrees and a speed of 100 knots.
In some embodiments, one or more visual cues may be used to indicate that the transmission of a command to an aircraft has been unsuccessful. For example, if there is a disruption in the transmission of a command to an aircraft and the command is not received, the second arrow icon 301 may change color, showing the controller that the command has not been received by the aircraft. By using one or more visual cues to convey that a command is being transmitted and has been successfully or unsuccessfully received by an aircraft, a controller can be made aware of potential communication issue with a particular aircraft. With this information, the controller may then be empowered to remedy the situation. For example, the controller may resend a command that was not successfully received.
In various embodiments, one or more flight parameters 302, 303 may be constrained to a defined range based on the operating envelope of the aircraft. For example, if it is determined that the operational limit of the aircraft speed is 150 knots, then the speed 302 will be constrained to a maximum speed of 150 knots to stay within the flight envelope. This may limit the range of commands that may be generated and transmitted to the aircraft. For example, if the speed 302 is set to have a range between 100 knots and 150 knots, then if a controller attempts input a speed 302 of 160 knots, a command may not be generated and/or transmitted to the corresponding aircraft.
In some embodiments, when a selected flight parameter 302, 303 that exceeds a set limit is chosen, a visual indicator 602 may be displayed indicating that the selected flight parameter 302, 303 is beyond the set limit. For example, if an upper limit of 100 knots is selected for the speed 302 of an aircraft and a controller attempts to select a speed 302 of 160 knots, a visual indicator 602 may be displayed on the pane of the GUI 100 to inform the controller that the chosen speed 302 is outside the permitted range. Thus, instead of transmitting a command to the aircraft to change the speed 302 to a value outside the permitted range, the input and/or transmitting of the command is rejected preventing execution of the unpermitted speed change.
Additionally and/or alternatively, one or more selected flight parameters 302, 303 may be constrained by limiting the movement of the second arrow icon 301 and/or its correlating target value. For example, if the controller attempts to select a flight parameter 302, 303 that exceeds the set limit 601 by dragging the ball 204 and second arrow icons 301 to a new location on the compass rose icon 202, the ball 204 and second arrow icons 301 may snap back to the position of the first arrow icon 203, effectively preventing the controller from selecting the prohibited value (e.g., prohibited flight parameter). One or more visual cues, such as the second arrow icon 301 flashing and/or changing colors, may also indicate that the selected flight parameter 302, 303 is prohibited. For example, if headings between 225 degrees and 270 degrees constitute prohibited flight parameters, then when the controller drags the ball 204 and second arrow icons 301 through the area of the compass rose icon 202 which represents that heading range of 225 degrees to 270 degrees, the second arrow icon 301 may turn opaque/transparent/translucent, change colors, flash, etc. to indicate that a selection of a heading 303 within the particular range is prohibited. Alternatively or additionally, when the ball 204 and second arrow icons 301 are moved and released at a location on the compass rose icon 202 representing a prohibited action and/or prohibited flight parameters, the ball 204 and second arrow icons 301 may turn color, change opacity, etc. and gradually return to the position of the first arrow icon 203. In some embodiments, if the ball 204 and second arrow icons 301 are being dragged over an area of compass rose icon 202 representing a prohibited action (e.g., selection of one or more prohibited flight parameters 302, 303), one or more visual cues may be presented to show that the ball 204 and second arrow icons 301 are over a location which is disallowed. For example, in the case where a heading range between 225 degrees to 270 degrees is prohibited, when a controller drags the ball 204 and second arrow icons 301 through this range on the compass rose icon 202, the ball 204 and second arrow icons 301 may change colors, turn opacity, flash, appear as dashed lines, disappear, etc. This changing in the depiction of the ball 204 and second arrow icons 301 may then convey to the controller that an attempt to select a heading 303 between 225 degrees to 270 degrees will be rejected.
In some embodiments, if a hazardous or restricted location intersects a selected flight route, a visual indicator 602 may be displayed indicating that the flight route includes a hazardous or prohibited location. For example, if there is an attempt to direct the aircraft in the direction of a restricted location, a visual indicator 602 may be displayed on a pane of the GUI 100 to inform the controller that the chosen flight route includes the restricted location. When it is determined that a hazard and/or restricted location intersects a selected route of the aircraft, the execution of said route may be prevented. Thus, a controller is given a clear indication that the selected route may be ill-advised to travel, and a potential accident may easily be averted.
In some embodiments, a portion of the compass rose icon 202 may be depicted with one or more visual cues to indicate that a hazardous or restricted location will intersect a flight route corresponding to the selection of the portion of the compass rose icon 202. For example, a portion of the compass rose icon 202 representing a heading 303 between 0 degrees to 45 degrees may be depicted in a different color, opacity, etc. than the other portion(s) of the compass rose icon 202. The controller is thus provided a visual representation that a selection of a particular location on the compass rose icon 202 corresponds to a flight path intersecting with a hazardous or restricted location. Thus the controller may more easily avoid ill-advised or dangerous travel routes easily averting potential errors and/or accidents.
The animated GUI 100 described herein is contextual. According to various embodiments, the upper and/or lower limits may be provided by the traffic control data associated with the location, built into the flight map 102, entered by the controller, or auto populated based on live data received from an external source at the server computer executing the GUI 100.
The animated GUI 100 described herein is transparent and/or translucent. According to various embodiments, the animated GUI 100 may render minimal structure (e.g., an annotated compass rose icon 202, rotated to the appropriate magnetic declination), dynamic translucency, no background, and few pixels, hence significant background information on the flight map 102 nor around the aircraft icon 103 is not obscured.
The animated GUI 100 described herein is intuitive. According to various embodiments, the animated GUI 100 accepts input from the controller by manipulating the head of a first arrow icon 203. This first arrow icon 203 indicates current heading 104 and speed 101. Once the head of the first arrow icon 203 is moved, in addition to continuing to show the current heading 104 and speed 101, another second arrow icon 301 (different color) is rendered showing the target heading 303 and speed 302.
Embodiments may also provide one or more non-transitory computer-readable storage medium storing instructions that, upon execution on a computer system (e.g., computing device), cause the computer system (e.g., computing device) to perform the method described above. Embodiments may also provide a system comprising a display screen, one or more processors, and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform the method described above.
At step 1004, an aircraft is represented with a first icon (e.g., aircraft icon 103) of a plurality of icons on the GUI 100. For example, referring back to
At step 1006 the computing device receives an input manipulating a second icon (e.g., a ball icon 204, a first arrow icon 203 and/or a second arrow icon 301) which represents a flight parameter 302, 303 associated with the aircraft. The input manipulating the second icon (e.g., a ball icon 204, a first arrow icon 203 and/or a second arrow icon 301) moves the second icon from a first position to a second position on the GUI 100. For example, referring to
At step 1008 a command based at least in part on the manipulation of the second icon (e.g., a ball icon 204, a first arrow icon 203 and/or a second arrow icon 301) representing the flight parameters 302, 303 is transmitted to the aircraft represented by the first icon (e.g., aircraft icon 103). In some embodiments, information corresponding to the flight parameters 302, 303 associated with the aircraft may be displayed in proximity to the first icon (e.g., aircraft icon 103) representing the aircraft. For example, referring to
As shown, the computing system 1100 may comprise one or more processors 1104, a system memory 1102 (which may comprise any combination of volatile and/or non-volatile memory such as, for example, buffer memory, RAM, DRAM, ROM, flash, or any other suitable memory device), a network interface 1106 (e.g., an external communication interface), and a computer readable medium 1108 (e.g., non-transitory computer readable medium 1108 storing instructions). Moreover, one or more of the modules may be disposed within one or more of the components of the system memory 1102 or may be disposed externally. The software and hardware modules shown in
The network interface 1106 may be configured or programmed to receive and generate electronic messages comprising information transmitted through the computing system 1100 to or from the plurality of autonomous aircraft 1140 (e.g., transmitting and executing instructions). The computing system 1100 may also include at least one display device 1110 for displaying a GUI 100. When an electronic message is received by the computing system 1100 via external communication interface (e.g., network interface 1106) of the computing system 1100, it may be processed, and relevant information may be displayed on the display device 1110 via the GUI 100. When an input is received from the controller 1130 via the GUI 100, it may be processed and relevant information may be transmitted to the corresponding autonomous aircraft 1140. For example, a controller 1130 may use an input device 1150 to input a command to be sent to a plurality of autonomous aircraft 1140. The command may be received by the computing system 1100 where the command is processed and transmitting to the plurality of autonomous aircraft 1140 for execution. According to various embodiments, the computing system 1100 may further be configured to receive supplementary information from third parties, such as air traffic control, weather, other aircraft (e.g., an aircraft that monitors the one or more autonomous aircraft 1140 in the air), etc. The supplementary information may be processed by the computing system 1100 and displayed on the GUI 100 via the display device 1110.
In the foregoing specification, embodiments of the disclosure have been described with reference to numerous specific details that can vary from implementation to implementation. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. The sole and exclusive indicator of the scope of the disclosure, and what is intended by the applicants to be the scope of the disclosure, is the literal and equivalent scope of the set of claims that issue from this application, in the specific form in which such claims issue, including any subsequent correction. The specific details of particular embodiments can be combined in any suitable manner without departing from the spirit and scope of embodiments of the disclosure.
Additionally, spatially relative terms, such as “bottom,” “top” or “side” and the like can be used to describe an element and/or feature's relationship to another element(s) and/or feature(s) as, for example, illustrated in the figures. It will be understood that the spatially relative terms are intended to encompass different orientations of the device in use and/or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as a “bottom” surface can then be oriented “above” other elements or features. The device can be otherwise oriented (e.g., rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.
The methods, systems, and devices discussed herein are examples. Various embodiments may omit, substitute, or add various procedures or components as appropriate. For instance, features described with respect to certain embodiments may be combined in various other embodiments. Different aspects and elements of the embodiments may be combined in a similar manner. Also, technology evolves and, thus, many of the elements are examples that do not limit the scope of the disclosure to those specific examples.
Terms “and,” “or,” and “an/or,” as used herein, may include a variety of meanings that also is expected to depend at least in part upon the context in which such terms are used. Typically, “or” if used to associate a list, such as A, B, or C, is intended to mean A, B, and C, here used in the inclusive sense, as well as A, B, or C, here used in the exclusive sense. In addition, the term “one or more” as used herein may be used to describe any feature, structure, or characteristic in the singular or may be used to describe some combination of features, structures, or characteristics. However, it should be noted that this is merely an illustrative example and claimed subject matter is not limited to this example. Furthermore, the term “at least one of” if used to associate a list, such as A, B, or C, can be interpreted to mean any combination of A, B, and/or C, such as A, B, C, AB, AC, BC, AA, AAB, ABC, AABBCCC, etc.
Reference throughout this specification to “one example,” “an example,” “certain examples,” or “exemplary implementation” means that a particular feature, structure, or characteristic described in connection with the feature and/or example may be included in at least one feature and/or example of claimed subject matter. Thus, the appearances of the phrase “in one example,” “an example,” “in certain examples,” “in certain implementations,” or other like phrases in various places throughout this specification are not necessarily all referring to the same feature, example, and/or limitation. Furthermore, the particular features, structures, or characteristics may be combined in one or more examples and/or features.
In the preceding detailed description, numerous specific details have been set forth to provide a thorough understanding of claimed subject matter. However, it will be understood by those skilled in the art that claimed subject matter may be practiced without these specific details. In other instances, methods and apparatuses that would be known by one of ordinary skill have not been described in detail so as not to obscure claimed subject matter. Therefore, it is intended that claimed subject matter not be limited to the particular examples disclosed, but that such claimed subject matter may also include all aspects falling within the scope of appended claims, and equivalents thereof.
This application claims benefit under 35 USC § 119(e) to U.S. Provisional Patent Application No. 63/440,652 filed Jan. 23, 2023 and entitled “Flight Guidance Controller,” the disclosure of which is incorporated by reference herein in its entirety for all purposes.
Number | Date | Country | |
---|---|---|---|
63440652 | Jan 2023 | US |