This application claims priority from Korean Patent Application No. 10-2022-0094887 filed on Jul. 29, 2022, in the Korean Intellectual Property Office, and all the benefits accruing therefrom under 35 U.S.C. 119, the contents of which in its entirety are herein incorporated by reference.
The present disclosure relates to a method and apparatus for providing flight vehicle operation information, and more particularly, to a method and apparatus for providing a control screen with flight vehicle operation information displayed thereon.
A control screen is presented, displaying operation information of multiple monitored flight vehicles. Controllers utilize this control screen to assess the operational states of the monitored flight vehicles and take appropriate actions to control their operations based on prevailing circumstances.
For example, controllers employ information gathered from sensors installed in each monitored flight vehicle to anticipate and notify the pilots, via communication, about potential collision risks between the monitored flight vehicles to avert collisions among the monitored flight vehicles.
However, if the sensors malfunction or if there is inadequate communication between the controllers and the pilots of the monitored flight vehicles, it becomes challenging to accurately predict and caution against collision risks, thereby impeding effective collision prevention measures between the monitored flight vehicles.
Aspects of the present disclosure provide a method and apparatus for providing flight vehicle operation information, which provide a plurality of control screens where operation information of a plurality of monitored flight vehicles is displayed and can thereby allow a user to easily identify various information regarding the monitored flight vehicles.
Aspects of the present disclosure also provide a method and apparatus for providing flight vehicle operation information, which can accurately predict the risk of collisions between the monitored flight vehicles using a plurality of control screens and an operation information prediction model trained with artificial intelligence (AI) technology.
Aspects of the present disclosure also provide a method and apparatus for providing flight vehicle operation information, which can rapidly and efficiently inform a controller of any detected collisions between the monitored flight vehicles through a control screen.
Aspects of the present disclosure also provide a method and apparatus for providing flight vehicle operation information, which can prevent collisions between the monitored flight vehicles by providing a control screen displaying selectable collision avoidance alternatives.
However, aspects of the present disclosure are not restricted to those set forth herein. The above and other aspects of the present disclosure will become more apparent to one of ordinary skill in the art to which the present disclosure pertains by referencing the detailed description of the present disclosure given below.
According to an aspect of the inventive concept, there is a method of providing flight vehicle operation information, performed by a computing device. The method may comprise providing a first control screen, which displays first operation information of a plurality of monitored flight vehicles, inputting the first operation information and context information to a pre-established operation information prediction model and generating second operation information of the monitored flight vehicles at a future time point based on data output from the operation information prediction model, and providing a second control screen, which displays the second operation information.
In some embodiments, providing the first control screen may comprise displaying the first operation information near user interfaces (UI) that represent the respective monitored flight vehicles, displaying a list of the monitored flight vehicles in a first area of the first control screen, displaying notification messages associated with operations of the monitored flight vehicles in a second area of the first control screen, and displaying a map of a region being controlled via the first control screen in a third area of the first control screen.
In some embodiments, providing the second control screen may comprise presenting a simulated image with a playback time that corresponds to a predefined first time on the second control screen, and the simulated image may be regenerated at intervals of a predefined second time.
In some embodiments, providing the second control screen may comprise predicting a potential collision between first and second monitored flight vehicles, which are among the monitored flight vehicles, based on the second operation information, displaying information on the potential collision if the potential collision is predicted, and presenting details on how to control the first and second monitored flight vehicles to avoid the predicted collision on the first control screen.
In some embodiments, predicting the potential collision between the first and second monitored flight vehicles may comprise predicting that a collision between the first and second monitored flight vehicles will occur when a first safety range, set around the first monitored flight vehicle, overlaps with a second safety range, set around the second monitored flight vehicle.
In some embodiments, displaying the information on the potential collision between the first and second monitored flight vehicles may comprise displaying the first and second monitored flight vehicles in the list of the monitored flight vehicles in the first area of the first control screen to be visually distinguishable from other monitored flight vehicles.
In some embodiments, displaying the information on the potential collision between the first and second monitored flight vehicles may comprise displaying a warning message for the potential collision between first and second monitored flight vehicles in the second area of the first control screen.
In some embodiments, displaying the information on the potential collision between the first and second monitored flight vehicles may comprise displaying location information of the potential collision between first and second monitored flight vehicles in the third area of the first control screen.
In some embodiments, displaying the information on the potential collision between the first and second monitored flight vehicles may comprise displaying an image of a simulated collision between the first and second monitored flight vehicles on the first control screen.
In some embodiments, presenting the details on how to control the first and second monitored flight vehicles may comprise displaying safety ranges around the first and second monitored flight vehicles and displaying guidelines for avoiding the potential collision between the first and second monitored flight vehicles.
In some embodiments, the details on how to control the first and second monitored flight vehicles may be a method of controlling the first monitored flight vehicle to avoid the potential collision between the first and second monitored flight vehicles.
In some embodiments, the details on how to control the first and second monitored flight vehicles may be a method of controlling the second monitored flight vehicle to avoid the potential collision between the first and second monitored flight vehicles.
According to yet another aspect of the inventive concept, there is a provided computer system for providing flight vehicle operation information. The system may comprise at least one processor and at least one memory configured to store instructions, wherein the instructions, when executed by at least one processor, causes the at least one processor to perform providing a first control screen, which displays first operation information of a plurality of monitored flight vehicles, inputting the first operation information and context information to a pre-established operation information prediction model and generating second operation information of the monitored flight vehicles at a future time point based on data output from the operation information prediction model, and providing a second control screen, which displays the second operation information.
In some embodiments, the operation of providing the first control screen may comprise displaying the first operation information near user interfaces (UI) that represent the respective monitored flight vehicles, displaying a list of the monitored flight vehicles in a first area of the first control screen, displaying notification messages associated with operations of the monitored flight vehicles in a second area of the first control screen, and displaying a map of a region being controlled via the first control screen in a third area of the first control screen.
In some embodiments, the operation of providing the second control screen may comprise presenting a simulated image with a playback time that corresponds to a predefined first time on the second control screen, and the simulated image may be regenerated at intervals of a predefined second time.
In some embodiments, the operation of providing the second control screen may comprise predicting a potential collision between first and second monitored flight vehicles, which are among the monitored flight vehicles, based on the second operation information, displaying information on the potential collision if the potential collision is predicted, and presenting details on how to control the first and second monitored flight vehicles to avoid the predicted collision on the first control screen.
In some embodiments, predicting the potential collision between the first and second monitored flight vehicles may comprise predicting that a collision between the first and second monitored flight vehicles occurs when a first safety range, set around the first monitored flight vehicle, overlaps with a second safety range, set around the second monitored flight vehicle.
In some embodiments, the operation of displaying the information on the potential collision between the first and second monitored flight vehicles may comprise displaying the first and second monitored flight vehicles in the list of the monitored flight vehicles in the first area of the first control screen to be visually distinguishable from other monitored flight vehicles.
In some embodiments, the operation of displaying the information on the potential collision between the first and second monitored flight vehicles may comprise displaying a warning message for the potential collision between the first and second monitored flight vehicles in the second area of the first control screen and displaying location information of the potential collision between first and second monitored flight vehicles in the third area of the first control screen.
In some embodiments, the operation of providing the first control screen may comprise displaying safety ranges around the first and second monitored flight vehicles and displaying guidelines for avoiding the potential collision between the first and second monitored flight vehicles.
The above and other aspects and features of the present disclosure will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings, in which:
Hereinafter, example embodiments of the present disclosure will be described with reference to the attached drawings. Advantages and features of the present disclosure and methods of accomplishing the same may be understood more readily by reference to the following detailed description of example embodiments and the accompanying drawings. The present disclosure may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of the disclosure to those skilled in the art, and the present disclosure will be defined by the appended claims and their equivalents.
In describing the present disclosure, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present disclosure, the detailed description thereof will be omitted.
In addition, in describing the component of this disclosure, terms, such as first, second, A, B, (a), (b), can be used. These terms are only for distinguishing the components from other components, and the nature or order of the components is not limited by the terms.
Hereinafter, embodiments of the present disclosure are described with reference to the accompanying drawings.
Referring to
In S200, the first operation information and context information may be input to a pre-established operation information prediction model, and second operation information of the monitored flight vehicles at a future time point may be generated based on data output from the operation information prediction model. The context information, which is information of the surroundings of each of the monitored flight vehicles, may include meteorological data such as wind direction, wind speed, temperature, and humidity.
That is, the operation information prediction model may receive the input of the first operation information and the context information and may output predictive result data for the future state from a current time point, represented by the first operation time, as a response to the input. The information prediction model may be trained using deep learning techniques, leveraging existing flight data. Specifically, the operation information prediction model utilizes a Recurrent Neural Network (RNN) and can be trained by adjusting the ratio between actual data (or training data) and predicted data (or test data) to achieve an accuracy of approximately 95% or higher. However, the present disclosure is not limited to this.
In S300, a second control screen that displays the second operation information may be provided. The second operation information may include operation information of the monitored flight vehicles at a future time point, which is a predetermined time after the current time point. That is, the second operation information may include predicted route information from the departures to the destinations of the monitored flight vehicles, speed information of the monitored flight vehicles at the future time point, and surrounding geographical information of the locations of the monitored flight vehicles at the future time point.
The predetermined time may be defined in advance by input from a user. For example, the predetermined time may be defined as dozens of seconds to several minutes. The longer the predetermined time, the more time can be secured to avoid potential collisions between the monitored flight vehicles at the future time point. That is, the predetermined time may be set to various values depending on the user's objectives.
S300 may include providing a simulated image with a playback time corresponding to a predefined first time on the second control screen, using the second operation information. The simulated image may be regenerated at intervals of a predefined second time, and the predefined first and second times may be set to various values by the user in advance.
The first and second control screens, which provide operation information of the monitored flight vehicles, will hereinafter be described with reference to
Referring to
On the contrary, as the first and second control screens 100 and 200, which display operation information of the monitored flight vehicles at a current time point and operation information of the monitored flight vehicles at a future time point, respectively, are provided together to the user, the user can easily identify the operating states of the monitored flight vehicles. Furthermore, with the second control screen 200 displaying operation information of the monitored flight vehicles at a near future time point, the user can easily identify and avoid potential collisions between the monitored flight vehicles in advance.
Processes that may be conducted between the first and second control screens 100 and 200 will hereinafter be described with reference to
Referring to
It is determined whether there are potential collisions between the monitored flight vehicles based on the second operation information displayed on the second control screen 200. If potential collisions between the monitored flight vehicles are detected, the first computing device, which outputs the first control screen 100, may transmit the collision information to the first control screen 100, and the first control screen 100, displaying the collision information, may then be provided to the user. This will be described later in further detail with reference to
In summary, a conventional method of predicting and issuing warnings for potential collisions between multiple monitored flight vehicles, based solely on operation information for a current time point, faces spatial limitations when attempting to efficiently display various related information, such as operation information, potential collision information, and collision warning messages, on a single control screen. However, by providing the user with both the first control screen, which displays the operation information of the multiple monitored flight vehicles at the current time point, and the second control screen, which displays operation information of the multiple monitored flight vehicles at a future time point, it becomes possible to efficiently present various flight operation information.
Referring to
Referring to the first control screen 100 of
A flight vehicle list 110 including the first and second monitored flight vehicles may be displayed in a first area 101 on the right side of the first control screen 100, a notification message window 120 for notification messages associated with the operations of the first and second monitored flight vehicles may be displayed in a second area 102 on the left side of the first control screen 100, and a map of the region where the first and second monitored flight vehicles are located may be displayed in a third area 103 below the notification message window 120. The region where the first and second monitored flight vehicles are located may refer to the region being controlled by the user via the first control screen 100.
As a first control screen presenting operation information of multiple monitored flight vehicles at a current time point and a second control screen presenting operation information of the multiple monitored flight vehicles at a future time point are both provided to the user, the user can easily identify various related operation information.
It will hereinafter be described how to predict and issue warnings for potential collisions among multiple flight vehicles based on operation information of the multiple flight vehicles with reference to
Referring to
A criterion for predicting a potential collision between the first and second monitored flight vehicles based on the second operation information will hereinafter be described with reference to
Referring to
A potential collision between the first and second monitored flight vehicles may be predicted using the safety range of
A method of displaying information about a potential collision between the first and second monitored flight vehicles on the first control screen will hereinafter be described with reference to
Referring to
In S321, the status windows of the first and second monitored flight vehicles are displayed with a red border or flash in red for a particular amount of time in the list of monitored flight vehicles, among other methods, to be visually distinguished from the other listed monitored flight vehicles.
S322 through S324 will hereinafter be described with reference to
First, a method of displaying collision information in the notification message window 120, which is displayed in the second region 102 of the first control screen 100, will hereinafter be described with reference to
Referring to
If a potential collision between multiple monitored flight vehicles is detected, a warning message 122 including collision information may be displayed in the notification message window 120. The warning message 122 may be a message that is automatically generated by the flight vehicle control system and may be displayed in a visually distinguishable manner from the other notification messages, i.e., the messages 121a and the messages 121b. For example, the warning message 122 may be displayed to have a red border or flash in red for a predetermined amount of time and may thus be visually distinguishable from ordinary notification messages.
A method of displaying collision information on a map 130 of the region being controlled, displayed in the third area 103 of the first control screen 100, will hereinafter be described with reference to
Referring to
In the map 130b, the location of the detection of the potential collision may be displayed in a visually distinguishable manner, and the number of flight vehicles involved in the potential collision may also be displayed. However, the present disclosure is not limited to this, and the method of displaying collision information in the third area 103 of the first control screen 100 is not particularly limited.
The user may face difficulty in easily identify potential collisions between multiple monitored flight vehicles across multiple screens. Thus, the flight vehicle control system may promptly issue warnings for potential collisions by employing various methods, including sending vibrations or notifications to the user's smart device (such as a smartwatch or a mobile phone). Here, the user may be a controller or a pilot.
A method of displaying collision information at the center of the first control screen 100 will hereinafter be described with reference to
Referring to
Specifically, when a potential collision between the first and second monitored flight vehicles, which are among the monitored flight vehicles, is detected, a simulated collision image 140 with a playback time corresponding to a third time set in advance for the detected potential collision may be presented on the second control screen 200 and may also be presented in the middle of the first control screen 100. Here, the third time may be set to various values by the user. The location of the simulated collision image 140 on the first control screen 100 is not particularly limited, but may vary.
Referring to the left side of
A list 110a of the monitored flight vehicles including the first monitored flight vehicle may be displayed in a first area 101a, which is on the right side of the first control screen 100a, a notification message window 120a associated with the operation of the first monitored flight vehicle may be displayed in a second region 102a, which is on the left side of the first control screen 100a, and a map of the region where the first monitored flight vehicle is located may be displayed in a third region 103a, which is below the notification message window 120a. The region where the first monitored flight vehicle is located may refer to the region being controlled via the first control screen 100a by the user.
Referring to the right side of
A map 130b of the region being controlled, associated with the potential collision between the first and second monitored flight vehicles, may be displayed in a third region 103b, which is below the notification message window 120b, and an image 140 of a simulated collision between the first and second monitored flight vehicles may be displayed at the center of the first control screen 100b.
In short, when a potential collision between the first and second monitored flight vehicles is predicted or detected, the status windows of the first and second monitored flight vehicles may be displayed with a red border in the first area of the first control screen, a warning message indicating the potential collision may be displayed in the second area of the first control screen, a map of the potential location of the collision between the first and second monitored flight vehicles may be displayed in the third area of the first control screen, and an image of a simulated collision between the first and second monitored flight vehicles, currently being played on the second control screen, may be displayed in the middle of the first control screen.
Accordingly, by presenting information on potential collisions between multiple monitored flight vehicles in various manners on the first control screen, the user can be promptly and efficiently alerted to the risk of collisions.
The scenario assuming that a collision between multiple monitored flight vehicles would occur at a specific location has been described so far. However, it is also possible to predict that collisions between multiple monitored flight vehicles may occur simultaneously in various locations, depending on the situation. A method that allows the user to easily perceive information on collision situations predicted to occur simultaneously in various locations and prevent accidents in advance through simple screen operations will hereinafter be described with reference to
If collisions between multiple monitored flight vehicles are predicted to occur simultaneously in various locations, the user may be presented with a notification message indicating the predicted collisions in multiple locations. Subsequently, the user may zoom in by touch or use predefined inputs, such as mouse scrolling, to zoom out and access a first control screen 100c that displays information on the predicted collisions in multiple locations.
For example, referring to
A method of avoiding collisions using operation information of a plurality of flight vehicles according to an embodiment of the present disclosure will hereinafter be described with reference to
Referring to
Referring to
The first operation information 10a of the first monitored flight vehicle and the first operation information 10b of the second monitored flight vehicle may include the ground speeds, headings, and AGLs of the first and second monitored flight vehicles and the distance between the first and second monitored flight vehicles.
The first control screen 100 with guidelines 11a and 11b for avoiding the predicted potential collision between the first and second monitored flight vehicles may be provided. The guidelines 11a and 11b may be generated based on the existing route information and the operation information of the first and second monitored flight vehicles. Upon receiving the input of a selection for the guidelines 11a and 11b from the user, the potential collision between the first and second monitored flight vehicles may be avoided by controlling at least one of the first and second monitored flight vehicles. If no user input is received for a predefined duration, one of the guidelines 11a and 11b may be automatically selected to prevent the potential collision between the first and second monitored flight vehicles.
Although the guidelines 11a and 11b for avoiding a collision between the first and second monitored flight vehicles are presented in a two-dimensional (2D) plane, indicating potential control of either the first or second monitored flight vehicle in horizontal and vertical directions to evade the collision, it is also feasible to provide a first control screen 100 with guidelines for controlling at least one of the speed, altitude, and heading of the first and second monitored flight vehicles in a three-dimensional (3D) space for collision avoidance.
The processor 1100 controls the overall operation of the system 1000. The processor 1100 may perform computations for at least one application or program to execute methods/operations according to various embodiments of the present disclosure. The memory 1400 stores various data, commands, and/or information. The memory 1400 may load the computer program 1500 from the storage 1300 to execute the methods/operations according to various embodiments of the present disclosure. The system bus 1600 provides communication capabilities among the components of the system 1000. The communication interface 1200 supports Internet communication of the system 1000. The storage 1300 may temporarily store the computer program 1500. The computer program 1500 may include one or more instructions that implement the methods/operations according to various embodiments of the present disclosure. When the computer program 1500 is loaded into the memory 1400, the processor 1100 may perform the methods/operations according to various embodiments of the present disclosure by executing the one or more instructions.
In some embodiments, the system 1000 described with reference to
Embodiments of the present disclosure have been described above with reference to
The technical features of the present disclosure described so far may be embodied as computer readable codes on a computer readable medium. The computer program recorded on the computer readable medium may be transmitted to other computing device via a network such as internet and installed in the other computing device, thereby being used in the other computing device.
Although operations are shown in a specific order in the drawings, it should not be understood that desired results can be obtained when the operations must be performed in the specific order or sequential order or when all of the operations must be performed. In certain situations, multitasking and parallel processing may be advantageous. In concluding the detailed description, those skilled in the art will appreciate that many variations and modifications can be made to the example embodiments without substantially departing from the principles of the present disclosure. Therefore, the disclosed example embodiments of the disclosure are used in a generic and descriptive sense only and not for purposes of limitation. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent range should be interpreted as being included in the scope of the technical ideas defined by the present disclosure.
Number | Date | Country | Kind |
---|---|---|---|
10-2022-0094887 | Jul 2022 | KR | national |