This application relates generally to a flight detail assistance application and interactive map systems on or associated with aircraft in-flight systems and/or dedicated terrestrial systems, and more particularly to allowing a user/passenger to access and/or control information related to or concerning the passenger's flight on their personal electronic devices (PEDs) and to allow the passengers interactive control over a map display on their PEDs.
Most, if not all, aircraft that provide in-flight entertainment displays offer some sort of map illustrative of the vessels' current position, along with other useful information such as time, altitude, temperature, expected local arrival time, and remaining flight time to name a few. The maps may be highly detailed or simple displays. The provided maps become increasing important during longer flights where passengers need supplemental sensory input (particularly when crossing multiple time zones) to assist in regulating things like sleeping, eating, limited physical movement, and entertainment (i.e., passing the time). Simply put, it appears to help to know things like how much longer the flight is and what time it will be when you arrive at your destination.
Although there have been recent improvements in in-flight map services, most improvements can be generically described as simply providing more data to the user/passenger. For example, providing factoids or pictures of the origination city, destination city, or locals along the flight path. While such features are an improvement, what is needed is a system that, while conveying the same useful data, provides a simulator or game like environment to the map display. Another feature that has been lacking in prior systems is to allow a user/passenger to enjoy the benefits of an in-flight map service utilizing their personal electronic device (PED). If the flight data is coupled with a specialized application, the full advantages of the enhanced map system can be enjoyed. Likewise, the enhanced map system is still capable of interfacing with and providing useful data to third party map displays.
There is likewise a myriad of information available to a passenger related to their airline travel, such as information about the departure airport, connecting flights, the destination airport, the destination city, transit options, hotels, restaurants, etc. Known systems and methods for obtaining the information on these many items is to individually access mostly disparate systems and obtain the information piecemeal. This type of information is rarely, if ever, based on real-time feedback from the passenger. That is, none of the known systems functions with spatial awareness of the passenger's location and/or interaction with the individual systems.
Therefore, what is needed is a system/method that is spatially aware of the passenger's location and/or feedback with the system in order to provide appropriate information to the passenger automatically or through interaction with the passenger. Also what is needed is an interactive map display system/method that provides the passenger with significant ability to interact with the map.
A method and system for providing a different interactive map to a plurality of passengers on an aircraft is disclosed. The method comprises receiving and converting flight specific data from an aircraft interface module; retrieving map imagery data stored on a media server located on the aircraft; first rendering a graphical representation of the retrieved map imagery data; second rendering a text layer to be overlaid on the graphical representation of the retrieved map imagery data from the media server; packaging the flight specific data, the graphical representation of the retrieved map imagery data, and the text layer with a server based application; transmitting the package data to a client based application for display; receiving request from the client based application for different imagery and text data; and repeating the retrieving, first and second rendering, packing, and transmitting steps based on received request from the client based application.
The method may allow the client application to have no map imagery data. The package data may be configured to permit no rendering to be done by the client application during display. The method may further include sending a map of a destination airport to the client based application on a passenger PED, the map including a terminal map and restaurants. The method may also include sending an assigned baggage claim number at the destination airport for the aircraft and associated flight to the client based application and/or sending government customs procedures at the destination airport to the client based application.
A method and system for providing a different interactive map to a plurality of passengers on an aircraft is also disclosed. The method comprises requesting flight specific data and map imagery using a client based application running on a personal electronic device (PED); receiving a raw data stream from a server application comprising converted flight specific data, and stored map imagery data; rendering the map imagery data per instructions of the client based application; displaying the rendered map imagery data and a text layer; requesting from the server based application different imagery and text data; and repeating the receiving, rendering, and displaying steps based on subsequent request from the client based application.
The method may include receiving at least one polling request on the PED as to whether the passenger has boarded an aircraft, connecting to an in-flight server of the aircraft upon receipt of the polling request via the PED, and downloading data for generating a visual map associated with the aircraft on the PED. The method can further include continuously receiving flight specific data on the PED while on board the aircraft, the flight specific data including aircraft position and expected landing time.
In an embodiment, a disclosed method includes detecting a position of an aircraft based on data from a aircraft interface module, calculating an expected arrival time of the aircraft at a destination airport based on the aircraft position, determining whether the aircraft is ahead or behind schedule based on the expected arrival time, retrieving a flight itinerary for a passenger personal electronic device (“PED”) including a scheduled connecting flight at the destination airport, providing an earlier connecting flight to the passenger PED for booking if the aircraft is ahead of schedule, and providing a later connecting flight to the passenger PED for booking if the aircraft is behind schedule. The method can also include automatically re-booking the later connecting flight when the scheduled connecting flight has already departed the destination airport. The method may include checking a set of permissions and preferences on the passenger PED prior to re-booking to determine whether automatic re-booking is enabled.
The preferences may specify a minimum layover time between the expected arrival time and departure time of an alternative connecting flight. The preferences may also specify alternative airports to reach as a final destination. The detected position may be based on aircraft position information from an in-flight server, global positioning system (“GPS”), and/or wifi location data.
a illustrates a method for providing a in-flight map display with a majority of processing and image rendering performed on the server.
b illustrates a method for providing a in-flight map display with a majority of processing and image rendering performed on the client (i.e. PED).
In the embodiment of
In an alternative embodiment, a PED may be hardwire connected or wirelessly connected to the server 120, for example, using either Ethernet, Universal Serial Bus (USB), or a similar communication protocol, or a wireless communication device compatible with the wireless communication component of the PED. In at least one embodiment, the PEDs are connected via a wired connection, e.g. USB, as further detailed in U.S. application Ser. No. 13/230,675 filed Sep. 12, 2011, entitled “In-Flight System” which is incorporated herein by reference in its entirety for all purposes. In one embodiment, the in-flight system is configured to connect wirelessly to a user PED when they enter the aircraft and if the necessary application software is not available on the PED, the in-flight system may offer to push the application software, so that when the user reaches their seat, their PED comprises the necessary software (e.g., smart phone application) to access the in-flight system, access or control related flight information, and access to an interactive map environment. For example, a HTTP server push may be used. In one embodiment, when the user connects their PED to the in-flight system, only the specific application software may be used on the PED, and all other functions/applications are disabled. The application software may be referred to as a flight details application.
In general, the word application, as used herein, refers to logic embodied in hardware or software instructions, which can be written in a programming language, such as Java™, PHP, Perl, PHP, HTML, CSS, and/or JavaScript, for example. A software application can be compiled into executable programs or written in interpreted programming languages. Software applications may be callable from other applications, engines, or themselves. Generally, the applications described herein refer to logical modules that may be merged with other engines or applications or divided into sub-engines despite their physical organization. The applications can be stored in any type of computer readable medium or computer storage device and be executed by one or more general purpose computers. In addition, the methods and processes disclosed herein can alternatively be embodied in one or more applications, or specialized computer hardware.
An aircraft interface module 110 may be connected to the server 120 to provide, among other things, flight data such as GPS coordinates, speed, altitude, time, temperature, yaw, pitch, and roll values. This data may be used by the server 120, for example, in conjunction with a map application either at the server 120 or on a user's PED, to provide the user with information regarding the status of the flight. Usually, the communication between aircraft interface module 110 and server 120 is a one-way communication, that is, aircraft interface module 110 sends flight data and server 120 receives and then utilizes or distributes the flight data. Of note, Aircraft interface module 110 and server 120 may reside on physically separate machines, such as computers, or be on the same machine. In addition, the illustrated system and devices may be configured to operate in local, remote, or cloud computing environments.
In one embodiment, a media loader module 150 may be connected to the server 120. The media loader module 150 may be used to upload and/or download media contents and information to/from the aircraft from/to an external entity 140. External entity 140 may be third party media content providers, the airline, or another aircraft. Alternatively, external entity 140 may be a terrestrial media storage facility for the in-flight system. Media loader module 150 may communicate with the external entity 140 through a wired or wireless communication medium while the aircraft is on the ground, or solely through a wireless communication medium while the aircraft is taxing or flying at an altitude while wireless communication is possible, or through a satellite at high altitudes. In one embodiment, media loader module 150 is used to load specialized materials (e.g., GUIs, fonts, graphics, etc.) and/or mass media updates from local removable storage that would be more efficiently updated locally than via an external entity 140. Additional description regarding the above described hardware architecture, as illustrated in
Server 120, and other devices shown, can include one or more central processing units (CPUs), a memory, such as random access memory (RAM), to store information temporarily or permanently, one or more input/output (I/O) devices and interfaces, such as a network interface or card, keyboard, and the like to receive or transmit data. Sever 120 may further comprise a storage device, such as one or more hard drives. The storage device includes one or more data repositories having a variety of structured or unstructured content, such as file systems or databases. Components of server can be interconnected using a standards based bus system, such as Peripheral Component Interconnect (PCI), for example. Server 100 may include various operating systems, web servers, hardware resources. The operating systems and other software may manage the various hardware resources, and provide a graphical user interface (GUI) through a web server, for example.
In one embodiment, the applications and communications processor 210/220 may operate under one or more platforms. In an embodiment, the PED 200 at least supports the Google Android™ application programming interface (API) provided by the Android™ platform. The PED 200 may run one or more Android™ applications in order to communicate with the server 120 that also runs on a platform, for example the Android™ platform. The PED 200 preferably communicates with the server 120 through wireless and the like, but is also configured to communicate with server 120 via a wired connection. When the PED 200 is accessing server 120 via a wireless network using, for example, wireless fidelity (“wifi”) protocol, the PED 200 may be implemented using Android™ android.net.wifi package to access the server. Further information on the Android™ application programming interface (API) and software development kit (SDK) may be found at http://developer.android.com/sdk/index.html.
Data regarding the aircraft's position, including but not limited to longitude, latitude, altitude speed, and heading are communicated via the server 120 to PED 200 (illustrated by two different embodiments in
Although it is possible to use a third party map application and “spoof” the GPS information, a process that will be detailed further below, an interactive map system as disclosed herein realizes its full potential with a customized (i.e. proprietary) map application that is written for the exact data provided by the Aircraft Interface Module 110 and the stored map graphics delivered by the server 120. Such an application utilizes the broadband 290 connection controlled by the communications processor 220 to most efficiently communicate the data to the applications processor 210 running the specifically designed application. The interactive map application drives the PED 200 to produce an output on the display 240 which can be interacted with via the user input 230 which may consist of numerous keys/buttons or may be a touchscreen interface coupled to the display 240. Specific operational strategies will be discussed further below with reference to
The present disclosure contemplates, in one embodiment, a custom designed flight details application, a major component of which is the map display function, running on either a passenger's PED or on in-seat hardware, which may represent the same or similar hardware as a passenger's PED, but be located in a fixed position (e.g., headrest or seat arm). The flight details application receives data from the server 120 via either a wired or wireless connection. The map application utilizes the data from the server 120 to render a visual map environment on the passenger's PED. The data may be utilized to render a plurality of different map views, for example, a globe view, a day/night boundary view, a satellite view, a night view, an information view, a time zone view, a plurality of 3-D views, a direction view, and a information view, to name a few. Several of these views allow the user to “interact” with the map. In the present disclosure, interaction means moving through the map in a game-like manner. This means that a user/passenger can fly through the map to experience different sights without being limited to the flight plan.
Such an experience requires an increase in processor power and bandwidth. As each passenger can now experience the map in a unique manner (i.e., that no two passenger will interact with the map identically), the data stream to each device will also be unique. The only constant data amongst the plurality of users will be the actual flight data. Each user that chooses to interact with the map will require a unique set of map imagery data. In one embodiment, all imagery data is saved on board the vessel and queued to the user as requested. In another embodiment, the server 120 initially only queues up the map imagery along the anticipated flight path. In one embodiment, as a user interacts with a map view, the most recent map imagery data received from server 120 is queued locally by PED 200. The server 120 may also comprise a repository of non-real time information (e.g., locale factoids, trivia, names of geographical features, etc. . . . ) that are transmitted to PED 200 for presentation with other map views, whether an interactive view or a static view. In one embodiment, the flight details application in conjunction with the flight management system (e.g., aircraft interface module, flight computer, server 120, etc. . . . ) is spatially aware of the vessel's present location in relation to the saved imagery and information database on server 120 and automatically triggers a communication to users that authorize such communication (e.g., e-mails, texts, advertisement banners within the map application, etc. . . . ). In at least one embodiment, all or the majority of imagery and information data rendering is performed by the PED 200 and the server 120 is merely transmitting data. This reduces the processor load at server 120 and more efficiently utilizes the collective processing power of devices (i.e., PED) brought on board the vessel. Specific implementations will now be discussed, but should not be considered limiting in practicing the present disclosure. A person of ordinary skill in the art would recognize that there are a plurality of ways to implement the ideas disclosed within, and said implementations are contemplated by this disclosure.
a illustrates a method for providing an in-flight map display with a majority of processing and image rendering performed on the server. The in-flight map display method of
In the other parallel path, the method requests stored satellite imagery data based on the map being viewed by the user in step 340. This imagery data is stored in a non-graphic format, for example, binary, and may or may not be encrypted and/or compressed. At step 360, the satellite imagery data is rendered into a visual map. A separate text layer may be rendered from information stored on the server 120 (e.g., names of geographical features, airline specific information, menus, etc. . . . ) at step 350. The rendered text map is a separate input to the visual map rendering step 360 and is layered on top of the map. The rendered map with text layer is then sent as an input to the server application at step 370. The server application then combines the flight information with the visual map presentation and sends actual graphic data at step 380 (e.g., full or partial screen jpegs or bitmap frames) to a user interface such as PED 200 or a SDU as described briefly herein and in further detail in U.S. application Ser. No. 13/230,675.
In this embodiment, the client side hardware (e.g., PED 200 or a SDU) is not required to render the maps or perform conversion on flight specific data. Rather all that is required from the client side hardware is to run the flight details application. The flight details application, among other things, displays the graphics data transmitted by the server application on server 120 at step 370. The flight details application also provides user feedback to the interactive map application by presenting menus and accepting user input to facilitate user interaction with the map.
In this embodiment, if each user is allowed to interact differently with the map application, then a extremely large amount of processing power and bandwidth are consumed by the server 120 running the server side application. This type of implementation is preferable for server hardware having such precious power and bandwidth.
b illustrates a method for providing an in-flight map display with a majority of processing and image rendering performed at the client (i.e. PED 200). The in-flight map display method of
In the other parallel path, the method requests stored satellite imagery data based on the map being viewed by the user in step 340. This imagery data is stored in a non-graphic format, for example, binary, and may or may not be encrypted and/or compressed. The raw stored map imagery data is then sent as an input to the server application step 370. The server application then combines the raw data sets and sends the raw data 380 to a user interface such as PED 200 or a SDU as described briefly herein and in further detail in U.S. application Ser. No. 13/230,675.
In this embodiment, the client side hardware (e.g., PED 200 or a SDU) renders the visual graphics for the maps and perform conversions on flight specific data and/or other calculations using the flight specific data. PED 200 or SDU where available are likewise utilized by the user to present menus and accept user input to facilitate user interaction with the map.
In this embodiment, with each user being allowed to interact differently with the map application, but with the majority of the processing being performed on the user's device (e.g., PED 200) the bandwidth consumed by the server 120 is running the server side application to service all the different clients with different data. With proper compression and communications planning, the bandwidth to implement such a solution can be kept in check thereby allowing the use of a less powerful server than the embodiment described in
It should understood that the network architecture or type and communication media or medium is not limited to wifi. For example, a variety of cellular or data networks may be used, including second-generation wireless telephone technology (2G), 3rd generation of mobile telecommunications technology (3G), fourth generation of mobile phone communications technology (4G), Global System for Mobile Communications (GSM), Enhanced Data rates for Global GSM Evolution (EDGE), 3rd Generation Partnership Project (3GPP), code division multiple access (CDMA), time division multiple access (TDMA), etc. In some embodiments, microwave, satellite, radio and spread-spectrum technology (e.g., 802.11), infrared network, global area network (GAN), wide area network (WAN), internet, and local area network (LAN) may also be used as the network communication methodology and medium. A variety of wired technologies may also be used as the communication medium, including twisted pair wire, coaxial cable, optical fiber, and phone lines, and power lines.
The flight details application downloads from the terrestrial server the flight plan of the user's upcoming flight and other related details at step 425. The download includes data for generating a visual map associated with the flight. At step 430, the user can interact with the map in a plurality of ways as described earlier in this disclosure. For example, the user can view the entire flight plan, fly across the flight plan or any other portion of the map in a simulator type environment, or download tourism features/data regarding different locales, including but not limited to the origination and destination cities. During and/or after each of steps 420, 425, and 430 the method polls the status of the user to determine if the user has boarded the aircraft. If so, the method proceeds to step 440 and connects to the in-flight server. From the in-flight server the process provides the flight details application with a download of flight plans and other related details at step 445. The download includes data for generating a visual map associated with the flight. Once the flight data is downloaded from the onboard server, the user can interact with the map 460 in a plurality of ways, download additional map features 450, and or download/upload flight specific information.
Once the passenger PED is connected to the in-flight server 120, at step 440, (see
In another embodiment, the flight details application uses aircraft position information if connected to the in-flight server 120 (such as in
In a further embodiment, the flight details application can be configured such that maps, direction guides, and/or government/airline procedures for a destination airport are pushed automatically to the passenger while they are connected to the in-flight server 120, in the set-up shown in
In one embodiment, the flight details application can be configured such that turn-by-turn directions to the passenger's hotel are pushed automatically to the passenger while they are connected to the in-flight server 120 or are available from a terrestrial server at the request of the passenger through the flight details application (utilizing the same flight plan entered by the passenger or received from the in-flight or terrestrial server associate with the passenger's flight details application). The turn-by-turn direction are based on GPS and wifi location data available to the flight details application.
In at least one embodiment, the flight details application can be utilized by persons not onboard or about to board the vessel, to track the status of the flight. In this embodiment, the application would function similarly to that described above, except the data would be different. The actual map data would be transmitted from a terrestrial server, and the flight information would be summary information and would come from a centralized data server and not be real-time like the on-board data.
In another embodiment as illustrated in
In another embodiment, the flight details application provides GUI and audible reminders on passenger's PED to pack, leave for the airport, or otherwise prepare for their flight based on travel info flight plan entered by the passenger or received from the in-flight or terrestrial server associate with the passenger's flight details application, GPS location, traffic to airport obtained from available internet sources, etc.
In one embodiment, the flight details application provides marketing and sales messages, incentives and offers for airport vendors or media (movies, games, etc.) to be enjoyed at airport or on aircraft to passenger at airport via a customized, dedicated graphical user interface embodied the flight details application. These features can be locally driven based on the particular signals received from local wifis 610/615 at the departure/destination airports, respectively.
In still another embodiment, the flight details application allows passengers waiting at the airport to preview entertainment options available on their aircraft, set-up or modify playlists, and create profiles of media to watch on the aircraft. This is accomplished through a customized, dedicated graphical user interface embodied in the flight details application, connecting either through an internet connection to a back-end data system. Such functionality can also be localized using wifi in the airport for locally served content, so the passenger does not need to use a cellular data plan.
If the PED user prefers the proprietary map program which may be an integral part of the in-flight system or may be a stand alone product running on the aircraft's server 120, the process provides the Aircraft Interface Info, at step 530, and the interactive map application utilizes this information to provide the user with an interactive visual map environment. As either the third party application or the proprietary application are running on a user controlled PED, the user has control over the continuation of the program and can end either process, at step 570, as would be understood by a person of ordinary skill in the art. For example, requesting the PED enter a home screen by indication of a user input.
Additional embodiments of the disclosure include identify groups of people traveling together and enable immediate, seamless onboard messaging between them (including email, txt, pictures, chat, video, & audio) using either the flight details application or other 3rd party applications. This is accomplished by having the passenger configure the group traveling together in their contact list prior to the flight. The application on the passenger's PED will communicate to a web-based back end server to determine the flight configuration of all members of the group. Once on the aircraft, connection to our servers will provide positive identification of seat location for every member of the group (communicated to the PED from the server), and APIs available on the passenger's PED will allow the application to liaise between the flight details application and third-party applications to enable direct communication between members of the group)
Another embodiment of the disclosure provides a mechanism for “pilot tweets” where the pilot, co-pilot, or other crew member sends tweets or other short messages to passengers' devices informing them of interesting or relevant data. These tweets or short messages will be delivered from the crew member via a PED or FAP or other portable electronic device into the on-board system of servers. The messages will then be propagated to all attached clients, whether they are using the flight details application, or optionally an available third-party app, and will display the messages.
This application claims the benefit of U.S. Provisional Patent Application No. 61/793,770, filed on Mar. 15, 2013, which is hereby incorporated by reference as if fully set forth herein.
Number | Date | Country | |
---|---|---|---|
61793770 | Mar 2013 | US |