Patent Application
20180192078
The present invention relates generally to vehicular entertainment systems and in particular to in-flight entertainment systems.
Entertainment systems for vehicles used in commercial passenger transport are frequently server-based. Specifically, a server stores content, e.g., media files, and provides the content via a network upon demand from client devices operated by users or passengers on the vehicle. Most often, the content is in the form of video and audio files, which are streamed to the client devices over the network. Accordingly, the server is central to operation of the entertainment system. For this reason, server-based systems in the in-flight entertainment field (IFE) are sometimes referred to as server-centric.
A disadvantage of server centric systems is that if the server becomes inaccessible the content stored on the server likewise becomes inaccessible for passengers or users of the client devices. Prior systems have addressed this disadvantage by providing alternative communication paths to the server. Hence, if there is a communication path failure, an alternate communication pathway still exists for accessing content on the server. Some systems provide multiple servers. Should one server become inaccessible, content can still be accessed via the other server. The more robust systems provide both multiple servers and redundant communication pathways.
Other types of IFE systems store content in client devices. In particular, IFE systems typically have client devices mounted at each seat for use by passengers. These systems are sometimes referred to in the IFE field as seat-centric. Seat-centric systems have an advantage in that they are not reliant on a server. However, there are disadvantages. For instance, client devices do not have the capability of a server and have far less storage capacity for content. In addition, there is a necessity for managing the content. Content is typically updated periodically as newer content becomes available. In vehicles having hundreds of seats, it is time consuming to load new content on each new client device.
Disclosed herein is a system that provides advantages of both server- and seat-centric systems.
A system is provided for entertainment on a passenger vehicle. The system includes a server disposed in the vehicle in which the server stores media files. The system further includes smart monitors disposed in the vehicle which are configured to present media selections to passengers corresponding to the media files stored by the server and receive an input from a passenger for playing one of the selections. Each smart monitor includes local content storage storing a subset of media files stored by the server.
Program logic executed by each smart monitor performs tasks including determining if a media file selected by the passenger is available from a first source, and if available, playing the media file from the first source. Program logic as used herein is defined to include software, firmware, logic implemented via hardware and/or combinations thereof.
If the media file corresponding to the passenger's input is not available from the first source, the logic determines if a media file corresponding to the request is available from a second source and if available, plays the media file from the second source. If the media file corresponding to the passenger's input is not available from the second source, the logic determines if the media file is available from a third source and if available, plays the media file from the third source.
A source may be local content storage of the smart monitor, a server, another smart monitor, or another source. Playing the media file from a source is defined herein to include submitting a request to have the media file streamed from the server or another smart monitor over the network or playing the media file from local content storage. If a smart monitor is receiving a media file being streamed from another smart monitor and the program logic determines packet loss is in excess of an acceptable level, the program logic will request the media file from a different source.
The network includes a sub-network connecting to a first group of the smart monitors and another sub-network connecting to a second group of the smart monitors. In at least one embodiment, each smart monitor includes program logic that will ignore or decline a request to stream a media file to a smart monitor on a different sub-network.
The local content storage of each smart monitor stores media files requiring an amount of storage space in bytes approximately equal on each of the other smart monitors. In another embodiment, a greater quantity of different media files is available from the server than that collectively available from media files stored on the smart monitors. The media selected for storage on the smart monitors is preferably the media that statistically most users or passengers wish to consume.
In one embodiment, the system includes seat boxes connecting the smart monitors in communication with the server via a network. Each seat box includes an ‘upstream’ port normally used for receiving communications from the server, another ‘downstream’ port normally used for sending communications to another seat box, and distribution ports in communication with the smart monitors. The system additionally includes a redundant communication connection between at least one seat box per seat column and the server for use in the event of an upstream communication path failure.
Each seat box includes program logic executed by the seat box that performs tasks including determining if the redundant communication connection is limited in capacity. If the logic determines the redundant communication connection is so limited, the program logic performs monitoring to determine if communications from the server are being received from the upstream or downstream port. If the communications from the server are being received from the downstream port, the program logic communicates to smart monitors in communication with at least one of the seat box's distribution ports to not request media files from the server. The program logic determines if the redundant communication connection is limited based on a configuration file downloaded from the server.
The smart monitors include program logic which performs tasks including determining if a media file selected by the passenger is available from the local content storage in the smart monitor. If the logic determines the media is available, the logic plays the media file from the smart monitor's local content storage.
If the media file selected by the passenger is not available from the smart monitor's local content storage and unless the communication has been received from a seat box to not request media files from the server, the logic determines if that media file is available from the server and if available, communicates a request to the server to stream the media file to the smart monitor over the network.
If a communication has been received from a seat box to not request media files from the server and the media file is not available from the local content storage in the smart monitor, the program logic of the smart monitor determines if the media file is available from one of the other smart monitors. If the media file is available, the logic communicates a request to the other smart monitor to stream the media file over the network to the smart monitor that communicated the request.
In yet another embodiment, a vehicle entertainment system is provided including a server disposed in the vehicle and storing media files. The system includes smart monitors disposed in the vehicle which are configured to present media selections to passengers corresponding to the media files stored by the server and receive an input from a passenger for playing one of the selections. Each smart monitor includes local content storage storing a subset of media files stored by the server. A network connects the smart monitors and server in communication with one another. The network includes column sub-networks, in which each column sub-network includes seat sub-networks. Each seat sub-network connects to a different group of smart monitors. The smart monitors of each group store identical media files to one another.
Each smart monitor includes program logic that performs tasks including, determining if a media file corresponding to the passenger's input is available from a first source, and if available, playing the media file from the first source. If the media file corresponding to the passenger's input is not available from the first source, the logic determines if a media file corresponding to the request is available from a second source, and if available, plays the media file from the second source.
In alternative embodiments, different media files collectively available from media files stored on the smart monitors may be at least equal to that available from the server. However, in some example embodiments described herein, the quantity of different media files collectively available from those stored in the local content storage in the smart monitors is less than the quantity of different media files available from the server.
Other aspects, details, and advantages will become apparent from the following description, taken in conjunction with the accompanying drawings, illustrating by way of example preferred and alternative embodiments.
The drawing figures are not necessarily to scale and do not represent every feature, but are diagrammatic to enable those of ordinary skill in the art to make and use the invention without undue experimentation and do not limit the scope of the claims. Embodiments in accordance with the invention and advantages will therefore be understood by those of ordinary skill in the art by reference to the detailed description below together with the following drawings figures, wherein:
Described in the following paragraphs are example embodiments. The embodiments are implemented via a combination of hardware and software that include computing or information processing equipment having one or more processors configured to execute program logic or software stored on computer readable tangible, non-transitory media, e.g., magnetic memory discs, RAM, ROM, flash memory or solid stated drives (SSDs). The program logic preferably configures the information processing equipment to provide the functionality as described herein.
The seat rows 108 through 122 may have different number of seats depending on the class of seating of 122 and 124. For example, seat rows 108 through 112 nearer the front of the vehicle 102 may be premium class seating 122, such as business or first class and have larger seats 128 and/or more spacing between the seats 128. Seat rows 114 through 122 further back in the vehicle 102 may be economy class 126 and have smaller seats 130 and/or less spacing between the seats. Often a bulkhead, not shown, separates one class of seating 124 and 126 from another.
The hardware for the smart monitors 132 is preferably of conventional design for use on vehicles. For example, smart monitors sold under the trademark ECO from Panasonic Avionics Corporation of Lake Forest, Calif., may be used. Smart monitors of other types and from other manufacturers may be used as well. The smart monitors 132 as described herein include software or program logic to perform as described in connection with the flow charts shown in
The server 134 is of conventional hardware design and commercially available, for example, from Panasonic Avionics Corporation of Lake Forest, Calif. Servers from other manufactures may be used as well.
An SSD also permits media files to be rapidly loaded or copied onto the server 134 to minimize vehicle down time. Commonly, a server 134 used on an aircraft for commercial passenger transport will store from between 300 gigabytes to 400 gigabytes of media files, with the average being around 350 gigabytes, for streaming to smart monitors 132. The media files are replaced periodically on the server 134, usually monthly or weekly, as newer content becomes available. Each server 134 is normally capable of storing between one and two terabytes of date in total, and usually around 1.6 terabytes.
The smart monitors 132 include a non-volatile memory for storing media files, such as a memory card according to the Secure Digital standard, i.e., an SD flash memory card. In particular, ECO smart monitors currently available from Panasonic Avionics Corporation have SD cards according to the eXtended-Capacity standard, i.e., SDXC flash memory cards. The total memory capacity is usually 64 GB, but may vary according to the class of seating in the vehicle 102, with smart monitors for premium class seating frequently being provided with greater capacity memory cards. It is anticipated that as memory prices decrease and/or technology improves, higher capacity cards will be provided and/or other types of non-volatile memory such as an SSD or other types of memory. System files in the smart monitors 132 normally require about 14 GB of storage, i.e., applications, a graphical user interface (GUI), metadata, operating system, etc. The remaining portion of the non-volatile memory is used for storage of media files locally on a smart monitor 132, which is preferably at least 50 GB or slightly more, depending on the space required for system files.
A network 136 connects the smart monitors 132 and server 134 in communication with another. The network 136 is preferably a conventional local area network (LAN) using Ethernet for communication between the smart monitors 132 and server 134. The network includes higher speed sub-networks 138 extending from the server 134 along the columns 104 and 106. Preferably, the higher speed sub-networks 138 provide throughput of at least gigabyte Ethernet using conventional 1000 BASE-T or Copper-Gigabit wiring/cabling. The higher speed sub-networks 138 are referred to hereinafter as column sub-networks 138.
The column sub-networks 138 connect to switches or seat boxes 140. A lower speed data sub-network 142 extends from each seat box 140 and extends along the nearest row of seats thereto (seat rows 108, 110, 112, 114, 116, 118, 120, or 122). The lower speed sub-networks 142 preferably each provide at least 100 Mbits/s of throughput via conventional Fast Ethernet connections using 100 BASE-TX wiring. The lower speed sub-networks 142 form seat LANs or seat sub-networks of at least two smart monitors 132, as opposed to the earlier described column sub-networks 138.
The seat boxes 140 preferably supply both network connections and power to the smart monitors 132 connecting thereto. The seat boxes 140 are preferably of conventional hardware and are frequently referred to in the in-flight entertainment field as Power-Network Boxes (PNBs) as the seat boxes 140 provide both power and network connections. Alternatively, the seat boxes 140 may be referred to as Seat Interface Boxes (SIBs). If larger smart monitors are used, such as smart monitors sold under the trademarks of ELITE SERIES V2 and ALTUS by Panasonic Avionics Corporation, the seat boxes 140 may provide network connections only, with power provided separately via seat electrical boxes (SEBs) or seat power modules (SPMs). Power Network Boxes, Seat Interface Boxes, Seat Electrical Boxes and Seat Power Modules are all available from Panasonic Avionics Corporation. The term seat box as used herein includes switches 140 that provide both power and network connections for the smart monitors 132 and switches 140 that provide only network connections.
Optionally, the network 138 may include a redundant communication connection or connections 144 for use in the event of a communication path failure. In this regard, a pathway failure along either column sub-network 138 would cut communications between the server 134 and smart monitors 132 in that column 104 or 106 for seats 128 and 130 downstream of the failure. Therefore, a redundant communication connection 144 preferably extends between the last seat box 140 in each column 104 and 106 and the server 134. The redundant communication connection 144 provides an alternative communication path in the event of a failure in a column sub-network 138 to prevent smart monitors 132 from being cut off from communication with the server 134.
Ideally, the redundant communication connections 144 provide full communication redundancy and provide gigabyte Ethernet using conventional 1000 BASE-T or Copper-Gigabit wiring/cabling. For cost reduction, the redundant communication connections 144 may be lower data rate connections and reserved only for public announcements and map data from the server 134. In this regard, the entertainment system 100 includes an interface or crew terminal 146 for use by vehicle personnel to control the entertainment system 100 and communicate public announcements to the smart monitors 132. Redundant communication connections 144 provide for an alternative way to broadcast public announcements to the smart monitors 132 in the event of a communication failure.
Each seat box 140 includes a processor and memory, in which the processor executes software or program logic. As shown in
In particular, the seat box 140 can distinguish from which port communications are being received from the server 134. With respect to
After monitoring begins, the logic determines if there is a change in which port server communications are being received from in decision block 154. If there is no change, monitoring continues. If there is a change, the program logic notifies smart monitors 132 in that seat box's row, i.e., the seat LAN formed by that seat box 140, to not request media files from the server in process block 156. This is only when redundant communication connections 144 are limited as determined in the previous decision block 150. If the redundant communication connections 144 are not limited, port monitoring is not performed as indicated in process block 158.
If a redundant communication connection 144 is used and it is limited, there may be insufficient bandwidth to stream media over the connection 144. Thus, the smart monitors 132 connecting through the seat box 140 that detected the port change, are notified to not request media from the server 134. Moreover, the smart monitors 132 may also be optionally notified to mute audio. This is to make public announcements sent via the redundant communication connection 144 more noticeable to passengers.
Referring to
In one embodiment, the first source is whether the media file is stored locally in the smart monitor's 132 non-volatile memory, i.e., local content storage such as a memory card. If so, the logic plays the media file from the first source, i.e., from local content storage as shown in process block 166 of the example program logic illustrated in
If a media file corresponding to the media file selection is not available from the first source, i.e., in local content storage for this embodiment, the program logic proceeds to decision block 166. The logic in decision block 166 determines if a notification has been received to not contact the server 134 for media, such as from a seat box 140. This is an optional decision block for use with systems that may have limited redundant communication connections 144. If connections are fully redundant and not limited, decision block 166 is not necessary.
If such a notification has not been received, the program logic proceeds to decision block 168. The program logic in decision block 168 determines whether a media file corresponding to the selection is available from a second source. In the example shown in
If the media file is not available from second source, i.e., the server 132 in this embodiment, the program logic in decision block 172 determines whether a media file corresponding to the selection is available from a third source. In this embodiment, the third source is another smart monitor 132 on the same column sub-network 138. That is, if a media file corresponding to the selection from the user/passenger is not available from the server and not available in local content storage, the smart monitor program logic searches or looks for the media on another smart monitor 132. In particular, it looks for the media on a smart monitor 132 on the same column sub-network 138 as the smart monitor 132 searching for the media file. This minimizes traffic on the network 136, helps to maintain acceptable stream speeds, and reduce load on the server 134. If the media file is available from another smart monitor 132 on the same column sub-network 138, the smart monitor 132 communicates a request to the other smart monitor to stream the media file over the network to the smart monitor that communicated the request as indicated by process block 172.
If the media file is not available from another smart monitor 132 on the same sub-network column 138, the smart monitor needing the file determines in decision block 174 whether the media file is available from a smart monitor on a different sub-network column 138. If the media file is available, the smart monitor 132 communicates a request to the other smart monitor on the different sub-network column to stream the media file over the network to the smart monitor that communicated the request as indicated by process block 176. If the file is not available, an unavailable indication is provided to the user or passenger, such as by displaying a message as indicated by process block 178. Thereafter, the logic returns to displaying media selections in process block 160 to wait for another input.
Finally, if it is determined in the previous decision bock 166 that a message has been received to not contact the server 134, the logic skips determining whether the media file is available from the server. Instead, the logic proceeds to the decision block 172 that determines whether the media file is available from another smart monitor 132 on the same column sub-network 138.
It is not necessary to seek media files from smart monitors 132 on the same column sub-network. However, streaming from a smart monitor 132 on the same column sub-network reduces overall network traffic and increases stream rates. Once streaming has began from one smart monitor 132 to another, the smart monitor 132 receiving the stream includes program logic that monitors for acceptable packet loss. If the packet loss is determined to be in excess of an acceptable level, the program logic requests the media from another source, i.e., a different smart monitor 132 or the server 134 if communication with the server 134 is available.
In some systems 100, there may be a selection of pay-per-view media files. The program logic in the smart monitors 132 preferably decline requests for pay-per-view media files if there is no communication available with the server 134. This is to comply with the standards set forth by the Payment Card Industry (PCI) to ensure a secure environment for payment information. In this regard, the PCI Data Security Standard (DSS) currently prohibits storing credit card data on smart monitors.
Based on testing, smart monitors 132 currently available under the ECO trademark from Panasonic Avionics Corporation have the ability to serve up to six streams of 720p audio and video stream comprising 12 language selections at approximately 5 Mbps per stream with acceptable performance. This is while the smart monitor is playing a stream from its local content storage or from another source, i.e., the server 134 or another smart monitor 132. Hence, the maximum quantity of smart monitors 132 that can be served by a single smart monitor 132 is six with ECO type smart monitors. This is the highest conservative quantity that does not have an observable adverse impact to a user or passenger of the smart monitor 132 that is serving the streams while running applications, such as games, operating the graphical user interface, or playing a media file, etc. Each smart monitor 132 includes program logic for operating a local media server to stream up to the highest conservative quantity of steams as described previously. It is expected that this quantity will increase as technology improves the hardware available, compression techniques, and/or if higher performance smart monitors 132 are used. Alternatively, the maximum quantity would be limited to less than six if less capable smart monitors 132 are used.
The preference for whether a source is first, second, third or later in priority for where a smart monitor looks for a media file may be read from a configuration file. The configuration information may be data pre-stored in the smart monitors 132 upon installation in the vehicle 102, a file downloaded from a server 134, or a simple message broadcast along the network 138. In some embodiments with high performance servers and/or high speed networks, the first source may be a server 134. Other embodiments may not have a server 134 and therefore the first source is local content storage of the smart monitor 132 and the second source is another smart monitor or vice-versa.
In some embodiments of the system 100 it may be desired to limit streaming from one smart monitor 132 to another, to only on the same column sub-network 138. If so, the logic proceeds to an optional decision block 184 that determines if the stream request is from a smart monitor 132 on the same column sub-network 138 as the smart monitor 132 that received the request. If it is not, the logic ignores the request as indicated in process block 186 and the logic returns to waiting or listening for a stream request in the initial process block 180.
If streaming is permitted from a smart monitor 132 on one column sub-network 138 to a smart monitor 138 on another column sub-network 138, this optional decision block 184 is not necessary. In this situation, or if the request is from a smart monitor 132 on the same column sub-network 138 in the case of the optional decision block 184, the logic inquires whether the maximum quantity of streams is being served in decision block 186.
If the maximum quantity of streams is being served, the request is declined or ignored as indicated in process block 188. Otherwise the media file corresponding to the request is streamed as indicated in process block 190. After accepting the request and streaming the media or declining the request, the logic returns to its default state in process block 180 of monitoring for a stream request. In addition, for some embodiments, the logic may prioritize requests from smart monitors 132 in premium class seating. For example, the logic may accept up to one less than the maximum quantity of streams possible to serve, except for requests from smart monitors 132 in premium class. In this way, a reserve would be established for users or passengers in premium class, should the server 134 become unavailable.
An individual smart monitor 132 does not have the storage capacity of the server 134 for storing media. Accordingly, each smart monitor 132 can only hold a subset of the total media available from the server 134. To increase the media available from the smart monitors in the event the server 134 becomes unavailable, different subsets of media are downloaded to the smart monitors 132.
For example, as indicated in
Media subset B is loaded into the smart monitors 132 for the users/passengers in row 24. These are the smart monitors 132 mounted to the back of the seats in row 23. The smart monitors 132 for the users/passengers in row 25 are loaded with media subset C, and so on. In total, five media subsets A, B, C, D and E are illustrated in
As discussed previously, a server 134 on average stores around 350 GB of media. All of the media stored on the server 134 could be stored in the smart monitors 132 if enough media subsets were defined and there are a sufficient number of rows. Alternatively, increased storage for the smart monitors 132 could be provided.
However, only the more popular content is typically selected by the users/passengers for viewing. Around 60% to 80% of the users/passengers select the same 10% to 30% of the same content to view. Therefore to reduce loading times, media subsets may be selected to store at least 70% of the more popular content. Generally, 80% of the users watch about 20% of the content. Alternatively, additional media subsets may be defined or smart monitors may be used with increased storage space for local content such that 100% of the media files on the server are available collectively distributed over the smart monitors 132.
The media is initially loaded into the server 134 using conventional techniques. Usually, this is performed by transferring the media from a portable media loader or onboard media loader having the media stored thereon in non-volatile memory, such as an SSD, and copying the media onto the server 134 via a wired connection through a media load port on the server, for example, a connection through a universal serial bus (USB). Wired connections currently provide the fastest loading times. Alternatively, the media may be transferred via a wireless connection, such as through a standard corresponding to the IEEE 802 family or through a satellite connection.
Media is thereafter loaded on to the smart monitors 132 in multiple, parallel streams using Internet Group Multicast Protocol (IGMP) to multicast each media subset to the smart monitors 132. Referring to
Some smart monitors 132 may have greater storage for local content, such as smart monitors provided for premium class seating. However, to minimize loading time, all of the smart monitors 132 are provided with the predefined media subsets, e.g., media subsets A through E as illustrated in
Loading time can be further decreased by first loading a media subset into the server 134 and thereafter multicasting the media subset to the smart monitors 132 assigned to that media subset. Simultaneously, the next media subset is loaded on the server 134. Hence, loading of the server 134 and smart monitors 132 overlaps, except for the last media subset.
The redundant communication connections 212 and 214 preferably provide full redundancy and permit streaming of video and audio in the event of a server or communication path failure. Moreover, even greater redundancy is provided as there are two servers 204 and 206 and the redundant communication connections cross connect to the servers. Hence, if one server 204 or 206 fails, the cross-over connection permits the other server to serve the column sub-network 208 or 210 of the failed server. An aircraft or control interface 216 connects to both servers 204 and 206 so that vehicle personnel can control the system 200 through a single interface.
The left side of
While embodiments may be illustrated or described as having certain components, additional, fewer, or different components may be used or substituted. Further, with respect to described methods or processes, various steps may be performed in different order, and fewer or more steps may be performed by combining or splitting steps, or omitting some steps. In this regard, some decision and process blocks in the program logic were described as optional. In addition, it is possible to have a system that that does not have a server 134 and relies only upon media files stored in local content storage of the smart monitors 132. A portable media loader or onboard media loader in this embodiment would incorporate a portable server for transferring media files to the smart monitors 132, but would not remain with the vehicle after the media files or content has been transferred to the smart monitors.
As previously described, the smart monitors 132 preferably use an operating system based on ANDROID. However, other operating systems could be used, such as LINUX or proprietary operating systems available from Microsoft Corporation of Redmond, Wash. or Apple Inc. of Cupertino, Calif., which respectively sell operating systems under the trademarks of WINDOWS and IOS. The servers 134, 204 and 206 preferably use LINUX, but other operating systems could be used as well, such as WINDOWS. When LINUX or ANDROID is used, a Network Block Device is used to make remote servers on the network appear as virtual drives for devices, e.g., a smart monitor 132, searching for files stored thereon.
Instead of wired connections, smart monitors 132 could wirelessly connect over a network either directly with one another or indirectly via a wireless access point. The communication standard could be according to the 802 family (Wi-Fi), BLUETOOTH standard, or other communication standards. If a wireless access point is provided, it could have local content storage and act as another source of media files should a connectivity failure occur. Streaming could provide different quality of service depending on the source, for example, lower speed connections, such as a wireless connection, providing lower quality of service.
Since changes can be made as described, the present examples and embodiments are to be considered as illustrative and not restrictive and the invention is not to be limited to the details given herein, but may be modified within the scope and equivalence of the appended claims.
This application claims priority from U.S. non-provisional patent application Ser. No. 14/724,585, filed May 28, 2015, entitled VEHICLE ENTERTAINMENT SYSTEM, as a divisional thereof. U.S. non-provisional patent application Ser. No. 14/724,585 in turn claims priority from U.S. provisional patent application Ser. No. 62/018,077, filed Jun. 27, 2014, entitled VEHICLE ENTERTAINMENT SYSTEM, as a non-provisional application thereof. Priority of each of the foregoing patent applications is expressly claimed, and the disclosure of each application is hereby incorporated herein by reference in its entirety and for all purposes.
| Number | Date | Country | |
|---|---|---|---|
| 62018077 | Jun 2014 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14724585 | May 2015 | US |
| Child | 15909852 | US |
