Patent Application
20220150597
Embodiments of the present invention relate to a communication system, and more particularly to a communication apparatus and method for simultaneous broadcasting of visual information during performances, which can include live performances, lectures, cinema, and other places of gathering whereby multiple language translations can optionally be selected by the user.
The current state of the art for displaying translations of a performance, either live (as in theatre or opera), or recorded (as in cinema or television mediums), is by displaying a single libretto or script upon a surface within the field of vision of the audience. The “super-titles” used in opera are usually in the language commonly spoken at the site of the performance. Translations in film and television are accomplished using “subtitles” which are superimposed over the presented image, different copies being made for specific languages.
The main problem with the current state of the art, and specifically these systems, is that the entire audience is forced to see the translation whether they want to or not. Only one translation at a time is feasible and the displayed information can become very large and too complicated to comprehend with the needed rapidity. Many opera patrons are offended by super-titles, whereas many other opera patrons find supertitles essential to their understanding and enjoyments of the performance.
It is therefore desirable to provide patrons with an individual display unit which can present several language channels of information, but does not obstruct or disturb patrons who do not wish to see the displayed information or other visual depictions of the performance.
Known inventions have attempted to address multi-channels and languages, as well as display units accessible at individual seats. However, there are significant limitations of the known methods and systems. These limitations include a mono-chromatic and low-resolution display. Size, color, and format of text is also fixed and limited, Diacritics and glyphs, which are particular to many languages, cannot be visually represented. Still further the user interfaces are limited to channel selection via a momentary circuit button, thus making it difficult or impractical for use in systems that provide a user with numerous channels to select from.
Such known systems are also not robust in that they rely on a clean operating frequency—where there are no other sources operating on a similar frequency that could interfere within the broadcast frequency. However, because the recent sales of FCC frequencies to communications providers the amount of “reliable” open transmission spectrum has significantly been reduced.
While the ability to provide information display using multiplexed data that is transmitted over wires is known, such systems use addresses to decode transmitted data. However, because embodiments of the present invention will often be used on a large scale, the scale of the entire system can result in a delay caused by the decoding of multiplexed data, which results in staggered arrival of the messages to the end user. This is problematic for live performances because the delay of the data will be noticeable in such live performances.
Some known tele-text method of displaying text on television using control characters rely on a keyboard to access information and cannot support live performance use. Further, other known wireless transmitters lack the ability to be used for live performances—particularly where the ability to transmit and display simultaneously on multiple channels is required.
There is thus a present need for an invention that incorporates both wired and wireless communication platforms for the most reliable delivery of language translations in the given environment.
Embodiments of the present invention relate to a multi-channel data distribution method that includes forming at least one data packet by combining data for a plurality of channels, a signifier, and at least one display instruction packed together in a single data packet; and transmitting the at least one data packet from an arbiter to a plurality of displays, Optionally, transmitting the at least one data packet from an arbiter to a plurality of displays can include sending the at least one data packet from the arbiter to one or more distribution servers which then send the at least one data packet to the plurality of displays. The method can include loading preselected display data into memory on the plurality of displays. Loading preselected display data into memory on the plurality of displays can include sending the preselected display data from the arbiter. Optionally, the plurality of displays can display a non-monochromatic image that was loaded as preselected display data into the plurality of displays. Optionally, loading preselected display data into memory on the plurality of displays can include loading a preselected video for display into memory of the plurality of displays. The method can further include the plurality of displays displaying the video that was loaded as preselected display data.
In one embodiment, combining data for a plurality of channels can include combining libretto data from at least two different languages. The method can include loading each of the two different languages into a separate channel in the data packet. Transmitting the at least one data packet can further include transmitting the at least one data packet on a bi-directional communication channel. The multi-channel data distribution method of claim 9 further comprising determining whether all connected displays have received the at least one data packet and if at least one display is determined not to have received the at least one data packet, retransmitting the at least one data packet on a line that is different from a line that the at least one data packet was originally transmitted on. Optionally, determining whether all connected displays have received the at least one data packet can include retransmitting the at least one data packet from a distribution network switch that is programmed for rapid spanning tree that can self-check data sent and received.
The method can also include determining whether all connected displays have received the at least one data packet and if at least one display is determined not to have received the at least one data packet, retransmitting the at least one data packet on a line that is different from a line that the at least one data packet was originally transmitted on and transmitting subsequent data packets on both a first line and a second line. The method can include monitoring a return line with a network switch to confirm that a signal sent on a transmit line is returned on the return line. Optionally, transmitting the at least one data packet can include transmitting the at least one data packet from an arbiter to a plurality of individually addressable displays. Transmitting the at least one data packet from an arbiter to a plurality of individually addressable displays can include providing information in the at least one data packet directed to and received by some subset of the plurality of displays. Optionally, transmitting the at least one data packet from an arbiter to a plurality of individually addressable displays can include providing sponsor information that is unique to at least some subset of the plurality of displays. In the method, transmitting the at least one data packet can include transmitting the at least one data packet from an arbiter to a plurality of displays via a closed-loop daisy-chained network, transmitting the at least one data packet via a closed-loop daisy-chained network which is formed on a closed loop of two 10/100 twisted pairs on a network cable, and/or transmitting the at least one data packet to a plurality of groups of displays. Optionally, forming at least one data packet can include forming at least one data packet comprising data derived from a live entertainment event that is occurring in real-time.
Embodiments of the present invention also relate to a multi-channel data display apparatus that includes an arbiter; at least one distribution server; and a plurality of individually addressable non-monochromatic color displays connected to the at least one distribution server via a daisy-chain configuration. The individually addressable non-monochromatic color displays can be arranged in a plurality of groups having members that are connected, as a daisy chained network, together with at least one of said at least one distribution servers. The daisy chained network can include a closed loop of two 10/100 twisted pairs on a network cable. The individually addressable non-monochromatic color displays can each include a touchscreen. The addressable non-monochromatic color displays can be configured to provide channel selection to a user through the touchscreen and not via a momentary mechanical switch.
Objects, advantages and novel features, and further scope of applicability of the present invention will be set forth in part in the detailed description to follow, taken in conjunction with the accompanying drawings, and in part will become apparent to those skilled in the art upon examination of the following, or may be learned by practice of the invention. The objects and advantages of the invention may be realized and attained by means of the instrumentalities and combinations particularly pointed out in the appended claims.
The accompanying drawings, which are incorporated into and form a part of the specification, illustrate one or more embodiments of the present invention and, together with the description, serve to explain the principles of the invention. The drawings are only for the purpose of illustrating one or more embodiments of the invention and are not to be construed as limiting the invention. In the drawings:
An embodiment of the present invention relates to an apparatus and method for simultaneously providing individual users, most preferably at a plurality of individual locations, the ability to select a visual text in various languages for performances, including but not limited to operas, theatre, movies, lectures, worship, plays, sporting events, etc., which can include a translation of a performance or event. In one embodiment, the invention comprises a multi-channel apparatus for the storing, transmitting, and simultaneous display of at least one selected channel to a remote site. In one embodiment, the term “channel” means a predetermined selection of available content—for example, in one embodiment, a first channel can comprise a series of English text while a second channel can comprise a series of Spanish text. In one embodiment, each language of libretto can be given its own channel, therefore any typed or scripted language can be broadcast as a channel with no limitation on the number of simultaneous transmissions (for example, English, Spanish, French, Italian, and/or any other language). In one embodiment, the information and/or data is transmitted to the display units, and upon command, each display unit displays the selected channel of information simultaneously with other display units. For example, in one embodiment, at a predetermined time, users who have selected an English channel can receive a particular statement in English at the same time that users who have selected a Spanish channel can receive the same statement in Spanish.
A preselected sequence of text that comprises at least one channel of data, and its encoding and decoding information is occasionally referred to as a “cue”. In one embodiment, the distribution of data packets is preferably accomplished via a main control unit or “arbiter” which is preferably used to time and transmit each title or “cue” of data to distribution servers that then broadcast the title or cue of data to the display interfaces.
Each data packet preferably comprises at least a predetermined portion of the preselected sequence of text, which can include for example the text of a spoken phrase, sentence or statement of an opera, and a display cue from the main control unit. At least one display interface is preferably provided for receiving the data packets. A buffer is also preferably provided for storing data from each of the data packets. An apparatus for selecting at least one channel is also preferably provided on or in conjunction with each display interface.
The data can optionally comprise one or more of a preselected sequence of text, monochromatic, grayscale, and/or full color graphics, a digital score, images, video and/or animation. In one embodiment, the data can also optionally include individually addressed sponsor, seat naming, and/or one or more advertisements. Any data can optionally be distributed to individual units prior to its actual display and stored for recall in order to eliminate the delay in transmission for larger portions of data, which can include for example images and/or video. In this case, the main control software can transmit the desired file(s) to a single unit, a selection of units, or every unit. The relevant files can then be saved within a predetermined file storage location on each receiving unit and can be later displayed on-screen upon receipt of a command as sent by the main control software. A command of this kind can, for example, contain a signifier and a file name, with the signifier indicating to the unit an instruction to display any media with a corresponding name that can be found in the predetermined location. In the case where no matching file exists, the display can fall back to a default image, or simply do nothing.
The transmitted data package can optionally be sent by way of a transmission control protocol or a user datagram protocol standard, therefore making use of the services provided therein, such as header inclusion and data integrity verification checks. When using a transmission mechanism that provides data verification, upon receipt the next data packet the display unit will preferably verify that the data package is correctly received, and if so, override the stored data in a buffer. Otherwise, the display preferably ignores that received transmission and waits for the next transmission, whereupon the process is repeated. This ensures that the data received, processed, and displayed is identical to the data transmitted from the main control unit. In the event of an incomplete or corrupted transmission receipt, the display preferably waits for another transmission. The data packets can be broadcast continuously or periodically, including at predetermined intervals, by the main control unit and transmitter. The data packets can also comprise one or more predetermined messages to control display brightness, text size, and/or data display time. The main control unit preferably comprises an apparatus for selecting the at least one predetermined portion of the preselected sequence of text. In one embodiment, this selection and transmission can be handled by a skilled operator initiating an input—for example pressing a “go” button. While in other instances this selection can occur with a pre-programmed timing sequence, or remote trigger interface receiving a command, which can optionally be received from other low voltage interfaces such as, lighting control systems, midi commands, logic triggers, combinations thereof, and the like.
The apparatus for distributing can include a primary distribution line and at least one secondary branch. This secondary branch preferably allows for a secondary transmission device to provide back-up system redundancy in the event the primary “arbiter” fails during performance. The structure for distributing preferably comprises an apparatus for electrically isolating a signal between the primary distribution line and the at least one secondary branch.
In one embodiment, the invention can simultaneously display at a remote site at least one channel of a preselected stored sequence of multichannel text most preferably including: storing the preselected sequence of multichannel text in a main control unit, and converting at least one predetermined portion of the preselected sequence of multichannel text into data packets; placing a display cue into each of the data packets; transmitting the data packets to at least one display apparatus, storing the converted at least one predetermined portion of the preselected sequence of multichannel text, and transmitting a display cue from the main control unit to the at least one display apparatus; and selecting the at least one channel and displaying the at least one predetermined portion of the preselected sequence of text of the selected at least one channel.
In one embodiment, the present invention utilizes the Unicode standard of encoding characters, giving access to all character sets for all written languages.
The apparatus for distributing data preferably comprises at least one transmitter and at least one receiver. The data is preferably transmitted by electromagnetic radiation and/or a closed loop network for portable and/or hard-wired applications.
Embodiments of the present invention preferably provide the use of a high-resolution interface, which is most preferably a touchscreen interface, that allows for clearer text display and full color graphics, video, and/or animation. Embodiments of the present invention preferably provide one or more of:
1) A display unit that presents a channel of information to view, describing a performance, lecture, or script to audience members either individually or to a group;
2) A scalable system that can be partially or completely installed or expanded at any time—particularly a system where installation work can cause minimal disturbance to the building and environment;
3) The capacity to present any written language at any time;
4) A system wherein people with disabilities can have access to visual and/or audio information;
5) A system that can be used in outdoor locations—for example at outdoor concerts and performances, multi-cultural events, stadium events, sporting events, religious services, combinations thereof and the like;
6) A portable system for use in touring productions whereby an apparatus constructed according to an embodiment of the present invention can be set up quickly and easily in different locations and be assured that the system is available for use for that production;
7) A scalable system that can be partially installed and made operational and then, at a future date, can be expanded as needs require or funding becomes available—in this way, immediate compliance with disabled person's legislation is possible;
8) Wide-ranging transmission medium, thus making it possible to transmit to a large area, comprising multiple buildings or large geographic zones;
9) No limit to the number of units that can simultaneously operate, although additional distribution servers and transmitters may be required to cover the necessary area depending on the space and transmission medium used;
10) Units that can optionally be powered by battery, thus providing the ability for them to operate independently and not need a power distribution system to be installed at the point of use;
11) A system that receives its data by electromagnetic radiation, thus permitting it to operate independently and not require cables to be installed at the point of use;
12) A system that utilizes the UNICODE character set, thus permitting every unit the ability to display any written language—multiple variations of the unit are not required for different countries and all languages are available on every display, if desired, for a particular application;
13) The ability to allow individual users a choice in the information they wish to see in conjunction with a performance;
14) Each individual member of an audience can be provided with the ability to choose one of many channels of information of a performance;
15) The ability to have a single master copy of the all translations desired encoded therein, which is particularly useful for cinema because it can be duplicated and sent to any venue where, with the appropriate equipment, any of the included translations can be accessed by individual patrons;
16) The ability to implement and/or provide other written graphic information, such as symbolic representation of sign language for persons with hearing disabilities;
17) Complex formatting of the displayed text is achieved by special formatting codes that allow text to be positioned anywhere on the screen while still retaining the text information in compact character code form this has the advantage of containing the data in very a compact form, thus reducing the amount of data that needs to be transmitted if a graphic bitmapped scheme were otherwise employed; and/or
18) The ability to restrict the visual output of a display so that it is clearly visible only to that specific individual user.
In one embodiment, the display, which can include for example a libretto display apparatus, can include hardware components and associated software to provide a user with the ability to view a selected score, or for example text of an opera, on an individual and/or group display unit, most preferably in a language selected by the user. Embodiments of the present invention are particularly useful in live theatre, live opera, cinema, television, movies, sporting events, and other performances and media—particularly those where a plurality of people are viewing and/or listening to a common event.
Referring now to the drawings, an embodiment of the present invention is schematically illustrated in
As best illustrated in
Any cues containing, for example, libretto text can have the above format. The cue number (position 01) is equivalent to the number of the cue, or all digits in the format “xx.xx”.
The fade in time (position 04) is preferably a number representing the amount of time, which can be represented as a number of milliseconds, that that it will take for this particular cue to fade in from a blank screen. In one embodiment, if this field is left empty, the default fade in time is preferably used instead.
The fade out time (position 05) is a number representing the amount of time, which can be represented a number of milliseconds, that it will take for this particular cue to fade out to a blank screen. In one embodiment, if this field is left empty, a default fade out time is preferably used instead. Optionally, a display instruction can include a fade in time and/or a fade out time.
In one embodiment, the language 1 and language 2 (positions 02 and 03) preferably hold translated text in desired languages. Any formatting of the text (italicization, boldface, etc.) is preferably embedded there in HTML format. Any desired language can be used, and optionally slots for additional languages can be added.
The flag marker (position 6) is preferably a Boolean value that the operator can optionally use to mark certain cues for editing. For example, a specific formatting change can be made to all cues with an active flag. Alternatively, flags can be used to indicate those cues which have recently modified text and require additional attention from a translator.
In some cases, a packet can contain only a signifier (i.e. only a single number is sent). For example, a predetermined pattern can indicate to the display unit a command to fade out to black, regardless of what is currently displayed on the screen. It can take a default fade time. Another example of a predetermined pattern is one that can be used to instruct the display unit to display a logo or other image stored in memory.
In one embodiment, cues containing information about libretto-wide settings can have the above format. Libretto setting cues can be sent when a new libretto has been opened for performance by the arbiter program. Libretto setting information can be stored alongside the text of the libretto itself and is therefore specific to a particular show. Display units can save the information received here for use throughout the rest of the libretto, unless the settings are changed and/or reset manually.
The default fade times (positions 02 and 03) can determine the amount of time any cue affecting the display will take to execute if no other fade time parameter is given. The typeface (position 07) preferably determines which embedded font will be used to display all text within the libretto. The typeface size, color, line spacing, and text justification (positions 08, 09, 10, 11) can be modified to best fit the typeface selected. Any chosen language(s) preferably use this typeface.
As best illustrated in
Sponsor data is preferably contained in a master database that can be edited via the inOvation software on the arbiter. When an update is made, the user can update the display units by distributing the new database, and from there each unit will look for an entry that matches its own IP address or other unique identifier. If no match is found, the unit will preferably default to a predetermined text.
As best illustrated in
By swapping pairs AB and CD on the output of each module, standard equipment can be plugged into the “in” port and because it uses pairs AB it will function as expected. The “out” port would not function with standard ethernet equipment without a custom cable—but in normal operations it can be used with the carrier boards. This configuration removes any single long run (except for the run to the head end). While a downside is that removing a segment from the chain shuts down everything down stream, that should only happen during a removal and replacement of a display. This prevents a single broken unit in the chain from shutting any other units down.
As best illustrated in
Small groups of patron seating—for example rows of seats, are preferably linked via a daisy chained network, which itself is most preferably a closed loop of two twisted pairs, which themselves are preferably capable of supporting about 10 or 100 mega-bits per second (or more) on one larger network cable.
Each group configuration (or optionally some group configurations) preferably has a physical homerun to a zone distribution rack. The home run, which can be for example a Cat6 cable, is preferably logically split into two separate signal routes that alternate every other display (See
Diagnostic tools in the software can optionally run network tests to identify the break point in order to assist in identifying bad cable/hardware so that a technician can make repairs to the physical system.
Although zones can be arranged in any desirable configuration, in one embodiment, zones are preferably groups of rows that can be based on physical location of seating and wiring requirements. Each zone is preferably connected to the distribution network via a primary and secondary fiber link. In the event that the primary link fails, the secondary link preferably continues to carry communication for the system.
Although the foregoing discussion referenced examples of positions of data (for example “position 01”) it is to be understood that the mentioning of specific positions is merely to provide a concise and exemplary explanation of an embodiment of the present invention. To be clear, any desired data position can be used for any of the foregoing discussion, so long as that data position is distinct from the other used data positions. Further, although the foregoing discussion referred to a “libretto” this too was done for simplicity and to provide an exemplary explanation of an embodiment of the present invention. In one embodiment, all necessary display instructions and the display data are packed into a single data packet. In one embodiment, display instructions for display data are not sent in a separate or different data packet. In one embodiment of the present invention, the display device of the present invention is not limited to a libretto display and can instead comprise a display for any other desired data display, entertainment, information, advertising and/or a combination thereof. In one embodiment, the displays are preferably touch screen displays and do not comprise a momentary switch to select a desired channel.
Optionally, embodiments of the present invention can include a general or specific purpose computer or distributed system programmed with computer software implementing steps described above, which computer software may be in any appropriate computer language, including but not limited to C++, FORTRAN, BASIC, Java, Python, Linux, assembly language, microcode, distributed programming languages, etc. The apparatus may also include a plurality of such computers distributed systems (e.g., connected over the Internet and/or one or more intranets) in a variety of hardware implementations. For example, data processing can be performed by an appropriately programmed microprocessor, computing cloud, Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA), or the like, in conjunction with appropriate memory, network, and bus elements. One or more processors and/or microcontrollers can operate via instructions of the computer code and the software is preferably stored on one or more tangible non-transitive memory-storage devices.
Note that in the specification and claims, “about” or “approximately” means within twenty percent (20%) of the numerical amount cited. All computer software disclosed herein may be embodied on any non-transitory computer-readable medium (including combinations of mediums), including without limitation CD-ROMs, DVD-ROMs, hard drives (local or network storage device), USB keys, other removable drives, ROM, and firmware.
Embodiments of the present invention can include every combination of features that are disclosed herein independently from each other. Although the invention has been described in detail with particular reference to the disclosed embodiments, other embodiments can achieve the same results. Variations and modifications of the present invention will be obvious to those skilled in the art and it is intended to cover in the appended claims all such modifications and equivalents. The entire disclosures of all references, applications, patents, and publications cited above are hereby incorporated by reference. Unless specifically stated as being “essential” above, none of the various components or the interrelationship thereof are essential to the operation of the invention. Rather, desirable results can be achieved by substituting various components and/or reconfiguring their relationships with one another.
This application claims priority to and the benefit of the filing of U.S. Provisional Patent Application No. 62/843,185, entitled “Interactive Electronic Libretto/Translation HD Display Interface Apparatus and Method”, filed on May 3, 2019, and the specification thereof is incorporated herein by reference.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US2020/031374 | 5/4/2020 | WO | 00 |
| Number | Date | Country | |
|---|---|---|---|
| 62843185 | May 2019 | US |
