The technology described in this patent document relates to systems and methods for providing supplemental data (e.g., metadata) that is associated with over-the-air radio broadcast signals.
Over-the-air radio broadcast signals are commonly used to deliver a variety of programming content (e.g., audio, etc.) to radio receiver systems. Such over-the-air radio broadcast signals can include conventional AM and FM analog broadcast signals, digital radio broadcast signals, or other broadcast signals. Digital radio broadcasting technology delivers digital audio and data services to mobile, portable, and fixed receivers. One type of digital radio broadcasting, referred to as in-band on-channel (IBOC) digital audio broadcasting (DAB), uses terrestrial transmitters in the existing Medium Frequency (MF) and Very High Frequency (VHF) radio bands. It is desirable to provide supplemental data with an audio broadcast. This supplemental data can include a name, call sign and a logo of the radio station broadcasting the signal for display on a radio broadcast receiver to a user. It can be challenging to coordinate delivery of the supplemental data with the broadcast received at the user's location.
Over-the-air radio broadcast signals are commonly used to deliver a variety of programming content (e.g., audio, etc.) to radio receiver systems. Supplemental data (e.g., metadata) may be provided to radio broadcast receiver systems. The metadata is associated with the programming content delivered via the over-the-air radio broadcast signals. The metadata can be included in a sub-carrier data. In IBOC, the radio broadcast includes a streamed analog broadcast and may include a digital audio broadcast. Sub-carriers of the main channel broadcast can include digital information such as text or numeric information, and the metadata can be included in the digital information of the sub-carriers. Thus, an over-the-air radio broadcast can include an analog audio broadcast, a digital audio broadcast, and other text and numeric digital information such as metadata streamed with the over-the-air broadcast. The programming content may be broadcast according to the DAB standard, the digital radio mondiale (DRM) standard, radio data system (RDS) protocol, or the radio broadcast data system (RBDS) protocol.
A radio broadcast receiver system may receive both the primary programming content (e.g., audio, etc.) via over-the-air radio broadcast transmission, and the metadata related to the programming content. In some examples, the receiver may receive both the over-the-air radio broadcast and related information wirelessly from the Internet. Thus, two different communication platforms can be used to communicate metadata, with the different communication platforms enabling the radio receiver system to receive relevant metadata in concert with terrestrial radio broadcast signals. Such a system can be described as a “hybrid radio” system.
The metadata related to the programming content can include both “static” metadata and “dynamic” metadata. Static metadata changes infrequently or does not change. The static metadata may include the radio station's call sign, name, logo (e.g., higher or lower logo resolutions), slogan, station format, station genre, language, web page uniform resource locator (URL), URL for social media (e.g., Facebook, Twitter), phone number, SMS number, SMS short code, PI code, country, or other information.
Dynamic metadata is related to content currently being played on the broadcast and changes relatively frequently. The dynamic metadata may include a song name, artist name, album name, artist image (e.g., higher or lower resolutions), enhanced advertising (e.g., title, tag line, image, phone number, SMS number, URL, search terms), program schedules (image, timeframe, title, artist name, DJ name, phone number, URL), service following data, or other information related to the audio content. When the radio receiver system is receiving an over-the-air radio broadcast signal from a particular radio station, the receiver system may receive static metadata and dynamic metadata wirelessly.
Hybrid radio systems can provide a user with an enhanced experience (e.g., an enhanced listening experience) regardless of the type of terrestrial broadcast signal that is received at the user's radio receiver system. For example, conventionally, a user receiving a conventional analog AM or FM radio broadcast signal is provided little, if any, metadata in addition to the received audio (e.g., a user's automotive receiver may display only a song title and artist name). By contrast, hybrid radio enhances the user's experience by providing a variety of different metadata in concert with the primary programming content. For example, users receiving radio broadcast signals at a receiver system may view images, videos, multimedia displays, text, etc., that is related to the programming content received in metadata via the over-the-air radio broadcast signals and wireless Internet.
The following description and the drawings sufficiently illustrate specific embodiments to enable those skilled in the art to understand the specific embodiment. Other embodiments may incorporate structural, logical, electrical, process, and other changes. Portions and features of various embodiments may be included in, or substituted for, those of other embodiments. Embodiments set forth in the claims encompass all available equivalents of those claims.
At 210, automatic content recognition (ACR) of an internet-based streaming version of the over-the-air radio broadcast is performed to identify content of the over-the-air radio broadcast. ACR refers to the process where an entity (e.g., an application executing on a server) identifies content of the radio broadcast by sampling a portion of the audio and identifies contents of the sampled portion. ACR can include comparing the sampled portion to a signal fingerprint or signal watermark to identify the content. An over-the-air radio broadcast is often simultaneously provided as a streaming version broadcast over the Internet. The Internet-based version of the broadcast can be used for the ACR. The ACR may be performed by an ACR service provided by a third party. The third party ACR service may be a cloud-based ACR service.
Returning to
At 220, the metadata is transmitted from the service controller 115 to the radio broadcast receiver 110. The metadata can be transmitted from the service controller to the receiver using the intermediate communication platform 120 (e.g., via the Internet). In certain embodiments, the service controller 115 may initiate transmission of the metadata to the radio broadcast transmitter 105, and the radio broadcast transmitter 105 transmits the metadata to the receiver 110, such as by an IBOC transmission for example. The service controller 115 may initiate the transmission of metadata automatically or in response to a message from the receiver. The metadata associated with the over-the-air radio broadcast can include an image related to the over-the-air radio broadcast (e.g., an album image related to a song being played), purchase information related to the over-the-air radio broadcast, advertising information, a radio station logo, or an on-air personality image.
Returning to
The content recognition unit 565 receives a URL from a service application (e.g., via the cloud) that identifies the Internet-based streaming version of the over-the-air radio broadcast that was identified by the radio broadcast receiver. The content recognition unit 565 samples a portion of the Internet-based streaming version and identifies content of the Internet-based streaming version using a fingerprinting process or watermarking process. Metadata is associated with the over-the-air radio broadcast using the identified content. The metadata may be identified using the content recognition unit 565.
The metadata may be provided by the server 560 or a different server. In the example of
As explained previously herein, metadata can be static or dynamic. Static metadata is mostly non-changing. For example, static metadata can be metadata associated with a radio station frequency or channel, such as a radio station logo or call letters. The static metadata stays the same even though the content of the radio broadcast changes, such as by broadcasting different songs. Dynamic metadata changes based on the content of the broadcast. For example, broadcast of a new song changes metadata that can include new image data for the new song such as image data of the artist or image data of the album corresponding to the song.
As shown in
The service application of server 315 may initiate transfer of other metadata to the radio broadcast receiver in addition to the dynamic metadata identified using ACR. For example, the service application may receive location information (e.g., latitude and longitude) sent by the radio broadcast receiver. The service application may initiate transmission of metadata associated with the location information to the radio broadcast receiver. The metadata may include advertising information based on the location of the receiver, or identification of radio stations available to the listener. In another example, the broadcaster of the over-the-air radio broadcast may provide metadata that is stored on the server 315 as either static or dynamic metadata. The service application initiates transmission of the metadata provided by the broadcaster to the radio broadcast receiver in response to the identification information received from the radio broadcast receiver.
As shown in the example of
Another path to the receiver is the over-the-air broadcast via the broadcast transmitter 105. The broadcast transmitter 105 may be a digital radio broadcast transmitter. The service controller 115 may include a port (e.g., a second COMM port in the example of
The example in
At 610, when the request is processed, it is determined whether dynamic metadata is available that corresponds to the over-the-air radio broadcast. If dynamic metadata is not available, the subscription request fails at 615. If dynamic metadata is available, it is determined at 620 whether the availability of the metadata is direct and located at the server, or whether an ACR service is needed. If the dynamic metadata is directly available at the server, the metadata is sent to the receiver and the request is successful at 625.
If the dynamic metadata is not directly available and ACR service is needed, a message to start a new ACR service is sent as 630. The message may include a station identifier (StationID) and a URL identifying the internet-based broadcast corresponding to the over-the-air radio broadcast.
At 715, the audio portion of the media may fingerprinted to identify the content of the audio. If the fingerprint is a valid finger at 720, dynamic metadata associated with content (e.g., a song) identified by the fingerprinting is pushed to the requesting API using the StationID at 725. When the audio is completed (e.g., the song that is streamed is over) at 730, the next portion of the streaming audio may be fingerprinted at 715.
Returning to
In addition or as an alternative to the cloud-based ACR service, ACR can be performed by one or more radio broadcast receivers receiving the over-air-radio broadcast and the identification of the broadcast content resulting from the ACR is transmitted to the service application by the one or more receivers. The receivers may perform ACR on a digital radio signal from a digital radio broadcast. Metadata can be associated with the broadcast content, and the service application initiates transmission of the metadata to all the receivers tuned to the over-the-air radio broadcast. This can be viewed as ACR by “crowd sourcing” where the identification of content of the radio broadcast is received by the service application from multiple sources.
In response to receiving the information identifying the content in the radio broadcast, the service application may communicate a request for the metadata to a cloud-based metadata source and receive the metadata from the cloud-based metadata source in response to the request. The service application may also receive information related to location of the receivers. The service application may also request cloud-based ACR from cloud-based ACR service in addition to the ACR information provided by the one or more receivers. The service application initiates transmission of one or more of: metadata associated with the content of the broadcast, metadata associated with location of the receivers, and metadata provided by the broadcaster to the receivers tuned to the broadcast. The service application ends transmission of the metadata to the receivers when the service application no longer receives identification of content of the radio broadcast and the information identifying the over-air-broadcast.
The systems, devices, and methods described provide for coordination of metadata with an over-the-air radio broadcast. The metadata can be displayed using the radio broadcast receiver. This provides an enriched experience of the radio broadcast for the user.
Example 1 includes subject matter (such as a system for providing metadata associated with over-the-air radio broadcasts to one or more radio receivers) comprising a first server. The first server can include a port, a memory, a processor operatively coupled to the port and memory, and a service application for execution by the processor. The service application can optionally be configured to: receive identification information related to an over-the-air radio broadcast via the port of the first server, wherein the identification information is transmitted to the first server using a radio broadcast receiver remote from the first server; communicate a request for automatic content recognition (ACR) of an Internet-based streaming version of the over-the-air radio broadcast; and receive metadata associated with the over-the-air radio broadcast in response to the request and initiate transmission of the metadata to the radio broadcast receiver.
In Example 2, the subject matter of Example 1 optionally includes the first server optionally configured to communicate the request for ACR to a cloud-based ACR service and receive the metadata from a cloud-based metadata source in response to the request.
In Example 3, the subject matter of one or both of Examples 1 and 2 optionally includes a second server including a content recognition unit and a port for operative coupling to an Internet access point. The content recognition unit is optionally configured to: receive a uniform resource locator (URL) from the service application identifying the Internet-based streaming version of the over-the-air radio broadcast; perform ACR using the Internet-based streaming version; and associate the metadata with the over-the-air radio broadcast using identified content of the Internet-based streaming version.
In Example 4, the subject matter of one or any combination of Examples 1-3 optionally includes a memory including a database configured to store static metadata, and one or more queues configured to store dynamic metadata. The dynamic metadata optionally includes the metadata associated with the over-the-air radio broadcast using the ACR; and the service application is optionally configured to initiate transmission of both static metadata and dynamic metadata associated with the over-the-air radio broadcast to the radio broadcast receiver.
In Example 5, the subject matter of one or any combination of Examples 1-4 optionally includes the first server configured to receive location information sent by the radio broadcast receiver; and the service application is optionally configured to initiate transmission of metadata associated with the location information to the radio broadcast receiver.
In Example 6, the subject matter of one or any combination of Examples 1-5 optionally includes a service application configured to initiate transmission of metadata provided by a broadcaster associated with the over-the-air radio broadcast to the radio broadcast receiver.
In Example 7, the subject matter of one or any combination of Examples 1-6 optionally includes the first server configured to receive the identification information from a plurality of the broadcast radio receivers and to transmit the metadata to the plurality of radio broadcast receivers. The service application is optionally configured to end transmission of the metadata associated with the over-the-air radio broadcast when ceasing to receive the identification information.
In Example 8, the subject matter of Example 7 optionally includes a service application configured to receive identification of content of the over-the-air radio broadcast from one or more radio broadcast receivers of the plurality of radio broadcast receivers; and initiate transmission of metadata associated with identified content of the over-the-air radio broadcast received from the one or more radio broadcast receivers to the plurality of radio broadcast receivers.
In Example 9, the subject matter of one or any combination of Examples 1-8 optionally includes a service application configured to initiate transmission of the metadata to the radio broadcast receiver via the Internet.
In Example 10, the subject matter of one or any combination of Examples 1-9 optionally includes the first server including a second port for operative coupling to a digital radio broadcast transmitter. The service application is optionally configured to initiate transmission of the metadata to the digital radio broadcast transmitter via the second port.
In Example 11, the subject matter of one any combination of Examples 1-10 optionally includes the metadata that is associated with the over-the-air radio broadcast including at least one of an image related to the over-the-air radio broadcast, purchase information related to the over-the-air radio broadcast, advertising information, a radio station logo, and an on-air personality image.
Example 12 includes subject matter (such as method for providing metadata associated with over-the-air radio broadcast signals, a means for performing acts, or a machine-readable medium including instructions that, when performed by the machine, cause the machine to perform acts), or can optionally be combined with the subject matter of one or any combination of Examples 1-11 to include such subject matter, comprising: receiving, using a service controller, an identification of an over-the-air radio-broadcast transmitted by a radio broadcast receiver remote from the service controller; performing automatic content recognition (ACR) of an internet-based streaming version of the over-the-air radio broadcast to identify content of the over-the-air radio broadcast; associating metadata with the over-the-air radio broadcast using the identified content; and transmitting the metadata from the service controller to the radio broadcast receiver.
In Example 13, the subject matter of Example 12 optionally includes transmitting a content recognition service request from the service controller to a cloud-based ACR service, and receiving, by the service controller, dynamic metadata from a cloud-based metadata service provider in response to the content recognition service request.
In Example 14, the subject matter of Example 13 optionally includes transmitting a message that includes the request, and one or both of a radio station identifier and a uniform resource locator (URL) identifying the internet-based streaming version of the over-the-air radio broadcast.
In Example 15, the subject matter of one or any combination of Examples 12-14 optionally includes receiving, by the service controller, location information from the radio receiver; and transmitting metadata associated with both the over-the-air radio broadcast and the location information to the radio broadcast receiver.
In Example 16, the subject matter of one or any combination of Examples 12-15 optionally includes transmitting, by the service controller, metadata provided to the service controller by a broadcaster of the over-the-air radio broadcast.
In Example 17, the subject matter of one or any combination of Examples 12-16 optionally includes receiving the identification from a plurality of radio broadcast receivers, transmitting the metadata from the service controller to the plurality of radio broadcast receivers, and ceasing the transmitting of the metadata when the service controller ceases to receive the identification of the over-the-air radio broadcast.
In Example 18, the subject matter of Example 17 optionally includes receiving, by the service controller, identification of content of the over-the-air radio broadcast from one or more radio broadcast receivers of the plurality of radio broadcast receivers; and transmitting metadata associated with identified content of the over-the-air radio broadcast to the plurality of radio broadcast receivers.
In Example 19, the subject matter of Example 18 optionally includes obtaining identification information of the content of the over-the-air radio broadcast by one of: performing ACR using the one or more radio broadcast receivers, or extracting the identification information from digital information included in the over-the-air broadcast using the one or more radio broadcast receivers. The method further includes transmitting the identification information to the service controller.
In Example 20, the subject matter of one or any combination of Examples 12-19 optionally includes associating dynamic metadata with the over-the-air radio broadcast, and transmitting both static metadata and dynamic metadata from the service controller to the radio receiver according to the identification of the over-the-air radio broadcast.
In Example 21, the subject matter of one or any combination of Examples 12-20 optionally includes the service controller transmitting the metadata to the radio broadcast receiver using the internet.
In Example 22, the subject matter of one or any combination of Examples 12-21 optionally includes the service controller initiating transmission of the metadata to the radio broadcast receiver using the over-the-air radio broadcast.
Example 23 includes subject matter (such as a system for providing metadata associated with over-the-air radio broadcast signals to one or more radio receivers), or can optionally be combined with the subject matter of one or any combination of Examples 1-22 to include such subject matter, comprising: a first server including: a port, a memory, a processor operatively coupled to the port and memory, and a service application for execution by the processor. The service application is configured to receive identification information of an over-the-air radio broadcast from a plurality of radio broadcast receivers remote from the first server; receive identification information of content broadcast in the over-the-air radio broadcast from a radio broadcast receiver of the plurality of radio broadcast receivers; and initiate transmission of metadata associated with the content broadcast in the over-the-air radio broadcast to the plurality of radio broadcast receivers.
In Example 24, the subject matter of Example 23 optionally includes a service application configured to communicate a request for the metadata to a cloud-based metadata source and receive the metadata from the cloud-based metadata source in response to the request.
In Example 25, the subject matter of one or both of Examples 23 and 24 optionally includes a service application configured to communicate a request for ACR service to a cloud-based ACR service; receive further identification information of content broadcast in the over-the-air radio broadcast from the cloud-based ACR service; communicate a request for the metadata to a cloud-based metadata source; and receive the metadata from the cloud-based metadata source in response to the request.
In Example 26, the subject matter of one or any combination of Examples 23-25 optionally includes a content recognition unit and a port for operative coupling to an Internet access point. The service application of the first server is configured to communicate a request for automatic content recognition (ACR) of an Internet-based streaming version of the over-the-air radio broadcast to the content recognition unit, and the request includes a uniform resource locator (URL) from the service application identifying the Internet-based streaming version of the over-the-air radio broadcast. The content recognition unit is configured to: perform ACR using the Internet-based streaming version in response to the request; and associate metadata with the over-the-air radio broadcast using identified content.
In Example 27, the subject matter of one or any combination of Examples 23-26 optionally includes the service application of the first server configured to initiate transmission of the metadata to the plurality of radio broadcast receivers via the Internet.
In Example 28, the subject matter of one or any combination of Examples 23-27 optionally includes the first server including a second port for operative coupling to a digital radio broadcast transmitter. The service application is optionally configured to initiate transmission of the metadata to the digital radio broadcast transmitter via the second port.
These non-limiting examples can be combined in any permutation or combination.
The above detailed description includes references to the accompanying drawings, which form a part of the detailed description. The drawings show, by way of illustration, specific embodiments in which the invention can be practiced. These embodiments are also referred to herein as “examples.” All publications, patents, and patent documents referred to in this document are incorporated by reference herein in their entirety, as though individually incorporated by reference. In the event of inconsistent usages between this document and those documents so incorporated by reference, the usage in the incorporated reference(s) should be considered supplementary to that of this document; for irreconcilable inconsistencies, the usage in this document controls.
In this document, the terms “a” or “an” are used, as is common in patent documents, to include one or more than one, independent of any other instances or usages of “at least one” or “one or more.” In this document, the term “or” is used to refer to a nonexclusive or, such that “A or B” includes “A but not B,” “B but not A,” and “A and B,” unless otherwise indicated. In this document, the terms “including” and “in which” are used as the plain-English equivalents of the respective terms “comprising” and “wherein.” Also, in the following claims, the terms “including” and “comprising” are open-ended, that is, a system, device, article, composition, formulation, or process that includes elements in addition to those listed after such a term in a claim are still deemed to fall within the scope of that claim. Moreover, in the following claims, the terms “first,” “second,” and “third,” etc. are used merely as labels, and are not intended to impose numerical requirements on their objects.
The above description is intended to be illustrative, and not restrictive. For example, the above-described examples (or one or more aspects thereof) may be used in combination with each other. Other embodiments can be used, such as by one of ordinary skill in the art upon reviewing the above description. The Abstract is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In the above Detailed Description, various features may be grouped together to streamline the disclosure. This should not be interpreted as intending that an unclaimed disclosed feature is essential to any claim. Rather, the subject matter may lie in less than all features of a particular disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separate embodiment, and it is contemplated that such embodiments can be combined with each other in various combinations or permutations. The scope should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
This application is a Divisional of U.S. patent application Ser. No. 15/671,768, filed on Aug. 8, 2017, the contents of which are incorporated by reference herein in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
6628928 | Crosby et al. | Sep 2003 | B1 |
6834308 | Ikezoye et al. | Dec 2004 | B1 |
7471677 | Deshpande | Dec 2008 | B2 |
7523312 | Kalker et al. | Apr 2009 | B2 |
7844259 | Iwatsu | Nov 2010 | B2 |
7881657 | Wang et al. | Dec 2011 | B2 |
8331966 | Anzures et al. | Dec 2012 | B2 |
8401580 | Anzures et al. | Mar 2013 | B2 |
9026546 | Emerson | May 2015 | B2 |
9049496 | Raesig | Jun 2015 | B2 |
9330647 | Bay | May 2016 | B1 |
9418669 | Emerson | Aug 2016 | B2 |
10574373 | Dillon | Feb 2020 | B2 |
20020183059 | Noreen et al. | Dec 2002 | A1 |
20040244042 | Billmaier | Dec 2004 | A1 |
20050176366 | Levy | Aug 2005 | A1 |
20060218580 | Bushnell | Sep 2006 | A1 |
20060218613 | Bushnell | Sep 2006 | A1 |
20080082510 | Wang | Apr 2008 | A1 |
20080133376 | Hill | Jun 2008 | A1 |
20090164514 | Svendsen | Jun 2009 | A1 |
20090205000 | Christensen et al. | Aug 2009 | A1 |
20100057781 | Stohr | Mar 2010 | A1 |
20100291861 | Anzures et al. | Nov 2010 | A1 |
20110124283 | Deluca | May 2011 | A1 |
20120036538 | Kudelski | Feb 2012 | A1 |
20120047156 | Jarvinen et al. | Feb 2012 | A1 |
20130071090 | Berkowitz et al. | Mar 2013 | A1 |
20130198768 | Kitazato | Aug 2013 | A1 |
20130254793 | Anniballi et al. | Sep 2013 | A1 |
20140007152 | Pora | Jan 2014 | A1 |
20140089309 | Ibasco et al. | Mar 2014 | A1 |
20140195028 | Emerson, III | Jul 2014 | A1 |
20140280265 | Wang | Sep 2014 | A1 |
20140282657 | Sinha et al. | Sep 2014 | A1 |
20140335834 | Emerson | Nov 2014 | A1 |
20140336799 | Emerson | Nov 2014 | A1 |
20150012937 | Yamagishi | Jan 2015 | A1 |
20160073148 | Winograd | Mar 2016 | A1 |
20160212501 | Master | Jul 2016 | A1 |
20160217136 | Maghraby | Jul 2016 | A1 |
20160314794 | Leitman | Oct 2016 | A1 |
20160352793 | Lee et al. | Dec 2016 | A1 |
20170013028 | Yang et al. | Jan 2017 | A1 |
20190052387 | Dillon | Feb 2019 | A1 |
Number | Date | Country |
---|---|---|
WO-2015162294 | Oct 2015 | WO |
WO-2019032453 | Feb 2019 | WO |
Entry |
---|
“U.S. Appl. No. 15/671,768, Notice of Allowance dated Oct. 21, 2019”, 23 pgs. |
“U.S. Appl. No. 15/671,768, Response filed Sep. 6, 2019 to Restriction Requirement dated Jul. 9, 2019”, 8 pgs. |
“U.S. Appl. No. 15/671,768, Restriction Requirement dated Jul. 9, 2019”, 9 pgs. |
“International Application Serial No. PCT/US2018/045374, International Search Report dated Oct. 18, 2018”, 2 pgs. |
“International Application Serial No. PCT/US2018/045374, Written Opinion dated Oct. 18, 2018”, 8 pgs. |
“International Application Serial No. PCT/US2018/045374, International Preliminary Report on Patentability dated Feb. 20, 2020”, 10 pgs. |
Number | Date | Country | |
---|---|---|---|
20200153522 A1 | May 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15671768 | Aug 2017 | US |
Child | 16741902 | US |