This application is a U. S. National Phase Application of PCT International Application PCT/JP2012/058259 filed on Mar. 28, 2012, which is based on and claims priority from JP 2011-083976 filed on Apr. 5, 2011, the contents of which is incorporated in its entirety by reference.
The present invention relates to an information providing system that provides a variety of information by using sound identification information and an identification information resolution server and a mobile terminal device that are used in the system.
Regarding television broadcasting, a system has been commercialized which superimposes data broadcasting during program broadcasting and provides a variety of information relating to the program by a remote control operation of a television.
Also, in order to increase a real time viewer rate of the television program, a program progressing model has been widely used which presents one or more keywords in the program, calls a viewer at the end of the program and provides an award if the viewer speaks the keywords.
Patent Literature 1: JP-A-2008-288638
Instead of the keyword presentation, a scheme is considered in which the data broadcasting is used as means for increasing the viewer rate of the television program. However, since the data broadcasting cannot cope with an individual access of a viewer, it is necessary to receive an access of a viewer by separate means so as to provide an award. Also, even when an award content such as coupon is displayed on a screen of a television receiver, the viewer cannot carry and utilize the displayed award content. In addition to the television broadcasting, there are also many demands for inducing a user to a media including radio broadcasting and web site, a store and the like.
An object of the present invention is to provide an information providing system capable of providing a mobile terminal device, which is used by a user, with information by using sound identification information to thus induce the user to a media, a store and the like in real time, and also to provide an identification information resolution server and a mobile terminal device, which are used in the system.
A first aspect includes an information providing system including: a sound emission device, adapted to emit, as a sound wave, identification information modulated to a sound signal; an identification information resolution server that is connected to an information communication network and includes a mapping table in which the identification information, valid time information, which indicates a range of valid time of the identification information, and address information of a content corresponding to the identification information are stored to be associated with each other; and a mobile terminal device that includes a sound pickup unit, adapted to pick up the sound wave emitted from the sound emission device, a demodulation unit, adapted to demodulate the identification information from the picked up sound wave, an identification information resolution unit, adapted to transmit the demodulated identification information to the identification information resolution server and thus acquire the address information, and a network access unit, adapted to access the content by using the acquired address information, wherein the identification information resolution server receives the identification information from the mobile terminal device, refers to the mapping table by using time information and the identification information and returns the address information of a corresponding content to the mobile terminal device when the time information is within the range of valid time indicated by the valid time information.
A second aspect includes the feature that the sound emission device is a broadcasting receiving device, the sound wave is transmitted from a broadcasting station, as a sound wave in a broadcasting program or promo, and the identification information resolution server identifies address information for accessing a content relating to the program or promo, based on the received identification information.
A third aspect includes the feature that the time information indicates at least one of time at which the identification information resolution server receives the identification information, time at which the sound pickup unit of the mobile terminal device picks up the sound wave, time at which the demodulation unit of the mobile terminal device demodulates the identification information and time at which the identification information resolution unit of the mobile terminal device transmits the identification information to the identification information resolution server.
An identification information resolution server of a fourth aspect includes: a reception unit, adapted to receive identification information through an information communication network from a mobile terminal device that is adapted to pick up a sound wave including the identification information and demodulate the identification information from the sound wave, the identification information being modulated to a sound signal; a storage unit storing therein a mapping table in which the identification information, valid time information, which indicates a range of valid time of the identification information, and address information of a content corresponding to the identification information are stored to be associated with each other; and an identification information resolution section, adapted to refer to the mapping table by using time information and the identification information received by the reception unit and return the address information of a corresponding content to the mobile terminal device when the time information is within the range of valid time indicated by the valid time information.
A fifth aspect includes an information providing system including: a sound emission device, adapted to emit, as a sound wave, identification information modulated to a sound signal; an identification information resolution server that is connected to an information communication network and includes a mapping table in which the identification information and address information of a content corresponding to the identification information are stored to be associated with each other; and a mobile terminal device that includes a sound pickup unit, adapted to pick up the sound wave emitted from the sound emission device, a demodulation unit, adapted to demodulate the identification information from the picked up sound wave, an identification information resolution unit, adapted to transmit the demodulated identification information to the identification information resolution server and thus acquire the address information, and a network access unit, adapted to access the content by using the acquired address information, wherein the demodulation unit of the mobile terminal device further extracts time information from the picked up sound wave or the demodulated identification information, and the identification information resolution unit of the mobile terminal device determines whether the identification information is valid or not based on the extracted time information, and transmits the identification information to the identification information resolution server when it is determined that the identification information is valid.
A mobile terminal device of a sixth aspect includes: a sound pickup unit, adapted to pick up a sound wave emitted from a sound emission device; a demodulation unit, adapted to demodulate identification information from the picked up sound wave; an identification information resolution unit, adapted to transmit the demodulated identification information to an identification information resolution server and thus acquire address information; and a network access unit, adapted to access a content corresponding to the identification information by using the acquired address information, wherein the demodulation unit further extracts time information from the picked up sound wave or the demodulated identification information, and the identification information resolution unit determines whether the identification information is valid or not based on the extracted time information, and transmits the identification information to the identification information resolution server when it is determined that the identification information is valid.
According to the aspects of the present invention, the valid time is set for the identification information superimposed on the sound, and the address information of the content is provided to the mobile terminal device when the time information is within the range of the valid time. Therefore, it is possible to induce a user of the mobile terminal device to a media such as a television program, a radio program and a web site or to a store in real time.
An information providing system according to an embodiment of the present invention will be described with reference to the drawings.
First, the information providing system is outlined. The television 1 emits a broadcasting sound and a sound ID while a predetermined television program (including a CM) is being telecast. The sound ID is emitted with being superimposed on the broadcasting sound. In the meantime, the sound ID may be superimposed by the television 1, a broadcasting station or a relay device. The emitted sound ID is picked up by the mobile terminal device 2. The mobile terminal device 2 demodulates the sound ID to an ID code and accesses a specific internet site (URL) by using the ID code. By doing so, specific information such as coupon or the like is transmitted from the internet site to the mobile terminal device 2. Like this, since the user 6 (viewer) of the mobile terminal device 2 can acquire the content such as coupon or the like by watching the predetermined television program, the user intends to watch the television program. Thereby, it is possible to improve the viewer rate of the television program.
The system has a main object of improving the viewer rate during the broadcasting of the television program. Thus, even when the internet site is accessed after the broadcasting of the program by using a sound ID, which is emitted when the user 6 reproduces a program video-recorded in a storage medium such as a hard disk drive, an optical disk and the like in home, the system determines that the access time to the Internet site is not within a predetermined valid time one designated by the television broadcasting, and cannot provide the content.
The television 1 is an example of a broadcasting receiving device that receives television broadcasting, displays an image and emits a sound. The sound ID that is an ID code modulated to a sound signal is superimposed on the sound of the television broadcasting. The sound ID may be superimposed one time upon opening part of the television broadcasting or may be superimposed several times at appropriate timing. Also, the sound ID may be repeatedly superimposed over an entire time zone of the television broadcasting. The superimposing method of the sound ID will be described later. The mobile terminal device 2 picks up the sound on which the sound ID is superimposed. The user 6 carries the mobile terminal device 2. The mobile terminal device 2 is installed with a sound ID application program that is executed by a control unit 22, which will be described later. The sound ID application program is application software that separates the sound ID from the picked up sound to thus demodulate the same to an ID code and transmits the ID code to an ID resolution server 4, thereby acquiring a URL of a content server 5 from the ID resolution server 4. As shown in
The sound ID is superimposed on a frequency band of a high-tone range of an audible sound that is reproduced by a speaker of the television 1. As shown in
Regarding the method of superimposing the sound ID on the sound of the program or CM, a variety of methods can be adopted. For example, a technology is suitable which is specifically described in WO 2010/016589 and spreads an ID code with a spread code to thus frequency-shift the same to a frequency band of 18 to 20 kHz.
In order to resolve the sound ID to a URL, the ID resolution server 4 is provided with the ID/URL mapping table 40 shown in
Also, in the ID/URL mapping table 40 of
The control unit 22 is configured by a processing means such as a CPU and the like and a storage means such as a RAM and the like storing various programs and data. The CPU and the like execute the various programs, so that the control unit 22 is implemented. The control unit 22 is provided with the sound ID processing unit 23 and a web browser 24. The control unit 22 executes a sound ID application program, so that the sound ID processing unit 23 is implemented. Also, the control unit 22 executes a browser program, which is a standard application program of the mobile terminal device 2, so that the web browser 24 is implemented. The sound ID processing unit 23 has a processing unit that enables a picked-up sound signal to pass through a matched filter, which has a spread code used in spread modulation as a coefficient, and thus demodulates an ID code, a processing unit that controls the network communication unit 25 and performs communication with the ID resolution server 4 and the content server 5, and the like. The demodulation processing of the ID code is specifically described in WO 2010/016589. The web browser 24 accesses the URL acquired by the sound ID processing unit 23 and thus displays a web page.
The GPS position measuring unit 26 measures a position thereof by using a GPS and provides the position information or time information to the web browser 24. Also, the timer 27 measures time upon the pickup of a sound including the sound ID or upon communication with the ID resolution server 4 and provides the time information to the web browser 24. The GPS position measuring unit 26 and the timer 27 are not necessarily provided in this embodiment. Also, the operation unit 28 is a touch panel that is provided on a surface of the display unit 29, for example, and detects an operation of the user 6 such as permission of the communication with the network 3.
The control unit 42 is connected to the storage unit 43 and the timer 47. The control unit 42 is a processing unit (an identification information resolution unit) (which will be specifically described later) that executes ID resolution processing of resolving an ID code, which is received through the network communication unit 45, to a URL while referring to the ID/URL mapping table 40 stored in the storage unit 43 and the timer 47.
The content server 5 is a computer apparatus having a storage unit that stores a variety of data configuring contents such as advertisement/coupon or the like corresponding to the URL resolved by the ID resolution server 4, a communication unit that transmits and receives a message, data and the like to and from the mobile terminal device 2, which is a client, and a control unit for implementing a function such as a web server that provides the information such as advertisement/coupon or the like, as a response corresponding to a request from the mobile terminal device 2. In the meantime, the configuration of the computer apparatus configuring the ID resolution server 4 and the content server 4 is arbitrary and may be implemented in one computer apparatus or a plurality of computer apparatuses. Alternatively, the configuration may be implemented on a virtual server that is provided through a network, not the actual computer apparatus.
In the meantime, the ID resolution server 4 executes following authentication processing to thereby specify the mobile terminal device 2. That is, the mobile terminal device 2 transmits a unique identification code of the mobile terminal device 2 to the ID resolution server 4 and executes predetermined processing to thus complete the authentication processing. Also, the authentication processing is preferably executed up to S3 of
In the meantime, when the content is data of a format that does not require the web browser 24, the sound ID processing unit 23 activates a necessary application program without activating the web browser 24, thereby displaying or reproducing the content.
Also, in order to prevent a plurality of accesses to the ID resolution server 4, the sound ID processing unit 23 of the mobile terminal device 2 or other processing unit provided to the control unit 22 may determine whether the ID code demodulated in S2 is the same ID code demodulated in past predetermined time. When the same ID code is identified, the sound ID processing unit 23 may not execute the transmission to the ID resolution server 4 in S3. Thereby, it is possible to prevent the ID code associated with the same program or scene from being uselessly transmitted several times from one mobile terminal device 2 to the ID resolution server 4.
In the flowchart of
When the mobile terminal device 2 waits for an operation of the user 6 and then accesses the ID resolution server 4, a message indicating that the mobile terminal device 2 receives the sound ID may be displayed or announced or the television 1 may instruct the user 6 to perform the transmission operation of the mobile terminal device 2 at appropriate timing after the sound ID is superimposed in the television program. In this case, the television 1 may instruct that the transmission operation should be made in conformity with a specific scene (for example, a scene at which an actor A shows up) that a user cannot know when it will be telecast. In the meantime, instead of the television 1, the mobile terminal device 2 or other instruction means may be used to instruct the user 6 to perform the transmission operation.
When predetermined time elapses after the sound ID is emitted, a message urging the user to operate the mobile terminal device 2 is displayed or announced in the television program, so that only the user 6 (the mobile terminal device 2) watching the TV from the emission of the sound ID to the display or announcement of the message may be enabled to access the ID resolution server 4. Also, after the sound ID is emitted, when the transmission operation is instructed in conformity to a specific scene that a user cannot know when it will be telecast in the television program, it is possible to urge the user 6 to watch the program from the instruction to the specific scene. The valid time zone of the ID/URL mapping table 40 may be preferably constant time from the display or announcement or specific scene.
By the above processing, while the ID resolution server 4 returns a URL of the content to the mobile terminal device 2 only when it is accessed immediately (or at predetermined timing) after the sound ID is telecast (emitted) in the television program, the ID resolution server 4 performs the invalidation processing for an access in a time zone deviating from the valid time zone after predetermined time elapses from the actual broadcasting, for example upon reproduction of a recorded content.
Meanwhile, in this embodiment, the ID resolution server 4 determines whether it is a valid time zone or not by using the time information that is the reception time at which the ID code is received from the mobile terminal device 2. However, the time that is used to determine the valid time period is not limited thereto. For example, time at which the mobile terminal device 2 picks up or demodulates the sound ID, time at which the mobile terminal device 2 transmits the ID code to the ID resolution server 4 or the like may be used. In this case, the time acquired by the GPS measuring unit 26 of the mobile terminal device 2 or time measured by the timer 27 is transmitted to the ID resolution server 4 together with the ID code, as the time information. Also, the plurality of time information may be used or combined to perform the determination.
When the determination is made using the plurality of time information, the ID code is preferably determined valid if all the plurality of time information is within the valid time zone of the ID/URL mapping table 40. Also, valid time zones about a plurality of time information may be respectively stored in the ID/URL mapping table 40, and when the plurality of time information is within the respective valid time zones, the received ID code may be determined valid.
Also, the ID resolution server 4 may determine whether the ID code is valid/invalid, based on a time difference of the plurality of time information. That is, when the ID code is transmitted to the ID resolution server 4 immediately (or in predetermined time) after the sound ID is received or after the sound ID is demodulated to the ID code, the ID code is determined valid. In this case, information of a valid time difference may be stored in the ID/URL mapping table 40, instead of the information of the valid time zones, as shown in
Also, the ID resolution server 4 may acquire the plurality of time information, perform the determination by one time information and determine a priority of the access by using the other time information. For example, the ID resolution server 4 determines whether the ID code is valid/invalid, based on the reception time, acquires time at which the ID code is demodulated from the mobile terminal device 2 and sets a priority of the access higher as a time difference from the demodulation time to the reception time is shorter. Regarding the access having a higher priority, a privilege that provides a URL providing a higher degree of content even though the ID code is the same may be given, for example.
Also, the time acquired by the GPS measuring unit 26 of the mobile terminal device 2 and the time measured by the timer 27 may be compared. Thereby, it is possible to obtain correct time information or to prevent incorrect time information from being acquired.
In the above embodiment, an example where the sound ID is superimposed on the sound of the television 1 to thereby improve the viewer rate of the television program has been described. However, the broadcasting is not limited to the television broadcasting. For example, when the present embodiment is applied to a radio broadcasting, it is possible to improve a listening rate of the radio broadcasting. Also, when the above embodiment is applied to the network delivery by the internet, it is possible to increase the number of accesses of a web site performing the network delivery. Like this, an operator of a television or radio broadcasting station or a web site can induce the user of the mobile terminal device 2 to a media in real time. Also, it is possible to emit the sound ID from a speaker mounted in a facility such as a retail store and to provide a content such as coupon or the like, thereby inducing a customer (the user of the mobile terminal device 2) to the store in the valid time zone to thus improve a customer visit (visit rate) to the store. In this case, a valid time zone may be set, so that it is possible to prevent a sound, which is recorded by a customer who records the sound ID by a sound recorder and the like and brings back the recorded sound ID, from being reproduced to acquire a content in a time zone deviating from the valid time zone.
When the speaker is mounted in the retail store and the like, the speaker 16 may be mounted in the vicinity of the store or in the store, as shown in (A) to (C) of
Meanwhile, in this embodiment, an exciter and a vibration pickup may be respectively used instead of the speaker 16 emitting the modulated signal and the microphone 21 picking up the signal. That is, the modulated signal may be transmitted by solid vibration, instead of the air vibration.
In the above embodiment, the smart phone has been exemplified as the mobile terminal device 2. However, the mobile terminal device 2 is not limited to the smart phone, and may be also a mobile phone, a PDA (Personal Digital Assistant) and the other device.
In the above embodiment, the ID resolution server 4 may return the URL when a plurality of accesses is tried from the mobile terminal device 2. For example, when ID codes are respectively attached to a plurality of scenes in the television program and all ID codes corresponding to the respective scenes are received from the mobile terminal device 2, when ID codes are respectively associated with the same program every day or every week and all the ID codes corresponding to the programs of respective episodes are received from the mobile terminal device 2, when an ID code emitted from a signage of a store is received several times, and the lie, the ID resolution server may return a URL to the mobile terminal device 2. In this case, the ID resolution server 4 may preferably store information of the identification code and the number of access times of the mobile terminal device 2 for a predetermined time period from the latest access.
In the above embodiment, the time information is not given to the sound ID and the ID resolution server 4 receiving the ID code from the mobile terminal device 2 determines whether the ID code is valid or invalid, based on the reception time. The time information may be added to the sound ID by other methods. By doing so, the mobile terminal device 2 may determine whether the sound ID (ID code) is valid or not, based on the time information read out from the received sound ID. That is, the sound ID that is emitted when reproducing the recorded program is determined invalid by the mobile terminal device 2 having received the sound ID because the time information included in the sound ID and the current time are largely different. Thereby, when the ID code is invalid, since the mobile terminal device 2 can destroy the ID code, the ID resolution server 4 does not transmit all the ID codes to the mobile terminal device 2, so that it is possible to reduce load of the ID resolution server 4. The time information may be a part of the ID code, and the ID code and the time information may be integrally modulated as the sound ID although the ID code and the time information are different information. Also, the time information may be encrypted.
Also, as a method other than the above method, the ID resolution server 4 may receive the accesses from the mobile terminal device 2 in order of arrival and return URLs of contents for a predetermined number of accesses transmitting the ID codes. In this case, the valid time information of the ID/URL mapping table 40 may be omitted.
As described above, in the respective embodiments, the sound ID processing unit 23 of the mobile terminal device 2 is a function unit that executes the sound ID application program in the control unit 22, and the sound ID application program can be provided with being recorded in a computer-readable recording medium. The computer-readable recoding medium may include a magnetic recording medium (a magnetic tape, a magnetic disk (HDD, FD) and the like), an optical recording medium (an optical disk (CD, DVD) and the like), an optical magnetic recording medium, a semiconductor memory and the like. Also, the program may be downloaded via an information communication network such as the Internet.
In the meantime, the ID code may be added to the broadcasting program by a method, other than the sound ID. For example, a sub code of a sound signal or data broadcasting may be also used. However, according to the method of using the sound ID, since it is not necessary to provide a new function to the television receiver 1, the method may be applied to an existing television receiver. Also, even when the sound ID is used, the sound signal may be emitted, as the sound (sound wave), from the speaker and picked up by the mobile terminal device 2 and may be also transmitted by a wired or wireless transmission system such as audio cable or Bluetooth (registered trademark).
The present application is based on Japanese Patent Application No. 2011-083976 filed on Apr. 5, 2011, the contents of which are incorporated herein by reference.
Number | Date | Country | Kind |
---|---|---|---|
2011-083976 | Apr 2011 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2012/058259 | 3/28/2012 | WO | 00 | 10/4/2013 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2012/137654 | 10/11/2012 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5612729 | Ellis et al. | Mar 1997 | A |
6163803 | Watanabe | Dec 2000 | A |
7324824 | Smith et al. | Jan 2008 | B2 |
8046257 | Wane | Oct 2011 | B2 |
8484670 | Klein | Jul 2013 | B2 |
8508357 | Srinivasan | Aug 2013 | B2 |
8930003 | Krug et al. | Jan 2015 | B2 |
20030051252 | Miyaoku et al. | Mar 2003 | A1 |
20030229900 | Reisman | Dec 2003 | A1 |
20040088739 | Shimoji | May 2004 | A1 |
20040117254 | Nemirofsky et al. | Jun 2004 | A1 |
20040117255 | Nemirofsky et al. | Jun 2004 | A1 |
20050076219 | De Bot | Apr 2005 | A1 |
20050080764 | Ito | Apr 2005 | A1 |
20060195861 | Lee | Aug 2006 | A1 |
20060282864 | Gupte | Dec 2006 | A1 |
20070022442 | Gil et al. | Jan 2007 | A1 |
20070299728 | Nemirofsky et al. | Dec 2007 | A1 |
20080032719 | Rosenberg | Feb 2008 | A1 |
20080049704 | Witteman et al. | Feb 2008 | A1 |
20080262928 | Michaelis | Oct 2008 | A1 |
20100134278 | Srinivasan et al. | Jun 2010 | A1 |
20110054993 | Marshall | Mar 2011 | A1 |
20110106605 | Malik | May 2011 | A1 |
20110150240 | Akiyama et al. | Jun 2011 | A1 |
20110246284 | Chaikin et al. | Oct 2011 | A1 |
20110314491 | Delidais et al. | Dec 2011 | A1 |
20110314995 | Lyon et al. | Dec 2011 | A1 |
20120005062 | Lutnick | Jan 2012 | A1 |
20120221389 | Sharma et al. | Aug 2012 | A1 |
20130024897 | Eyer | Jan 2013 | A1 |
20130127636 | Aryanpur | May 2013 | A1 |
20130279300 | Iwase et al. | Oct 2013 | A1 |
20150356620 | Gil et al. | Dec 2015 | A1 |
Number | Date | Country |
---|---|---|
1744606 | Mar 2006 | CN |
101379484 | Mar 2009 | CN |
2 189 915 | May 2010 | EP |
2 200 199 | Jun 2010 | EP |
11-110319 | Apr 1999 | JP |
11-119974 | Apr 1999 | JP |
2003-052072 | Feb 2003 | JP |
2005-122321 | May 2005 | JP |
2007-013925 | Jan 2007 | JP |
2007116719 | May 2007 | JP |
2008-258898 | Oct 2008 | JP |
2008-288638 | Nov 2008 | JP |
2012155706 | Aug 2012 | JP |
2004008276 | Jan 2004 | WO |
2010016589 | Feb 2010 | WO |
Entry |
---|
Notification of Reasons for Refusal issued in JP2012084062, dated Jan. 6, 2015. English translation provided. |
International Search Report issued in PCT/JP2012/058259 dated Apr. 24, 2012. |
Extended European Search Report, dated Jul. 22, 2014, issued in corresponding European Patent Application No. 12 76 7600. |
Notice of Submission of Opinion, dated Jun. 26, 2014, issued by the Korean Intellectual Property Office in corresponding Korean Patent Application No. 10-2013-7026194. Please note, reference cited in OA were previously cited in an IDS filed Oct. 4, 2013. English Translation provided. |
Notice of Submission of Opinion, issued by the Korean Intellectual Property Office in Application No. 10-2013-7026194 dated Jan. 27, 2015. English translation provided. References cited in OA have been previously cited in an IDS filed Feb. 13, 2015. |
Japanese Office Action issued in corresponding Japanese patent application No. JP2012-084062, dated Aug. 18, 2015. English translation provided. |
Office Action issued in CN Appln. No. 201280017523.6 mailed Mar. 28, 2016. English translation provided. |
Office Action issued in Chinese Appln. No. 201280017523.6, mailed Sep. 14, 2016. English translation provided. |
Written Opinion issued in Intl. Appln. No. PCT/JP2012/058259 dated Apr. 24, 2012. English translation provided. |
Number | Date | Country | |
---|---|---|---|
20140039654 A1 | Feb 2014 | US |