The present invention relates generally to online searching and, more particularly, concerns a method and system for online searching of physical objects and multimedia, such as a broadcast radio or print media commercial, and establishing a communication relative to the multimedia through the use of an externally provided, actuable executable, such as a software button.
Online searches in accordance with the present invention are provided through the use of a “computing device”, which will be understood to include not only an actual computer, such as a personal computer, but also any kind of intelligent device, such as a personal digital assistant (PDA) or a smart telephone, capable of Internet browsing. For voice communications, the device will need to be capable of sensing sound, as through a microphone, and producing sound, as through a speaker or earphone. Communication takes place through a network, such as the Internet and, in some instances, through the public service telephone network (PSTN).
Online searching, for example on the Internet, is by now a common experience. Even competent searchers spend endless hours seeking useful information on a wide range of subjects. A great deal of time could be saved if a searcher had immediate access to a human for assistance on the subject being searched.
In our co-pending U.S. patent application Ser. No. 12/603,683, filed Oct. 22, 2009, we disclose a method and system for facilitating telephone calls that convey the context of the call to the called party. The disclosure of that patent application is incorporated herein by reference in its entirety. In accordance with one embodiment of the invention disclosed in that patent application, a software button is utilized on a computing device to initiate a call. Activation of the button causes a “soft phone” to be downloaded from a server. The soft phone is essentially an executable software agent that operates on the computing device to set up a call to only a specified telephone number. The software agent causes certain call context information to be embedded which is unique to the actuated software button.
In our co-pending U.S. patent application Ser. No. 13/013,085, filed Jan. 25, 2011, a user performing a search on a computing device, for example with a browser application, is provided with one or more software buttons on the display of the device. The buttons are created based on the subject matter of his search. As the user searches, his queries are stored. Should the user actuate a software button, real time communication, for example a telephone call, is established with an adviser, who receives a copy of the user's search queries on his computing device.
We now seek to extend enhanced searching beyond Internet objects to physical ones. For example, suppose a user hears a broadcast radio advertisement while driving. Despite an advertiser's efforts to select an easy to remember telephone number or website name, the chances of a driver forgetting the contact information are very high. The efforts required for an occupied driver to remember a telephone number or website name and to later call the number or look up the website is a big barrier to the effectiveness of a broadcast advertisement campaign. To a great extent, advertisements in print media (newspapers, magazines, books on product labels) have similar difficulties. A commuter riding a train may read through newspaper and magazine advertisements without remembering the contact information for items of interest. Similarly, a shopper walking around in a supermarket or mall may see a product of interest and want to memorize it for further study or inquiry, and the only way to do so is to write down something from the product label.
In accordance with one aspect of embodiments of the present invention, a method is provided responding to a search by a user initiated by the user's submission through a computing device of a representation of a physical object. In response, an actuable software button associated with a device of a subscriber related to the object is returned. The software button is constructed so that, upon its actuation, a communication connection is established with the device of a subscriber related to the object and an identification of the object is sent to the device.
In accordance with another aspect of embodiments of the present invention, online searching related to a physical object by a user making use of a computing device is accomplished by creating a representation of the object at the user's computing device. A software button originating remote from the user's computing device is provided to the user's computing device, and the button is constructed based upon the representation of the object. The software button is associated with a second device in use by a subscriber associated with the object, the button and it is actuable by the user. Upon actuation of the software button by the user, an executable agent is downloaded to his computing device, effective to establish a connection between the user's computing device and the second device.
The foregoing description and other objects, features, and advantages of the present invention will be understood more completely from the following detailed description of presciently preferred, but nonetheless illustrative, embodiments in accordance with the present invention, with reference being had to the accompanying drawings, in which:
The terminology defined in this paragraph will be used consistently herein. A button is sent from a “Sender” to a “Recipient.” When clicking on a button, the Recipient is attempting to initiate a communication, for example, a call to the Sender. Thus, when a call is established, the (button) Recipient is the “Caller” (making the call), and the (button) Sender is the “Receiver” (of the call). Recipient and Sender are associated with the button operation, and Caller and Receiver are associated with the call session.
Turning now to the details of the drawings,
In practice, user U will have to “tag” the object of his search with computing device 20 before undertaking the search. Tagging involves obtaining a representation of the object. For example, if the object is a radio advertisement and computing device 20 is a smartphone, it would contain an object tagger 50 (e.g. an application running on the smartphone) to capture a sound sample from the advertisement upon the user's operation of an activation key. This is not a typical start/stop recording, but an automatic capture of sound segment upon operation of a key. Similarly, if the object were viewable, the object tagger would be constructed to take a photograph of the object with the built-in camera on the smartphone, upon the user's operation of a key. Object tagger 50 stores captured samples for subsequent retrieval. Specifically, user U may review a sample and submit it as part of a search.
User U initiates an online search through his computing device 20 (block 60). At block 62, he retrieves a captured sample, using object tagger 50, and submits it as part of a search to search server 52. Server 52 then performs a search, using the submitted sample and returns the results to the user's computing device 20 (block 64).
In the present example, the sample is a tagged portion of a radio commercial. Server 52 has a database with a collection of “fingerprints” of radio commercials. The server runs a pattern recognition algorithm on the sample correlating the sample to the database. Appropriate pattern recognition algorithms exist in the art. See, for example, U.S. Pat. Nos. 7,277,766 and 5,918,223. Through this operation, server 52 will find one or more commercials that correlate to the sample. It then communicates with button system 54 to obtain communication buttons for the companies which provide the found commercials (block 68). These companies are all subscribers to the button system and would have set up appropriate buttons previously.
A search service is available at http://www.shazam.com which has a database of “fingerprints” of recordings of popular songs. A user runs an application on his smartphone which allows him to capture a sample recording of a song he hears. When he submits the sample recording to the server, it is correlated to the database, and the song is identified. Thus, the technology to perform the functions of search server 52 is readily available.
Search server 52 returns a web page to the containing the following features for each subscriber:
A test is performed at block 68 to determine whether the user has activated a software button. If not, control returns to the user (block 60). When the test at block 68 determines that the user has activated a software button, communication is established with button system 54 (block 70). If the chat button was pressed, button system 54 sends a software agent to computing device 20 causing it to take part in a real time chat session running on computing device 28 of the respective subscriber (block 72). If the voice connection software button was pressed, button system 54 sends a software agent to computing device 20 which sets up a voice connection with corresponding subscriber via telephone network T (block 76). Button system 54 creates an internal reference number, for example, “1234” for this call and causes the voice call to the advisor to be set up with that reference number as the caller ID (block 78). It then sends a message to the user's computing device 28 containing the reference number and identifying the commercial identified by the user. In the present instance, the user's computing device might display the message:
It is contemplated that that communication between button system 54 and the subscriber's computing device 28 would be via a continuous real-time instant messaging session, which can be implemented completely independently of the telephone communication. To receive the telephone communication, the subscriber need only have a telephone with a caller ID display.
Making a communication connection with another party typically means making a telephone call (PSTN, cell or VoIP), sending an SMS (Short Message Service) message on a cell phone, sending an Instant Message (IM) on a computer or sending an email. In each of these examples, a Caller, who initiates the call or the connection (real-time or messaging) with his telephone or computing device, makes a clear choice of the connection or service type to be used (i.e., phone, email, IM or SMS). Depending on the service type selected, the resulting connection is made to the appropriate receiving device (phone, computer, email box, etc.) used by the Receiver, who is the intended recipient of the call.
The service servers 26 shown in
In configuring a particular communication option, a Sender obviously has to provide appropriate parameters to use. For example, the Sender has to specify a phone number for calling, an email address for email, and so on. These parameters are written into button database 24, available to server 22, and they are hidden from the users. The parameters provided by a subscriber can be changed anytime.
Although preferred embodiments of the invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that many additions, modifications, and substitutions are possible without departing from the scope and spirit of the invention as defined by the accompanying claims.
Number | Name | Date | Kind |
---|---|---|---|
5754636 | Bayless et al. | May 1998 | A |
5918223 | Blum et al. | Jun 1999 | A |
7277766 | Khan et al. | Oct 2007 | B1 |
20010038624 | Greenberg et al. | Nov 2001 | A1 |
20020039095 | Nakano | Apr 2002 | A1 |
20020120680 | Greco et al. | Aug 2002 | A1 |
20060033809 | Farley | Feb 2006 | A1 |
20070156726 | Levy | Jul 2007 | A1 |
20080028223 | Rhoads | Jan 2008 | A1 |
20080107051 | Chen | May 2008 | A1 |
20090277322 | Cai et al. | Nov 2009 | A1 |
20110242617 | King et al. | Oct 2011 | A1 |
Entry |
---|
International Search Report and Written Opinion, dated May 8, 2012 of International Application No. PCT/US2012/22350, filed: Jan. 24, 2012. |
Number | Date | Country | |
---|---|---|---|
20120203793 A1 | Aug 2012 | US |