Patent Application
20150310479
1. Field of the Invention
The present invention relates to electronic billboards, and, more particularly, to presenting digital information in conjunction with an electronic billboard.
2. Description of the Related Art
Currently, the digital signage solutions available in the market are not accompanied by audio. The information that the viewer can obtain is limited to the images displayed on the digital signs.
The invention may provide a method for synchronizing a message/video displayed on a digital sign board with an audio channel of a smartphone by using a combination of optical image processing, optical character recognition, a timestamp in the audio channel, and the actual time displayed on the board. A time-of-day may be indicated on the signboard by numbers or by a Quick Response code, for example.
The invention utilizes smartphone technology to enable images on signboards to be accompanied by audio messages. The high resolution of modern digital signs along with cameras on smartphones are combined to synchronize the audio with the video displayed on the sign. The audio data may be predownloaded from the application server multimedia database to the smartphone based on the current geographic GPS coordinate location of the smartphone.
The invention may enable the synchronous playback of the audio on the smartphone with the video of the digital sign.
The invention comprises, in one form thereof, a method of operating a plurality of signboards, including continuously displaying a current time-of-day on the signboards. A request is received from a smartphone for an audio clip corresponding to one of the signboards. The request includes the displayed time-of-day as captured from the one signboard by a camera of the smartphone. The request also includes a geographic location of the smartphone. It is determined that the one signboard is within a visible range of the smartphone. The determining is performed dependent upon the geographic location of the smartphone. The audio clip corresponding to the one signboard is selected from a plurality of audio clips. The selecting is performed dependent upon the determination that the one signboard is within a visible range of the smartphone and upon the displayed time-of-day. At least a portion of the selected audio clip is downloaded to the smartphone.
The invention comprises, in another form thereof, a method of operating a plurality of signboards, including receiving a request from a smartphone for an audio clip corresponding to one of the signboards. The request includes a geographic location of the smartphone, and a cardinal direction in which a camera on the smartphone is directed. It is determined, dependent upon the geographic location of the smartphone that the one signboard is within a visible range of the smartphone. It is ascertained, dependent upon the cardinal direction in which the camera on the smartphone is directed, that the one signboard may be within the field of view of the camera. The audio clip corresponding to the one signboard is selected from a plurality of audio clips. The selecting is dependent upon the determining step and upon the ascertaining step. The selected audio clip is downloaded to the smartphone.
The invention comprises, in yet another form thereof, a method of operating a signboard, including receiving from a motor vehicle a geographic location of the vehicle and a cardinal heading direction of the vehicle. A signboard that is visible to a person within the vehicle is identified dependent upon the geographic location of the vehicle and the cardinal heading direction of the vehicle. An audio clip corresponding to the signboard is selected from a plurality of audio clips dependent upon the identifying step and upon a time-of-day. The selected audio clip is downloaded to the vehicle.
An advantage of the present invention is that audio playback files may capture a user's attention better than a signboard alone, and may bring the signboard to the user's attention.
The above-mentioned and other features and objects of this invention, and the manner of attaining them, will become more apparent and the invention itself will be better understood by reference to the following description of embodiments of the invention taken in conjunction with the accompanying drawings, wherein:
Smartphone—a cellular phone that performs many of the functions of a computer, typically having a touchscreen interface, Internet access, and an operating system capable of running downloaded applications.
QR Code—a type of matrix barcode (or two-dimensional barcode). A barcode is a machine-readable optical label that contains information about the item to which it is attached.
Timestamp—a sequence of characters or encoded information associated with a time an event has occurred or will occur, or with a time duration of the event,
The embodiments hereinafter disclosed are not intended to be exhaustive or limit the invention to the precise forms disclosed in the following description. Rather the embodiments are chosen and described so that others skilled in the art may utilize its teachings.
Smart phone 14 includes a camera 20 which the user may point at billboard 12 and capture an image thereof, as indicated at 22. Phone 14 also includes a GPS module 24 that determines the geographical coordinates of phone 14, as is well known.
Phone 14 further includes an image processor 26 that processes images captured by camera 20. More particularly, as indicated at 28, processor 26 may transform the image displayed on billboard 12, including both the image within area 18 and the image within a remaining area 30 on billboard 12. The transformation of the image within area 18 may include segmentation of the QR code in order to decode the information encoded within the QR code. More generally, “segmentation.” may refer to the process of assigning a label or value to each pixel within an image such that pixels having equivalent labels or values also have equivalent visual characteristics. In this case, the QR code may specify the content displayed within area 18. For example, there may be a number of billboards displayed around the world or around the country that display the same content (e.g., “Panasonic”), and each of these billboards may share the same identification QR code. The transformation of the image within area 18 performed by image processor 26 may also include optical character recognition (OCR) to determine the time of day or clock time that is displayed within area 18.
After camera 20 has captured the image of the billboard, GPS 24 may determine the geographical coordinates of phone 14. Application server 16 may include a database specifying which billboards are visible at any location or set of geographical coordinates. For example,
It is also possible in one embodiment for phone 14 to include a compass application that determines in which cardinal direction camera 20 is pointed. Then only the audio clips or files associated with the signboard at which camera 20 is pointed may need to be downloaded to phone 14.
In one embodiment, geographic locations of the signboards may be determined in order to ascertain which, if any, signboard is within the field of view of the smartphone camera, or within the field of view of the humans within the vehicle, given the geographic locations of the camera or vehicle, and possibly the direction in which the camera is pointed. The geographic location of each signboard may be found in a lookup table maintained by the application server, or may be determined in real time by GPS devices associated with each respective signboard.
As an example of how the table of
Vehicle electronics 114 includes a GPS module 124 that determines the geographical coordinates of phone 14, as is well known; a compass device 150 that determines a direction 152 in which vehicle 148 is headed or facing; and a radio processor 126 that receives the geographical location information from GPS 124 and the direction information from compass device 150. Radio processor 126 uploads the geographical location information and the direction information to application server 116, as indicated at 142. Application server 116 may download a satellite radio service to radio processor 126 for audibly playing on loudspeakers (not shown) within vehicle 148.
During use, when the satellite radio service programming reaches a commercial break, application service 116 may determine, based on the geographical location information and the direction information associated with vehicle 148, whether people within vehicle 148 are likely to be able to see and recognize what is being displayed on billboard 112. If it is determined that people within vehicle 148 are likely to be able to see and recognize what is being displayed on billboard 112, then the satellite radio service may download to radio processor 126 an audio clip that corresponds to the images displayed on billboard 112 rather than the audio commercial that would otherwise be downloaded to radio processor 126. Application service 116 may determine, based on the time-of-day, what images are being displayed on billboard 112, and what audio clip corresponds to the images and thus should be downloaded to radio processor 126 for playing within vehicle 148.
While this invention has been described as having an exemplary design, the present invention may be further modified within the spirit and scope of this disclosure. This application is therefore intended to cover any variations, uses, or adaptations of the invention using its general principles. Further, this application is intended to cover such departures from the present disclosure as come within known or customary practice in the art to which this invention pertains.
This application claims the benefit of U.S. Provisional Application No. 61/984,480 filed on Apr. 25, 2014, which the disclosure of which is hereby incorporated by reference in its entirety for all purposes.
| Number | Date | Country | |
|---|---|---|---|
| 61984480 | Apr 2014 | US |
