The present invention is directed toward setting up a network of short-range communication devices in three dimensional space and, in particular, to systems and methods associated with assigning identifications to the short-range communication devices and associating the short-range communication devices with products, category of products, product location, based on interactions among a communications device and a plurality of short-range transmission devices.
Short-range beacons using technologies such as infrared, ultrasonics, near-field communications (NFC) and Bluetooth® have been used to determine the presence of a device in the transmission range of the beacon. These technologies, may, for example, determine whether one Bluetooth enabled device is detached from another Bluetooth enabled device in order to sound an alarm.
An example embodiment of the present invention includes a system having multiple short-range transmission devices, each of which is assigned a unique identity by a listening device and is positioned at a respectively different location within a three dimensional space. The assignment of the identity is according to the signals broadcast by short-range device(s) as sensed unambiguously by the listening device and further includes associating the unique identity of the short-range devices, with a product, product category or location of a product in the three dimensional space.
The invention is best understood from the following detailed description when read in connection with the accompanying drawings, with like elements having the same reference numerals. When a plurality of similar elements are present, a single reference numeral may be assigned to the plurality of similar elements with a small letter designation referring to specific elements. When referring to the elements collectively or to a non-specific one or more of the elements, the small letter designation may be dropped. The letter “n” may represent a non-specific number of elements. Also, lines without arrows connecting components may represent a bi-directional exchange between these components. According to common practice, the various features of the drawings are not drawn to the scale. Also, the dimensions of the various features are arbitrarily expanded or reduced for clarity. Included in the drawings are the following figures:
With the proliferation of sensors and mobile listening devices, it may be possible for users, employing mobile listening devices, to gather information related to products in an indoor area based on the ability of the listening device to unambiguously receive data from one of the transponders located in the indoor area.
To support applications related to providing information from the transponders, the transponders in the indoor area are initialized. Particularly, the transponders, distributed throughout the area, may be assigned unique identity values associated with their respective locations in the indoor physical space to enable proximity applications for the client.
However, current navigation and positioning systems, providing longitude and latitude information, are optimized for outdoor environments and do not function well inside buildings. Furthermore, location determination for an interior space may require dense and expensive infrastructures, for example, WiFi Access Points and/or video cameras. As such, establishing indoor transponders for supporting the above mentioned applications remains a challenge.
Embodiments of the invention overcome the limitations by setting up a group of short-range transmission devices such as RF transponders in a three dimensional space and by assigning the RF transponders unique identifications. A RF transponder may not have a pre-defined identification and may acquire a unique identification during the setup process based on an interaction with the listening mobile device. The unique identification value of a RF transponder may be related to a product, class of products, indoor area identification value or physical location identification value within the indoor area.
The RF transponder identification may, for example be associated to a reference point (of a reference system) representing the physical location within the given environment. The reference point, in turn, may be related to a product. An advantage of this method is that, products may be moved around within the reference system, as the transponder identification will be associated to any product that is placed at the reference point. In this embodiment, it is desirable to keep the reference system current in terms of the association of the RF transponder identification with the reference point (as the physical location of the product may change). Alternatively, the RF transponder may be associated with products that are in the vicinity of the RF transponder's physical placement without using a reference system. The advantage of this method is its simplicity, however, any movement of a product needs to be tracked, and, in turn, the transponders may need to be moved or reprogrammed to reflect association with the moved product (as the products are directly associated with the RF transponder identification and not with the physical location of the product).
The subject invention is described in terms of short-range transmitters (e.g. Bluetooth® low energy (Ble) transmitters) the signals from which are captured by mobile listening devices, such as a mobile telephone including a Bluetooth transceiver. It is contemplated, however, that other types of transmitter and receivers can be used, for example infrared, ultrasonic, or near-field communications (NFC). In addition, as described below, it is contemplated that the transponders may be RF transceivers that do not broadcast signals but, instead, sense signals broadcast by the portable mobile device, such as the listening device. In such a scenario, the transponders may be associated with other transponders in a MESH network (e.g., ZigBee network based on IEEE 802.15) described below. Furthermore, although the transponders are described as being stationary, it is contemplated that they may be mobile devices as well and, thus, that the areas within the indoor area or zones related to these transponders may move throughout the space. Furthermore, although the invention is described in terms of a retail environment, it is contemplated that it has broader application including, without limitation, security, enterprise workflow, gaming and social interactions.
An example beacon system according to the subject invention employs a plurality of transponders each of which may broadcast a signal that is sensed by the listening device or sense a signal that is broadcast by a listening device. Each transponder may be assigned a unique identity. In one implementation, a transponder is assigned a unique identity and is further associated with a reference point. The reference point may be a particular area related to the transponder, for example, an aisle or a shelving unit in a retail store. In another example, a transponder may be further associated with a product in the retail store, or information related to the product.
Yet in another example, the listening device may assign the unique identity to the transponder upon being in a particular area or a zone relative to the transponder. For example, the listening device may be in an area relative to a transponder such that the listening device unambiguously receives data signals from the transponder. In other words, the listening device may be within a threshold proximity level of the transponder, or in a specific zone, and may assign the unique identity to the transponder accordingly. In one example, the listening device may select the transponder from a plurality of transponders that are in the retail area, upon determining that it unambiguously senses the signal of the transponder. The listening device may then further associate the transponder with the particular area or zone. In one example, the collection of RF transponders (e.g. short-range transmitters) taken as a whole or individually, in combination with their broadcast signals captured by a listening device, and signal characteristics that are derived from the broadcast signals, may further help to determine zone proximity in the indoor area. The signal characteristics attributed to an RF transponder can be, but are not limited to, a range of its signal strengths, a range of the times of arrival of a distinguishable sequence, a range of signal qualities, a range of round trip times of an emitted signal and/or a range of phases of the signal. For example, in a retail environment, a zone may be determined probabilistically according to a measured signal strength of a transponder located in an aisle of a retail store. In yet in another example, this zone, in turn, may be defined in terms of an estimated proximity of the listening device to products being sold in that aisle or in a portion of the aisle covered by the transponder.
In a proximity aware system, a plurality of transponders may each broadcast a unique signal that is sensed by a listening device or they may sense a signal broadcast by the listening device. The unique identification signal, in one example, may be a tag ID, a retailer ID, a store ID, or a combination thereof. Each transponder may also be further associated with one or more products or a product type. Transponders may be discrete and unrelated to each other. In another example, transponders can be related to each other based on their respective positions, or zones, relative to each other, or by association with a product or product type. As such, association of a product may be based on multiple transponders.
The RF transponder may be associated with a reference point. The reference point in turn may be associated with a product in the indoor space. Transponder may also be associated with information related with the products.
It is contemplated that the determination of the product classification may be performed by the listening device. In this embodiment, the listening device may send only the transponder IDs to the server. The server may respond with all product information. The listening device may then analyze the received data and associate the transponder ID with a location based on a planogram (described below), downloaded to the listening device, or associate the transponder ID with a product or a product type.
In a server-centric example, the listening device 102, after entering the retail venue 100, transmits information about the unique ID of the transponder 106a corresponding to the signal characteristics of 106a coupled with a product information or location information of the transponder as a reference to the server 104. The server 104 may process the received information related to the product and determine an association of the product with the transponder and furthermore classify the product into a product group. For example, the product information may include the name of a specific beverage drink. The server 104 may classify the product into a beverage class based on the name of the drink. Moreover, the classification may be based on a planogram, stored in the server 104. A planogram is a layout of a retail venue that provides a diagram or model that indicates the placement of retail products on shelves. In one example, the planogram may have detailed information about products including labels, digital images, videos of the products in the retail venue. In another example, the server may decode a bar code information of the product. Alternatively, or in addition, the server may map a location of the transponder to a respective coordinate point based on a coordinate system, stored in the server 104. Furthermore, in yet another example, management of the product information may be handled by a content management system implemented on the server. Server-centric systems reduce the computational load on the listening device but may increase the communications load in the covered area and, thus, the latency of the product association determination.
In one embodiment of the invention, the transponders 106 may be receiving signals from other devices, for example, they may sense signals broadcast by the listening device 102 or transmitters and send identifying information about the listening device and the transponder. The server may then send a request to the listening device to determine its location or product association and, after receiving the response from the listening device, couple the location or product information to the unique ID of the transponder. Optionally, the transponders may already be associated with products, and in one example, the transponders may then send the product association information and the sensed signal strength measurements to the server 104. As such, the server 104 may determine which products are associated with the transponder 106 upon further determining a threshold proximity level of the listening device relative to the transponder. In such an example, the transponders may be in a MESH network of transponders that may be linked to the server, for example, via a global information network. Example listening device, server and transponder devices are described below with reference to
In an exemplary embodiment of the invention, the listening device may assign unique identities to the transponders and further associate each unique ID with a reference related to a product, class of products or a location in the indoor area. In such an example, an administrator of the store may be operating the listening device and may thus be configured to be an administrative listening device.
The listening device 102, in another example, may be the customer listening device 102. As shown in
In one example, an administrator, a store employee, carrying listening device 102, may enter the retail venue 100 and place the transponders 106a and 106b in the vicinity of the products 114 and 116, respectively, in order to setup a beacon system (not shown) in the retail venue 100. Beacon system may include multiple transponders, but for the sake of brevity, discussion will be focused with reference to transponder 106a.
Broadcast signals of RF transponder 106a may help to determine zones, for example, zones Z1 and Z2, in the retail venue 100. Moreover, the signal characteristics, that may be derived from the sensed signals and attributed to the RF transponder 106a can be, but are not limited to, a range of its signal strengths, a range of the times of arrival of a distinguishable sequence, a range of signal qualities, a range of round trip times of an emitted signal and/or a range of phases of the signal, may further help to determine the zones
In one example, the listening device 102 in the retail venue 100 may be in the proximity of the transponder 106a, such as in the zones Z1, and Z2 (as shown by curved lines), corresponding to the transponder 106a, for example. However, upon entering the zone Z2, the listening device may unambiguously sense signals of the transponder 106a. In one example, zone Z2 may correspond to a threshold proximity level, according to a threshold signal or signal characteristics derived from the broadcast signal of the transponder 106a. The listening device 102 may then securely, or non-securely, communicate with the transponder 106a.
In one example, the listening device 102, upon being within the threshold proximity level of transponder 106a, may perform a configuration step to assign a unique identity to the transponder 106a. The configuration step may include, at first, decoding an encrypted broadcasted signal of the transponder 106a. The decrypted message may include a tag ID value of the transponder 106a. The listening device 102 may then associate a retailer ID value or a store ID value with the tag ID value in order to assign the unique ID to the transponder. In one example, the tag ID may be 48 bits long of which 12 bits are used by the listening device to identify the transponder during an identification phase. As such, the listening device may then fill in the remaining 36 bits with other data, for example, a retail ID value or a store ID value to assign a unique identity to the transponder 106a.
Alternatively, the transponder may be configured with a 48 bits tag identity by the manufacturer. As such, the listening device 102 may simply then decode the tag identity and assign the tag ID as the unique ID.
The listening device 102 may then perform an association of the physical location of the transponder with the unique ID of the transponder by various means. Particularly, the association may be performed once the listening device is within a threshold proximity level of the transponder, or in other words, once the listening device senses the signal of the transponder unambiguously. In one example, the listening device 102 may associate the assigned unique ID of the transponder 106a with a reference point corresponding to the physical location of the transponder 106a. The association may be performed when the listening device is in the zone Z2 (where it senses the signal unambiguously). The reference point may be the aisle number where the transponder 106a is physically located, for example, aisle 110. In another example, the reference point may be the shelf ID of shelf 108a. The reference points may be accessed from an internal reference database stored in the server 104. Alternatively, the internal reference database may be downloaded to listening device 102, and the user of the listening device 102 may access the database directly from the listening device 102. Upon accessing the corresponding reference point of the transponder 106a, the user of the listening device 102 may associate the reference point and the unique ID of the transponder 106a and send the pair to the server 104.
In one example, a product name or description of the product 114 may be used as the reference point.
It is contemplated that, the association process performed by the listening device 102, may take place once the listening device 102 is within the threshold proximity of a given transponder, or in other words, when the listening device unambiguously senses the signal of the given transponder. As such the listening device may then communicate with the transponder. For example, the listening device 102 may not communicate exclusively with transponder 106a when it is in zone Z1. This may be because of the presence of other transponders (not shown), which may interfere with the broadcast signal of the transponder 106a. However, once the listening device 102 moves to zone Z2, it may sense signal of the transponder 106a unambiguously, and thus have a one-to-one communication with the transponder 106a. This may be determined by the listening device 102. Thus, the listening device may then carry the association process.
In another example, the listening device 102 may associate the assigned unique ID of the transponder 106a with the physical location of the transponder 106a using an indoor map of the retail store 100. The indoor map may be stored in the server 104 and the listening device may then download the map from the server 104. In one example, the map may provide topographic information. In another example, the map may be a list of products or sections in the retail venue 100. The user of the listening device 102 may pinpoint the physical location of the transponder 106a in the map and associate the physical location with the unique ID of the transponder 106a and send the associated pair to the server 104.
In yet another example, the listening device may be configured to scan at least one existing product displayed in/on the shelf where the transponder is located. The resulting scanned code is then associated with the transponder ID and sent to the server. For example, the listening device 102 may scan a bar code (not shown) of product 114, where the product 114 is placed on the shelf 108a in aisle 112 near the transponder 106a. Alternatively, the listening device may scan the bar code (not shown) of the shelf 108a near the transponder. The listening device 102 may then associate the scanned bar code with the unique ID of the transponder 106a and then send it to the server 104. In one example, the listening device 102 may be coupled with an external bar-code reader (not shown) for scanning purposes. Alternatively, the listening device 102 may use an on-board camera in the sensor module 202, as shown in
Listening device 102 may also scan another barcode (not shown) of the product 116 located near the transponder 106b on the shelf 108b of aisle 112. Again, the associated scanned code and the unique ID of the transponder 106b may be sent to the server 104. The association, in this case, may take place when the listening device 102 is unambiguously sensing the signal of the transponder 106b, for example, in zone Z4.
Server 104, receiving the associated pair of scanned code and the unique ID of the transponder, may further process the associated pair to resolve the scanned code and further determine the association of the transponder with a product. The server may utilize a planogram of the retail venue, stored in the server. As described earlier, a planogram is a layout of the retail venue that provides a diagram or model indicating the placement of retail products on shelves. Thus, the resolved bar code may then be associated to a product or a product type located at a given location in planogram.
The server may then associate the transponder ID with the product (with resolved bar code) and with a product location based on the planogram.
In one example, the planogram may be stored in the memory 222 of the server 104, and the processor 220 may be configured to process and resolve the scanned bar code.
Alternatively, the listening device may utilize the on-board camera for taking digital images or videos of the products near a transponder. For example, listening device 102 may take picture of the product 114 and send the picture of the product 114 along with the unique ID of the transponder 106a to the server 104.
Upon receiving the pictures/videos from the listening device 102, the server 104 may process the paired data for product recognition, for example. Alternatively, the server 104 may compare the received images/videos with the images or videos stored in the planogram, for classification of products, in another example. The server 104 may then further perform association of the product with the unique ID of the transponder. For example, based on the planogram, the server may locate the position of the recognized product. As such, the transponder ID may be associated with the recognized product, or with the location of the recognized product. Further, processor 220 of server 104 may be configured to perform the classification and recognition of the product.
In another exemplary embodiment, the listening device may establish a relation between already associated transponders. For example, as shown in
Yet, in another exemplary embodiment of the invention, the server 104 may be configured to further associate the transponder to a coordinate system, once the transponder is associated with a physical space (as discussed above) and stored in a database (e.g. memory 222 shown in
The example listening device 102 further includes an optional sensor module 202 that may include one or more of an accelerometer, a gyroscope, and/or a compass. The sensor module may be used to gather information on movement of the listening device. This information may be processed locally by the processor 208 or it may be sent to the server 104 in addition to signal characteristics for determining proximity level to a transponder. In one example, the sensor module of the listening device may also include a camera (not shown) or bar-code scanner (not shown) that a user may employ to scan barcodes or QR codes of the products on shelves 108 or bar codes or QR codes placed on the shelves.
In this example, the transponder 106 includes the transmitter 234 and antenna 232 and does not include the communication module 224. Although not shown, the transponder also includes a power source, for example, a lithium battery. Because it periodically broadcasts a low-power signal, the example transponder 106 may operate for several years using the battery.
In an another example, the transponder 106 may include the antenna 232, and receiver 238 and may be configured to sense low-power signals (e.g. Ble) signals broadcast by the listening devices and to send its identity and information on the detected listening devices to the server, for example, via cellular/WLAN/mesh communications unit 236. Because this device may transmit higher powered signals more often than the transmit-only transponder, it may include a larger battery or may be connected to the store's electrical network.
In one embodiment, a transponder may be assigned a unique identity. For example, as shown in
In another embodiment, the server 104 may be configured to receive an associated pair of a transponder ID and its corresponding reference point, as described in the flow diagram of
In one embodiment, the transponders 106 are transmit-only devices that emit signals having signal characteristics and including a transponder ID or label asynchronously and at regular intervals. These signals are sensed by one or more listening devices proximate to one of the transponders (line 502). Listening device 102 senses signals from the transponders that are within range and may collect one or more signal characteristics over a period of time. In addition, the listening device may receive the transponder signal and decode the transponder ID from it. For example, with reference to
In another embodiment, as shown by the dashed line 502, the transponders 104 may be configured to sense low-power signals (e.g. Ble) signals broadcast by the listening device and to send information of the detected listening devices to the server, for example as shown by line 506. The information sent may include a listening device identifier, characteristics of the sensed signal and a transponder ID. The server may then determine an association of a product to the transponder ID, based on a database, a map, planogram, stored in the server. The server may also process the signal received by the listening device to determine the proximity of the transponder to the listening device. If the listening device is within the threshold proximity level, the server may then send the association of the transponder ID with the product to the listening device (line 506).
Listening device 102 may also be configured to have bi-directional communication (line 502) with the server 104 and further transmit signal characteristics wherein determination of proximity of the listening device with respect to the transponder for a predetermined time may be performed by the server. During the communication, the listening device may also receive the association information of a product with the transponder from the server, for example.
Although the invention is illustrated and described herein with reference to specific embodiments, the invention is not intended to be limited to the details shown. Rather, various modifications may be made in the details within the scope and range of equivalents of the claims and without departing from the invention.
Number | Name | Date | Kind |
---|---|---|---|
5774876 | Woolley | Jun 1998 | A |
5942987 | Heinrich | Aug 1999 | A |
6025780 | Bowers | Feb 2000 | A |
6084512 | Elberty | Jul 2000 | A |
6330971 | Mabry | Dec 2001 | B1 |
6415978 | McAllister | Jul 2002 | B1 |
7124943 | Quan | Oct 2006 | B2 |
7207488 | Hammerslag | Apr 2007 | B2 |
7295114 | Drzaic | Nov 2007 | B1 |
7423534 | Dhanjal | Sep 2008 | B2 |
7728729 | Christopher | Jun 2010 | B2 |
7844505 | Arneson | Nov 2010 | B1 |
8120482 | Ulrich | Feb 2012 | B2 |
8159350 | Bauchot | Apr 2012 | B2 |
8174383 | Chung | May 2012 | B1 |
8446254 | Carrick | May 2013 | B2 |
8917165 | Marques | Dec 2014 | B2 |
20010045893 | Swartzel | Nov 2001 | A1 |
20020008621 | Barritz | Jan 2002 | A1 |
20020149480 | Shanks | Oct 2002 | A1 |
20020180588 | Erickson | Dec 2002 | A1 |
20020185532 | Berquist | Dec 2002 | A1 |
20020196126 | Eisenberg | Dec 2002 | A1 |
20030009383 | Mori | Jan 2003 | A1 |
20030097302 | Overhultz | May 2003 | A1 |
20030216969 | Bauer | Nov 2003 | A1 |
20050040974 | Shanks | Feb 2005 | A1 |
20050134459 | Glick | Jun 2005 | A1 |
20050231370 | Tagato | Oct 2005 | A1 |
20060012480 | Klowak | Jan 2006 | A1 |
20060022038 | Hewlin et al. | Feb 2006 | A1 |
20060022823 | Ryal | Feb 2006 | A1 |
20060092072 | Steiner | May 2006 | A1 |
20060119471 | Rudolph | Jun 2006 | A1 |
20060119487 | Atkinson | Jun 2006 | A1 |
20060176152 | Wagner | Aug 2006 | A1 |
20060197653 | Kung | Sep 2006 | A1 |
20060210115 | Nemet | Sep 2006 | A1 |
20060280181 | Brailas | Dec 2006 | A1 |
20060287759 | Charych | Dec 2006 | A1 |
20070035380 | Overhultz | Feb 2007 | A1 |
20070046439 | Takaku | Mar 2007 | A1 |
20070061041 | Zweig | Mar 2007 | A1 |
20070096882 | Bandy | May 2007 | A1 |
20070188342 | Valeriano | Aug 2007 | A1 |
20070198174 | Williams | Aug 2007 | A1 |
20070257796 | Easton | Nov 2007 | A1 |
20070282482 | Beucher | Dec 2007 | A1 |
20070285236 | Batra | Dec 2007 | A1 |
20070290802 | Batra | Dec 2007 | A1 |
20080198001 | Sarma | Aug 2008 | A1 |
20080231431 | Stawar | Sep 2008 | A1 |
20080278325 | Zimman | Nov 2008 | A1 |
20080284600 | Drzaic | Nov 2008 | A1 |
20090036060 | Takahashi | Feb 2009 | A1 |
20090121843 | Bauchot | May 2009 | A1 |
20090166415 | Braun | Jul 2009 | A1 |
20090289776 | Moore | Nov 2009 | A1 |
20090322490 | Kung | Dec 2009 | A1 |
20100019887 | Bridgelall | Jan 2010 | A1 |
20100138037 | Adelberg | Jun 2010 | A1 |
20100277284 | Brown | Nov 2010 | A1 |
20110012713 | Wilkinson | Jan 2011 | A1 |
20110128129 | Graczyk | Jun 2011 | A1 |
20110199211 | Campero | Aug 2011 | A1 |
20110221576 | Itagaki | Sep 2011 | A1 |
20110231236 | Gonzalez | Sep 2011 | A1 |
20110309931 | Rose | Dec 2011 | A1 |
20120075071 | Liu | Mar 2012 | A1 |
20120256732 | McAllister | Oct 2012 | A1 |
20140304123 | Schwartz | Oct 2014 | A1 |
20140344118 | Parpia | Nov 2014 | A1 |
20150194030 | Davidson | Jul 2015 | A1 |
Number | Date | Country |
---|---|---|
0696011 | Feb 1996 | EP |
Entry |
---|
GB Search Report issued in related GB Application No. 1406127.9, dated Oct. 3, 2014. |
Number | Date | Country | |
---|---|---|---|
20150054620 A1 | Feb 2015 | US |