Patent Application
20170254876
The present disclosure relates generally to an arrangement for, and a method of, improving the performance of target sensing systems, such as a radio frequency (RF) identification (RFID) system for reading targets configured as RFID tags, and/or an ultrasonic locationing system for ultrasonically locating targets configured as mobile devices, and/or a video system for capturing video streams of images of targets, in a venue, and, more particularly, to a video-controlled arrangement for capturing target data from such RFID tags and mobile devices.
It is known to deploy a radio frequency (RF) identification (RFID) system in a retail, factory, or warehouse environment, or a like venue, for product locationing, product tracking, product identification, and inventory control. For example, in order to take an inventory of products associated with RFID tags in a warehouse environment or venue, it is known to position a plurality of RFID tag readers at overhead locations in the venue, and then, to operate each such reader, under the control of a network host computer or server, to form and steer an interrogation beam over a coverage range across any such tags to read their payloads. A multitude of tags may be in the coverage range of each reader. A specific location of any particular RFID-tagged product in the venue is typically determined by having the server process the payloads and capture data from a plurality of the readers by using triangulation/trilateration techniques known in the art.
Instead of an RFID system, it is also known to deploy an ultrasonic locationing system in the venue to capture data from, and determine the location of, mobile devices, such as handheld RFID tag readers, handheld bar code symbol readers, phones, radios, watches, tablets, radios, or computers, that are carried and/or worn by people movable within the venue. The mobile devices can also be product movers, such as trucks or forklifts, movable within the venue, for moving the products. For example, it is known to position a plurality of ultrasonic transmitters, e.g., speakers, virtually anywhere, preferably at overhead locations in the venue, and to drive the speakers, under the control of the network server, to determine the location of any such mobile device that contains an ultrasonic receiver, e.g., a microphone. Each ultrasonic speaker transmits an audio signal or ultrasonic energy in a short burst which is received by the microphone on the mobile device, thereby establishing the presence and specific location of each mobile device within the venue, again using triangulation/trilateration techniques known in the art.
Instead of the RFID and ultrasonic locationing systems, it is still further known to deploy a video or surveillance system in the venue by positioning a plurality of video cameras throughout the venue. Each video camera is operated, under the control of the network server, to capture a video stream of images of targets in its imaging field of view. The targets can be the aforementioned RFID-tagged products, and/or the RFID-tagged product movers for moving the RFID-tagged products, and/or the aforementioned mobile devices, and/or can even be people in the venue, such as employees or customers, under surveillance by the cameras. The employees may be carrying the aforementioned RFID-tagged products, and/or the aforementioned mobile devices, and/or may be operating the aforementioned product movers.
It is yet also known to install a wireless communications system by deploying a plurality of Wi-Fi access points for transmitting and receiving wireless communications throughout the venue. Wi-Fi is an available wireless standard for wirelessly exchanging data between electronic devices, thereby establishing a local area network in the venue.
Although the known RFID, ultrasonic locationing, video, and communications systems have all been generally satisfactory for their intended purposes, the performance of the RFID system at a venue could sometimes suffer and degrade due to RF interference among all the RFID tag readers deployed at the same venue, all competing for the same RF spectrum. Likewise, the performance of the ultrasonic locationing system at a venue could sometimes suffer and degrade due to acoustic interference among all the ultrasonic speakers deployed at the same venue, all transmitting simultaneously. Such RF and acoustic interference were made especially worse in a venue where there was a multitude of RFID readers and/or speakers, and where the venue had multiple zones with multiple surfaces, e.g., walls, off which the RF/ultrasonic signals were reflected and/or scattered along multiple paths.
Accordingly, it would be desirable to reduce RF and acoustic interference in a venue where an RFID system and/or an ultrasonic locationing system are deployed, as well as to improve the performance of such systems.
The accompanying figures, where like reference numerals refer to identical or functionally similar elements throughout the separate views, together with the detailed description below, are incorporated in and form part of the specification, and serve to further illustrate embodiments of concepts that include the claimed invention, and explain various principles and advantages of those embodiments.
Skilled artisans will appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions and locations of some of the elements in the figures may be exaggerated relative to other elements to help to improve understanding of embodiments of the present invention.
The arrangement and method components have been represented where appropriate by conventional symbols in the drawings, showing only those specific details that are pertinent to understanding the embodiments of the present invention so as not to obscure the disclosure with details that will be readily apparent to those of ordinary skill in the art having the benefit of the description herein.
One aspect of this disclosure relates to an arrangement for sensing targets with improved performance in a venue, such as a retail, factory, or warehouse environment. The arrangement includes a network host computer or server, a video system deployed in the venue, and a sensing system also deployed in the venue. The video system is operatively connected to, and controlled by, the network server, and is operative for detecting a level of activity in the venue. The sensing system is operatively connected to, and controlled by, the network server, and is operative for sensing the targets in the venue in response to the activity level detected by the video system.
Advantageously, the sensing system is a radio frequency (RF) identification (RFID) system operative for reading the targets configured as RFID tags in a reading mode of operation with a set of reading parameters, and/or a locationing system operative for ultrasonically locating the targets configured as mobile devices in a locating mode of operation with a set of locating parameters. Preferably, the RFID system, the locationing system, and the video system are all mounted in a common housing mounted at a single overhead location in at least one zone of the venue. The network server changes at least one of the reading parameters and/or one of the locating parameters based on the activity level detected by the video system.
For example, the network server at least partially deenergizes or controls the RFID system to not read any RFID tags, or to read fewer RFID tags, when no or a zero or a reduced level of activity is detected by the video system, and changes at least one of the reading parameters, e.g., a dwell time in which an RF signal transmitted by the RFID system reads each RFID tag, based on the activity level detected by the video system. Thus, a high detected level of activity, e.g., a lot of motion caused by many moving targets, will cause the network server to increase the dwell time, and vice versa. Other reading parameters that can be changed include, but are not limited to, a transmit power at which the RF signal is transmitted, and/or a transmit direction along which the RF signal is transmitted, and/or a firing order of a plurality of RF signals that are transmitted by a plurality of RFID antennas. As another example, the network server at least partially deenergizes or controls the locationing system to not locate any mobile devices, or to locate fewer mobile devices, when no or a zero or a reduced level of activity is detected by the video system, and changes at least one of the locating parameters, e.g., a transmit time in which an ultrasonic signal transmitted by the locationing system locates each mobile device, based on the activity level detected by the video system. Thus, a high detected level of activity, e.g., a lot of motion caused by many moving targets, will cause the network server to increase the transmit time, and vice versa. Other locating parameters that can be changed include, but are not limited to, a transmit power at which the ultrasonic signal is transmitted, and/or a transmit direction along which the ultrasonic signal is transmitted, and/or a drive order of a plurality of ultrasonic signals that are transmitted by a plurality of ultrasonic transmitters.
A further aspect of this disclosure is directed to a method of sensing targets with improved performance in a venue. The method is performed by deploying and operating a video system in the venue to detect a level of activity in the venue, and by deploying and operating a sensing system in the venue to sense the targets in the venue in response to the activity level detected by the video system.
In accordance with this disclosure, the video system provides additional control, information, and feedback to the RFID system and/or the locationing system to improve their data capture performance. When the video system detects no or a reduced level of activity in a particular zone of the venue, there is no reason for the RFID system and/or the locationing system in that zone to operate at full performance, and, therefore, they can be at least partially deenergized, thereby reducing, if not eliminating, RF and acoustic interference. As the video system detects greater and greater levels of activity in a particular zone of the venue, then the aforementioned dwell and transmit times can be proportionally directly increased to accommodate the greater levels of activity, and vice versa, thereby optimizing the data capture performance of the video-controlled, RFID system and/or locationing system.
Turning now to the drawings, reference numeral 10 in
A network host computer or server 16, typically locally located in a backroom at the venue 10, comprises one or more computers and is in wired, wireless, direct, or networked communication with each sensing network unit 30. The server 16 may also be remotely hosted in a cloud server. The server 16 may include a wireless RF transceiver that communicates with each sensing network unit 30. For example, Wi-Fi and Bluetooth® are open wireless standards for exchanging data between electronic devices. The server 16 controls the video, RFID, and locationing systems in each sensing network unit 30. As diagrammatically shown by the dashed lines 20 in
A preferred embodiment of each sensing network unit 30 is depicted in
As best shown in
As also shown in
As further shown in
As still further shown in
Each ultrasonic speaker 56 periodically transmits ultrasonic ranging signals, preferably in short bursts or ultrasonic pulses, which are received by the microphone on the mobile device. The microphone determines when the ultrasonic ranging signals are received. The communications module 58 advises the ultrasonic locationing module 52 when the ultrasonic ranging signals were received. The locationing module 52, under the control of the server 16, directs all the speakers 56 to emit the ultrasonic ranging signals in the drive order such that the microphone on the mobile device will receive minimized overlapping ranging signals from the different speakers. The flight time difference between the transmit time that each ranging signal is transmitted and the receive time that each ranging signal is received, together with the known speed of each ranging signal, as well as the known and fixed locations and positions of the speakers 56 on each sensing unit 30, are all used to determine the position of the microphone mounted on the mobile device, and, in turn, the position of the mobile device, also known as captured target data, using a suitable locationing technique, such as triangulation, trilateration, multilateration, etc.
A power and data distribution system is employed for transmitting network control data and electrical power to the sensor modules 42, 46, 52, and for transmitting the captured target data away from the sensor modules 42, 46, 52. The power and data distribution system includes a networking control switch 62 mounted within the housing 32, an exterior power and data cable, preferably a Power-over-Ethernet (PoE) cable, connected between each unit 30 and the server 16, and a plurality of interior PoE cables each connected between a respective module 42, 46, 52, 58 and the networking control switch 62. Each PoE cable connected to the modules 42, 46, 52 transmits the electrical power and transmits the control data thereto from the networking control switch 62, and transmits the target data away from the respective module 42, 46, 52 to the networking control switch 62. The PoE cable connected to the communications module 58 transmits the electrical power and transmits the control data thereto from the networking control switch 62, and transmits communications data away from the communications module 58 back to the server 16.
The exterior PoE cable is connected between a power source (not illustrated) and an input port 64 on the networking control switch 62. An optional DC power line 66 can be connected to the networking control switch 62. A spare module 68 can be accommodated within the housing 32. The spare module can be another sensor module, or, advantageously, can be another communications module operating under a different protocol, such as the Bluetooth® protocol or the ultra wideband protocol.
The aforementioned access door 38 is hinged at hinge 70 to the housing 32 for movement between an open position (
A safety switch 80 (see
In accordance with this disclosure, the video system provides additional control, information, and feedback to the RFID system and/or the locationing system to improve their data capture performance. The camera 48 in each unit 30 monitors the activity level of any targets in its imaging field of view or zone in the venue 10. When the camera 48 detects no or zero or a reduced level of activity in a particular zone of the venue 10, e.g., at idle shelves 96, 98, then there is no reason for the RFID system and/or the locationing system in that zone to operate to capture target data at full performance, and, therefore, they can be at least partially deenergized by the server 16, thereby reducing, if not eliminating, RF and acoustic interference. As the camera 48 detects greater and greater levels of activity in a particular zone of the venue 10, e.g., at busy shelves 92, 94, then the operation of the RFID system and/or the locationing system in that zone is modified by the server 16 to accommodate the greater levels of activity, and vice versa, thereby optimizing the data capture performance of the video-controlled, RFID system and/or locationing system.
For example, the RFID system reads the RFID tags in a reading mode of operation with a set of reading parameters or settings. One such reading parameter is the duration of a dwell time of an RF interrogation signal transmitted by the RFID system. The dwell time is the length of time that an RFID tag stays in the field 28 of the RF interrogation beam. The network server 16 varies the dwell time, or any other reading parameter or setting, based on the activity level detected by the video system. Thus, a higher detected level of activity, e.g., more motion caused by many moving targets, for example, at busy shelves 92, 94, will cause the network server 16 to directly proportionately increase the dwell time, or any other reading parameter, and vice versa. Other reading parameters that can be changed include, but are not limited to, a transmit power at which the RF signal is transmitted, and/or a transmit direction along which the RF signal is transmitted, and/or a firing order of a plurality of RF signals that are transmitted by the RFID antennas 44. Any one or more of such reading parameters can be varied in any combination.
Analogously, the locationing system locates the mobile devices in a locating mode of operation with a set of locating parameters or settings. One such reading parameter is the duration of a transmit time of an ultrasonic signal transmitted by the locationing system. The transmit time is the length of time that a mobile device is located in the presence of the ultrasonic signal. The network server 16 varies the transmit time, or any other locating parameter or setting, based on the activity level detected by the video system. Thus, a higher detected level of activity, e.g., more motion caused by many moving targets, for example, at busy shelves 92, 94, will cause the network server 16 to directly proportionately increase the transmit time, or another parameter, and vice versa. Other locating parameters that can be changed include, but are not limited to, a transmit power at which the ultrasonic signal is transmitted, and/or a transmit direction along which the ultrasonic signal is transmitted, and/or a drive order of a plurality of ultrasonic signals that are transmitted by a plurality of ultrasonic speakers 56. Any one or more of such locating parameters can be varied in any combination.
The RFID and the locationing systems need not be independently operative of each other, but could mutually cooperate with other to accurately locate the targets. For example, the RFID module may determine the general location or neighborhood of the tag with a certain level of accuracy, and the locationing module may determine the location of the tag with a higher or finer level of accuracy by locating the person who is holding or moving the tag.
The flow chart of
In the foregoing specification, specific embodiments have been described. However, one of ordinary skill in the art appreciates that various modifications and changes can be made without departing from the scope of the invention as set forth in the claims below. Although the invention has been described for use with modules 42, 46, 52, 58, different modules, or different combinations of modules, can be mounted in each unit 30. In addition, although the RFID system, the locationing system, the video system, and the communications have been described and illustrated as being mounted in a common housing in each unit 30, this need not be the case, because each system could also be mounted in its own separate housing. Accordingly, the specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of present teachings.
The benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential features or elements of any or all the claims. The invention is defined solely by the appended claims including any amendments made during the pendency of this application and all equivalents of those claims as issued.
Moreover in this document, relational terms such as first and second, top and bottom, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms “comprises,” “comprising,” “has,” “having,” “includes,” “including,” “contains,” “containing,” or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises, has, includes, contains a list of elements does not include only those elements, but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by “comprises . . . a,” “has . . . a,” “includes . . . a,” or “contains . . . a,” does not, without more constraints, preclude the existence of additional identical elements in the process, method, article, or apparatus that comprises, has, includes, or contains the element. The terms “a” and “an” are defined as one or more unless explicitly stated otherwise herein. The terms “substantially,” “essentially,” “approximately,” “about,” or any other version thereof, are defined as being close to as understood by one of ordinary skill in the art, and in one non-limiting embodiment the term is defined to be within 10%, in another embodiment within 5%, in another embodiment within 1%, and in another embodiment within 0.5%. The term “coupled” as used herein is defined as connected, although not necessarily directly and not necessarily mechanically. A device or structure that is “configured” in a certain way is configured in at least that way, but may also be configured in ways that are not listed.
It will be appreciated that some embodiments may be comprised of one or more generic or specialized processors (or “processing devices”) such as microprocessors, digital signal processors, customized processors, and field programmable gate arrays (FPGAs), and unique stored program instructions (including both software and firmware) that control the one or more processors to implement, in conjunction with certain non-processor circuits, some, most, or all of the functions of the method and/or apparatus described herein. Alternatively, some or all functions could be implemented by a state machine that has no stored program instructions, or in one or more application specific integrated circuits (ASICs), in which each function or some combinations of certain of the functions are implemented as custom logic. Of course, a combination of the two approaches could be used.
Moreover, an embodiment can be implemented as a computer-readable storage medium having computer readable code stored thereon for programming a computer (e.g., comprising a processor) to perform a method as described and claimed herein. Examples of such computer-readable storage mediums include, but are not limited to, a hard disk, a CD-ROM, an optical storage device, a magnetic storage device, a ROM (Read Only Memory), a PROM (Programmable Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read Only Memory) and a Flash memory. Further, it is expected that one of ordinary skill, notwithstanding possibly significant effort and many design choices motivated by, for example, available time, current technology, and economic considerations, when guided by the concepts and principles disclosed herein, will be readily capable of generating such software instructions and programs and ICs with minimal experimentation.
The Abstract of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in various embodiments for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus, the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter.
