Patent Application
20240319316
The invention relates generally to systems and methods for determining the position of an electromagnetic signal transmitting device, in particular, the position of a mobile reader with such a transmitter.
Commercial organizations are becoming increasingly complex, and industry is seeking techniques for tracking the location and use of inventory and assets with increasing specificity. Accordingly, many industries are deploying asset tracking systems that include electronically readable identification tags. Conventionally, assets are bar-coded and manually scanned. Other techniques involve placing passive radio frequency identification (RFID) tags placed on the front of assets, which can be read RFID readers.
Systems and methods described herein using a combination of a handheld (or mobile) ID reader (or scanner) and a master radio-based scanner location tracking system to track uniquely identified objects or locations. The mobile reader reads identifying information from the assets and inventory, while the tracking system determines and tracks the physical location of the mobile reader. As the mobile reader records the identifying information, or related data, from items placed on or embedded in the item being scanned by the mobile reader (barcode labels for example), the data is then transmitted back to the tracking system, along with the relevant mobile reader information transmitted from the mobile reader to be used by the tracking system to determine scanner location.
The principles apply to any item, object, or article (e.g., game pieces, clothing, automobiles, etc.) that contains a unique identifier readable with a mobile reader and in any environment where receiver antennae are available to receive the RF signals emitted by the mobile reader. Further, data at unique locations may be recorded, with the recorded data becoming associated with the location where the reader determined, measured, or calculated the data.
All examples and features mentioned below can be combined in any technically possible way.
In one aspect, a method of associating data with a physical location comprises receiving, by at least two receiver antennae, a radiofrequency (RF) signal transmitted by a mobile device, the RF signal conveying data collected by the mobile device from an external source; calculating, for each of the at least two receiver antennae, a phase of the RF signal received by each receiver antennae; calculating, based on the calculated phases, a physical location from where the mobile device transmitted the RF signal; and associating the data conveyed by the RF signal and the external source from which the data were collected with the calculated physical location from where the mobile device transmitted the RF signal.
In another aspect, a method of associating data with a physical location, the method comprises receiving, by at least two receiver antennae, a radiofrequency (RF) signal transmitted by a mobile device, the RF signal conveying data collected by the mobile device from an external source; calculating, for each of the at least two receiver antennae, timing information of the RF signal received by each of the at least two receiver antennae; calculating, based on the calculated timing information, a distance from where the mobile device transmitted the RF signal to the at least two receiver antennae; and associating the data conveyed by the RF signal and the external source from which the data were collected with a physical location of the mobile device transmitting the RF signal.
In yet another aspect, a system for associating data with a physical location, comprising at least two receiver antennae that receive a radiofrequency (RF) signal transmitted by a mobile device, the RF signal conveying data collected by the mobile device from an external source. A special-purpose processor calculates, for each of the at least two receiver antennae, a phase of the RF signal received by each receiver antennae, calculates, based on the calculated phases, a physical location from where the mobile device transmitted the RF signal, and associates the data conveyed by the RF signal and the external source from which the data were collected with the calculated physical location from where the mobile device transmitted the RF signal.
The above and further advantages of this invention may be better understood by referring to the following description in conjunction with the accompanying drawings, in which like numerals indicate like structural elements and features in various figures. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention.
In one embodiment, the mobile reader 10 is a handheld device used to read identifier information (e.g., a barcode) and other related data from assets or inventory using a basic scanning technique. The mobile reader 10 may be a device dedicated to reading the identifier, an example of which is a handheld barcode scanner, or be a device with multiple functions, such as a handheld computer, smart phone, or augmented reality glasses. The method used by the mobile reader 10 to read identifier information can be any one of a number of different optical or wireless data reading technologies including, but not limited to, passive transponder tags, optical tags, and active transceivers.
In another embodiment, the mobile reader 10 is a device capable of capturing information associated with a physical location. For example, the mobile reader 10 can have a sensor for detecting a condition of the environment where the mobile reader is located, examples of such sensors include, but are not limited to, temperature, humidity, chemical, gas, or other sensors. While the mobile reader may be handheld, it may be mounted on an attachment to the body (i.e., a glove type device) or as part of glasses (such as the antenna and scanner being integrated into augmented reality glasses). In any configuration, the antenna, scanner, battery and processing circuitry may be co-located or physically separated (i.e., the scanner and antenna are mounted on augmented reality glasses while the battery and processor are mounted on the user's body, for example, on a belt). The mobile reader 10 may be also referred to herein as a mobile device or mobile scanner.
The mobile reader 10 includes a transmitter (not shown) that transmits an electromagnetic signal (microwave, radio frequency) from an antenna 16. In one embodiment, the RF signal conforms to an 802.11 wireless Local Area Network (LAN) type protocol. In addition, the principles described herein extend to other RF protocols including, but not limited to, Bluetooth and ZigBee. System tradeoffs mean that frequency choice affects antenna size and that very high frequency systems result in signal propagation limitations. Provided the phase of the signal can be calculated or the time of arrival can be measured by either phase comparison at the mobile reader or single receiver antenna or through a synchronized two-way communication between the mobile reader and the receiver antenna, various protocols and signal wavelengths may be utilized including but not limited to Bluetooth, Wi-Fi, ultra wideband, and other frequency RF carrier signals. FSK, BPSK, QPSK or any other modulation scheme that provides phase information may be utilized.
In one embodiment, each of the receivers 14 includes at least one antenna 18, a band pass filter (not shown) and a low noise amplifier (LNA) (not shown). The antennae 18 are disposed near or around the mobile reader 10. The receivers 14 form a receiver network, and the mobile reader 10 works within the physical receiver network (i.e., within range of the receivers 14). The position (X, Y, Z) of each receiver antenna 18 is known; the coordinates of each phase center of the one or more antennae 18 of each receiver 14 are predetermined and used as coordinate reference for correlating the coordinate location of the mobile reader 10 within the receiver network. Also, the phase center of the one or more antennae 16 of the mobile reader 10 is used as a reference for the coordinates of the mobile reader 10. Although four receivers 14 are shown, the principles described herein can be practiced by as few as two receivers 14. Furthermore, a variety of filters, amplifiers or other receiver circuitry may be utilized to receive electromagnetic signals.
The central processing unit 12 is in communication with each of the receivers 14 over communication links 20. Such communication links 20 can be wired (e.g., cables) or wireless.
In brief overview, during operation of the mobile reader tracking system 2, the mobile reader 10 reads the identifier information (e.g., barcode) from an item, either recorded on a label or embedded into the item, to determine the identification (ID) of the identifier and optionally, other relevant data. After recording the identifier information and/or relevant data, the mobile reader 10 sends an electromagnetic signal to the tracking system 2. The electromagnetic signal carries the identifier information and relevant data, if any, of the item. Each of the receivers 14 in range of the mobile reader 10 receives the electromagnetic signal and sends the electromagnetic signal (possibly filtered and amplified) to the central processing unit 12. The central processing unit 12 records the identifier information and relevant data (if any) and determines the two- or three-dimensional location of the mobile reader 10.
The mobile reader 10 may capture a variety of data associated with an item. Examples of other relevant data that may be read include product identifier (including, but not limited to, a barcode), spoilage information, temperature, functional description or any other information that the mobile reader 10 may capture, derive or decode. As an example, the mobile reader 10 can capture a picture of the item for identification purposes, and that image data would be sent by the mobile reader 10 with signals enabling position determination and/or tracking. Alternatively, or in addition, the user can manually input data associated with an item, and when the user sends this information to the central processing unit 12, the location of the mobile reader 10 is determined at the tracking system and that location is associated with the entered data.
In an alternate embodiment, the mobile reader 10 may capture information associated with a location rather than an item. For example, the mobile reader 10 may have a sensor to measure temperature; each time a temperature measurement is taken the mobile reader 10 transmits an RF signal containing the captured data to the tracking system 2 along with RF signals adequate to determine the position of the mobile reader 10 (described in connection with
In this system 2, the mobile reader 10 records ID, relevant data or both from a barcode label, for example, placed on a piece of inventory. As or after reading the barcode label, the mobile reader 10 transmits a radio signal to the network of receivers 14 (or receiver antennae 18) placed around a facility, for example, a warehouse, factory, store, supermarket, or mall. As the radio signal from the mobile reader 10 arrives at each receiver 14 (or receiver antenna 18), the tracking system 2 processes the signal to record the identifier information, relevant data, or both of the item, and uses the radio signal transmitted by the mobile reader 10 to determine the location of the mobile reader 10. The CPU 12 performs the item data recording and the scanner location recovery.
In one embodiment, the location of the signal transmitter 16 located in the mobile reader 10 is calculated based on the timing difference between receipt of the radio signal at each antenna (specifically TDOA). An example of a method for tracking an RF transmitter using phase differences at multiple receiver antennas in order to identify the position of the transmitter is described in U.S. Pat. No. 8,749,433, granted Jun. 10, 2014, titled “Multiplexing Receiver System”, the entirety of which is incorporated by reference herein. Other techniques for tracking the signal transmitter 16 in mobile reader 10 may be utilized.
More specifically, each receiver 14 may receive the same signal, but the phase difference between each signal represents the distance the signal travelled from the transmitter to the known position of the antennas. This allows a distance calculation from each receiver 14 to the transmitter 16 and with four antennae 18 permits position locating and tracking (because the location of each antenna in receiver 14 is known). FSK, BPSK, QPSK or any other modulation scheme that provides phase information can be utilized.
Consider, for example, a receiver 14 with two or more antennas 18 that receive an RF signal from the RF-transmitting device (the mobile reader or mobile device). As the signal from the RF signal source (i.e., the mobile device) arrives at the receiver antennas with different and known positions, each antenna experiences a different phase, and thus, a different time of arrival, of the RF signal. The central processing unit 12 can calculate the angle of arrival (AOA) of the RF signal received by the two or more antennas 18 of the receiver 14 based on the measured phase difference of the signal received at the antennas (the locations of the antennas being known). Using the AOA of the received signal, the receiver's CPU can calculate the direction of the transmitting signal and therefor the direction of the mobile device from the receiver.
The central processing unit 12 can then calculate the position of the mobile device using the mobile device's direction data, as determined from the mobile device's signal's angle of arrival at the single receiver, in combination with distance as measured from the receiver 14 to the mobile device. The central processing unit 12 can acquire this distance information using a variety of techniques using the mobile device's electromagnetic signal to provide the data to make distance measurements. For example, in one embodiment, Time Difference of Arrival (TDoA) calculations are made using the same phase data of the RF signal received at the antennas to determine the time difference of arrival of the signal received at each antenna. These time of arrival differences at the receiver antennas can be used to determine a distance between the mobile device and the receiver. In another embodiment, the receiver can also send a signal to the mobile device to start a time comparison to determine the time of signal propagation between the receiver and the mobile device. In this embodiment, the receiver (or in other embodiments the mobile device could start the communication) transmits to the mobile device, starting a round trip communication between the receiver and the mobile device, that round trip timing will be measured at the receiver to determine the time of propagation between the receiver and mobile device back to the receiver and therefore the distance between the mobile device and the receiver. In another example, the signal strength of the mobile device's signal, as measured at the receiver, is used to calculate a distance between the mobile device and the receiver.
Consider, as another example, two or more receivers 14, with each receiver 14 having two or more antennas 18, that receive an RF signal from the mobile device. For each receiver, the central processing unit 12 can calculate the angle of arrival of the RF signal, in a manner as described earlier. To calculate the position of the mobile device, the central processing unit 12 can use two or more angles of arrival calculated for the two or more receivers (e.g., using triangulation based on three measured angles, or using two measured angles and the distance between the receivers). Alternatively, or in combination, the central processing unit 12 can calculate the mobile device position based on trilateration (the distance from each receiver (or receiver antenna) to the mobile device being acquired by signal time difference of arrival calculations or signal strength). The foregoing examples may be performed by the tracking system 2 described in embodiments herein.
In one embodiment, the item (or location) identifier and/or data may be transmitted upon activation of the mobile reader 10 collecting data. Further, to conserve battery power in the mobile reader 10, the RF signal may be transmitted over a short period of time or intermittently. If battery power is not a concern, the RF transmitter 16 in the mobile reader 10 may continuously transmit RF signals to permit continuous tracking of the mobile reader 10, with storage of that track possible in conjunction with storage of captured data.
In one embodiment, a stock person may scan product with the mobile reader 10 as the person places the product on a shelf. The act of scanning the product barcode, for example, can cause storage of the product identity and location by the central processing unit 12. An asset manager, customer, or other party, can then know exactly where the product was placed as the identifying information and location of the product are communicated to them from the central processing unit 12.
In this embodiment, the central processing unit 12 can use the database 54 to correlate data and locations. The database 54 may be created before any use of the mobile reader 10 by populating, for example, product identification data with associated physical locations. For example, a person could identify various locations in a warehouse, and then associate items or products that are to be stored at those locations in the warehouse. Barcode data identifying a product can be paired with an expected location for various products. Alternatively, the database 54 can be populated in part or in whole by using the mobile reader 10 to read item or product data. The central processing unit 12 can store the item identifier information and tracked location in the database 54, and identify the stored product item identifier information and location as the “standard” or correct location for the product. In this embodiment, the database 54 is populated in a “learn mode”.
After the database 54 contains the identifier information and location expected for the items or products, the central processing unit 12 can compare later captured item (or location data) and identified position with the expected data and location for that item stored in the central processing unit 12. For example, when a stockperson scans a product barcode, the central processing unit 12 can also determine the location of the mobile reader 10, as described above, thereby determining product identification and location. The central processing unit 12 can then compare the actual stocking location to a stored stocking location in the database 54 (i.e., do the product identifier and location obtained from the scan match the expected location for that product as stored in central processing unit 12?).
In such a system, the transmitter 52 can provide information about the match back to the mobile reader 10 through the receiver 50 of the mobile reader 10. For example, after the central processing unit 12 compares the captured data and location to the stored data and location, a signal may be sent from the central processing unit 12 through the transmitter 52 to the receiver 50 in the mobile reader 10 to inform the stockperson (or other individual) by cue (visual, auditory, or both) that the product has been correctly stocked or had been misplaced.
Upon matching the product identifier location and tracked location with the stored expected location and identifier, an acknowledgment signal can be transmitted by the tracking system 2 to the mobile reader 10. Alternatively, if either the captured product data or location do not match the stored location for that item, the tracking system 2 can send a signal to the mobile reader 10 indicating a problem or prohibiting further data capture.
Further, if the central processing unit 12 has stored the expected location for the scanned item, the correct location for the identified item may be transmitted to the mobile reader 10. As an example, a stockperson trying to stock an item in the wrong location, or finding an item misplaced, may scan the item causing the item identification data and location to be sent to the central processing unit 12. The central processing unit 12 can determine that the captured item data and location do not match the stored item identification and location. If the central processing unit 12 has stored the correct location of the misplaced item stored, the tracking system 2 can direct the stockperson to the proper stocking location.
The identifier information, relevant data, and position location information stored by the central processing unit 12 may be stored in various types of memory devices (including but not limited to, DRAM, SRAM, hard drive or other electronic data storage devices). Further, when referring to the central processing unit 12 accessing information stored “in” the central processing unit 12, the information may be physically stored in the central processing unit 12 or may be stored in another physical location and sent to the central processing unit (i.e., a separate memory device, server or the cloud) within the scope of this invention.
Optionally, the RF signal from the mobile reader 10 containing the captured data (and the location, if desired) may be transmitted repeatedly until an acknowledgement is received by the mobile reader 10 from the central processing unit 12, at which point the mobile reader 10 may stop transmitting to preserve power. Similarly, the mobile reader 10 may stop transmitting RF signals that permit position tracking if no reading or scanning is performed for a predetermined amount of time.
In another embodiment, a user playing a game can find an item or object and capture identifying data from it. If the location of the object matches the predicted location for that object stored in the central processing unit 12, the game can reward the player with, for example, points, information. Further, other users may be allowed to see the location of the found item and thereby track the item and the player that found the item.
In another embodiment, a user can identify an item presenting an issue, problem, or opportunity. The user can identify a tag on the object, place a tag on an item and scan the tag (or input tag information into the mobile reader 10 manually), or take a photograph of the item. Other methods may be used to input identification data into the mobile reader 10.
In one embodiment, a homeowner can walk through a house with a mobile reader, intending to create a checklist of things that need repair. The homeowner may find, for example, a power outlet that is nonfunctional. The homeowner can take a photograph of the faulty outlet with the mobile transmitter 34 (
Alternatively, instead of capturing an image, the user can put an identifier tag on the faulty outlet and scan a tag (for example, a barcode). In another embodiment, the homeowner can physically input (through a keyboard, touchscreen, or the like) identifying data (i.e., indication that a repair needs to be made) using the data entry on the mobile reader 10. In these examples, the image or tag may be considered a “virtual sticky” placed on the virtual location of the power outlet in the memory associated with the central processing unit 12. The data (i.e., “an issue is here”) and the location of the data are thus transmitted and stored at the central processing unit 12.
When the builder or repair person walks into the house with access to the data (image and location) stored in the central processing unit 12, they can identify the location of the faulty outlet based on the data stored in the central processing unit 12. In one embodiment, after repairing the issue, the repair person may take a photograph of the faulty outlet and the image data and location of the mobile reader 10 is communicated to the central processing unit 12. This update may cause removal of the faulty outlet as needing repair in the central processing unit 12—thus, removing the virtual sticky. Similar to that described above, the virtual sticky may be removed by physical input of data to the mobile reader 10 and sending data and position location to the central processing unit 12.
In one embodiment, a central processing unit 12 of one of the cells 62 is a master processor and the other central processing units 12 of the other cells 62 are slave processors. The master processor may track items thru cells. Although three cells 62 are shown, the area of coverage may be extended by adding additional cells 62. Further, the master processor may not be a central processing unit that tracks a transmitter directly, but may receive captured data and position information from multiple central processing units to track multiple objects, items, and data in the regions of coverage.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method, and computer program product. Thus, aspects of the present invention may be embodied entirely in hardware, entirely in software (including, but not limited to, firmware, program code, resident software, microcode), or in a combination of hardware and software. Such embodiments may generally be referred to herein as a circuit, a module, or a system. In addition, aspects of the present invention may be in the form of a computer program product embodied in one or more computer readable media having computer readable program code embodied thereon.
Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable medium may be a non-transitory computer readable storage medium, examples of which include, but are not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof.
As used herein, a computer readable storage medium may be any tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, device, computer, computing system, computer system, or any programmable machine or device that inputs, processes, and outputs instructions, commands, or data. A non-exhaustive list of specific examples of a computer readable storage medium include an electrical connection having one or more wires, a portable computer diskette, a floppy disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), a USB flash drive, an non-volatile RAM (NVRAM or NOVRAM), an erasable programmable read-only memory (EPROM or Flash memory), a flash memory card, an electrically erasable programmable read-only memory (EEPROM), an optical fiber, a portable compact disc read-only memory (CD-ROM), a DVD-ROM, an optical storage device, a magnetic storage device, or any suitable combination thereof.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. As used herein, a computer readable storage medium is not a computer readable propagating signal medium or a propagated signal.
Program code may be embodied as computer-readable instructions stored on or in a computer readable storage medium as, for example, source code, object code, interpretive code, executable code, or combinations thereof. Any standard or proprietary, programming or interpretive language can be used to produce the computer-executable instructions. Examples of such languages include C, C++, Pascal, JAVA, BASIC, Smalltalk, Visual Basic, and Visual C++.
Transmission of program code embodied on a computer readable medium can occur using any appropriate medium including, but not limited to, wireless, wired, optical fiber cable, microwave or radio frequency (RF), or any suitable combination thereof.
The program code may execute entirely on a user's device, partly on the user's device, as a stand-alone software package, partly on the user's device and partly on a remote computer or entirely on a remote computer or server. Any such remote computer may be connected to the user's device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
Additionally, methods of this invention can be implemented on a special purpose computer, a programmed microprocessor or microcontroller and peripheral integrated circuit element(s), an ASIC or other integrated circuit, a digital signal processor, a hard-wired electronic or logic circuit such as discrete element circuit, a programmable logic device such as PLD, PLA, FPGA, PAL, or the like. In general, any device capable of implementing a state machine that is in turn capable of implementing the proposed methods herein can be used to implement the principles of this invention.
Furthermore, the disclosed methods may be readily implemented in software using object or object-oriented software development environments that provide portable source code that can be used on a variety of computer or workstation platforms. Alternatively, the disclosed system may be implemented partially or fully in hardware using standard logic circuits or a VLSI design. Whether software or hardware is used to implement the systems in accordance with this invention is dependent on the speed and/or efficiency requirements of the system, the particular function, and the particular software or hardware systems or microprocessor or microcomputer systems being utilized.
While the aforementioned principles have been described in conjunction with a number of embodiments, it is evident that many alternatives, modifications and variations would be or are apparent to those of ordinary skill in the applicable arts. Accordingly, it is intended to embrace all such alternatives, modifications, equivalents, and variations that are within the spirit and scope of this invention.
This application is a continuation of U.S. patent application Ser. No. 17/576,029, filed Jan. 14, 2022, titled “Tracking System with Mobile Reader” which is a continuation-in-part of U.S. patent application Ser. No. 16/857,342, filed Apr. 24, 2020, now U.S. Pat. No. 11,226,395 and titled “Tracking System with Mobile Reader” which is a continuation application of U.S. patent application Ser. No. 15/291,304, filed Oct. 12, 2016, now U.S. Pat. No. 10,634,762 and titled “Tracking System with Mobile Reader,” which is a division application of the U.S. patent application Ser. No. 14/568,468, filed Dec. 12, 2014, now U.S. Pat. No. 10,634,761 and titled “Tracking System with Mobile Reader,” which claims priority from U.S. provisional application No. 61/915,647, filed Dec. 13, 2013, titled “Tracking System with Mobile Scanner.” U.S. patent application Ser. No. 16/857,342 is also a continuation of U.S. patent application Ser. No. 14/568,468, filed Dec. 12, 2014, now U.S. Pat. No. 10,634,761 and titled “Tracking System with Mobile Reader,” which claims priority from U.S. provisional application No. 61/915,647, filed Dec. 13, 2013, titled “Tracking System with Mobile Scanner.” The entireties of these U.S. patent applications and provisional application are incorporated by reference herein.
| Number | Date | Country | |
|---|---|---|---|
| 61915647 | Dec 2013 | US | |
| 61915647 | Dec 2013 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14568468 | Dec 2014 | US |
| Child | 15291304 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17576029 | Jan 2022 | US |
| Child | 18679772 | US | |
| Parent | 15291304 | Oct 2016 | US |
| Child | 16857342 | US | |
| Parent | 14568468 | Dec 2014 | US |
| Child | 16857342 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16857342 | Apr 2020 | US |
| Child | 17576029 | US |
