Patent Application
20190361109
The present disclosure generally relates to tracking objects in an industrial automation environment, and more particularly to tracking motion of industrial equipment or employees.
Industrial environments, such as manufacturing facilities, warehouses, fulfillment centers, etc., typically have a mix of personnel, machinery, and equipment working among and in combination with each other. Automated equipment and machinery, human-controlled equipment and machinery, and human personnel may all move about independently of each other and may pose risks to each other or may not perform their functions in an efficient or coordinated manner. Traditional systems to optimize operations and/or detect danger typically involve independent sensors on machinery and rules or operating procedures imposed upon humans, all of which are subject to malfunction, error, or actions out of the ordinary. There exists a need, therefore, for a set of components, a system, and a method to increase automation and precision tracking of operations and movement within industrial environments.
Aspects and embodiments relate to tracking objects in an industrial automation environment, and more particularly to tracking motion of industrial equipment or employees.
According to one aspect, a system for tracking position of objects includes at least one interrogator which transmits a first electromagnetic signal and provides a first reference signal corresponding to the transmitted signal; at least one transponder which receives the first electromagnetic signal and provides a response signal; the at least one interrogator including a receiver which receives the response signal and provides a second reference signal corresponding to the response signal; and a processor which in response to the first reference signal and the second reference signal determines a precise location of at least one of the at least one interrogator or the at least one transponder; wherein the objects to be tracked includes at least one of a part of one of a human, a piece of equipment, and an item; wherein the system is configured to determine a precise position and location of the human's body movement in cooperation with the piece of equipment or item; and wherein one of the at least one interrogator and the at least one transponder is configured to be mounted to the object.
In some embodiments the at least one interrogator includes a plurality of interrogators in fixed positions. In some embodiments the at least one transponder includes a plurality of transponders in fixed positions. In some embodiments one of the at least one interrogator and the at least one transponder is integrated into a wristband. In some embodiments the at least one interrogator and the at least one transponder is integrated into a personal digital device. In some embodiments one of the at least one interrogator and the at least one transponder is configured with a feedback mechanism. In some embodiments the feedback mechanism includes one of a colored LED, a speaker, a microphone, a wireless beacon, an accelerometer, a gyroscope, and a haptic device. In some embodiments the system is configured to signal the feedback mechanism to give the human real time feedback regarding task performance. In some embodiments the feedback mechanism is configured to provide at least one indication of critical feedback and at least one other indication of routine feedback. In some embodiments the system is configured to provide the human with real time instructions. In some embodiments the system is configured to monitor and store work patterns of a limb of the human for one of analytics, performance monitoring, and training. In some embodiments the system is configured to track the piece of equipment or item for performance monitoring in a work environment. In some embodiments the work environment is one of a pick and pack environment, a warehouse environment, and an assembly environment. In some embodiments the limb is a person's hand and the system is configured for tracking the person's hand and the item to the selection of items from bins to provide real time feedback in a pick and pack environment. In some embodiments the system is configured for precisely tracking one or more human limbs in relation to the piece of equipment. In some embodiments the system is configured for actuating the industrial equipment to perform an action based on and in cooperation with the recognized movement the one or more limbs. In some embodiments the system is configured to detect a pending collision between the limb and piece of equipment, and in response to cause the industrial equipment to halt or to move out of the way of the collision. In some embodiments the system is configured for interpreting the movement of the human body part as a performable action. In some embodiments the system is configured to predict movement of the human limb. In some embodiments the system is configured for enabling setup or modifications of robotic lines to eliminate interference and optimize movement paths of robots operating in an industrial environment. In some embodiments the system is configured for automatic switching between modes of control for the piece of equipment based on the determined location of the piece of equipment. In some embodiments the system is configured for precise assembly or setup within tolerances of large scale machinery that has multiple subcomponents.
Still other aspects, embodiments, and advantages of these exemplary aspects and embodiments are discussed in detail below. Embodiments disclosed herein may be combined with other embodiments in any manner consistent with at least one of the principles disclosed herein, and references to “an embodiment,” “some embodiments,” “an alternate embodiment,” “various embodiments,” “one embodiment” or the like are not necessarily mutually exclusive and are intended to indicate that a particular feature, structure, or characteristic described may be included in at least on embodiment. The appearances of such terms herein are not necessarily all referring to the same embodiment.
Various aspects of at least one embodiment are discussed below with reference to the accompanying figures, which are not intended to be drawn to scale. The figures are included to provide illustration and a further understanding of the various aspects and embodiments, and are incorporated in and constitute a part of this specification, but are not intended as a definition of the limits of the invention. In the figures, each identical or nearly identical component that is illustrated in various figures is represented by a like numeral. For purposes of clarity, not every component may be labeled in every figure.
In the Figures:
It is to be appreciated that embodiments of the methods and apparatuses discussed herein are not limited in application to the details of construction and the arrangement of components set forth in the following description or illustrated in the accompanying drawings. The methods and apparatuses are capable of implementation in other embodiments and of being practiced or of being carried out in various ways. Examples of specific implementations are provided herein for illustrative purposes only and are not intended to be limiting. Also, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use herein of “including,” “comprising,” “having,” “containing,” “involving,” and variations thereof is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. References to “or” may be construed as inclusive so that any terms described using “or” may indicate any of a single, more than one, and all of the described terms. Any references to front and back, left and right, top and bottom, upper and lower, and vertical and horizontal are intended for convenience of description, not to limit the present systems and methods or their components to any one positional or spatial orientation.
Referring to
A preferred embodiment of the ranging system of the present invention is illustrated and described with reference to
This embodiment of the ranging system is based on the transmission and reception of an FMCW transmitted signal and determining a beat frequency difference between the transmitted and received signals. The beat frequency signal is proportional to the TOF distance between the transmitter and the receiver. By way of example, the sampled signal from the A/D converter 26 is fed to the Fast Fourier Transform (FFT) device 30 to transform the sampled time signal into the frequency domain x(t)⇒X(k). It will be understood that other transforms or algorithms may be used, such as multiple signal classifiers (MUSIC), estimation of signal parameters via rotational invariance techniques (ESPRIT), discrete Fourier transforms (DFT), and inverse Fourier transforms (IFT), for example. From the FFT, the TOF of the signal 14′ can be determined. In particular, the data output from the A/D converter 26 is a filtered set of amplitudes, with some low frequency noise. According to aspects of this embodiment a minimum amplitude threshold for object detection to occur can be set so that detection is triggered by an amplitude above the minimum threshold. If an amplitude of the sampled signal at a given frequency does not reach the threshold, it may be ignored.
In the system illustrated in
In the ranging system of
It is appreciated that for any of the embodiments and aspects disclosed herein, there can be coordinated timing between the transmitter and receivers to achieve the precise distance measurements. It is also appreciated that the disclosed embodiments of the system are capable of measuring distance by TOP on the order of about a millimeter or sub-millimeter scale in precision, at 1 Hz or less in frequency over a total range of hundreds of meters. It is anticipated that embodiments of the system can be implemented with very low-cost components for less $100.
Referring to
As shown in
According to aspects of this embodiment, the system can include two separate PN code generators 44, 46 for the transmitter and receiver subsystems of the transceiver 38, so that the code at the receiver portion of the transceiver can be out of phase with the transmitted code or so that the codes can be different.
The transmitter portion of the transceiver 38 for measuring TOF distance of an electromagnetic signal comprises a 1st pseudo noise generator 44 for generating a first phase shift signal, a first mixer 48 which receives a carrier signal 50, which modulates the carrier signal with a first phase shift signal 52 to provide a pseudo-noise code-modulated signal 32 having a center frequency F1 that is transmitted by the transceiver 38. The transponder apparatus 42 comprises the translator 34 which receives the pseudo-noise code-modulated signal 32 having center frequency F1 and translates the pseudo-noise code-modulated signal of frequency F1 to provide a translated pseudo-noise code-modulated signal having a center frequency F2 or that provides a different coded signal centered at the center frequency F1, and that is transmitted by the transponder back to the transceiver 38. The transceiver apparatus 38 further comprises a second pseudo noise generator 46 for generating a second phase shift signal 56, and a second mixer 54 which receives the second phase shift signal 56 from the pseudo-noise generator 46, which receives the translated pseudo-noise code-modulated signal 36 at frequency F2 and modulates the pseudo-correlated code-modulated signal 36 having center frequency F2 with the second phase shift signal 56 to provide a return signal 60. The apparatus further comprises a detector 62 which detects the return signal 60, and a ranging device/counter 64 that measures the time delay between the transmitted signal 32 and the received signal 36 to determine the round trip range from the transceiver 38 to the transponder 42 and back to the transceiver 38 so as to determine the two-way propagation delay. According to aspects of some embodiments, the first PN generator 44 and the second PN generator 46 can be two separate PN code generators.
It is appreciated that the preciseness of this embodiment of the system depends on the signal-to-noise ratio (SNR) of the signal, the bandwidth, and the sampling rate of the sampled signals. It is also appreciated that this embodiment of the system can use any pulse compressed signal.
As illustrated by
An embodiment of transponder 42, 420, 421, 423 can include a frequency multiplying element 422, such as but not limited to a diode, integrated into an antenna structure. For example, a diode may be placed upon and coupled to a conducting structure, such as a patch antenna or microstrip antenna structure, and placed in a configuration so as to match impedance of a received and/or transmitted signal so as to be capable of exciting antenna modes at each of the receive and response frequencies.
An embodiment of a passive harmonic transponder 423 includes a low power source such as a battery 425 (for example a watch battery), which can be used to reverse bias the diode multiplier 422 to normally be off, and the low power source can be turned off to turn the harmonic transponder to an on state (a wake up state) to multiply or otherwise harmonically shift a frequency of a received signal. The low power source can be used to reverse bias the multiplier 422 to turn on and off the transponder, for example in applications like those discussed herein. According to an embodiment of the transponder, the power source 425 can also be configured to forward bias the multiplexer (diode) 422 to increase the sensitivity and increase the range of the transponder to kilometer range up from for example, a 10-100 meter range. In still another embodiment, amplification (LNA, LNA2, LNA3, LNA4) either solely or in combination with forward biasing of the multiplier diode 422, may also or alternatively be used to increase sensitivity of the transponder. It is appreciated that in general, amplification may be employed with any transponder to increase the sensitivity of any of the embodiments of a transponder of any of the ranging systems as disclosed herein.
According to aspects and embodiments, the diode-based transponder 423 can be a passive transponder that is configured to use very little power and may be powered via button-type or watch battery, and/or may be powered by energy harvesting techniques. This embodiment of the transponder is configured to consume low amounts of energy with the transponder in the powered off mode most of the time, and occasionally being switched to a wake up state. It is appreciated that the reverse biasing of the diode and the switching on and off of the diode bias takes little power. This would allow passive embodiments of the transponder 423 to run off of watch batteries or other low power sources, or to even be battery-less by using power harvesting techniques, for example from the TOF electromagnetic signals, or from motion, such as a piezoelectric source, a solenoid, or an inertial generator, or from a light source, e.g., solar. With such an arrangement, the interrogator 38, 380, 381 can include an auxiliary wireless transmitter 429 and the transponder 42, 420, 421, and 423 can include an auxiliary wireless receiver 427 as discussed herein, particularly with respect to
It is appreciated that embodiments of the passive harmonic transponder 423 do not require a battery source that needs to be changed every day/few days. The passive harmonic transponder 423 can either have a long-life battery or for shorter range applications may be wirelessly powered by the main channel signal or by an auxiliary channel signal for longer range (e.g. the interrogator and transponder can operate over the 3-10 GHz range, while power harvesting can occur using either or both of the main signal range and a lower frequency range such as, for example, 900 MHz or 13 MHz. In contrast, classic harmonic radar tags simply respond as a chopper to an incoming signal, such that useful tag output power levels require very strong incoming signals such as >−30 dBm at the tag from a transmitter. It is appreciated that the passive harmonic transponder 423 provides a compact, long/unlimited lifetime long-range transponder by storing energy to bias the diode, drastically increasing the diode sensitivity and range of the transponder to, for example, 1 km scales.
One aspect of the embodiment shown in
As shown in
For example, the transmitter portion of the interrogator 380 for measuring precise location of a transponder 420 comprises an oscillator 382 that provides a first signal 320 having a center frequency F1 that is transmitted by the interrogator 380. The transponder apparatus 420 comprises a frequency harmonic translator 422 which receives the first signal 320 having center frequency F1 and translates the signal of frequency F1 to provide a harmonic of the signal F1 having a center frequency F2, for example 2×F1 that is transmitted by the transponder 420 back to the interrogator 380. The interrogator 380 as shown further comprises four receive channels 390, 392, 394, 396 for receiving the signal F2. Each receive channel comprises a mixer 391, 393, 395, 397 which receives the second signal 360 at frequency F2 and down converts the return signal 360. The interrogator apparatus further comprises a detector which detects the return signal, an analog-to-digital converter and a processor to determine a precise measurement of the time delay between the transmitted signal 320 and the received signal 360 to determine the round trip range from the interrogator 380 to the transponder 420 and back to the interrogator 380 so as to determine the two-way propagation delay.
According to aspects of this embodiment, the interrogator can include four separate receive channels 390, 392, 394, 396 to receive the harmonic return frequencies of the retransmitted signal 401 in a spatially diverse array for the purpose of navigation. It is appreciated that the first signal 320 having a center frequency F1 can be varied in frequency according to any of the modulation schemes that have been discussed herein, such as, for example FMCW, and that the modulation could also be any of CW pulsed, pulsed, impulse, or any other waveform. It is to be appreciated that any number of channels can be used. It is also to be appreciated that in the four receive channels of the interrogator can either be multiplexed to receive the signal 360 at different times or can be configured to operate simultaneously. It is further appreciated that, at least in part because modulation is being used, the interrogator 380 and the transponder 420 can be configured to operate simultaneously.
It is to be appreciated that according to aspects and embodiments disclosed herein, the modulator can use different forms of modulation. For example, as noted above direct sequence spread spectrum (DSSS) modulation can be used. In addition, other forms of modulation such as Doppler modulation, amplitude modulation, phase modulation, coded modulation such as CDMA, or other known forms of modulation can be used either in combination with a frequency or harmonic translation or instead of a harmonic or frequency translation. In particular, the interrogator signal 320 and the transponder signal 360 can either be at the same frequency, i.e. F1, and a modulation of the interrogator signal by the transponder 420 can be done to provide the signal 360 at the same frequency F1, or the interrogator can also frequency translate the signal 320 to provide the signal 360 at a second frequency F2, which may be at a harmonic of F1, in addition to modulate the signal F1, or the interrogator can only frequency translate the signal 320 to provide the signal 360. As noted above, any of the noted modulation techniques provide the advantage of distinguishing the transponder signal 360 from background clutter reflected signal 320. It is to be appreciated that with some forms of modulation, the transponders can be uniquely identified by the modulation, such as coded modulation, to respond to the interrogation signal so that multiple transponders 420 can be operated simultaneously. In addition, as been noted herein, by using a coded waveform, there need not be a translation of frequency of the retransmitted signal 360, which has the advantage of providing a less expensive solution since no frequency translation is necessary.
It is to be appreciated that according to aspects and embodiments of any of the ranging system as disclosed herein, multiple channels may be used by various of the interrogator and transponder devices, for example, multiple frequency channels, quadrature phase channels, or code channels may be incorporated in either or both of interrogation or response signals. In other embodiments, additional channel schemes may be used. For example, one embodiment of a transponder 42, 420, 421, 423 can have both in phase and 90° out of phase (quadrature) channels with two different diodes where the diodes are modulated in quadrature by reverse biasing of the diodes. With such an arrangement, the interrogator could be configured to send coded waveform signals to different transponders simultaneously. In addition, other methods as discussed herein, such as polarization diversity, time sharing, a code-multiplexed scheme where each transponder has a unique pseudo-random code to make each transponder uniquely addressable, and the like provide for allow increased numbers of transponders to be continuously monitored at full energy sensitivity.
One aspect of this embodiment 310 of a modulation ranging system or any of the embodiments of a ranging system as disclosed herein is that each transponder 42, 420, 421, 423 can be configured to be uniquely addressable to wake up each transponder by receiving with an auxiliary wireless receiver 427 an auxiliary wireless signal 401 from an auxiliary wireless transmitter 429, such as for example a blue tooth signal, a Wi-Fi signal, a cellular signal, a Zigbee signal, and the like, which auxiliary wireless signal can be transmitted by the interrogator 381. Thus, the interrogator 381 can be configured with an auxiliary signal transmitter 429 to transmit an auxiliary wireless signal 401 to identify and turn on a particular transponder 42, 420, 421, 423. For example, the auxiliary wireless signal could be configured to turn on each transponder based on each transponder's serial number. With this arrangement, each transponder could be uniquely addressed by an auxiliary wireless signal provided by the interrogator or another source.
With respect to
According to aspects and embodiments the interrogator and each transponder of the system can be configured to use a single antenna (same antenna) to both transmit and receive a signal. For example, the interrogator 38, 380, 381 can be configured with one antenna 40, 400, to transmit the interrogator signal 32, 320, 321 and receive the response signal 36, 360, 361. Similarly, the transponder can be configured with one antenna to receive the interrogator signal 32, 320, 321 and transmit the response signal 36, 360, 361. This can be accomplished, for example, if coded waveforms are used for the signals. Alternatively, where the signals are frequency translated but are close in frequency, such as for example 4.9 GHz and 5.8 GHz, the same antenna can be used. Alternatively or in addition, it may be possible to provide the interrogator signal 32, 320, 321 at a first polarization, such as Left Hand Circular Polarization (LHCP), Right Hand Circular Polarization (RHCP), vertical polarization, horizontal polarization, and to provide the interrogator signal 36, 360, 361 at a second polarization. It is appreciated that providing the signals with different polarizations can also enable a system with the interrogator and the transponder each using a single antenna, thereby reducing costs. It is further appreciated that using circular polarization techniques mitigates the reflections from background clutter thereby reducing the effects of multi-path return signals, because when using circular polarization, the reflected signal is flipped in polarization, and so the multipath return signals could be attenuated by using linear polarizations and/or polarization filters.
According to aspects and embodiments of any of the systems disclosed herein, it is further appreciated that there can be selective pinging of each transponder 42, 420, 421, 423 to wake up each transponder by receiving with an auxiliary wireless receiver 427 an auxiliary wireless signal 401, such as for example a blue tooth signal, a Wi-Fi signal, a cellular signal, a Zigbee signal and the like, which can be transmitted by the interrogator 380 to provide for scene data compression. In particular, there can be some latency when using an auxiliary wireless signal to identify and interrogate each transponder 42, 420, 421, 423. As the number of transponders increases, this can result in slowing down of interrogation of all the transponders. However, some transponders may not need to be interrogated as often as other transponders. For example, in an environment where some transponders may be moving and others may be stationary, the stationary transponders need not be interrogated as often as the transponders that are actively moving. Still others may not be moving as fast as other transponders. Thus, by dynamically assessing and pinging more frequently the transponders that are moving or that are moving faster than other transponders, there can be a compression of the transponder signals, which can be analogized for example to MPEG4 compression where only pixels that are changing are sampled.
According to aspects and embodiments disclosed herein, the interrogators and transponders can be configured with their own proprietary micro-location frequency allocation protocol so that the transponders and interrogators can operate at unused frequency bands that exist amongst existing allocated frequency bands. In addition, the interrogators and transponders can be configured so as to inform users of legacy systems at other frequencies for situational awareness, e.g. to use existing frequency allocations in situations that warrant using existing frequency band allocations. Some advantages of these aspects and embodiments are that it enables a control for all modes of travel (foot, car, aerial, boat, etc.) over existing wired and wireless backhaul networks, with the interrogators and the transponders inter-operating with existing smart vehicle and smart phone technologies such as Dedicated Short Range Communications (DSRC) and Bluetooth Low Energy (BLE) radio.
In particular, aspects and embodiments are directed to high power interrogators in license-free bands e.g. 5.8 GHz under U-NII and frequency sharing schemes via dynamic frequency selection and intra-pulse sharing wherein the system detects other loading issues such as system timing and load factor, and the system allocates pulses in between shared system usage. One example of such an arrangement is dynamic intra pulse spectrum notching on the fly. Another aspect of embodiments disclosed herein is dynamic allocation of response frequencies by a lower power transponder at license-free frequency bands (lower power enables wider selection of transponder response frequencies).
Another aspect of embodiments of interrogators and transponders disclosed herein is an area that has been configured with a plurality of interrogators (a localization enabled area) can have each of the transponders enabled with BLE signal emitting beacons (no connection needed), as has been noted herein. With this arrangement, when a user having a transponder, such as a wearable transponder, enters into the localization area, the transponder “wakes up” to listen for the BLE interrogation signal and replies as needed. It is also appreciated that the transponder can be configured to request an update on what's going on, either over the BLE channel or another frequency channel, such as a dynamically allocated channel.
Some examples of applications where this system arrangement can be used are for example as a human or robot walks, drives, or pilots a vehicle or unmanned vehicle through any of for example a dense urban area, a wooded area, or a deep valley area where direct line of sight is problematic and multipath reflections cause GNSS navigation solutions to be highly inaccurate or fail to converge altogether. The human or robot or vehicle or unmanned vehicle can be equipped with such configured with transponders and interrogators can be configured to update the transponders with their current state vector as well as broadcast awareness of their state vector over preselected or dynamically selected frequency using wireless protocols, Bluetooth Low Energy, DSRC, and other appropriate mechanisms for legal traceability (accident insurance claims, legal compliance).
One implementation can be for example with UDP multicasting, wherein the transponders are configured to communicate all known state vectors of target transponders with UDP multicast signals. The UDP multicast encrypted signals can be also be configured to be cybersecurity protected against spoofing, denial of service and the like. One practical realization of the network infrastructure may include: Amazon AWS IoT service, 512 byte packet increments, TCP Port 443, MQTT protocol, designed to be tolerant of intermittent links, late to arrive units, and brokers and logs data for traceability, and machine learning.
The code source 912 comprises a storage device such as a random access memory (RAM), read only memory (ROM), or the like, for storing codes and outputting the codes as code signal 920. For example, orthogonal PN codes are stored in the code source 912. The code source 912 monitors the periodic timing signal 908 to permit the code signal to be synchronized to the code time modulator 916. The code time modulator 916 uses the code signal 920 to modulate the periodic timing signal 908 for channelization and smoothing of the final emitted signal. The output of the code time modulator 916 is a coded timing signal 924.
The coded timing signal 924 is provided to an output stage 928 that uses the coded timing signal as a trigger to generate electromagnetic pulses. The electromagnetic pulses are sent to a transmit antenna 932 via a transmission line 936. The electromagnetic pulses are converted into propagating electromagnetic waves 940 by the transmit antenna 932. The electromagnetic waves propagate to an impulse radio receiver through a propagation medium, such as air.
The decode source 1020 generates a decode signal 1028 corresponding to the code used by the associated transmitter 900 that transmitted the signal 940. The adjustable time base 1024 generates a periodic timing signal 1032 that comprises a train of template signal pulses having waveforms substantially equivalent to each pulse of the received signal 1008.
The decode signal 1028 and the periodic timing signal 1032 are received by the decode timing modulator 1036. The decode timing modulator 1036 uses the decode signal 1028 to position in time the periodic timing signal 1032 to generate a decode control signal 1040. The decode control signal 1040 is thus matched in time to the known code of the transmitter 900 so that the received signal 1008 can be detected in the correlator 1016.
An output 1044 of the correlator 1016 results from the multiplication of the input pulse 1008 and the signal 1040 and integration of the resulting signal. This is the correlation process. The signal 1044 is filtered by a low pass filter 1048 and a signal 1052 is generated at the output of the low pass filter 1048. The signal 1052 is used to control the adjustable time base 1024 to lock onto the received signal. The signal 1052 corresponds to the average value of the correlator output, and is the lock loop error signal that is used to control the adjustable time base 1024 to maintain a stable lock on the signal. If the received pulse train is slightly early, the output of the low pass filter 1048 will be slightly high and generate a time base correction to shift the adjustable time base slightly earlier to match the incoming pulse train. In this way, the receiver is held in stable relationship with the incoming pulse train.
It is appreciated that this embodiment of the system can use any pulse compressed signal. It is also appreciated that the transmitter 900 and the receiver 1000 can be incorporated into a single transceiver device. First and second transceiver devices according to this embodiment can be used to determine the distance d to and the position of an object. Further reference to functionalities of both a transmitter and a receiver are disclosed in U.S. Pat. No. 6,297,773 System and Method for Position Determination by Impulse Radio, which is herein incorporated by reference.
Referring to
According to one embodiment implementing linear FMCW ranging, a transmitted signal 74 is swept through a linear range of frequencies and transmitted as transmitted signal 74. For one way linear TOF FMCW ranging, at a separate receiver 80, a linear decoding of the received signal 74 and a split version of the linear swept transmitted signal are mixed together at a mixer 82 to provide a coherent received signal corresponding to the TOF of the transmitted signal. Because this is done at a separate receiver 80, it yields a one-way TOF ranging.
With FHSS FMCW ranging, the transmitted signal is not linearly swept through a linear range of frequencies as is done with linear FMCW ranging, instead the transmitted signal is frequency modulated with a series of individual frequencies that are varied and transmitted sequentially in some pseudo-random order according to a specific PN code. It might also exclude particular frequency bands, for example, for purposes of regulatory compliance. For FHSS FMCW ranging at a separate receiver 80 for one way TOF ranging, a decoding of the received signal 74 and a split version of the individual frequencies that are varied and transmitted sequentially according to a specific PN code are mixed together at a mixer 82 to provide a coherent received signal corresponding to the TOF of the transmitted signal. For FHSS FMCW, this is done at a separate receiver 80 for one-way TOF ranging.
More specifically, this embodiment of an apparatus 400 for measuring TOF distance via a linear FHSS FMCW electromagnetic signal comprises a transmitter 70 comprising a local oscillator 72 for generating a signal 74 and a linear ramp generator 76 coupled to the local oscillator that sweeps the local oscillator signal to provide a linear modulated transmitted signal 74 for linear modulation. According to the FHSS FMCW embodiment, instead of a linear ramp generator, the signal provided to modulate the local oscillator signal is broken up into discrete frequency signals 78 that modulate the local oscillator signal to provide a series of individual frequencies according to a specific PN code for modulating the local oscillator signal. The modulated transmitted signal 74 modulated with the series of individual frequencies are transmitted sequentially in some pseudo-random order, according to a specific PN code, as the transmitted signal. For one-way TOF measurements, a split off version of the transmitted signal is also fed via a cable 88 to a receiver 80. The receiver 80 receives the transmitted signal at an antenna 90 and forwards the received signal to a first port 91 of the mixer. The mixer also receives the signal on cable 88 at a second port 92 and mixes the signal with the received signal 74, to provide at an output 94 of the mixer a signal corresponding to the time of flight distance between the transmitter 70 and the receiver 80 of the transmitted signal 74 that is either linear modulated (for linear FMCW) or modulated with the PN codes of individual frequencies (for FHSS FMCW). The apparatus further comprises an analog to digital converter 84 coupled to an output 94 of the mixer 82 that receives that signal output from the mixer and provides a sampled output signal 85. The sampled output signal 85 is fed to a processor 86 that performs a FFT on the sampled signal. According to aspects of this embodiment, the ranging apparatus further comprises a frequency generator configured to provide signals at a plurality of discrete frequencies and processor to provide a randomized sequence of the individual frequency signals.
It is appreciated that this embodiment of the system can use any pulse compressed signal.
It is desirable to make the interrogators and the transponders as have been discussed herein as small as possible and as cheap as possible, so that the interrogators and transponders can be used anywhere and for anything. This it is desirable to implement as much of the interrogator structure and functionality and as much of the transponder structure and functionality as can be done on a chip. It is appreciated that one of the most inexpensive forms of manufacturing electronic devices is as a CMOS implementation. Accordingly, aspects and embodiments of the interrogators and transponders as described herein are to be implemented as CMOS.
Multiple Transmitter and/or Transceivers
Referring to
One example of a system according to this embodiment includes one transceiver 98 (interrogator) that transmits a first interrogation signal 106 to at least one transponder 104, which transponder can be attached to an object being tracked. The at least one transponder retransmits a second re-transmitted signal 108 that is received by, for example second, third, and fourth transceivers 98 to determine a position and a range of the transponder and the object being tracked. For example two transceivers can be grouped in pairs to do hyperbolic positioning and three transceivers can be grouped to do triangulation position to the transponder/object. It is appreciated that any of the transceivers 98 can be varied to be the interrogator that sends the first transmit interrogation signal to the transponder 104 and that any of the transceivers 98 can be varied to receive the re-transmitted signal from the responder. It is appreciated that where ranging to the transponder is being determined at the transceivers, the range and position determination is a time of flight measurement between the signals transmitted by the transponder 104 and received by at least two of the transceivers 98.
Another example of a system according to this embodiment includes at least one transponder 104, which can be attached to an object being tracked. The at least one transponder 104 receives a signal 106 that is transmitted by any of at least first, second, third, and fourth transceivers 98 (interrogators). The signal can be coded to ping at least one of the transponders. It is appreciated that more than one transponder 104 can be provided. It is appreciated that each transponder can be coded to respond to a different ping of the transmitted signal 106. It is appreciated that multiple transponders can be coded to respond to a same ping of the transmitted signal 106. Thus, it is appreciated that one transponder or any of a plurality of transponders or a plurality of the transponders can be pinged by the signal 106 transmitted by at least one of the transceivers 98. It is appreciated that multiple transceivers can be configured to send a signal 106 having a same code/ping. It is also appreciated that each transceiver can be configured to send a transmitted signal having a different code/ping. It is further appreciated that pairs or more of transceivers can be configured to send a signal having the same code/ping. It is also appreciated that pairs or more of the transponders can be configured to respond to a signal having the same code/ping. It is appreciated that where the range to the transponder is being determined at the transponder (the device being tracked), the range determination is a time difference of arrival measurement between the signal transmitted by at least two of the transceivers 98. For example, where the transponder is pinged by two of the transceivers 98 a hyperbolic positioning of the transponder (object) can be determined. Where the transponder is pinged by three of the transceivers 98, triangulation positioning of the transponder (object) can be determined.
Alternatively, instead of coding each signal with a ping, it is appreciated that according to some embodiments a precise time delay can be introduced between signals transmitted by the transmitters and/or transceivers. Alternatively, a precise time delay can be introduced between signals re-transmitted by the at least one transponder in response to receipt of the transmitted signal. With this arrangement pairs of transceivers can be used to accomplish 3D or hyperbolic positioning or at least three transceivers can be used to perform triangular positioning according to any of the signals described herein.
Another example of a system according to this embodiment includes one transmitter 96 that is a reference transmitter that provides a waveform by which the receivers 102 and/or transponders 104 correlate against to measure a delta in time of the time difference of arrival (TDOA) signal relative to the reference transmitter 96. It is also appreciated that this embodiment of the system can use any pulse compressed signal.
Multiple Receivers and/or Transponders
Various embodiments of a system according to the invention can comprise at least one transmitter 96 or transceiver 98 that transmits a transmitted 106 signal and a plurality of receivers 102 or transponders 104 that receive the transmitted signal from each transmitter or transceiver, according to any of ranging systems and signals described herein. Such embodiments include at least one transmitter 96 or transceiver 98 that transmits the transmitted signal 106 and a plurality of receivers 102 or transponders 104 that either receive the transmitted signal 106 or receive and re-transmit a signal 108 that is a re-transmitted version of the transmitted signal 106 back to the at least one transceivers 98, according to any of ranging signals and systems described herein.
It is appreciated that according to aspects of this embodiment a transmitter 96 can be attached to an object being tracked and can transmit a first signal 106 to a plurality of receivers 102 to perform time of flight positioning and ranging from the transmitter to the receiver. For example, where two receivers receive the transmitted signal, hyperbolic positioning of the transmitter/object can be achieved. Alternatively or in addition, where at least three receivers receive the transmitted signal 106, triangulation positioning to the transmitter 96 and object can be achieved.
According to aspects of another embodiment, at least one transceiver 98 can be attached to an object being tracked and can transmit a first signal 106 to a plurality of transponders 104 to perform positioning and ranging from the transmitter to the receiver. For example, where two transponders receive and re-transmit the transmitted signal 106, hyperbolic positioning of the transmitter/object can be achieved. Alternatively or in addition, where at least three transponders 104 receive and re-transmit the transmitted signal 106, triangulation positioning to the transceiver 98 and object can be achieved.
It is appreciated that any of the transponders can be varied to respond to the interrogator 98 that sends the first transmit interrogation signal to the transponder 104. It is appreciated that the at least one transponder 104 receives a signal 106 that is transmitted by the transceivers 98 (interrogators). The signal can be coded to ping at least one of the transponders. It is appreciated that each transponder can be coded to respond to a different ping of the transmitted signal 106. It is appreciated that multiple transponders can be coded to respond to a same ping of the transmitted signal 106. It is appreciated that one transponder or any of a plurality of transponders or a plurality of the transponders can be pinged by the signal 106 transmitted by at least one transceivers 98. It is also appreciated that pairs or more of the transponders can be configured to respond to a signal having the same code/ping.
Alternatively, instead of coding each signal with a ping, it is appreciated that according to some embodiments a precise time delay can be introduced between signals re-transmitted by the transponders 104 in response to receipt of the transmitted signal. With this arrangement pairs of transponders can be used to accomplish hyperbolic positioning of the at least one transceiver or at least three transponders can be used to perform triangular positioning according to any of the signals described herein. It is also appreciated that this embodiment of the system can use any pulse compressed signal.
Referring to
According to the disclosure above regarding any of the TOF ranging systems disclosed, it will be apparent that a TOF ranging system may be comprised of devices, any of which may transmit, receive, respond, or process signals associated with any of the foregoing TOF ranging systems. In aspects and embodiments, any transceiver, interrogator, transponder, or receiver may determine TOF information in one or more of the manners discussed above in accordance with any of the TOF ranging systems disclosed. Any transmitter, transceiver, interrogator, or transponder may be the source of a signal necessary for determining the TOF information in one or more of the manners discussed above in accordance with any of the TOF ranging systems disclosed.
It is appreciated that in embodiments, the exact position of signal generating and signal processing components may not be significant, but the position of an antenna is germane to precise ranging, namely the position and the location from which an electromagnetic signal is transmitted or received. Accordingly, the TOF ranging systems locations disclosed herein are typically configured to determine by the TOF ranging to antenna positions and locations. For example, the exemplary embodiments discussed above with respect to
In aspects and embodiments, multiple antennas may be provided in a single device to take advantage of spatial diversity. For example, an object with any of the TOF ranging components embedded may have multiple antennas to ensure that at least one antenna may be unobstructed at any given time, for example as the orientation of the object changes. In one embodiment, a wristband may have multiple antennas spaced at intervals around a circumference to ensure that one antenna may always receive without being obstructed by a wearer's wrist.
In aspects and embodiments, signal or other processing, such as calculations, for example, to determine distances based on TOF information, and positions of TOF devices, may be performed on a TOF device or may be performed at other suitable locations or by other suitable devices, such as, but not limited to, a central processing unit or a remote or networked computing device.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can be used to accomplish precise distance measurements, to accomplish multiple distance measurements for multilateration, to accomplish highly precise absolute TOF measurements, to accomplish precision localization of a plurality of transponders, transceivers, or receivers, or to accomplish ranging with a hyperbolic time difference of arrival methodology, or any other ranging or localization capability for which TOF measurements may be used.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can use any pulse compressed signal.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, each transponder can be configured to detect a signal of a unique code and respond only to that unique code.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, a plurality of transmitters or transceivers can be networked together and configured to transmit at regular, precisely timed intervals, and a plurality of transponders or receivers can be configured to receive the transmissions and localize themselves via a hyperbolic time difference of arrival methodology.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, at least one transceiver is carried on a vehicle.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, at least one transceiver may be fixed to a person or animal, or to clothing, or embedded in clothing, a watch, or wristband, or embedded in a cellular or smart phone or other personal electronic device, or a case for a cellular or smart phone or other personal electronic device.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, transceivers can discover each other and make an alert regarding the presence of other transceivers. Such discovery and/or alerts may be triggered by responses to interrogation signals or may be triggered by enabling transceivers via an auxiliary wireless signal as discussed. For example, vehicles could broadcast a BLE signal that activates any TOF transceiver in its path and thereby discover humans, animals, vehicles, or other objects in its path. Similarly, a human, animal, or vehicle in the path may be alerted to the approaching vehicle. In another scenario, people with transceivers on their person may be alerted to other people's presence, e.g., when joining a group or entering a room or otherwise coming in to proximity. In such a scenario, distance and location information may be provided to one or more of the people.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can comprise a wireless network of wireless transponders in fixed locations, and wherein the element to be tracked includes at least one transceiver that pings the wireless transponders with coded pulses so that the transponders only respond and reply with precisely coded pulses.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system further comprises a wireless network of wireless transceivers or transponders in fixed locations that transmit or interrogate, and reply to each other, for purposes of measuring a baseline between the transceivers or transponders for calibrating the network.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, an object to be tracked includes at least one transceiver that is configured to transmit the first signal to interrogate one of a plurality of transponders in the network, and wherein at least one transponder is configured to respond to the first signal and to transmit a signal to interrogate one or more other transponders in the network, and wherein the one or more other transponders emit a second signal that is received by the original interrogator-transceiver for purposes of calibration.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system comprises at least one transponder that is programmed to send a burst of data and its timing transmission and including data for purposes of revealing any of temperature, battery life, other sensor data, and other characteristics of the transponder.
According to aspects and embodiments of any of the TOF ranging systems disclosed herein, the system can include wireless transponders configured to send ranging signals between each of the transponders for measuring distances between transponders.
Referring to
The system includes a plurality of TOF transmitters 96 or transceivers/interrogators 98 (depicted by an antenna) as has been described herein that transmit and/or transmit and receive a signal 110 for measuring movement of a transponder 114 mounted to a body part of a user. The system can be used to measure a position of the user in a pick and pack environment, or a position of a user such as a user's arm proximate to and in cooperation with industrial machinery 112, such as a robotic arm, and proximate to the TOF sensors 96/98. The system may further include at least one transponder 118 mounted to the industrial machinery 112, such as a robotic arm, and proximate to the TOF sensors 96/98. According to aspects of this embodiment, a controller can be configured to receive measurements of movement of the receivers or transponders 114, 118 as measured by the transmitters or transceivers/interrogators 96/98, to determine any or all of whether or not the movement of the body part conforms with a recognized movement of the body part, to determine a precise position and location of the receivers or transponders 114, 118, to predict movement of the human limb, to monitor movement and performance of a user such as in a pick and pack environment and provide feedback to the user, and to control industrial machinery such as the robotic arm 112 to perform an action based at least in part on instructions received from the industrial controller and a position of the receivers or transponders 114, 118 attached to the user, to control the robotic arm to perform an action based at least in part on any of instructions received from the industrial controller and a position of the receivers or transponders 114, 118 so that the human and the robotic arm can work in cooperation and without risk or danger of harm to the human. It is also appreciated that the system can be configured to have a transmitter or transceiver/interrogator on the robotic arm and a transponder or transceiver/interrogator on the limb or appendage of a human so as to have direct time of flight ranging between the robotic arm and the human arm or limb.
According to aspects and embodiments, workers can for example be outfitted with a small wristband or other personal digital device that is configured as a transponder 114. The transponder device can be configured with feedback mechanisms such as colored LEDs, a simple microphone, a wireless beacon and/or a haptic feedback system (e.g. gyroscope) to provide feedback to the user. For example, the device could give the worker real time feedback on their task performance in contemporary pick and pack systems. The pick and pack systems could be configured with a variety of communication mechanisms such as for example a laser pointer that directs the worker to the bin that the worker should place to or pick from. The system could be configured for example such that as the worker moves towards a correct or incorrect movement, the wristband (or other device) could signal this to the user via any of the feedback mechanisms (e.g., a flashing green/red light and slow-weak/fast-intense pulses of the gyroscope). It is appreciated that some signals could be reserved for critical feedback (e.g., unsafe conditions) and other feedback signals could be used for routine task feedback (e.g., correct/incorrect placement). It is also appreciated that the system could be so configured such that if despite feedback from the system the user still engages in some form of incorrect or unsafe behavior, the system can also interact with the equipment involved (e.g., stopping it, moving it out of the user's space, etc.). It is also appreciated that the system and the transponder device can be configured such that users may be able to customize their preferred feedback patterns to a certain extent (as determined by the system operator). It is further appreciated that the system can be used to monitor and catalogue a user's performance for any of a variety of purposes such as analytics, training, and the like.
Referring to
In the example of
It is appreciated that numerous variations on this example environment are contemplated. With knowledge of the movement of items, users, and machinery, the system could monitor for safety, accuracy, efficiency, etc. Transponders 114 could be affixed to individual boxes in addition to or instead of the conveyor belt, or the system could track conveyor belt motion in an alternate manner. While tracking items out of bins, the system could also track items placed into bins and/or manage inventory. Transponders 114 could be affixed to individual items, which could further allow identification of the contents of a box even after it is sealed closed.
While this particular example is for picking and packing, it is appreciated that the work to be tracked could include any environment or application. For example, the work monitored could be an assembly line function. The system could monitor the regular operation of the assembly line for safety, accuracy, efficiency, and could also control or monitor for options installed or incorporated into particular product builds, etc.
In accordance with yet further aspects or embodiments, the system includes time of flight transmitters and/or transceivers/interrogators and time of flight receivers or transponders (time of flight sensors) in any of the combinations and using any of the signals disclosed herein for constantly monitoring the movement performed by the user, for detecting an appropriate movement performed by the user, for predicting movement of the human limb, for monitoring movement and performance of a user such as in a pick and pack environment and to provide feedback to the user, for controlling industrial machinery in combination with movement of a user for demarcating a safety zone around the industrial equipment for appropriate movement performed by the user and for cooperating with the industrial equipment, and for controlling and actuating the industrial equipment to stay clear of the safety zone and/or to cooperate with and interact with movement of the user.
It is appreciated that in accordance with aspects or embodiments, the TOF systems as have been discussed herein can be used to provide for initial and ongoing engineering of robotic lines to eliminate interference and optimize movement paths of industrial-scale robots operating in an industrial environment. The TOF systems would provide an improvement over systems that require large industrial robots on an assembly line to have to be placed precisely, which requires a great deal of integration effort and time ensuring that the robots don't clash in operation and that their paths have been optimized to maximize production capacity. The TOF systems would provide an improvement over systems that require the precise location of the robots to be checked and fixed on a regular basis, where even small changes to the line can require near-complete reengineering of the entire solution. With the TOF systems as have been discussed herein, interrogator and transponders can be integrated at several points (i.e. on an end effector, one or more joints) which will vary by application on each multi-axis robot. Data from these sensors can be fed to an optimization and machine learning software suite, which can provide one or more sets of interference resolutions that optimize work flow for the line. A User Interface and state machine could be provided that would allow users to plan and execute this process in contextually-appropriate ways. The system could be configured based on the TOF measurements to resolve interferences and optimize itself, and could also be configured to allow users to control the process. The system can also be configured to dynamically optimize itself as ongoing changes to line configurations and robotic technology are required, the system could dynamically optimize for these changes with reduced integration and setup efforts.
It is appreciated that in accordance with aspects or embodiments, the TOF systems as have been discussed herein can be used to provide for location awareness in an automated industrial environment. With the TOF systems as have been discussed herein, a baseline TOF interrogator infrastructure could be installed near important work areas, and transponders can be integrated into various devices (e.g. a drill, a powered exoskeleton, a transport vehicle). Software could be provided for automatic switching between modes of control for the device depending on the location of that tool. For example, a drill might become inactive if taken more than two meters away from a workstation, a vehicle might switch to different speed limits depending on its proximity to certain areas in an automated production facility, and a powered exoskeleton might allow for different modes of activity depending on proximity of certain workstations. Software could further allow users to tailor this mode switching to certain degrees as set by those granted authority in the system (e.g., managers), and the system could also collect users' tailoring/feedback on the current control schemes for representation to those granted authority in the system. An analytics engine could produce reports and visualizations for users to make more informed decisions about control mode switching, error states and optimization opportunities.
It is appreciated that in accordance with aspects or embodiments, the TOF systems as have been discussed herein can be used to provide for a system that provides for precise assembly of large Machinery that has multiple subcomponents (e.g., a 100 meter long molding and assembly machine). Some advantages are that such a system could provide for assembly of such machines within millimeter scale tolerances and allow users to manage the assembly process intuitively and smoothly. Organizations could use TOF systems as disclosed herein to assemble large (100 m+) machinery to tolerance and specification before and after it's taken apart for delivery to a facility. Such an arrangement could provide ease of assembly advantages as compared to processes that involve weeks of intensive, expensive effort on site when the equipment arrives.
Each subcomponent of the machinery could be instrumented with interrogators and/or transponders that would measure precise ranges between these subcomponents at key points. Software could analyze and present the precise range data to users guide assembly processes in real time, to make assessments on assembly quality, to make informed decisions about assembly processes, and to store data for each subcomponent of the machinery to reassemble to tolerance based on micro-location information and analytics.
According to aspects of one embodiment, the time of flight sensors as have been disclosed herein can be used in industrial automation environments of large scale or where, due to distance and/or overwhelming ambient noise, voice commands are futile, it is not uncommon for body movements (e.g., hand gestures, arm motion, or the like) to be employed to direct persons in control of industrial equipment to perform tasks, such as directing a fork lift operator to load a pallet of goods onto a storage shelf, or to inform an overhead gantry operator to raise or lower, move to the right or left, backward or forward, an oversized or heavy component portion (e.g., wing spar or engine) for attachment to the fuselage of an aircraft. These human hand, arm, body gestures, and/or finger gesticulations can have universal meaning to human observers, and/or if they are not immediately understood, they typically are sufficiently intuitive that they can easily be learned without a great investment in training, and moreover they can be repeated, by most, with a great deal of uniformity and/or precision. In the same manner that a human observer can understand consistently repeatable body motion or movement to convey secondary meaning, a system 710 can also utilize human body movement, body gestures, and/or finger gesticulations to have conveyed meaningful information in the form of commands, and can therefore perform subsequent actions based at least in part on the interpreted body movement and the underlying command.
In accordance with one embodiment, TOF sensors can monitor or detect motion associated with the torso of the user located proximate the TOF sensor. In accordance with another embodiment, TOF sensors can detect or monitor motion associated with the hands and/or arms of the user situated within the TOF sensors line of sight. In accordance with another embodiment, TOF sensors can detect or monitor movement associated with the hand and/or digits (e.g., fingers) of the user positioned proximate to automated machinery.
It is understood that TOF sensors in conjunction or cooperation with other components (e.g., a controller and a logic component) can perceive motion of an object in at least three-dimensions. In accordance with embodiments, a TOF sensor can perceive lateral body movement (e.g., movement in the x-y plane) taking place within its line of sight, and also discern body movement in the z-axis as well.
Additionally it is appreciated, in cooperation with further components such as controller and/or associated logic component, a TOF sensor as disclosed herein can gauge the velocity with which a body movement, gesticulation, or gesture is performed. For example, where the user is configured with one or more TOF sensors and is moving their hands with vigor or velocity, the time of flight sensors in conjunction with a controller and/or logic component, can comprehend the velocity and/or vigor with which the user is moving their hands to connote urgency or aggressiveness. Accordingly, in one embodiment, TOF sensors can perceive the vigor and/or velocity of the body movement. For instance, in an industrial automated environment, where a forklift operator is receiving directions from a colleague, the colleague can have initially commenced his/her directions by gently waving his/her arm back and forth (indicating to the operator of the forklift that he/she is clear to move the forklift in reverse). The colleague on perceiving that the forklift operator is reversing too rapidly and/or that there is a possibility of a collision with on-coming traffic can either start waving his/her arm back and forth with great velocity (e.g., informing the forklift operator to hurry up) or hold up their arm with great emphasis (e.g., informing the forklift operator to come to an abrupt halt) in order to avoid the impending collision. According to aspects of embodiments of this disclosure, the systems disclosed herein can be used to interpret such hand commands and transmit instructions for example to a fork lift operator, where the fork lift operator may not be able to see or hear instructions from the human providing the instructions.
It is also appreciated that according to aspects of such embodiment, the TOF sensors in conjunction with a controller and/or logic component, can detect the sluggishness or cautiousness with which the user is moving their hands. Such time-of-flight measurements of sluggishness, cautiousness, or lack of emphasis can be interpreted by the controller and/or logic component to convey uncertainty, warning, or caution, and once again can provide instructions for previously perceived body movements or future body movements. Thus, continuing with the foregoing forklift operator example, the colleague can, after having waved his/her arm back and forth with great velocity, vigor, and/or emphasis can now commence moving his/her arm in a much more languid or tentative manner, indicating to the forklift operator that caution should be used to reverse the forklift.
It is appreciated without limitation or loss of generality that TOF sensors, controller (and associated logic component), and industrial machinery 112 can be located in disparate locations within an automated industrial environment. For instance, in accordance with an embodiment, TOF sensors and industrial machinery 112 can be situated in close proximity to one another, while controller and associated logic component can be located in an environmentally controlled (e.g., air-conditioned, dust free, etc.) environment. In accordance with a further embodiment, time of flight sensors, a controller and logic components can be located in an environmentally controlled safe environment (e.g., a safety control room) while industrial machinery can be positioned in an environmentally hazardous environment.
It can be appreciated from the foregoing, the sequences and/or series of body/movements, signals, gestures, or gesticulations utilized by the subject application can be limitless, and as such a complex command structure or set of commands can be developed for use in a warehouse and/or industrial environment. Moreover, one need only contemplate established human sign language (e.g. American Sign Language) to realize that a great deal of complex information can be conveyed merely through use of hand movements. Accordingly, as will have been observed in connection with the foregoing, in particular contexts, certain gestures, movements, motions, etc. in a sequence or set of commands can act as modifiers to previous or prospective gestures, movements, motions, gesticulations, etc.
According to aspects of certain embodiments, a controller and/or logic component can further be configured to distinguish valid body movement (or patterns of body movement) intended to convey meaning from invalid body movement (or patterns of body movement) not intended to communicate information, parse and/or interpret recognized and/or valid body movement (or patterns of body movement), and translate recognized and/or valid body movement (or patterns of body movement) into a command or sequence of commands or instructions necessary to actuate or effectuate industrial machinery to perform tasks. For example, to aid a controller and/or associated logic component in differentiating valid body movement from invalid or unrecognized body movement, a controller and/or logic component can consult a persisted library or dictionary of pre-established or recognized body movements (e.g., individual hand gestures, finger movement sequences, etc.) in order to ascertain or correlate the body movement supplied by, and received from, TOF sensors with recognized body movement, and thereafter to utilize the recognized body movement to interpret whether or not the recognized body movement is capable of one or more performable action a warehouse environment and/or in cooperation with industrial machinery 112.
It should be noted without limitation or loss of generality that a library or dictionary of pre-established or recognized body movements and translations or correlations thereof to commands or sequences of commands can be persisted to a memory or storage media. While storage devices (e.g., memory, storage media, and the like) are not depicted, typical examples of these devices include computer readable media including, but not limited to, an ASIC (application specific integrated circuit), CD (compact disc), DVD (digital video disk), read only memory (ROM), random access memory (RAM), programmable ROM (PROM), floppy disk, hard disk, EEPROM (electrically erasable programmable read only memory), memory stick, and the like.
In order to facilitate communication between the various and disparately located component parts of any of the herein disclosed systems, a network topology or network infrastructure can be utilized. Typically the network topology and/or network infrastructure can include any viable communication and/or broadcast technology, for example, wired and/or wireless modalities and/or technologies can be utilized to effectuate the subject application. Moreover, the network topology and/or network infrastructure can include utilization of Personal Area Networks (PANs), Local Area Networks (LANs), Campus Area Networks (CANs), Metropolitan Area Networks (MANs), extranets, intranets, the Internet, Wide Area Networks (WANs)—both centralized and/or distributed—and/or any combination, permutation, and/or aggregation thereof.
Having described above several aspects of at least one embodiment, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure and are intended to be within the scope of the invention. Accordingly, the foregoing description and drawings are by way of example only, and the scope of the invention should be determined from proper construction of the appended claims, and their equivalents.
This Application is a divisional claiming the benefit under 35 U.S.C. § 120 of U.S. application Ser. No. 15/960,224, filed Apr. 23, 2018, entitled “HIGH PRECISION TIME OF FLIGHT MEASUREMENT SYSTEM FOR INDUSTRIAL AUTOMATION,” which is a continuation claiming the benefit under 35 U.S.C. § 120 of U.S. application Ser. No. 15/181,999, filed Jun. 14, 2016, entitled “HIGH PRECISION TIME OF FLIGHT MEASUREMENT SYSTEM FOR INDUSTRIAL AUTOMATION”, which claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Application Ser. No. 62/175,819, filed Jun. 15, 2015; U.S. Provisional Application Ser. No. 62/198,633, filed Jul. 29, 2015; U.S. Provisional Application Ser. No. 62/243,264, filed Oct. 19, 2015; U.S. Provisional Application Ser. No. 62/253,983, filed Nov. 11, 2015; U.S. Provisional Application Ser. Nos. 62/268,727, 62/268,734, 62/268,736, 62/268,741, and 62/268,745, each filed Dec. 17, 2015; U.S. Provisional Application Ser. No. 62/271,136, filed Dec. 22, 2015; U.S. Provisional Application Ser. No. 62/275,400, filed Jan. 6, 2016; and U.S. Provisional Application Ser. Nos. 62/306,469, 62/306,478, and 62/306,483, each filed Mar. 10, 2016, each of which is herein incorporated by reference in its entirety for all purposes.
| Number | Date | Country | |
|---|---|---|---|
| 62306469 | Mar 2016 | US | |
| 62306478 | Mar 2016 | US | |
| 62306483 | Mar 2016 | US | |
| 62275400 | Jan 2016 | US | |
| 62271136 | Dec 2015 | US | |
| 62268727 | Dec 2015 | US | |
| 62268734 | Dec 2015 | US | |
| 62268736 | Dec 2015 | US | |
| 62268741 | Dec 2015 | US | |
| 62268745 | Dec 2015 | US | |
| 62253983 | Nov 2015 | US | |
| 62243264 | Oct 2015 | US | |
| 62198633 | Jul 2015 | US | |
| 62175819 | Jun 2015 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15960224 | Apr 2018 | US |
| Child | 16536095 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15181999 | Jun 2016 | US |
| Child | 15960224 | US |
