The present disclosure relates to electromagnetic identification (EMID) tags. In particular, it relates to locating parts with EMID tags for contextual visualization.
Currently, parts are generally located on an aircraft manually (e.g., by a person physically reading the identification number directly off of the part itself). This process is tedious and very time consuming. There is no automated way of accurately determining the location of a part on an aircraft that will help improve production efficiency.
It should be noted that global Positional System (GPS) based location systems are not suitable for an accurate positioning of objects in an indoor environment, such as in an aircraft cabin. Many positioning systems for indoor applications that are being developed rely on a Wi-Fi infrastructure and a passive radio frequency identification (RFID) technology. Most of the traditional methods employ triangulation of the radio frequency (RF) parameters, such as receive signal strength indicator (RSSI), time difference of arrival (TDOA), and angle of arrival (AOA). On an aircraft, the constraints of weight restrictions and the RF propagation conditions being less than benign make these traditional methods unsuitable to locate parts.
As such, there is a need for an improved method to locate parts on an aircraft.
The present disclosure relates to a method, system, and apparatus for locating parts with electromagnetic identification (EMID) tags for contextual visualization. In one or more embodiments, a method for locating parts with electromagnetic identification (EMID) tags on a vehicle involves transmitting, with at least one transmit antenna on an EMID reader, at least one first transmit signal having a first signal strength and/or a first field of view (FOV), thereby establishing a first radiation region. The method further involves receiving, with at least one receive antenna on the EMID reader, at least one first receive signal radiated from at least one of the EMID tags. Also, the method involves transmitting, with at least one transmit antenna on the EMID reader, at least one second transmit signal having a second signal strength and/or a second field of view (FOV), thereby establishing a second radiation region. In addition, the method involves receiving, with at least one receive antenna on the EMID reader, at least one second receive signal radiated from at least one of the EMID tags. Additionally, the method involves subtracting, by at least one processor, the second radiation region from the first radiation region to determine a difference region. Also, the method involves determining, by at least one processor, which of the EMID tags are located within the difference region by using at least one first receive signal and at least one second receive signal. Further, the method involves determining, by at least one processor, a location of the EMID tags located within the difference region.
In one or more embodiments, the method further involves repeatedly transmitting, with at least one transmit antenna on the EMID reader, successive transmit signals having different signal strengths and/or different FOVs; and repeatedly receiving, with at least one receive antenna on the EMID reader, successive receive signals radiated from at least one of the EMID tags.
In at least one embodiment, the vehicle is an airborne vehicle, a terrestrial vehicle, or a marine vehicle. In some embodiments, the EMID reader is a mobile device or a stationary device. In one or more embodiments, the EMID reader is a handheld device or a device mounted on a tripod.
In one or more embodiments, a first signal strength and a second signal strength are the same or different. In at least one embodiment, the first FOV and the second FOV are the same or different. In some embodiments, at least one transmit antenna is a gimbaled antenna or a phased array.
In at least one embodiment, the method further involves determining, by a gyro of the EMID reader, an orientation of the EMID reader. In some embodiments, the method further involves determining, by at least one processor, a location of the EMID reader by referring to a preset location, using an EMID tag in a known location, using a Wi-Fi source, and/or using a light emitting diode (LED) source.
In one or more embodiments, at least one of the EMID tags is a radio frequency identification (RFID) tag, an ultra high frequency identification (UHFID) tag, and/or a Wi-Fi identification (Wi-Fi ID) tag. In at least one embodiment, at least one of the EMID tags is an active tag or a passive tag.
In at least one embodiment, the method further involves including, by at least one processor, the location of the EMID tags into a map of the vehicle. In some embodiments, the method further involves including, by at least one processor, metadata for the EMID tags that are included in the map of the vehicle. In one or more embodiments, the metadata comprises a part number, a serial number, a production date, an installation date, and/or test data.
In one or more embodiments, a system for locating parts with electromagnetic identification (EMID) tags on a vehicle involves at least one transmit antenna on an EMID reader to transmit at least one first transmit signal having a first signal strength and/or a first field of view (FOV), thereby establishing a first radiation region; and to transmit at least one second transmit signal having a second signal strength and/or a second field of view (FOV), thereby establishing a second radiation region. The system further involves at least one receive antenna on the EMID reader to receive at least one first receive signal radiated from at least one of the EMID tags, and to receive at least one second receive signal radiated from at least one of the EMID tags. Also, the system involves at least one processor to subtract the second radiation region from the first radiation region to determine a difference region, to determine which of the EMID tags are located within the difference region by using at least one first receive signal and at least one second receive signal, and to determine a location of the EMID tags located within the difference region.
In at least one embodiment, the system further involves a gyro of the EMID reader to determine an orientation of the EMID reader. In some embodiments, at least one processor is further to determine a location of the EMID reader by referring to a preset location, using a EMID tag in a known location, using a Wi-Fi source, and/or using a light emitting diode (LED) source. In one or more embodiments, at least one processor is further to include the location of the EMID tags into a map of the vehicle. In at least one embodiment, at least one processor is further to include metadata for the EMID tags that are included in the map of the vehicle.
The features, functions, and advantages can be achieved independently in various embodiments of the present inventions or may be combined in yet other embodiments.
These and other features, aspects, and advantages of the present disclosure will become better understood with regard to the following description, appended claims, and accompanying drawings where:
The methods and apparatus disclosed herein provide an operative system for locating parts with electromagnetic identification (EMID) tags for contextual visualization. The disclosed system provides a method for locating EMID tags affixed to parts on an aircraft by utilizing an EMID reader in a three-dimensional plane. The EMID reader estimates the relative radial distance and angular position between the EMID reader and the aircraft part(s) within the EMID reader's field of view (FOV) determined by the transmit power and the solid angle of a directional antenna.
This method accurately determines the location of an aircraft part by comparing the part(s) within successive FOVs in three-dimensions. An accurate position of the aircraft part is then calculated based on the initial reference position of the EMID reader, which is determined by the available infrastructure at that location. This two-dimensional/three-dimensional visualization will then be overlaid into a panoramic view representing the surroundings similar to a panoramic photo/video created from a still camera to provide details of the part with a contextual view. The parts which appear on the image will contain metadata (e.g., the part number and the serial number), which is similar to the process of tagging an object/human within an image captured by a camera.
With many aircraft parts affixed with EMID tags, this disclosed method will improve the production process in not only collecting the information on the parts as part of the “as delivered” configuration, but also to accurately determine the location of the part that can be verified by a quality assurance (QA) team.
In the following description, numerous details are set forth in order to provide a more thorough description of the system. It will be apparent, however, to one skilled in the art, that the disclosed system may be practiced without these specific details. In the other instances, well known features have not been described in detail so as not to unnecessarily obscure the system.
Embodiments of the invention may be described herein in terms of functional and/or logical block components and various processing steps. It should be appreciated that such block components may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions. For example, an embodiment of the invention may employ various integrated circuit components, e.g., memory elements, digital signal processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices. In addition, those skilled in the art will appreciate that embodiments of the present invention may be practiced in conjunction with, and that the system described herein is merely one example embodiment of the invention.
For the sake of brevity, conventional techniques and components related to signal processing, and other functional aspects of the system (and the individual operating components of the systems) may not be described in detail herein. Furthermore, the connecting lines shown in the various figures contained herein are intended to represent example functional relationships and/or physical couplings between the various elements. It should be noted that many alternative or additional functional relationships or physical connections may be present in an embodiment of the invention.
The EMID tags 120a-c are each affixed to a separate asset (e.g., a piece of equipment or unit) on a vehicle (e.g., an aircraft). EMID tag A 120a is located at coordinate B1, S1, W1; EMID tag B 120b is located at coordinate B2, S2, W2; and EMID tag C 120c is located a coordinate B3, S3, W3. The EMID reader 110 is located at coordinate Br, Sr, Wr.
During operation, in one or more embodiments, the EMID reader 110 transmits at least one first transmit signal 130 towards the EMID tags 120a-c. In response, the EMID tags 120a-c transmit at least one second transmit signal (e.g., a response signal) 140 back to the EMID reader 110.
The method of
Relative Angular Location
On a two-dimensional plane, at a given time t=0, the EMID reader 110 is shown with an initial bore axis θi and an EMID field of view (FOV) angle β centered on the bore axis. This positioning will allow the EMID reader 110 to generate an EMID FOV region i (e.g., a first radiation region) 200.
Let all EMID tags 120a-c read in EMID FOV region i be denoted as the set {Si}.
At time t=1, the EMID reader 110 is gimbaled by Δθi, where Δθi<β will produce a new bore axis of θi+1, which will allow the EMID reader 110 to generate a new EMID FOV region i+1 (e.g., a second radiation region) 300. It should be noted that this new EMID FOV region could be, alternatively, achieved by scanning the beam (e.g., by using a phased array) while keeping the EMID reader 110 at the same reference point and position.
Let all EMID tags 120a-c read in EMID FOV region i+1 be denoted as the set {Si+1}.
The resulting change in the EMID read area ΔΓi could be calculated by the determining the difference between Γi+1 and Γi (e.g., a difference region) 400.
For the set of EMID tags in {Si} but not in {Si+1} or {SΔj}=Difference ({Si}, {Si+1}), we will have a set of EMID tags in {SΔj} that must reside in the read area of ΔΓi.
Therefore, if we rotate Δθ to cover the total desired region, we can determine which set of EMID tags were read corresponding to the change in the EMID FOV region ΔΓi, which is a function of the change of EMID reader 110 bore angle Δθi.
The above concept can be summarized as:
Let the function ƒα(θi) be the EMID FOV region with respect to EMID reader 110 bore angle θi.
ƒα(θi)=Γi
Let the function rα(θi) be the set of EMID tags read with respect to EMID reader bore angle θi.
rα(θi)={Si}
By rotating the EMID reader Δθi, we will have new EMID FOV region and a new set of EMID tags read:
ƒα(θi+1)=Γi+1
rα(θi+1)={Si+1}
And taking the difference between the EMID FOV region and set of EMID tags:
ƒα(θΔi)=Γi+1−Γi+1=ΔΓi={θΔΓi-min,θΔΓi-max}
rα(θΔi)=Difference({Si},{Si+1})={SΔi}
Because Δi<<i, the EMID tags in the set {SΔi} will have more precise information about their relative angular position.
Applying this concept from a two-dimensional (2D) plane to a three-dimensional (3D) plane is done in the same manner such that Δθ is the change in the x-y plane and ΔΦ is the change in y-z plane:
ƒα(θΔi,ΦΔi)=Γi+1−Γi=ΔΓi={θΔΓi-min,θΔΓi-max,ΦΔΓi-min,ΦΔΓi-max}
rα(θΔi,ΦΔi)=Difference({Si},{Si+1})={SΔi}
This results in the corresponding location of the set of EMID tags read in that EMID FOV:
{θΔΓi-min,θΔΓi-max,ΦΔΓi-min,ΦΔΓi-max}={SΔi}
With the concept above, the EMID boresight angle can be used as a point of reference to draw and display the relative angular distances between each EMID tag in a higher resolution than possible by traditional methods of locating parts with RF parameters, such as Residual Signal Strength Indicator (RSSI), Time of Arrival (TOA), Time Difference of Arrival (TDOA), and Angle of Arrival (AOA).
Relative Distance Location
At a given time t=0, an EMID reader 110 with an initial RF power of Pi generates an EMID FOV region i (e.g., a first radiation region) 500 with a maximum read distance of di.
Let all EMID tags read in EMID FOV region i be denoted as the set {Si}.
At time t=1, if we reduce the power of the EMID reader 110 by ΔPi, the EMID reader 110 will generate a new EMID FOV region i+1 (e.g., a second radiation region) 600, such that the maximum read range di+1 will be less than di.
Let all EMID tags read in EMID FOV region i+1 be denoted as the set {Si+1}.
The resulting change in the EMID read area Δi (e.g., a difference region) 700 could be calculated by the difference between i+1 and i.
For the set of EMID tags in {Si}, but not in {Si+1} or {SΔj}=Difference ({Si}, {Si+1}), we will have a set of EMID tags in {SΔi} that must reside in the read area of Δi. Therefore, we know the maximum (dΔi-max) and minimum (dΔi-min) distance of where all of the EMID tags in {SΔi} are relative to the EMID reader 110.
Therefore, if we perform EMID tag reads from the highest power setting to the minimum power setting, we can determine each set of EMID tags that were read corresponding to the change in EMID FOV region Δi with respect to the EMID reader's 110 power settings.
The above concept could be summarized as below:
Let the function ƒd(Pi) be the EMID FOV region with respect to EMID reader 110 power level Pi.
ƒd(Pi)=Γi
Let the function rd(Pi) be the set of EMID tags read with respect to the EMID reader 110 power level Pi.
rd(Pi)={Si}
By decreasing the EMID reader 110 power level by ΔPi, we will have new EMID FOV region and a new set of EMID tags read:
ƒd(Pi+1)=Γi+1
rd(Pi+1)={Si+1}
And taking the difference between the EMID FOV region and set of EMID tags:
ƒd(θΔi)=Γi+1−Γi+1=ΔΓi={dΔi-max,dΔi-min}
rd(θΔi)=Difference({Si},{Si+1})={SΔi}
Which will result in the corresponding distance location to the set of EMID tags read in that EMID FOV:
{dΔi-max,dΔi-min}={SΔi}
We can determine the relative distance of the set of EMID tags in {SΔi}, and the higher resolution of power settings will result in a finer set of Δi, which will result in higher resolution of the distance location data.
Relative Angular Location and Relative Distance Location
By combining both the relative angular location (refer to
Below is exemplary pseudo-code that could be used to combine the relative angular location and relative distance location methods to create a three-dimensional mapping of where each EMID tag 120a-c is located with reference to the EMID reader 110.
The pseudo-code is as follows:
Based on the EMID tags scanned with their locations determined, a 2D mapping of the EMID tags read relative to each other can be constructed (e.g., generate a stereoscopic view based on the multiple EMID reader 110 scans and the EMID tags 120a-c scanned/read). With the inclusion of directionality information of the pointing orientation of the EMID reader, a 3D mapping of the EMID tags 120a-c scanned/read can be constructed.
This EMID tag location information is then directly mapped onto a wireframe diagram (e.g., a cutaway diagram) of the aircraft to present a 2D/3D visualization of the location of the aircraft parts, with the EMID reader 110 providing the reference location on aircraft. The EMID reader 110 reference location can be determined by the current aircraft infrastructure (e.g., from Wi-Fi or light emitting diode (LED) source enabled by a visible light communications (VLC) technology). Metadata collected as part of the automated data collection process can also be annotated into the 2D/3D visualization to provide the viewer with details relating to each specific part. The 2D/3D visualization can be built into an interactive 3D graphical visualization tool using, for example, the framework provided by HTML5.
An added benefit of this 2D/3D visualization would be the ability to detect foreign object debris (FOD) on the aircraft when the object is located at an unapproved location on the aircraft.
At least one processor then subtracts the second radiation pattern from the first radiation pattern to determine a difference region 860. At least one processor determines which of the EMID tags are located within the difference region by using at least one first receive signal and at least one second receive signal 870. At least one processer then determines the location of the EMID tags located within the difference region 880. Then, the method 800 ends 890.
It should be noted that in one or more embodiments, the vehicle is an airborne vehicle (e.g., an aircraft, a space plane, or a satellite), a terrestrial vehicle (e.g., a car, a truck, a train, or a tank), or a marine vehicle (e.g., a ship or a boat). In at least one embodiment, the EMID reader is a mobile device or a stationary device. In some embodiments, the EMID reader is a handheld device or a mounted device (e.g., a device mounted on a tripod). In one or more embodiments, the transmit antenna on the EMID reader is a gimbaled antenna or a phased array. In at least one embodiment, the receive antenna on the EMID reader is a gimbaled antenna or a phased array. In one or more embodiments, an EMID tag is a radio frequency identification (RFID) tag, an ultra high frequency identification (UHFID) tag, or a Wi-Fi identification (Wi-Fi ID) tag. In some embodiments, an EMID tag is an active tag, a passive tag, or a battery-assisted passive tag.
Also, it should be noted that in one or more embodiments, the method 800 further involves at least one transmit antenna on the EMID reader repeatedly transmitting successive transmit signals having different signal strengths and/or different FOVs, and at least one receive antenna on the EMID reader repeatedly receiving successive receive signals radiated from at least one of the EMID tags. In at least one embodiment, the method 800 further involves a gyroscope (i.e. a gyro) of the EMID reader determining the orientation of the EMID reader. In some embodiments, the method 800 further involves at least one processor of the EMID reader determining the location of the EMID reader by referring to a preset location, using an EMID tag in a known location, using a Wi-Fi source (e.g., using triangulation and/or ranging of the Wi-Fi signals), and/or using a light emitting diode (LED) source (e.g., using triangulation and/or ranging of the signals from the LED source).
Although particular embodiments have been shown and described, it should be understood that the above discussion is not intended to limit the scope of these embodiments. While embodiments and variations of the many aspects of the invention have been disclosed and described herein, such disclosure is provided for purposes of explanation and illustration only. Thus, various changes and modifications may be made without departing from the scope of the claims.
Where methods described above indicate certain events occurring in certain order, those of ordinary skill in the art having the benefit of this disclosure would recognize that the ordering may be modified and that such modifications are in accordance with the variations of the invention. Additionally, parts of methods may be performed concurrently in a parallel process when possible, as well as performed sequentially. In addition, more parts or less part of the methods may be performed.
Accordingly, embodiments are intended to exemplify alternatives, modifications, and equivalents that may fall within the scope of the claims.
Although certain illustrative embodiments and methods have been disclosed herein, it can be apparent from the foregoing disclosure to those skilled in the art that variations and modifications of such embodiments and methods can be made without departing from the true spirit and scope of the art disclosed. Many other examples of the art disclosed exist, each differing from others in matters of detail only. Accordingly, it is intended that the art disclosed shall be limited only to the extent required by the appended claims and the rules and principles of applicable law.
Number | Name | Date | Kind |
---|---|---|---|
20050104736 | Gudat | May 2005 | A1 |
20080100450 | Ayyagari | May 2008 | A1 |
20100148985 | Lin | Jun 2010 | A1 |
20130154801 | O'Haire | Jun 2013 | A1 |
20130278386 | Zumsteg | Oct 2013 | A1 |
Number | Date | Country | |
---|---|---|---|
20150363616 A1 | Dec 2015 | US |