Patent Application
20200025573
A variety of positioning systems operate to help find locations of persons and objects. For example, global positioning system receivers can receive satellite signals to determine the geographic locations of the receivers. But, these receivers may not work indoors or in areas where the satellite signals are not received or are significantly weakened. Wireless triangulation systems can be used, but these systems may lack the precision desired in determining locations inside structures. Other wireless positioning systems and techniques, such as BLUETOOTH low energy (or BLE), have shown to be less accurate in determining locations than other systems or techniques.
Other positioning systems can use modulated light that is generated by indoor lamp fixtures. Drivers of light emitting diodes in the lamp fixtures can modulate the light generated by different lamp fixtures in different ways. Cameras capture information about the modulated light from at least two different lamp fixtures. For example, a camera can obtain image data of at least two lamp fixtures that are concurrently generating light that is modulated in different ways, such as by changing the amplitude, phase, and/or polarization of the light in different ways. A device can examine this image data and determine which lamp fixtures are creating the differently modulated light. Based on the identification of the two or more lamp fixtures, the device can determine where the camera is located.
These light modulation positioning systems are not without shortcomings. For example, the camera may be required to obtain modulated light created by two or more different lamp fixtures at the same time for the device to be able to determine the location of the camera. Additionally, the camera may need to be held in a designated orientation relative to the lamp fixtures and/or may need to be held at a designated distance from the lamp fixtures for the device to be able to detect or identify the light modulation. Otherwise, the camera and device may not be able to detect or identify the light modulation, and therefore may not be able to identify the location of the camera. The modulation of light can require expensive drivers and software solutions for the lamp fixtures, which can significantly add to the installation and maintenance costs of a lighting system.
In one embodiment, a method includes obtaining image data of a light fixture having an indicator associated with the light fixture (using an optical sensor). The indicator at least partially attenuates light generated by one or more light generating devices of the light fixture prior to the light falling on (e.g., being detected by) the optical sensor. The method also includes determining one or more characteristics of the indicator based on the image data that is obtained, and one or more of determining a unique identity of the light fixture based on the one or more characteristics of the indicator that are determined or determining a location of the light fixture within a structure based on the one or more characteristics of the indicator that are determined.
In one embodiment, an electronic mobile device includes an optical sensor configured to obtain image data of a light fixture having an indicator associated with the light fixture. The indicator at least partially attenuates light generated by one or more light generating devices of the light fixture prior to the light falling on the light sensor. The device also includes one or more processors configured to determine one or more characteristics of the indicator based on the image data that is obtained. The one or more processors also are configured to one or more of determine a unique identity of the light fixture based on the one or more characteristics of the indicator that are determined or determine a location of the light fixture within a structure based on the one or more characteristics of the indicator that are determined.
In one embodiment, a method includes obtaining image data of a light fixture having an indicator using an optical sensor. The indicator includes one or more of a missing light-generating device in a repeating pattern of light-generating devices in the light fixture or a body affixed to the light fixture and that at least partially attenuates light generated by one or more light generating devices of the light fixture. The method also includes determining one or more characteristics of the indicator based on the image data that is obtained, and one or more of determining a unique identity of the light fixture based on the one or more characteristics of the indicator that are determined and/or determining a location of the light fixture within a structure based on the one or more characteristics of the indicator that are determined.
The present inventive subject matter will be better understood from reading the following description of non-limiting embodiments, with reference to the attached drawings, wherein below:
The components shown in the drawings may not be drawn to scale.
The inventive subject matter described herein relates to positioning systems and methods that identify locations and/or unique identities of lamp fixtures using lamp identifying indicators. The systems and methods can be used to accurately and precisely determine indoor locations within a structure, such as a building. In one embodiment, the identifying indicator is a body that is placed onto a specified location on the lamp fixture to indicate a unique identity of the fixture. There are multiple ways and materials that can be utilized to implement this functionality. One example involves placing a visible identifying indicator on the fixture that covers a portion of the fixture. The indicator is uniquely associated with the fixture in that the indicator is located inside the fixture (in a visible location), outside of the fixture, adjacent to the fixture, or integral to the fixture. The indicator changes the appearance of light generated by the fixture in such a way that the indicator can be used to uniquely identify the fixture.
This identifying indicator can be translucent or opaque. The identifying indicator can be different sizes and/or shapes to allow for a wide variety of combinations of identifying indicators to be used to uniquely identify many different lamp fixtures. Additionally, the identifying indicator can be formed from a single body, or from multiple separate bodies to allow for many more unique identities to be created. Additionally or alternatively, the identifying indicator can also be created by removing one or more light generating devices (e.g., light-emitting diodes) from the fixture to create the unique identity.
The electronic device 106 can be a mobile electronic device that includes an optical sensor 108 and hardware circuitry that includes and/or is coupled with one or more processors (e.g., one or more microprocessors, one or more field programmable gate arrays, one or more integrated circuits, or the like) that perform the functions described herein in connection with the electronic device 106. The optical sensor 108 can be a camera or other sensor that detects light emitted from or generated by the lamp fixtures 104. In one embodiment, the electronic device 106 is a hand-held, mobile device, such as a mobile phone, tablet computer, or the like.
The lamp fixture 104 optionally includes an outer lens 202 that defines an outer surface of the lamp fixture 104 through which light generated by the light-generating devices 200 leaves the lamp fixture 104 (e.g., to illuminate an area of the structure 102 shown in
In the illustrated embodiment, an identifying indicator 206 is associated with the fixture 104. For example, the indicator 206 can be attached to the outer surface of the lens 202 of the lamp fixture 104, can be attached to an inner surface of the lens 202, can be coupled with the fixture 104 but not the lens 202, can be integrally formed in the body of the fixture 104, or the like. The indicator 206 can be markings or stripes on a non-light-emitting white reflector of the fixture 104, thereby creating an altered image for the appearance of the light fixture 104 in the optical sensor.
The identifying indicator 206 shown in
The identifying indicator 206 can be opaque such that light does not pass through the identifying indicator 206 (e.g., the body of the indicator 206 completely attenuates the light directed onto one side of the indicator 206). Alternatively, the identifying indicator 206 can be partially opaque to the light, such that at least part of the light passes through the identifying indicator 206 while another part of the light is attenuated and diffused by the identifying indicator 206. For example, the identifying indicator 206 can be translucent. The identifying indicator 206 can have one or more different colors (either opaque or tinted with color).
In operation (and as shown in
The identifying indicator 206 can at least partially attenuate the light generated by the light-generating devices 200 as the light passes through the lens 202 and/or around the indicator 206. The mobile electronic device 106 examines the image data that captures the identifying indicator 206, the attenuated light, and/or the reference indicator (described below), and determines one or more characteristics of the identifying indicator 206 from the image data.
The mobile electronic device 106 then determines a unique identity of the lamp fixture 104 based on the characteristic(s) of the identifying indicator 206 that is or are determined. This identity may be unique to the lamp fixture 104 in that no other lamp fixture 104 in the same structure 102 has the same identity. Alternatively, different lamp fixtures 104 in different portions of the structure 102 (e.g., different rooms or different floors) may have the same identity. Alternatively, different lamp fixtures 104 in different structures 102 may have the same identity.
Using this unique identity, the mobile electronic device 106 can determine where the mobile electronic device 106 and/or optical sensor 108 are located within the structure 102. For example, the mobile electronic device 106 can refer to a list, table, map, or other memory structure stored in a memory of or associated with the mobile electronic device 106 that associates different unique identities of the lamp fixtures 104 with different locations. The mobile electronic device 106 can determine that the location of the mobile electronic device 106 and/or optical sensor 108 is the same as the location associated with the lamp fixture 104 that is identified.
The mobile electronic device 106 includes one or more processors 300 that perform the operations described herein in connection with the mobile electronic device 106. For example, the processors 300 can examine image data from the optical sensor 108 to determine characteristics of indicators, identify the indicators from the characteristics, and determine locations of the mobile electronic device 106 and/or optical sensor 108 from the characteristics. The processors 300 represent one or more microprocessors, one or more field programmable gate arrays, one or more integrated circuits, and/or associated hardware circuitry.
The mobile electronic device 106 also includes or has access to a memory 302, which represents one or more tangible and non-transitory computer readable storage media. Examples of the memory 302 include computer hard drives, optical discs, removable drives, servers, and the like. The memory 302 may be internal to the mobile electronic device 106, or may at least partially be external to the device 106. The processors 300 can read data from and optionally write data to the memory 302 directly or via one or more communication devices 304. The communication device 304 represents hardware circuitry (the same or different from the circuitry of the processors 300) that includes and/or is connected with one or more transceivers, antennas, receivers, transmitters, or the like, to allow for the mobile electronic device 106 to communicate with other devices.
The mobile electronic device 106 can include a user interface 306 that communicates information to and/or receives input from an operator of the mobile electronic device 106. The user interface 306 can represent a display device, a touchscreen, a keyboard, a stylus, an electronic mouse, a speaker, a microphone, or the like. The user interface 306 can inform the operator of the identity of the lamp fixture 104 and/or location of the mobile electronic device 106, as determined by the processors 300.
Returning to the description of the example identifying indicator 206 shown in
As another example, the amount by which light is attenuated by the identifying indicator can be a characteristic of the indicator. The processors 300 can examine the image data to determine how much light is attenuated by the identifying indicator. For example, opaque identifying indicators can attenuate more light and appear darker in the image data when compared with translucent or less opaque identifying indicators. The processors 300 can examine the image data to determine how much light is attenuated by the identifying indicator. Different amounts of light attenuation can be associated with different lamp fixtures in the memory 302, and the processors 300 can identify the lamp fixture 104 to which the identifying indicator is attached to identify the lamp fixture 104 using the amount of light attenuation that is determined.
As another example, the color of the identifying indicator can be a characteristic of the indicator. The processors 300 can examine the image data to determine the color of the identifying indicator. Different colors can be associated with different lamp fixtures in the memory 302, and the processors 300 can identify the lamp fixture 104 to which the identifying indicator is attached to identify the lamp fixture 104 using the color that is identified.
As another example, a characteristic that is determined includes a location of the identifying indicator on the lamp fixture 104. Different locations on the lamp fixture 104 can be associated with different lamp fixtures 104, and the processors 300 can examine the image data to identify the lamp fixture 104 using the location where the identifying indicator is located.
The reference indicator 512 can provide a designated location on the lamp fixture 104 from which a characteristic of the identifying indicator is to be determined. For example, the processors 300 can examine the image data to identify where the reference indicator 512 is located, and can measure a separation distance 514 between the reference and identifying indicators. This separation distance 514 can represent how far the identifying indicator is from the reference indicator 512. This distance 514 can be measured along the center axis 210 of the lens 202 or lamp fixture 104, or along another direction. In one embodiment, the distance 514 is the shortest distance between the reference and identifying indicators.
Different separation distances 514 between reference indicators 512 and identifying indicators can be associated with different lamp fixtures 104. The processors 300 can examine the image data to determine the separation distance 514 associated with a lamp fixture 104 to identify the lamp fixture 104.
The characteristic of the multi-body identifying indicator 606 can be a difference between the bodies 608, 610. For example, the processors 300 can examine the image data to determine the separation distance 514 between the identifying indicator bodies 608, 610 as a difference in locations of the bodies 608, 610 as the characteristic. Optionally, the processors 300 can examine the image data to determine widths 208 of the bodies 608, 610 and a difference in the widths 208 of the bodies 608, 610 as the characteristic. As another example, the processors 300 can examine the image data to determine lengths 408 of the bodies 608, 610 and a difference in the lengths 408 of the bodies 608, 610 as the characteristic. As another example, the processors 300 can examine the image data to determine how much light is attenuated by the bodies 608, 610 and a difference in the amount of light attenuation between the bodies 608, 610 as the characteristic.
Different separation distances 514 between the bodies 608, 610, differences in widths 208 between the bodies 608, 610, differences in lengths 408 between the bodies 608, 610, attenuation differences between the bodies 608, 610, or other differences between the bodies 608, 610 can be associated in the memory 302 with different lamp fixtures 104. The processors 300 can examine the image data to determine the difference(s) between the identifying indicator bodies 608, 610 associated with a lamp fixture 104 to identify the lamp fixture 104.
In one embodiment, a combination of characteristics of indicator(s) on lamp fixture 104 can be determined by the processors 300 from the image data to uniquely identify the lamp fixture 104. For example, two or more of a width 208 of a body of an identifying indicator, a length 408 of the body of the same identifying indicator, a separation distance 514 of the body of the same identifying indicator from a reference indicator, an amount of light attenuation by the same identifying indicator, a color of the same identifying indicator, a separation distance 514 between two bodies of the same identifying indicator, multiple separation distances 514 between three or more bodies of the same identifying indicator, a width difference between two bodies of the same identifying indicator, multiple width differences between three or more bodies of the same identifying indicator, amounts of light attenuation by different bodies of the same identifying indicator, differences in amounts of light attenuation by different bodies of the same identifying indicator, and/or a combination of colors of different bodies of the same identifying indicator. The combination of characteristics can be determined by the processors 300 examining the image data. Different combinations of the characteristics can be associated with different lamp fixtures 104 in the memory 302, and the processors 300 can identify the lamp fixture 104 based on the combination of characteristics that is determined from the image data.
Different lamp fixtures 104 can be identified as described herein, and the identifications can be used in different ways. In one example, an identified lamp fixture 104 can be associated with a location within the structure 102 in the memory 302. The processors 300 can use the identified lamp fixture 104 to determine where the mobile electronic device 106 is located in the structure 102. As another example, the identified lamp fixture 104 can be associated with a maintenance schedule (e.g., that involves replacing a light-generating device 200 in the fixture 104 or other maintenance) in the memory 302, and identifying the lamp fixture 104 can help the processors 300 determine what maintenance is needed for the lamp fixture 104 and/or when the maintenance is needed.
At 704, one or more characteristics of an identifying indicator on the lamp fixture are determined from the image data. The processors 300 can determine locations, widths, lengths, amounts of light attenuation, colors, separation distances, or the like, of the identifying indicator(s) on the lamp fixture 104, as described above. This information can be determined by the processors 300 examining the image data.
At 706, a determination is made as to whether the characteristic(s) of the identifying indicator are associated with a unique identity of a lamp fixture. For example, different locations, widths, lengths, amounts of light attenuation, colors, separation distances, or the like, of the identifying indicator(s) on the lamp fixture 104, or different combinations of two or more of these characteristics, can be associated with different individual ones of the lamp fixtures 104. One lamp fixture 104 can be associated with a single-body, opaque identifying indicator that is two centimeters wide and five centimeters from a reference indicator, another lamp fixture 104 can be associated with a multi-body, opaque identifying indicator that is two centimeters wide and five centimeters from a reference indicator, another lamp fixture 104 can be associated with a single-body, translucent identifying indicator that is two centimeters wide and five centimeters from a reference indicator, another lamp fixture 104 can be associated with a multi-body, translucent identifying indicator that is two centimeters wide and five centimeters from a reference indicator, another lamp fixture 104 can be associated with a single body, opaque identifying indicator that is four centimeters wide and five centimeters from a reference indicator, another lamp fixture 104 can be associated with a single body, opaque identifying indicator that is four centimeters wide and ten centimeters from a reference indicator, and so on. The more characteristics that define or are associated with a unique identity of a lamp fixture 104, the more lamp fixtures 104 can be uniquely identified by the identifying indicators.
If the characteristic or combination of characteristics is associated with a unique identity of a lamp fixture, then flow of the method 700 can proceed toward 708. Otherwise, the method 700 can return toward 702 to obtain image data of another lamp fixture, or the method 700 can terminate.
At 708, a determination is made as to whether the unique identity of the lamp fixture is associated with a location. Different identities of different lamp fixtures can be associated with different locations in a structure. If the identity of the lamp fixture that was determine is associated with a location in the structure, then flow of the method 700 can proceed toward 710. Otherwise, the method 700 can return toward 702 to obtain image data of another lamp fixture, or the method 700 can terminate.
At 710, a location is determined. This location can be the location of the mobile electronic device or other electronic device that obtained the image data of the lamp fixture. This location can be used to determine where equipment or machinery (e.g., forklifts, carts, etc.) is located in large structures, without having to rely on light modulation, global positioning system receivers, BLUETOOTH low energy systems, wireless triangulation systems, or the like, which may not work, may not be accurate, or may have less precision than one or more embodiments of the inventive subject matter described herein.
In one embodiment, a method includes obtaining image data of a light fixture having an indicator disposed outside of a lens of the light fixture (using an optical sensor). The indicator at least partially attenuates light generated by one or more light generating devices disposed within the lens of the light fixture. The method also includes determining one or more characteristics of the indicator based on the image data that is obtained, and one or more of determining a unique identity of the light fixture based on the one or more characteristics of the indicator that are determined or determining a location of the light fixture within a structure based on the one or more characteristics of the indicator that are determined.
Optionally, the optical sensor is a camera of a mobile electronic device.
Optionally, the indicator is an elongated section of a light-attenuating material adhered to the lens of the light fixture.
Optionally, the indicator is opaque to the light generated by the one or more light generating devices.
Optionally, the indicator is partially opaque to the light generated by the one or more light generating devices.
Optionally, the one or more characteristics of the indicator include a location of the indicator on the light fixture.
Optionally, the one or more characteristics of the indicator include a distance of the indicator from a designated location on the light fixture.
Optionally, the one or more characteristics of the indicator include a size of the indicator.
Optionally, the one or more characteristics of the indicator include a width of the indicator.
Optionally, the one or more characteristics of the indicator include a length of the indicator.
Optionally, the one or more characteristics of the indicator include an amount of attenuation of the light that is caused by the indicator.
Optionally, the indicator is formed from two or more separate bodies, and the one or more characteristics of the indicator include a difference between the two or more separate bodies.
Optionally, the difference between the two or more separate bodies includes one or more of a distance between the separate bodies, a width difference between the separate bodies, or an attenuation difference between the separate bodies.
In one embodiment, an electronic mobile device includes an optical sensor configured to obtain image data of a light fixture having an indicator disposed outside of a lens of the light fixture. The indicator at least partially attenuates light generated by one or more light generating devices disposed within the lens of the light fixture. The device also includes one or more processors configured to determine one or more characteristics of the indicator based on the image data that is obtained. The one or more processors also are configured to one or more of determine a unique identity of the light fixture based on the one or more characteristics of the indicator that are determined or determine a location of the light fixture within a structure based on the one or more characteristics of the indicator that are determined.
Optionally, the optical sensor is a camera. The indicator can be an elongated section of a light-attenuating material adhered to the lens of the light fixture. The indicator can be opaque to the light generated by the one or more light generating devices. Optionally, the indicator can be partially opaque to the light generated by the one or more light generating devices. The one or more characteristics of the indicator can include a location of the indicator on the light fixture.
In one embodiment, a method includes obtaining image data of a light fixture having an indicator using an optical sensor. The indicator includes one or more of a missing light-generating device in a repeating pattern of light-generating devices in the light fixture or a body affixed to the light fixture in a location that is outside of a lens of the light fixture and that at least partially attenuates light generated by one or more light generating devices disposed within the lens of the light fixture. The method also includes determining one or more characteristics of the indicator based on the image data that is obtained, and one or more of determining a unique identity of the light fixture based on the one or more characteristics of the indicator that are determined and/or determining a location of the light fixture within a structure based on the one or more characteristics of the indicator that are determined.
As used herein, an element or step recited in the singular and proceeded with the word “a” or “an” should be understood as not excluding plural of said elements or steps, unless such exclusion is explicitly stated. Furthermore, references to “one embodiment” of the presently described subject matter are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features. Moreover, unless explicitly stated to the contrary, embodiments “comprising” or “having” an element or a plurality of elements having a particular property may include additional such elements not having that property.
It is to be understood that the above description is intended to be illustrative, and not restrictive. For example, the above-described embodiments (and/or aspects thereof) may be used in combination with each other. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the subject matter set forth herein without departing from its scope. While the dimensions and types of materials described herein are intended to define the parameters of the disclosed subject matter, they are by no means limiting and are exemplary embodiments. Many other embodiments will be apparent to those of skill in the art upon reviewing the above description. The scope of the subject matter described herein should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled. In the appended claims, the terms “including” and “in which” are used as the plain-English equivalents of the respective terms “comprising” and “wherein.” Moreover, in the following claims, the terms “first,” “second,” and “third,” etc. are used merely as labels, and are not intended to impose numerical requirements on their objects. Further, the limitations of the following claims are not written in means-plus-function format and are not intended to be interpreted based on 35 U.S.C. § 112(f), unless and until such claim limitations expressly use the phrase “means for” followed by a statement of function void of further structure.
This written description uses examples to disclose several embodiments of the subject matter set forth herein, including the best mode, and also to enable a person of ordinary skill in the art to practice the embodiments of disclosed subject matter, including making and using the devices or systems and performing the methods. The patentable scope of the subject matter described herein is defined by the claims, and may include other examples that occur to those of ordinary skill in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal languages of the claims.
