Patent Application
20190052818
The present disclosure relates to imaging, and more particularly to imaging systems and methods employing pulse detection for image enhancement.
Search and rescue missions are commonly undertaken to locate individuals in need of assistances. In some searches, such as expansive environments or in rugged terrain, it can be necessary to employ aircraft to assist in locating individuals that have become lost or are incapacitated due to the size of the search area and/or the obstacles presented to ground-based searchers by the search area. Not all each and rescue missions are successful, and in some instances lost or incapacitated individuals suffer harm or succumb to the environment due to the time required for the searchers to locate the individual.
To facilitate search and rescue effort, emergency locator beacon (ELB) devices have been developed for vehicles like ships and aircraft. ELB devices are generally incorporated into vehicles or are carried by individuals, such by aircraft transiting difficult terrain or engaged in flight over water. Such ELB devices generally emit a signal when activated, either automatically or by actuation through user input, after which the ELB device emits a signal discernable by searches for a period of time after activation. The range at which the signal is discernable is a function of the signal modality, strength, and the conditions of the environment searched.
Such conventional methods and systems have generally been considered satisfactory for their intended purpose. However, there is still a need in the art for improved imaging methods and imaging systems, such as those employed in search and rescue missions. The present disclosure provides a solution for this need.
An imaging method includes imaging a scene having a pulsed light source and associating a symbol with the light source. The image is enhanced by inserting a symbol into the image indicative of location of the pulsed light source in the scene. The symbol overlays the image in spatial registration with the location of the pulsed light source in the scene to augment indication of the location provided by the pulsed light source.
In certain embodiments, imaging the scene can include receiving non-pulsed light and pulsed light. The pulsed light can be within a visible waveband. The non-pulsed light can be within a visible waveband. Image data can be generated from the non-pulsed light. Frequency data can be generated from the pulsed light. Frequency of the pulsed light source can be determined, for example, from the frequency data.
In accordance with certain embodiments, frequency of the pulsed light source can be compared to a set of frequency/symbol associations. A determination can be made as to whether the pulsed light source is associated with a locator device. A symbol can be selected based on the frequency of the pulsed light source and an association of the frequency with a symbol. It is contemplated that the image can be enhanced by inserting a map overlay into the image.
It is also contemplated that, in accordance with certain embodiments, the image can be enhanced by inserting one or more of gimbal directional data and aircraft positional information into the image. The image can be communicated to a user interface. The user interface can be co-located with the imaging system or remote from the imaging system. The image can be displayed on the user interface. The pulsed light source can faint such that the pulse light source is not readily discernable to a human observer monitoring the image. The pulsed light source can occupy five (5) or fewer pixels in the image.
In further embodiments, the pulsed light source can be a first pulsed light source and the symbol can be a first symbol. A determination can be made as to whether the second pulsed light source is associated with a second locator, and a second symbol associated with the second light source. The image can be enhanced by inserting a second symbol into the image indicative of location of the second pulsed light source in the scene. The second symbol can overlay the image in spatial registration with the location of the second pulsed light source in the scene. The image can be further enhanced by displaying a tally of symbols appearing in the image.
An imaging system includes an imaging and pulse detection array and a controller. The controller is disposed in communication with a memory and is operatively connected to the imaging and pulse detection array. The memory has a plurality of program modules recorded therein with instructions that, when read by the controller, cause the controller to image a scene having a pulsed light source, associate a symbol with the light source, and enhance the image by inserting a symbol into the image indicative of location of the pulsed light source in the scene. The symbol overlays the image and is in spatial registration with the location of the pulsed light source to augment indication of the pulsed light source in the scene.
In certain embodiments, the system includes a rising a pulsed light source configured to emit light having a selected frequency. The frequency can be associated with a symbol in a lookup table recorded on the memory. The pulsed light source can be remote. The pulsed light source can be powered by a self-contained power supply. The pulsed light can be incorporated into a wearable device, a hand-held device, a flotation device, or a survival suit.
These and other features of the systems and methods of the subject disclosure will become more readily apparent to those skilled in the art from the following detailed description of the preferred embodiments taken in conjunction with the drawings.
So that those skilled in the art to which the subject disclosure appertains will readily understand how to make and use the devices and methods of the subject disclosure without undue experimentation, embodiments thereof will be described in detail herein below with reference to certain figures, wherein:
Reference will now be made to the drawings wherein like reference numerals identify similar structural features or aspects of the subject disclosure. For purposes of explanation and illustration, and not limitation, a partial view of an exemplary embodiment of an imaging system in accordance with the disclosure is shown in
Referring now to
Controller 102 is operatively connected to image and pulse detection array 106 and director 112. Controller 102 is also disposed in communication with user interface 108 and memory 104. Memory 104 includes a non-transitory machine-readable medium having a plurality of program modules 130 recorded thereon that, when read by controller 102, cause controller 102 to execute certain operations. For example, the instructions recorded on memory 104, when read by controller 102, cause controller 102 to execute the steps of imaging method 200 (shown in
Image and pulse detection array 106 is configured an adapted to generate image data 114 and pulse frequency data 116 using light received from scene 12. In this respect image and pulse detection array 106 receives light 18 incident upon and reflected from scene 12, light 18 originating from a source 20 external to scene 12, such as the sun, and generates therefrom image data 114 representative of scene 12. Image and pulse detection array 106 also receives pulsed light 22 originating from within scene 12, and generates therefrom pulse frequency data 116. It is contemplated that image data 114 and pulse frequency data 116 are acquired using a photodiode array 118. Examples of suitable pulse detection arrays and photodiode arrays include those described in U.S. patent application Ser. No. 15/266,837, filed on Sep. 15, 2016, the contents of which are incorporated herein by reference in its entirety.
Light 18 can be ambient illumination, e.g., sunlight. It is contemplated that light 18 can be within a visible waveband, i.e., from within a waveband extending between about 400 nanometers and about 700 nanometers. As will be appreciated by those of skill in the art in view of the present disclosure, light 18 can also be from outside of the visible waveband. For example, light 18 can be from within an infrared waveband, i.e. between about 700 nanometers and about 1 millimeter. Examples of suitable infrared wavebands include near-infrared (NIR) wavebands, shortwave infrared (SWIR) wavebands, mid-wavelength infrared (MWIR), long-wave infrared LWIR) wavebands, and far-infrared (FIR) wavebands. NIR wavebands include electromagnetic radiation with wavelengths between about 0.75 and about 1.4 microns; SWIR wavebands includes electromagnetic radiation with wavelengths between about 1.4 micros and about 3 microns; MWIR wavebands include electromagnetic radiation between about 3 microns and about 8 microns; LWIR wavebands include electromagnetic radiation between about 8 microns and about 15 microns; and FIR wavebands include electromagnetic radiation between about 15 microns and about one millimeter. Photodiode array 118 is responsive to light 18 to generate image data 114, from which an image 140 (shown in
Pulsed light 22 has a predetermined frequency and/or a modulated pulse frequency. Pulsed light 22 originates from a pulsed light source 120 and is also within the visible portion of the electromagnetic spectrum, i.e., within a visible waveband. In certain embodiments pulsed light 22 light generated by a light-emitting-diode (LED) device. LED devices require relatively little power, which increases the time and/or reduces the size of a power source, e.g., power source 122, powering pulsed light source 120. As will be appreciated by those of skill in the art in view of the present disclosure, light 18 can alternatively be from outside of the visible waveband and can be within one or more of the NIR, SWIR, MWIR, LWIR, and FIR wavebands. As will also be appreciated by those of skill in the art in view of the present disclosure, different sub-divisions of the infrared waveband have differing properties that renders them well suited for search and rescue, e.g., frequencies with low water absorption being suited for use in marine applications, etc., improving the distance at which light 18 can be discerned by imaging system 100. Photodiode array 118 is responsive to pulsed light 22 to generate pulse frequency data 116, from which symbol 142 (shown in
Locator 110 is remote from imaging and pulse detection array 106, e.g., is located within scene 12, and includes pulsed light source 120 and power source 122. Power source 122 is electrically connected to pulsed light source 120 for providing electrical power to pulsed light source 120, and can include a battery or solar collection array. It is contemplated that locator 110 be incorporated into a wearable device, hand-held device, a flotation device, a survival suit 124, or any other suitable device worn or donned by an individual in need of assistance.
Director 112 is configured for controlling orientation of image and pulse detection array 106 relative to scene 12 and/or vehicle 10. In this this respect director provides one or more of pan, tilt, and zoom capability to image and pulse detection array 106. In certain embodiments director 112 includes a gimbal movably fixed to vehicle 10 that orients image and pulse detection array according to a selected azimuth and deflection relative to vehicle 10. Director 112 is configured to provide either or both of gimbal directional data 132 and/or aircraft positional data 134, which can be used to enhance image 140 (shown in
User interface 108 is configured for displaying image 140 (shown in
With reference to
Image 140 is includes at least one enhancement to make more clear the location of pulsed light source 120 in scene 12. In this respect image 140 includes symbol 142. Symbol 142 overlays image 140 in spatial registration with pulsed light source 120 (shown in
In the illustrated exemplary embodiment, image 140 is additionally enhanced with a map overlay 154 and gimbal directional data and aircraft positional information 156. Further, pulsed light source 120 is a first pulsed light source 120, symbol 142 is a first symbol 142, and a second light source 160 is augmented with a second symbol 162. Second symbol 162 is similar to first symbol 142 with the difference that second symbol overlays second light source 160 and is selected according to frequency of second light source 160. The pulsed illuminators may pulse at different frequencies so that they can be distinguished from each other.
A tally 164 is provided image 140, providing a count of pulsed light sources in scene 12 (shown in
With reference to
The frequency of the pulsed light source is determined for identifying the source of the pulsed illumination, as shown with box 218. The frequency is compared to a predetermined listing of frequency/symbol associations, as shown with box 220. The frequency/symbol associations may be resident, for example, in a lookup table resident in a program module of a memory, e.g., memory 104 (shown in
When determination is made that the pulsed light source is not associated with a locator device the image is communicated to a user interface, as shown with arrow 224 and box 226. The user interface can display the image, as shown with body 228, and imaging method 200 continue, as shown with arrow 228.
When determination is made that the pulsed light source is associated with a locator a symbol is associated with the pulsed light source, as shown with arrow 232 and box 234. The image is then enhanced with the symbol by inserting the symbol into the image, as shown with box 236. Examples of symbols include first symbol 30 (shown in
As will be appreciated by those of skill in the art in view of the present disclosure, overlaying the symbol in the image in spatial registration with the location of the pulsed light source in the scene augments indication of the location provided by the pulsed light source because the pulsed light source may not otherwise be readily discernable to a human observer monitoring the displayed image. In this respect the present inventors have come to appreciate the pulsed illumination sources occupying five (5) or fewer pixels in an image tend to increase likelihood that a human observer with not discern the source, potentially prolonging a search effort.
In certain embodiments method 200 can include enhancing the image by inserting a map overlay into the image, as shown with box 238. Such augmented reality mapping techniques enhance features that may not be readily apparent in an image, like roads in forested areas, that otherwise might go unnoticed. This can be advantageous when directing a ground-based search team toward a symbolically indicated location from an aircraft.
In accordance with certain embodiments, method 200 can include enhancing the image by inserting one or more of gimbal directional data and/or aircraft positional information into the image, as shown with box 240. The gimbal directional data and/or aircraft positional information can be projected such that the real-world geographic location of the pulsed light source is marked on a map. Alternatively (or additionally), the gimbal directional data and/or aircraft positional information can be used to direct the aircraft, ground-based searchers, or other aircraft, toward the location of the pulsed light source.
Identifying the location of individuals who have become lost or incapacitated in rugged, wilderness terrain or during maritime operations in can be a difficult endeavor involving significant time and other resources. As a result, lost or incapacitated individuals sometimes perish because they cannot be located quickly. In addition, searching for such locations may require search of large areas, require the employment of aircraft, and be costly due to difficulties attendant with identifying lost or incapacitated people from the air.
In certain embodiments described herein, imaging devices with imaging and pulse detection arrays, e.g., imaging device 100 (shown in
Accordingly, in accordance with certain embodiments described above, frequency data generated by the imaging and pulse detection array, pulse frequency data 116 (shown in
It is also contemplated that, in accordance with certain embodiments, augmented reality mapping can be employed. In this respect image data, with the symbol when a pulsed light source is determined to be present in a scene, is further enhanced with mapping information, e.g., mapping information 154 (shown in
The present disclosure provides a small, compact, and highly reliable method for rapidly searching wide swaths of terrain or marine environments. This invention enables the detection and accounting of lost or incapacitated individual(s) when traditional search methods fail, such as when the searchers are searching from high above the lost individual(s) and when other optical signals that indicate the location of the lost individual(s) are difficult to distinguish from the background with existing tech.
The methods of imaging a scene and imaging systems of the present disclosure, as described above and shown in the drawings, provide for imaging with superior properties including the capability to locate individuals in need of assistance that otherwise cannot be discerned by the human eye and/or occupy fewer pixels in an image than can be recognized by the human eye. While the apparatus and methods of the subject disclosure have been shown and described with reference to preferred embodiments, those skilled in the art will readily appreciate that changes and/or modifications may be made thereto without departing from the scope of the subject disclosure.
