Patent Grant
9689669
Electro-optical systems are used in a variety of applications such as imaging, targeting, ranging, tracking, surveillance, and reconnaissance, among other military applications. In many systems, imaging sensors sharing a common image plane produce mutually aligned images of a target or “scene.” Mutual alignment of the images ensures accurate alignment of the system components. In particular, various multi-spectral electro-optical systems employ imaging sensors that are receptive to light of different spectral bands, such as infrared thermal imagers and visible color television cameras. Accordingly, multi-spectral electro-optical systems permit an operator to detect and identify target characteristics otherwise concealed in optical systems responsive to light of a single spectral band. Conventionally, boresight misalignments in optical systems have been detected and cured with the use of targeting boards after an initial alignment during manufacture. The alignment tends to drift over time, leading to the need to use targeting boards to periodically adjust the alignment. In such conventional systems, the targeting board is located at a distance from the optical system and illuminated so that it is clearly visible in all sensors. By aligning the sensors with the common targeting board, misalignments in the optical system may be detected and properly addressed.
Various aspects and embodiments relate to electro-optical systems and, in particular, to reimaging optical systems that include an alignment object selectively positioned at an intermediate image plane of the reimaging optical system and configured to superimpose an alignment tool upon one or more images produced therefrom. Accordingly, various embodiments of the alignment object discussed herein permit rapid and real-time sensor to sensor alignment and thus also sensor to laser alignment.
In particular, and as discussed in more detail below, certain aspects and embodiments are directed to a reimaging optical system that includes one or more imaging sensors positioned at a focal plane to receive electromagnetic radiation and configured to generate an image having the alignment tool superimposed thereon. In one setting, this includes a first imaging sensor configured to produce a first image having the alignment tool superimposed thereon and a second imaging sensor configured to produce a second image having the alignment tool superimposed thereon. One or more system components, such as a controller, may be configured to perform an alignment process for the first imaging sensor and/or the second imaging sensor based at least on a position of the alignment tool in the first and/or second image.
In other particular aspects and embodiments discussed in more detail below, the reimaging optical system may include an optical transmitter (e.g., laser) configured to emit an optical beam to designate a target. The first imaging sensor may be positioned to receive electromagnetic radiation reflected from the target and configured to generate an image of the designated target. One or more system components, such as a controller, may be configured to perform an alignment process for the first imaging sensor to align the optical transmitter with the first imaging sensor based on at least a position of the alignment tool in the first image.
Various embodiments discussed herein permit the correction of misalignments resulting from environmental conditions, thermal fluctuations, vibrational forces, or any other disruptive influences on the optical system during operation. It is appreciated that often these disruptive influences increase, decrease, or continually vary during operation of the optical system. Accordingly, various embodiments discussed herein additionally permit real-time correction of misalignments during operation of the associated optical system to accommodate for multiple and varying disruptive influences. In various embodiments, this may include avoiding the need to disengage with the target to perform sensor to sensor alignment at a targeting board. Among the foregoing, various embodiments may have numerous other advantages, such as the advantages discussed below.
According to one aspect, provided is a reimaging optical system. The reimaging optical system may include reimaging foreoptics positioned to receive and reimage incident electromagnetic radiation to produce an intermediate image plane and output an optical beam of the received incident electromagnetic radiation, an imaging optical apparatus positioned to receive the optical beam and focus the electromagnetic radiation of the optical beam onto a first focal plane, a first imaging sensor positioned at the first focal plane and configured to produce a first image responsive to receiving the electromagnetic radiation of the optical beam, an alignment object selectively positioned at the intermediate image plane and configured to superimpose an alignment tool upon the first image, and a controller coupled to the first imaging sensor and configured to perform an alignment process for the first imaging sensor based on at least a position of the alignment tool in the first image.
In one example, the reimaging foreoptics includes a front objective and a first optical component, wherein the intermediate image plane is interposed between the front objective and the first optical component. In a further example, the front objective includes at least one optical element positioned to focus the electromagnetic radiation onto the intermediate image plane. In a further example, the reimaging foreoptics includes a beam steering mirror configured to aim the electromagnetic radiation to substantially position the alignment tool in a field of view of the first imaging sensor.
In one example, the alignment object is fixed at the intermediate image plane and the alignment process for the first imaging sensor includes pixel substitution. In another example, the alignment object includes a plurality of focus indicators, individual ones of the plurality of focus indicators disposed at varying depths of the intermediate image plane, wherein, the controller is further configured to perform a focus process for the first imaging sensor based on at least a focus of individual ones of the plurality of focus indicators. In a further example, the plurality of focus indicators includes a plurality of discrete protrusions extending from a frame of the alignment object.
In one example, the system further includes a second imaging sensor positioned at a second focal plane and configured to produce a second image responsive to receiving the electromagnetic radiation of the optical beam, wherein the alignment object is further configured to superimpose the alignment tool upon the second image. In a further example, the second imaging sensor may include a plurality of imaging sensors positioned at a plurality of focal planes and configured to produce a plurality of images responsive to receiving the electromagnetic radiation of the optical beam, wherein the alignment object is further configured to superimpose the alignment tool upon the plurality of images. In another example, the controller is further coupled to the second imaging sensor and configured to perform the alignment process for the second imaging sensor based on a position of the alignment tool in the second image and the position of the alignment tool in the first image, wherein the alignment process for the second imaging sensor includes determining an offset between the alignment tool superimposed upon the first image and the alignment tool superimposed upon the second image.
In a further example, the controller may be further configured to align the first image sensor and second image sensor to an optical transmitter responsive to determining an offset between the alignment tool superimposed upon the first image and the alignment tool superimposed upon the second image. In another example, the first imaging sensor is responsive to light in a first spectral band and the second imaging sensor is responsive to light in a second spectral band and the imaging optical apparatus further comprises a dichroic beam splitter positioned to receive the optical beam and partition the electromagnetic radiation of the optical beam to the first imaging sensor and the second imaging sensor based on the first and second spectral bands.
In one example, the alignment tool may include a reticle. In a further example, the reticle includes a grid having a plurality of longitudinal and latitudinal extending delineations defined by a substantially square profile.
In one example, the reimaging foreoptics may include at least one pivot and the alignment object is configured to rotate about the pivot and extend into the intermediate image plane in real-time. In one example, the system further includes at least one illumination source positioned to substantially illuminate the alignment object.
According to one aspect, provided is an optical reimaging method. The method may include receiving and reimaging electromagnetic radiation incident on reimaging foreoptics configured to produce an intermediate image plane and output an optical beam, receiving and focusing the electromagnetic radiation of the optical beam onto a first focal plane, producing a first image with a first imaging sensor positioned at the first focal plane responsive to receiving the electromagnetic radiation of the optical beam, selectively positioning an alignment object having an alignment tool at the intermediate image plane to superimpose the alignment tool upon the first image, and performing an alignment process for the first imaging sensor based on at least a position of the alignment tool in the first image.
In one example, the method may further include aiming the electromagnetic radiation to substantially position the alignment object in a field of view of the first imaging sensor. In another example, the alignment object is fixed at the intermediate image plane and performing the alignment process for the first imaging sensor includes performing pixel substitution.
In one example, the method may further include producing a second image with a second imaging sensor positioned at a second focal plane responsive to receiving the electromagnetic radiation of the optical beam, and wherein selectively positioning an alignment object having an alignment tool at the intermediate image plane includes selectively positioning an alignment object having an alignment tool at the intermediate image plane to superimpose the alignment tool upon the first image and the second image. In a further example, the method further includes performing an alignment process for the second imaging sensor based on a position of the alignment tool in the second image and a position of the alignment tool in the first image. In a further example, the alignment process for the second imaging sensor includes determining an offset between the alignment tool superimposed upon the first image and the alignment tool superimposed upon the second image.
In one example, the method may further include performing a focus process for the first imaging sensor based on at least a focus of individual ones of a plurality of focus indicators of the alignment object positioned at the intermediate image plane. In a further example, the focus process includes repositioning the alignment object at the intermediate image plane responsive to comparing the focuses of individual ones of the plurality of focus indicators. In a further example, the focus process further includes analyzing range information and temperature information. In another example, the method further includes illuminating the alignment object.
Still other aspects, embodiments, and advantages of these exemplary aspects and embodiments are discussed in detail below. Embodiments disclosed herein may be combined with other embodiments in any manner consistent with at least one of the principles disclosed herein, and references to “an embodiment,” “some embodiments,” “an alternate embodiment,” “various embodiments,” “one embodiment” or the like are not necessarily mutually exclusive and are intended to indicate that a particular feature, structure, or characteristic described may be included in at least one embodiment. The appearances of such terms herein are not necessarily all referring to the same embodiment.
Various aspects of at least one embodiment are discussed below with reference to the accompanying figures, which are not intended to be drawn to scale. The figures are included to provide illustration and a further understanding of the various aspects and embodiments, and are incorporated in and constitute a part of this specification, but are not intended as a definition of the limits of the invention. In the figures, each identical or nearly identical component that is illustrated in various figures is represented by a like numeral. For purposes of clarity, not every component may be labeled in every figure. In the figures:
Aspects and embodiments described herein include systems and methods for image plane sensor alignment. In various embodiments this includes systems and methods for real-time correction of sensor to sensor misalignments in a multi-spectral electro-optical system. Electro-optical systems are used in a variety of applications including imaging, targeting, ranging, tracking, surveillance, and reconnaissance, and in particular, are often used in military airborne missions. In these applications, mutually aligned imaging sensors in the optical system are imperative to ensuring the accuracy of the associated system. Even slight misalignments can result in undesirable effects, such as targeting inaccuracy and decreased precision.
As discussed above, there is a need for an optical system configured to correct sensor to laser and sensor to sensor misalignments resulting from environmental conditions, thermal fluctuations, vibrational forces, or any other disruptive influences on the optical system during operation. Conventional alignment techniques generally require special test equipment and a great deal of time to perform. Alternative techniques require field equipment that fails to accommodate operational conditions and invariably requires disengagement with the target to complete alignment. Therefore, such alignment techniques are not practical or efficient during the normal operation of the optical system. Accordingly, various embodiments discussed herein permit real-time alignment of one or more imaging sensors in an optical system without disengaging with the target. Such systems permit continual boresight corrections to accommodate the misalignment of imaging sensors that may occur during airborne military missions.
It is to be appreciated that embodiments of the methods and apparatuses discussed herein are not limited in application to the details of construction and the arrangement of components set forth in the following description or illustrated in the accompanying drawings. The methods and apparatuses are capable of implementation in other embodiments and of being practiced or of being carried out in various ways. Examples of specific implementations are provided herein for illustrative purposes only and are not intended to be limiting.
Also, the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use herein of “including,” “comprising,” “having,” “containing,” “involving,” and variations thereof is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. References to “or” may be construed as inclusive so that any terms described using “or” may indicate any of a single, more than one, and all of the described terms. Any references to front and back, left and right, top and bottom, upper and lower, and vertical and horizontal are intended for convenience of description, not to limit the present systems and methods or their components to any one positional or spatial orientation.
Referring to
Incident electromagnetic radiation from a distant target or “scene” is received and manipulated by the reimaging foreoptics 102 so as to produce an image at the intermediate image plane 110 and output an optical beam of the received incident electromagnetic radiation. In various embodiments, electromagnetic radiation received by the reimaging foreoptics 102 enters through the front objective 104 of the reimaging optical system 100. The front objective 104 may include one or more optical elements, such as one or more mirrors or lenses. In one setting, the front objective 104 receives the electromagnetic radiation and focuses the electromagnetic radiation onto the intermediate image plane 110. In various embodiments, the reimaging foreoptics further includes a first optical component 108, such as a mirror or lens. In one implementation, optical components of the reimaging optical system 100, such as the front objective 104 and first optical component 108 are configured to substantially reimage the received electromagnetic radiation to generate an output optical beam. In various embodiments, the reimaging foreoptics 102 direct the optical beam to the imaging optical apparatus 118.
As discussed herein, the intermediate image plane 110 is formed between the front objective 104 and the first optical component 108 of the reimaging foreoptics 102. Notably, the intermediate image plane 110 is upstream from the imaging optical apparatus 118. The intermediate image plane 110 includes the plane at which an image of the target or “scene” is formed. In various embodiments, the reimaging foreoptics 102 may further include one or more optical elements positioned at the intermediate image plane 110 to filter the electromagnetic radiation respective to the angle of incidence at which the electromagnetic radiation is received. Accordingly, positioning the alignment object 112 upstream from the imaging optical apparatus 118 enables the reimaging optical system 100 to rapidly and efficiently insert and remove the alignment object 112 with minimal interference to other system components. As discussed above, and in contrast to many conventional systems, deployment or retraction of the alignment object 112 may occur at any time during operation of the optical system 100. Accordingly, the reimaging optical system 100 may repeatedly perform one or more alignment processes to accommodate for fluctuations in environmental influences.
In various embodiments, the alignment object 112 is defined by a frame and a transparent window having the alignment tool 114 disposed therein. Accordingly, the transparent center of the alignment object permits the received electromagnetic radiation to pass through the alignment object 112 and propagate to the imaging optical apparatus 118 and associated one or more imaging sensors. It is appreciated that this configuration permits the reimaging optical system 100 to remain engaged and in view of the target, despite placement of the alignment object 112 at the intermediate image plane 110. As used herein, the intermediate plane is not defined as a discrete point and may include, for example, the general area around the image plane as defined by geometric optics. Accordingly, in various embodiments positioning the alignment object at the intermediate plane may not restrict the alignment object to the depth of focus of the intermediate image plane.
In one embodiment, the imaging optical apparatus 118 is positioned to receive the optical beam and focus the electromagnetic radiation of the optical beam onto one or more focal planes (e.g., first focal plane 128 and second focal plane 132). One or more imaging sensors are positioned at the one or more focal planes and configured to produce an image of the scene formed at the respective focal plane by the optical beam. In one embodiment, the imaging sensors may include one or more cameras sensitive to electromagnetic radiation of one or more spectral bands. In one example, the imaging sensors may include a detector array, such as a focal plane array comprised of a grid array of pixels organized in rows and columns. For instance, the imaging sensors may include a daytime television (DTV) camera, a SWIR camera, and a MWIR camera. The electromagnetic radiation of the optical beam may include ultraviolet (UV), visible, and/or infrared radiation in one or more of the near infrared (NIR), shortwave infrared (SWIR), midwave infrared (MWIR), longwave infrared (LWIR), and/or very-longwave infrared (VLWIR) spectral bands. As discussed above, the one or more imaging sensors may be configured to produce an image from the received electromagnetic radiation. In various embodiments, the images produced by the one or more imaging sensors are copies of the image formed at the intermediate image plane 110. For example, the first imaging sensor 122 may be positioned at the first focal plane 128 and configured to produce a first image responsive to receiving electromagnetic radiation in a first spectral band. Furthermore, the second imaging sensor 130 may be positioned at the second focal plane 132 and configured to produce a second image responsive to receiving electromagnetic radiation in a second spectral band. As discussed above, the dichroic beamsplitter 124, or other device, may be used to separate and direct the electromagnetic radiation in the different spectral bands to the respective imaging sensors. Alternatively, the first imaging sensor 122 and the second imaging sensor 130 may share the same focal plane. In such an embodiment, the optical system 100 can be configured to switch the imaging sensors based on a wavelength of the electromagnetic radiation received. While shown in
In various embodiments, the alignment object 112 may be deployed at the intermediate image plane 110, manually or automatically, to superimpose the alignment tool 114 upon the image formed thereat. Accordingly, the alignment tool 114 will appear superimposed on the images produced by the one or more imaging sensors. The alignment object 112 may also be retracted to remove the alignment tool 114 from the image plane 110. In various embodiments, the controller 120 coupled to the one or more imaging sensors may be configured to perform an alignment process, discussed in more detail below, for the first imaging sensor 122 and/or second imaging sensor 130 based on at least a position of the alignment tool 114 in the first image and/or second image.
Accordingly, the controller may be configured to perform a series of operations, such as an alignment process, responsive to receiving one or more images from the one or more cameras. In various embodiments this may include, displaying the one or more images for external presentation via one or more interfaces, detecting a misalignment, aligning the one or more imaging sensors with the optical transmitter, and/or mutually aligning the one or more imaging sensors, among various other operations. As shown in
As discussed above, the imaging optical apparatus 118 may further include a dichroic beamsplitter 124 positioned to receive the optical beam and partition the electromagnetic radiation of the optical beam to the one or more imaging sensors (e.g., first imaging sensor 122 and second imaging sensor 130). In further embodiments, the beam splitter may be positioned to partition to the collimated optical beam to the first, the second, and a third imaging sensor of the imaging optical apparatus 118. In various applications, this includes splitting the collimated optical beam as a function of the wavelengths of the electromagnetic radiation received. The collimated optical beam may be split into one or more spectrally distinct partitions of the collimated optical beam. For example, this can include partitioning the collimated optical beam to the DTV camera, the SWIR camera, and the MWIR camera, of one embodiment. Accordingly, images produced by the DTV camera, SWIR camera, and MWIR camera, all provide distinct information regarding the target or scene imaged.
In various embodiments, one or more optical elements of the reimaging foreoptics 102 are in communication with a controller, such as the controller 120, are selectively positioned to aim the received electromagnetic radiation. For example, one or more optical elements of the front objective 104 configured to aim the electromagnetic radiation to substantially align the intermediate image plane at the alignment tool.
In some cases, the alignment tool 114 may require illumination to produce sufficient contrast and visibility in one or more sensors. In such an instance, an illumination source 136 may be placed in the foreoptics 102 outside of the optical path. The illumination source 136 is configured to illuminate the alignment tool 114. Illumination reflected from the alignment tool 114 travels through the optical path to the one or more imaging sensors. At longer wavelengths, such as MWIR and LWIR, the alignment tool 114 is typically glows due to its own temperature. Variations on the use of an illumination source 136 include the use of an alignment tool 114 that produces its own light in the UV through SWIR bands via electrical heating, phosphorescent material, or other similar mechanisms.
Referring to
In additional embodiments, the alignment object 200 may include additional alignment tools (e.g., reticles) or filters. In such an embodiment, individual ones of a plurality of alignment tools and/or filters may be selectively deployed or removed from the intermediate image plane. For example, the alignment object 200 may include a rotatable wheel shaped and positioned to allow any one of multiple alignment tools to be placed in the optical path at the intermediate image plane. In one example, each alignment tool may be configured to assist sensor to sensor alignment for a different field of view of the optical system. Accordingly, rotation of the alignment object 200 (e.g., by the controller) may switch between the plurality of alignment tools or filters, and further permit the associated optical system to conform the alignment tool to the particular mission. It is appreciated that this may further increase the precision of alignments. In other embodiments, the alignment object 200 is retained in a fixed position outside of the nominal field of view of the imaging sensors at intermediate image plane. In such a setting, a beam steering mirror may be positioned to receive and aim the electromagnetic radiation to the imaging sensors so as to substantially align the intermediate image plane with the alignment tool 202. In further implementations, the alignment object 200 may include one or more focus indicators. Individual ones of the plurality of focus features are positioned so as to appear at varying depths when the alignment object 200 is positioned at the intermediate image plane. Accordingly, the alignment object may be used to perform a focus process for an associated optical system. Such implementations are discussed in detail below with reference to
Turning briefly to
Returning to
In various embodiments, such as those discussed with reference to
Referring to
The memory 504 stores programs (e.g., sequences of instructions coded to be executable by the processor 502) and data during operation of the controller 500. Thus, the memory 504 may be a relatively high performance, volatile, random access memory such as a dynamic random access memory (“DRAM”) or static memory (“SRAM”). However, the memory 504 may include any device for storing data, such as a disk drive or other nonvolatile storage device. Various examples may organize the memory 504 into particularized and, in some cases, unique structures to perform the functions disclosed herein. These data structures may be sized and organized to store values for particular data and types of data.
Components of the controller 500 are coupled by an interconnection mechanism such as the interconnection mechanism 506. The interconnection mechanism 506 may include any communication coupling between system components such as one or more physical busses in conformance with specialized or standard computing bus technologies such as IDE, SCSI, PCI and InfiniBand. The interconnection mechanism 506 enables communications, including instructions and data, to be exchanged between system components of the controller 500.
The controller 500 can also include one or more user interface devices 508 such as input devices, output devices and combination input/output devices. Interface devices may receive input or provide output. More particularly, output devices may render information for external presentation. Input devices may accept information from external sources. Examples of interface devices include keyboards, mouse devices, trackballs, microphones, touch screens, printing devices, display screens, speakers, network interface cards, etc. Interface devices allow the controller 500 to exchange information and to communicate with external entities, such as users and other systems.
The data storage element 510 includes a computer readable and writeable data storage medium configured to store noon-transitory instructions and other data, and can include both nonvolatile storage media, such as optical or magnetic disk, ROM or flash memory, as well as volatile memory, such as RAM. The instructions may include executable programs or other code that can be executed by the at least one processor 502 to perform any of the functions described here below.
Although not illustrated in
Returning to
In one embodiment, the controller is configured to perform one or more processes to pixel shift the image produced by the first, and/or second, and/or third imaging sensor. Pixel shifting includes moving individual pixels or the entire image frame of the image. While in one embodiment, pixel shifting is performed automatically by the controller, in various other embodiments, the optical system may provide one or more tools, via the interface, permitting the user to manually or automatically mechanically align the imaging sensor(s) or optical transmitter of the optical system 100. Further, the controller can be configured to perform one or more processes to substitute pixels of the image produced by the imaging sensors. Similar to pixel shifting, pixel substitution includes replacing individual pixels of the image. Pixel substitution may be performed automatically by the controller, or via the one or more tools provided to the user.
Although described herein primarily in the context of sensor to sensor alignment (e.g., boresight misalignments), in further embodiments, the alignment object permits measurement and correction of aberrations in the associated optical system. Aberrations can include distortion, rotation, and magnification at each imaging sensor. Various embodiments of an alignment object, such as alignment object 112 discussed above with reference to
As described with reference to
In act 604, various components of the reimaging optical system receive and image the received incident electromagnetic radiation to the intermediate image plane and output an optical beam of the incident electromagnetic radiation. In one embodiment, the optical beam is directed to an imaging optical apparatus, such as the imaging optical apparatus 118 discussed above with reference to
In act 606, a first imaging sensor in the imaging optical apparatus positioned at the focal plane produces a first image responsive to receiving the electromagnetic radiation of the optical beam. In various embodiments, the method may also include producing a second image with a second imaging sensor positioned at the focal plane responsive to receiving the electromagnetic radiation of the optical beam. In further embodiments, the method may include producing a third image with a third imaging sensor, or any additional image with an associated additional imaging sensors. For example, in various embodiments, a DTV camera may produce a DTV image, a SWIR camera may produce a SWIR image, and a MWIR camera may produce a MWIR image.
In act 608, the reimaging optical system selectively positions an alignment object having an alignment tool at the intermediate image plane so as to superimpose the alignment tool upon the first image produced by the first imaging sensor. In various embodiments, selectively positioning the alignment object can include rotating the alignment object about a pivot to extend the alignment object in and out of the intermediate image plane in real-time. In other embodiments, selectively positioning can include aiming the electromagnetic radiation with an optical element, such as a mirror. Accordingly, while in one embodiment positioning the alignment object may include deploying the alignment object at the image plane, in various additional embodiments momentarily positioning the alignment object may include aiming the collimated optical beam to substantially align with the alignment tool of a fixed alignment object. In further embodiments, selectively positioning can include placing the alignment object at a fixed position in the intermediate image plane.
In act 610, a controller, such as controller 120 discussed above with reference to
In various other embodiments, the alignment process may further include a series of algorithms to align the one or more imaging sensors with an optical transmitter. For example, in various embodiments, one or more optical transmitters emit electromagnetic beams out of apertures that are separate from the reimaging foreoptics. These optical transmitter apertures are typically intended to be boresighted to the reimaging foreoptics and imaging optical apparatus. However, various disturbances can cause the optical transmitter aperture to become misaligned from the reimaging foreoptics, such that the optical transmitter can miss a target despite the target being centered in the imaging system. Various embodiments of the imaging optical system and alignment tool can be exploited to achieve laser-to-sensor alignment after sensor-to-sensor alignment has been performed. For example, a target may only be apparent to a particular imaging sensor (e.g., a visible-band detector), while the reflected light of the optical transmitter is visible only to a second imaging sensor (e.g., SWIR detector). Responsive to aligning the imaging sensors, the alignment process can include centering the target in the first imaging sensor (visible-band sensor), and centering the reflected light in the second imaging sensor (SWIR sensor) by manipulating beam steering optics in the optical transmitter aperture. As a result of aligning the imaging sensors, the user can be confident that the reflected light is properly positioned on the target.
In various other embodiments the optical transmitter may share common foreoptics with the imaging optical apparatus. The optical transmitter of the reimaging optical system propagates an electromagnetic beam toward the target. Accordingly, receiving electromagnetic radiation incident on the foreoptics may include collecting radiation from reflection of the electromagnetic beam from the target. As such, in one embodiment a target indicator will appear on the target in the image produced by the one or more imaging sensors (e.g. first and second imaging sensors). As such, the controller may perform an alignment process to substantially center the target indicator in the image produced, based on at least a position of the alignment tool in the image. While in one embodiment alignment may include mechanical adjustment of the sensor or optical transmitter, in various other embodiments, the controller may perform a series of image registration algorithms to center the image produced by the imaging sensor. For example, the process may include determining an offset between the alignment tool superimposed upon the first image and the location of the target indicator on the image.
Turning now to
As shown in
While described above as included in an alignment object, in further implementations focus indicators (e.g., focus indicators 706 described with reference to
As described above with reference to
In act 902, one or more components of the controller are configured to focus on a target or “scene” imaged by the associated optical system. In various embodiments, act 902 may include an active, passive, or combination of active and passive, autofocus act. It is appreciated that when ambient conditions are ideal (e.g., proper illumination is present, climate conditions are temperate, vibrational influences are minimal, etc.), act 902 may result in an optimal focus of the target and, accordingly, the optimum focus position of the optical system. If the initial focus of act 902 results in an optimum focus position for the optical system, one or more components of the controller are configured to compare the focus of the individual focus indicators to identify the focus indicator having the best feature, as described above. Accordingly, the best feature is identified and associated with the resulting optimum focus position. Such a process is shown in act 904.
In further embodiments, one or more components of the controller are configured to further detect operational diagnostics of the optical system responsive to achieving the optimum focus position. In acts 906 and 908, range information and temperature information are detected responsive to performing the initial focus act 902. It is appreciated that in various embodiments range and temperature may have an effect on the optimum focus position of the optical system. As used herein, temperature information may include ambient temperatures internal or external to the optical system and range information may include the distance to a target imaged by the one or more imaging sensors of the optical system. While shown in act 906 and 908 as detecting range information and temperature information, in further embodiments, other diagnostics may be determined responsive to act 902. For example, the system may include one or more accelerometers, or other vibrational sensors, configured to detect vibrational forcers.
Responsive to receiving the range information, temperature information, and/or identification of the best focused feature, the controller can be configured to store the optimum focus position indexed by the best focused feature, range information, and/or temperature information. For instance, the best feature, range information, or temperature information may be stored in a look-up table. As discussed in further detail with regards to acts 912-916, storage of optimum focus positions indexed by the best focused feature, temperature information, and/or range information permits the optical system to determine an optimum focus position when autofocus is not possible, or, operating conditions prevent focusing on the target as described above in act 902.
In act 912, responsive to failing to determine the optimum focus position of the optical system based on a focus of the target, one or more components of the optical system are configured to determine the best focused feature, temperature information, and/or range information, as described above with reference to acts 904-908. The determined best feature, temperature information, and/or range information, is then used to query one or more databases of stored optimum focus positions to determine the optimum focus position corresponding to the determined best feature, temperature information, and/or range information. While shown in
In response to determining the optimum focus position from the index or through calculation, the controller is configured to issue a focus command. In act 910, the focus command is issued by the controller to one or more components of the optical system. For example, in response to determining the optimum focus position the controller is configured to issue a command to re-position the alignment object of one embodiment. In such an embodiment, the alignment object may be repositioned at the optimum focus position such that the alignment tool superimposed upon the first image produced by the first imaging sensor is in focus. As described herein, the focus process eliminates the need to manually change the focus of an optical system in order to perform sensor to sensor alignments, in addition to increasing efficiency and reducing boresight shift.
As shown in
As is understood, electro-optical systems are used in a variety of applications including imaging, targeting, ranging, tracking, surveillance, and reconnaissance applications, and in particular, are often used in military airborne missions. In such applications, mutually aligned images produced by a variety of sensors all sharing a common image plane in the optical system is imperative to ensuring accurate and precise execution of the corresponding mission. Even slight misalignments can result in undesirable effects, such as targeting inaccuracy and decreased precision. Accordingly, various embodiments discussed herein provide systems and methods for real-time correction of laser to sensor and/or sensor to sensor misalignments in a multi-spectral electro-optical system.
Having described above several aspects of at least one embodiment, it is to be appreciated various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure and are intended to be within the scope of the invention. Accordingly, the foregoing description and drawings are by way of example only, and the scope of the invention should be determined from proper construction of the appended claims, and their equivalents.
| Number | Name | Date | Kind |
|---|---|---|---|
| 2171571 | Karnes | Sep 1939 | A |
| 2800718 | Benford | Jul 1957 | A |
| 3371212 | Weiss | Feb 1968 | A |
| 3614238 | Stites | Oct 1971 | A |
| 4080623 | Needs | Mar 1978 | A |
| 4238157 | Strauch | Dec 1980 | A |
| 4308551 | Ohnuma et al. | Dec 1981 | A |
| 4422758 | Godfrey et al. | Dec 1983 | A |
| 4811061 | Sud et al. | Mar 1989 | A |
| 4855777 | Suda | Aug 1989 | A |
| 4902128 | Siebecker et al. | Feb 1990 | A |
| 5315341 | Hibbard | May 1994 | A |
| 5900942 | Spiering | May 1999 | A |
| 6211951 | Guch, Jr. | Apr 2001 | B1 |
| 6239912 | Ozawa | May 2001 | B1 |
| 6765663 | Byren et al. | Jul 2004 | B2 |
| 8934097 | Rushford | Jan 2015 | B2 |
| 20120162757 | Roider | Jun 2012 | A1 |
| 20130314567 | McComas et al. | Nov 2013 | A1 |
| 20140300751 | Orband | Oct 2014 | A1 |
| 20150054936 | Bach | Feb 2015 | A1 |
| Number | Date | Country |
|---|---|---|
| 9741460 | Nov 1997 | WO |
| Entry |
|---|
| International Search Report and Written Opinion for PCT/US2016/017567 mailed Jun. 20, 2016. |
| Number | Date | Country | |
|---|---|---|---|
| 20160305774 A1 | Oct 2016 | US |
