1. Field of the Invention
The disclosure relates to systems and methods for optimizing the aimpoint for a missile and, more particularly, to systems and methods that provide automated aimpoint update optimization.
2. Description of the Related Art
Presently, some Man-In-The-Loop (MITL) missiles and associated aircraft launch controls allow the pilot to re-designate the aimpoint of the in-flight missile's target imaging seeker.
The in-flight seeker image from the missile in flight 2 is linked back to the launching aircraft via a data link pod 4. The data link pod 4 is linked to the aircraft mission planning command processor 6 with a suitable data bus (e.g. 1553 data bus). The data link pod 4 sends annotated seeker image video to the command processor 6. The command processor 6 sends the annotated video to the aircraft display 8 where the annotated seeker image is displayed on the display 8 with the aimpoint shown at the center of the display 8. The pilot can improve or change the aimpoint by commanding an aimpoint update by depressing and holding a switch on the stick control 10. The data link pod 4 relays this command to the in-flight missile 2 and the missile 2 notes the video frame that the pilot used to update the aimpoint.
Using control stick 10, the pilot can position a cursor overlaid on the seeker image on the cockpit display to a more desirable target location by moving the control stick 10. With the cursor positioned, the pilot releases the switch which immediately causes the position of the cursor on the image to be sent to the in-flight missile as the new commanded aimpoint. The missile seeker is aimed at the new aimpoint and the video resumes, such that the pilot can verify the aimpoint update. This process can be repeated until the missile 2 hits the target. This process takes time and the positioning is coarse and usually requires repetition, and the target impact point is not optimized.
Accordingly, there is a need for an automated system and method for providing an optimized aimpoint.
The present invention addresses the problems identified above by providing methods, equipment, and systems that can automatically suggest an updated aimpoint. Embodiments of systems and methods in accordance with the present disclosure may advantageously reduce the workload of the pilot, and optimizes the accuracy and timing of the missile updating process.
One embodiment provides a computerized method of using the returned seeker video from a missile in flight to find the mission target in the seeker image, locate the precise optimized software generated aimpoint on the target in the returned seeker image, and output the optimized aimpoint as a pixel location in the image.
A further embodiment uses the seeker video returned from the missile in flight. In this embodiment, the target is found in the returned video image and the system computes the precise optimized pixel location in the returned image for the missile aimpoint update. Thereafter the system positions the launcher cursor overlay on the launch crew display of the seeker image.
Embodiments in accordance with the present disclosure may improve the accuracy of a Man-In-The-Loop (MITL) missile (or any missile with a retargeting data link and video) by providing the pilot or controller with an autonomous target aim point update assist. This improvement may be accomplished in the aircraft launch equipment software, without requiring expensive and lengthy recertification of the aircraft, launch system or the missile.
Another embodiment assists the pilot in the positioning of the cursor by instantly suggesting a precise software generated aimpoint update location. The pilot can accept the software generated update or override the software assist by positioning the update aimpoint cursor to a desired location on the image.
The features, functions, and advantages that have been discussed can be achieved independently in various embodiments of the present invention or may be combined in yet other embodiments, further details of which can be seen with reference to the following description and drawings.
The accompanying drawings incorporated in and forming part of the specification illustrate several aspects of the present invention. In the drawings:
Reference will now be made in detail to the present preferred embodiment to the invention, examples of which are illustrated in the accompanying drawings.
Embodiments of methods and systems in accordance with the present disclosure may improve the accuracy of a Man-In-The-Loop (MITL) missile (or any missile with a retargeting data link and video) by providing the pilot or controller with an autonomous target aim point update assist. In some embodiments, this improvement may be accomplished in the aircraft launch equipment software, without requiring expensive and lengthy recertification of the aircraft, launch system or the missile. Other embodiments may be done in hardware or a combination of hardware and software.
One embodiment assists the pilot in the positioning of the cursor by automatically suggesting an aimpoint update location. In some embodiments cursor position represents a precise software generated aimpoint update location. The pilot can accept the software generated update or override the software assist by positioning the update aimpoint cursor to a desired location on the image.
The AOD device 100 may send cursor or marker position commands or location to the command processor 6. The command processor 6 may use the location or position commands to cause cockpit display 8 to display the marker or cursor at the optimized position.
A target image library 102 may receive the identity of mission target(s) from the aircraft mission planning command processor 6. This library 102 contains missile target image sets. Each image set may contain one or more images of targets. In some embodiments, each image set includes images of potential targets taken from different ranges (distances), azimuth directions or angles, and elevation angles. The target image library 102 outputs missile target image sets that correspond to the mission target(s) of interest. In the embodiment shown in
In the embodiment shown, the image and data processor 104 receives missile data that may include seeker image data from the aircraft mission planning command processor 6. The image and data processor 104 may process the missile data into a format suitable for automatic target recognition (ATR) processing. In some embodiments, the ATR format is a digital format. In some embodiments, the digital format may represent a combination of two interlaced frames of video that preserves the annotation areas. In other embodiments, the pixel intensity in the image fields may be compressed to avoid saturation.
The ATR formatted data may be sent from the image and data processor 104 to a background and noise reduction component 106. The background and noise reduction component 106 reduces the noise in the ATR formatted data. In some embodiments, the background and noise reduction component 106 may analyze the ATR formatted data for signal-to-noise ratio. In further embodiments, the background and noise reduction component 106 may also combine multiple frames of ATR data so that noise reduced ATR formatted data exceeds a predetermined ATR feature-to-noise ratio. The noise reduced ATR formatted data may be sent to an ATR component extractor 108.
The ATR component extractor 108 extracts data from the noise reduced ATR formatted data that may be used to identify and locate targets. In some embodiments, the extracted data corresponds to features and segments needed for an ATR algorithm. The extracted data may be passed to an identify and locate targets component 112.
In the embodiment shown in
The identify and locate targets component 112 may compare the extracted data with the tailored image elements in order to identify the mission target. In some embodiments, the identify and locate targets component 112 will match, code, and locate the mission target in the ATR formatted data. At least the location of the identified mission target is passed to an ATR aimpoint marker generator 114 from the identify and locate targets component 112.
The ATR aimpoint marker generator 114 may receive some missile data, such as seeker and slew mode and/or status, from the aircraft mission planning command processor 6. Using the data from the identify and locate targets component 112 and the command processor 6, the ATR aimpoint marker generator 114 generates an aimpoint marker at the mission target location generated by the identify and locate targets component 112. This aimpoint marker may be sent to the command processor 6. The command processor 6 may then update the cursor position in the cockpit display 8.
In block 204, the processed image format is analyzed for signal-to-noise ratio. Block 204 may also combine multiple frames to exceed a threshold for ATR feature-to-noise ratio (signal-to-noise ratio). Block 204 may output a noise reduced image format.
In block 206, the missile seeker annotation is read and separated from the noise reduced image format. The seeker annotation describes the current seeker modes. The modes reported in the video may be compared to the last commanded state (from the aircraft weapon control system) to verify the mode and settings that the seeker was in when the image was received.
The target library shown in block 216 contains missile target image sets. In block 218, mission planning data are used to identify and extract an image set for this mission from the library. In block 220, the range, look angle, field of view and missile seeker mode status (hot, cold, etc.) from the annotation extracted in block 206 may be used to preprocess the library image set extracted in block 218.
In block 208, the ATR processing component extracts features and segments needed by an ATR algorithm, known to those in the practice and described in IEEE reference: INSPEC Accession No. 7303990, from the image format having the annotations removed. These features and segments (elements) are then fed into the ATR algorithm and compared with the scaled target image set from the reference library to match, code, and locate the mission target.
In block 210, the matched target certainty data is compared to an ATR threshold for each detected target. The primary mission target position is identified and the location of the aimpoint of the matched & registered library target is determined in terms of the pixel location on the pilot display 8.
In block 212, the pixel location of the target is extracted from the results of block 210 and the aimpoint location on the target image from the target library 216 are combined to determine the optimized pixel position of the cursor on the display. The optimized pixel location is then loaded into a hardware register for access by the operator via the switch on the control stick. When the operator depresses the switch, the aimpoint cursor will be located at this optimized point for the operator to see. The pilot sees this assisted ATR cursor position and decides if the cursor should be further repositioned. If the pilot moves the stick position, the AOD optimized cursor input is interrupted and the cursor is controlled only by the pilots stick until after the aimpoint update switch is released.
In summary, numerous benefits are described which result from employing the concepts of the invention. The foregoing description of exemplary embodiments is presented for the purposes of illustration and description, and is not intended to be exhaustive or to limit the embodiment to the precise form disclosed. Obvious modifications or variations are possible in light of the above teachings. The described embodiments were selected and described in order to best illustrate the principles disclosed and its practical application to thereby enable one of ordinary skill in the art to best utilize various embodiments and with various modifications as are suited to particular uses contemplated. It is intended that the scope of the disclosure be defined by the claims appended hereto.