Patent Application
20190068880
Many aircraft have camera systems to provide input to pilots. Aircraft camera systems are often equipped with de-icing and anti-fogging systems. Typically, high-power heaters are installed to prevent and eliminate ice and condensation from accumulating on the camera window. These high-power heaters are either powered constantly, or powered based on a temperature condition. When there is no ice or condensation accumulation this wastes power and sacrifices operating life of the components.
In one example, an exterior camera system of an aircraft comprises an image sensor configured to capture image data and one or more processors. The one or more processors are configured to determine a contrast of at least a portion of the captured image data; evaluate whether the contrast is less than a threshold contrast level; and output, in response to the contrast being less than the threshold contrast level, an initiate heating command configured to initiate heating of a camera window positioned between the image sensor and an exterior of the aircraft.
In one example, a method comprises capturing image data using an image sensor of an exterior camera system of an aircraft; determining, by one or more processors of the exterior camera system, contrast of at least a portion of the captured image data; evaluating, by the one or more processors, whether the contrast is less than a threshold contrast level; and outputting, in response to determining that the contrast is less than the threshold contrast level, an initiate heating command configured to initiate heating of a camera window positioned between the image sensor and an exterior of the aircraft.
Apparatus, systems, and associated methods relate to image optimization using image processing to determine when a camera window heater should be turned on to rid the camera window of ice or condensation. In some applications, such as an aircraft, heaters are turned on constantly during flight due to low temperatures. The constant heat consumes more power than necessary and lowers the operating life of camera system and heating components. Using the apparatus, systems, and associated methods herein, allows for the window heater to only be turned on when the camera window is obscured by ice and/or condensation.
Camera window 44 protects exterior camera system 42 from elements and conditions external to an aircraft while providing visual access to the exterior of the aircraft. Lens 56 focuses light from viewable zone 46 so that image sensor 54 can capture image data of viewable zone 46. In some examples, the captured image data is stored in computer-readable memory 52.
As illustrated in
One or more processors 50 can determine various aspects of the captured image data including, brightness, contrast, color, and other image data properties. In one example, contrast is determined along an edge of a known object in the image data. The known object can be a wing, the fuselage, or other part of the aircraft that remains in viewable zone 46. Edge-detection can be used to find the known object. If edge-detection fails, one or more processors 50 can determine that the contrast of the image data is below a threshold. In one example, the contrast is an average contrast of the image data. One or more processors 50 can evaluate whether the contrast of the image data is below a threshold. In response to determining the contrast is below a threshold, one or more processors 50 can output an initiate heating command. The initiate heating command can be configured to initiate heating of camera window 44. The command signal can be received by heater control system 48, which will then initiate heating of camera window 44. In response to determining the contrast is above the threshold, one or more processors 50 can output a terminate heating command. The terminate heating command can be configured to terminate heating of camera window 44. The command signal can be received by heater control system 48, which will then terminate heating of camera window 44.
Computer-readable memory 52 can be configured to store information within exterior camera system 42 during operation. Computer-readable memory 52, in some examples, is described as a computer-readable storage medium. In some examples, a computer-readable storage medium can include a non-transitory medium. The term “non-transitory” can indicate that the storage medium is not embodied in a carrier wave or a propagated signal. In certain examples, a non-transitory storage medium can store data that can, over time, change (e.g., in RAM or cache). In some examples, computer-readable memory 52 is a temporary memory, meaning that a primary purpose of computer-readable memory 52 is not long-term storage. Computer-readable memory 52, in some examples, is described as a volatile memory, meaning that computer-readable memory 52 does not maintain stored contents when power to exterior camera system 42 is removed. Examples of volatile memories can include random access memories (RAM), dynamic random access memories (DRAM), static random access memories (SRAM), and other forms of volatile memories. In some examples, computer-readable memory 52 is used to store program instructions for execution by processors 50. Computer-readable memory 52, in certain examples, is used by software applications running on exterior camera system 42 to temporarily store information during program execution, such as determining a contrast of at least a portion of an image, or determining the contrast is below a contrast threshold.
Computer-readable memory 52, in some examples, also include one or more computer-readable storage media. Computer-readable memory 52 can be configured to store larger amounts of information than volatile memory. Computer-readable memory 52 can further be configured for long-term storage of information. In some examples, computer-readable memory 52 include non-volatile storage elements. Examples of non-volatile storage elements can include magnetic hard discs, optical discs, floppy discs, flash memories, or forms of electrically programmable memories (EPROM) or electrically erasable and programmable (EEPROM) memories.
Exterior camera system 42, as illustrated in
At step 60, image data is captured using image sensor 54. In some examples, the captured image data is be stored in computer-readable memory 52. The image data can be image data of a viewable zone of an exterior camera. The image data can include known objects, such as wings, fuselage, wheels, and other parts of an aircraft. At step 62, the contrast of at least a portion of the captured image data is determined using one or more processors 50. In one example, the contrast is determined along a known object in the image data. The known object can be a wing, the fuselage, or other part of the aircraft that remains in a viewable zone of the exterior camera. In one example, the contrast is determined by using an average contrast of the image data.
At step 64, the contrast is evaluated as to whether it satisfies criteria. In one example, the contrast evaluated as to whether it is less than a threshold contrast level using one or more processors 50. In one example, the threshold contrast level is a predetermined threshold contrast level. In a further example, the threshold contrast level is determined from image data captured when it is known there is nothing obscuring the camera window, such as ice or condensation. In a still further example, evaluating whether the contrast is less than a threshold contrast level includes comparing a second contrast determined at a point in time after an initiate heating command has been output to a third contrast determined after the second contrast, to determine if the third contrast is greater than the second contrast. If the contrast does not improve over time, it can be an indication that ice and condensation has been cleared, or ice and condensation are not causing the lack of contrast. If the contrast meets the criteria (i.e. is below the contrast level and/or the third contrast is greater than the second contrast), process 58 proceeds from step 64 to step 66. At step 66, an initiate heating command configured to initiate heating of camera window 44 is output. In some examples, the heating command is output to heater control system 48. Process 58 then returns to step 60. If the contrast fails to satisfy the criteria (i.e. is above the threshold and/or the third contrast is not greater than the second contrast), process 58 proceeds from step 64 to step 68. At step 68, a terminate heating command configured to terminate heating of camera window 44 is output. In some examples, the terminate heating command is output to heater control system 48. Process 58 then proceeds back to step 60.
Accordingly, implementing techniques of this disclosure, image optimization using an exterior camera system of an aircraft can determine when a camera window heater needs to be turned on. Using the exterior camera system described herein a window heater can be turned on and off based upon the contrast of image data captured by the camera system. This allows the window heater to only be turned on when needed, using less power and extending the operating life of affected components.
The following are non-exclusive descriptions of possible embodiments of the present invention.
An exterior camera system of an aircraft can comprise an image sensor configured to capture image data; and one or more processors can be configured to determine a first contrast of at least a portion of the captured image data; evaluate whether the first contrast is less than a threshold contrast level; and output, in response to the first contrast being less than the threshold contrast level, an initiate heating command configured to initiate heating of a camera window positioned between the image sensor and an exterior of the aircraft.
The exterior camera system of the preceding paragraph can optionally include, additionally and/or alternatively, any one or more of the following features, configurations and/or additional components:
The processor can be further configured to output, in response to the first contrast being greater than or equal to the threshold contrast level, a terminate heating command configured to terminate heating of the camera window.
The determined contrast can be a contrast along an edge of a known object within the captured image data.
Edge-detection can be used to determine and evaluate the first contrast along an edge of a known object within the captured image data.
The determined contrast can be an average contrast of the image data.
The one or more processors can be further configured to determine a second contrast of the at least a portion of the captured image data at point in time after the initiate heating command has been output; determine a third contrast of the at least a portion of the captured image data at point in time after the second contrast is determined; and evaluate whether the third contrast is greater than the second contrast.
The one or more processors can be further configured to output, in response to the third contrast being equal to the second contrast, a terminate heating command configured to terminate heating of the camera window.
The one or more processors can be further configured to output, in response to the third contrast being equal to the second contrast and the and the second contrast being above the contrast threshold level, a terminate heating command configured to terminate heating of the camera window.
The threshold level can be a predetermined threshold level.
The image sensor can be configured to capture image data of a viewable zone including a wheel and a fuselage of the aircraft.
A method can comprise capturing image data using an image sensor of an exterior camera system of an aircraft; determining, by one or more processors of the exterior camera system, a first contrast of at least a portion of the captured image data; evaluating, by the one or more processors, whether the first contrast is less than a threshold contrast level; and outputting, in response to determining that the first contrast is less than the threshold contrast level, an initiate heating command configured to initiate heating of a camera window positioned between the image sensor and an exterior of the aircraft.
The method of the preceding paragraph can optionally include, additionally and/or alternatively, any one or more of the following features, configurations and/or additional components:
Outputting, in response to the first contrast being greater than or equal to the threshold contrast level, a terminate heating command configured to terminate heating of the camera window.
The determined contrast can be a contrast along an edge of a known object within the captured image data.
Edge-detection can be used to determine and evaluate the first contrast along an edge of a known object within the captured image data.
The determined contrast can be an average contrast of the image data.
Determining a second contrast of the at least a portion of the captured image data at point in time after the initiate heating command has been output; determining a third contrast of the at least a portion of the captured image data at point in time after the second contrast is determined; and evaluating whether the third contrast is greater than the second contrast.
Outputting, in response to the third contrast being equal to the second contrast, a terminate heating command configured to terminate heating of the camera window.
Outputting, in response to the third contrast being equal to the second contrast and the third contrast being above the contrast threshold level, a terminate heating command configured to terminate heating of the camera window.
The threshold level can be a predetermined threshold level.
The heating command can be output to a heater control system.
While the invention has been described with reference to an exemplary embodiment(s), it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from the essential scope thereof. Therefore, it is intended that the invention not be limited to the particular embodiment(s) disclosed, but that the invention will include all embodiments falling within the scope of the appended claims.
