The present invention relates to a pan-tilt camera and to the quality of the captured image.
Digital pan-tilt cameras, hereinafter referred to as PT cameras, are often used in monitoring and surveillance applications and are therefore often required to capture images with high quality. The quality of the captured images from cameras becomes even more important when the cameras becomes more intelligent and therefore relies even more on that the quality of the images captured for processing in the camera is high.
There are quite many factors that have effect on the quality of an image captured by a digital camera. For example is the lighting of the scene to capture one such factor, less light results in less quality. Other factors are the quality of the lenses and the resolution of the image sensor. Yet another factor is noise from the image sensor of the digital camera. Even when using a High Definition (HD) image sensor having high resolution the acquired image may gain much quality from noise reduction.
In a modern CMOS based image sensor the light from the scene to capture is collected and transformed into an analog electrical signal. This analog electrical signal is converted into a digital signal by an on chip analog to digital converter. The alternative technology used to capture images is CCD image sensors. These CCD image sensors usually require a couple of external components in order to reach the same functionality as the CMOS image sensor. These components should be arranged physically close to the sensor in order not to degrade the image signal with noise. Moreover, an increased temperature of a CMOS sensor or a CCD sensor makes the images from the image sensor noisier. In order to reduce the noise of the captured images various noise reduction techniques are applied both to the analog signal and to the digital signal. In some critical installations the image sensor may even be cooled using a cooling system external to the image sensor.
It is an object of the present invention to provide an enhanced PT camera.
This object is achieved by means of a PT camera according to claim 1. Further embodiments of the invention are disclosed in the dependent claims.
In particular, according to a first aspect of the invention, a PT camera comprises a camera head, a stationary unit, an intermediate member arranged between the camera head and the stationary unit, a first rotary joint rotatably connecting the camera head to the intermediate member, a second rotary joint rotatably connecting the intermediate member to the stationary unit, a communication path between the camera head and the stationary unit, the communication path including an optical waveguide arranged between the camera head and the stationary unit, the optical waveguide having a first end and a second end, the first end being positioned at the first rotary joint and being arranged to receive light from the camera head through said first rotary joint, and the second end being positioned at the second rotary joint and being arranged to send light to the stationary unit through said second rotary joint. The PT camera is characterized by an image processing unit being arranged in the stationary unit, and by said image processing unit including a color interpolator arranged to perform a first color interpolation of the image data from the image sensor.
By arranging the image processing unit performing the first color interpolation of the image data from the image sensor in the stationary unit, at least one computing intense processing is removed from the camera head close to the image sensor. This type of computing intense processing requires a lot of current and thereby introduces a lot of heat and thereby increases the temperature of the surroundings of the image processing unit. Hence, the arrangement of said image processing unit in the stationary unit increases the captured image quality, because a high temperature heat source is removed from the vicinity of the image sensor.
Further, the introduction of the optical link and thereby making it feasible to arrange the processing unit for processing substantially unprocessed image data in the stationary unit also contribute to the increased image quality being achieved due to less heat generated in proximity to the image sensor. The optical link enables high speed communication and transmission of large amounts of data. Thereby it is possible to arrange the processing unit for processing the substantially unprocessed image data in the stationary unit at a distance from the image sensor.
Further, by arranging the image processing unit in the stationary unit fewer components is required in the camera head making the camera head weigh less and thereby making it easier to turn the camera head with precision. Additionally, the lesser weight makes it possible to use a smaller motor to operate the turning of the camera head. Moreover, less number of components requiring a lot of current and a smaller size motor makes it possible to provide power to the camera head using simpler means than in a camera head not implementing the invention, because the camera head will require less power.
In the context of the present invention the term up-link and downlink, respectively, are to be understood as specifying the direction of communication. The up-link direction specifies, in the present application, a direction from the camera head to the stationary unit and the down-link direction specifies, in the present application, a direction from the stationary unit to the camera head.
According to one embodiment the first rotary joint is arranged to turn around a first axis and the second rotary joint is arranged to turn around a second axis, and wherein the first axis and second axis are substantially perpendicular to each other.
According to yet another embodiment the optical waveguide is an optical fiber. In another embodiment the optical waveguide is molded.
In one embodiment the image processing unit is arranged to process raw image data in the stationary unit.
According to another embodiment the communication path further includes an up-link optical transmitter arranged to send light over the first rotary joint into the optical waveguide, and an up-link optical receiver arranged to receive light over the second rotary joint from the optical waveguide.
In another embodiment the communication path further includes a camera head optical waveguide arranged in the camera head and arranged to send light over the first rotary joint to the first end of the optical waveguide, and a stationary unit optical waveguide arranged in the stationary unit and arranged to receive light over the second rotary joint from the second end of the optical waveguide.
According to one embodiment said first end of the optical waveguide further is arranged to send light to the camera head through the first rotary joint, and said second end of the optical waveguide further is arranged to receive light from the stationary unit through said second rotary joint. This allows the PT camera to communicate over the optical communication path in both directions.
According to another embodiment the communication path further includes a down-link optical receiver arranged to receive light over the first rotary joint from the optical waveguide, and a down-link optical transmitter arranged to transmit light over the second rotary joint into the optical waveguide.
In one embodiment of the PT camera the image processing unit in the stationary unit further includes a noise reducer, in another embodiment it includes a color space converter, and in a further embodiment it includes an image compressor for compressing the image data. All of these features are functions requiring a lot of power and current. Therefore the arrangement of them in the stationary unit contributes to the increase of image quality due to exposing the image sensor to less heat.
In another embodiment the color interpolator is a Bayer pattern interpolator.
According to another embodiment the PT camera further includes an electrical motor arranged in the camera head and connected to the first rotary joint for turning of the camera head around the rotary axis of said first rotary joint. One advantage of arranging the motor in the camera head is that the production of the camera may be facilitated due to the fact that no electronics then has to be manufactured into the intermediate part and that the motor is mounted in the camera head where there have to be electronics installed any way. Moreover, the control signals to the motor may then be sent via the communication path to the camera head without having to return the signals via the joint between the camera head and the intermediate portion. Thereby the reliability of the device is increased as one point prone to failure is removed.
According to yet another embodiment the communication path further includes a lens arranged between the first end of the optical waveguide and the up-link optical transmitter.
In yet another embodiment the communication path further includes a lens arranged between the second end of the optical waveguide and the up-link optical receiver. It is beneficial to use a lens to be able to guide the light from the up-link optical transmitter or down-link optical receiver into the optical waveguide.
In yet another embodiment the PT camera further includes a down-link communication path including an electrical slip-ring arrangement between the intermediate member and the stationary unit.
In another embodiment the PT camera further includes a down-link communication path including a wireless transmitter arranged in the stationary unit for wireless transmission of data to the camera head, a wireless receiver arranged in the camera head for wireless receipt of the data from the stationary unit.
This and other aspects of the present invention will now be described in more detail, with reference to appended drawings showing embodiments of the invention. The figures should not be considered limiting the invention to the specific embodiment; instead they are used for explaining and understanding the invention. Like numbers refer to like elements throughout the figures.
a is a schematic side view of a camera unit according to one embodiment.
b is a schematic side view of the camera of
a is a schematic view of a first rotary joint, showing the optical coupling in that point.
b is a schematic view of a second rotary joint, showing the optical coupling in that point.
a is a schematic view of a first rotary joint, showing bidirectional optical coupling in that point.
b is a schematic view of a second rotary joint, showing bidirectional optical coupling in that point.
a is a schematic view of a camera head unit.
b is a schematic view of a stationary unit.
c is a schematic view of an image processing unit from the stationary unit depicted in
a is a schematic view of a camera head unit including an optical backchannel.
b is a schematic view of a stationary unit including an optical backchannel.
a is a perspective view of a camera unit comprising a camera head, intermediate member, panning unit and a stationary unit according to an alternative embodiment.
b is a schematic view of a two rotary joints, showing the optical coupling in each point for a camera unit according to
a is a schematic view of a camera head and an intermediate member showing one possible arrangement for a tilting motor of the PT camera.
b is a schematic view of a camera head and an intermediate member showing another possible arrangement for a tilting motor of the PT camera.
a is a schematic view of an optical coupling that may be used at the rotary joints.
b is a schematic view of another optical coupling that may be used at the rotary joints.
c is a schematic view of yet another optical coupling that may be used at the rotary joints.
a-b show schematic views of a camera unit 100 according to one embodiment of the invention. The camera unit 100 comprises a camera head 102, an intermediate member 104, and a stationary unit 106. The camera head 102 is attached to the intermediate member 104 by means of two joints 107, 108 enabling turning of the camera head 102 around a first axis 110, hereinafter referred to as a tilting axis 110. According to another embodiment the camera head 102 is attached to one joint 107 or 108 and is also turnable around the tilting axis 110. The intermediate member 104 is connected to the stationary unit 106 via yet another joint 112. The joint 112 between the intermediate member 104 and the stationary unit 106 is arranged to enable rotation around a second axis 114 of the intermediate member 104 in relation to the stationary unit 106 by multiple turns, thus enabling turning multiple 360 degree turns of the intermediate member 104 in relation to the stationary unit around the second axis 114, hereinafter referred to as panning axis 114.
An optical waveguide 116 is mounted to the intermediate member 104. The optical wave guide 116 having a first end 118 facing towards the camera head 102 at the joint 108 at the tilting axis 110 and a second end 120 facing towards the stationary unit 106 at the joint at the panning axis 114. The optical waveguide 116 may be an optical fiber of the type single mode fiber, gradient index fiber, plastic optical fiber or a similar waveguide. Alternatively, the optical waveguide 116 is molded as a separate part or it is molded onto or within the intermediate member 104.
By using an optical wave guide 116, problems relating to, for instance, many high-end PT cameras which have the ability to rotate n×360 degrees, especially in the rotational direction of panning, may be solved. Many, cameras designed for this purpose are prone to entangling cables for transmitting image signals, power, control signals etc., which are running from the camera head to stationary parts. Historically this problem has been solved generally by using a slip-ring joint for the transfer of electrical signals and power over the panning joint 112, and cables for the tilting joint 108, 107, limiting the rotation around the tilting axis 110, which due to other features of the camera assembly 100 normally is restricted to turning more than 180 degrees. The slip-ring joint, used for the panning rotation, enabled free rotation without restrictions of cables.
However, slip-ring joints supporting a plurality of channels and supporting high-frequency signals are in general expensive, heavy, and bulky and generate excessive heat in the camera. Hence, these slip-ring joints introduces technical problems in the camera construction, such as internal heat problems and the large size of the camera products resulting in, for example, the cameras being difficult to mount due to the weight and bulkiness of them.
To decrease the costs in low-end PT cameras the slip-ring in the panning joint 112 was often replaced by cables which were cleverly mounted through the mechanics. These cameras may not be rotated, i.e. panned or tilted, without mechanical restrictions, as the cables do not allow unlimited turning without breaking. Even if the number of degrees allowed for turning the camera was restricted, in order to avoid breaking, the cables were worn out due to repeated panning and tilting of the camera. In general, problems with wearing of the cables due to the rotation as well as the height needed for the cable-based joint increased with the number of cables in the joint. Accordingly, current PT cameras have either mechanical restrictions related to the panning rotation using cables or are expensive, heavy and bulky due to use of a slip-ring design for transfer of image signals, power, control signals etc between the stationary part and the pan- and tilt enabled camera head.
Yet another solution is to use optical communication by mounting a transmitter and receiver on either sides of the panning joint, see the published Japanese patent application 09-284612. These solutions have however not gained interest by the industry due to problems with the height and complexity of such product resulting from the fact that drive circuits and optical components have to be mounted in the intermediate part 104 of the camera assembly 100 arranged between the panning joint 112 and the tilting joint 107, 108.
These problems may be solved by arranging an optical wave guide 116 as previously described. Moreover there are several additional benefits in implementing a communication path in the PT camera 100 using optical wave guides 116 instead of for example wireless solutions. One of these benefits relates to cameras used in environments where security is important. In terms of security, the optical waveguide 116 does not emit any electromagnetic radiation which for example both wireless solutions such as WLAN and electrically wired systems do. In particular the wireless solution may be a security hazard as the communication may be accessed at quite a distance from the camera. Hence, the system operating with an optical waveguide 116 is safer against interfering signals and is able to prevent eavesdropping of the signal generated by the camera unit 100.
One benefit in relation to implementing the communication path by means of a slip ring or cables is that an optical wave guide between the camera head and the stationary unit and the sending light from the camera head into the optical waveguide through the rotary joint and the receiving light from the optical waveguide through the rotary joint at the stationary unit makes it possible to experience a decrease in the mechanical wear of operation critical components, e.g. the communication path, and at the same time make the camera smaller, lighter and less complex than previous PT cameras.
Another benefit is that an optical communication path 116 enables transmissions using a high bandwidth and thus larger quantities of data can be transferred over the optical communication path.
Once more referring to
In one preferred embodiment, see
The light used for communication in the up-link i.e. communication from the camera head 102 to the stationary unit 106 could interfere with the light communication in the down-link i.e. communication from the stationary unit 106 to the camera head 102. To avoid forward traveling light interfering with backward traveling light it is possible to use different frequencies, wavelengths, or colors for the up-link communication and down-link communication respectively. Using an optical fiber as optical wave guide 116 it is possible to guide the up-link communication in the core of the fiber and the down-link communication in the cladding of the fiber or vice versa.
As previously mentioned the optical coupling across any one of the joints 108 or 112 may be performed directly from the transmitter 122, 212 to the end 118, 120, of the optical waveguide 116 or/and directly from the end 118, 120, of the optical waveguide 116 to the receiver 124, 210. This configuration is shown in
In one embodiment enabling the optical coupling of
It is possible to implement the optical coupling like this because the communication link is very short, e.g. shorter than one meter, and does not introduce enough signal attenuation to be a problem. Hence, the optical coupling does not have to be perfect but may work properly even if some light is lost during the transfer.
According to another embodiment, see
In yet another embodiment the half reflecting mirror is replaced by a reflecting filter 134, see
Accordingly, the optical communication path may be used to transfer data from the image capturing camera head 102 to the stationary unit 106 but may also be used to transfer data from the stationary unit 106 to the camera head 102. Data from the camera head 102 to the stationary unit 106 may comprise image data, camera feedback, image statistics etc and may need a high speed link to meet the demands on high frame rates and megapixel video. The provision of a high bandwidth link between the camera head and the stationary unit 106 is even more advantageous in that it enables transmission of unprocessed, uncompressed or raw image data. Data to the camera head 102 from the stationary unit 106 may comprise data relating to mechanical settings for zoom, focus, and tilt, may comprise data relating to register settings and control signals to the image sensor, e.g. controlling the timing of an image sensor of the camera, and may be a low speed link due to the limited data amount transmitted in this direction.
a shows a schematic view of a camera head 102. The camera head 102 captures an image through a lens 302 and the image is then projected onto a sensor 304. The sensor 304 may be an image sensor of the type CCD, CMOS, etc. The received image in the sensor 304 is translated into an electrical signal and then fed into a processing device 306 which may have the main functionality of ND-converting the inputs from the sensor and to serialize the digital data into a serial data format. The serial data format is then fed into a transmitter driver 308 where the serial data is sent to the transmitter 122. The serial data format received in the transmitter 122 is converted into an optical signal and then emitted out from the transmitter 122 as light. The camera head may also include a control circuit 320 for a tilting motor 322 arranged in or at the camera head for turning the camera head in relation to the intermediate member 104. The control circuit 320 is arranged to control the speed and the rotational direction of the tilting motor 322 and thereby the turning of the camera head 102 in relation to the intermediate member 104 based on a control signal received from a pan tilt control means arranged either in the camera head 102 or in the stationary unit 106. The control circuit 320 may be arranged to control other properties as well, e.g. zoom, focus, etc.
In the embodiment of
b shows a schematic view of a stationary unit 106 according to one embodiment of the invention. The stationary unit 106 as illustrated in
The image processing unit 314 from
According to one embodiment the color interpolator 330 is a Bayer pattern interpolator which is arranged to interpolate a Bayer pattern image received from the image sensor 304. This interpolation may be performed by means of various demosaicing algorithms interpolating a set of red, green, and blue values for each pixel.
In one embodiment the image processing unit 314 includes a noise reducer arranged to reduce either spatial image noise, temporal image noise, or both.
The color adjuster 334, if included in the image processing unit 314, is arranged to adjust the color of the image and may for example be a function for adjusting the white balance of the image. The sharpening means 336 may be any device arranged to provide sharpening to an image, e.g. an “un-sharp mask” filter. The Color space converter 338 is arranged to convert the image data from one color space to another.
According to one embodiment the image processing unit 314 connected to the deserializer 312 is an Axis Real Time Picture EnCoder (ARTPEC) chip. The ARTPEC chip includes the functionality previously described and the functionality of performing such camera controller functions as managing the exposure, e.g. light level of image, and of video compression, arranged to compresses the digital image into an image containing less data for efficient transfer over the network.
The benefits of arranging the image processing unit 314 in the stationary unit are several. One benefit, as previously discussed is that an image processing unit 314 as the one described herein generate a lot of heat. This heat generation is a result of each of the above described functions/devices included in the image processing unit 314 being very computing intensive and when a plurality of them are implemented the computing intensity of the image processing unit becomes even higher. Further, many of the functions/devices require fast memory access to access older images or other recorded data. Therefore the image processing unit 314 requires a lot of electrical current which generated heat, the more current the more heat. In addition moving the image processing unit 314 less power is required in the camera head which in turn reduces the heat generated in the camera head. Hence yet another advantage of arranging the image processing unit 314 in the stationary unit 106 is that the resulting image quality from the camera is improved. This is so as a result of image sensors being sensitive to heat and generating thermal sensor noise when heated, the arrangement of the computing intensive image processing unit 314 in the stationary unit 106 reduces the amount of heat that the image sensor is exposed to and thereby the image quality of the images from the camera is evidently increased.
Additionally, using an optical communication path having a high bandwidth allows the captured image data to be sent substantially unprocessed over the communication path. This optical communication path makes it more feasible to have the processing carried out in the stationary unit 106. The optical components 122, 124, 210, 212 used in the communication path are small in size and this fact in combination with the fact that the image processing unit 314 is arranged in the stationary unit 106 instead for in the camera head 102 allows the camera to be smaller in size. Moreover, mechanical wearing, which are a problem when using electrical wiring as well as any wiring going through each of the joints, is eliminated with by the use of the optical information transfer through the pan and tilt joints respectively.
a shows a schematic view of a camera head 102 including an optical down-link. The up-link communication path is the same as the one described previously in connection with
b shows a schematic view of a stationary unit 106 including an optical down-link according to one embodiment of the invention. The signal that is to be sent to the camera head, for example to control the tilting motor or change the zoom of the camera, may be received at the camera system processing unit 315 from the Ethernet interface 316 where the output signal from the camera processing unit 315 is sent to a parallel-to-serial converter 412. The serial data format is fed into a transmitter driver 414 and the output from the transmitter driver 414 is fed into the optical transmitter 212 wherein the electrical signal is converted into a corresponding optical signal.
a shows a perspective view of an alternative embodiment of a camera unit 100 comprising a camera head 102, intermediate member 104 and a stationary unit 106. The difference compared to the previously described camera unit 100 lies in the communication path. The optical communication path is extended using an optical wave guide 502 in the camera head 102 as well as an optical wave guide 504 in the stationary unit 106. The optical coupling in the tilt joint 108 and the panning joint 112 will then differ from the ones previously described, as illustrated in
As mentioned above in connection with the
However, in some cameras, especially in the cameras where the main processing capacity has been positioned in the stationary unit 106, the amount of data required to be sent in the down link is low. This data mainly relates to tilting the camera head 102, zooming, and focusing, and to setting of parameters such as aperture and shutter speed. Accordingly, in those cases neither a high speed connection nor a high bandwidth connection is required. As the requirements on such a down-link path may be quite modest it may be possible to implement the down-link path by using a simple slip ring design at the joint 112 between the stationary unit 106 and the intermediate member 104 and at the joint 108 or 107 between the intermediate member 104 and the camera head 102. In another embodiment the down-link path between the intermediate member and the camera head may be implemented by means of a cable or cables.
According to another embodiment the down-link path is implemented as a wireless communication path between the stationary unit 106 and the camera head 102. This may be implemented by connecting a wireless transmitter to the circuitry of the stationary unit 106 and a wireless receiver to the circuitry of the camera head 102. The wireless transmitter and the wireless receiver may implementing any one of a plurality of wireless standards, e.g. a point to point coded radio link, Bluetooth, Wi-Fi (IEEE 802.11a,b,g,n), etc.
The tilting of the camera head may be performed by means of a motor 322 controlled by a control circuit 320 as described in connection with
In yet another alternative embodiment, see
In any of the above described embodiments it is necessary to provide power to electronic components and circuits in the camera head 102. As the stationary unit 106 is stationary, as its name suggests, power may easily be connected to the camera at the stationary unit. One way of transporting the power from the stationary unit to the camera head 102 is by arranging an electric slip ring for power transport between the stationary unit 106 and the intermediate member 104 and another electric slip ring for power transport between the intermediate part 104 and the camera head 102. These slip rings may be manufactured at quite low cost, because even simple design slip rings perform well in transporting power.
The slip ring between the intermediate member 104 and the camera head 102 may be substituted for a cable because most cameras are designed to enable turning of the camera head in relation to the intermediate part by less than 360 degrees, often about 180 degrees.
The person skilled in the art realizes that the present invention by no means is limited to the preferred embodiments described above. Many modifications and variations are possible within the scope of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
09173280.0 | Oct 2009 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP2010/064826 | 10/5/2010 | WO | 00 | 6/19/2012 |