Information
-
Patent Grant
-
6724423
-
Patent Number
6,724,423
-
Date Filed
Friday, June 21, 199628 years ago
-
Date Issued
Tuesday, April 20, 200420 years ago
-
Inventors
-
Original Assignees
-
Examiners
- Garber; Wendy R.
- Wilson; Jacqueline
Agents
- Frommer Lawrence & Haug LLP
- Frommer; William S.
- Polito; Bruno
-
CPC
-
US Classifications
Field of Search
US
- 348 2231
- 348 2251
- 348 2281
- 348 227
- 348 259
- 348 262
- 348 187
- 348 188
-
International Classifications
-
Abstract
A video camera system capable of matching colors between configured video cameras by effectively reducing color differences therebetween. A red, a green and a blue signal from imaging devices are amplified by preamplifiers and video amplifiers before being fed to a color matching circuit. The color matching circuit performs color matching in accordance with the levels of the red, green and blue signals using variables of gains and DC offset values. The gains and DC offset values are determined by the color matching circuit executing predetermined operation expressions. With a plurality of colors imaged in advance by the video cameras to be matched in color with a reference video camera, necessary coefficients of the operation expressions are obtained by use of the level measurements (tristimulus values) of the red, green and blue signals from an integrating circuit of each camera. Executing the operation expressions thus obtained allows the matching circuit to absorb the color differences between the reference video camera on the one hand, and the video camera to be matched in color therewith on the other hand.
Description
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a video camera and a video camera system. More particularly, the invention relates to a video camera and a video camera system capable of reducing color differences between the innovative video cameras that make up the system by adjusting their gains and DC offset values in keeping with the red, green and blue signals obtained through imaging operation.
2. Description of the Related Art
FIG. 9
is a schematic view outlining the constitution of a conventional video camera. In
FIG. 9
, a light source
1
illuminates an object
2
. The light coming from the object
2
through an imaging lens
3
enters an optical filter
4
such as a CC (color conversion) filter or ND (neutral density) filter, and an IR (infrared) cut filter
5
. Past the filter, the incident light is fed to a color separation prism
6
for separation into red, green and blue light components which are led to CCD solid state image sensing devices
7
R,
7
G and
7
B respectively. On the imaging planes of the image sensing devices
7
R,
7
G and
7
B, the red, green and blue images of the object
2
are focused for imaging. The image sensing devices
7
R,
7
G and
7
B output signals that are amplified by amplifiers
8
R,
8
G and
8
B respectively. The outputs from the amplifiers provide red, green and blue signals R, G and B as tristimulus values.
FIG. 10A
shows a typical spectral distribution characteristic I(λ) of the camera input integrating the reflectance ratio of the illuminated object
2
and other relevant factors.
FIG. 10B
graphically illustrates typical spectral distribution characteristics r(λ), g(λ) and b(λ) integrating the properties of the optical filter
4
, IR cut filter
5
, color separation prism
6
, and imaging devices
7
R,
7
G and
7
B. If the gains of the amplifiers
8
R,
8
G and
8
B are represented by A
r
, A
g
and A
b
, the tristimulus values R, G and B are given by the following equations (1):
R=A
r
∫I
(λ)
r
(λ)
dλ
G=A
g
∫I
(λ)
g
(λ)
dλ
B=A
b
∫I
(λ)
b
(λ)
dλ
(1)
Suppose that a plurality of video cameras constitute a video camera system. In this system, each of the tristimulus values R, G and B needs to be the same between the component video cameras so that the system may absorb color differences between the cameras for color matching.
Consider a case where two video cameras take pictures of the same object. For this setup, it is assumed that the spectral distribution of one of the video cameras is represented by r
1
(λ), g
1
(λ) and b
1
(λ), and that of the other video camera by r
2
(λ), g
2
(λ) and b
2
(λ). It is also assumed that the gains of the amplifiers
7
R,
7
G and
7
B in one video camera are designated by A
r1
, A
g1
, and A
b1
, respectively, and those of the corresponding amplifiers in the other video camera by A
r2
, A
g2
and A
b2
respectively. In that case, the tristimulus values R
1
, G
1
and B
1
of one video camera are given by the equations (2) below, and the tristimulus values R
2
, G
2
and B
2
Of the other video camera are expressed by the following equations (3):
R
1
=A
r1
∫I
(λ)
r
1
(λ)
dλ
G
1
=A
g1
∫I
(λ)
g
1
(λ)
dλ
B
1
=A
b1
∫I
(λ)
b
1
(λ)
dλ
(2)
R
2
=A
r2
∫I
(λ)
r
2
(λ)
dλ
G
2
=A
g2
∫I
(λ)
g
2
(λ)
dλ
B
2
=A
b2
∫I
(λ)
b
2
(λ)
dλ
(3)
To make the tristimulus values R
1
, G
1
and B
1
of one video camera match the corresponding tristimulus values R
2
, G
2
and B
2
Of the other video camera for color matching requires using at least three variables. In one example, the levels of the tristimulus values R
2
, G
2
and B
2
would be adjusted by use of six variables, i.e., gains G
r
, G
g
and G
b
, and DC offset values O
r
, O
g
and O
b
in the equations (4) below. The adjustments would provide tristimulus values R
2
′, G
2
′ and B
2
′ matching the tristimulus values R
1
, G
1
and B
1
.
R′
2
=G
r
R
2
+O
r
G′
2
=G
g
G
2
+O
g
B′
2
=G
b
B
2
+O
b
(4)
However, one disadvantage of conventional video cameras is that their gains and DC offset values (black level) are fixed. This makes it impossible to match the tristimulus values of a plurality video cameras constituting a video camera system; color differences between different video cameras within a system cannot be absorbed thereby for color matching.
OBJECT AND SUMMARY OF THE INVENTION
It is therefore an object of the present invention to provide a video camera and a video camera system capable of absorbing the color differences between a plurality of such video cameras making up the system in order to ensure appropriate color matching between the component cameras.
In carrying out the invention and according to one aspect thereof, there is provided a video camera comprising: level detecting means for detecting the levels of a red, a green and a blue signal obtained through imaging operation; and color matching means for adjusting the gains and/or the DC current offset values of the red, green and blue signals in accordance with those levels of the red, green and blue signals which are detected by the level detecting means.
According to another aspect of the invention, there is provided a video camera system comprising a plurality of video cameras and a controller. Each of the plurality of video cameras includes level detecting means for detecting the levels of a red, a green and a blue signal obtained through imaging operation; and color matching means for adjusting the gains and/or the DC current offset values of the red, green and blue signals. The controller controls the operation of the color matching means of the plurality of video cameras in accordance with those levels of the red, green and blue signals which are detected by the level detecting means.
The color matching means of each video camera adjusts the gains and/or DC offset values of the red, green and blue signals. Where a plurality of video cameras making up a video camera system acquire their respective red, green and blue signals through imaging operation, the gains and/or DC offset values of these red, green and blue signals are adjusted in accordance with the levels of the signals, whereby the color differences between the component video cameras within the system are absorbed.
Other objects, features and advantages of the present invention will become apparent in the following specification and accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1
is a schematic view of a video camera system practiced as one preferred embodiment of the invention;
FIG. 2
is a schematic flow diagram showing the circuit constitution of a video camera included in the embodiment;
FIG. 3
is a view of a two-dimensional display of color light;
FIG. 4
is a view of an rg chromaticity diagram;
FIG. 5
is a circuit diagram of a first circuit constitution example of the color matching circuit in the video camera;
FIG. 6
is a circuit diagram of a second circuit constitution example of the color matching circuit;
FIG. 7
is a circuit diagram of a third circuit constitution example of the color matching circuit;
FIG. 8
is a circuit diagram of a fourth circuit constitution example of the color matching circuit;
FIG. 9
is a schematic view outlining the constitution of the video camera; and
FIGS. 10A and 10B
are graphic representations illustrating the spectral distribution characteristics of the camera input and of the camera.
DESCRIPTION OF THE PREFERRED EMBODIMENT
The preferred embodiment of the invention will now be described with reference to the accompanying drawings.
FIG. 1
shows a video camera system
100
practiced as the preferred embodiment of the invention. The video camera system
100
comprises N video cameras
101
-1
through
101
-N
(N is an integer of at least 2) and a master setup unit (called the MSU hereunder)
102
acting as a controller. The video cameras
101
-1
through
101
-N
and the MSU
102
are interconnected by communication lines. The video cameras
101
-1
through
101
-N
are each equipped with a color matching circuit for adjusting the gains and DC offset values (black level) of the red, green and blue signals obtained through imaging operation.
The video cameras
101
-1
through
101
-N
supply the MSU
102
with level measurements Vr, Vg and Vb of the red, green and blue signals obtained through imaging operation of each video camera. The MSU
102
feeds each of the video cameras
101
-1
through
101
-N
with a plurality of color matching coefficients COE. The color matching coefficients COE are computed illustratively on the basis of the level measurements Vr, Vg and Vb taken by the configured video cameras
101
-1
through
101
-N
imaging a plurality of colors by use of a common color chart
103
such as Macbeth Color Checker™, as will be described later.
In the above constitution, the video camera system
100
executes color matching in the manner described below, illustratively so that the tristimulus values of the video cameras
101
-2
through
101
-N
will match those of the video camera
101
-1
.
That is, using the common color chart
103
, the video cameras
101
-1
through
101
-N
first image a plurality of colors. The MSU
102
computes the color matching coefficients COE to be used by the color matching circuits of the video cameras
101
-1
through
101
-N
in accordance with the level measurements Vr, Vg and Vb fed from each video camera.
The color matching coefficients COE supplied to the video camera
101
-1
are computed so that the gain for the red, green and blue signals to be adjusted by the color matching circuit will be 1 and their DC offset value will be 0. The color matching coefficients COE fed to the video cameras
101
-2
through
101
-N
are computed so as to provide necessary gains and DC offset values for the red, green and blue signals to be adjusted by the respective color matching circuits, such that the tristimulus values of the video cameras
101
-2
through
101
-N
match those of the video camera
101
-1
.
The color matching coefficients computed as described by the MSU
102
are supplied to and set for the color matching circuits of the video cameras
101
-1
through
101
-N
so that their red, green and blue signals are adjusted in gain and DC offset value. This provides color matching allowing the tristimulus values of the video cameras
101
-2
through
101
-N
to match those of the video camera
101
-1
.
FIG. 2
illustrates the circuit constitution of any one of the video cameras
101
-1
through
101
-N
. In
FIG. 2
, CCD solid state imaging devices
11
R,
11
G and
11
B output red, green and blue signals to preamplifiers
12
R,
12
G and
12
B respectively. The amplified outputs of the preamplifiers
12
R,
12
G and
12
B are fed to video amplifiers
13
R,
13
G and
13
B respectively. The video amplifiers
13
R,
13
G and
13
B cause the red, green and blue signals to match therebetween in terms of black and white levels.
The red, green and blue signals from the video amplifiers
13
R,
13
G and
13
B are converted to digital signals by A/D converters
14
R,
14
G and
14
B respectively. The digital signals are then fed to a horizontal/vertical contour enhancement signal generating circuit (called the detail circuit)
15
. The red, green and blue signals from the A/D converters
14
R,
14
G and
14
B are also sent to a series circuit made up of delay circuits
16
R and
17
R, to another series circuit composed of delay circuits
16
G and
17
G, and to another series circuit constituted by delay circuits
16
B and
17
B. The delay circuits
16
R,
16
G,
16
B,
17
R,
17
G and
17
B each provide a delay time corresponding to one horizontal period (
1
H).
The delay circuits
16
R,
16
G and
16
B output red, green and blue signals each delayed by one horizontal period, and the delay circuits
17
R,
17
G and
17
B output red, green and blue signals delayed by two horizontal periods each. These signals are fed to the detail circuit (contour enhancement signal generating circuit)
15
. Given the red, green and blue signals corresponding to three horizontal periods, the detail circuit
15
generates horizontal and vertical contour enhancement signals and adds these enhancement signals together to form a contour enhancement signal S
DTL
.
The red, green and blue signals output by the delay circuits
16
R,
16
G and
16
B and delayed by one horizontal period each are supplied to a color matching circuit
18
. The color matching circuit
18
also receives the color matching coefficient COE sent as described from the MSU
102
over a communication line by way of a CPU (central processing unit)
30
constituting part of the system controller. Given the signals and the coefficient, the color matching circuit
18
adjusts the gains and/or the DC offset values of the red, green and blue signals, as will be described later. The red, green and blue signals output by the color matching circuit
18
are sent to a linear matrix circuit
19
. The linear matrix circuit
19
electronically corrects any color reproduction error arising from the difference between the imaging characteristic of the color video camera and the ideal imaging characteristic of the NTSC format.
As will be described later, the contour enhancement signal S
DTL
is commonly added to the red, green and blue signals. Since it is irrelevant to colors, the signal S
DTL
is extracted upstream of the color matching circuit
18
of the embodiment. Carrying out in parallel both the extraction of the contour enhancement signal S
DTL
and the color matching with the color matching circuit
18
provides the benefit of reducing the overall delay amount.
The red, green and blue signals from the linear matrix circuit
19
are supplied respectively to adders
20
R,
20
G and
20
B whereby the contour enhancement signal S
DTL
is added to the signals. The signals thus supplemented are sent to knee circuits
21
R,
21
G and
21
B. The knee circuits
21
R,
21
G and
21
B compress the high-intensity components of the received signals so as to expand the apparent dynamic range. The red, green and blue signals output by the knee circuits
21
R,
21
G and
21
B are fed to gamma correction circuits
22
R,
22
G and
22
B wherein the signals are multiplied by the inverse function of the voltage-luminance characteristic of the image receiving tube in use. The red, green and blue signals thus multiplied are sent to a matrix circuit
23
.
The matrix circuit
23
subjects the red, green and blue signals to matrix processing so as to acquire a luminance signal, a red color difference signal and a blue color difference signal. The luminance signal, red color difference signal and blue color difference signal from the matrix circuit
23
are supplied to an encoder
24
. In turn, the encoder
24
carries out color modulation, attaching of a synchronous signal, and addition of luminance and color signals, thereby forming a color image signal SCV in the NTSC, PAL or other format. The color image signal SCV from the encoder
24
is converted by a D/A converter
25
to an analog signal that is led to an output terminal
26
. The luminance signal, red color difference signal and blue color difference signal are also converted by a parallel/serial converter
27
into serial video data that is sent to an output terminal
28
.
The red, green and blue signals from the delay circuits
16
R,
16
G and
16
B are fed to an integrating circuit
29
for integration whereby the level measurements Vr, Vg and Vb of the red, green and blue signals are obtained. The level measurements Vr, Vg and Vb from the integrating circuit
29
are sent via the CPU
30
to the MSU
102
over a communication line.
As mentioned in connection with the equations (4) above, the color matching circuit
18
adjusts the levels of the tristimulus values R, G and B using six variables, i.e., the gains G
r
, G
g
and G
b
, and the DC offset values O
r
, O
g
and O
b
. Although the spectral distribution of the imaging segment of the system could be measured in advance, it is practically impossible to measure the spectral distribution of the lighting and the object simultaneously during imaging in order to perform integral operations of the equations (2) and (3), before adjusting the variables in the equations (4) for color matching. A more practical method involves obtaining beforehand functional relations such as those of the equations (5) and (6) below, so that the variables consisting of the gains G
r
, G
g
and G
b
and of the DC offset values O
r
O
g
and O
b
are adjusted according to the tristimulus values R
2
, G
2
and B
2
. It should be noted that the tristimulus values do not correspond to the spectral distribution on a one-to-one basis; the method above provides only an approximation.
G
r
=f
gr
(
R
2
, G
2
, B
2
)
G
g
=f
gg
(
R
2
, G
2
, B
2
)
G
b
=f
gb
(
R
2
, G
2
, B
2
) (5)
O
r
=f
or
(
R
2
, G
2
, B
2
)
O
g
=f
og
(
R
2
, G
2
, B
2
)
O
b
=f
ob
(
R
2
, G
2
, B
2
) (6)
Suppose that the brightness of the camera input is multiplied by a factor of k for the equations (2) and (3). In that case, the spectral distribution of the camera input is given as kI(λ) . The tristimulus values R
1
′, G
1
′ and B
1
′ as well as R
2
′, G
2
′ and B
2
′ of each video camera are then expressed by the equations (7) and (8) below. That is, when brightness is multiplied by k, each of the tristimulus values is simply multiplied by k as well.
R
1
′=A
r1
∫kI
(λ)
r
1
(λ)
dλ=kR
1
G
1
′=A
g1
∫κI
(λ)
g
1
(λ)
dλ=kG
1
B
1
′=A
b1
∫κI
(λ)
b
1
(λ)
dλ=kB
1
(7)
R
2
′=A
r2
∫kI
(λ)
r
2
(λ)
dλ=kR
2
G
2
′=A
g2
∫kI
(λ)
g
2
(λ)
dλ=kG
2
B
2
′=A
b2
∫κI
(λ)
b
2
(λ)
dλ=kB
2
(8)
Thus if the terms of brightness are eliminated from parameters regarding the gains G
r
, G
g
and G
b
in the equations (5), it is possible to determine color matching variables using two parameters. However, simply obtaining the ratios (R/G, B/G, etc.) of the components making up the tristimulus value vector (R, G, B) is difficult to achieve. This is because the domain involved stretches from zero to infinity.
This embodiment envisages expressing the colors of the tristimulus values by use of the tristimulus value vector (R, G, B) and the coordinates (r, g, b) of a point of intersection with a plane R+G+B=1, as shown in FIG.
3
. If the length is not sufficient, an extension is used to find those coordinates (r, g, b) of an intersection point which are given by the following equations (9):
Since r+g+b=1, one parameter may be eliminated, and two parameters (r, g) may be used to express color. Such color representation is generally called rg chromaticity. As shown in
FIG. 4
, the R axis in the color space of the tristimulus values corresponds to (r, g)=(1, 0), the G axis to (r, g)=(0, 1), the B axis to (r, g)=(0, 0), and a black-and-white point W to (r, g)=(⅓, ⅓). It follows that the variables of the gains G
r
, G
g
and G
b
in the equations (4) can be determined using two parameters rand g, as shown in the following equations
G
r
=f
gr
(
r,g
)
G
g
=f
gg
(
r,g
)
G
b
=f
gb
(
r,b
) (10)
Below is a description of specific circuit constitution examples of the color matching circuit
18
and the color matching coefficients COE associated therewith. Consider first a case where the color matching circuit
18
performs the processing defined by the equations (11) below. The equations (11) have the gains G
r
, G
g
and G
b
expressed by linear equations of r and g, with the DC offset values O
r
, O
g
and O
b
regarded as zero. In this case, the error squared E
2
is given by the equation (12) below.
R
′=(
C
0
r+C
1
g+C
2
)
R
G
′=(
C
3
r+C
4
g+C
5
)
G
B
′=(
C
6
r+C
7
g+C
8
)
B
E
2
={R
′−(
C
0
r+C
1
g+C
2
)
R}
2
+{G
′−(
C
3
r+C
4
g+C
5
)
G}
2
+{B
′−(
C
6
r+C
7
g+C
8
)
B}
2
(12)
Coefficients C
0
through C
8
in the equations (11) above are acquired for each of the video cameras that need to be matched in color. Specifically, to obtain the coefficients requires measuring a plurality of combinations of the tristimulus values (R′, G′, B′) of the reference video camera and the tristimulus values (R, G, B) of the video cameras to be matched in color through imaging of a plurality of colors by use of the color chart
103
as described. The coefficients C
0
through C
8
thus obtained are such as to minimize the total sum (ΣE
2
) of the errors squared E
2
in the measurements. In this case, the equations (13) below must hold on the basis of the method of least squares. These partial differential equations are reduced to three sets of simultaneous linear equations (14) through (16) below with three unknowns each. Solving the equations (14) through (16) gives the coefficients C
0
through C
8
.
For this embodiment, it is assumed that the video camera
101
-1
is the reference video camera and that the video cameras
101
-2
through
101
-N
are the cameras to be matched in color with the reference video camera. The level measurements (Vr, Vg, Vb) output by the integrating circuit
29
of the video camera
101
-1
are regarded as the tristimulus values (R′, G′, B′) of the reference video camera, and the level measurements (Vr, Vg, Vb) output by the integrating circuit
29
in each of the video cameras
101
-2
through
101
-N
are taken as the tristimulus values (R, G, B) of the video cameras to be matched in color.
The CPU included in the MSU
102
(see
FIG. 1
) acquires the coefficients C
0
through C
8
by solving the three sets of simultaneous linear equations (14) through (16) above with three unknowns each. The coefficients C
0
through C
8
computed by the MSU
102
for the video cameras
101
-2
through
101
-N
are each supplied as the color matching coefficients COE to the color matching circuit
18
in each of the video cameras
101
-2
through
101
-N
. The reference video camera
101
-1
is fed both with 1 representing the coefficients C
2
, C
5
and C
8
, and with 0 denoting the other coefficients.
FIG. 5
is a circuit diagram of the first circuit constitution example of the color matching circuit
18
to which the equations (11) are applied. In
FIG. 5
, a register
201
retains the color coefficients COE (C
0
-C
8
) supplied from the MSU
102
past the CPU
30
(see
FIG. 2
) over a communication line.
The red signal R, green signal G and blue signal B from the delay circuits
16
R,
16
G and
16
B (see
FIG. 2
) are fed to an adder
202
for addition. The red signal R and the output signal (R+G+B) of the adder
202
are sent to a divider
203
r
which in turn generates a signal r. The green signal G and the output signal (R+G+B) of the adder
202
are supplied to a divider
203
g
which generates a signal g.
The signal r from the divider
203
r
is sent to multipliers
204
R,
204
G and
204
B whereby the coefficients C
0
, C
3
and C
6
from the register
201
are multiplied respectively. The signal g from the divider
203
g
is forwarded to multipliers
205
R,
205
G and
205
B whereby the coefficients C
1
, C
4
and C
7
from the register
201
are multiplied respectively.
The output signals of the multipliers
204
R and
205
R are fed to an adder
206
R for addition. The added result in the adder is supplemented by the coefficient C
2
from the register
201
, whereby the gain G
r
is obtained. The red signal R from the delay circuit
16
R is sent to a multiplier
207
R. The multiplier
207
R multiplies the red signal R by the gain G
r
from the adder
206
R, thereby producing an output red signal R′.
The output signals of the multipliers
204
G and
205
G are fed to an adder
206
G for addition. The added result in the adder is supplemented by the coefficient C
5
from the register
201
, whereby the gain G
g
is acquired. The green signal G from the delay circuit
16
G is sent to a multiplier
207
G. The multiplier
207
G multiplies the green signal G by the gain G
g
from the adder
206
G, thereby producing an output green signal G′.
In like manner, the output signals of the multipliers
204
B and
205
B are fed to an adder
206
B for addition. The added result in the adder is supplemented by the coefficient C
8
from the register
201
, whereby the gain G
b
is obtained. The blue signal B from the delay circuit
16
B is sent to a multiplier
207
B. The multiplier
207
G multiplies the blue signal B by the gain G
b
from the adder
206
B, thereby generating an output blue signal B′.
As described, the color matching circuit
18
of
FIG. 5
adjusts the gains of the red, green and blue signals through the processing defined by the equations (11). The adjustments allow the system to absorb the color differences of the video cameras
101
-2
through
101
-N
relative to the reference video camera
101
-1
in the color matching operation.
Consider next a case where the color matching circuit
18
performs the processing defined by the equations (17) below. The equations (17) regard the gains G
r
, G
g
and G
b
as 1 and have the DC offset values O
r
, O
g
and O
b
expressed by linear equations of R, G and B. It will be appreciated that the tristimulus values (R, G, B) can be used as described with respect to the DC offset values O
r
, O
g
and O
b
because of the need for brightness terms with three parameters. The coefficients C
3
, C
7
and C
11
maybe omitted because they are unnecessary as long as the proper black balance is maintained. As with the equations (12) and (13), it will be understood that the coefficients C
0
through C
11
for minimizing the errors involved using the method of least squares are obtained by solving three sets of simultaneous linear equations (18) through (20) below with four unknowns each.
R′=R+C
0
R+C
1
G+C
2
B+C
3
G′=G+C
4
G+C
5
R+C
6
B+C
7
B′=B+C
8
B+C
9
R+C
10
G+C
11
(17)
Where the coefficients C
3
, C
7
and C
11
are omitted, the equations (17) above are reduced to the equations (21) below. The coefficients C
0
through C
2
, coefficients C
4
through C
6
, and coefficients C
8
through C
10
are obtained respectively by solving three sets of simultaneous linear equations (22) through (24)
below with three unknowns each.
R′=R+C
0
R+C
1
G+C
2
B
G′=G+C
4
G+C
5
R+C
6
B
B′=B+C
8
B+C
9
R+C
10
G
(21)
It is the CPU in the MSU
102
(see
FIG. 1
) that solves either the three sets of simultaneous linear equations (18) through (20) with four unknowns each, to find the coefficients C
0
through C
11
, or the three sets of simultaneous linear equations (22) through (24) with three unknowns each, to obtain the coefficients C
0
through C
2
, C
4
through C
6
and C
8
through C
10
. Either the coefficients C
0
through C
11
, or the coefficients C
0
through C
2
, C
4
through C
6
and C
8
through C
10
, all computed by the MSU
102
for the video cameras
101
-2
through
101
-N
, are supplied as the color matching coefficients COE to the color matching circuit
18
in each of these video cameras. The reference video camera
101
-1
is fed with 0 representing either the coefficients C
0
through C
11
, or the coefficients C
0
through C
2
, C
4
through C
6
, and C
8
through C
10
.
FIG. 6
is a circuit diagram of the second circuit constitution example of the color matching circuit
18
to which the equations (17) are applied. In
FIG. 6
, a register
301
retains the color coefficients COE (C
0
-C
11
) supplied from the MSU
102
past the CPU
30
(see
FIG. 2
) over a communication line.
The red signal R, green signal G and blue signal B from the delay circuits
16
R,
16
G and
16
B (see
FIG. 2
) are sent to multipliers
302
R,
303
R and
304
R respectively. The multipliers
302
R,
303
R and
304
R multiply the red signal R, green signal G and blue signal B respectively by the coefficients C
0
, C
1
and C
2
from the register
301
. The output signals of the multipliers
302
R,
303
R an
304
R are fed to an adder
305
R for addition. The added result in the adder is supplemented by the coefficient C
3
from the register
301
, whereby the DC offset value O
r
is obtained. The adder
305
R is further supplied with the red signal R from the delay circuit
16
R. Adding the DC offset value O
r
to the red signal R generates an output red signal R′.
The green signal G, red signal R and blue signal B from the delay circuits
16
G,
16
R and
16
B are sent to multipliers
302
G,
303
G and
304
G respectively. The multipliers
302
G,
303
G and
304
G multiply the green signal G, red signal R and blue signal B respectively by the coefficients C
4
, C
5
and C
6
from the register
301
. The output signals of the multipliers
302
G,
303
G an
304
G are fed to an adder
305
G for addition. The added result in the adder is supplemented by the coefficient C
7
from the register
301
, whereby the DC offset value O
g
is acquired. The adder
305
G is further supplied with the green signal G from the delay circuit
16
G. Adding the DC offset value O
g
to the green signal G generates an output green signal G′.
The blue signal B, red signal R and green signal G from the delay circuits
16
B,
16
R and
16
G are transferred to multipliers
302
B,
303
B and
304
B respectively. The multipliers
302
B,
303
B and
304
B multiply the blue signal B, red signal R and green signal G respectively by the coefficients C
8
, C
9
and C
10
from the register
301
. The output signals of the multipliers
302
B,
303
B an
304
B are fed to an adder
305
B for addition. The added result in the adder is supplemented by the coefficient C
11
from the register
301
, where by the DC offset value O
b
is obtained. The adder
305
B is further supplied with the blue signal B from the delay circuit
16
B. Adding the DC offset value O
b
to the blue signal B produces an output blue signal B′.
As described, the color matching circuit
18
of
FIG. 6
adjusts the DC offset values of the red, green and blue signals through the processing defined by the equations (17). The adjustments allow the system to absorb the color differences of the video cameras
101
-2
through
101
-N
relative to the reference video camera
101
-1
in the color matching operation.
A variation of the above-described circuit constitution example is one to which the equations (21) are applied with the coefficients C
3
, C
7
and C
11
omitted. This variation of the color matching circuit
18
, not shown, is commensurate with the setup of
FIG. 6
minus the components associated with the coefficients C
3
, C
7
and C
11
.
Consider a case where the processing defined by the equations (25) below is carried out by the color matching circuit
18
. The equations (25) are made up of linear equations of r and g expressing the gains G
r
, G
g
and G
b
as well as linear equations of R, G and B representing the DC offset values O
r
, O
g
and O
b
. These equations are expected to permit flexible color matching. As with the foregoing equations (12) and (13), where the method of least squares is adopted, the coefficients C
0
through C
5
are obtained by solving the simultaneous linear equations (26) below with six unknowns. When R is replaced by G and G by R in the equations (26), the equations become those to be solved to find the coefficients C
6
through C
11
. When R is replaced by B, G by R and B by G in the equations (26), the equations become those to be solved to find the coefficients C
12
through C
17
.
R
′=(
C
0
r+C
1
g+C
2
)
R
+(
C
3
G+C
4
B+C
5
)
G
′=(
C
6
r+C
7
g+C
8
)
G
+(
C
9
R+C
10
B+C
11
)
B
′=(
C
12
r+C
13
g+C
14
)
B
+(
C
15
R+C
16
G+C
17
) (25)
The coefficients C
5
, C
11
and C
17
maybe omitted as long as the proper black balance is maintained. In such a case, the equations (25) above are reduced to the equations (27) shown below. Where the method of least squares is adopted, the coefficients C
0
through C
4
are obtained by solving the simultaneous linear equations (28) below with five unknowns. When R is replaced by G and G by R in the equations (28), the equations become those to be solved to find the coefficients C
6
through C
10
. When R is replaced by B, G by R and B by G, the equations (28) become those to be solved to acquire the coefficients C
12
through C
16
.
R
′=(
C
0
r+C
1
g+C
2
)
R
+(
C
3
G+C
4
B
)
G
′=(
C
6
r+C
7
g+C
8
)
G
+(
C
9
R+C
10
B
)
B
′=(
C
12
r+C
13
g+C
14
)
B
+(
C
15
R+C
16
G
) (27)
It is the CPU in the MSU
102
(see
FIG. 1
) that solves either the three sets of simultaneous linear equations with six unknowns each, to find the coefficients C
0
through C
17
, or the three sets of simultaneous linear equations with five unknowns each, to obtain the coefficients C
0
through C
4
, C
6
through C
10
and C
12
through C
16
. Either the coefficients C
0
through C
17
, or the coefficients C
0
through C
4
, C
6
through C
10
and C
12
through C
16
, all computed by the MSU
102
for the video cameras
101
-2
through
101
-N
, are supplied as the color matching coefficients COE to the color matching circuit
18
in each of these video cameras. The reference video camera
101
-1
is fed with 1 representing the coefficients C
2
, C
8
and C
14
, and with 0 denoting the other coefficients.
FIG. 7
is a circuit diagram of the third circuit constitution example of the color matching circuit
18
to which the equations (25) are applied. In
FIG. 7
, a register
401
retains the color coefficients COE (C
0
-C
17
) supplied from the MSU
102
past the CPU
30
(see
FIG. 2
) over a communication line.
The red signal R, green signal G and blue signal B from the delay circuits
16
R,
16
G and
16
B (see
FIG. 2
) are sent to an adder
402
for addition. The red signal R and the output signal of the adder
402
(R+G+B) are fed to a divider
403
r
whereby a signal r is obtained. The green signal G and the output signal of the adder
402
(R+G+B) are supplied to a divider
403
g
whereby a signal g is acquired.
The signal r from the divider
403
r
is transferred to multipliers
404
R,
404
G and
404
B which multiply respectively the coefficients C
0
, C
6
and C
12
from the register
401
by the received signal r. The signal g from the divider
403
g
is fed to multipliers
405
R,
405
G and
405
B which multiply respectively the coefficients C
1
, C
7
and C
13
from the register
401
by the received signal g.
The output signals of the multipliers
404
R and
405
R are sent to an adder
406
R for addition. The added result in the adder is supplemented by the coefficient C
2
from the register
401
, whereby the gain G
r
is obtained. The red signal R from the delay circuit
16
R is added to a multiplier
407
R which multiplies the received signal R by the gain G
r
from the adder
406
R. The output signal of the multiplier
407
R is supplied to an adder
408
R.
The green signal G and blue signal B from the delay circuits
16
G and
16
B are sent respectively to multipliers
409
R and
410
R. The multipliers
409
R and
410
R multiply the received green and blue signals G and B respectively by the coefficients C
3
and C
4
from the register
401
. The output signals of the multipliers
409
R and
410
R are forwarded to the adder
408
R for addition. The added result in the adder is supplemented by the coefficient C
5
from the register
401
, whereby the DC offset value O
r
is acquired. The adder
408
R further adds the DC offset value O
r
to the signal from the multiplier
407
R (R×Gr), thus generating an output red signal R′.
The output signals of the multipliers
404
G and
405
G are supplied to an adder
406
G for addition. The added result in the adder is supplemented by the coefficient C
8
from the register
401
, whereby the gain G
g
is obtained. The green signal R from the delay circuit
16
G is added to a multiplier
407
G which multiplies the received signal G by the gain Gg from the adder
406
G. The output signal of the multiplier
407
G is sent to an adder
408
G.
The red signal R and blue signal B from the delay circuits
16
R and
16
B are fed respectively to multipliers
409
G and
410
G. The multipliers.
409
G and
410
G multiply the received red and blue signals R and B respectively by the coefficients C
9
and C
10
from the register
401
. The output signals of the multipliers
409
G and
410
G are transferred to the adder
408
G for addition. The added result in the adder is supplemented by the coefficient C
11
from the register
401
, whereby the DC offset value O
g
is obtained. The adder
408
G further adds the DC offset value O
g
to the signal from the multiplier
407
G (G×Gg), thus generating an output green signal G′.
The output signals of the multipliers
404
B and
405
B are sent to an adder
406
B for addition. The added result in the adder is supplemented by the coefficient C
14
from the register
401
, whereby the gain Gb is obtained. The blue signal B from the delay circuit
16
B is added to a multiplier
407
B which multiplies the received signal B by the gain Gb from the adder
406
B. The output signal of the multiplier
407
B is sent to an adder
408
B.
The red signal R and green signal B from the delay circuits
16
R and
16
G are supplied respectively to multipliers
409
B and
410
B. The multipliers
409
B and
410
B multiply the received red and green signals R and G respectively by the coefficients C
15
and C
16
from the register
401
. The output signals of the multipliers
409
B and
410
B are sent to the adder
408
B for addition. The added result in the adder is supplemented by the coefficient C
17
from the register
401
, whereby the DC offset value O
b
is obtained. The adder
408
B further adds the DC offset value O
b
to the signal from the multiplier
407
B (B×Gr), thus generating an output blue signal B′.
As described, the color matching circuit
18
of
FIG. 7
adjusts the gains and DC offset values of the red, green and blue signals through the processing defined by the equations (25) above. The adjustments allow the system to absorb the color differences of the video cameras
101
-2
through
101
-N
relative to the reference video camera
101
-1
in the color matching operation.
The linear matrix circuit
19
performs the processing defined by the equation (29) below involving six coefficients a through f. The processing, which has not been discussed so far, is intended to compensate any negative portions in the ideal spectral imaging characteristics of the NTSC format by reducing the remaining portions of the tristimulus values. That is, a colorless object being imaged leaves the tristimulus values unchanged. The equation (29) represents a functional relation wherein the gains G
r
, G
g
and G
b
are represented by 1 and the DC offset values O
r
, O
g
and O
b
are expressed by linear equations of color differences. In the equation (29), R
i
, G
i
and B
i
stand for the tristimulus values of the input, and R
0
, G
0
and B
0
denote the tristimulus values of the output.
Consider next a case where the color matching circuit
18
performs the processing defined by the equations (30) below, i.e., the processing equal to that carried out by the linear matrix circuit
19
. Specifically, the equations (30) have the gains G
r
, G
g
and G
b
represented by 1 and have the DC offset values O
r
, O
g
and O
b
expressed by linear equations of color differences. The equations (30) are formulated by setting the relations (31) below in the equations (17) shown earlier. With the equations (30) in effect, a colorless object being imaged leaves the tristimulus values unchanged.
R′=R+C
0
(
R−G
)+
C
1
(
R−B
)
G′=G+C
2
(
G−R
)+
C
3
(
G−B
)
B′=B+C
4
(
B−R
)+
C
5
(
B−G
) (30)
C
0
+C
1
+C
2
=0
, C
3
=0
C
4
+C
5
+C
6
=0
, C
7
=0
C
8
+C
9
+C
10
=0
, C
11
=0 (31)
Where the method of least squares is applied, the coefficients C
0
and C
1
are obtained by solving the simultaneous equations (32) below. When R is replaced by G and G by R in the equations (32), the equations become those to be solved to find the coefficients C
2
and C
3
. When R is replaced by B, G by R and B by G in the equations (32), the equations become those to be solved to obtain the coefficients C
4
and C
5
.
Suppose that the six coefficients C
0
through C
5
in the equations (30) are varied with the tristimulus values R, G and B. In that case, only two parameters are needed because it is color difference gains that are to be changed. In this respect, the embodiment of the invention envisages using the equation (33) below involving two parameters (r, g).
R′=R
+(
C
0
r+C
1
g+C
2
) (
R−G
)+(
C
3
r+C
4
g+C
5
) (
R−B)
G′=G
+(
C
6
r+C
7
g+C
8
) (
G−R
)+(
C
9
r+C
10
g+C
11
) (
G−B)
B′=B
+(
C
12
r+C
13
g+C
14
) (
B−R
)+(
C
15
r+C
16
g+C
17
) (
B−G
) (33)
Where the method of least squares is applied on the basis of the equations (33) above, the coefficients C
0
through C
5
are acquired by solving the simultaneous equations (34) below. When R is replaced by G and G by R in the equations (34), the equations become those to be solved to find the coefficients C
6
through C
11
. When R is replaced by B, G by R and B by G in the equations (34), the equations become those to be solved to obtain the coefficients C
12
through C
17
.
Σ
r
2
(
R−G
)
2
C
0
+Σrg
(
R−G
)
2
C
1
+Σr
(
R−G
)
2
C
2
+Σr
2
(
R−G
)(
R−B
)
C
3
+Σrg
(
R−G
)(
R−B
)
C
4
+Σr
(
R−G
)(
R−B
)
C
5
=Σr
(
R−G
)(
R′−R
)
Σrg
(
R−G
)
2
C
0
+Σg
2
(
R−G
)
2
C
1
+Σg
(
R−G
)
2
C
2
+Σrg
(
R−G
)(
R−B
)
C
3
+Σg
2
(
R−G
)(
R−B
)
C
4
+Σg
(
R−G
)(
R−B
)
C
5
=Σg
(
R−G
)(
R′−R
)
Σr
(
R−G
)
2
C
0
+Σg
(
R−G
)
2
C
1
+Σ(
R−G
)
2
C
2
+Σr
(
R−G
)(
R−B
)
C
3
+Σg
(
R−G
)(
R−B
)
C
4
+Σ(
R−G
)(
R−B
)
C
5
=Σ(
R−G
)(
R′−R
)
Σr
2
(
R−G
)(
R−B
)
C
0
+Σrg
(
R−G
)(
R−B
)
C
1
+Σr
(
R−G
)(
R−B
)
C
2
+Σr
2
(
R−B
)
2
C
3
+Σrg
(
R−B
)
2
C
4
+Σr
(
R−B
)
2
C
5
=Σr
(
R−B
)(
R′−R
)
Σrg
(
R−G
)(
R−B
)
C
0
+Σg
2
(
R−G
)(
R−B
)
C
1
+Σg
(
R−G
)(
R−B
)
C
2
+Σrg
(
R−B
)
C
3
+Σg
2
(
R−B
)
2
C
4
+Σg
(
R−B
)
2
C
5
=Σg
(
R−B
)(
R′−R
)
Σr
(
R−G
)(
R−B
)
C
0
+Σg
(
R−G
)(
R−B
)
C
1
+Σ(
R−G
)(
R−B
)
C
2
+Σr
(
R−B
)
2
C
3
+Σg
(
R−B
)
2
C
4
+Σ(
R−B
)
2
C
5
=Σ(
R−B
)(
R′−R
) (34)
Although the equations (33) above need 18 coefficients C
0
through C
17
as described, the number of coefficients may be reduced to 15. In order to explain why the number of coefficients may be reduced, reference is made to equations (35) and (36) in which D
0
, D
1
. . . D
5
denote an alternative set of coefficients. It will be appreciated that the equation (35) below holds even if C
0
≠D
0
as long as the equations (36) below hold. Thus if D
0
=0, then one coefficient can be omitted. In like manner, one of the coefficients C
0
through C
5
, another out of C
6
through C
11
and yet another out of C
12
through C
17
can be omitted, which leaves 15 coefficients. This reduces the equations (33) above to the equations (37) below.
(
C
0
r+C
1
g+C
2
)(
R−G
)+(
C
3
r+C
4
g+C
5
)(
R−B
)=(
D
0
r+D
1
g+D
2
)(
R−G
)+(
D
3
r+D
4
g+D
5
)(
R−B
) (35)
R′=R
+(
C′
0
r+C′
1
g+C′
2
)(
R−G
)+(
C′
3
r+C′
4
g
)(
R−B
)
G′=G
+(
C′
5
r+C′
6
g+C′
7
)(
G−R
)+(
C′
8
r+C′
9
)(
G−B
)
B′=B
+(
C′
10
r+C′
11
g+C′
12
)(
B−R
)+(
C′
13
r+C′
14
)(
B−G
)
C′
0
=C
0
−2
C
4
, C′
1
=C
1
−C
4
, C′
2
=C
2
+C
4
, C′
3
=C
3
+C
4
, C′
4
=C
5
C′
5
=C
6
+C
10
, C′
6
=C
7
+2
C
10
, C′
7
=C
8
−C
10
, C′
8
=C
9
+C
10
, C′
9
=C
11
C′
10
=C
12
+C
16
, C′
11
=C
13
+2
C
16
, C′
12
=C
14
−C
16
, C′
13
=C
15
−2
C
16
, C′
14
=C
17
+C
16
(37)
Where the method of least squares is applied on the basis of the equations (37) above, the coefficients C
0
′ through C
4
′ are obtained by solving the simultaneous equations (38) shown below. When R is replaced by G and G by R in the equations (38), the equations become those to be solved to find the coefficients C
5
′ through C
9
′. When R is replaced by B, G by R and B by G in the equations (38), the equations become those to be solved to acquire the coefficients C
10
′ through C
14
′. ti
Σr
2
(
R−G
)
2
C′
0
+Σrg
(
R−G
)
2
C′
1
+Σr
(
R−G
)
2
C′
2
+Σr
2
(
R−G
)(
R−B
)
C′
3
+Σr
(
R−G
)(
R−B
)
C′
4
=Σr
(
R−G
)(
R′−R
)
Σ
rg
(
R−G
)
2
C′
0
+Σg
2
(
R−G
)
2
C′
1
+Σg
(
R−G
)
2
C′
2
+Σrg
(
R−G
)(
R−B
)
C′
3
+Σg
(
R−G
)(
R−B
)
C′
4
=Σg
(
R−G
)(
R′−R
)
Σ
r
(
R−G
)
2
C′
0
+Σg
(
R−G
)
2
C′
1
+Σ(
R−G
)
2
C′
2
+Σr
(
R−G
)(
R−B
)
C′
3
+Σ(
R−G
)(
R−B
)
C′
4
=Σ(
R−G
)(
R′−R
)
Σ
r
2
(
R−G
)(
R−B
)
C′
0
+Σrg
(
R−G
)(
R−B
)
C′
1
+Σr
(
R−G
)(
R−B
)
C′
2
+Σr
2
(
R−B
)
2
C′
3
+Σ
r
(
R−B
)
2
C′
4
=Σr
(
R−B
)(
R′−R
)
Σ
r
(
R−G
)(
R−B
)
C′
0
+Σg
(
R−G
)(
R−B
)
C′
1
+Σ(
R−G
)(
R−B
)
C′
2
+Σr
(
R−B
)
2
C′
3
+Σ(
R−B
)
2
C′
4
=Σ(
R−B
)(
R′−R
) (38)
FIG. 8
is a circuit diagram of the fourth circuit constitution example of the color matching circuit
18
to which the equations (37) above are applied. In
FIG. 8
, a register
501
retains the color coefficients COE (C
0
′-C
14
′) supplied from the MSU
102
past the CPU
30
(see
FIG. 2
) over a communication line.
The red signal R, green signal G and blue signal B from the delay circuits
16
R,
16
G and
16
B (see
FIG. 2
) are sent to an adder
502
for addition. The red signal R and the output signal of the adder
502
(R+G+B) are fed to adivider
503
r
whereby a signal r is obtained. The green signal G and the output signal of the adder
502
(R+G+B) are supplied to a divider
503
g
whereby a signal g is acquired.
The signal r from the divider
503
r
is transferred to a multiplier
504
R which multiplies the received signal by the coefficient C
0
′ from the register
501
. The signal g from the divider
503
g
is forwarded to a multiplier
505
R which multiplies the received signal by the coefficient C
1
′ from the register
501
. The output signals of the multipliers
504
R and
505
R are fed to an adder
506
R for addition. The added result in the adder is supplemented by the coefficient C
2
′ from the register
501
.
The red signal R and green signal G from the delay circuits
16
R and
16
G are supplied to a subtracter
507
R for subtraction. The output signal of the subtracter
507
R (R−G) and the output signal of the adder
506
R (C
0
′
r
+C
1
′g+C
2
′) are sent to a multiplier
508
R for multiplication. The output signal of the multiplier
508
R is sent to an adder
509
R.
The signal r from the divider
503
r
is supplied to a multiplier
510
R which multiplies the received signal by the coefficient C
3
′ from the register
501
. An adder
511
R adds up the output signal of the multiplier
510
R and the coefficient C
4
′ from the register
501
. The red signal R and blue signal B from the delay circuits
16
R and
16
B are fed to a subtracter
512
R for subtraction. The output signal of the subtracter
512
R (R−B) and the output signal of the adder
511
R (C
3
′r+C
4
′) are sent to a multiplier
513
R for multiplication. The output signal of the multiplier
513
R is transferred to the adder
509
R.
The adder
509
R adds up the output signals of the multipliers
508
R and
513
R, thus generating the DC offset value O
r
. The adder
509
R further adds the DC offset value O
r
to the red signal R from the delay circuit
16
R to produce an output red signal R′.
The signal r from the divider
503
r
is fed to a multiplier
504
G which multiplies the received signal by the coefficient C
5
′ from the register
501
. The signal g from the divider
503
g
is supplied to a multiplier
505
G which multiplies the received signal by the coefficient C
6
′ from the register
501
. The output signals of the multipliers
504
G and
505
G are sent to an adder
506
G for addition. The added result in the adder is supplemented by the coefficient C
7
′ from the register
501
.
The green signal G and red signal R from the delay circuits
16
G and
16
R are transferred to a subtracter
507
G for subtraction. The output signal of the subtracter
507
G (G−R) and the output signal of the adder
506
G (C
5
′r+C
6
′g+C
7
′) are supplied to a multiplier
508
G for multiplication. The output signal of the multiplier
508
G is forwarded to an adder
509
G.
The signal r from the divider
503
r
is sent to a multiplier
510
G which multiplies the received signal by the coefficient C
8
′ from the register
501
. An adder
511
G adds up the output signal of the multiplier
510
G and the coefficient C
9
′ from the register
501
. The green signal G and blue signal B from the delay circuits
16
G and
16
B are transferred to a subtracter
512
G for subtraction. The output signal of the subtracter
512
G (G−B) and the output signal of the adder
511
G (C
8
′r+C
9
′) are forwarded to a multiplier
513
G for multiplication. The output signal of the multiplier
513
G is fed to the adder
509
G.
The adder
509
G adds up the output signals of the multipliers
508
G and
513
G to produce the DC offset value O
g
. Furthermore, the adder
509
G adds the DC offset value O
g
to the green signal G from the delay circuit
16
G to generate an output green signal G′.
The signal r from the divider
503
r
is also sent to a multiplier
504
B which multiplies the received signal by the coefficient C
10
′ from the register
501
. The signal g from the divider
503
g
is supplied to a multiplier
505
B which multiplies the received signal by the coefficient C
11
′ from the register
501
. The output signals of the multipliers
504
B and
505
B are fed to an adder
506
B for addition. The added result in the adder is supplemented by the coefficient C
12
′ from the register
501
.
The blue signal B and red signal R from the delay circuits
16
B and
16
R are transferred to a subtracter
507
B for subtraction. The output signal of the subtracter
507
B (B−R) and the output signal of the adder
506
B (C
10
′r+C
11
′g+C
12
′) are forwarded to a multiplier
508
B for multiplication. The output o the multiplier
508
B is fed to an adder
509
B.
The signal r from the divider
503
r
is also supplied to a multiplier
510
B which multiplies the received signal by the coefficient C
13
′ from the register
501
. An adder
511
B adds up the output signal of the multiplier
510
B and the coefficient C
14
′ from the register
501
. The blue signal B and green signal G from the delay circuits
16
B and
16
G are sent to a subtracter
512
B for subtraction. The output signal of the subtracter
512
B (B−G) and the output signal of the adder
511
B (C
13
′r+C
14
′) are fed to a multiplier
513
B for multiplication. The output signal of the multiplier
513
B is supplied to the adder
509
B.
The adder
509
B adds up the output signals of the multipliers
508
B and
513
B to generate the DC offset value O
b
. Furthermore, the adder
509
B adds the DC offset value O
b
to the blue signal B from the delay circuit
16
B to produce an output blue signal B′.
As described, the color matching circuit
18
of
FIG. 8
adjusts the DC offset values of the red, green and blue signals through the processing defined by the equations (37) above. The adjustments allow the system to absorb the color differences of the video cameras
101
-2
through
101
-N
relative to the reference video camera
101
-1
in the color matching operation.
The embodiment of the invention thus uses the color matching circuit
18
to adjust the gains and DC offset values of the red, green and blue signals obtained from imaging operation in accordance with the levels of these signals. The color matching operation permits effective absorption of color differences between the different video cameras
101
-1
through
101
-N
constituting the video camera system.
Although the embodiment above computes errors with no weight placed on the measurements of the respective colors, this is not limitative of the invention. Alternatively, the measured value of each color may be weighted in the following manner. Suppose that R
i
′, G
i
′ and B
i
′ represent the tristimulus values of the reference video camera in effect when the camera images an i-th color, that R
i
, G
i
and B
i
denote the tristimulus values of the video cameras to be matched in color relative to the reference video camera, and that W
i
stands for the weight of the error regarding the i-th color. In that case, the total sum of errors squared is given by the equation (39) below.
If the above error equation is applied to the equations (38), the coefficients C
0
′ through C
4
′ for minimizing the error are obtained by solving the simultaneous equations (40) shown below. When R is replaced by G and G by R in the simultaneous equations (40), the equations become those to be solved to find the coefficients C
5
′ through C
9
′. When R is replaced by B, G by R and B by G in the simultaneous equations (40), the equations become those to be solved to obtain the coefficients C
10
′ through C
14
′. That is, the terms in the simultaneous equations are each multiplied by the weight W
i
before being added up. The same applies to the equations (14) through (16), (18) through (20), (26), (28), (32) and (34).
In the above-described embodiment, the linear matrix circuit
19
is connected downstream of the color matching circuit
18
for absorbing color differences between different video cameras configured, the linear matrix circuit
19
compensating any losses of saturation in the imaging segment of the system. Whereas the coefficients of the color matching circuit
18
are different with respect to different video cameras as discussed, the coefficients of the linear matrix circuit
19
are the same for all the video cameras configured within the same studio.
Suppose now that the color matching circuit
18
performs the processing defined by the equations (41) below using the coefficients C
0
through C
5
(the same as in the equations (30) above), and that the linear matrix circuit
19
carries out the processing defined by the equations (42) below involving the coefficients C
0
′ through C
5
′ (see the equations (29) above)
In that case, a series circuit made up of the color matching circuit
18
and linear matrix circuit
19
performs the processing defined by the matricial equation for multiplication (43) below. As shown in the equations (44) below, the equation (43) can be developed into matricial equations similar to the equations (41) and (42). This means that either the color matching circuit
18
or the linear matrix circuit
19
may be used to perform the kind of processing equivalent to what is carried out by the series circuit composed of the color matching circuit
18
and linear matrix circuit
19
. In this case, it is necessary to set to the above circuit the coefficients C
0
″ through C
5
″ derived from the coefficients C
0
through C
5
and C
0
′ through C
5
′.
C″
0
=(1
+C′
0
+C′
1
)
C
0
+(1
+C
2
+C
3
)
C′
0
−C′
1
C
5
C″
1
=(1
+C′
0
+C
′
1
)
C
1
+(1
+C
4
+C
5
)
C′
1
−C′
0
C
3
C″
2
=(1
+C′
2
+C
′
3
)
C
2
+(1
+C
0
+C
1
)
C′
2
−C′
3
C
4
C″
3
=(1
+C′
2
+C
′
3
)
C
3
+(1
+C
4
+C
5
)
C′
3
−C′
2
C
1
C″
4
=(1
+C′
4
+C
′
5
)
C
4
+(1
+C
0
+C
1
)
C′
4
−C′
5
C
2
C″
5
=(1
+C′
4
+C
′
5
)
C
5
+(1
+C
2
+C
3
)
C′
5
−C′
4
C
0
If the six coefficients C
0
through C
5
in the equation (41) above are represented by two parameters (r, g), then the result is the equations (45) below (see the equations (37) above). The processing carried out in that case is followed by that which is defined by the equation (42). This means that the series circuit made up of the color matching circuit
18
and linear matrix circuit
19
performs the processing defined by the equations (46) below. In carrying out the processing, the circuit shown in
FIG. 8
can act both as the color matching circuit
18
and as the linear matrix circuit
19
. It should be noted that the coefficients C
0
′ through C
14
′ are replaced by the coefficients C
0
″ through C
14
″ in the equations (46).
R′=R
+(
C
0
r+C
1
g+C
2
)(
R−G
)+(
C
3
r+C
4
)(
R−B
)
G′=G
+(
C
5
r+C
6
g+C
7
)(
G−R
)+(
C
8
r+C
9
)(
G−B
)
B′=B
+(
C
10
r+C
11
g+C
12
)(
B−R
)+(
C
13
r+C
14
)(
B−G
) (45)
R″=R
+(
C″
0
r+C″
1
g+C″
2
)(
R−G
)+(
C″
3
r+C″
4
)(
R−B
)
G″=G
+(
C″
5
r+C″
6
g+C″
7
)(
G−R
)+(
C″
8
r+C″
9
)(
G−B
)
B″=B
+(
C″
10
r+C″
11
g+C″
12
)(
R−B
)+(
C″
13
r+C″
14
)(
R−B
)
C″
0
=(1
+C′
0
+C′
1
)
C
0
+C′
0
(
C
5
+C
8
)+
C′
1
(−2
C
11
−C
13
)
C″
1
=(1
+C′
0
+C′
1
)
C
1
+C′
0
C
6
−C′
1
C
11
C″
2
=(1
+C′
1
+C′
1
)
C
2
+C′
0
(1
C
7
+C
9
)+
C′
1
(
C
11
−C
14
)
C″
3
=(1
+C′
0
+C′
1
)
C
3
−C′
0
C
8
+C′
1
(
C
10
+C
11
+C
13
)
C″
4
=(1
+C′
0
+C′
1
)
C
4
−C′
0
C
9
+C′
1
(1
+C′
12
+C
14
)
C″
5=(1
+C′
2
+C′
3
)
C
5
+C′
2
(
C
0
+C
2
)+C′
3
(−
C
10
+C
11
)
C″
6
=(1
+C′
2
+C′
3
)
C
6
+C′
2
C
1
−C′
3
C
11
C″
7
=(1
+C′
2
+C′
3
)
C
7
+C′
2
(1
+C
2
+C
4
)+
C′
3
(−
C
11
−C
12
)
C″
8
=(1
+C′
2
+C′
3
)
C
8
−C′
2
C
3
+C′
3
(
C
10
+C
11
+C
13
)
C
″
9
=(1
+C′
2
+C′
3
)
C
9
-C′
2
C
4
+C′
3
(1
+C
12
+C
14
)
C″
10
=(1
+C′
4
+C′
5
)
C
10
+C′
4
(
C
0
−C
1
+C
3
)+
C′
5
(−
C
5
+C
6
)
C″
11
=(1
+C′
4
+C′
5
)
C
11
−C′
4
C
1
+C′
5
C
6
C″
12
=(1
+C′
4
+C′
5
)
C
12
+C′
4
(1
+C
1
+C
2
+C
4
)+
C′
5
(−
C
6
+C
7
)
C″
13
(1
+C′
4
+C′
5
)
C
13
+C′
4
(
C
0
+2
C
1
)+
C′
5
(−
C
5
+2
C
6
+C
8
)
C″
14
=(1
+C′
4
+C′
5
)
C
14
+C′
4
(−
C
1
−C
2
)+
C′
5
(1
+C
6
+C
7
+C
9
) (46)
The color matching circuit
18
in the above embodiment has been shown providing color matching by carrying out its processing using the gains G
r
, G
g
and G
b
and the DC offset values O
r
, O
g
and O
b
determined by the tristimulus values R
2
, G
2
and B
2
indicated in the equations (4). This setup has the following disadvantage. That is, where an appropriate functional relation is obtained on the basis of the equations (5) and (6) under a certain lighting condition for a given object to be matched in color among the configured video cameras, that relation does not hold and must be changed once a different lighting condition is introduced. One solution to this problem is to correct the gains G
r
, G
g
and G
b
as well as the DC offset values O
r
, O
g
and O
b
through the following approximation:
Assuming that the functional relation of the equations (5) and (6) has been acquired and retained in accordance with the tristimulus values R
2
, G
2
and B
2
obtained through imaging operation with the amplifier gains A
r2
, A
g2
and A
b2
in effect (i.e., composite gains from the preamplifiers
12
R,
12
G and
12
B and the video amplifiers
13
R,
13
G and
13
B); When the lighting condition is subsequently changed and the white balance is reestablished, the amplifier gains are modified accordingly. This means that, even with the spectral distribution I(λ) of the camera input kept unchanged, the resulting tristimulus values are different from those given when the above functional relation was in effect. Thus the equations (5) and (6) do not hold as they are.
As evident from the equations (1), the amplifier gains are outside the domain of integration and are independent of the wavelength λ. For this reason, the amplifier gains may be considered separate from the tristimulus values. Thus if the current amplifier gains are represented by A
r3
, A
g3
, and A
b3
and the resulting tristimulus values by R
3
, G
3
and B
3
, then the equations (47) below hold. Assuming that color temperature differences are small between the current and the preceding setups and that the outputs R
3
′, G
3
′ and B
3
′ after color matching may be approximated as indicated in the equations (48) below, inserting the equations (47) and (48) into the equations (4) gives the equations (49) below.
As described, when the functional relation obtained with the amplifier gains of A
r2
, A
g2
and A
b2
is applied to the case in which the amplifier gains are A
r3
, A
g3
and A
b3
, the tristimulus values R
3
, G
3
and B
3
for the gains G
r
′, G
g
′ and G
b
′ as well as for the DC offset values O
r
′, O
g
′ and O
b
′ need to be multiplied by A
r2
/A
r3
, A
g2
/A
g3
and A
b2
/A
b3
respectively. Furthermore, the DC offset values O
r
′, O
g
′ and O
b
′ thus obtained need to be multiplied by A
r3
/A
r2
, A
g3
/A
g2
and A
b3
/A
b2
respectively.
The white balance must be detected downstream of the color matching circuit
18
, and must be adjusted in accordance with the corrected tristimulus values. Where the spectral radiation characteristics of the lighting condition are drastically changed, e.g., where color matching is initially performed outdoors in the sun and then the white balance is readjusted indoors under fluorescent lamps, the correction based on the equations (49) are not expected to be effective.
In the above-described embodiment, the use of rg chromaticity is intended to reduce the number of parameters. It is obvious that uv chromaticity or xy chromaticity may be used instead. However, since the tristimulus values actually obtained through imaging operation do not include negative values and no value will appear outside the triangle in
FIG. 4
, the use of rg chromaticity is preferred for the simplicity of computations involved.
As described and according to the invention, where a plurality of video cameras making up a video camera system acquire their respective red, green and blue signals through imaging operation, the gains and/or DC offset values of these red, green and blue signals are adjusted for color matching between the configured video cameras in accordance with the levels of their signals. The color matching operation effectively absorbs the color differences between the component video cameras within the system. In addition, one circuit may act both as the color matching circuit and as the linear matrix circuit, whereby the scale of circuitry is reduced.
As many apparently different embodiments of this invention may be made without departing from the spirit and scope thereof, it is to be understood that the invention is not limited to the specific embodiments thereof except as defined in the appended claims.
Claims
- 1. A video camera comprising:level detecting means for detecting the levels of red, green and blue signals obtained through imaging operation; and color matching means for adjusting the gains and/or the DC current offset values of said red, green and blue signals according to one or more coefficients such that the component color characteristics of the camera substantially match the component color characteristics of a reference camera, said coefficients being computed based on the levels of said red, green and blue signals which are detected by said level detecting means and levels of red, green and blue signals detected in said reference camera.
- 2. A video camera according to claim 1, further comprising a linear matrix circuit for electronically correcting color reproduction errors, wherein both said color matching means and said linear matrix circuit are included in a single circuit.
- 3. A video camera system comprising a plurality of video cameras connected to a controller:wherein said plurality of video cameras each include level detecting means for detecting the levels of red, green and blue signals obtained through imaging operation; and color matching means for adjusting the gains and/or the DC current offset values of said red, green and blue signals for each camera according to one or more coefficients such that the component color characteristics of each said camera substantially match the component color characteristics of a reference camera; and wherein for each respective camera other than said reference camera said controller computes said coefficients based on the levels of said red, green and blue signals which are detected by said level detecting means of said respective camera and levels of red, green and blue signals detected in said reference camera.
- 4. A video camera system according to claim 3, wherein said controller computes said color matching coefficients on the basis of those levels of said red, green and blue signals which are detected by said level detecting means of said plurality of video cameras imaging a common color chart, said color matching coefficients being used by said color matching means of said plurality of video cameras.
- 5. A color matching method for matching colors between a plurality of video cameras, said color matching method comprising the steps of:detecting the levels of red, green and blue signals obtained through imaging operation of each of said plurality of video cameras; and controlling color matching means to adjust the gains and/or the DC current offset values of said red, green and blue signals for each said camera according to one or more coefficients such that the component color characteristics of each said camera substantially match the component color characteristics of a reference camera, said coefficients being computed based on the levels of said red, green and blue signals which are detected for said camera and levels of red, green and blue signals detected in said reference camera.
- 6. A color matching method according to claim 5, wherein the step for level detection detects the levels of said red, green and blue signals obtained by said plurality of video cameras imaging a common color chart.
Priority Claims (1)
Number |
Date |
Country |
Kind |
07-157817 |
Jun 1995 |
JP |
|
US Referenced Citations (5)
Number |
Name |
Date |
Kind |
4414573 |
Griesshaber et al. |
Nov 1983 |
A |
4608593 |
Miyaji et al. |
Aug 1986 |
A |
5189511 |
Parulski et al. |
Feb 1993 |
A |
5260774 |
Takayama |
Nov 1993 |
A |
5668596 |
Vogel |
Sep 1997 |
A |