Video mixing apparatus

BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates to a video mixing apparatus for performing a video mixing process for a plurality of input video signals in accordance with a plurality of key signals and outputting a mixed video signal.
2. Description of the Related Art
An apparatus is known which, in accordance with two or more input key signals, mixes a video in which input video signals corresponding to the respective key signals are inserted into a background video signal (i.e., a video signal representing a background image). Such a video mixing apparatus includes a video signal mixer for performing the above-mentioned key mixing process for two video signals. As used herein, a "video signal" means a signal representing an image. Accordingly, mixing of images is performed by processing video signals representing the images.
Many conventional video mixing apparatuses include a plurality of video signal mixers interconnected in series, the number of video signal mixers being in accordance with the number of input video signals (e.g., Japanese Patent Publication No. 5-30350).
In such a video mixing apparatus including a plurality of video signal mixers provided in series, a background video signal is input to a first video signal mixer, and a plurality of video signal mixers for mixing two video signals are connected in series. This results in a problem in that the background video signal is led through a plurality of video signal mixers, thus degrading the video transfer characteristics. An input video signal and a background video signal that were mixed in a given stage are not distinguishable when provided to a subsequent stage as an input video signal for further mix. Therefore, after a plurality of input video signals are mixed at a predetermined mix ratio, it is impossible to employ this method for inserting the resultant mixed video into a background video in order to generate a mixed-video signal.
In order to avoid circuit configurations in which a plurality of video signal mixers having two inputs each are interconnected in series, a video mixing apparatus has been proposed which is capable of mixing a plurality of input video signals with one another and mixing a plurality of key signals with one another in advance (e.g., Japanese Patent Publication No. 5-30350).
The above-mentioned video mixing apparatus, in which a plurality of input video signals are mixed with one another and a plurality of key signals are mixed with one another in advance, can solve the problem of background video signals being influenced by the deterioration of video transfer characteristics. However, because there exists a multiple interaction of linear key characteristics, non-linear key characteristics may result. Boundaries of images may vary due to such non-linear characteristics. Specifically, when mixing videos in the last video signal mixer, unnecessary video signals may be mixed in the boundaries therebetween ("KEY PROCESS TECHNIQUE IN POSTPRODUCTION", Seibundo Shinkosha, CHROMA, July 1994, pp. 19-20).
In order to prevent unnecessary video signals from being mixed, the control characteristics of a video signal mixer for mixing input video signals with one another are required to have on-off characteristics such that the input video signals are selected exclusively in response to each input key signal.
However, if the video signal mix between input video signals is controlled in an on-off manner, only one input video signal is exclusively selected when mixing input video signals. Such a configuration cannot handle a situation where a plurality of input key signals may be at an intermediate level simultaneously. Moreover, as in the case of the above-described configuration in which a plurality of video signal mixers interconnected in series, it is impossible to mix a plurality of input video signals at a predetermined mix ratio and then insert a resultant mixed video into a background video in order to obtain a further mixed video signal.
SUMMARY OF THE INVENTION
A video mixing apparatus for mixing a first video signal and a second video signal in accordance with a first key signal and a second key signal according to the present invention includes: a key signal mixer for receiving the first and second key signals and generating and outputting a third key signal and a fourth key signal, wherein a level K.sub.1 of the first key signal, a level K.sub.2 of the second key signal, a level K.sub.3 of the third key signal, and a level K.sub.4 of the fourth key signal satisfy the relationships:
K.sub.3 =K.sub.2 -K.sub.1 K.sub.2,
and
K.sub.4 =K.sub.1 +K.sub.2 -K.sub.1 K.sub.2 ;
a key signal division section for receiving the third and fourth key signals and generating and outputting a fifth key signal, wherein a level K.sub.5 of the fifth key signal satisfies the relationship:
K.sub.5 =K.sub.3 /K.sub.4 ;
and
a first video signal mixer for receiving the first and second video signals and the fifth key signal and generating and outputting a third video signal by mixing the first and second video signals at a mix ratio which is in accordance with the fifth key signal.
In one embodiment of the invention, a level V.sub.1 of the first video signal, a level V.sub.2 of the second video signal, and a level V.sub.3 of the third video signal satisfy the relationship:
V.sub.3 =(1-K.sub.5)V.sub.1 +K.sub.5 .multidot.V.sub.2.
In another embodiment of the invention, the video mixing apparatus further includes a second video signal mixer for receiving the third and fourth video signals and the fourth key signal and generating and outputting a fifth video signal by mixing the third and fourth video signals at a mix ratio which is in accordance with the fourth key signal.
In still another embodiment of the invention, a level V.sub.4 of the fourth video signal and a level V.sub.5 of the fifth video signal satisfy the relationship:
V.sub.5 =(1-K.sub.4)V.sub.4 +K.sub.4 .multidot.V.sub.3.
In still another embodiment of the invention, the video mixing apparatus further includes a key signal division section for receiving the first and fourth key signals and generating and outputting a sixth key signal, wherein a level K.sub.6 of the sixth key signal satisfies the relationship:
K.sub.6 =K.sub.1 /K.sub.4,
and
the first video signal mixer further receives the sixth key signal and generates and outputs a third video signal by mixing the first and second video signals at a mix ratio which is in accordance with the fifth and sixth key signals.
In still another embodiment of the invention, a level V.sub.1 of the first video signal, a level V.sub.2 of the second video signal, and a level V.sub.3 of the third video signal satisfy the relationship:
V.sub.3 =K.sub.6 .multidot.V.sub.1 +K.sub.5 .multidot.V.sub.2.
Alternatively, a video mixing apparatus for mixing a first video signal and a second video signal in accordance with a first key signal, a second key signal, and a priority key signal according to the present invention includes: a key signal mixer for receiving the first key signal, the second key signal, and the priority key signal and generating and outputting a third key signal and a fourth key signal, wherein a level K.sub.1 of the first key signal, a level K.sub.2 of the second key signal, a level K.sub.3 of the third key signal, a level K.sub.4 of the fourth key signal, and a level K.sub.p of the priority key signal satisfy the relationships:
K.sub.3 =K.sub.2 -K.sub.p K.sub.1 K.sub.2,
and
K.sub.4 =K.sub.1 +K.sub.2 -K.sub.1 K.sub.2 ;
a key signal division section for receiving the third and fourth key signals and generating and outputting a fifth key signal, wherein a level K.sub.5 of the fifth key signal satisfies the relationship:
K.sub.5 =K.sub.3 /K.sub.4 ;
and
a first video signal mixer for receiving the first and second video signals and the fifth key signal and generating and outputting a third video signal by mixing the first and second video signals at a mix ratio which is in accordance with the fifth key signal.
In one embodiment of the invention, a level V.sub.1 of the first video signal, a level V.sub.2 of the second video signal, and a level V.sub.3 of the third video signal satisfy the relationship:
V.sub.3 =(1-K.sub.5)V.sub.1 +K.sub.5 .multidot.V.sub.2.
In another embodiment of the invention, the video mixing apparatus further includes a second video signal mixer for receiving the third and fourth video signals and the fourth key signal and generating and outputting a fifth video signal by mixing the third and fourth video signals at a mix ratio which is in accordance with the fourth key signal.
In still another embodiment of the invention, a level V.sub.4 of the fourth video signal and a level V.sub.5 of the fifth video signal satisfy the relationship:
V.sub.5 =(1-K.sub.4)V.sub.4 +K.sub.4 .multidot.V.sub.3.
In still another embodiment of the invention, the video mixing apparatus further includes a key signal division section for receiving the first and fourth key signals and generating and outputting a sixth key signal, wherein a level K.sub.6 of the sixth key signal satisfies the relationship:
K.sub.6 =K.sub.1 /K.sub.4,
and
the first video signal mixer further receives the sixth key signal and generates and outputs a third video signal by mixing the first and second video signals at a mix ratio which is in accordance with the fifth and sixth key signals.
In still another embodiment of the invention, a level V.sub.1 of the first video signal, a level V.sub.2 of the second video signal, and a level V.sub.3 of the third video signal satisfy the relationship:
V.sub.3 =K.sub.6 .multidot.V.sub.1 +K.sub.5 .multidot.V.sub.2.
Alternatively, a video mixing apparatus for mixing 1.sup.st to N.sup.th video signals in accordance with 1.sup.st to N.sup.th key signals according to the present invention includes:
a key signal mixer for receiving the 1.sup.st to N.sup.th key signals and generating and outputting a (N+1).sup.th to 2N.sup.th key signals and a mixed key signal, wherein a level K.sub.1 of the 1.sup.st key signal, a level K.sub.2 of the 2.sup.nd key signal, . . . , and a level K.sub.2N of the 2N.sup.th key signal satisfy the relationship:
K.sub.i =K.sub.i-N .multidot.(1-K.sub.i-N-1).multidot.(1-K.sub.i-N-2).multidot.. . . .multidot.(1-K.sub.1)
for i=(N+1) to 2N (where K.sub.0 =0), and a level K.sub.m of the mixed key signal satisfies the relationship:
K.sub.m =1-(1-K.sub.1).multidot.(1-K.sub.2).multidot.. . . .multidot.(1-K.sub.N);
a key signal division section for receiving the (N+1).sup.th to 2N.sup.th key signals and the mixed key signal and generating and outputting (2N+1).sup.th to 3N.sup.th key signals, wherein a level K.sub.2N+1 of the (2N+1).sup.th key signal, a level K.sub.2N+2 of the (2N+2).sup.th key signal, . . . , and a level K.sub.3N of the 3N.sup.th key signal satisfy the relationship:
K.sub.i =K.sub.i-N /K.sub.m
for i=(2N+1) to 3N; and
a first video signal mixer for receiving the 1.sup.st to N.sup.th video signals and the (2N+1).sup.th to 3N.sup.th key signals and generating and outputting a first output video signal by mixing the 1.sup.st to N.sup.th video signals at a mix ratio which is in accordance with the (2N+1)th to 3N.sup.th key signals,
wherein N is an integer equal to or greater than two.
In one embodiment of the invention, a level V.sub.1 of the 1.sup.st video signal, a level V.sub.2 of the 2.sup.nd video signal, . . . , and a level V.sub.N of the N.sup.th video signal satisfy the relationship:
V.sub.m1 =V.sub.1 .multidot.(K.sub.2N+1)+V.sub.2 .multidot.(K.sub.2N+2)+. . . +V.sub.3 .multidot.(K.sub.3N).
In another embodiment of the invention, the video mixing apparatus further includes a second video signal mixer for receiving the first output video signal, the (N+1).sup.th video signal, and the mixed key signal and generating and outputting a second output video signal by mixing the first output video signal and the (N+1).sup.th video signal at a mix ratio which is in accordance with the mixed key signal, wherein N is an integer equal to or greater than three.
In still another embodiment of the invention, a level V.sub.N+1 of the (N+1).sup.th video signal and a level V.sub.m2 of the second video signal satisfy the relationship:
V.sub.m2 =K.sub.m .multidot.V.sub.m1 +(1-K.sub.m).multidot.V.sub.N+1.
In still another embodiment of the invention, the video mixing apparatus further includes a key signal weighting unit for varying at least one of the key signals depending on a display location on a display, wherein the key signal mixer receives at least one of the weighted key signals output from the key signal weighting unit.
In still another embodiment of the invention, the video mixing apparatus further includes a key signal weighting unit for varying at least one of the key signals depending on a display location on a display, wherein the key signal mixer receives at least one of the weighted key signals output from the key signal weighting unit.
In still another embodiment of the invention, the video mixing apparatus further includes a key signal weighting unit for varying at least one of the key signals depending on a display location on a display, wherein the key signal mixer receives at least one of the weighted key signals output from the key signal weighting unit.
A video mixing apparatus according to the present invention is capable of adjusting the levels of a plurality of input key signals even when the input key signals are all at levels which are not the zero level, thus performing a mixing of the plurality of input video signals. By previously dividing each priority key signal by a mixed key signal at a key signal division section, non-linear characteristics are avoided which would result from multiple interaction between input key signals in a video signal mixer for performing a video mixing process for input video signals and a video signal mixer for performing a video signal mix into a background video signal. As a result, it becomes possible to input a plurality of input video signals to the apparatus so as to generate one mixed video signal in accordance with the respective input key signals. In the case where a plurality of key signals are at intermediate levels simultaneously, the present invention makes it possible to provide a mixed video signal in which video signals are visibly overlaid on one another against a background video signal.
Thus, the invention described herein makes possible the advantages of (1) providing a video mixing apparatus for performing a video mixing process for a plurality of input video signals in accordance with a plurality of input key signals and outputting a mixed video signal, in which a background video signal is led through only one video signal mixer, and the desired mixing of video signals is possible even in the case where a plurality of input key signals are simultaneously at intermediate levels; (2) providing a video mixing apparatus which is, in addition to the features in (1) above, capable of previously mixing two input video signals at a predetermined mix ratio and thereafter inserting the resultant pre-mixed video signal into a background video signal; and (3) providing a video mixing apparatus which is capable of modifying the level of the input video signal with the weighting pattern signal before mixing the input video signal with other video signals.
These and other advantages of the present invention will become apparent to those skilled in the art upon reading and understanding the following detailed description with reference to the accompanying figures.

BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram showing a video mixing apparatus 1 according to Example 1 of the present invention.
FIG. 2 is a block diagram showing the key signal mixer 101 shown in FIG. 1.
FIG. 3 is a block diagram showing the video signal mixer 103 or 104 shown in FIG. 1.
FIG. 4A illustrates a mixed image to be displayed on the display 13 shown in FIG. 1.
FIG. 4B is a diagram showing the level of an input key signal K.sub.1.
FIG. 4C is a diagram showing the level of an input key signal K.sub.2.
FIG. 4D is a diagram showing the level of a mixed key signal K.sub.m.
FIG. 4E is a diagram showing the level of a priority key signal K.sub.p.
FIG. 4F is a diagram showing the level of a video gain control signal K.sub.g.
FIG. 4G is a diagram showing the level of a mixed video signal V.sub.m1.
FIG. 4H is a diagram showing the level of a mixed video signal V.sub.m2.
FIG. 5 is a block diagram showing a variation of the video mixing apparatus of Example 1.
FIG. 6 is a block diagram showing the key signal mixer 201 shown in FIG. 5.
FIG. 7 is a block diagram showing the video signal mixer 204 shown in FIG. 5.
FIG. 8 is a block diagram showing a video mixing apparatus 3 according to Example 2 of the present invention.
FIG. 9 is a block diagram showing the key signal mixer 301 shown in FIG. 8.
FIG. 10A is a diagram showing the level of a mixed image to be displayed by the display 13 shown in FIG. 8.
FIG. 10B is a diagram showing the level of an input key signal K.sub.1.
FIG. 10C is a diagram showing the level of an input key signal K.sub.2.
FIG. 10D is a diagram showing the level of a mix priority key signal P.sub.r.
FIG. 10E is a diagram showing the level of a priority key signal K.sub.p.
FIG. 10F is a diagram showing the level of a mixed key signal K.sub.m.
FIG. 10G is a diagram showing the level of a video gain control signal K.sub.g.
FIG. 10H is a diagram showing the level of a mixed video signal V.sub.m1.
FIG. 10I is a diagram showing the level of a mixed video signal V.sub.m2.
FIG. 11 is a block diagram showing a variation of the video mixing apparatus of Example 2.
FIG. 12 is a block diagram showing the key signal mixer 401 shown in FIG. 11.
FIG. 13 is a block diagram showing a video mixing apparatus 5 according to Example 3 of the present invention.
FIG. 14A is a diagram showing the level of an input key signal K.sub.1.
FIG. 14B is a diagram showing the level of an input key signal K.sub.2.
FIG. 14C is a diagram showing the level of an input key signal K.sub.3.
FIG. 14D is a diagram showing the level of an input key signal K.sub.4.
FIG. 14E is a diagram showing the level of a priority key signal K.sub.p1.
FIG. 14F is a diagram showing the level of a priority key signal K.sub.p2.
FIG. 14G is a diagram showing the level of a priority key signal K.sub.p3.
FIG. 14H is a diagram showing the level of a priority key signal K.sub.p4.
FIG. 14I is a diagram showing the level of a mixed key signal K.sub.m.
FIG. 14J is a diagram showing the level of a video gain control signal K.sub.g1.
FIG. 14K is a diagram showing the level of a video gain control signal K.sub.g2.
FIG. 14L is a diagram showing the level of a video gain control signal K.sub.g3.
FIG. 14M is a diagram showing the level of a video gain control signal K.sub.g4.
FIG. 14N is a diagram showing the level of a mixed video signal V.sub.m1.
FIG. 14O is a diagram showing the level of a mixed video signal V.sub.m2.
FIG. 15 is a block diagram showing a video mixing apparatus 6 according to Example 4 of the present invention.
FIG. 16A is a diagram showing a state in which an image and its dropshadow are mixed with a background image.
FIG. 16B is a diagram showing the level of an input key signal K.sub.1.
FIG. 16C is a diagram showing the level of an input key signal K.sub.2.
FIG. 16D is a diagram showing the level of a weighting pattern signal W.sub.2.
FIG. 16E is a diagram showing the level of an output signal K.sub.w2.
FIG. 16F is a diagram showing the level of a priority key signal K.sub.p.
FIG. 16G is a diagram showing the level of a mixed key signal K.sub.m.
FIG. 16H is a diagram showing the level of a video gain control signal K.sub.g.
FIG. 16I is a diagram showing the level of a mixed video signal V.sub.m1.
FIG. 16J is a diagram showing the level of a mixed video signal V.sub.m2.
FIG. 17 is a block diagram showing a video mixing apparatus 7 according to Example 5 of the present invention.
FIG. 18A is a diagram showing the level of an input key signal K.sub.1.
FIG. 18B is a diagram showing the level of an input key signal K.sub.2.
FIG. 18C is a diagram showing the level of an input key signal K.sub.3.
FIG. 18D is a diagram showing the level of an input key signal K.sub.4.
FIG. 18E is a diagram showing the level of a weighting pattern signal K.sub.w4.
FIG. 18F is a diagram showing the level of a priority key signal K.sub.p1.
FIG. 18G is a diagram showing the level of a priority key signal K.sub.p2.
FIG. 18H is a diagram showing the level of a priority key signal K.sub.p3.
FIG. 18I is a diagram showing the level of a priority key signal K.sub.p4.
FIG. 18J is a diagram showing the level of a mixed key signal K.sub.m.
FIG. 18K is a diagram showing the level of a video gain control signal K.sub.g1.
FIG. 18L is a diagram showing the level of a video gain control signal K.sub.g2.
FIG. 18M is a diagram showing the level of a video gain control signal K.sub.g3.
FIG. 18N is a diagram showing the level of a video gain control signal K.sub.g4.
FIG. 18O is a diagram showing the level of a mixed video signal V.sub.m1.
FIG. 18P is a diagram showing the level of a mixed video signal V.sub.m2.

DESCRIPTION OF THE PREFERRED EMBODIMENTS
Hereinafter, the video mixing apparatus according to the present invention will be described by way of examples, with reference to the accompanying figures. Like constituent elements will be denoted by like numerals.
(Example 1)
FIG. 1 is a block diagram showing a video mixing apparatus 1 according to Example 1 of the present invention. The video mixing apparatus 1 receives two input video signals V.sub.1 and V.sub.2 and their corresponding input key signal K.sub.1 and K.sub.2 from video signal generators 11 and 12, respectively. The video mixing apparatus 1 mixes the input video signals V.sub.1 and V.sub.2 and a background video signal V.sub.b, and outputs a resultant mixed video signal V.sub.m2 to a display 13. The mixing of the input video signals V.sub.1 and V.sub.2 is performed in accordance with input key signals K.sub.1 and K.sub.2. Herein, "mixing of video signals" is defined as performing summation of the multiplication of a plurality of input video signals and input key signals corresponding to the key signals.
The video signal generator 11 supplies the input video signal V.sub.1 and the input key signal K.sub.1 to the video mixing apparatus 1. The input video signal V.sub.1 is a video signal representing characters and/or graphics, etc. Hereinafter, the reference numeral "V.sub.1 ", when employed within equations, represents the level of the input video signal V.sub.1. Similarly, the reference numeral "K.sub.1 ", when employed within equations, represents the level of the input key signal K.sub.1. Hereinafter, the other reference numerals, when employed within equations, all represent the levels of the signals they indicate.
The present invention employs a luminance signal Y and color difference signals Cb and Cr as video signals, which are generally referred to as "component signals". In this specification, a "level of video signal" means values of luminance signal Y and color difference signals Cb and Cr. When these signals are analog signals, the values are represented by respective voltage levels of the analog signals. On the contrary, when these signals are digital signals, the values are represented by respective numerical expression using, for example, binary notation of the digital signals.
Here, the luminance signal Y is normalized so as to represent black level at zero level, and white level at "+1.0" level. Color difference signals Cb and Cr are normalized so as to represent maximum level at "+1.0" level, minimum level at "-1.0", and absence of the signal components at zero level. It is noted, however, that the video signal is not limited to the component signal in order to implement the video mixing apparatus of the present invention. For example, a composite signal or an RGB signal may be used as the video signal.
A "key signal" is a signal for controlling gain, which represents transfer gain of the video signal. In this specification, "key signal level" ranges from 0.0 to +1.0. The key signal level of 1.0 means that the transfer gain is 1.0, where the output video signal level is the same as the input video signal level. The key signal level of 0.0 means that the transfer gain is 0.0, where the output video signal level is zero level however high the input video signal level is.
It is noted that the key signal representation is not limited to the above-mentioned key signal and other key signal representation suitable for each design specification of the apparatus may be used. For example, when the key signal level is represented by analog voltage signal, it is possible to define the voltage level of 700 Mv as the key signal level of 1.0 and the voltage level of 0.0 Mv as the key signal level of 0.0, where the voltage level varies linearly in response to the key signal. On the contrary, when the key signal is represented by digital signal using eight bits, it is possible to define the digital signal representing 255 as the key signal level of 1.0 and the digital signal representing 0 as the key signal level of 0.0, where the numerical value of the digital signal varies linearly in response to the key signal.
The video signal generator 12 supplies the input video signal V.sub.2 and the input key signal K.sub.2 to the video mixing apparatus 1. A video signal generator 10 supplies the background video signal V.sub.b to the video mixing apparatus 1.
The video signal generators 11 and 12 generate a video signal representing characters and/or graphics, for example. The video signal generator 10 generates, for example, a video signal representing a background in an image displayed by the display 13 against which video images represented by the video signal generated by the video signal generators 11 and 12 are displayed. The background can be a video image representing characters and/or graphics, or alternatively a plain image including no variation in video signal. The video signals generated by the video signal generators 11 and 12 can also represent plain images including no variation in video signal.
The key signal mixer 101 receives the input key signals K.sub.1 and K.sub.2, and generates and outputs a mixed key signal K.sub.m and a priority key signal K.sub.p.
A key signal division section 102 divides the priority key signal K.sub.p by the mixed key signal K.sub.m, and outputs the result of division as a video gain control signal K.sub.g to a video signal mixer 103.
The video signal mixer 103 mixes the input video signals V.sub.1 and V.sub.2 in accordance with the video gain control signal K.sub.g, and outputs a mixed video signal V.sub.m1.
A video signal mixer 104 mixes the background video signal V.sub.b supplied by the video signal generator 10 and the mixed video signal V.sub.m1 in accordance with the mixed key signal K.sub.m, and outputs the result of mix as a mixed video signal V.sub.m2 to the display 13. The display 13 displays an image of characters and/or graphics in accordance with the received mixed video signal V.sub.m2. For example, a cathode-ray tube, a liquid crystal display panel, or a plasma display panel can be used as the display 13.
FIG. 2 is a block diagram showing the key signal mixer 101. The key signal mixer 101 includes an adder 161 for summing the input key signals K.sub.1 and K.sub.2, a multiplier 162 for multiplying the input key signal K.sub.1 by the input key signal K.sub.2 (or vice versa), a subtracter 163 for generating the mixed key signal K.sub.m by subtracting the output of the multiplier 162 from the output of the adder 161, and a subtracter 164 for subtracting the output of the multiplier 162 from the input key signal K.sub.2 so as to generate the priority key signal K.sub.p. The levels of the mixed key signal K.sub.m and the priority key signal K.sub.p can be expressed by the following equations:
K.sub.p =K.sub.2 -K.sub.1 K.sub.2
K.sub.m =K.sub.1 +K.sub.2 -K.sub.1 K.sub.2
FIG. 3 is a block diagram showing the video signal mixer 103 or 104. As the video signal mixer 103, the circuit shown in FIG. 3 functions in the following manner: terminals V.sub.1 and V.sub.2 receive the input video signals V.sub.1 and V.sub.2, respectively; a terminal K receives the video gain control signal K.sub.g ; and a terminal V.sub.m outputs a first mixed video signal V.sub.m1. As the video signal mixer 104, the circuit shown in FIG. 3 functions in the following manner: the terminals V.sub.1 and V.sub.2 receive the background video signal V.sub.b and the mixed video signal V.sub.m2, respectively; the terminal K receives the mixed key signal K.sub.m ; and the terminal V.sub.m outputs a second mixed video signal V.sub.m2. The video signal mixers 103 and 104 each includes a complementing operator 151 for a key signal input from the terminal K, multipliers 152 and 153 for controlling the respective gains of the video signals V.sub.1 and V.sub.2, and an adder 154 for summing the outputs of the multipliers 152 and 153. In this specification, "complement" operation is defined as operation of deriving (1-K) for the key signal input from the terminal K. The levels of the mixed video signals V.sub.m1 and V.sub.m2 output from the video signal mixers 103 and 104, respectively, can be expressed by the following equations:
V.sub.m1 =(1-K.sub.g)V.sub.1 +K.sub.g V.sub.2
V.sub.m2 =(1-K.sub.m)V.sub.b +K.sub.m V.sub.m1
FIG. 4A illustrates a mixed image to be displayed on the display 13. FIGS. 4B to 4H show the levels of the input key signal K.sub.1, the input key signal K.sub.2, the mixed key signal K.sub.m, the priority key signal K.sub.p, the video gain control signal K.sub.g, the mixed video signal V.sub.m1, and the mixed video signal V.sub.m2, respectively.
The video signal generators 11 and 12, respectively, supply the input key signal K.sub.1 (shown in FIG. 4B) and the input key signal K.sub.2 (shown in FIG. 4C) to the key signal mixer 101. The mixed key signal K.sub.m output from the key signal mixer 101 is as shown in FIG. 4D. The priority key signal K.sub.p output from the key mixer 101 is as shown in FIG. 4E.
The key signal division section 102 divides the priority key signal K.sub.p (shown in FIG. 4E) by the mixed key signal K.sub.m, (shown in FIG. 4D), and outputs the result of division to the video signal mixer 103 as the video gain control signal K.sub.g. As shown in FIG. 4F, the video gain control signal K.sub.g, which is the result of division, has a waveform whose gain is controlled in such a manner that the input key signal K.sub.2 is amplified to the full level in regions where the two input key signals K.sub.1 and K.sub.2 do not overlap with each other and that the input key signal K.sub.2 non-linearly decreases in accordance with the level of the input key signal K.sub.1 where the two input key signals K.sub.1 and K.sub.2 overlap with each other.
The video signal mixer 103 mixes the input video signals V.sub.1 and V.sub.2 in accordance with the video gain control signal K.sub.g (shown in FIG. 4F) and outputs the result of mix to the video signal mixer 104 as the mixed video signal V.sub.m1 shown in FIG. 4C.
The video signal mixer 104 mixes the background video signal V.sub.b and the mixed video signal V.sub.m1 in accordance with the mixed key signal K.sub.m (shown in FIG. 4D) and outputs the result of mix as the mixed video signal V.sub.m2 shown in FIG. 4H. The mixed video signal V.sub.m2 is a video signal in which the input video signals V.sub.1 and V.sub.2 are inserted into the background video signal V.sub.b.
In regions where the input key signal K.sub.1 is at the zero level and the input key signal K.sub.2 is at an intermediate level (i.e., a level which is larger than 0 and smaller than 1), the input video signal V.sub.2 is output at the full level as the mixed video signal V.sub.m1. However, the mixed key signal K.sub.m supplied to the video signal mixer 104 is at the same level as that of the input key signal K.sub.2. In regions where the input key signal K.sub.1 is at the zero level and the input key signal K.sub.2 is at an intermediate level, the input video signal V.sub.2 is output, as the resultant mixed video signal V.sub.m2, at a level designated by the input key signal K.sub.2. Thus, in accordance with the video mixing apparatus of the present example, a desired video mix is achieved in the case where one of the input key signals is at an intermediate level, without allowing non-linear mix characteristics to be generated due to multiple interaction of the key signals.
In the mixed video signal V.sub.m1, the input video signals V.sub.1 and V.sub.2 are subjected to non-linear mix in regions where the input key signals K.sub.1 and K.sub.2 are both at intermediate levels. However, in the second video signal mixer 104, such a non-linearly mixed video is cancelled by the interaction with the mixed key signal K.sub.m, so that the mix becomes linear as a whole. Thus, in accordance with the video mixing apparatus of the present example, desired (i.e., linear) video mix is achieved in the case where two input key signals are both at intermediate levels. Therefore, one of the objectives of the present invention, i.e., linear mix in the case where two input key signals are both at intermediate levels, is achieved under the condition that the background video signal V.sub.b is led through the video signal mixer only once.
In Example 1, the key signal division section 102 outputs a zero-level signal as the result of division (i.e., the video gain control signal K.sub.g) in the case where the divisor of the division (i.e., the mixed key signal K.sub.m) is at the zero level. However, the regions in which the mixed key signal K.sub.m is at the zero level are regions in which the background video signal V.sub.b is inserted at the full level in the subsequent video signal mixer 104. Therefore, when the mixed key signal K.sub.m is at the zero level, it is not necessary for the key signal division section 102 to output a zero-level signal as the result of the division; the key signal division section 102 can output a signal at any level.
FIG. 5 is a block diagram showing a variation of the video mixing apparatus of Example 1. In the video mixing apparatus 1, the video signal mixer 103 for mixing input video signals performs a key mixing process in accordance with one video gain control signal K.sub.g. In the video mixing apparatus 2 shown in FIG. 5, a video signal mixer 204 mixes input video signals V.sub.1 and V.sub.2 in accordance with a plurality of video gain control signals K.sub.g1 and K.sub.g2. The video mixing apparatus 2 also attains the same effect attained by the video mixing apparatus 1.
In the video mixing apparatus 2, the key signal mixer 201 receives input key signals K.sub.1 and K.sub.2, and generates and outputs priority key signals K.sub.p1 and K.sub.p2 and a mixed key signal K.sub.m. Key signal division sections 202 and 203 divide the priority key signals K.sub.p1 and K.sub.p2 each by the mixed key signal K.sub.m, and outputs the results of division as video gain control signals K.sub.g1 and K.sub.g2. The video signal mixer 204 adds a result of multiplication of the input video signal V.sub.1 by the video gain control signal K.sub.g1 with a result of multiplication of the input video signal V.sub.2 by the video gain control signal K.sub.g2, and generates a mixed video signal V.sub.m1.
Thus, the video signal mixer 204 mixes the input video signals V.sub.1 and V.sub.2 in accordance with the video gain control signals K.sub.g1 and K.sub.g2, and outputs the result of mix to the video signal mixer 104 as the mixed video signal V.sub.m1. The video signal mixer 104 mixes a background video signal V.sub.b supplied from a video signal generator 10 and the mixed video signal V.sub.m1 in accordance with the mixed key signal K.sub.m, and outputs the result of mix as a mixed video signal V.sub.m2 to a display 13. The display 13 displays an image represented by the received mixed video signal V.sub.m2 on its screen.
FIG. 6 is a block diagram showing the key signal mixer 201. The key signal mixer 201 includes an adder 261 for summing the input key signals K.sub.1 and K.sub.2, a multiplier 262 for multiplying the input key signal K.sub.1 by the input key signal K.sub.2 (or vice versa), a subtracter 263 for generating the mixed key signal K.sub.m, by subtracting the output of the multiplier 262 from the output of the adder 261, and a subtracter 264 for subtracting the output of the multiplier 262 from the input key signal K.sub.2 so as to generate the priority key signal K.sub.p2. The input key signal K.sub.1 is output as the priority key signal K.sub.p1, without being processed. The levels of the priority key signals K.sub.p1 and K.sub.p2 and the mixed key signal K.sub.m can be expressed by the following equations:
K.sub.p1 =K.sub.1
K.sub.p2 =K.sub.2 -K.sub.1 K.sub.2
K.sub.m =K.sub.1 +K.sub.2 -K.sub.1 K.sub.2
FIG. 7 is a block diagram showing the video signal mixer 204. The video signal mixer 204 includes two multipliers 251 and 252 for controlling the gains of the video signals V.sub.1 and V.sub.2 and an adder 253 for summing the outputs of the multipliers 251 and 252. The level of the mixed video signals V.sub.m1 output from the video signal mixers 204 can be expressed by the following equation:
V.sub.m1 =K.sub.g1 V.sub.1 +K.sub.g2 V.sub.2
The difference between the video mixing apparatus 1 shown in FIG. 1 and the video mixing apparatus 2 shown in FIG. 5 lies in the video gain for the input video signal V.sub.1 in the video signal mixer when the key signals K.sub.1 and K.sub.2 are both at the zero level.
In either video mixing apparatus, however, the mixed key signal K.sub.m is at the zero level when both the key signals K.sub.1 and K.sub.2 are at the zero level. When the mixed key signal K.sub.m is at the zero level, the video gain for the mixed video signal V.sub.m1 in the video signal mixer 104 is at the zero level. As a result, the difference between the two apparatus is cancelled so that the difference does not exist in the mixed video signal V.sub.m2 to be finally output. Consequently, the video mixing apparatus 2 shown in FIG. 5, in which the video gain control signals K.sub.g1 and K.sub.g2 are provided for the input video signals V.sub.1 and V.sub.2, attains the same effect attained by the video mixing apparatus 1 shown in FIG. 1.
In accordance with the video mixing apparatus 2, the priority key signals K.sub.p1 and K.sub.p2 are each divided by the mixed key signal K.sub.m. In order to avoid non-linear mix characteristics resulting from the interaction of a number of key signals, the mixing of video signals in the video signal mixer 204 can be performed in accordance with the priority key signals K.sub.p1 and K.sub.p2, instead of the video gain control signals K.sub.g1 and K.sub.g2, and by dividing the mixed video signal V.sub.m1 by the mixed key signal K.sub.m. However, in this case, the video signals are once subjected to a gain control process in the video signal mixer 204 in accordance with the priority key signals K.sub.p1 and K.sub.p2, and again subjected to a gain control process in the division section based on a reciprocal number of the mixed key signal K.sub.m. In the case where one of the input key signals K.sub.1 and K.sub.2 is at an intermediate level and the other is at the zero level, the mixed key signal K.sub.m will be equal to the input key signal which is not at the zero level. In such a case, the video signals are attenuated to an intermediate level by the video signal mixer 204 and then divided so as to be amplified to the full level in a video mixing apparatus where the mixed video signal V.sub.m1 is divided by the mixed key signal K.sub.m. This results in a deterioration of the image quality.
In contrast, in accordance with the video mixing apparatus 2 of the present invention, the key signal division sections 202 and 203 divide the priority key signals K.sub.p1 and K.sub.p2 by the mixed key signal K.sub.m before they are output to the video signal mixer 204. As a result, the gain control signals, rather than video signals themselves, are amplified to the full level through division processes. Thus, the number of gain control processes performed for the video signals can be reduced relative to the above-described configuration, so that the operation precision can be maintained high, thereby preventing deterioration of image quality.
Some character/graphics generation apparatuses or superimposing apparatuses (or captioning apparatuses) in a video edition system perform a key mixing process for a background video signal and a mixed video signal at a video switcher. In the case where the video signal mixer 104 for mixing the mixed video signal V.sub.m1 and the background video signal V.sub.b is provided in a video switcher, the video signal mixer 104 can be omitted from the video mixing apparatus 1 or 2. In other words, the video mixing apparatus 1 and 2 will function sufficiently without incorporating the video signal mixer 104 as long as they are capable of outputting the mixed video signal V.sub.m1 and the mixed key signal K.sub.m.
(Example 2)
FIG. 8 is a block diagram showing a video mixing apparatus 3 according to Example 2 of the present invention. The video mixing apparatus 3 mixes input video signals V.sub.1 and V.sub.2 and a background video signal V.sub.b in accordance with a mix priority key signal P.sub.r and input key signals K.sub.1 and K.sub.2.
A wipe waveform generator 34 generates a mix priority key signal P.sub.r and outputs the mix priority key signal P.sub.r to a key signal mixer 301. The key signal mixer 301 receives the input key signals K.sub.1 and K.sub.2 and the mix priority key signal P.sub.r, and generates and outputs a mixed key signal K.sub.m and a priority key signal K.sub.p.
A key signal division section 102 divides the priority key signal K.sub.p by the mixed key signal K.sub.m, and outputs the result of division as a video gain control signal K.sub.g to a video signal mixer 103. The video signal mixer 103 mixes the input video signals V.sub.1 and V.sub.2 in accordance with a video gain control signal K.sub.g, and outputs the result of mix as a mixed video signal V.sub.m1 to a video signal mixer 104.
The video signal mixer 104 mixes the background video signal V.sub.b (supplied from a video signal generator 10) and the mixed video signal V.sub.m1 in accordance with the mixed key signal K.sub.m, and outputs the result of mix as a mixed video signal V.sub.m2 to the display 13.
FIG. 9 is a block diagram showing the key signal mixer 301. The key signal mixer 301 includes an adder 351 for summing the input key signals K.sub.1 and K.sub.2, a multiplier 352 for multiplying the input key signal K.sub.1 by the input key signal K.sub.2 (or vice versa), a subtracter 353 for generating the mixed key signal K.sub.m by subtracting the output of the multiplier 352 from the output of the adder 351, a second multiplier 354 for multiplying the output of the first multiplier 352 by the mix priority key signal P.sub.r, and a subtracter 355 for subtracting the output of the multiplier 354 from the input key signal K.sub.2 so as to generate the priority key signal K.sub.p. The levels of the priority key signal K.sub.p and the mixed key signal K.sub.m, which are outputs of the key signal mixer 301, can be expressed by the following equations:
K.sub.p =K.sub.2 -P.sub.r K.sub.1 K.sub.2
K.sub.m =K.sub.1 +K.sub.2 -K.sub.1 K.sub.2
FIG. 10A is a diagram showing a mixed image to be displayed by the display 13. FIGS. 10B to 10I are diagrams showing the input key signals K.sub.1 and K.sub.2, the mix priority key signal P.sub.r, the priority key signal K.sub.p, the mixed key signal K.sub.m, the video gain control signal K.sub.g, the mixed video signals V.sub.m1, and the mixed video signals V.sub.m2, respectively.
The video signal generator 11 and the video signal generator 12 output the input key signal K.sub.1 (shown in FIG. 10B) and the input key signal K.sub.2 (shown in FIG. 10C), respectively, to the key signal mixer 301. The wipe waveform generator 34 outputs the mix priority key signal P.sub.r to the key signal mixer 301. A key signal division section 102 divides the priority key signal K.sub.p (shown in FIG. 10E) by the mixed key signal K.sub.m (shown in FIG. 10F) and outputs the result of division as the video gain control signal K.sub.g (shown in FIG. 10G).
A video signal mixer 103 mixes the input video signal V.sub.1 and the input video signal V.sub.2 in accordance with the video gain control signal K.sub.g, and outputs the mixed video signal V.sub.m1 shown in FIG. 10H.
The video signal mixer 104 mixes the background video signal V.sub.b and the mixed video signal V.sub.m1 in accordance with the mixed key signal K.sub.m and outputs the result of mix as the mixed video signal V.sub.m2 shown in FIG. 10I. As a result, the input video signals V.sub.1 and V.sub.2 are inserted into the background video signal V.sub.b as shown in FIG. 10I.
In Example 1, the input video signal V.sub.1 was mixed into the mixed video signal V.sub.m2 with a higher priority over the input video signal V.sub.2 in regions where the input key signals K.sub.1 and K.sub.2 overlap with each other. In other words, the priorities of the input video signal V.sub.1, the input video signal V.sub.2, and the background video signal V.sub.b increases in this order when mixed. In Example 2, however, the mix priority key signal P.sub.r ensures that the input video signals V.sub.1 and V.sub.2 are mixed so as to be positioned as if intersecting or overlaying each other in a three-dimensional manner (as shown in FIG. 10A) before being inserted into the background video signal V.sub.b.
Example 2 described a case where the value of the mix priority key signal P.sub.r varies depending on the specific location within the screen. In the case where the mix priority key signal P.sub.r has a constant value regardless of the location within the screen, the input video signals V.sub.1 and V.sub.2 are mixed at a predetermined ratio depending on the mix priority key signal P.sub.r before being mixed into the background video signal V.sub.b. Therefore, Example 2 attains one of the objectives of the present invention; that is, two input video signals are mixed at a predetermined mix ratio and thereafter are mixed with a background video signal.
FIG. 11 is a block diagram showing a variation of the video mixing apparatus of Example 2. As in Example 1, the same effect attained by the video mixing apparatus 2 can be attained by mixing the input video signals V.sub.1 and V.sub.2 in accordance with a plurality of video gain control signals K.sub.g1 and K.sub.g2. In this case, a key signal mixer 401 receives input key signals K.sub.1 and K.sub.2 and a mix priority key signal P.sub.r, and generates and outputs priority key signals K.sub.p1 and K.sub.p2. Key signal division sections 202 and 203 respectively divide the priority key signals K.sub.p1 and K.sub.p2 each by the mixed key signal K.sub.m, and outputs the results of division as video gain control signals K.sub.g1 and K.sub.g2 to a video signal mixer 204. The video signal mixer 204 adds a result of multiplication of the input video signal V.sub.1 by the video gain control signal K.sub.g1 and a result of multiplication of the input video signal V.sub.2 by the video gain control signal K.sub.g2, and outputs the resultant video signal as a mixed video signal V.sub.m1 to a video signal mixer 104.
FIG. 12 is a block diagram showing the key signal mixer 401. The key signal mixer 401 includes an adder 451 for summing the input key signals K.sub.1 and K.sub.2, a multiplier 452 for multiplying the input key signal K.sub.1 by the input key signal K.sub.2 (or vice versa), a subtracter 453 for generating the mixed key signal K.sub.m by subtracting the output of the multiplier 452 from the output of the adder 451, a multiplier 454 for multiplying the output of the multiplier 452 by the mix priority key signal P.sub.r, a subtracter 455 for subtracting the output of the multiplier 452 from the input key signal K.sub.1, an adder 456 for summing the output of the subtracter 455 and the output of the multiplier 454 so as to output the priority key signal K.sub.p1, and a subtracter 457 for subtracting the output of the multiplier 454 from the input key signal K.sub.2 so as to output the priority key signal K.sub.p2. The levels of the priority key signals K.sub.p1 and K.sub.p2 and the mixed key signal K.sub.m can be expressed by the following equations:
K.sub.p1 =K.sub.1 -K.sub.1 K.sub.2 +P.sub.r K.sub.1 K.sub.2
K.sub.p2 =K.sub.2 -P.sub.r K.sub.1 K.sub.2
K.sub.m =K.sub.1 +K.sub.2 -K.sub.1 K.sub.2
As in Example 1, in the case where the video signal mixer 104 for mixing the mixed video signal V.sub.m1 and the background video signal V.sub.b is provided in a video switcher, the video signal mixer 104 can be omitted from the video mixing apparatus 3 or 4. In other words, the video mixing apparatuses 3 and 4 will function sufficiently without incorporating the video signal mixer 104 as long as they are capable of outputting the mixed video signal V.sub.m1 and the mixed key signal K.sub.m.
(Example 3)
FIG. 13 is a block diagram showing a video mixing apparatus 5 according to Example 3 of the present invention. The video mixing apparatus 5 mixes input video signals V.sub.1 to V.sub.4 and a background video signal V.sub.b in accordance with input key signal K.sub.1 to K.sub.4.
Video signal generators 11 and 12 output input key signals K.sub.1 and K.sub.2, respectively, and also output, respectively, input video signals V.sub.1 and V.sub.2. Similarly, video signal generators 53 and 54 output input key signals K.sub.3 and K.sub.4, respectively, and also output, respectively, input video signals V.sub.3 and V.sub.4.
A key signal mixer 510 receives the input key signals K.sub.1 to K.sub.4 (which are output from the video signal generators 11, 12, 53, and 54, respectively), and outputs a mixed key signal K.sub.m and priority key signals K.sub.p1 to K.sub.p4.
A key signal division section 520 divides the priority key signals K.sub.p1 to K.sub.p4 by the mixed key signal K.sub.m, and outputs the respective results of division as video gain control signals K.sub.g1 to K.sub.g4 to a video signal mixer 530.
The video signal mixer 530 mixes the input video signals V.sub.1 to V.sub.4 in accordance with the video gain control signal K.sub.g1 to K.sub.g4, respectively, and outputs the resultant video signal as a mixed video signal V.sub.m1 to a video signal mixer 104.
The video signal mixer 104 mixes the background video signal V.sub.b (output from a video signal generator 10) and the mixed video signal V.sub.m1 in accordance with the mixed key signal K.sub.m, and outputs the result of mix as a mixed video signal V.sub.m2 to a display 13. The display 13 displays the mixed video signal V.sub.m2 on its screen.
The key signal mixer 510 includes a complementing operator 511 for deriving a complement for the input key signal K.sub.1 ; a multiplier 512 for multiplying the output of the complementing operator 511 by the input key signal K.sub.2 so as to output the priority key signal K.sub.p2 ; a subtracter 513 for subtracting the output of the multiplier 512 from the output of the complementing operator 511, a multiplier 514 for multiplying the output of the subtracter 513 by the input key signal K.sub.3 so as to output the priority key signal K.sub.p3, a subtracter 515 for subtracting the output of the multiplier 514 from the output of the subtracter 513, a multiplier 516 for multiplying the output of the subtracter 515 and the input key signal K.sub.4 so as to output the priority key signal K.sub.p4, a subtracter 517 for subtracting the output of the multiplier 516 from the output of the subtracter 515, and a complementing operator 518 for deriving a complement for the output of the subtracter 517. The input key signal K.sub.1 is output as the priority key signal K.sub.p1 without being processed. The levels of the mixed key signal K.sub.m and the priority key signals K.sub.p1 to K.sub.p4 can be expressed by the following equations:
K.sub.p1 =K.sub.1
K.sub.p2 =K.sub.2 (1-K.sub.1)
K.sub.p3 =K.sub.3 (1-K.sub.2)(1-K.sub.1)
K.sub.p4 =K.sub.4 (1-K.sub.3) (1-K.sub.2)(1-K.sub.1)
K.sub.m =1-(1-K.sub.4)(1-K.sub.3) (1-K.sub.2)(1-K.sub.1)
The key signal division section 520 includes dividers 521 to 524 for dividing the priority key signals K.sub.p1 to K.sub.p4 by the mixed key signal K.sub.m, respectively, so as to output the respective results of division as the video gain control signals K.sub.g1 to K.sub.g4. The video gain control signals K.sub.g1 to K.sub.g4 can be expressed by the following equations:
K.sub.g1 =K.sub.p1 /K.sub.m
K.sub.g2 =K.sub.p2 /K.sub.m
K.sub.g3 =K.sub.p3 /K.sub.m
K.sub.g4 =K.sub.p4 /K.sub.m
The video signal mixer 530 includes multipliers 531 to 534 and adders 535 to 537. The multipliers 531 to 534 output products obtained by multiplying the input video signals V.sub.1 to V.sub.4, respectively, by the video gain control signals K.sub.g1 to K.sub.g4, respectively. The adders 535 to 537 calculate summation of the products output by the multipliers 531 to 534, and output the summation as a mixed video signal V.sub.m1. The mixed video signal V.sub.m1 can be expressed by the following equation:
V.sub.m1 =K.sub.g1 V.sub.1 +K.sub.g2 V.sub.2 +K.sub.g3 V.sub.3 +K.sub.g4 V.sub.4
FIGS. 14A to 14O are diagrams showing the input key signal K.sub.1 to K.sub.4, priority key signals K.sub.p1 to K.sub.p4, the mixed key signal K.sub.m, the video gain control signals K.sub.g1 to K.sub.g4, and the mixed video signals V.sub.m1 and V.sub.m2, respectively.
The video signal generators 11, 12, 53, and 54 output the input key signals K.sub.1 to K.sub.4 (shown in FIGS. 14A to 14D), respectively, to the key signal mixer 510. The key signal mixer 510 outputs the priority key signals K.sub.p1 to K.sub.p4 (shown in FIGS. 14E to 14H). In Example 3, the input key signals K.sub.1 to K.sub.4 have higher priorities in this order when mixed. Therefore, the priority key signals K.sub.p1 to K.sub.p4 have waveforms whose levels are limited in accordance with the levels of the input key signals K.sub.1 to K.sub.4 in their order of priority. For example, the input key signal K.sub.1 has a higher priority than that of the input key signal K.sub.2. Therefore, the priority key signal K.sub.p2 is limited to the zero level in regions where the input key signal K.sub.1 is at the full level (i.e., 1). The priority key signal K.sub.p2 is not limited in regions where the input key signal K.sub.1 is at the zero level, so that the input key signal K.sub.2 is output as the priority key signal K.sub.p2.
The mixed key signal K.sub.m has a waveform corresponding to the summation of the priority key signals K.sub.p1 to K.sub.p4, as shown in FIG. 14I.
The key signal division section 520 divides the priority key signals K.sub.p1 to K.sub.p4 (shown in FIGS. 14E to 14H) each by the mixed key signal K.sub.m (shown in FIG. 14I). The video gain control signals K.sub.g1 to K.sub.g4 which are the results of division, have waveforms obtained by subjecting the priority key signals K.sub.p1 to K.sub.p4 to non-linear gain controls, as shown in FIGS. 14J to 14M, respectively.
Thus, the video gain control signals K.sub.g1 to K.sub.g4 ensure that the video signal mixer 530 generates the mixed video signal V.sub.m1 as shown in FIG. 14N, in which the input video signal V.sub.1, the input video signal V.sub.2, the input video signal V.sub.3. and the input video signal V.sub.4 are mixed.
The video signal mixer 104 mixes the mixed video signals V.sub.m1 and the background video signal V.sub.b in accordance with the mixed key signal K.sub.m (shown in FIG. 14I). Therefore, the mixed video signal V.sub.m2 is a video signal in which the input video signals V.sub.1 to V.sub.4 are mixed and inserted into the background video signal V.sub.b as shown in FIG. 14O.
Thus, a desired video mix is achieved in the case where two input key signals are both at intermediate levels (i.e., levels larger than 0 and smaller than 1), without allowing non-linear mix characteristics to be generated due to multiple interaction of the key signals. Thus, one of the objectives of the present invention, i.e., video mix in the case where a plurality of input key signals are at intermediate levels, is achieved under the condition that the background video signal V.sub.b is led through the video signal mixer only once.
As in Example 1, in the case where the video signal mixer 104 for mixing the mixed video signal V.sub.m1 and the background video signal V.sub.b is provided in a video switcher, the video signal mixer 104 can be omitted from the video mixing apparatus 5 in Example 3. In other words, the video mixing apparatus 5 will function sufficiently without incorporating the video signal mixer 104 as long as they are capable of outputting the mixed video signal V.sub.m1 and the mixed key signal K.sub.m.
Although a case is illustrated in FIG. 13 in which four input key signals and four input video signals are employed, a video mixing apparatus for receiving and mixing a number N (where N is an integer of 3 or more) of input key signals and N input video signals can be similarly constructed as follows: A key signal mixer receives 1.sup.st to N.sup.th key signals, and generates and outputs (N+1).sup.th to 2N.sup.th key signals and a mixed key signal. Given that the 1.sup.st to 2N.sup.th key signals have levels K.sub.1 to K.sub.2N, respectively, K.sub.i =K.sub.i-N .multidot.(1-K.sub.i-N-1).multidot.(1-K.sub.i-N-2).multidot. . . . .multidot.(1-K.sub.1) holds for i=(N+1) to 2N (where K.sub.0 =0). Given that the mixed key signal has a level K.sub.m, K.sub.m =1-(1-K.sub.1).multidot.(1-K.sub.2).multidot. . . . .multidot.(1-K.sub.N). A key signal division section receives the (N+1).sup.th to 2N.sup.th key signals and the mixed key signal, and generates and outputs (2N+1).sup.th to 3N.sup.th key signals. Given that the (2N+1).sup.th to 3N.sup.th key signals have levels K.sub.2N+1 to K.sub.3N, respectively, K.sub.i =K.sub.i-N /K.sub.m holds for i=(2N+1) to 3N. A video signal mixer receives the 1.sup.st to N.sup.th video signals and the (2N+1).sup.th to 3N.sup.th key signals, and mixes the 1.sup.st to N.sup.th video signals at a mix ratio in accordance with the (2N+1).sup.th to 3N.sup.th key signals so as to generate and output an output video signal having a level of V.sub.m1. Specifically, given that the 1.sup.st to N.sup.th video signals are at levels V.sub.1 to V.sub.N, respectively, V.sub.m1 =V.sub.1 .multidot.K.sub.2N+1 +V.sub.2 .multidot.K.sub.2N+2 +. . . +V.sub.N .multidot.K.sub.3N holds.
(Example 4)
FIG. 15 is a block diagram showing a video mixing apparatus 6 according to Example 4 of the present invention. The video mixing apparatus 6 receives an input key signal K.sub.1 and an input video signal V.sub.1, which are output from a video signal generator 11, and a background video signal V.sub.b, which are output from a video signal generator 10, and mixes an image represented by the input video signal V.sub.1, a dropshadow of that image, and the background video signal V.sub.b so as to output a mixed video signal V.sub.m1.
A "dropshadow" is generally used for creating visual effect as if a video mix were performed three-dimensionally. For example, the dropshadow is generated by moving the input image toward right bottom corner of the screen of the display and by decreasing the luminance of the moved image. Where the input image and the dropshadow are overlapped on the screen, the input image is displayed with higher priority so as to be displayed as if the input image were positioned before the dropshadow and light were irradiated from left top corner of the screen.
The video mixing apparatus 6 includes a key signal mixer 101, a key signal division section 102, a video signal mixer 103, a video signal mixer 104, a shadow position controller 1521, a multiplier 1523, and a shadow image generator 1524.
The shadow position controller 1521 outputs a key signal K.sub.2 representing the dropshadow (which determines the position of the dropshadow) by shifting the position of the input key signal K.sub.1 on the display screen upward, downward, rightward, and/or leftward. In the case of a real-time video processing apparatus such as a video switcher, the shadow position controller 1521 can be realized by using a time delaying element. For an analog signal, the time delaying element is implemented by a delay line device. For a digital signal, on the contrary, the time delaying element is implemented by a first-in first-out (FIFO) type memory.
A key signal weighting unit 1522 weights the key signal K.sub.2 in order to perform a weighting operation for an image representing the dropshadow generated by the shadow image generator 1524. Due to this weighting, the level of the key signal varies depending on the location on the display screen. As a result, it becomes possible to add a pattern of light and shade to the image representing the dropshadow. The multiplier 1523 multiplies the key signal K.sub.2 output from the shadow position controller 1521 by a weighting pattern signal W.sub.2 output from the key signal weighting unit 1522, and outputs the result of multiplication to a key signal mixer 101. The video signal mixer 103 receives the input video signals V.sub.1 output from the video signal generator 11 and the input video signal V.sub.2 output from the shadow image generator 1524, mixes these video signals in accordance with a video gain control signal K.sub.g, and outputs the result of mix as the mixed video signal V.sub.m1 to the video signal mixer 104.
FIG. 16A is a diagram showing a state in which an image and its dropshadow are mixed with a background image. FIGS. 16B to 16J show the input key signals K.sub.1 and K.sub.2, the weighting pattern signal W.sub.2, an output signal K.sub.w2 which is output from the multiplier 1523, a priority key signal K.sub.p, a mixed key signal K.sub.m, the video gain control signal K.sub.g, and the mixed video signals V.sub.m1 and V.sub.m2, respectively. The weighting pattern signal W.sub.2 has a conical level distribution inside each shaded circular region in FIG. 16A, but is at the zero level outside each region. The multiplier 1523 multiplies the key signal K.sub.2 (shown in FIG. 16C) output from the shadow position controller 1521 by the weighting pattern signal W.sub.2 (shown in FIG. 16D). As a result, the output signal K.sub.w2 of the multiplier 1523 is trimmed so that only in a region where the dropshadow exists the weighting pattern signal W.sub.2 is output, as shown in FIG. 16E.
As for the mixed video signal V.sub.m1, which is output from the video signal mixer 103, the video signal V.sub.2 of the dropshadow output from the shadow image generator 1524 is output in the dropshadow region, and the input video signal V.sub.1 is output in regions other than the dropshadow region, as shown in FIG. 16I. The mixed video signal V.sub.m2 (shown in FIG. 16J) output from the video signal mixer 104 is a video signal in which the input video signal V.sub.1 and the video signal V.sub.2 of the dropshadow are mixed with the background video signal V.sub.b. By inputting the output signal K.sub.w2 to the key signal mixer 101 as a key signal (the output signal K.sub.w2 being obtained by multiplying the key signal K.sub.2 which is output from the shadow position controller 1521 by the weighting pattern signal W.sub.2), it becomes possible to modify the level of the input video signal V.sub.2 with the weighting pattern signal W.sub.2 before mixing the input video signal V.sub.2 with other video signals.
In the present example, the video signal V.sub.2 of the dropshadow (output from the shadow image generator 1524) is employed as one of the video signals to be input to the video signal mixer 103, and a key signal (i.e., K.sub.2) which is obtained by shifting the input key signal K.sub.1 on the display screen by use of the shadow position controller 1521 is multiplied by the weighting pattern signal W.sub.2. However, the same effect can also be attained in the case where the two video signals to be mixed in the video signal mixer 103 are both externally supplied and the key signal to be multiplied by the weighting pattern signal W.sub.2 is also externally supplied, that is, in the case where input video signals V.sub.1 and V.sub.2 are input to the video signal mixer 103 and an input key signal K.sub.1 corresponding to the input video signal V.sub.1 and V.sub.2 is input to the key signal mixer 101, an input key signal K.sub.2 corresponding to the input video signal V.sub.2 being multiplied by the weighting pattern signal at the multiplier 1523.
Although Example 4 described a case where the weighting pattern signal W.sub.2 output from the key signal weighting unit 1522 is a signal whose level varies depending on the location on the display screen, the same effect can also be attained in the case where the weighting pattern signal W.sub.2 has a constant level regardless of the location.
The key signal weighting unit 1522 and the multiplier 1523 are provided for one of the input key signals to the key signal mixer 101, i.e., K.sub.2, in Example 4. In the case where a key signal weighting unit and a multiplier are also provided for the other input key signal K.sub.1 in a similar manner (i.e., so that a key signal weighting unit and a multiplier are provided for the key signals K.sub.1 and K.sub.2 each), the above-mentioned effect of modifying the video signal level of the video signal V.sub.2 can also be attained for the video signal V.sub.1.
As in Example 1, in the case where the video signal mixer 104 for mixing the mixed video signal V.sub.m1 and the background video signal V.sub.b is provided in a video switcher, the video signal mixer 104 can be omitted from the video mixing apparatus 6. In other words, the video mixing apparatus 6 will function sufficiently without incorporating the video signal mixer 104 as long as they are capable of outputting the mixed video signal V.sub.m1 and the mixed key signal K.sub.m.
(Example 5)
FIG. 17 is a block diagram showing a video mixing apparatus 7 according to Example 5 of the present invention. The video mixing apparatus 7 has the same configuration as that of the video mixing apparatus 5 of Example 3 except that the video mixing apparatus 7 includes a key signal weighting unit 1761 and a multiplier 1762.
FIGS. 18A to 18P show the input key signals K.sub.i to K.sub.4, the weighting pattern signal K.sub.w4, priority key signals K.sub.p1 to K.sub.p4, a mixed key signal K.sub.m, video gain control signals K.sub.g1 to K.sub.g4, and mixed video signals V.sub.m1 and V.sub.m2, respectively.
The key signal mixer 510 receives the key signals shown in FIGS. 18A to 18C. The key signal weighting unit 1761 outputs a weighting pattern signal W.sub.4 which is at a 50% level (i.e., 0.5) of the full level (i.e., 1.0) regardless of the location on the display screen. The multiplier 1762 multiplies the input key signal K.sub.4 (shown in FIG. 18D) by the weighting pattern signal W.sub.4, and outputs the result of multiplication as the key signal K.sub.w4 (shown in FIG. 18E) to the key signal mixer 510. The key signal mixer 510 receives the input key signals K.sub.1 to K.sub.3 and K.sub.w4, and outputs the priority key signals K.sub.p1 to K.sub.p4 (shown in FIGS. 18F to 18I) to the signal division section 520. The priority key signals K.sub.p1 to K.sub.p4 are controlled so that their levels are limited in accordance with the levels of the input key signal K.sub.1 to K.sub.4 in their order of priorities. Herein, the input key signals K.sub.1 to K.sub.4 have higher priorities in this order. The mixed key signal K.sub.m has a waveform corresponding to the summation of the priority key signals K.sub.p1, K.sub.p2, K.sub.p3, and K.sub.p4, as shown in FIG. 18I.
The input key signal which has a higher priority than that of the input key signal K.sub.1 is the input key signal K.sub.2. Therefore, the priority key signal K.sub.p2 is limited to the zero level in regions where the input key signal K.sub.1 is at the full level (i.e., 1.0). The priority key signal K.sub.p2 is not limited in regions where the input key signal K.sub.1 is at the zero level, so that the input key signal K.sub.2 is output as the priority key signal K.sub.p2.
The key signal division section 520 divides the priority key signals K.sub.p1 to K.sub.p4 each by the mixed key signal K.sub.m. Therefore, the video gain control signals K.sub.g1 to K.sub.g4, which are the respective results of division, have waveforms obtained by subjecting the priority key signals K.sub.p1 to K.sub.p4 to non-linear gain controls, as shown in FIGS. 18K to 18N, respectively. Thus, the video gain control signals K.sub.g1 to K.sub.g4 ensure that the video signal mixer 530 generates the mixed video signal V.sub.m1 as shown in FIG. 180, in which the input video signal V.sub.1, the input video signal V.sub.2, the input video signal V.sub.3, and the input video signal V.sub.4 are mixed.
The video signal mixer 104 mixes the mixed video signals V.sub.m2 and the background video signal V.sub.b in accordance with the mixed key signal K.sub.m. Therefore, the mixed video signal V.sub.m2 is a video signal in which the input video signals V.sub.1 to V.sub.4 are inserted into the background video signal V.sub.b as shown in FIG. 18P. Thus, a linear mix is achieved even in the case where two input key signals are both at intermediate levels, without allowing square characteristics to be generated due to multiple interaction of the key signals.
Thus, one of the objectives of the present invention, i.e., video mix in the case where a plurality of input key signals are at intermediate levels, is achieved under the condition that the background video signal V.sub.b is led through the video signal mixer only once.
The key signal weighting unit 1761 and the multiplier 1762 are provided only for the input key signal K.sub.4 in Example 5. However, it is also applicable to provide a key signal weighting unit and a multiplier for the other input key signals K.sub.1, K.sub.2, and K.sub.3 in a similar manner. In this case, the above-mentioned effect of modifying the video signal level of the input video signal V.sub.4 (illustrated in Example 5) can also be attained for the input video signals V.sub.1, V.sub.2, and V.sub.3, respectively.
As in Example 1, in the case where the video signal mixer 104 for mixing the mixed video signal V.sub.m1 and the background video signal V.sub.b is provided in a video switcher, the video signal mixer 104 can be omitted from the video mixing apparatus 7. In other words, the video mixing apparatus 7 will function sufficiently without incorporating the video signal mixer 104 as long as they are capable of outputting the mixed video signal V.sub.m1 and the mixed key signal K.sub.m.
In the above-described Examples 1 to 5, the video signal generator which generates both a video signal and a key signal (e.g. video signal generators 11 and 12 in the Example 1) can be, for example, a character/graphic generator, a chromakey device, or a computer graphics device. On the other hand, the video signal generator which generates a video signal only (e.g. video signal generators 10 in the Example 1) can be, for example, a video cassette recorder, or a video camera.
In the above-described Examples 1 to 5, the background video signal V.sub.b only needs to be a video signal; for example, the background video signal V.sub.b can be an output video signal of an imaging apparatus or an output video signal of a video switcher. The input key signals and the input video signals are merely required to be a combination of key signals and video signals; for example, they can be output key signals of a flying spot apparatus and output video signals of a video signal recording apparatus. The mix priority key signal P.sub.r only needs to be a signal representing the mixing ratio of video mix; for example, the mix priority key signal P.sub.r can be an output key signal of a chromakey apparatus, instead of an output of a wipe waveform generator. Furthermore, the mixed video signal V.sub.m2 allows general use as a video signal, instead of being displayed by a display apparatus; for example, the mixed video signal V.sub.m2 can be recorded by a video signal recording apparatus or input to a video mixing apparatus for performing further mixing processes.
It is also applicable to employ the key signal weighting units described in Examples 4 and 5 in Examples 1 to 3. For example, in Example 1 (illustrated in FIG. 1), an output signal K.sub.w2 can be supplied to the key signal mixer 101, instead of the input key signal K.sub.2 output from the video signal generator 12.
The adders, subtracters, multipliers, and dividers in Examples 1 to 5 can be realized by using analog circuits or digital circuits. When they are implemented by digital circuits, the desired operations can be performed for key signals and video signals which have been converted into digital signals from analog signals. In such cases, it is applicable to employ a digital signal processor (DSP), for example, for high-precision and high-speed operations.
The internal structures of the key signal mixers and video signal mixers shown in FIGS. 2, 3, 6, 7, 9, 12, and 13 are not limited to those which are shown these figures. The adders, multipliers, etc. in the respective internal structures admit variations as long as the mixer shown in each figure provides the desired signal.
Various other modifications will be apparent to and can be readily made by those skilled in the art without departing from the scope and spirit of this invention. Accordingly, it is not intended that the scope of the claims appended hereto be limited to the description as set forth herein, but rather that the claims be broadly construed.

Number	Name	Date
4851912	Jackson et al.	Jul 1989
5305107	Gale et al.	Apr 1994
5353068	Moriwake	Oct 1994
5428401	Hinson	Jun 1995

Number	Date	Country
0 486 468	May 1992	EPX
0 586 140	Mar 1994	EPX
5-30350	May 1993	JPX
6-86163	Mar 1994	JPX

Video mixing apparatus

Information

Patent Number

Date Filed

Date Issued

Inventors

Original Assignees

Examiners

Agents

CPC

US Classifications

Field of Search

US

International Classifications

Abstract

Description

Claims

Priority Claims (1)

US Referenced Citations (4)

Foreign Referenced Citations (4)

Non-Patent Literature Citations (2)

Entry
Y. Oda, "Key Process Technique In Postproduction", Jul. 1994, (8 pages).
European Search Report dated Feb. 4, 1997.