The present invention relates to a scanning line interpolation apparatus and a scanning line interpolation method which interpolate a scanning line for an image signal.
Conventionally, as a scanning line interpolation apparatus which performs processing of interpolating a scanning line, such as conversion of a video signal for which interlace scan has been performed into a video signal for which progressive scan has been performed, there has been known a scanning line interpolation apparatus having a function (hereinafter, referred to as oblique interpolation function) of determining a pixel value of an interpolation target pixel, based on a correlation between at least two pixels positioned in an oblique direction as seen from the interpolation target pixel (for example, see Patent Document 1). The scanning line interpolation apparatus having the oblique interpolation function is capable of appropriately reproducing an oblique edge.
Patent Document 1: Japanese Laid-Open Patent Publication No. H11-146346
The interpolation processing section 90 includes an angle detection section 901, an oblique interpolation processing section 902, a vertical interpolation processing section 903, and a selection section 904. By referring to an upper line video signal which is a video signal on a scanning line next to and above the interpolation target pixel, and to a lower line video signal which is a video signal on a scanning line next to and below the interpolation target pixel, the angle detection section 901 detects whether or not the interpolation target pixel is on an oblique edge, and when the interpolation target pixel is on an oblique edge, detects the angle of the oblique edge (that is, detects the angle or the slope of the edge with respect to a reference direction (for example, horizontal direction or vertical direction)). Note that even if the interpolation target pixel is on an oblique edge, when the angle of the oblique edge is almost horizontal, the angle detection section 901 cannot detect the angle of the oblique edge. The oblique interpolation processing section 902 determines an oblique interpolation pixel value, based on a pixel value of a pixel, positioned in the direction indicated by the angle detected by the angle detection section 901, as seen from the interpolation target pixel. The vertical interpolation processing section 903 determines a vertical interpolation pixel value, based on a pixel value of a pixel positioned in the direction vertical to a scanning line, as seen from the interpolation target pixel. The selection section 904 outputs the oblique interpolation pixel value outputted from the oblique interpolation processing section 902, as a pixel value of an interpolation target pixel in an area, of the image, from which the angle of an oblique edge has been detected by the angle detection section 901, and outputs the vertical interpolation pixel value outputted from the vertical interpolation processing section 903, as a pixel value of an interpolation target pixel in an area, of the image, from which the angle of an oblique edge has not been detected by the angle detection section 901.
However, when a scanning line is interpolated for a video signal including an edge whose angle gradually varies as shown in
Therefore, an object of the present invention is to provide a scanning line interpolation apparatus and a scanning line interpolation method which are capable of reducing unnaturalness at the boundary between, of the edge whose angle gradually varies, a part (oblique area) for which oblique interpolation has been performed and a part (non-oblique area) for which vertical interpolation has been performed.
To achieve the above objects, the present invention has the following aspects. Note that the reference numerals in the parentheses merely indicate an exemplary correspondence with the drawings so as to aid in understanding the present invention, and are not intended to limit, in any way, the scope of the present invention.
A scanning line interpolation apparatus of the present invention is a scanning line interpolation apparatus which interpolates a scanning line for an image signal, the scanning line interpolation apparatus comprising an interpolation processing section (10), and a nonuniform sharpening section (20). The interpolation processing section detects an angle of an edge in an image (11), and which, based on the detected angle, determines a pixel value of an interpolation target pixel in an oblique area (
Note that the scanning line interpolation apparatus may further comprise a horizontal edge detection section (23) which detects a horizontal edge that is an edge extending almost parallel to a scanning line in the image, and the nonuniform sharpening section may perform sharpening processing more strongly for a horizontal edge part (
Moreover, the horizontal edge detection section may further detect an intensity of the horizontal edge, and the nonuniform sharpening section may perform stronger sharpening processing for a part, of the non-oblique area, in which the horizontal edge has a greater intensity.
Alternatively, the nonuniform sharpening section may change a strength at which sharpening processing is performed for a part of the horizontal edge part of the non-oblique area, based on a distance from the part of the horizontal edge part to the oblique area which is continuous from the horizontal edge part
Moreover, when the distance is smaller than a predetermined threshold value, the nonuniform sharpening section may perform sharpening processing more strongly for the part of the horizontal edge part than when the distance is larger than the predetermined threshold value.
A scanning line interpolation method of the present invention is a scanning line interpolation method of interpolating a scanning line for an image signal, the scanning line interpolation method comprising an interpolation processing step, and a nonuniform sharpening step. In the interpolation processing step, an angle of an edge in an image is detected, and based on the detected angle, a pixel value of an interpolation target pixel in an oblique area in which there is an oblique edge is determined by performing oblique interpolation, and a pixel value of an interpolation target pixel in a non-oblique area which is an area excluding the oblique area is determined by performing vertical interpolation. In the nonuniform sharpening step, sharpening processing is performed, in a direction vertical to a scanning line, more strongly for the non-oblique area in the image for which a scanning line has been interpolated in the interpolation processing step, than for the oblique area.
Note that the scanning line interpolation method may further comprise a horizontal edge detection step of detecting a horizontal edge that is an edge extending almost parallel to a scanning line in the image, and in the nonuniform sharpening step, sharpening processing may be performed more strongly for a horizontal edge part of the non-oblique area than for the oblique area.
Moreover, in the horizontal edge detection step, an intensity of the horizontal edge may be further detected, and in the nonuniform sharpening step, stronger sharpening processing may be performed for a part, of the non-oblique area, in which the horizontal edge has a greater intensity.
Alternatively, in the nonuniform sharpening step, a strength at which sharpening processing is performed for a part of the horizontal edge part of the non-oblique area may be changed, based on a distance from the part of the horizontal edge part to the oblique area which is continuous from the horizontal edge part.
Moreover, in the nonuniform sharpening step, when the distance is smaller than a predetermined threshold value, sharpening processing may be performed more strongly for the part of the horizontal edge part than when the distance is larger than the predetermined threshold value.
According to the present invention, unnaturalness at the boundary between, of the edge whose angle gradually varies, a part (oblique area) for which oblique interpolation has been performed and a part (non-oblique area) for which vertical interpolation has been performed, can be reduced.
Hereinafter, various embodiments of the present invention will be described with reference to the drawings.
The interpolation processing section 10 generates an interpolation video signal, based on an upper line video signal and a lower line video signal. Specifically, the interpolation processing section 10 has a function of detecting the angle of an edge in an image, and of, based on the detected angle, determining a pixel value of an interpolation target pixel in an oblique area in which there is an oblique edge by performing oblique interpolation, and determining a pixel value of an interpolation target pixel in a non-oblique area which is an area excluding the oblique area by performing vertical interpolation. The details of the interpolation processing section 10 will be described later.
The nonuniform sharpening section 20 performs sharpening processing, in the direction vertical to the scanning line, more strongly for the non-oblique area in the image for which a scanning line has been interpolated by the interpolation processing section 10, than for the oblique area. The details of the nonuniform sharpening section 20 will be described later.
The motion detection section 30 and the mixing section 40 provide a so-called motion adaptive IP conversion function, and the function is known art which is not particularly relevant to the present invention. Therefore, the detailed description thereof is omitted.
Next, with reference to
The angle detection section 11 detects the angle of an edge in an image. More specifically, by referring to an upper line video signal which is a video signal on a scanning line next to and above an interpolation target pixel, and to a lower line video signal which is a video signal on a scanning line next to and below the interpolation target pixel, the angle detection section 11 detects whether or not the interpolation target pixel is on an oblique edge, and when the interpolation target pixel is on an oblique edge, detects the angle of the oblique edge.
The oblique interpolation processing section 12 determines an oblique interpolation pixel value, based on a pixel value of a pixel positioned in the direction indicated by the angle detected by the angle detection section 11, as seen from the interpolation target pixel. Note that although oblique interpolation is performed based on an upper line video signal and a lower line video signal here, oblique interpolation may be performed by also considering a video signal on a scanning line above the scanning line on which the upper line video signal is positioned or a video signal on a scanning line below the scanning line on which the lower line video signal is positioned. Various algorithms have been conventionally devised as an algorithm of oblique interpolation processing, and such various algorithms can be adopted in the present invention.
The vertical interpolation processing section 13 determines a vertical interpolation pixel value, based on a pixel value of a pixel positioned in the direction vertical to a scanning line, as seen from the interpolation target pixel. Note that although vertical interpolation is performed based on an upper line video signal and a lower line video signal here, vertical interpolation may be performed by also considering a video signal on a scanning line above the scanning line on which the upper line video signal is positioned or a video signal on a scanning line below the scanning line on which the lower line video signal is positioned.
The selection section 14 selects an oblique interpolation pixel value outputted from the oblique interpolation processing section 12, as a pixel value of an interpolation target pixel in an area, of the image, from which the angle of an oblique edge has been detected by the angle detection section 11, and selects a vertical interpolation pixel value outputted from the vertical interpolation processing section 13, as a pixel value of an interpolation target pixel in an area, of the image, from which the angle of an oblique edge has not been detected by the angle detection section 11, thereby outputting an interpolation video signal.
Note that the angles of oblique edges detected by the angle detection section 11 vary in reliability. For example, the accuracy of detecting the angle of an oblique edge in an image having a relatively high contrast is relatively high, while the accuracy of detecting the angle of an oblique edge in an image having a relatively low contrast is relatively low. Considering the above, in an example of variations, the angle detection section 11 may calculate the degree of reliability of the angle of the detected oblique edge, and the selection section 14 may mix the oblique interpolation pixel value outputted from the oblique interpolation processing section 12, with the vertical interpolation pixel value outputted from the vertical interpolation processing section 13, at an adequate ratio in accordance with the degree of reliability of the angle of the oblique edge detected by the angle detection section 11, and output the resultant signal as a pixel value of the interpolation target pixel.
Next, with reference to
The nonuniform sharpening section 20a includes a sharpening processing section 21 and a selection section 22.
The sharpening processing section 21 performs sharpening processing, in the direction vertical to a scanning line, on the interpolation video signal outputted from the interpolation processing section 10. In general, when a scanning line is interpolated based on an upper line video signal and a lower line video signal, an image appears blurred at an edge (contour line or border line) extending in the horizontal direction or in the direction nearly equal to the horizontal direction. However, the blur is remedied in a certain degree by performing sharpening processing in the direction vertical to a scanning line.
The selection section 22 selects one of the interpolation video signal outputted from the interpolation processing section 10, and the interpolation video signal which has been sharpened by the sharpening processing section 21, in accordance with a signal (signal indicating whether or not an oblique edge has been detected) outputted from the angle detection section 11, and outputs the selected interpolation video signal as an output signal. Specifically, the interpolation video signal outputted from the interpolation processing section 10 is selected for an area (hereinafter, referred to as oblique area), of the entire area of the image, from which an oblique edge has been detected, and the interpolation video signal outputted from the sharpening processing section 21 is selected for an area (hereinafter, referred to as non-oblique area), of the entire area of the image, from which an oblique edge has not been detected. Note that in an example of variations, similarly to the aforementioned selection section 14, the selection section 22 may mix the oblique interpolation pixel value outputted from the oblique interpolation processing section 12, with the vertical interpolation pixel value outputted from the vertical interpolation processing section 13, at an adequate ratio in accordance with the degree of reliability of the angle of the oblique edge, and output the resultant signal.
Note that although in the present embodiment, sharpening processing is not performed for an oblique area, the present invention is not limited thereto. Only by performing sharpening processing more strongly for a non-oblique area than for an oblique area, unnaturalness at the boundary is remedied.
Next, a scanning line interpolation apparatus according to a second embodiment of the present invention will be described. Note that the second embodiment and the first embodiment are different from each other only in the nonuniform sharpening section 20. Therefore, only the nonuniform sharpening section 20 will be described in detail here.
The sharpening processing section 21 performs sharpening processing, in the direction vertical to a scanning line, on the interpolation video signal outputted from the interpolation processing section 10.
The horizontal edge detection section 23 detects an edge (horizontal edge) extending in the direction along a scanning line or the direction nearly equal to the direction along a scanning line, based on the upper line video signal and the lower line video signal (as necessary, a video signal on a scanning line above the scanning line on which the upper line video signal is positioned or a video signal on a scanning line below the scanning line on which the lower line video signal is positioned may also be considered). Any known technique such as a method using a Sobel filter can be used as a method of detecting the horizontal edge. The horizontal edge detection section 23 detects the area B (horizontal edge part) in
The selection section 22 selects one of the interpolation video signal outputted from the interpolation processing section 10, and the interpolation video signal which has been sharpened by the sharpening processing section 21, in accordance with a signal (signal indicating whether or not an oblique edge has been detected) outputted from the angle detection section and a signal (signal indicating whether or not a horizontal edge has been detected) outputted from the horizontal edge detection section 23, and outputs the selected interpolation video signal as an output signal. Specifically, the interpolation video signal outputted from the interpolation processing section 10 is selected for, of the entire area of the image, the oblique area (area A in
As described above, according to the second embodiment, sharpening processing is performed, in the vertical direction, for the horizontal edge part. Therefore, unnaturalness at the boundary as shown in
Next, a scanning line interpolation apparatus according to a third embodiment of the present invention will be described. Note that the third embodiment and the first embodiment are different from each other only in the nonuniform sharpening section 20. Therefore, only the nonuniform sharpening section 20 will be described in detail here.
The sharpening processing section 21 performs sharpening processing, in the direction vertical to a scanning line, on the interpolation video signal outputted from the interpolation processing section 10.
The horizontal edge intensity detection section 25 detects the intensity of an edge (horizontal edge) extending in the direction along a scanning line or the direction nearly equal to a direction along a scanning line, based on the upper line video signal and the lower line video signal (as necessary, a video signal on a scanning line above the scanning line on which the upper line video signal is positioned or a video signal on a scanning line below the scanning line on which the lower line video signal is positioned may also be considered). Any known technique such as a method using a Sobel filter can be used as a method of detecting the intensity of the horizontal edge. The horizontal edge intensity detection section 25 figures out the degree in which the horizontal edge stands out.
The mixing section 24 mixes the interpolation video signal outputted from the interpolation processing section 10, with the interpolation video signal which has been sharpened by the sharpening processing section 21, at an adequate ratio in accordance with a signal (signal indicating whether or not an oblique edge has been detected) outputted from the angle detection section 11 and a signal (signal indicating the intensity of the horizontal edge) outputted from the horizontal edge intensity detection section 25, and outputs the resultant signal as an output signal. Specifically, the interpolation video signal outputted from the interpolation processing section 10 is selected and outputted for the oblique area (area A in
As described above, according to the third embodiment, sharpening processing is performed, in the vertical direction, more strongly for a horizontal edge part which relatively stands out, the horizontal edge part which relatively stands out appears increasingly clear, and unnaturalness at the boundary is further remedied.
Next, a scanning line interpolation apparatus according to a fourth embodiment of the present invention will be described. Note that the fourth embodiment and the first embodiment are different from each other only in the nonuniform sharpening section 20. Therefore, only the nonuniform sharpening section 20 will be described in detail here.
The sharpening processing section 21 performs sharpening processing, in the direction vertical to a scanning line, on the interpolation video signal outputted from the interpolation processing section 10.
The horizontal edge detection section 23 detects a horizontal edge, based on the upper line video signal and the lower line video signal (as necessary, a video signal on a scanning line above the scanning line on which the upper line video signal is positioned or a video signal on a scanning line below the scanning line on which the lower line video signal is positioned may also be considered).
The boundary distance detection section 27 calculates the distance from a pixel to the boundary (that is, as shown in
The mixing section 26 mixes the interpolation video signal outputted from the interpolation processing section 10, with the interpolation video signal which has been sharpened by the sharpening processing section 21, at an adequate ratio in accordance with a signal (signal indicating whether or not an oblique edge is detected) outputted from the angle detection section 11, a signal (signal indicating whether or not a horizontal edge is detected) outputted from the horizontal edge detection section 23, and a signal (signal indicating the distance from the pixel to the boundary) outputted from the border distance detection section 27, and outputs the resultant signal as an output signal. Specifically, the interpolation video signal outputted from the interpolation processing section 10 is selected and outputted for, of the entire area of the image, the oblique area (area A in
As described above, according to the fourth embodiment, sharpening processing is performed, in the vertical direction, more strongly for, particularly, a part, of a horizontal edge part, which is near to the boundary. Therefore, the part, of the horizontal edge part, which is near to the boundary appears increasingly clear, and unnaturalness at the boundary is further remedied.
According to the present invention, unnaturalness at the boundary between, of the edge whose angle gradually varies, a part for which oblique interpolation has been performed and a part for which vertical interpolation has been performed, can be reduced. Therefore, the present invention can be preferably applied to, for example, a progressive scan conversion apparatus which converts a video signal for which interlace scan has been performed into a video signal for which progressive scan has been performed.
Number | Date | Country | Kind |
---|---|---|---|
2007-276726 | Oct 2007 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2008/002857 | 10/9/2008 | WO | 00 | 4/20/2010 |