This application claims the benefit of priority under U.S.C. 119 based on Japanese Patent Application No. 2023-023385 filed on Feb. 17, 2023, the entire contents of which are incorporated herein by reference.
The present disclosure relates to an image processing apparatus.
In a certain document, a screen aspect ratio conversion method for a television is described. In the method, an input video signal having a screen aspect ratio of 4:3 is displayed on a video apparatus having a screen aspect ratio of 16:9. In the screen aspect ratio conversion method described in the document, predetermined numbers of upper and lower scanning lines (for example, 30 lines each from an upper side and a lower side) are deleted from the input video signal having the screen aspect ratio of 4:3 (4 in a horizontal dimension to 3 in a vertical dimension). Then, the input video signal is time-compressed in a horizontal direction and thereafter displayed on a screen having the screen aspect ratio of 16:9 (16 in the horizontal dimension of 16 to 9 in the vertical dimension).
According to an aspect of the present disclosure, an image processing apparatus includes an image generator and a display adjuster. The image generator generates a content image. The display adjuster adjusts an aspect ratio of the content image. The content image is divided into plural partial content areas. The content image is displayed on a display screen. A predetermined adjustment priority is set for each of the partial content areas. The display adjuster adjusts the aspect ratio of the content image by changing an aspect ratio for each of the partial content areas on the basis of the adjustment priority.
A description will hereinafter be made on an embodiment with reference to the drawings. In the drawings, the same or corresponding portions will be denoted by the same reference signs, and the description thereon will not be repeated.
First, a description will be made on a configuration of an image processing apparatus 10 with reference to
The image processing apparatus 10 is mounted, for example, as a part of a personal computer (PC) or a smartphone. Alternatively, the image processing apparatus 10 may be a server.
The storage 12 stores various types of data, such as program data, required for operation of the image processing apparatus 10. The data stored in the storage 12 includes content data such as character data and image data. The storage 12 includes a storage device such as random access memory (RAM) or read only memory (ROM).
The communicator 14 relays data transmission/reception between the image processing apparatus 10 and another device (in particular, the display 50). The communicator 14 is a communication interface unit that performs communication conforming to a communication standard, such as a High-Definition Multimedia Interface (HDMI®) standard, used for the transmission/reception of the data including images and videos. For example, the communicator 14 receives the content data and the like from the outside of the image processing apparatus 10 (a server on the Internet, or the like) and stores the content data and the like in the storage 12. For example, the communicator 14 transmits, to the display 50, the data of the image to be displayed on the display screen 60.
The controller 20 includes a processor such as a central processing unit (CPU) or an application specific integrated circuit (ASIC). For example, when the processor of the controller 20 executes a program stored in the storage 12, the processor functions as the image generator 22 and the display adjuster 24. The controller 20 may include the plural processors. For example, the processor that implements a function as the image generator 22 and the processor that executes a function as the display adjuster 24 may be provided separately.
The image generator 22 generates a content image to be displayed on the display screen 60. The content image is an image that is divided into plural partial content areas. For example, the image generator 22 combines plural pieces of content data stored in the storage 12 to generate the content image in which a content corresponding to each piece of the content data is displayed in the respective partial content area.
The display adjuster 24 adjusts an aspect ratio of the content image generated by the image generator 22. For example, the display adjuster 24 adjusts the aspect ratio of the content image by reducing, enlarging, or partially deleting the content image.
The display 50 in
Next, a description will be made on an example of a content image 40 generated by the image generator 22 with reference to
The moving image area 42 is an area where a moving image is displayed. For example, a movie, a news video, and the like are displayed in the moving image area 42. The still image area 44 is an area where a still image is displayed. For example, an advertisement image, a weather map, and the like are displayed in the still image area 44.
The horizontal on-screen text area 46 is an area where a horizontal on-screen text is displayed. The horizontal on-screen text in
The vertical on-screen text area 47 is an area where a vertical on-screen text is displayed. The vertical on-screen text in
In the content image 40 illustrated in
For example, in the case where the storage 12 stores moving image data, still image data, and plural types of the character data are included in the storage 12, the image generator 22 generates the content image 40 including the moving image area 42, the still image area 44, the horizontal on-screen text area 46, and the vertical on-screen text area 47 as illustrated in
The data of the content image 40 generated by the image generator 22 is transmitted to the display 50 via the communicator 14. The display 50 displays the transmitted content image 40 on the display screen 60. However, depending on a characteristic of the display screen 60, the content image 40 may not be displayed appropriately (the content image 40 may not be displayed as intended by a creator of the content data on which the content image 40 is based). Next, a description will be made on an example of a case where the content image 40 is not displayed appropriately with reference to
In the display 50 such as the liquid-crystal display, the display screen 60 generally includes the plural pixels 61. As illustrated in
The pixel 61 illustrated in
However, for example, as illustrated in
In the case where the aspect ratio of the pixel 61 is not 1:1, the content image 40 is not displayed appropriately. For example, in the case where the ratio of length to width of the pixel 61 is 0.95:1, the content image 40 is displayed as an image that is reduced in the vertical direction from the original display thereof. More specifically, for example, a perfect circle included in the content image 40 is displayed as a horizontally long ellipse having 1 in the horizontal dimension to 0.95 in the vertical dimension.
Numerical information on the aspect ratio of the pixel 61 in the display screen 60 is confirmed at the time of manufacturing the display 50 and is stored in a storage (in particular, nonvolatile memory such as flash memory) of the display 50. For example, information on the pixel 61 is preferably included in a part of Extended Display Identification Data (EDID) that indicates information on an operation setting of the display 50.
The display adjuster 24 of the image processing apparatus 10 adjusts the aspect ratio of the content image 40 such that the content image 40 is appropriately displayed on the display screen 60. For example, the display adjuster 24 receives the numerical information on the aspect ratio of the pixel 61 from the display 50 and adjusts the aspect ratio of the content image 40 according to the aspect ratio of the pixel 61.
For example, in the case where the ratio of length to width of the pixel 61 is 0.95:1, the display adjuster 24 enlarges (stretches) the content image 40 by 100/95 times in the vertical direction. The content image 40 enlarged by 100/95 times in the vertical direction is appropriately displayed in terms of a shape thereof on the display screen 60 having the pixel 61 whose ratio of length to width is 0.95:1. For example, the perfect circle included in the content image 40 is also displayed as the perfect circle on the display screen 60.
However, a part of the content image 40 enlarged in the vertical direction is not displayed on the display screen 60. A description will be made on that the part of the content image 40 enlarged in the vertical direction by the display adjuster 24 is not displayed on the display screen 60 with reference to
As illustrated in
Meanwhile, in the lower portion of the content image 40, parts of lower portions of the horizontal on-screen text area 46 and the vertical on-screen text area 47 are located outside the range of the display screen 60. As a result, the parts of the lower portions of the horizontal on-screen text area 46 and the vertical on-screen text area 47 are not displayed. However, the on-screen text areas (the horizontal on-screen text area 46 and the vertical on-screen text area 47) often indicate relatively less important information of the content image 40. In particular, even in the case where a blank space (a portion in which the character string is not displayed) in the on-screen text area is not displayed on the display screen 60, information to be given out to a viewer is not changed in many cases.
The display adjuster 24 of the image processing apparatus 10 adjusts the aspect ratio differently for each of the partial content areas (in
A description will be made on that the aspect ratio is significantly changed for the partial content area having a high adjustment priority with reference to
The display adjuster 24 changes the aspect ratio of each of the partial content areas according to the aspect ratio of the pixel 61. The display adjuster 24 makes a significant change on the aspect ratio particularly for the on-screen text area having a high adjustment priority. More specifically, the display adjuster 24 changes the aspect ratio of the on-screen text area by reducing, enlarging, or partially deleting the on-screen text image. In particular, the display adjuster 24 preferably changes the aspect ratio of the on-screen text area by reducing, enlarging, or partially deleting the blank space in the on-screen text area. Even in the case where the on-screen text image (particularly, a portion corresponding to the blank space) in the on-screen text area is reduced, enlarged, or partially deleted, the viewer only develops a little sense of discomfort, and the information included in the content image 40 is not changed. Thus, the display adjuster 24 can appropriately adjust the aspect ratio of the content image 40 without losing the information included in the content image 40.
In the case where the higher adjustment priority is set for the partial content area of less importance, the display adjuster 24 changes the aspect ratio according to the importance of the partial content area. Accordingly, a scale of the change in the aspect ratio is small for the partial content area of high importance (the moving image area 42 and the like) while the scale of the change in the aspect ratio is large for the partial content area of low importance (the on-screen text area and the like). When the aspect ratio is significantly changed for the moving image area 42 (the area of high importance), the viewer develops the strong sense of discomfort. Meanwhile, when the aspect ratio is significantly changed for the on-screen text area (the area of low importance), the viewer develops the little sense of discomfort. Thus, the image processing apparatus 10 can appropriately display the content image 40 on the display screen 60 without giving the sense of discomfort to the viewer and without losing the information included in the content image 40. That is, in the image processing apparatus 10, when the aspect ratio of the content image 40 is adjusted, the appropriate aspect ratio adjustment processing is executed according to the content of the content image 40.
There is also a case where the content image 40 becomes smaller than the display screen 60 as a result of the fact that only the aspect ratio of the content image 40 is changed according to the aspect ratio of the pixel 61. For example, in the case where each of the partial content areas is reduced in the vertical direction, the entire content image 40 is reduced in the vertical direction. Then, the content image 40 becomes smaller than the display screen 60. In the case where the aspect ratio of the content image 40 does not match the aspect ratio of the display screen 60 as a result of the reduction of the entire content image 40 in the vertical direction, the display adjuster 24 preferably changes the aspect ratio of the on-screen text area by enlarging the on-screen text image in the on-screen text area in the vertical direction.
The partial content area having the second highest adjustment priority after the on-screen text area is the still image area 44 where the still image is displayed. In the case where it is difficult to make the aspect ratio of the content image 40 match the aspect ratio of the display screen 60 only by changing the aspect ratio of the on-screen text area, the display adjuster 24 can also change the aspect ratio of the still image area 44.
For example, in the case where the aspect ratio of the pixel 61 significantly deviates from 1:1, or in the case where the content image 40 having the aspect ratio of 4:3 is displayed on the display screen 60 having the aspect ratio of 16:9, the display adjuster 24 has to make the significant adjustment in the aspect ratio of the content image 40. In the case where the display adjuster 24 makes the significant adjustment in the aspect ratio of the content image 40 and only changes the aspect ratio of the on-screen text area, the on-screen text area becomes extremely large or extremely small. The content image 40 with the extremely large or extremely small on-screen text area possibly gives the sense of discomfort to the viewer. By changing the aspect ratio not only for the on-screen text area but also for the still image area 44, the display adjuster 24 can lessen the sense of discomfort given to the viewer by the content image 40. Since the adjustment priority of the still image area 44 is lower than that of the on-screen text area, the scale of the change in the aspect ratio of the still image area 44 is preferably smaller than the scale of the change in the aspect ratio of the on-screen text area.
The display adjuster 24 may change the aspect ratio of the on-screen text area by reducing, enlarging, or partially deleting the on-screen text image after reducing or enlarging a character size in the on-screen text image. By reducing, enlarging, or partially deleting the on-screen text image after reducing or enlarging the character size in the on-screen text image, the display adjuster 24 can change the aspect ratio of the on-screen text area without changing the information indicated in the on-screen text area.
As an example, a description will be made on a case where the character size of the on-screen text image in the horizontal on-screen text area 46 is reduced with reference to
When the deletion range 68 is deleted together with the part of the character 71, the information indicated in the horizontal on-screen text area 46 is possibly changed. In the case where it is assumed that the part (or a whole) of the character 71 is included in the deletion range 68, the display adjuster 24 reduces the character size of the character 71 and thereby changes the character 71 to a small-sized character 72, so as to prevent the change in the information indicated in the horizontal on-screen text area 46. The small-sized character 72 is no longer included in the deletion range 68. Thus, by deleting the deletion range 68 after reducing the character size of the character 72, the display adjuster 24 can change the aspect ratio of the horizontal on-screen text area 46 without changing the information indicated in the horizontal on-screen text area 46. Instead of deleting the deletion range 68 after reducing the character size of the character 72, the display adjuster 24 may reduce the size of the on-screen text image in the horizontal on-screen text area 46 such that the deletion range 68 fits within the display screen 60.
In the case where it is necessary to enlarge the horizontal on-screen text area 46, the display adjuster 24 may enlarge the character 72 of the on-screen text image and then enlarge the on-screen text image in the horizontal on-screen text area 46. When the character 72 of the on-screen text image is enlarged and then the on-screen text image in the horizontal on-screen text area 46 is enlarged, a size ratio between the character 72 and the blank space in the enlarged on-screen text image becomes equal to the ratio in the on-screen text image before the enlargement. Thus, the viewer hardly develops the sense of discomfort. Also, in regard to the vertical on-screen text area 47, the display adjuster 24 may change the aspect ratio of the vertical on-screen text area 47 by reducing, enlarging, or partially deleting the on-screen text image after reducing or enlarging the character size of the on-screen text image.
Next, a description will be made on the change of the aspect ratio in the still image area 44 with reference to
As illustrated in
When the display adjuster 24 reduces, enlarges, or partially deletes the still image area 44, it is preferred to reduce, enlarge, or partially delete only a portion of relatively low importance in the still image area 44. In particular, the display adjuster 24 preferably changes the aspect ratio of the still image area 44 by reducing, enlarging, or partially deleting the background portion 77 in the still image area 44.
As an example, a description will be made that the still image area 44 is partially deleted. As illustrated in
The display adjuster 24 preferably determines the person portion 76 and the background portion 77 of the still image area 44 by image analysis. For example, preferably, a portion having a large color change rate in the still image area 44 is extracted as a contour, a portion surrounded by the contour is determined as the person portion 76 (or some article), and a portion outside the contour is determined as the background portion 77.
Next, a description will be made on an operation flow of the image processing apparatus 10 with reference to
Then, in step S11, the display adjuster 24 of the controller 20 determines whether to adjust the aspect ratio of the content image 40 in consideration of the characteristic of the display screen 60 on which the content image 40 is to be displayed.
For example, the display adjuster 24 receives EDID information from the display 50 and checks the aspect ratio of the pixel 61 in the display screen 60. In the case where the aspect ratio of the pixel 61 is not 1:1, it is necessary to adjust the aspect ratio of the content image 40. In addition, in the case where the aspect ratio of the content image 40 differs from the aspect ratio of the display screen 60 (for example, in the case where one of the aspect ratios is 4:3 and the other aspect ratio is 16:9), it is also necessary to adjust the aspect ratio of the content image 40.
After determining whether to adjust the aspect ratio of the content image 40, in step S12, the display adjuster 24 enlarges or reduces the entire content image 40 in the vertical direction or the horizontal direction according to the characteristic of the display screen 60 (the aspect ratio of the pixel 61 or the aspect ratio of the entire display screen 60). If it is determined in step S11 that the adjustment of the aspect ratio is unnecessary, the processing in step S12 may be skipped. However, enlargement processing or reduction processing of the content image 40 with magnification of 1 (processing in which substantially no change is made) may be executed.
Then, in step S13, the display adjuster 24 changes the aspect ratio for each of the partial content areas on the basis of a display priority of each of the partial content areas. In step S13, the aspect ratio is changed for each of the partial content areas such that the aspect ratio of the content image 40 matches the aspect ratio of the display screen 60.
In step S13, the aspect ratio of the partial content area having a high adjustment priority (for example, the on-screen text area) is preferentially changed. For example, while the blank space in the on-screen text area is largely deleted, the moving image area 42 is not changed.
When the display adjuster 24 changes the aspect ratio for each of the partial content areas to make the aspect ratio of the content image 40 match the aspect ratio of the display screen 60, the image processing apparatus 10 transmits the content image 40 to the display 50 and displays the content image 40 on the display screen 60. Then, the image processing apparatus 10 waits until receiving the next command to display the content image 40 (END).
The description has been made so far on the embodiment of the present disclosure with reference to the drawings. However, the present disclosure is not limited to the embodiment described above, and can be implemented in various aspects without departing from the gist thereof. To facilitate understanding, the drawings mainly and schematically illustrate the constituent elements, and thicknesses, lengths, the numbers, intervals, and the like of the illustrated constituent elements differ from those in reality for convenience of production of the drawings. In addition, materials, shapes, dimensions, and the like of the constituent elements in the embodiment described above are merely examples, and the present disclosure is not particularly limited thereto. It is needless to say that various modifications can be made thereto without substantially departing from the configuration of the present disclosure.
Number | Date | Country | Kind |
---|---|---|---|
2023-023385 | Feb 2023 | JP | national |