This application claims priority to Taiwan Application Serial Number 112138824, filed Oct. 11, 2023, which is herein incorporated by reference.
The present disclosure relates to an image processing technology. More particularly, the present disclosure relates to an image processing apparatus and an image processing method capable of optimizing a stitched image automatically.
As modern consumers' demands for audio and video playback continue to increase, large-sized image applications can be seen everywhere in daily life, for example, electronic menus, video walls, driving simulation games, etc. The cost of a large-sized display device is much higher than the solution of using multiple small-sized display devices to stitch, and large-sized display devices also have a higher failure rate. Therefore, the current mainstream is to use multiple small-sized display devices to provide a stitched picture. However, the amount of output terminals of the video signal source may not be sufficient to drive the required amount of small-sized display devices, and the transmission interface of the video signal source may not be compatible with some small-sized display devices.
For the foregoing reason, there is a need to solve the above-mentioned problems by providing an image processing apparatus and an image processing method.
The present disclosure provides an image processing apparatus, which includes an output circuit, a processing circuit, and a receiving circuit. The output circuit includes multiple connection ports, and is configured to perform handshakes through connected ones of the multiple connection ports to respectively obtain multiple display capability data through the connected ones of the multiple connection ports. The output circuit is further configured to output multiple picture data through the connected ones of the multiple connection ports, respectively. The processing circuit is coupled with the output circuit, and is configured to determine a stitching mode resolution according to the multiple display capability data. The receiving circuit is coupled with the processing circuit, and is configured to perform handshakes according to the stitching mode resolution in order to obtain a first image having the stitching mode resolution. The processing circuit is configured to slice the first image into multiple sub-images respectively corresponding to the multiple display capability data, and is configured to generate the multiple picture data respectively including the multiple sub-images.
The present disclosure also provides an image processing method. The image processing method includes the following steps: performing handshakes through connected ones of multiple connection ports of an output circuit to respectively obtain multiple display capability data through the connected ones of the multiple connection ports; determining a stitching mode resolution according to the multiple display capability data through a processing circuit, in which the processing circuit is coupled with the output circuit; performing handshakes according to the stitching mode resolution through a receiving circuit in order to obtain a first image having the stitching mode resolution; slicing the first image into multiple sub-images respectively corresponding to the multiple display capability data through the processing circuit so as to generate multiple picture data respectively including the multiple sub-images; and outputting the multiple picture data through the connected ones of the multiple connection ports, respectively.
The above image processing apparatus and image processing method can automatically optimize the stitched image according to the amount and positioning methods of the display devices.
It is to be understood that both the foregoing general description and the following detailed description are by examples, and are intended to provide further explanation of the disclosure as claimed.
The disclosure can be more fully understood by reading the following detailed description of the embodiment, with reference made to the accompanying drawings as follows:
Reference will now be made in detail to the present embodiments of the disclosure, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the description to refer to the same or like parts or method flow.
Reference is made to
The output circuit 110 includes multiple connection ports CPa_1-CPa_5. Each of the connection ports CPa_1-CPa_5 can be configured to be communicatively connected with a display device. For example, the connection ports CPa_1-CPa_4 are communicatively connected with the display devices 103_1-103_4 respectively, that is, the connection ports CPa_1-CPa_4 are in a connected state. The output circuit 110 is configured to perform handshakes with the display devices 103_1-103_4 through the connected connection ports CPa_1-CPa_4, so as to respectively obtain multiple display capability data DD1-DD4 from the display devices 103_1-103_4 through the connected connection ports CPa_1-CPa_4. The output circuit 110 is further configured to respectively output multiple picture data (not shown in the figure) to the display devices 103_1-103_4 through the connected connection ports CPa_1-CPa_4. The multiple picture data respectively include multiple sub-images PD1-PD4. In some embodiments, each of the display capability data DD1-DD4 includes: a pose, a relative positional relationship with other display devices, a size, a supported resolution, or any combination thereof of its corresponding display device. The aforementioned “pose” includes three-dimensional spatial coordinates and/or rotation angle(s) on one or more coordinate axes of the display device.
The processing circuit 120 is coupled with the output circuit 110, and is configured to determine a stitching mode resolution ST according to the display capability data DD1-DD4. The receiving circuit 130 is coupled with the processing circuit 120, and is configured to receive the stitching mode resolution ST from the processing circuit 120. The receiving circuit 130 is further communicatively connected with the video source VS through one or more connection ports (to simplify matters,
In some embodiments, each of the connection ports CPa_1-CPa_4 and the connection port CPb is one of the following: a universal serial bus Type-C (USB Type-C), a display port, a high-definition multimedia interface (HDMI), and a mobile industry processor interface (MIPI). It should be understood that an amount of the connection ports CPa_1-CPa_5 is only an embodiment taken for example, and is not intended to limit the scope of the present disclosure.
Reference is further made to
For example, in the embodiment of
For another example, in the embodiment of
In summary, an amount of pixels along at least one axis in the stitching mode resolution ST is N times as dense as an amount of pixels along a corresponding axis in a maximal supported resolution or a minimal supported resolution. N is a positive integer greater than or equal to 2.
Then, in step S230 of
In step S240, the image slicing circuit 124 of the processing circuit 120 is configured to receive the first image IMa from the receiving circuit 130, and is configured to slice the first image IMa into the multiple sub-images PD1-PD4 respectively corresponding to the display capability data DD1-DD4. In addition, the image slicing circuit 124 is further configured to generate the multiple picture data respectively including the multiple sub-images PD1-PD4.
After that, in step S250, the output circuit 110 receives the multiple picture data from the image slicing circuit 124 and outputs the multiple picture data respectively through the connected connection ports CPa_1-CPa_4, so that the display devices 103_1-103_4 display the sub-images PD1-PD4 correspondingly.
In the following, how the image slicing circuit 124 generates the sub-images PD1-PD4 in step S240 in different embodiments is described. It is noted that, in the following description multiple parameters (for example, image content and resolution) of the sub-images PD1-PD4 are determined by the analysis circuit 122 according to the display capability data DD1-DD4 in step S220, and these parameters are stored in a memory circuit (not shown in the figure) of the image slicing circuit 124. However, the present disclosure is not limited in this regard. In some embodiments, the image slicing circuit 124 can receive the display capability data DD1-DD4 from the analysis circuit 122 in step S240, and determine the parameters of the sub-images PD1-PD4 by itself.
In some embodiments, the analysis circuit 122 determines the resolution of each of the multiple sub-images PD1-PD4 according to an amount of the display devices 103_1-103_4 represented by the display capability data DD1-DD4 (for example, 4), and according to the relative positional relationships of the display devices 103_1-103_4 recorded in the display capability data DD1-DD4. For example, in the embodiment of
In some embodiments, the analysis circuit 122 can further determine whether to further adjust the resolutions of the sub-images PD1-PD4 or not after slicing according to the supported resolutions of the display devices 103_1-103_4 recorded in the display capability data DD1-DD4. For example, when the supported resolutions of the display devices 103_1-103_4 are respectively 2K, HD, HD, and 2K, the analysis circuit 122 can control the image slicing circuit 124 to reduce the resolutions of the sub-images PD1 and PD2 from 2K to HD, and vice versa.
In some embodiments, the analysis circuit 122 will control the image slicing circuit 124 to slice the first image IMa according to the relative positional relationships of the display devices 103_1-103_4 recorded in the display capability data DD1-DD4. For example, in the embodiment of
Reference is further made to
The analysis circuit 122 will determine whether a height difference 510 between two adjacent rows (for example, the rows R1-R2) in the matrix 500 exceeds a height threshold (for example, 2 inches) or not and determine whether a width difference 520 between two adjacent columns (for example, the columns C1-C2) in the matrix 500 exceeds a width threshold (for example, 2 inches) or not, so as to determine whether to further adjust the resolutions of sub-images PD1˜PD4 or not after slicing. In greater detail, as shown in
Similarly, under the circumstances that the analysis circuit 122 determines that (1). the display devices 103_1-103_4 are arranged in the matrix 500 so the sub-images PD1-PD4 are used to form the rectangular stitched picture, and (2). the widths of the two adjacent columns C1-C2 in the matrix 500 are different and the width difference 520 is lower than the width threshold, the analysis circuit 122 controls the image slicing circuit 124 to reduce a horizontal resolution of the sub-image PD4 of the column C1. As a result, a black area 540 will be displayed in part of the display device 103_4 when the stitched picture is displayed.
In some other embodiments, under the circumstances that the analysis circuit 122 determines that (1) the display devices 103_1-103_4 are arranged in the matrix 500 so the sub-images PD1-PD4 are used to form the rectangular stitched image, and (2) the height difference 510 between the adjacent rows R1-R2 in the matrix 500 is higher than or equal to the height threshold or the width difference 520 between the adjacent columns C1-C2 in the matrix 500 is higher than or equal to the width threshold, the analysis circuit 122 does not perform steps S220, S230, and S240 of
In greater detail, after step S210 is completed, the analysis circuit 122 will generate a non-stitching mode resolution NST, and sends the non-stitching mode resolution NST to the receiving circuit 130. In some embodiments, the non-stitching mode resolution NST may be the largest one or smallest one among the supported resolutions of the display devices 103_1-103_4. Then, the receiving circuit 130 uses the non-stitching mode resolution NST to perform handshakes with the video source VS to obtain a single second image IMb having the non-stitching mode resolution NST returned by the video source VS. The image slicing circuit 124 omits slicing the second image IMb, and generates multiple display data respectively including the second image IMb. Next, after aforementioned steps are completed, the output circuit 110 will perform step S250 to output these display data to the display devices 103_1-103_4, so that the display devices 103_1-103_4 provide display pictures with the same content.
Reference is further made to
Reference is further made to
The analysis circuit 122 is configured to control the image slicing circuit 124 to slice positions of the first image IMa according to the poses. For example, multiple center points T1-T4 of the sub-images PD1-PD4 form a first shape 700 in the first image IMa, the spatial coordinates OD1-OD4 of the display devices 103_1-103_4 form a second shape 800 in the physical environment PE, and the first shape 700 and the second shape 800 are in similar shapes. For another example, a figure arranged by the sub-images PD1-PD4 in the first image IMa is similar to a figure arranged by the display devices 103_1-103_4 in the physical environment PE. It is noted that the analysis circuit 122 can control the image slicing circuit 124 to rotate the sub-images PD1 and PD4 after image slicing according to the method similar to that shown in
It is understood that, the video source VS in aforesaid embodiments is not required to support the multi-stream transport mode and the video source VS is also not required to have multiple output ports, the image processing apparatus 100 and the image processing method 200 is able automatically optimize the stitched image according to the amount and positioning methods of the display devices 103_1-103_4. As a result, the image processing apparatus 100 and the image processing method 200 can reduce the difficulty for users in setting up a multi-screen system.
Although the present disclosure has been described in considerable detail with reference to certain embodiments thereof, other embodiments are possible. Therefore, the spirit and scope of the appended claims should not be limited to the description of the embodiments contained herein.
Number | Date | Country | Kind |
---|---|---|---|
112138824 | Oct 2023 | TW | national |