Patent Grant
11289055
This application claims the priority benefit of Taiwan application serial no. 108109529, filed on Mar. 20, 2019. The entirety of the above-mentioned patent application is hereby incorporated by reference herein and made a part of this specification.
The invention relates to a display technology, and particularly relates to a display device capable of being simultaneously connected with a peripheral apparatus and a plurality of hosts and an operating method thereof.
Currently, some displays are compatible with display methods such as picture in picture (PIP) and/or picture by picture (PBP), etc. A display of this kind is capable of being connected with a plurality of hosts and simultaneously displaying images provided by the hosts. Such a display method offers great convenience in scenarios such as meetings, etc.
Even though the display method allows the user to conveniently view the images of the hosts from the display at the same time, the user is unable to freely control the respective hosts. For example, in a conference, the user may need to use a peripheral apparatus, such as a keyboard or a mouse, around the user to operate the images displayed on the display.
In view of the above, the embodiments of the invention provide a display device and an operating method thereof capable of switching an access right of a peripheral apparatus, such as a keyboard, a mouse, etc., among a plurality of hosts, thereby making the use more convenient.
An embodiment of the invention provides a display device including a display panel, a connector, a controller, and a multiplexer. The display panel is configured to simultaneously display a plurality of images of a plurality of external hosts. The connector is configured to connect at least one peripheral apparatus. The controller is coupled to the display panel, the connector and the external hosts, and configured to generate a control signal. The multiplexer is coupled between the controller, the connector and the external hosts, and configured to switch an access right of the at least one peripheral apparatus to one of the external hosts according to the control signal. The controller receives switching information from the external hosts and generates the control signal according to the switching information.
An embodiment of the invention provides an operating method of a display device. The display device is connected with a plurality of external hosts and at least one peripheral apparatus. The operating method includes: simultaneously displaying a plurality of images of the external hosts through a display panel; generating a control signal; switching an access right of the at least one peripheral apparatus to one of the external hosts according to the control signal; receiving switching information from the external hosts; and generating the control signal according to the switching information.
An embodiment of the invention provides a display device including a controller, a display panel, and a connector. The controller is coupled to a plurality of external hosts. The display panel is coupled to the controller and configured to simultaneously display a plurality of images of the external hosts. The connector is coupled to the controller and configured to be connected with a mouse. One of the external hosts has an access right of the mouse. The controller is further configured to: receive a mouse coordinate from the external host having the access right of the mouse; convert the mouse coordinate into a display panel coordinate according to a layout of the images on the display panel; and start a screen setting process according to the display panel coordinate.
Based on the above, the display device and the operating method thereof according to the embodiments of the invention are capable of connecting the plurality of external hosts and the peripheral apparatus such as the keyboard, the mouse, etc., and are capable of favorably switching the access right of the peripheral apparatus among the external hosts while simultaneously displaying the images of the external hosts.
To make the above features and advantages of the invention more comprehensible, embodiments accompanied with drawings are described in detail as follows.
The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
Reference will now be made in detail to the present preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the description to refer to the same or like parts.
Referring to
Specifically, the display device 100 includes a controller 101, a display panel 103, a multiplexer 105, and a connector 107.
In the embodiment, the controller 101 is a scalar, for example, coupled to the display panel 103, the multiplexer 105, the first host 200a, and the second host 200b. The controller 101 may receive image signals from the first host 200a and the second host 200b and process the image signals to allow the display panel 103 to simultaneously display the images of the first host 200a and the second host 200b. The method for displaying the images includes picture-in-picture (PIP) and/or picture-by-picture (PBP), etc. However, the invention does not intend to limit the type of the controller 101. In other embodiments, the controller 101 may also be implemented with other devices having computing capability.
In the embodiment, the connector 107 is, for example, a universal serial bus (USB) hub with which one or more peripheral apparatuses 300 can be connected. However, the invention does not intend to limit the type or the interface of the connector 107.
In the embodiment, the multiplexer 105 is connected between the controller 101, the connector 107, the first host 200a and the second host 200b, and is capable of changing the connection relationship between the connector 107, the first host 200a and the second host 200b according to the instruction of the controller 101, so as to switch the access right of the peripheral apparatus 300 between the first host 200a and the second host 200b. It should be noted that, while several embodiments of the invention are described herein using the first host 200a and the second host 200b as an example of the plurality of external hosts, the invention does not intend to limit the actual number of the external hosts.
For example, the peripheral apparatus 300 includes a keyboard, a mouse, and a storage device, etc. When the multiplexer 105 switches the access right of the peripheral apparatus 300 to the first host 200a, the first host 200a is able to access the data of the keyboard, the mouse, and the storage device. Therefore, the first host 200a can be operated with the keyboard and the mouse, and the first host 200a can read and write the storage device. Alternatively, when the multiplexer 105 switches the access right of the peripheral apparatus 300 to the second host 200b, the second host 200b is able to access the data of the keyboard, the mouse, and the storage device. Therefore, the second host 200b can be operated with the mouse and the keyboard, and the second host 200b can read and write the storage device.
Referring to
With the display method according to the layout LO1, the user may encounter the following issues. When the cursor of the mouse within the first image IMGa is moved to the right boundary of the first image IMGa, the cursor of the mouse is unable to be switched to and moved into the second image IMGb. That is because the first host 200a has the access right of the mouse such that the cursor of the mouse is unable to be switched to and moved into in the first image IMGa. Also, when the cursor of the mouse within the second image IMGb is moved to the left boundary of the second image IMGb, the cursor of the mouse is unable to be switched to and moved in the first image IMGa. That is because the second host 200b has the access right of the mouse such that the cursor of the mouse is unable to be switched to and moved into the second image IMGb.
Referring to
With the display method according to the layout LO2, the user may encounter the following issues. When the cursor of the mouse within the first image IMGa is moved to the display area of the second image IMGb, the cursor of the mouse is unable to be switched to and moved in the second image IMGb. That is because only the first host 200a has the access right of the mouse such that the cursor of the mouse is unable to be switched to and moved into the second image IMGb. When the cursor of the mouse within the second image IMGb is moved to the boundary of the second image IMGb, the cursor of the mouse is unable to be switched to and moved into the first image IMGa. That is because only the second host 200b has the access right of the mouse such that the cursor of the mouse is unable to be switched to and moved into the first image IMGa. Also, when the cursor of the mouse within the first image IMGa is moved to the display area of the second image IMGb, the cursor of the mouse cannot perform an operation on the portion of the first image IMGa. That is because the second image IMGb shields a portion of the first image IMGa.
Several embodiments will be described in the following to demonstrate how these issues are addressed in the display device 100. It should be noted that the invention is not limited thereto.
Then, under some circumstances, the controller 101 generates a control signal (Step S320) and transmits the control signal to the multiplexer 105, so that the multiplexer 105 switches the access right of the peripheral apparatus 300 to one of the external hosts according to the control signal (Step S330). In some embodiments, the controller 101 generates the control signal and transmits the control signal to the multiplexer 105, so that the multiplexer 105 switches the access right of the peripheral apparatus 300 from the first host 200a to the second host 200b according to the control signal.
Referring to
Referring to
Taking the layout LO1 (PBP) as an example, the second host 200b determines whether the mouse coordinates are moved to the edge (e.g., an upper edge, a lower edge, a left edge, or a right edge) of the second image IMGb after accessing the mouse coordinate, and the second host 200b generates the switching information and transmits the switching information to the controller 101 of the display device 100 when the mouse coordinate is moved to or located at the edge of the second image IMGb.
For example, the switching information may include directional information (e.g., upper, lower, left, or right), so as to indicate to which edge of the second image IMGb the mouse coordinate is moved. The switching information may further include edge position information (e.g., which position on the left edge). Accordingly, after receiving the switching information from the second host 200b, the controller 101 is able to determine whether there is an image of another external host in the direction indicated in the direction information of the switching information of the second image IMGb according to the layout LO1. If there is an image of another external host in the direction indicated in the direction information of the switching information of the second image IMGb, it is necessary to switch the access right. Alternatively, if there no image of another external host in the direction indicated in the direction information of the switching information of the second image IMGb, it is not necessary to switch the access right. In the embodiment, if the direction indicated in the direction information in the switching information from the second host 200b is “left”, the controller 101 determines that it is necessary to switch the access right. At this time, the controller 101 may determine that the first host 200a corresponding to the first image IMGa to the left of the second image IMGb has the access right of the peripheral apparatus 300, and generate the control signal according to the switching information, so that the multiplexer 105 may switch the access right of the peripheral apparatus 300 to the first host 200a according to the control signal. When obtaining the access right of the peripheral apparatus 300, the first host 200a may receive the edge position information included in the switching information from the controller 101, so as to be informed of the position at which the mouse coordinate is located on the right edge of the first image IMGa accordingly. Therefore, in the embodiment, the user may observe that the cursor of the mouse displayed on the display panel 103 is smoothly moved from the second image IMGb to the first image IMGa.
In the embodiment, if the direction indicated in the direction information in the switching information from the second host 200b is “upper/top”, “lower/bottom”, or “right”, the controller 101 determines that it is not necessary to switch the access right. At this time, the cursor of the mouse displayed on the display panel 103 stays on the edge of the second image IMGb.
Accordingly, the display device 100 is able to automatically switch the access right of the peripheral apparatus 300 among the external hosts, thereby bringing forth favorable user experiences.
Taking the layout LO2 (PIP) as an example, the second host 200b determines whether the mouse coordinate is moved to the edge (e.g., the upper edge, the lower edge, the left edge, or the right edge) of the second image IMGb (the sub-image) after accessing the mouse coordinate. The second host 200b generates the switching information and transmits the switching information to the controller 101 of the display device 100 when the mouse coordinate is moved to the edge of the second image IMGb. In particular, in the layout with a sub-image and a main image, such an operation is only carried out when the switching is from the sub-image to the main image.
For example, the switching information may include directional information (e.g., upper/top, lower/bottom, left, or right), so as to indicate to which edge of the second image IMGb the mouse coordinate is moved to. Accordingly, after receiving the switching information from the second host 200b, the controller 101 is able to determine whether there is an image of another external host in the direction indicated in the direction information of the switching information of the second image IMGb according to the layout LO2. If there is an image of another external host in the direction indicated in the direction information of the switching information of the second image IMGb, it is necessary to switch the access right. Alternatively, if there is no image of another external host in the direction indicated in the direction information of the switching information of the second image IMGb, it is not necessary to switch the access right. In the layout LO2, it is necessary to switch the access right regardless of whether the direction in the direction information in the switching information from the second host 200b is “upper/top”, “lower/bottom”, “left”, or “right”. Therefore, the controller 101 may choose the first host 200a corresponding to the first image IMGa to the upper, lower, left, or right of the second image IMGb and generate the control signal accordingly, so that the multiplexer 105 may switch the access right of the peripheral apparatus 300 to the first host 200a.
Particularly, in some embodiments, the user may further determine the contents of the switching signal on his/her own. For example, the user may determine of which peripheral apparatus 300 or transmission interface the access right is to be switched.
Specifically, the switching of the transmission interface includes switching of USB 2.x (e.g., USB2.0, USB2.1, etc.) and switching of USB 3.x (e.g., USB3.0, USB3.1, USB3.2, etc.). For example, when the peripheral apparatus 300 includes a keyboard, a mouse, and a storage device, the switching of USB 2.x is directed to switching of a keyboard and a mouse using USB 2.x interface, and the switching of USB 3.x is directed to switching of the keyboard, the mouse, and a storage device using USB 3.x interface. If the user does not hit a special key (e.g., a key combination) on the keyboard when the cursor of the mouse is moved to the left edge of the second image IMGb, the switching that the user intends to perform is the switching of USB 3.x, i.e., the switching of the access right of the keyboard, the mouse, and the storage device. Alternatively, the user may hit a special key (e.g., a key combination) on the keyboard when the cursor of the mouse is moved to the left edge of the second image IMGb to choose to perform the switching of USB 2.x, i.e., switching only the access right of the keyboard and the mouse but not switching the access right of the storage device. From another perspective, if the user hits the special key on the keyboard when the cursor of the mouse is moved to the left edge of the second image IMGb, the contents of the switching signal are changed. Hence, the controller 101 is able to choose some of the peripheral apparatuses 300 and generate the control signal according to the switching signal, so that the multiplexer 105 may switch only the access right of the chosen peripheral apparatuses 300 (e.g., switching only the access right of the keyboard and the mouse but not switching the access right of the storage device) when switching the access right of the peripheral apparatuses 300. However, people having ordinary skills in the art may modify the peripheral apparatus 300 of which the access right is to be switched and how the switching signal is changed. The invention does not intend to impose a limitation on this regard.
Referring to
Taking the layout LO1 as an example, the controller 101 may receive the mouse coordinates of the external host (e.g., the first host 200a or the second host 200b) from the external host having the access right of the peripheral apparatus 300, and converts the mouse coordinates of the external host into the display panel coordinates on the display panel 103. Specifically, in addition to receiving the mouse coordinates, the controller 101 may also receive image resolution information from each of the external hosts, so as to convert the mouse coordinates into the display panel coordinates according to the mouse coordinates, the resolution of the display panel 103, and the image resolutions of the external hosts.
For example, assuming that the resolution of the display panel 103 is 1920×2160, the image resolution of the first host 200a is 3840×2160, the image resolution of the second host 200b is 1920×2160, and each of the first image IMGa and the second image IMGb takes up a half of the layout LO1, the conversion into the display panel coordinates is as shown in Table 1 in the following.
According to Table 1, the display panel coordinates of the first image IMGa on the display panel 103 are from (0, 0) to (2159, 1919), and the display panel coordinates of the second image IMGb on the display panel 103 are from (1920, 0) to (2159, 3839). The mouse coordinates (x1, y1) from the first host 200a are converted into the display panel coordinates (x1×1920/3840+0, y1×2160/2160+0), and the mouse coordinates (x2, y2) from the second host 200b are converted into the display panel coordinates (x2×1920/1920+1920, y2×2160/2160+0). For example, the mouse coordinates (100, 0) from the first host 200a is converted into the display panel coordinates (100×1920/3840+0, 0×2160/2160+0)=(50, 0), and the mouse coordinates (100, 0) from the second host 200b is converted into the display panel coordinates (100×1920/1920+1920, 0×2160/2160+0)=(2020, 0). Other coordinates may be converted based on the same principle.
If the mouse coordinates are from the first host 200a, the controller 101 may choose another external host to generate the control signal accordingly after converting the mouse coordinates into the display panel coordinates. For example, when the display panel coordinates converted from the mouse coordinates reach the rightmost of the first image IMGa, the controller 101 may choose the second host 200b corresponding to the second image IMGb to the right of the first image IMGa according to the layout LO1 and generate the control signal accordingly, so that the multiplexer 105 may switch the access right of the peripheral apparatus 300 to the second host 200b. Similarly, if the mouse coordinates are from the second host 200b, the controller 101 may choose another external host to generate the control signal accordingly after converting the mouse coordinates into the display panel coordinates. For example, when the display panel coordinates converted from the mouse coordinates reach the leftmost of the second image IMGb, the controller 101 may choose the first host 200a corresponding to the first image IMGa to the left of the second image IMGb and generate the control signal accordingly, so that the multiplexer 105 may switch the access right of the peripheral apparatus 300 to the first host 200a.
Taking the layout LO2 as an example, the controller 101 may similarly receive the mouse coordinates from the external host having the access right of the peripheral apparatus 300 and receive the image resolution information from each of the external hosts, and then converts the mouse coordinates into the display panel coordinates on the display panel 103 in a similar way according to the mouse coordinates, the resolution of the display panel 103, and the image resolutions of the external hosts.
If the mouse coordinates are from the first host 200a, the controller 101 may choose another external host to generate the control signal accordingly after converting the mouse coordinates into the display panel coordinates. For example, according to the layout LO2, when the display panel coordinates converted from the mouse coordinates enter the display area of the second image IMGb, the controller 101 may choose the second host 200b and generate the control signal accordingly, so that the multiplexer 105 may switch the access right of the peripheral apparatus 300 to the second host 200b. Alternatively, if the mouse coordinates are from the second host 200b, the controller 101 may choose another external host to generate the control signal accordingly after converting the mouse coordinates into the display panel coordinates. For example, when the display panel coordinates converted from the mouse coordinates reach the edge of the second image IMGb, the controller 101 may choose the first host 200a corresponding to the first image IMGa according to the layout LO2 and generate the control signal accordingly, so that the multiplexer 105 may switch the access right of the peripheral apparatus 300 to the first host 200a.
Referring to
Taking the layout LO2 as an example, the control right of the cursor of the mouse constantly belong to the host (the first host 200a) corresponding to the main image (the first image IMGa), and the controller 101 converts the mouse coordinates of the main image into the display panel coordinates. If the controller 101 detects that the display panel coordinates of the mouse cursor are about to enter the display area of the second image IMGb, the controller 101 may move the second image IMGb to prevent the second image IMGb from overlapping the mouse cursor. For example, the display panel coordinates converted from the mouse coordinates entering the display area of the second image IMGb may indicate that the user intends to perform an operation in the portion of the first image IMGa shielded by the second image IMGb. Therefore, the controller 101 may move the second image IMGb away (e.g., moving the second image IMGb from the lower right area to the upper right area of the display panel 103, but the invention is not limited thereto), so that the cursor of the mouse is still operated on the first image IMGa.
The controller 101 in the embodiments of
Referring to
Taking the layout LO2 as an example, the main image is the first image IMGa corresponding to the first host 200a, and the sub-image is the second image IMGb corresponding to the second host 200b. The controller 101 may receive the mouse coordinates from the first host 200a and convert the mouse coordinates into the display panel coordinates according to the layout LO2. The user may use a special key to control the controller 101 to switch the access right of the peripheral apparatus 300 when the display panel coordinates enter the display area of the second image IMGb, and may use different special keys to determine of which peripheral apparatus 300 the access right is to be switched. Alternatively, if the user chooses not to hit a special key, the controller 101 may move the position of the second image IMGb when the display panel coordinates enter the display area of the second image IMGb.
For example, the user may hit a first special key on the keyboard when the display panel coordinates enter the display area of the second image IMGb. At this time, the first host 200a may transmit a signal corresponding to the first special key to the controller 101. Accordingly, when the display panel coordinates enter the display area of the second image IMGb, the controller 101 may determine that the signal corresponding to the first special key from the first host 200a is received and may generate the control signal according to the signal to switch the access right of the peripheral apparatus 300 or the transmission interface (e.g., switching the access right of the keyboard and the mouse but not the storage device) corresponding to the first special key to the second host 200b. In addition, the user may also hit a second special key on the keyboard when the display panel coordinates enter the display area of the second image IMGb. At this time, the first host 200a may transmit a signal corresponding to the second special key to the controller 101. Accordingly, when the display panel coordinates enter the display area of the second image IMGb, the controller 101 may determine that the signal corresponding to the second special key from the first host 200a is received and may generate the control signal according to the signal to switch the access right of the peripheral apparatus 300 or the transmission interface (e.g., including switching the keyboard, the mouse, the storage device) corresponding to the second special key to the second host 200b. If the user does not hit any special key when the display panel coordinates enter the display area of the second image IMGb, the controller 101 may move the position of the second image IMGb when the display panel coordinates enter the display area of the second image IMGb.
Accordingly, the user is allowed to conveniently perform operations on the images of the external hosts.
It should be noted that the communication between the external hosts (e.g., the first host 200a and the second host 200b) and the controller 101 of the display device 100, including the transmission of the mouse coordinates and the image resolution, may be achieved through a communication protocol of the display data channel command interface (DDC/CI), for example. However, in some embodiments, some external hosts (e.g., mobile phones) are not compatible with such type of communication protocol. In the following, an operating method of a display device is described. The operating method is capable of successfully and smoothly switching the access right of the peripheral apparatus 300 when some of the external hosts are not compatible with the DDC/CI communication protocol.
Referring to
Accordingly, the second host 200b may make the display device 100 switch the access right of the peripheral apparatus 300 by discontinuing the transmission of the image signal to the controller 101.
Taking the layout LO2 as an example, when the access right of the peripheral apparatus 300 is switched from the first host 200a to the second host 200b, the second host 200b may obtain the mouse coordinates and determine whether the mouse coordinates are moved to the edge of the second image IMGb. When determining that the mouse coordinates are moved to the edge of the second image IMGb, the second host 200b may discontinue the transmission of the image signal to the controller 101. In this way, according to the flow in the embodiment of
Referring to
Besides, the controller 101 may also determine whether the starting signal is also received from the same external host (i.e., the external host having the access right of the peripheral apparatus 300) (Step S930). For example, when intending to start the screen setting process, the user may hit a special key on the keyboard to trigger the external host having the access right of the peripheral apparatus 300 to transmit the starting signal to the controller 101. Starting the screen setting process includes, for example, enabling an on-screen display (OSD) adjusting function of the display panel 103. However, the invention is not limited thereto.
When the controller 101 determines that the starting signal is received from the external host having the access right of the peripheral apparatus 300, the controller 101 may determine whether to start the screen setting process according to the display panel coordinates (Step S940). For example, the controller 101 may define a predetermined area on the display panel 103, and may determine to start the screen setting process, such as enabling the OSD adjusting function, when the starting signal is received and the display panel coordinates enter the predetermined area.
After starting the screen setting process, the controller 101 may detect a gesture according to the mouse coordinates (Step S950). For example, after the screen setting process is started, the user may choose the property (e.g., brightness) of the display panel 103 to be adjusted, and may drag the mouse to create a gesture (e.g., a gesture of dragging rightward or leftward), so as to make an adjustment. The controller 101 may detect the gesture of the user according to the received mouse coordinates.
Then, the controller 101 may adjust a setting value of the display panel 103 according to the detected gesture (Step S960). For example, when the property of the display panel 103 to which the user chooses to make an adjustment is brightness and a gesture of dragging rightward is created, the controller 101 may increase the setting value on the brightness of the display panel 103 according to the detected gesture. When the property of the display panel 103 to which the user chooses to make an adjustment is brightness and a gesture of dragging leftward is created, the controller 101 may decrease the setting value on the brightness of the display panel 103 according to the detected gesture.
Accordingly, the user is allowed to conveniently move the mouse and input a special key to start the screen setting process, so as to adjust the setting value of the display panel 103.
In view of the foregoing, the display device and the operating method thereof according to the embodiments of the invention are capable of connecting the plurality of external hosts and the peripheral apparatus such as the keyboard, the mouse, etc., and are capable of favorably switching the access right of the peripheral apparatus among the external hosts while simultaneously displaying the images of the external hosts. Besides, in some embodiments, the display device is capable of receiving the mouse coordinates from the external host and automatically switching the access right of the peripheral apparatus among the external hosts accordingly, automatically adjusting the layout of the images on the display panel, or starting the screen setting process, thereby making the use more convenient.
It will be apparent to those skilled in the art that various modifications and variations can be made to the structure of the present invention without departing from the scope or spirit of the invention. In view of the foregoing, it is intended that the present invention cover modifications and variations of this invention provided they fall within the scope of the following claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 108109529 | Mar 2019 | TW | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5606345 | Truchet | Feb 1997 | A |
| 8902273 | Cho | Dec 2014 | B2 |
| 10394376 | Hosokawa | Aug 2019 | B2 |
| 10635233 | Hosokawa | Apr 2020 | B2 |
| 20060195637 | Zhang | Aug 2006 | A1 |
| 20090128504 | Smith | May 2009 | A1 |
| 20110239142 | Steeves | Sep 2011 | A1 |
| 20130019263 | Ferren | Jan 2013 | A1 |
| 20130162502 | Lee | Jun 2013 | A1 |
| 20150356045 | Soffer | Dec 2015 | A1 |
| 20180275814 | Hosokawa | Sep 2018 | A1 |
| 20190332221 | Hosokawa | Oct 2019 | A1 |
| Number | Date | Country |
|---|---|---|
| 108628402 | Oct 2018 | CN |
| M501591 | May 2015 | TW |
| I630542 | Jul 2018 | TW |
| Entry |
|---|
| “Office Action of Taiwan Counterpart Application”, dated Sep. 19, 2019, pp. 1-8. |
| “Office Action of Taiwan Counterpart Application”, dated Feb. 26, 2020, p. 1-p. 10. |
| “Office Action of Taiwan Counterpart Application”, dated Apr. 24, 2020, p. 1-p. 7. |
| Number | Date | Country | |
|---|---|---|---|
| 20200302895 A1 | Sep 2020 | US |
