Patent Application
20200348649
This application claims the benefit of People's Republic of China application Serial No. 201910362158.6, filed Apr. 30, 2019, the subject matter of which is incorporated herein by reference.
The invention relates in general to a server, a control system and a control method, and more particularly to a remote server, a remote control system and a remote control method.
With the development of technologies, various novel and innovative products are constantly launched to the market, and machines on production lines are also getting increasingly complex. A machine usually has a screen for displaying images of various control keys, messages or work-pieces. A user can carry out settings and operations required in a next stage by using the images of keys, messages or work-pieces displayed on the screen.
To facilitate the operation of work staff, a machine can be connected to a remote server by using a remote desktop technology. During a remote operation process, a display of the remote server displays an image the same as that on the screen of the machine. Work staff can directly learn the content shown on the screen of the machine without being near the machine in person.
However, the display of the remote server needs to display an image the same as that on the screen of the machine. Thus, if several machines need to be concurrently operated, several remote servers need to be corresponding provided, hence significantly depreciating the benefits of remote control and degrading the efficiency of remote control.
The invention is directed to a remote server, a remote control system and a remote control method, in which images of multiple machines are automatically analyzed at a remote server through a KVM switch, and corresponding control instructions are generated by using artificial intelligence, so as to automatically operate multiple machines.
According to an aspect of the present invention, a remote server is provided. The remote server includes a connector and a processor. The connector is connected to a KVM switch, which is connected to at least two machines. The connector individually receives a plurality of screen images of the machines through the KVM switch, wherein the screen images are captured at the machines. The processor generates a plurality of control instructions according to the screen images, respectively. The control instructions are transmitted from the connector to the machines through the KVM switch, respectively.
According to another aspect of the present invention, a remote control system is provided. The remote control system includes at least two machines, a KVM switch and a remote server. The remote server includes a connector and a processor. The connector is connected to the KVM switch, which is connected to the machines. The connector individually receives a plurality of screen images of the machines through the KVM switch, wherein the screen images are captured at the machines. The processor generates a plurality of control instructions according to the screen images, respectively. The control instructions are transmitted from the connector to the machines through the KVM switch, respectively.
According to yet another aspect of the present invention, a remote control method is provided. The remote control method includes the following steps. At least two machines and a remote server are connected through a KVM switch. A plurality of screen images are respectively captured at the machines, and are transmitted from the machines to the remote server through the KVM switch. The remote server generates a plurality of control instructions respectively according to the screen images. The control instructions are transmitted to the machines through the KVM switch.
The above and other aspects of the invention will become better understood with regard to the following detailed description of the preferred but non-limiting embodiments. The following description is made with reference to the accompanying drawings.
In a convention remote desktop technology, the images F4, F5, . . . of the machines 400, 500, . . . need to be presented on multiple displays (not shown) of multiple remote servers (not shown).
In this step, rather than continuously transmitting screen desktops of the machines 400, 500, . . . , only transmission paths between the remote server 100 and the machines 400, 500, . . . are established.
In step S120, multiple image request instructions R4, R5, . . . are respectively transmitted to the machines 400, 500, . . . from the remote server 100 through the KVM switch 300. The remote server 100 can set screenshot time points of the image request instructions R4, R5, . . . . For example, the screenshot time points can be set as immediately capturing a screenshot upon receipt of the image request instructions R4, R5, . . . . Alternatively, the screenshot time point can be a predetermined time interval from a previous screenshot time point, and the remote server 100 can set the predetermined time interval according to manufacturing phases of the machines 400, 500, . . . . Alternatively, the screenshot time points can be a predetermined standard time (e.g., 10:25), and the remote server 100 can set the predetermined standard time according to manufacturing phases of the machines 400, 500, . . . .
In another embodiment, step S120 can be omitted. The machines 400, 500, . . . can automatically perform screenshot at predetermined time intervals without having to wait for any image request instructions transmitted from the remote server 100.
In step S130, the screen images F4, F5, . . . are respectively captured at the machines 400, 500, . . . . The screen images F4, F5, . . . are images of the screens 410, 510, . . . . As described above, the machines 400, 500, . . . can perform screenshot at the screenshot time points of the image request instructions R4, R5, . . . . Alternatively, the machines 400, 500, . . . can automatically perform screenshot at predetermined time intervals without having to wait for any image request instructions transmitted from the remote server 100.
In this step, the machines 400, 500, . . . can simultaneously capture the screen images F4, F5, . . . without incurring any conflicts.
Further, because the machines 400, 500, . . . can continuously transmit screen desktops without delay, the resolutions of the screen images F4, F5, . . . can be increased without occupying an overly large transmission bandwidth.
In step S140, the screen images F4, F5, . . . are transmitted from the machines 400, 500, . . . to the remote server 100 through the KVM switch 300. In this step, when there are multiple screen images F4, F5, . . . that need to transmitted in a same period, the screen images F4, F5, . . . are transmitted to the remote server 100 by means of time-division multiplexing (TDM).
The KVM switch 300 has multiple connection port identifiers 11, 12, . . . , which respectively correspond to the second terminal connection ports P21, P22, . . . . The remote server 100 corresponds the screen images F4, F4, . . . to the machines 400, 500, . . . according to the connection port identifiers 11, 12, . . . without causing any confusion.
In step S150, the remote server 100 generates a plurality of control instructions C4, C5, . . . according to the screen images F4, F5, . . . , respectively. The control instructions C4, C5, . . . are, for example, instructions for adjusting the temperature, taking out a chip, opening an air valve, pressing a particular screen key and vacuuming. The remote server 100 can identify the contents of the screen images F4, F5, . . . by using a deep learning algorithm, and analyze operations of the next phase according to the contents, wherein different operations may need to be carried out for different contents.
In this step, the remote server 100 can directly analyze the screen images F4, F5, . . . at the backstage, instead of also displaying the screen images F4, F5, . . . on the display 200. The display 200 maintains the original display content F0 or remains in a turned off state.
In one embodiment, if multiple screen images F4, F5, . . . are received at the same time, the remote server 100 can generate the control instructions C4, C5, . . . by means of time-division multiplexing (TDM). In another embodiment, the processor 120 of the remote server 100 can adopt a multicore structure, so as to be able to synchronously analyze the screen images F4, F5, . . . to generate the control instructions C4, C5, . . . .
In step S160, the processor 120 of the remote server 100 sets the screenshot time points of the image request instructions R4, R5, . . . according to the screen images F4, F5, . . . . In this step, the remote server 100 can use a deep learning algorithm to analyze the screenshot time points that should be set for the next phase so as to accurately obtain required information.
In another embodiment, step S160 can be omitted. The machines 400, 500, . . . can automatically perform screenshot at predetermined time intervals without having to set the screenshot time points.
In step S170, the control instructions C4, C5, . . . are transmitted to the machines 400, 500, . . . through the KVM switch 300. In this step, when there are multiple control instructions C4, C5, . . . that need to be transmitted in the same period, the control instructions C4, C5, . . . are transmitted to the machines 400, 500, . . . by means of time-division multiplexing.
The process then returns to step S120 (or step S130) to continue to the above operations. Thus, one remote server 100 can analyze the images F4, F5, . . . of the machines 400, 500, . . . , and generate the corresponding control instructions C4, C5, . . . , so as to automatically perform the operations of the machines 400, 500, . . . .
The processing method using time-division multiplexing is described in the embodiment below.
At a time point T1, upon completion of step S120 for the machine 400, the operation of step S150 for the machine 140 begins and the operation of step S120 for the machine 500 also begins.
At a time point T2, upon completion of step S150 for the machine 400, the operation of step S170 for the machine 400 begins.
At a time point T3, upon completion of step S120 for the machine 500, the operation of step S150 for the machine 500 begins.
At a time point T4, the operation of step S170 for the machine 400 is complete.
At a time point T5, the operation of step S170 for the machine 500 is complete.
That is to say, steps S120, S150 and S170 are performed in a time-division multiplexing manner. The execution of steps S120, S150 and S170 adopts pipelining to improve execution efficiency. For example, the operation of step S120 for the machine 500 and the operation of step S150 of the machine 400 can be performed synchronously without incurring any conflicts. The operation of step S120 of the machine 500 and the operation of step S170 for the machine 400 can be performed synchronously without incurring any conflicts.
At a time point T7, after completion of the operation of step S170 for the machine 500, the screenshot time point of the image request instruction R5 is set as executing immediately, and thus the operation of step S120 for the machine 500 is performed immediately.
At a time point T8, after completion of the operation of step S120 for the machine 500, the operation of step S150 for the machine 500 begins.
At a time point T9, after completion of the operation of step S150 for the machine 500, the operation of step S170 for the machine 500 begins.
At a time point T10, the operation of step S120 for the machine 400 begins.
At a time point T11, after completion of the operation of step S120 for the machine 400, the operation of step S150 for the machine 400 begins.
At a time point T12, after completion of the operation of step S150 for the machine 400, the operation of step S170 for the machine 400 begins.
That is to say, the operations for the machine 400 and the machine 500 are not required to be performed according to numerical sequences, and the operation for the machine 500 can be performed before that for the machine 400.
With the above embodiments, the remote control system 1000 of the disclosure is capable of automatically analyzing the images F4, F5, . . . of the machines 400, 500, . . . at one remote server 100 through the KVM switch 300, and using artificial intelligence to generate the corresponding control instructions C4, C5, . . . , so as to automatically perform operations on the machines 400, 500, . . . .
While the invention has been described by way of example and in terms of the preferred embodiments, it is to be understood that the invention is not limited thereto. On the contrary, it is intended to cover various modifications and similar arrangements and procedures, and the scope of the appended claims therefore should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements and procedures.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201910362158.6 | Apr 2019 | CN | national |
