The present invention relates to a non-intrusive shared processing method and a non-intrusive shared processing system for pop-up window, and more particularly, to a non-intrusive shared processing method and a non-intrusive shared processing system with capability of automatically detecting, closing and inhibiting the pop-up window of equipment.
With the rapid development of industry, equipment in many factories is gradually becoming automated and intelligent. The equipment usually goes with the display device, and the equipment displays current production schedule or various parameters on the display device, so that operators can examine the operational status of the equipment.
In the prior art, the equipment reminds operators by a signal light when the parameters or values of the equipment exceed the warning threshold. In other word, the operators need to standby beside the equipment to deal with the emergency or abnormal event of the equipment. Furthermore, when the production parameters or values of the equipment need to be recorded, the operators also have to transcribe them periodically on site. The current technology and products for capturing the screen image and analyzing the data on screen image have been developed for solving the problem related to labor costs of traditional equipment, so as to automatically monitor the operating status of the equipment.
However, the pop-up windows of notifying or warning for peripheral device or unit configured in the equipment sometimes show up on the display device, for example, the notification window for notifying that the charging device has been charged completely, the notification window for notifying that the air supply device has been opened, and the warning window for notifying that 30% remaining materials in the feeding tray. The pop-up windows may cover the production parameters or the data those need to be detected on the display device, so that the system cannot recognize the data and result in abnormal state. The current solutions comprises that the operators manually close the pop-up windows on the equipment on site, or the operators remotely control the equipment to close the pop-up windows by the intrusive controlling module installed in the equipment. Due to a large amount of equipment in large factories, even hundreds of them, if each of the equipment appears a pop-up window, the operators need to close the pop-up windows one by one and it would reduce the efficiency and increase the cost. Furthermore, if each of the equipments installs the intrusive controlling module, it would cause additional loadings to the equipments to reduce the production efficiency. In addition, the same equipment may encounter the pop-up windows of the same type, and the operators still have to close the pop-up windows manually or remotely one by one, thereby reducing the efficiency.
Therefore, it is necessary to develop a new automatically processing mechanism for the pop-up windows to solve the problems in the prior art.
Therefore, a scope of the present invention is to provide a non-intrusive shared processing method to solve the problems in the prior art.
In one embodiment of the present invention, the non-intrusive shared processing method is configured to inhibit or close the pop-up window on the display device. The non-intrusive shared processing method for pop-up window comprises the following steps: a first non-intrusive terminal device publishing the pop-up window data of the pop-up window to an information theme in a communication interface; a central processing device subscribing to the information theme in the communication interface to receive the pop-up window data and generating a decision data corresponding to the pop-up window data, and publishing the decision data to the information theme in the communication interface; and, the first non-intrusive terminal device receiving the decision data from the information theme in the communication interface, and inhibiting or closing the pop-up window on the display device according to the decision data
Wherein, the non-intrusive shared processing method for pop-up window further comprises the following steps: the first non-intrusive terminal device capturing a screen image of the display device and detecting the pop-up window by comparing the screen image with a preset screen image; and, the first non-intrusive terminal device analyzing the pop-up window to generate the pop-up window data.
Wherein, the step of the first non-intrusive terminal device capturing the screen image of the display device and detecting the pop-up window by comparing the screen image with a preset screen image further comprises the following steps: the first non-intrusive terminal device capturing the screen image of the display device; the first non-intrusive terminal device determining whether the preset screen image exists or not; if the preset screen image does not exist, the first non-intrusive terminal device setting the screen image as the preset screen image; and, if the preset screen image exists, the first non-intrusive terminal device detecting the pop-up window by comparing the screen image with the preset screen image.
Wherein, the step of the first non-intrusive terminal device analyzing the pop-up window to generate the pop-up window data further comprises the following steps: the first non-intrusive terminal device analyzing and calculating the pop-up window by an algorithm to generate a button data in the pop-up window data, wherein the button data comprises a button contour and a button position; and, the first non-intrusive terminal device analyzing the button data by Optical Character Recognition analysis to generate a button character in the button data.
Furthermore, the non-intrusive shared processing method for pop-up window further comprises the following steps: the first non-intrusive terminal device comparing the pop-up window data with a plurality of history pop-up window data stored in a first database to determine whether the pop-up window data conforms with a first history pop-up window data in the plurality of history pop-up window data, wherein the first database stores a plurality of history decision data, and the plurality of history pop-up window data are respectively corresponding to the plurality of history decision data; and, if the pop-up window data conforms with a first history pop-up window data, the first non-intrusive terminal device inhibiting or closing the pop-up window according to the history decision data corresponding to the first history pop-up window data.
Wherein, the step of the central processing device subscribing to the information theme in the communication interface to receive the pop-up window data and generating the decision data corresponding to the pop-up window, and publishing the decision data to the information theme in the communication interface further comprises the following steps: the central processing device receiving the pop-up window data to generate a plurality of solutions corresponding to the pop-up window data; selecting one of the solutions as the decision data according to the pop-up window data of the pop-up window; and, the central processing device publishing the decision data to the information theme in the communication interface.
Wherein, the non-intrusive shared processing method for pop-up window further comprises the following steps: a second non-intrusive terminal device subscribing to the information theme in the communication interface; and, the second non-intrusive terminal device receiving and storing the pop-up window data and the decision data into a second database from the information theme of the communication interface.
Another scope of the present invention is to provide a non-intrusive shared processing system for pop-up window to solve the problems in the prior art.
According to one embodiment of the present invention, the non-intrusive shared processing system for pop-up window is configured to inhibit or close a pop-up window of a display device. The non-intrusive shared processing system for pop-up window comprises a communication interface and a first non-intrusive shared terminal device. The communication interface comprises an information theme. The information theme is configured to store a pop-up window data of the pop-up window and a decision data corresponding to the pop-up window. The first non-intrusive shared terminal device is coupled to the communication interface and the display device, and subscribes to the information theme in the communication interface. The first non-intrusive shared terminal device further comprises an image capturing module, an image analyzing module, a transmission module and a processor. The image capturing module is configured to capture a screen image of the display device. The image analyzing module is coupled to the image capturing module and storing a preset screen image. The image analyzing module is configured for analyzing the screen image and the preset screen image to detect the pop-up window and generate the pop-up window data. The transmission module is configured to publish the pop-up window data to the information theme and receive the decision data from the information theme. The processor is coupled to the transmission module and the display device. The processor controls the transmission module to publish the pop-up window and to receive the decision data, and the processor inhibits or closes the pop-up window on the display device according to the decision data.
Wherein, the image analyzing module sets the screen image as the preset screen image when the preset screen image does not exist.
Wherein, the image analyzing module analyzes the pop-up window by an algorithm and Optical Character Recognition to generate a button character in the pop-up window data, wherein the button data comprises a button contour, a button position, and a button character.
Wherein, the first non-intrusive terminal device comprises a first database coupled to the processor. The first database is configured to store a plurality of the history pop-up window data and a plurality history decision data. The history pop-up window data are respectively corresponding to the history decision data. When the pop-up window data generated by the image analyzing module conforms with a first history pop-up window data in the plurality of history pop-up window data, the processor inhibits or closes the pop-up window on the display device according to the history decision data corresponding to the first history pop-up window.
Wherein, the non-intrusive shared processing system for pop-up window further comprises a second non-intrusive terminal device coupled to the communication interface and subscribing to the information theme of the communication interface. The second non-intrusive terminal device comprises a second database. The second non-intrusive terminal device receives the pop-up window data and the decision data from the information theme, and stores the pop-up window data and the decision data into the second database.
Wherein, the non-intrusive shared processing system of the pop-up window further comprises a central processing device coupled to the communication interface and subscribing to the information theme of the communication interface. The central processing device receives the pop-up window data from the information theme to generate the decision data corresponding to the pop-up window, and publishes the decision data into the information theme of the communication interface.
In one embodiment, the central processing device generates a plurality of solutions corresponding to the pop-up window data, and sets one of the solutions selected by a user as the decision data.
In another embodiment, the central processing device comprises an analyzing module. The central processing device generates a plurality of solutions corresponding to the pop-up window data according to the pop-up window data, and the analyzing module selects one of the solutions as the decision data according to pop-up window data.
In one embodiment, the non-intrusive shared processing system for pop-up window further comprises a third non-intrusive terminal device coupled to the communication interface and subscribing to the information theme of the communication interface. The third non-intrusive terminal device receives the pop-up window data from the information theme to generate the decision data corresponding to the pop-up window, and publishes the decision data into the information theme of the communication interface.
In summary, the non-intrusive shared processing method and system of this invention can automatically detect the pop-up windows of the equipment, and the operators can remotely provide the solutions through the communication interface, thereby reducing the labor costs. In addition, the non-intrusive shared processing method and system for pop-up window of this invention can automatically inhibit the pop-up window generated by the equipment through the non-intrusive terminal device, thereby reducing the labor costs and increasing the production efficiency. Furthermore, the non-intrusive shared processing method and system of the pop-up window of this invention can automatically detect the pop-up window and compare it with the processed pop-up window through the storage device, thereby increasing the detecting efficiency and reducing the time costs. Moreover, the non-intrusive shared processing method and system for pop-up window of the present invention can automatically transmit the data of pop-up window and the solutions to other equipments of the same type by subscribing and publishing, thereby reducing the processing time of the operators, increasing the efficiency and lowering the cost. In addition, the non-intrusive shared processing system for pop-up window of the present invention can also directly process the pop-up window on the equipment, thereby increasing the convenience and efficiency.
For the sake of the advantages, spirits and features of the present invention can be understood more easily and clearly, the detailed descriptions and discussions will be made later by way of the embodiments and with reference of the diagrams. It is worth noting that these embodiments are merely representative embodiments of the present invention, wherein the specific methods, devices, conditions, materials and the like are not limited to the embodiments of the present invention or corresponding embodiments. Moreover, the devices in the figures are only used to express their corresponding positions and are not drawing according to their actual proportion.
In the description of the present specification, the terminologies “in an embodiment”, “in another embodiment”, or “in some embodiments” means that the specific feature, structure, material or characteristic of the present embodiment is involved in at least one embodiment of the present invention. In the description of the present specification, the schematic representation of the mentioned terminologies does not necessarily refer to the same embodiment. Furthermore, the described specific feature, structure, material or characteristic can be involved in any one or more embodiments in a proper way.
Please refer to
In this embodiment, the non-intrusive shared processing system 1 for pop-up window comprises the non-intrusive terminal device 11, the communication interface 13, and the central processing device 15. The non-intrusive terminal device 11 is coupled to the communication interface 13, and the communication interface 13 is coupled to the central processing device 15. Furthermore, the non-intrusive terminal device 11 is coupled to the display device 81. In practice, the display device 81 can be a display screen of the equipment 8. The non-intrusive terminal device 11 can communicate with the display device 81, and the non-intrusive terminal device 11 can communicate with the central processing device 15 through the communication interface 13.
In practice, the communication interface 13 can be a middleware connected with the operating system. The communication interface 13 can generate an information stream comprising a plurality of information themes. The information themes can comprise the data about pop-up windows. The non-intrusive terminal device 11 can establish the information theme 131 and publish the information theme 131 with the pop-up window data to the communication interface 13 when the transmission module 113 of the non-intrusive terminal device 11 publishes the pop-up window data to the communication interface 13. Furthermore, the information theme 131 can comprise a decision data corresponding to the pop-up window. The non-intrusive terminal device 11 can receive the decision data from the information theme, and inhibit or close the pop-up window on the display device 81 according to the decision data. The decision data can be the order or the means for processing the pop-up window to prevent the display device 81 of the equipment from being covered by the pop-up window.
In this embodiment, the non-intrusive terminal device 11 comprises an image capturing module 111, an image analyzing module 112, a transmission module 113, a processor 114, and a database 115. The image capturing module 111 is configured to capture a screen image of the display device 81. The image analyzing module 112 is connected to the image capturing module 111 and store a preset screen image. The image analyzing module 112 is configured to analyze the screen image with the preset screen image for detecting the pop-up window, and to generate the pop-up window data by analyzing the pop-up window. The transmission module 113 is configured to publish the pop-up window data to the information theme 131, and to receive the decision data from the information theme 131. The processor 14 is coupled to the transmission module 113 and the display device 81. The processor 14 controls the transmission module 113 to publish the pop-up window and to receive the decision data, and the processor 14 inhibits or closes the pop-up window on the display device 81 according to the decision data. The database 115 is connected to the processor 114. The database 115 is configured to store a plurality of history pop-up window data and a plurality of history decision data. The history pop-up window data are respectively corresponding to the history decision data. In practice, the image capturing module 111 can be an image capturing chip. The image analyzing module 112 can be an image analyzing chip. The transmission module 113 can be a transceiver. The processor 14 can be a central processing unit (CPU), and the database 115 can be a hard disk.
In step S11 of
In practice, the image capturing module 111 can capture the screen images of the display device 81 of the equipment 8 at different time, and the image analyzing module 112 can store the preset screen image. The preset screen image can be the screen image of the equipment in the normal operation. The image analyzing module 112 can compare two adjacent screen images by image differential method (such as image binarization), and detect the pop-up window of the display device 81 of the equipment 8 by image erosion, structural elements, contour calculation, etc. If the image differential value analyzed by the image analyzing module 112 is 0, the image analyzing module 112 can store the present screen image as the preset screen image, so as to be compared with the next screen image captured by the image capturing module 111. If the image differential value analyzed by the image analyzing module 112 is not 0, the image analyzing module 112 can detect the pop-up window of the display device 81 according to the image differential method. In addition, when the equipment starts at the first time or reboots, the preset screen image does not exist in the non-intrusive terminal device 11. At this time, the image analyzing module 112 can set the first screen image captured by the image capture module 111 as the preset screen image.
In step S12 of
In practice, the image analyzing module 112 can obtain the button contour and the button position in the pop-up window data by Canny edge detector, Douglas-Peucker algorithm, or other algorithm. Moreover, the image analyzing module 112 can recognize the button character by Optical Character Recognition (OCR). In addition, the image analyzing module 112 can calculate the position of the pop-up window on the display device 81 and the characters on the pop-up window. It should be noted that the types of the image capturing module 111 and the image analyzing module 112 are not limited to those mentioned above, and the image capturing module 111 and the image analyzing module 112 can be integrated in the same chip.
In step S13 of
In step S17 of
In step S14 of
In step S15 of
In practice, the central processing device 15 can be central controlling computer. The central processing device 15 can pre-store the plurality of solutions, and each of the solutions can comprise different processing means and processing data. For example, the solutions can be closing the pop-up window, minimizing the pop-up window or hiding the pop-up window. In practice, the central processing device 15 further comprises a central processing chip and a displayer. In step S151 of
The operators can not only select one of the solutions for the pop-up window from the pre-stored solutions but also define the solution for the pop-up window by themselves. After receiving the pop-up window without solution yet from the communication interface, the central processing device 15 can rebuild the buttons of the pop-up window on the displayer according to the button data in the pop-up window data, and the central processing device 15 can generate decision data corresponding to the pop-up window through, but not limited to, the mouse event. In practice, the operators can click one of the button of the pop-up window by the mouse according to the type and information of the pop-up window. At this time, the analyzing and processing chip in the central processing device 15 can record the position coordinate of the mouse and the clicking location on the displayer by the mouse for generating the decision data.
The decision data generated by the central processing device 15 can be determined by the operators, but also in other ways. In one embodiment, the central processing device 15 comprises an analyzing module. The central processing device 15 generates a plurality solutions corresponding to the pop-up window data, and the analyzing module selects one of the solutions as the decision data according to the pop-up window data. In practice, the analyzing module can be a machine learning chip and pre-store a decision module. The analyzing module calculates the solution corresponding to the pop-up window according to the pop-up window data and decision module after the central processing device 15 receives the pop-up window data. In another embodiment, the central processing device comprises a timer. The central processing chip in the central processing device 15 selects a preset solution as the decision data if the central processing device displays the pop-up window for a specific period without receiving the solution.
In step S153 of
In step S16 of
In the non-intrusive shared processing method and system for pop-up window of the present invention, the pop-up window of equipment is detected by the non-intrusive terminal device, and then it is determined if there is any solution existing for processing the current pop-up window. If the pop-up window is an unprocessed pop-up window, it would be published to the information theme of the communication interface. After that, the central processing device manually or automatically generates the decision data corresponding to the pop-up window, and publishes the decision data to the information theme in the communication interface. At last, the non-intrusive terminal device receives the decision data from the information theme in the communication interface, and inhibits or closes the pop-up window of equipment according to the decision data. Therefore, the non-intrusive shared processing method and system for pop-up window can automatically detect the pop-up window of the equipment, and the operators can remotely provide the solution through the communication interface, thereby reducing the labor costs. Moreover, the non-intrusive shared processing method and system for pop-up window of the present invention can also automatically inhibit the pop-up window of the equipment through the non-intrusive terminal device, thereby increasing the production efficiency.
In addition, the data transmission means of the non-intrusive terminal device and the central processing device can be other ways except those aforementioned. In one embodiment, when the non-intrusive terminal device and the central processing device subscribe to the same information theme, the communication interface directly connects the non-intrusive terminal device and central processing device with each other. When the non-intrusive terminal device publishes the pop-up window, the pop-up window data would be transmitted to the central processing device directly. In the same way, when the central processing device publishes the decision data, the decision data would be transmitted to the non-intrusive terminal device directly.
The non-intrusive shared processing system for pop-up window in
In this embodiment, the first non-intrusive terminal devices 21A, the second non-intrusive terminal devices 21B and the central processing device 25 all subscribe to the information theme 231 in the communication interface 23. As shown in the steps of
Similar, when the first non-intrusive terminal device 21A, the second non-intrusive terminal device 21B and the central processing device 25 all subscribe to the information theme 231, the communication interface 23 directly connects the first non-intrusive terminal device 21A, the second non-intrusive terminal device 21B and the central processing device 25 with each other. When the first non-intrusive terminal device 21A publishes the pop-up window data and the central processing device 25 publishes the decision data, the pop-up window data and decision data are also transmitted to the second non-intrusive terminal device 21B.
Please refer to
In practice, the first equipment 8A and second equipment 8B can be the first type equipment, and the third equipment 8C and fourth equipment 8D can be the second type equipment. Although the type of the first equipment 8A and the second equipment 8B is different from that of the third equipment 8C and the fourth equipment 8D, the pop-up windows with the same type may appear on the first equipment 8A and the third equipment 8C. Therefore, after the first non-intrusive terminal device 31A publishes the pop-up window data to the first information theme 331A in the communication interface 33 and the central processing device 35 generates the decision data according to the pop-up window data, the central processing device 35 can also publish the pop-up window data and the decision data to the second information theme 331B in addition to publishing the decision data to the first information theme 331A. At this time, the third non-intrusive terminal device 31C can receive and store the pop-up window data and the decision data from the second information theme 331B. Similarly, the second non-intrusive terminal device 31B can receive and store the pop-up window data and decision data from the first information theme 331A, and the fourth non-intrusive terminal device 31D receive and store the pop-up window data and the decision data from the second information theme 331B. Therefore, the non-intrusive shared processing method and system for pop-up window makes the equipments with different types to process the pop-up windows with the same type through multiple information themes for reducing the processing time of the operators, improving efficiency and saving costs.
In addition, although the pop-up windows with the same type may appear on the first equipment 8A and the third equipment 8C, the first equipment 8A and third equipment 8C may need different solutions for the pop-up windows because they may comprise different parameters or thresholds. Therefore, the first non-intrusive terminal device 31A and third non-intrusive terminal device 31C can respectively publish the pop-up window data to the first information theme 331A and second information theme 331B, and the central processing device 35 respectively establish the pop-up window of the first equipment 8A and the pop-up window of the third equipment 8C. After that, the operators can respectively select the solutions suitable for the pop-up windows of the first equipment 8A and the third equipment 8C to generate the decision data. Finally, the central processing device 35 publishes the decision data respectively corresponding to the pop-up windows of the first equipment 8A and the third equipment 8C to the first information theme 331A and second information theme 331B. The first non-intrusive terminal device 31A and third non-intrusive terminal device 31C respectively receive the decision data from the first information theme 331A and second information theme 331B. Therefore, the non-intrusive shared processing method and system for pop-up window makes the equipments with different types to process the pop-up windows with the different types through multiple information themes for reducing the processing time of the operators, improving efficiency and saving costs.
The decision data can be generated by other device in addition to the central processing device. Please refer to
In practice, the operators can generate the decision data from the display device of the equipment. After the first non-intrusive terminal device 41A publishes the pop-up window data of the pop-up window, the processor of the third non-intrusive terminal device 41C can present the pop-up window data on the third display device 81C of the third equipment 8C. The operators can execute the processing through the mouse and keyboard of the third equipment 8C. At this time, the processor of the third non-intrusive terminal device 41C records the position coordinate of the mouse on the third display device 81C and the clicking location of the mouse for forming the decision data. And then, the processor of the third non-intrusive terminal device 41C controls the transmission module to publish the decision data to the information theme 431 of the communication interface 43. Furthermore, the first non-intrusive terminal device 41A receives the decision data from the information theme 431 in the communication interface 43 for inhibiting the pop-up window on the first display device 81A. In addition, the second non-intrusive terminal device 41B receives and stores the pop-up window data and the decision data from the information theme 431 of the communication interface 43. Therefore, the non-intrusive shared processing system for pop-up window can directly process the pop-up window on the equipment for increasing convenience and efficiency.
In summary, the non-intrusive shared processing method and system of the present invention can automatically detect the pop-up window of the equipment, and the operators can remotely provide the solution through the communication interface, thereby reducing the labor costs. In addition, the non-intrusive shared processing method and system for pop-up window of this invention can automatically inhibit the pop-up window generated by the equipment through the non-intrusive terminal device, thereby reducing the labor costs and increasing the production efficiency. Furthermore, the non-intrusive shared processing method and system for pop-up window of the present invention can automatically detect and compare the current pop-up window with the processed pop-up window through the storage device, thereby increasing the detecting efficiency and reducing the time costs. Moreover, the non-intrusive shared processing method and system for pop-up window of the present invention can automatically transmit the pop-up window data and the corresponding solution to the equipments of the same type by the way of subscribing/publishing, thereby reducing the processing time of the operators, increasing the efficiency and lowering the cost. In addition, the non-intrusive shared processing system for pop-up window of the present invention can directly process the pop-up window on the equipment, thereby increasing convenience and efficiency.
With the examples and explanations mentioned above, the features and spirits of the invention are hopefully well described. More importantly, the present invention is not limited to the embodiment described herein. Those skilled in the art will readily observe that numerous modifications and alterations of the device may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
110116945 | May 2021 | TW | national |