Patent Application
20110010642
1. Field of the Invention
The present invention relates to an image processing apparatus in which plural virtual machines can operate, and more particularly to a technology for controlling a display device of the image processing apparatus.
2. Description of the Related Art
The virtualization technology is known for building a pseudo system in which plural computers appear to be operating in a single physical computer. A pseudo information processing system environment (logic computer) implemented by the virtualization technology is referred to as a virtual machine (VM) (see, for example, International Publication WO01/084303).
In recent years and continuing, the virtualization technology has been applied as an operational environment for image processing apparatuses such as multifunction peripherals (MFP) and personal computers (PC). For example, an operational environment is established in the following manner. That is, two virtual machine environments are operated in a single image processing apparatus. The first virtual machine executes the main functions of image processing. The second virtual machine executes extension functions such as customized functions.
One of the purposes of applying the virtualization technology to image processing apparatuses is to secure the robustness of main functions relevant to image processing.
The software for implementing the extension functions may include software that has been developed by other companies such as third party vendors. Unlike the main functions, the software for the extension functions is likely to cause failures, such as a failure in collaborating with other software. When such a failure occurs due to software developed by another company, the manufacturer of the image processing apparatus may not be able to fix the failure. Therefore, it may be time consuming to fix the failure. For this reason, there is demand for an image processing apparatus having an operational environment in which the main functions and the extension functions are operated in different virtual machines, so that even when a failure occurs in an extension function, the processes of the main functions are unaffected by such a failure.
Incidentally, recent image processing apparatuses can display a wide variety of information items on a large display panel. For example, Japanese Laid-Open Patent Application No. 2008-131388 discloses an image processing apparatus in which browser is used for controlling the operation of displaying information (display control).
However, in conventional image processing apparatuses, in order to display information on a display screen, an increased amount of communication data is exchanged between the virtual machines, and the frequency of communication increases between the virtual machines. Consequently, the process of displaying the information on the display screen is delayed, which leads to degraded usability for the user.
In an image processing apparatus having plural virtual machines, communications are performed between a first virtual machine and a second virtual machine such that the functions are implemented as if they are operating in a single virtual machine. In such an environment of the image processing apparatus, when the operation of displaying an updated screen page is executed, data including the updated information is exchanged between the virtual machines. The updated information may amount to a large volume. As a result, when the operation of displaying information is implemented in the image processing apparatus, an increased amount of communication data is exchanged between the virtual machines, and the frequency of communication increases between the virtual machines.
The present invention provides an image processing apparatus, a display control method, and a computer-readable recording medium, in which one or more of the above-described disadvantages are eliminated.
A preferred embodiment of the present invention provides an image processing apparatus, a display control method, and a computer-readable recording medium, with which information can be displayed on a display screen at high speed in a system with plural virtual machines.
According to an aspect of the present invention, there is provided an image processing apparatus including a first virtual machine in which a standard function of the image processing apparatus is operated; a second virtual machine in which an extension function that uses the standard function is operated, the second virtual machine being different from the first virtual machine; plural operation modules configured to implement display control on a display screen page as the standard function; a first communications interface unit configured to operate in the first virtual machine; and a second communications interface unit configured to operate in the second virtual machine, wherein the first communications interface unit and the second communications interface unit perform inter-virtual machine communication that is common to the plural operation modules, the second communications interface unit includes a generating unit configured to generate display control data with the use of a display control command in response to a screen page update request from an application that implements the extension function, the display control data being used for performing the display control on the display screen page of the application, and a data transmitting unit configured to transmit the display control data generated by the generating unit to the first virtual machine in which the standard function is operated, and the first communications interface unit includes a data receiving unit configured to receive the display control data from the second virtual machine, and a requesting unit configured to send, to a screen page control module configured to perform screen page control included among the plural operation modules, a request to perform the display control in accordance with the display control data received by the data receiving unit.
According to an aspect of the present invention, there is provided a display control method performed in an image processing apparatus including a first virtual machine in which a standard function of the image processing apparatus is operated, a second virtual machine in which an extension function that uses the standard function is operated, the second virtual machine being different from the first virtual machine, plural operation modules configured to implement display control on a display screen page as the standard function, a first communications interface unit configured to operate in the first virtual machine, and a second communications interface unit configured to operate in the second virtual machine, wherein the first communications interface unit and the second communications interface unit perform inter-virtual machine communication that is common to the plural operation modules, the display control method including generating step performed by the second communications interface unit to generate display control data with the use of a display control command in response to a screen page update request from an application that implements the extension function, the display control data being used for performing the display control on the display screen page of the application; a data transmitting step performed by the second communications interface unit to transmit the display control data generated by the generating unit to the first virtual machine in which the standard function is operated; a data receiving step performed by the first communications interface unit to receive the display control data from the second virtual machine; and a requesting step performed by the first communications interface unit to send, to a screen page control module configured to perform screen page control included among the plural operation modules, a request to perform the display control in accordance with the display control data received by the data receiving unit.
According to an aspect of the present invention, there is provided a computer-readable recording medium having recorded therein instructions for causing a computer to function as an image processing apparatus including a first virtual machine in which a standard function of the image processing apparatus is operated, a second virtual machine in which an extension function that uses the standard function is operated, the second virtual machine being different from the first virtual machine, plural operation modules configured to implement display control on a display screen page as the standard function, a first communications interface unit configured to operate in the first virtual machine, and a second communications interface unit configured to operate in the second virtual machine, wherein the first communications interface unit and the second communications interface unit perform inter-virtual machine communication that is common to the plural operation modules, the instructions causing the image processing apparatus to execute a generating step performed by the second communications interface unit to generate display control data with the use of a display control command in response to a screen page update request from an application that implements the extension function, the display control data being used for performing the display control on the display screen page of the application; a data transmitting step performed by the second communications interface unit to transmit the display control data generated by the generating unit to the first virtual machine in which the standard function is operated; a data receiving step performed by the first communications interface unit to receive the display control data from the second virtual machine; and a requesting step performed by the first communications interface unit to send, to a screen page control module configured to perform screen page control included among the plural operation modules, a request to perform the display control in accordance with the display control data received by the data receiving unit.
According to one embodiment of the present invention, an image processing apparatus, a display control method, and a computer-readable recording medium are provided, with which the amount of data communicated between virtual machines can be reduced while performing display control of a display screen page, and a screen page can be displayed at high speed in a system with plural virtual machines.
Other objects, features and advantages of the present invention will become more apparent from the following detailed description when read in conjunction with the accompanying drawings, in which:
A description is given, with reference to the accompanying drawings, of embodiments of the present invention.
<Hardware Configuration>
As shown in
The display device 120 has a display unit and an input unit such as a touch panel. The display device 120 is for providing the user with various kinds of information such as device information, and for receiving various user-input operations such as operational settings and operational instructions. The plotter 130 includes an image forming unit and forms images (output images) on a sheet. The output images may be formed by an electrophotographic method, an inkjet method, etc. The scanner 140 optically scans an original document, and generates a scanned image.
The controller 110 includes a CPU (Central Processing Unit) 111, a storage device 112, a network I/F 113, and an external storage I/F 114, which are connected to each other by the bus B.
The CPU 111 executes programs to implement various functions and to control the overall image processing apparatus 100. The storage device 112 stores the aforementioned programs and various kinds of data (for example, image data). For example, the storage device 112 may be a RAM (Random Access Memory) that is a volatile memory, a ROM (Read Only Memory) that is a nonvolatile memory, and a HDD (Hard Disk Drive) having a large capacity storage area. The RAM functions as a work area (storage area into which programs and data are temporarily loaded) of the CPU 111. The ROM and HDD are used for storing programs and various kinds of data. Accordingly, in the image processing apparatus 100, the CPU 111 loads the programs into the RAM from the ROM, and executes the programs.
The network I/F 113 is an interface for connecting the image processing apparatus 100 to a predetermined data transmission line such as a network. The external storage I/F 114 is an interface for connecting a recording medium 114A, which is an external storage device, to the image processing apparatus 100. For example, the external storage device may be an SD memory card or a USB (Universal Serial Bus) memory. Accordingly, the image processing apparatus 100 can read the programs and data stored in the recording medium 114A via the external storage I/F 114.
According to the above-described hardware configuration of the image processing apparatus 100, the CPU 111 may execute a program that has been loaded into the RAM from the HDD to operate one or more virtual machine environments.
<System and Software Configuration>
As shown in
(Display Device)
The display device 120 includes applications relevant to screen display, such as a browser 11, a Flash Player 12, and a soft keyboard 13, which are operated on an OS (Operating System) 10. The OS 10 is embedded basic software such as Linux (registered trademark, hereafter omitted). The browser 11 is software for browsing Web contents described in HTML (HyperText Markup Language). The Flash Player 12 (registered trademark, hereafter omitted) is a browser plug-in that corresponds to a cross-platform with which Web contents can be provided. The soft keyboard 13 is GUI (Graphical User Interface) software for supporting the operation of inputting characters with a display screen.
The display device 120 can provide information to the user and display a GUI, with the above-described software configuration.
(Controller)
The system configuration illustrated in
As shown in
Plural virtual machine environments can be implemented by operating plural Java VMs 21 on the OS 20. In the present embodiment, a Java VM 211 and a Java VM 212 (two Java VMs 21),are operated to implement a first virtual machine environment and a second virtual machine environment (two virtual machine environments), respectively. In the following descriptions, the Java VM 211 and the Java VM 212 are referred to as a first virtual machine 211 and a second virtual machine 212, respectively. The first virtual machine 211 and the second virtual machine 212 may be referred to as a virtual machine 21 (without distinguishing whether it is a first or second virtual machine). Similarly, software (for example, programs and data) and storage areas operated in the respective virtual machines 21 may also be collectively referred to with common reference numerals (a subscript 1 and a subscript 2 accompanying the reference numerals are relative to the first virtual machine 211 and the second virtual machine 212, respectively).
The virtual machine 21 includes a heap memory 211 for operating a Java component 22 provided on the virtual machine 21. The heap-memory 211 is a memory area that can be freely used by an application operating on the virtual machine 21. As described above, in this system with plural virtual machines 21, each virtual machine 21 has a separate heap memory 211. Therefore, even if a failure occurs and a process stops in one of the virtual machines 21, the systems of the other virtual machine 21 will be unaffected.
The Java component 22 that is operated on the virtual machine 21 includes plural Java programs for implementing the functions of the platform and application, i.e., a Java platform 221 and a Java application 222, as shown in
As described above, an environment with plural virtual machines 21 is built into the image processing apparatus 100 according to the present embodiment.
Next, a detailed description is given of the software configuration in the above system.
For example, assuming that the image processing apparatus 100 of the above-described system is a MFP (Multifunction Peripheral), the image processing apparatus 100 may have the following system.
In the first virtual machine 211, standard functions such as a printer, a scanner, and a fax (facsimile) are operated. The Java application 2221 of the Java component 221 operating on the first virtual machine 211 includes a standard application 222A1 and an SDK (Software Development Kit) application 222B1. The Java platform 2211 includes a group of Java modules (group of operation modules) 221A1 and an SDK API (Application Program Interface) 221B1.
The standard application 222A1 is software for implementing a user-provided function using standard functions installed in the MFP. The standard application 222A1 uses, as a standard function, an operation module in the group of Java modules 221A1 of the platform. For example, the group of Java modules 221A1 includes operation modules (not shown) for implementing standard functions such as a printer, a scanner, and a fax machine. Accordingly, the standard application 222A1 implements a copy function (copy application) with the use of the operation modules of a printer and a scanner in the group of Java modules 221A1.
The group of Java modules 221A1 includes operation modules for implementing the standard functions relevant to display control. Examples of such operation modules are a screen control module 42, a hard key event distribution module 43, and an LED (Light Emitting Diode) lighting module 44. The screen control module 42 is an operation module for implementing a screen control function such as generating and updating screen pages. The hard key event distribution module 43 is an operation module for implementing a distribution function of an event (for example, an event of pressing the start key) detected from hard keys such as a numeric keypad (not shown) of the image processing apparatus 100. A distribution function is for reporting the detected event to various functions that are operated according to the corresponding event. The LED lighting module 44 is an operation module for implementing the function of controlling lighting of LEDs provided in the image processing apparatus 100.
As described above, various functions relevant to display control are operated on the first virtual machine 211 of the image processing apparatus 100. Examples of such functions are generating screen pages, updating screen pages, distributing hard key events, and controlling lighting of LEDs.
The SDK application 222B1 is developed with the use of the SDK API 221B1 that is an assembly of commands and functions that can be used when developing software. The SDK application 222B1 is software for implementing functions that uniquely correspond to each user (customized functions). The SDK application 222B1 uses an operation module of the group of Java modules 221A1 included in the platform, via the SDK API 221B1. For example, the SDK application 222B1 implements a usage authentication function for printing (secure print application), by using the printer module of the group of Java modules 221A1 via the SDK API 221B1 in combination with an authentication module that is an extension function.
Meanwhile, in the second virtual machine 212, extension functions (for example, functions provided by third party vendors) for using standard functions are operated.
The Java application 2222, which is included in the Java component 222 that operates on the second virtual machine 212, includes an SDK application 222B2. The Java platform 2212, which is included in the Java component 222 that operates on the second virtual machine 212, includes an SDK API 221B2.
As described above, the SDK application 222B2 can be individually developed by using the SDK API 221B2 of the platform. The SDK application 222B2 for implementing extension functions is software that has been developed and provided by a third party vendor. With regard to the software that has been developed by the third party vendor, it is not known how it has been designed and programmed, what kind of processes it has undergone to be tested, or what kind of process it has undergone before being provided. Therefore, unexpected errors (failures) such as memory leakage may occur during execution.
In such a case, if the SDK application 222B2 (extension function) is operated on the same virtual machine 21 (first virtual machine 211) as the standard application 222A1 (standard function), the entire system may stop (system down) due to a failure of the SDK application 222B2. Thus, in the present embodiment, the standard functions and the extension functions installed in the MFP are operated on different virtual machines 21. Accordingly, even if a failure occurs in the extension function, the MFP may continue to provide the user with services of the standard functions.
However, with such a system configuration, the SDK application 222B2 operating on the second virtual machine 212 needs to perform data communications (inter-virtual machine communications) with the operation module of the group of Java modules 221A1 on the first virtual machine 211. This is because the SDK application 222B2 operating on the second virtual machine 212 implements its function (extension function) by using the operation module (module for implementing a standard function) operating on the first virtual machine 211.
One method of responding to inter-virtual machine communications is to operate a communications module corresponding to each operation module on the second virtual machine 212 (method of responding in units of operation modules). However, numerous communication modules may be needed if the system is large-scale and there are numerous operation modules collaborating with each other in the system. In this case, it is unrealistic to execute the above method. Even if numerous communication modules can be provided for the operation modules, the management/maintenance of the system may involve complex operations in the event of a failure. Furthermore, numerous communication modules need to be operated on the virtual machine 21, which leads to needless consumption of resources.
Therefore, in the present embodiment, each virtual machine is provided with an interface unit for the whole system. The interface units have data communications functions (inter-virtual machine communications functions) performed between the virtual machines 21. The interface unit is a subset module (communications interface unit) 41 of the group of Java modules 221A of the Java platform 221 operating on each virtual machine 21. One subset module 41 operates on each virtual machine 21.
In response to a request to execute a function from the SDK application 222B, the subset module 41 sends a request for executing processes to the operation modules that operate in coordination with each other for implementing the requested function. Furthermore, the subset module 41 exchanges function execution requests with another virtual machine to control execution of operation modules operating on the other virtual machine.
As described above, the subset module 41 functions as a common communications interface for plural operation modules.
Among the display control processes relevant to the SDK application 222B2 that operates on the second virtual machine 212, there are processes that need to be transferred from the second virtual machine 212 to the first virtual machine 211.
Processes that need to be transferred between the virtual machines include generating screen pages, updating screen pages, distributing hard key events, and controlling lighting of LEDs. As described above, these processes are standard functions relevant to display control, and are operated on the first virtual machine 211. Therefore, as for functions of generating screen pages, updating screen pages, and controlling lighting of LEDs, the second virtual machine 212 needs to send a control request to the first virtual machine 211. As for the function of distributing a hard key event, the event needs to be distributed from the first virtual machine 211 to the second virtual machine 212.
Specifically, the display control processes are transferred as follows. For example, the SDK application 222B2 operating on the second virtual machine 212 indicates an operation of requesting an update of the application screen page. The SDK application 222B2 sends a request to update the screen page to the subset module 411 of the first virtual machine 211 via the subset module 412 of the second virtual machine 212. The subset module 411 of the first virtual machine 211 requests the specified screen control module 42 to execute a process based on the screen page update request that has been received.
As described above, in the image processing apparatus 100, inter-virtual machine communications are performed via the subset modules 41 that are communications interfaces, so that a display control process is executed from the SDK application 222B2 operating on the second virtual machine 212.
The only Java application 222 operating on the second virtual machine 212 is the SDK application 222B2, and therefore the subset module 412 of the second virtual machine 212 has an instance (actual value) of the SDK API 221B2 and unique data of the SDK application 222B2.
Furthermore, as shown in
In a GUI provided for the user, image data items are typically used as display elements such as windows and buttons. For example, it is assumed that image data of a display element relevant to the SDK application 222B2 operating on the second virtual machine 212 is held on the second virtual machine 212 (in a storage area of the second virtual machine 212).
In such a configuration, when the display control process is performed via the subset modules 41, the image data necessary for forming the display screen page (a screen page to be displayed) is sent from the second virtual machine 212 to the first virtual machine 211. This leads to an increase in the amount of data communicated between the virtual machines and a delay in displaying images (delay in the processing time), thereby degrading the usability for the user.
Thus, the present embodiment includes the image resource 31 for loading and caching the image data to be used as display elements, to increase the speed of displaying a screen page. That is to say, in the image processing apparatus 100, image data is not exchanged between the virtual machines when performing the display control process, so that the process of displaying the screen page is prevented from being delayed.
The image resource 31 is a predetermined storage area in the storage device 112 (for example, an HDD) provided in the image processing apparatus 100. The image data is loaded and saved in the image resource 31 by each application name and product number, every time the SDK application 222B is installed.
Accordingly, in the image processing apparatus 100, the screen control module 42 operating on the first virtual machine 211 accesses the image resource 31, and displays an application screen page with the use of the image data acquired from the image resource 31, based on application identification information such as an application name or a product number for identifying the SDK application 222B.
<Display Control Function>
A description is given of a display control function of the present embodiment.
In the image processing apparatus 100 according to the present embodiment, the second virtual machine 212 acquires attribute information of display elements that form the display screen page according to a request to update the screen page, and generates display control data with the use of a unique command for display control (hereinafter, display control command) based on the acquired attribute information. The image processing apparatus 100 sends the generated display control data to the first virtual machine 211 on which the screen control module 42 that controls the display screen page is operating. As a result, the image processing apparatus 100 executes the screen control module 42 and performs display control according to the received data, on the first virtual machine 211. The image processing apparatus 100 has the above-described display control function. The display control function according to the present embodiment is implemented as the subset module 41 operates on the virtual machine 21.
As described above, the display control processes transferred from the second virtual machine 212 to the first virtual machine 211 include generating screen pages, updating screen pages, distributing hard key events, and controlling lighting of LEDs.
Among these processes, in the processes of distributing hard key events and controlling lighting of LEDs, the only information that is sent from the second virtual machine 212 to the first virtual machine 211 is hard key information that is distributed and LED information specified for requesting to light an LED. Accordingly, the amount of data transmission is small. Furthermore, when generating a screen page, the only information that is sent from the second virtual machine 212 to the first virtual machine 211 is application identification information used for requesting to generate the screen page. Accordingly, the amount of data transmission is small.
However, in the process of updating a screen page (for example, a process of changing the entire display screen page), a large amount of display element information is sent from the second virtual machine 212 to the first virtual machine 211. An example of inter-virtual machine communications is RMI (Remote Method Invocation API) communications. However, in RMI communications, instances (actual values) of Java are often exchanged, including data that is unnecessary for screen page control. Furthermore, the process of updating a screen page is executed more frequently than the process of generating a screen page, the process of distributing hard key events, and the process of controlling lighting of LEDs.
Accordingly, in inter-virtual machine communications for the process of updating a screen page, a large amount of data is usually transmitted. This leads to a delay in the process of displaying the screen page (delay in the processing time).
Thus, the image processing apparatus 100 according to the present embodiment generates display control data with the use of a unique command for display control, for the purpose of reducing the data transmission amount when updating the screen page. The generated display control data is transmitted from the second virtual machine 212 to the first virtual machine 211 to request display control.
Accordingly, in the image processing apparatus 100, a reduced amount of data is transmitted between virtual machines when implementing display control. As a result, information provided for the user and a GUI can be displayed at high speed (the process of displaying a screen page can be accelerated).
A description is given of a configuration and an operation of the display control function. In the following, function units of the subset module 41 (function units for implementing the display control function) having the same name may be collectively referred to with the same name and same reference numeral.
As shown in
For example, when an event report that a hard key has been pressed is received from the hard key event distribution module 43 operating on the first virtual machine 211, the transmitting unit 5111 of the first virtual machine 211 transmits hard key information based on the reported event to the second virtual machine 212. The transmitted hard key information is received by the receiving unit 5122 of the second virtual machine 212. Accordingly, in the image processing apparatus 100, a hard key event distribution process is transferred from the first virtual machine 211 to the second virtual machine 212.
Meanwhile, when a request to light an LED is received from the SDK application 222B2 of the second virtual machine 212, the transmitting unit 5112 of the second virtual machine 212 transmits specified LED information to the first virtual machine 211 based on the request. The transmitted specified LED information is received by the receiving unit 5121 of the first virtual machine 211. Accordingly, in the image processing apparatus 100, an LED lighting process is transferred from the second virtual machine 212 to the first virtual machine 211.
When a request to generate an application screen page is received from the SDK application 222B2 of the second virtual machine 212, the transmitting unit 5112 transmits application identification information to the first virtual machine 211 based on the request. The transmitted application identification information is received by the receiving unit 5121 of the first virtual machine 211. Accordingly, in the image processing apparatus 100, a screen page generating process is transferred from the second virtual machine 212 to the first virtual machine 211.
When a display control data generating unit 532 (described below) generates display control data instructing to update a screen page in accordance with a request to update the application screen page, the transmitting unit 5112 transmits the generated display control data to the first virtual machine 211. The transmitted display control data is received by the receiving unit 5121 of the first virtual machine 211. Accordingly, in the image processing apparatus 100, a screen page updating process is transferred from the second virtual machine 212 to the first virtual machine 211.
As shown in
The process request unit 521 is a function unit for requesting an operation module operating on the first virtual machine 211 to execute a process. The process request unit 521 makes a request to execute a process according to a process request received at the receiving unit 5121.
For example, when the receiving unit 5121 receives a request to light an LED, the process request unit 521 requests the LED lighting module 44 operating on the first virtual machine 211 to execute an LED lighting process based on the specified LED information accompanying the request. When a request to generate an application screen page is received at the receiving unit 5121, the process request unit 521 requests the screen control module 42 operating on the first virtual machine 211 to execute a screen page generating process based on application identification information accompanying the request. When a request to update an application screen page is received at the receiving unit 5121, the process request unit 521 requests the screen control module 42 operating on the first virtual machine 211 to execute a screen page update process based on the display control data accompanying the request.
Next, as shown in
The display control data generating unit 532 is a function unit for generating display control data with the use of a unique command for display control, for the purpose of reducing the data transmission amount. The display control data generating unit 532 generates display control data based on attribute information of display elements used for forming the application screen page corresponding to the screen page update request.
The information acquiring unit 542 is a function unit for acquiring, from the SDK application 222B2, attribute information of display elements used for forming the application screen page. The attribute information of a display element includes layout positions (layout coordinates), appearance (for example, color and size), and operation (for example, click action).
The SDK application 222B2 needs to update an application screen page when an event report is received. Accordingly, the communications unit 512 determines whether it is necessary to update the application screen page of the SDK application 222B2 according to the display control process transferred from the first virtual machine 211. In the present embodiment, when a hard key event distribution process is transferred, it is determined whether the application screen page is to be updated based on hard key information. The determination whether the application screen page is to be updated may be made based on information other than the hard key information, such as operation event information including various input operation events that are input via the browser 11 or the soft keyboard 13.
When the communications unit 512 determines that the application screen page is to be updated, the communications unit 512 requests the information acquiring unit 542 to acquire attribute information relevant to display elements. The information acquiring unit 542 passes the acquired attribute information to the display control data generating unit 532, to request the display control data generating unit 532 to generate display control data.
The following describes the display control data generated by the display control data generating unit 532.
A description is given of the configuration of display elements P forming the display screen page. The SDK application 222B forms the display screen page with the use of the SDK API 221B. As shown in
As described above, in the hierarchical structure according to the present embodiment, display elements P forming the display screen page are associated with each other.
The display control data generating unit 532 generates display control data 60 as illustrated in
The following are examples of data for controlling “delete”, “add”, and “change” of the display elements P when updating the screen page.
The above described identifier of a display element is identification information (ID) with which each display element P can be uniquely identified. An identifier is assigned to a display element when the SDK application 222B2 forms the application screen page.
The contents of the display element to be added or changed include detailed information relevant to the layout position, the appearance, and the operation of the display element P to be added or changed, as shown in the display control data for adding/changing display elements illustrated in
As described above, in the present embodiment, the amount of data required for display control included in the display control data 60 is minimized, and therefore the amount of data communicated between virtual machines when updating a screen page can be reduced.
Furthermore, in the present embodiment, the display elements P that are control targets are specified according to the parent-child relationship in the hierarchical structure. Accordingly, the following display control process can be performed.
For example, when deleting a display element P, plural display elements P (child display elements), which are laid out on the display element P to be deleted, do not have to be deleted one by one. Only the display element P that is the target to be deleted needs to be specified in the display control data 60. Accordingly, all of the child display elements P can be deleted due to the parent-child relationship.
Furthermore, with the display control data 60, plural requests for updating the screen page can be made by using predetermined separators to divide the display control commands.
The following is an example of data for controlling “delete” and “add” of the display elements P when updating the screen page.
As described above, in the present embodiment, plural display control process requests relevant to the process of updating a screen page may, be made together at once, and therefore the display control data 60 may include plural display control commands.
The display control data generating unit 532 determines the display control command according to the contents of the operation for updating a screen page. Next, the display control data generating unit 532 uses predetermined separators to specify display element identifiers for display elements P that are control targets and a display element P corresponding to the parent. When “add” or “change” is specified as the display control operation for updating a screen page, the display control data generating unit 532 adds the contents (detailed information) of the display element that is the control target to the display control data 60, based on attribute information of the display element P acquired from the SDK application 222B2 by the information acquiring unit 542. The display control data generating unit 532 generates the display control data 60 having the above described structure.
As described above, the display control function according to the present embodiment is implemented as the function units operate in collaboration with each other.
Next, detailed operations of the display control function (collaborated operations of function units) are described with reference to a sequence diagram of processing procedures.
The display control function, which is implemented as a display control program installed in the image processing apparatus 100, is loaded into the RAM from the storage (for example, the ROM), and the following processes are executed. The display control process is described in the order of a process (process 1) for generating an application screen page of the SDK application 222B2 operating on the second virtual machine 212, and a process (process 2) for updating the application screen page of the SDK application 222B2 when a button is pressed.
(Process 1—First Embodiment)
As shown in
The SDK application 222B2 operating on the second virtual machine 212 generates an application screen page with the use of the SDK API 221B2 (step S101).
The SDK API 221B2 sends an application screen page generating request to the subset module 412 operating on the same second virtual machine 212 (step S102). The SDK API 221B2 passes, to the subset module 412, various parameters (hereinafter, screen page generation information), including application identification information specified by the SDK application 222B2 with the generation request.
When an application screen page generation request is received, the subset module 412 uses the communications unit 512 to perform inter-virtual machine communications with the subset module 411 operating on the first virtual machine 211, to transfer the process of generating an application screen page to the first virtual machine 211 (step S103). The subset module 412 uses the transmitting unit 5112 of the communications unit 512 to convert the screen page generation information into a value that can be specified by the screen control module 42 for performing the process of generating an application screen page, and sends the value to the first virtual machine 211. Accordingly, the second virtual machine 212 makes the request for a process to generate an application screen page. As a result, the subset module 411 receives, with the receiving unit 5121 of the communications unit 511, screen page generation information obtained as a result of the conversion (post-conversion screen page generation information), which is sent from the subset module 412 operating on the second virtual machine 212. Thus, the first virtual machine 211 receives the application screen page generation request.
When the subset module 411 receives the application screen page generation request, the receiving unit 5121 of the communications unit 511 sends a request to render an application screen page to the process request unit 521 (step S201). The receiving unit 5121 passes, to the process request unit 521, the post-conversion screen page generation information accompanying the generation request.
The process request unit 521 requests the screen control module 42 to execute an application screen page generating process (to render an application screen page) based on the post-conversion screen page generation information (step S202). The process request unit 521 sets various post-conversion parameters including the application identification information (screen page generation information) as execution parameters for the screen control module 42 and requests the screen control module 42 to execute the application screen page generating process.
Based on the set parameters, the screen control module 42 executes a process of generating an application screen page (rendering an application screen page) on the display screen page of the display device 120 provided in the image processing apparatus 100 (step S203). In the application screen page generation process, when image data is used for the display element P forming the application screen page, the screen control module 42 accesses the image resource 31 and acquires the image data based on the application identification information.
In the display device 120, the application screen page is rendered as described above (step S204). The display device 120 returns the execution result of the application screen page generation process to the process request unit 521 via the screen control module 42.
As described above, in the image processing apparatus 100, inter-virtual machine communications are performed with the use of the subset modules 41 for transferring, to the first virtual machine 211, the application screen page generation process of the SDK application 222B2 operating on the second virtual machine 212, and for generating the display screen page.
(Process 2—First Embodiment)
As shown in
At the display device 120, it is detected that a hard key button has been pressed (step S301). The detection signal indicating that the button has been pressed is passed to the hard key event distribution module 43 (see
When the subset module 411 receives the event report, the communications unit 511 performs inter-virtual machine communications with the subset module 412 operating on the second virtual machine 212, to transfer the process that is performed when the button is pressed (button-press process) to the second virtual machine 212 (step S303). The subset module 411 sends the hard key information and operation event information to the second virtual machine 212, with the use of the transmitting unit 5111 (see
When the subset module 412 receives the button-press process request, the receiving unit 5122 of the communications unit 512 reports the button-press process request to the SDK API 221B2 (step S401). The receiving unit 5122 passes, to the SDK API 221B2, the hard key information and operation event information accompanying the process request.
The SDK API 221B2 requests the SDK application 222B2 to execute the button-press process (step S402). The SDK API 221B2 passes the hard key information and operation event information to the SDK application 22232, and requests the SDK application 222B2 to execute the button-press process.
The SDK application 222B2 executes the button-press process (step S403). Furthermore, the
SDK application 222B2 returns the execution result of the button-press process to the SDK API 221B2.
When the subset module 412 receives the button-press process request, the receiving unit 5122 of the communications unit 512 requests the information acquiring unit 542 to acquire attribute information relevant to the display element P that forms the application screen page after the screen page is updated due to the button-press (step S404).
When the request to acquire attribute information is received, the information acquiring unit 542 acquires attribute information relevant to the display element P from the SDK application 222B2 via the SDK API 221B2 (steps S405 to S407).
The information acquiring unit 542 requests the display control data generating unit 532 of the subset module 412 to generate the display control data 60 when updating the screen page (step S408). The information acquiring unit 542 passes the acquired attribute information to the display control data generating unit 532 and requests the display control data generating unit 532 to generate the display control data 60.
When the data generation request is received, the display control data generating unit 532 generates the display control data 60 based on the attribute information relevant to the display element P and contents of the operation for updating the screen page (step S409). The display control data generating unit 532 determines a display control command according to the contents of the operation for updating the screen page, and specifies a display element identifier of the display element P that is the control target. When “add” or “change” is specified as the display control when updating the screen page, the display control data generating unit 532 adds, to the display control command, the contents of the display element P that is a control target, based on attribute information of the display element P.
The display control data generating unit 532 sends a request to transmit the generated display control data 60 to the subset module 412 operating on the same second virtual machine 212 (step S410). The display control data generating unit 532 passes the generated display control data 60 to the subset module 412.
When the request to transmit the display control data 60 is received, the subset module 412 uses the communications unit 512 to perform inter-virtual machine communications with the subset module 411 operating on the first virtual machine 211, and transfers the application screen page update process to the first virtual machine 211 (step S411). The subset module 412 uses the transmitting unit 5112 of the communications unit 512 to send the display control data 60 to the subset module 411. Accordingly, the second virtual machine 212 makes the request for a process to update the application screen page. As a result, the subset module 411 receives, with the receiving unit 5121 of the communications unit 511, the display control data 60 that is sent from the subset module 412 operating on the second virtual machine 212. Accordingly, the first virtual machine 211 receives the request to update the application screen page.
When the subset module 411 receives the application screen page update request, the receiving unit 5121 of the communications unit 511 sends a request to render an application screen page to the process request unit 521 (step S501). The receiving unit 5121 passes, to the process request unit 521, the display control data 60 accompanying the update request.
The process request unit 521 requests the screen control module 42 to execute the application screen page update process (once again render (rerender) the application screen page), based on the display control data 60 (step S501). The process request unit 521 sets the execution parameter of the screen control module 42 based on the data analysis result of the display control data 60 and requests the screen control module 42 to execute the application screen page update process.
The screen control module 42 executes the application screen page update process (rerender the application screen page) on the display screen page of the display device 120 in the image processing apparatus 100, based on the set parameters (step S503).
In the display device 120, the application screen page is rerendered and updated (step S504). The display device 120 returns the execution result of the application screen page update process to the process request unit 521 via the screen control module 42.
As described above, in the image processing apparatus 100, inter-virtual machine communications are performed with the use of the subset modules 41 to transfer the application screen page update process of the SDK application 222B2 operating on the second virtual machine 212 to the first virtual machine 211, to update the display screen page.
<Overview>
As described above, in the image processing apparatus 100 according to the present embodiment, the second virtual machine 212 acquires attribute information of the display element P that forms the display screen page according to the screen page update request, and generates the display control data 60 with the use of a unique command for display control (display control command) based on the acquired attribute information. The image processing apparatus 100 sends the generated display control data 60 to the first virtual machine 211 on which the screen control module 42 for controlling the display screen page is operating. As a result, in the image processing apparatus 100, the first virtual machine 211 executes the screen control module 42 and performs display control according to the received data.
Accordingly, in the image processing apparatus 100, the amount of data transmitted between the virtual machines for display control can be reduced. As a result, information provided to the user and the GUI can be displayed at high speed (the process of displaying a screen page can be accelerated).
In a second embodiment according to the present invention, a servlet is used as the screen page display module for controlling the display screen page. Accordingly, similar to the first embodiment, the amount of data transmitted between virtual machines for display control can be reduced. In a description of the present embodiment, elements corresponding to those of the first embodiment are denoted by the same reference numerals and are not further described. <Software Configuration>
As shown in
As described above, in the present embodiment, the servlet 45 provides a display screen page via the browser 11. Specifically, in a platform for providing an interface for creating a GUI of Java in a format compatible with AWT (Abstract Windowing Tools), the display element P is converted into an HTML format and displayed on the browser 11, without using an Applet. The AWT is a name of a class library used for implementing a GUI with Java.
The following benefits can be achieved by using the browser 11 for providing a display screen page.
For example, in the display control data 60 of the first embodiment, HTML data is used as detailed information relevant to the display element P. In the conventional method of rendering a display screen page in the AWT format, the instance (actual value) of the display element P in the AWT format needs to be copied to the first virtual machine 211 that renders the screen page, and therefore the data used for displaying a screen page becomes redundant. Furthermore, the data exchanged between virtual machines is an object in the AWT format, and therefore the amount of transmitted data increases.
Conversely, the browser 11 uses HTML data as the data relevant to screen page display, and therefore the amount of data used for displaying a screen page can be reduced.
Furthermore, in recent years and continuing, Ajax (Asynchronous JavaScript+XML) is known as a technology used for the browser 11. Ajax is a technology for building an interface for asynchronous communications in the browser 11. Specifically, asynchronous communications (message exchange) are performed with an XML HTTP Request. Therefore, by using Ajax, the display control data 60 can be asynchronously exchanged between virtual machines with the browser 11. Accordingly, only part of the display screen page needs to be updated in the display control process. As a result, the screen page can be displayed at higher speed.
Furthermore, in the present embodiment, with the above-described software configuration, the display control process, which is performed when a button is pressed on the display screen page (process of updating button image), can be implemented with a JavaScript operating on the browser 11. That is to say, in the display control process when a button is pressed, communications do not need to be performed between virtual machines. As a result, the frequency of communications performed for display control can be reduced.
Specifically, the following describes a case where buttons are laid out on the application screen page of the SDK application 222B2 operating on the second virtual machine 212.
When the SDK application 222B2 makes a request for generating an application screen page, the second virtual machine 212 sends, to the first virtual machine 211, display control data for making the request for generating the screen page, via the subset module 412. The subset module 411 operating on the first virtual machine 211 receives the display control data, and displays the application screen page based on the received data on the browser 11 via the servlet 45.
Therefore, in the present embodiment, a JavaScript program including the following information is sent together with HTML data, as the display control data sent from the second virtual machine 212 to the first virtual machine 211.
As shown in
<Display Control Function>
A description is given of the display control function according to the present embodiment.
The display control function of the image processing apparatus 100 according to the present embodiment is implemented as the subset module 41 operates on the virtual machine 21, which is described in the first embodiment. Thus, details of the function configuration are not further described. However, a description is given of detailed operations of the display control function (coordination operation of function unit groups), with reference to a sequence diagram indicating the processing procedures.
The display control function, which is implemented as a display control program installed in the image processing apparatus 100, is loaded into the RAM from a storage (for example, a ROM) by the CPU 111, and the following process is executed. In the following, a process 1 of generating an application screen page of the SDK application 222B2 operating on the second virtual machine 212, and a process 2 of updating the application screen page of the SDK application 22282 when a button is pressed, are described as examples of the display control process.
(Process 1—Second Embodiment)
As shown in
The SDK application 222B2 operating on the second virtual machine 212 uses the SDK API 221B2 to generate an application screen page (step S601).
The SDK API 221B2 sends an application screen page generation request to the subset module 412 operating on the same second virtual machine 212 (step S602). The SDK API 221B2 passes, to the subset module 412, attribute information relevant to the display element P for forming the application screen page, whereby the attribute information has been received from the SDK application 222B2 accompanying the generation request.
When the application screen page generation request is received at the subset module 412, the communications unit 512 requests the display control data generating unit 532 of the subset module 412 to generate the display control data 60 for generating the screen page (step S603). The communications unit 512 passes the attribute information that has been received to the display control data generating unit 532 to request the display control data generating unit 532 to generate the display control data 60.
When the request to generate data is received, the display control data generating unit 532 generates the display control data 60 based on the attribute information relevant to the display element P and screen page generation contents (step S604). The display control data generating unit 532 generates HTML data for defining the layout of the display screen page as the display control data 60. The HTML data includes a JavaScript program for executing a display control process.
A description is given of the display control data 60 generated by the display control data generating unit 532 according to the present embodiment. As described above, Ajax is used in the present embodiment. Therefore, the display control data generating unit 532 generates the display control data 60 with the use of DOM (Document Object Model). DOM is an API that uses applications to use HTML documents and XML (Extensible Markup Language) documents that are recommended by the W3C (World Wide Web Consortium). The display control data generating unit 532 uses the DOM to generate and update the display control data 60 (HTML data) (generate, add, or delete a display element P for forming the display screen page).
For example, when generating a display element P, the display control data generating unit 532 generates the display control data 60 as an object on the DOM, by document.createElement( ) Furthermore, the display control data generating unit 532 adds a display element P by appendChild( ), and deletes (removes) a display element P by removeChild( ). The display control data generating unit 532 generates and updates the display control data 60 in the above-described manner.
A DIV tag defines the display element identifier (ID) for identifying the display element.
In the display control data 60, the display element P that is a target of control on the display screen page can be identified by the display element identifier.
A DIV tag can define information (display element information) including attributes of the display element P, as illustrated in
The display control data generating unit 532 generates the display control data 60 in an HTML format including the above DIV tags, with the use of a common interface for implementing the process of generating the display elements P. Therefore, the display control data generating unit 532 can execute a generating process common to different types of display elements P. In the process of generating different types of display elements P that are to be laid out in the display screen page, the display control data 60 can be generated in accordance with the hierarchical structure (parent-child relationship) by recursively calling the common interface.
The description of the processing procedures of display control is continued below.
The display control data generating unit 532 sends, to the subset module 412 operating on the same second virtual machine 212, a request to transmit the generated display control data 60 (step S605). The display control data generating unit 532 passes the generated display control data 60 to the subset module 412.
When the request to transmit the display control data is received, the subset module 412 uses the communications unit 512 to perform inter-virtual machine communications with the subset module 411 operating on the first virtual machine 211, to transfer the process of generating an application screen page to the first virtual machine 211 (step S606). The subset module 412 uses the transmitting unit 5112 (see
When the subset module 411 receives the application screen page generation request, the receiving unit 5121 of the communications unit 511 sends a request to render an application screen page to the process request unit 521 (step S701). The receiving unit 5121 passes, to the process request unit 521, the display control data 60 accompanying the update request.
The process request unit 521 requests the servlet 45 to execute a process of generating an application screen page based on the display control data 60 (to render the application screen page) (step S702). The process request unit 521 passes the display control data 60 to the servlet 45 and requests the servlet 45 to execute a process of generating the application screen page.
According to the received display control data 60, the servlet 45 executes a process of generating the application screen page (to render the application screen page) on the browser 11 operating on the display device 120 provided in the image processing apparatus 100 (step S703).
In the display device 120, an application screen page is rendered and generated in the browser (step S704). The display device 120 returns the execution result of the application screen page generation process performed by the browser 11, to the process request unit 521 via the servlet 45.
As described above, in the image processing apparatus 100, inter-virtual machine communications are performed with the use of the subset modules 41 for transferring, to the first virtual machine 211, the application screen page generation process of the SDK application 222B2 operating on the second virtual machine 212, and for generating the display screen page.
(Process 2—Second Embodiment)
At the display device 120, it is detected that a hard key button has been pressed (step S801). The detection signal indicating that the button has been pressed is passed to the hard key event distribution module 43 (see
When a button of a GUI is pressed on the browser 11 operating on the display device 120, the operation event is reported to the subset module 411 via the servlet 45.
When the subset module 411 receives the event report, the communications unit 511 performs inter-virtual machine communications with the subset module 412 operating on the second virtual machine 212, to transfer the process when the button is pressed (button-press process) to the second virtual machine 212 (step S803). The subset module 411 sends the hard key information and operation event information to the second virtual machine 212, with the use of the transmitting unit 5111 (see
When the subset module 412 receives the button-press process request, the receiving unit 5122 of the communications unit 512 sends the button-press process request to the SDK API 221B2 (step S901). The receiving unit 5122 passes, to the SDK API 221B2, the hard key information and operation event information accompanying the process request.
The SDK API 221B2 requests the SDK application 222B2 to execute the button-press process (step S902). The SDK API 221B2 passes the hard key information and operation event information to the SDK application 222B2, and requests the SDK application 222B2 to execute the button-press process. The SDK application 222B2 executes the button-press process (step S903). Furthermore, the SDK application 222B2 returns the execution result of the button-press process to the SDK API 221B2.
In the display device 120, a JavaScript program is executed on the browser 11 in an asynchronous manner with respect to the process of steps 5901 through S903 executed in the second virtual machine 212, to perform the process of updating the application screen page (rerendering the application screen page) when a button is pressed. This process corresponds to step S1001.
In the browser 11, the application screen page is displayed in accordance with the display control data 60 in the HTML format received with the screen page generation request. Furthermore, a JavaScript program is received together with the HTML data with the screen page generation request.
Accordingly, in the browser 11, the JavaScript program is executed and the application screen page is updated when a button is pressed on the GUI. An update process according to the state transition is performed on the display elements P corresponding to the received operation event.
A detailed description is given below. In the browser 11, the display element information 70 corresponding to the update target is identified from the display control data 60, based on the display element identifier of the display element P that has been pressed. The browser 11 updates the identified display element information 70, i.e., the data defined with the DIV tag. As described above, the display control data 60 is generated as a DOM object, and the display element information 70 in the display control data 60 is generated or updated with the use of DOM. Therefore, in the browser 11, the corresponding data is updated with the use of DOM, and the process of updating the application screen page (rerendering the application screen page) is executed. In the display device 120, the application screen page is rerendered and updated in the above manner.
As described above, in the image processing apparatus 100, inter-virtual machine communications are performed with the use of the subset modules 41, in order to transfer the application screen page update process from the SDK application 222B2 operating on the second virtual machine 212 to the first virtual machine 211, and to update the display screen page.
<Modification>
As shown in
For example, as shown in
With the software configuration according to the modification, the frequency of inter-virtual machine communications can be further reduced compared to the configuration in which the servlet 45 inter-virtual machine communications may be performed with the use of the subset modules 41 when distributing hard key events and controlling lighting of the LED. However, when a display screen page is generated or updated, there is no need to perform inter-virtual machine communications. This is because all of the above-described processes of generating/updating a display screen page can be completed as a function that is implemented by the browser 11 and the servlet 45. In order to operate the servlets 45 in both the first virtual machine 211 and the second virtual machine 212, it is preferable to determine port numbers used for HTTP (HyperText Transfer Protocol) communications and URLs (Uniform Resource Locator) registered in the servlets 45, so as not to cause competition between the two servlets 45. That is to say, the web server operating in the first virtual machine 211 and the web server operating in the second virtual machine 212 are to have different port numbers and URLs for use in the browser 11.
<Overview>
As described above, with the image processing apparatus 100 according to the present embodiment, the display control data 60 is generated. The display control data 60 includes detailed information (display element information) including attributes of display elements P forming the display screen page, and a program (procedure) for generating/updating the display element P according to a request. The image processing apparatus 100 sends the generated display control data 60 to the first virtual machine 211 in which the servlet 45 for controlling the display screen page is operating. As a result, the image processing apparatus 100 can process the display control data 60 with the use of the servlet 45 in the first virtual machine 211, and implement display control such as generating/updating the display screen page with the browser operating in the display device 120.
Accordingly, when display control is performed in the image processing apparatus 100, the data amount communicated between virtual machines and the frequency of inter-virtual machine communications can be reduced. As a result, information and GUIs can be displayed to the user at high speed (the speed of displaying screen pages can be increased).
Furthermore, in the present embodiment, the processes of generating/updating a display screen page are implemented by the browser 11 and the servlet 45, and therefore stable operations can be achieved in an environment including plural virtual machines.
The display control function of the image processing apparatus 100 according to the present embodiment is implemented as the CPU 111 executes a program that is encoded in a programming language that is appropriate for the environment (platform) for operating the processing procedures that are described above with reference to various figures.
Such a program may be stored in the computer-readable recording medium 114A. Examples of the recording medium 114A are an SD memory card and a USB memory.
Accordingly, by storing the above program in the recording medium 114A, the program can be installed in the image processing apparatus 100 via the external storage I/F 114 that can read the recording medium 114A. Furthermore, the image processing apparatus 100 includes the network I/F 113, and therefore the program can be downloaded and installed in the image processing apparatus 100 with the use of an electric communications line such as the Internet.
The present invention is not limited to the specific embodiments described herein, and variations and modifications may be made without departing from the scope of the present invention.
The present application is based on Japanese Priority Patent Application No. 2009-163074, filed on Jul. 9, 2009, the entire contents of which are hereby incorporated herein by reference.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2009-163074 | Jul 2009 | JP | national |
