The present invention relates to a graphical user interface technique.
Along with the improvement of the arithmetic processing performance of computers, an operating system (to be referred to as an OS hereinafter) having a graphical user interface (GUI) in place of a character-based user interface (CUI), and application programs which run on such OS are of long-continued after their appearances.
Since applications for the GUI of recent personal computers (to be referred to as PCs hereinafter) display various buttons, icons, and pull-down menus (to be generally referred to as controls hereinafter) unlike the CUI, it is easy to visually and intuitively recognize the operation contents.
For example, a simple character string or mark (symbol) is displayed on each displayed button, so as to inform the user of the contents to be executed upon operation of that button.
However, even when a character string or mark is displayed on each button, it is difficult to recognize the correspondence between the buttons and their processing contents at the beginning of use of an application program. Especially, when there are many controls such as buttons and the like, such tendency is high.
For this reason, an application program normally adopts a help system that gives comments of the use method of that application (for example, reference “Learning Carbon” (Chapter 12 Help; p. 273), Ohmsha, Ltd. (the first impression of the first edition, Dec. 27, 2001)).
The help system is launched from a predetermined menu of an application, and various display forms of help systems such as keyword search, hierarchical display by processing items, and the like are available.
Also, a technique that stores the user's operation history, and displays help information according to the stored history (e.g., Japanese Patent Laid-Open No. 2000-330683) or a technique of a help system which can register target application programs and can cope with general-purpose applications (e.g., Japanese Patent Laid-Open No. 2000-196850) is known.
Furthermore, like Help Center of “OS 9” provided by Apple Computer, Inc., a technique which provides a comment message about a given control in a “balloon” form when the user moves a cursor that cooperates with a pointing device to that control is available.
The conventional help system can provide a hint about what to do upon executing target processing, and can inform the user of comment information about the meaning of a control of interest. However, with increasing complexity/functions of a GUI application program, the size of a program file (including a program code file and data file) of the help system is ballooning is growing. Also, PCs used by the users have various hardware resources, and it is impossible for an application program whose processes change depending on the hardware resources to configure help systems for respective individuals.
Moreover, the conventional help system is prepared by an application vendor unilaterally, and is created independently of data to be manipulated by the users. Hence, the conventional help system is no better than message outputs in a greatest common manner.
It is an object of the present invention to provide a technique which can prevent ballooning of comment information while being applied to an operation environment of the user, and can give comment information associated with an intuitively plain operation.
In order to achieve the above object, for example, an information processing apparatus of the present invention comprises the following arrangement. That is, an information processing apparatus which lays out selectable processing items in a display window, and executes a corresponding process when one of the processing items is designated by a predetermined instruction, comprises:
acquisition means for, when the display window is displayed, acquiring display image data which forms the display window; and
display control means for displaying the acquired image data and comments of the processing items in association with each other together with the display window.
Also, an image edit apparatus to which the present invention is applied comprises the following arrangement. That is, an image edit apparatus which displays an image, and edits the displayed image by selecting a desired image process item, comprises:
determination means for determining if an instruction of a comment display of a processing item associated with an image edit process is input;
acquisition means for, when the determination means determines that the instruction of the comment display is input, acquiring displayed image data to be edited; and
Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.
Preferred embodiments of the present invention will be described in detail hereinafter with reference to the accompanying drawings.
With the above arrangement, when the power switch of the PC 100 is turned on, the CPU 1 executes the boot program stored in the ROM 2, and loads and launches the OS from the HDD 4 onto the RAM 3, After that when a designation input of an application of this embodiment is issued, that application program is loaded onto the RAM 3, and executes various kinds of processing using the MFP 200.
Assume that Windows(R) provided by Microsoft Corporation will be exemplified as the OS of this embodiment. Also, a utility application program which stores and manages images input from the MFP 200 in the HDD 4 in the form of an album, and prints these images will be exemplified as the application program of this embodiment.
When images are stored and are printed as needed, it is a common practice to display a GUI window having buttons corresponding to respective functions.
In
When the “document scan” button is clicked, the current window is switched to a GUI window for a document scan mode (not shown) (i.e., the control shifts to document scan processing), a process for scanning documents set on the MFP 200, and storing their images in an album (a folder which is assured on the HDD 4 and is managed by this application) is executed.
Upon clicking the “copy” button, the control shifts to a process for scanning a document, and printing its copy on a print sheet. Upon clicking the “album list” button, the control shifts to a process for displaying a list of images which were previously registered in the album.
In practice, various menu items line up on the window top of
The present inventors have hit on an idea that a GUI window shown in
On a GUI window 40 shown in
Since the buttons and messages indicating the processing contents upon clicking these buttons are displayed in correspondence with each other, the user can more easily recognize the processing upon clicking each button displayed on the window.
Note that “MFP1230” is selected in a combo box associated with the connected model at the lower left position on the window 40. In addition, a message corresponding to this portion may be displayed on the message display area.
When a model that can receive a memory card which stores images sensed by a digital still camera or the like is selected as the connected MFP, since means for inputting images includes means for reading images from the memory card in addition to the means for scanning documents, a window 40 shown in
In
That is, as can be easily understood from
Upon displaying the GUI window, as shown in
The problem lies in the scale-down image displayed on the reference image display area 42. Even the scale-down image preferably has the same display color of the window 40 to be operated by the user, and the information size of this portion is incommensurably larger than other information sizes. Since the recent OS using the GUI can change the display pattern (color, appearance) of the window to be displayed using a technique called a desktop theme, a huge information size is required to prepare scale-down images in correspondence with individual cases.
In order to solve the above problem, the present inventors can display the GUI window 40 shown in
Procedure 1. The window 40 is displayed while leaving the reference image display area 42 in blank. At this time, messages displayed on the message display area 41 depend on the previously selected model name.
Procedure 2. The displayed window 40 is self-captured. Note that self-capturing is a process for acquiring bitmap image data of the displayed window 40. The application can acquire its window size and position by utilizing the function call of the OS. A bitmap image of the corresponding rectangular area of the video memory of the display controller 6 can be acquired based on this information. Since the OS which runs on the PC 100 of this embodiment is Windows(R), a bitmap image of its own window 40 can be acquired using an API (a process executed when a “PrintScreen” key is pressed whole holding down an “Alt” key).
Procedure 3. The acquired image data of the window 40 undergoes a scale-down process to fall within the size of the reference image display area 42. Thus scale-down process can be implemented by decimation of pixels.
Procedure 4. The scale-down window image is displayed within the reference image display area, and arrow lines indicating the contents of the message display area and scale-down images are displayed on the basis of the information depending on the selected model.
The processes of procedures 2 to 4 above are done instantaneously since the recent CPU 1 has a high processing speed. That is, the user hardly feels odd since it looks as if the scale-down version of the window were displayed on the reference image display area 42 simultaneously with display of the window 40, as shown in
Upon clicking the “document scan” button in
The structure and operation of the application program of this embodiment will be described below.
As shown in
Hence, in this embodiment, files having information associated with GUI windows are prepared for respective MFPs that can be connected, and are specified by a model name selected from the model name combo box on the GUI window in
The processing operation of the application program of this embodiment will be described below with reference to the flowchart of
When the application program is launched, the GUI window file of the previously selected MFP is read in step S1. Note that information indicating the previously selected MFP is saved as an independent file upon selecting the model. In this embodiment, since Windows(R) has been exemplified as the OS, such information can be registered in a registry or the like.
The flow advances to step S2, and a root window is set as an object to be displayed so as to display a default window. As a result, since the window to be displayed is determined, the flow advances to step S3, and the GUI window 40 (see
It is then checked in step S4 if the self-capturing flag of the window of interest is ON. If the self-capturing flag is ON, the flow advances to step S5 to execute a process for acquiring image data of the displayed window (self-capturing process). The acquired window image undergoes a scale-down process to fall within the reference image display area 42 in step S6, and is displayed on the reference image display area 42 in step S7.
After that, the control waits for a user's instruction input in step S8.
If it is determined in
On the other hand, if a displayed menu or button is clicked, one of two different processes is executed. That is, one instruction is that for displaying another window, and the other instruction is that for starting the process (print start instruction or the like). These distinctions comply with respective buttons and menu items.
If it is determined that the other window display instruction (a shift instruction to a sub window) is input, a setting is made to display the corresponding window in step S9, and the processes in step S3 and subsequent steps are executed. Of course, if the “self-capturing flag” in that sub window information is ON, the process for acquiring and displaying the self window image is executed.
On the other hand, if it is determined that the processing start instruction is input, the corresponding process is executed in step S10.
As described above, according to this embodiment, upon displaying an application window, image data of the application window is acquired, and correspondence between the acquired image and items (buttons, menus) that can be operated by the user is presented, thus providing a user interface that can be easily understandable for the user. Even when the types of hardware resources (MFPs in this embodiment), desktop themes, and the like are different for respective users, the self-capturing result of a self window image according to the hardware resources and desktop theme can provide information that supports the user's operation. Hence, window images need not be prepared for individual hardware resources, and the application program size can be suppressed from increasing.
An image edit process of this embodiment will be described below. This process is executed when the “album list” button is clicked on the window of
As shown in
An image display area 91 displays an image designated (selected) by the user. When the image size exceeds the window size, a desired area can be displayed by operating scroll bars 92 and 93. Also, the window size may be changed.
The image edit window 90 shown in
As image edit processes, trimming, color conversion (monotone conversion), rotation, filter processes associated with softening and sharpness, and various special effects are known. It is difficult for the beginner to recognize terms and meanings used in these image edit processes. Therefore, a help system that gives comments of respective terms are normally prepared in an application program, but it merely gives comments of respective terms as sentences.
The application of this embodiment gives comments of various image processes using an image which is read as an object to be edited by the user in practice.
In
As shown in
An object to be displayed upon displaying the actual example of the image process is an image in the image display area 91 in the self-captured window in place of the entire self-captured window. This is because the user wants to know the meaning of “trimming” in this case, and comments of other processing items are not necessary. In addition, when the actual example is presented within the limited space, it is effective to preferentially display an image to be edited in place of displaying the entire window.
Since the application program can acquire the display size of the self window from the OS, and the number of menus and the like are known, it is apparent that it can determine the location of the image display area 91. An area slightly inside the image display area 91 may be captured in place of just a circumscribed rectangle of the image display area 91.
Upon displaying the actual example, for an image process such as trimming or the like, which requires area designation, target area information of a pre-edit image display area 96 (e.g., an area having the same center as the pre-edit image display area 96 and the height and width 80% of the area 96) is stored as needed, a line segment 96a indicating that area is displayed, and the result of the selected image process within the line segment 96a is displayed in a processing result display area (or post-edit image display area) 97. As for an image process that does not require any area designation, no line segment 96a is displayed, and an actual processing result of an image in the pre-edit image display area 96 can be displayed in the processing result display area 97.
The process after the image edit window 90 of this embodiment is displayed will be described below with reference to the flowchart of
In step S21, the user's instruction contents are checked. If it is determined that the instruction contents are other than a help, a corresponding process (a read, save, print, actual image edit process, or the like of an image) is executed in step S22.
On the other hand, if the help of the glossary is designated, it is checked in step S23 if an image to be edited is read onto the image display area 91. If NO in step S23, the flow advances to step S24 to display a message “read an image to be edited since this application gives a comment using an actually read image” or the like. Then, the flow returns to step S21.
If it is determined that the image to be edited is read, the edit window 90 is self-captured in step S25, and is trimmed to leave only the image display area 91 and is temporarily saved in the RAM 3 in step S26. In step S27, the help window 95 which allows to select the list of image processes is displayed. It is checked in steps S28 and S29 if a help process end instruction is issued, and if one of the image processes is selected. If the help process end instruction is issued, this process ends. On the other hand, if one of the image processes is selected, the flow advances to step S30 to display a comment part of the selected image process on the help window 95, and to display the image temporarily saved in the RAM 3 on the pre-edit image display area 96. At this time, in case of the image process that requires area designation, since a predetermined area in the pre-edit image display area 96 is designated in advance, that area is displayed to be bounded by a line segment.
Next, the image process selected by the user is applied to the image in the area set in step S32, and the processing result is displayed on the post-edit image display area 97. As a result, if “trimming” is designated as the image process, display shown in
If “back” is designated, since the flow returns to step S27, i.e., to the select window of processing items, the user can designate another image process. In this case, a comment of another image process can be given on the basis of the self-captured image (image in the image display area 91), which is temporarily stored in the RAM 3.
As described above, according to this embodiment, a comment about actual processing contents can be given on the comment (help) window of various image processes taking an image which is displayed by the user on the image edit window 90 as an object to be edited as an example. Hence, the user can receive a comment about his or her interesting image, and can easily understand the image process. Since the programmer of this application need not prepare a help system with images, the program and data size of that help system can be greatly reduced.
The embodiment according to the present invention has been described. A characteristic feature of the present invention lies in a computer program. In general, a computer program is stored in a computer-readable storage medium such as a CD-ROM or the like, and is ready to run after the computer-readable storage medium is set in an apparatus, and the computer program is copied or installed in a system. Hence, such computer-readable storage medium is also included in the scope of the present invention, as a matter of course.
This embodiment has exemplified the application program using the MFP. However, the present invention is not limited to such specific application.
As described above, according to the present invention, when a window including processing items is displayed, display image data which forms that display window is acquired, and the acquired image data and commends of the respective processing items are displayed together with the display window in association with each other. Hence, a comment about the actually displayed display window can be given.
According to another invention, when a comment about a processing item associated with an image edit process is to be given, image data displayed as an object to be edited is acquired, the acquired image is displayed as a pre-edit image, the result obtained by applying the image process of the processing item corresponding to a comment display request is displayed as a post-edit image, and a comment of the processing item corresponding to the comment display request is displayed together with these images. Hence, a comment can be given using the user's interesting image, and ballooning of the information size required for the process for giving a comment using the image can be suppressed.
As many apparently widely different embodiments of the present invention can be made without departing from the spirit and scope thereof, it is to be understood that the invention is not limited to the specific embodiments thereof except as defined in the claims.
This application claims priority from Japanese Patent Application No. 2004-191457 filed on Jun. 29, 2004, which is hereby incorporated by reference herein.
Number | Date | Country | Kind |
---|---|---|---|
2004-191457 | Jun 2004 | JP | national |