This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2021-052799 filed Mar. 26, 2021.
The present invention relates to an information processing apparatus, a non-transitory computer readable medium storing a program, and an information processing method.
JP4821529B describes a configuration in which based on operation information on a thumbnail image of a user on a screen in which an image based on document data and the thumbnail image are displayed, a display magnification in a case of enlarging and displaying the image is determined, and a menu is provided at an upper portion of the enlarged and displayed image according to the determined display magnification.
In an aspect, in a case where an instruction image of a document on the screen is selected, a document image related to the selected document is displayed. In this aspect, a menu image for accepting an operation or editing on the document is fixedly displayed on, for example, one side or the like of an upper portion of an area of the document image. Meanwhile, in a case where a display position of the instruction image of the document is within a lower portion of the screen, a distance from the instruction image of the document in this lower portion area to the menu image in the upper portion area becomes longer, and operability of the user is reduced.
Aspects of non-limiting embodiments of the present disclosure relate to an information processing apparatus, a non-transitory computer readable medium storing a program, and an information processing method that improve operability of a user as compared with a case where a display position of an instruction image of a document displayed on a screen is not considered in a case of displaying a menu image for accepting an operation or editing of the document.
Aspects of certain non-limiting embodiments of the present disclosure overcome the above disadvantages and/or other disadvantages not described above. However, aspects of the non-limiting embodiments are not required to overcome the disadvantages described above, and aspects of the non-limiting embodiments of the present disclosure may not overcome any of the disadvantages described above.
According to an aspect of the present disclosure, there is provided an information processing apparatus including: a processor configured to: display an instruction image for accepting an instruction of a user on a document on an operation screen for accepting an operation by the user; display a document image related to the document according to the instruction of the user on the instruction image; and display a menu image for accepting the operation of the user on the document image at a position determined by a display position of the instruction image on the operation screen.
Exemplary embodiment(s) of the present invention will be described in detail based on the following figures, wherein:
Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to drawings.
Hardware Configuration of Image Display Apparatus 1
As illustrated in
The arithmetic processing unit 10 includes a central processing unit (CPU) 11 that controls the entire apparatus, as an example of a processor, a random access memory (RAM) 12 to be used as a working memory of the CPU 11, a read only memory (ROM) 13 that stores an image display processing program or the like executed by the CPU 11, a non-volatile memory 14 such as a static RAM (SRAM), a flash memory, or the like backed up by battery, that is rewritable and can hold data even in a case where power supply is interrupted, and an interface unit 15 that controls each unit such as the input unit 20 connected to the arithmetic processing unit 10. Image information such as thumbnail images (described below) displayed on the display unit 40 is stored in the non-volatile memory 14.
In addition to storing image data and the like, the secondary storage unit 30 also stores an image display processing program to be executed by the arithmetic processing unit 10, and the arithmetic processing unit 10 reads the image display processing program to execute each process of the image display apparatus 1 according to the present exemplary embodiment.
Here, the program executed by the CPU 11, as an example of a processor, is provided to the arithmetic processing unit 10 in a state of being stored in a computer-readable recording medium such as a magnetic recording medium (a magnetic tape, a magnetic disk, or the like), an optical recording medium (an optical disk, or the like), an optical magnetic recording medium, a semiconductor memory, or the like. Further, the program executed by the CPU 11 may be downloaded to the image display apparatus 1 by using a communication section such as the Internet.
In the embodiments above, the term “processor” refers to hardware in a broad sense. Examples of the processor include general processors (e.g., CPU: Central Processing Unit) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, and programmable logic device).
In the embodiments above, the term “processor” is broad enough to encompass one processor or plural processors in collaboration which are located physically apart from each other but may work cooperatively. The order of operations of the processor is not limited to one described in the embodiments above, and may be changed.
The input unit 20 is an apparatus such as a pointing device by which the user inputs an operation.
For example, in a case where the input unit 20 is a mouse or the like, the user can designate a position on a screen of the display unit 40, a displayed image, or the like by performing a cursor movement operation or a click operation.
Further, in a case where the input unit 20 is a touch panel or the like, the user can designate a position on a screen or a displayed image by performing an operation of touching the touch panel with a finger or the like or an operation of maintaining the touched state of the finger or the like for a longer time than a predetermined time. In this case, the input unit 20 is provided integrally with the display unit 40.
In addition to the apparatus such as the pointing device described above, a keyboard or the like for performing a key input operation may be provided as the input unit 20.
The display unit 40 displays an operation screen 400, which is a screen for accepting an operation by the user, as illustrated in
In addition to a document icon 410, the operation screen 400 displays an enlargement instruction image 411, an enlarged thumbnail image 420, a menu image 430, a toolbar 440, and the like. The document icon 410 is an example of an instruction image for accepting an instruction of the user on the document. Further, the enlargement instruction image 411 is an image for giving an instruction related to display of the enlarged thumbnail image 420. The enlarged thumbnail image 420 is a document image related to the document displayed by the instruction of the user with respect to the document icon 410. The menu image 430 is an image for accepting an operation of the user on the document image related to the document. The toolbar 440 is an aggregation of instruction units prepared to simplify operations on electronic documents by the user. Examples of the operation for this electronic document include operations of saving, printing, rotating, searching for, and encrypting the electronic document, an operation of bundling two or more electronic documents, and the like.
The document icon 410 represents various types of functions such as a program function with pictograms, and is an instruction image for accepting an instruction of the user on the document. The document icon 410 may be a thumbnail image for confirming at least a part of a content of the document. This thumbnail image is simply displayed as a reduced image of the original image, for example, in a case where the corresponding file is image data. In a case where the corresponding file is document data having a plurality of pages, a representative page such as the first page is displayed as the reduced image. The document icon 410 displayed as a thumbnail image functions as an icon for opening the corresponding file.
In a case where a document displayed as a thumbnail image consists of a plurality of pages, an image (not illustrated) for accepting a change of the display page from the user may be displayed in a state of being associated with the document icon 410.
In the present exemplary embodiment, the “page” is a set of pieces of data displayed as one surface on the operation screen 400 at a time.
The document icon 410 may be a tray used for the user to deliver an electronic document to a third party, a folder used for storing the electronic document, an electronic document, or the like represented by a pictogram.
The enlargement instruction image 411 is an image for accepting an operation of the user and giving an instruction related to the display of the enlarged thumbnail image 420, and is displayed in a state of being associated with the document icon 410. Instead of the enlargement instruction image 411 illustrated in
In the present exemplary embodiment, the enlargement instruction image 411 and the maintenance instruction image 412 are displayed so as to be superimposed on an upper right corner portion of the document icon 410. In this case, it is preferable that the enlargement instruction image 411 and the maintenance instruction image 412 are displayed so as not to reduce visibility of the document icon 410, for example. For example, the enlargement instruction image 411 is displayed to be smaller than the document icon 410. Further, the enlargement instruction image 411 is displayed semi-transparently so that a superimposed portion on the document icon 410 can be seen through.
The enlarged thumbnail image 420 is an example of the document image related to the document and an enlarged image of a thumbnail image related to the document icon 410, instructed to be enlarged by the user, and is displayed without starting a new program. Here, it is assumed that the enlarged thumbnail image 420 is enlarged and displayed in a size that allows the user to understand contents of the document corresponding to the document icon 410. The enlarged thumbnail image 420 is generally displayed larger than the corresponding document icon 410. Further, a resolution of the enlarged thumbnail image 420 may be higher than a resolution of a thumbnail image displayed as the document icon 410.
The menu image 430 is an image for accepting an operation of the user on the document or a document image related to the document, and is displayed at a position determined by a display position of the document icon 410, instructed by the user on the operation screen 400. This determined position is a position that does not interfere with the display of a document image such as the enlarged thumbnail image 420. The menu image 430 is displayed at a position close to the document icon 410 instructed by the user, which is an end area of an area for displaying the enlarged thumbnail image 420, for example. In a case where the display position of the document icon 410 instructed by the user is located above the operation screen 400, the upper end area of the area for displaying the enlarged thumbnail image 420 is closer to the display position of the document icon 410 instructed by the user, than a lower end area of the area. Further, in a case where the display position of the document icon 410 instructed by the user is on the left side of the area for displaying the enlarged thumbnail image 420, an end area on the left side of the area for displaying the enlarged thumbnail image 420 is closer to the display position of the document icon 410 instructed by the user, than an end area on the right side of the area.
In addition to the number of pages of the document, the menu image 430 displays button images 431 related to various types of menus. Examples of the button image 431 include a change button image 431a, which is a button image for accepting a change in a display page, and an edit button image 431b, which is a button image for accepting execution of editing a document, for example. The editing of the document includes inputting a text, adding a sticky note image or a stamp image, and the like. Further, for example, there are a history button image 431c which is a button image for accepting display of an editing history of the document, and an omission button image 431d which is a button image for accepting display of a screen related to a process in which the display as various button images is omitted. In addition to these, a button for accepting other operations (not illustrated) may be displayed. An example of the other operation is transmitting the document to another user or the like.
In addition, as illustrated in
Functional Configuration of Image Display Apparatus 1
Next, a functional configuration of the image display apparatus 1 will be described.
The operation determination unit 101 determines whether or not a user operation is performed via the input unit 20 on the operation screen 400 (see
The display control unit 102 controls a display mode or a position of the document icon 410, the enlarged thumbnail image 420, the menu image 430, the toolbar 440 (see
The instruction image output unit 103 outputs an instruction image such as the enlargement instruction image 411 for assisting the operation of the user to the display unit 40 in a case of an enlargement instruction from the user or an instruction to maintain the enlargement. This instruction image is displayed in a state of being associated with the document icon 410.
The enlarged image output unit 104 brings out the thumbnail image from the thumbnail image storage unit 107, based on determination that the enlargement instruction image 411 is designated, by the operation determination unit 101. The enlarged image output unit 104 outputs the enlarged thumbnail image 420, which is enlarged from a thumbnail image corresponding to the document icon 410 instructed by the user, to the display unit 40 without starting a new program.
The menu image output unit 105 outputs the menu image 430 to the display unit 40, based on determination that the enlarged thumbnail image 420 is designated, by the operation determination unit 101. The menu image 430 is displayed at a position determined by the display position of the document icon 410 instructed by the user. Preferably, in order to secure the area for displaying the enlarged thumbnail image 420, the menu image 430 is displayed in the area for displaying the enlarged thumbnail image 420, for example. More preferably, in the area for displaying the enlarged thumbnail image 420, the menu image 430 is displayed at a position close to the document icon 410 instructed by the user, for example. In the area for displaying the enlarged thumbnail image 420, the position close to the document icon 410 instructed by the user is a position is closer to the document icon 410 than a distance between a center of the area for displaying the enlarged thumbnail image 420 and the document icon 410.
The thumbnail image generation unit 106 generates a thumbnail image to be displayed on the operation screen 400, based on a file such as image data stored in the secondary storage unit 30.
The thumbnail image storage unit 107 acquires and stores the thumbnail image generated by the thumbnail image generation unit 106. The thumbnail image storage unit 107 is realized by the non-volatile memory 14.
Display of Menu Image by Mouse Operation
Next, a user operation and a display process in a case where the menu image 430 is displayed will be described with reference to
As illustrated in
The document icons 410 (410a, 410b, and 410c) and the toolbar 440 are displayed on the operation screen 400.
The enlargement instruction image 411a illustrated in
The maintenance instruction image 412a illustrated in
In the menu image 430 illustrated in
As illustrated in
The display areas 421 (421a and 421b) illustrated in
Next, the description is continued with reference to the flowchart illustrated in
First, the operation determination unit 101 illustrated in
In a case where the document icon 410 is not designated in step S501 (NO in step S501), the process waits until the document icon is designated. In a case where the document icon 410 is designated (YES in step S501), the instruction image output unit 103 outputs and displays the enlargement instruction image 411 (step S502). For example, in a case where a mouse over operation of locating the cursor 200 over the document icon 410a illustrated in
Next, the operation determination unit 101 determines whether or not the enlargement instruction image 411 is designated based on an operation via the input unit 20 (step S503). The operation determination unit 101 according to the present exemplary embodiment determines, for example, that a mouse over operation on the enlargement instruction image 411 is designation on the enlargement instruction image 411.
In a case where the enlargement instruction image 411a is not designated in step S503 (NO in step S503), the process waits until the enlargement instruction image 411a is designated. In a case where the enlargement instruction image 411 is designated (YES in step S503), the enlarged image output unit 104 brings out a thumbnail image from the thumbnail image storage unit 107, and outputs and displays the enlarged thumbnail image 420 enlarged from the thumbnail image corresponding to the designated document icon 410 to the display unit 40 (step S504). In the example in
The instruction image output unit 103 outputs and displays the maintenance instruction image 412 to the display unit 40 (step S505). The maintenance instruction image 412 accepts that the display of the enlarged thumbnail image 420 is maintained. For example, in a case where the enlargement instruction image 411a illustrated in
Subsequently, the operation determination unit 101 determines whether or not the maintenance instruction image 412 is designated (step S506). In the present exemplary embodiment, the operation determination unit 101 determines, for example, a click operation on the maintenance instruction image 412 as designation on the maintenance instruction image 412. In the example illustrated in
In a case where the maintenance instruction image 412 is not designated in this step S506 (NO in step S506), the process waits until the maintenance instruction image 412 is designated. In a case where the maintenance instruction image 412 is designated (YES in step S506), the operation determination unit 101 determines whether or not the cursor 200 is over the enlarged thumbnail image 420 of which display is maintained (step S507).
In a case where the cursor 200 is not over the enlarged thumbnail image 420 in step S507 (NO in step S507), the process waits until the cursor 200 moves to the enlarged thumbnail image 420, and the menu image 430 is not displayed. In a case where the cursor 200 does not exist over the enlarged thumbnail image 420, it is predicted that the user does not need the menu image 430.
In step S507, in a case where the cursor 200 is over the enlarged thumbnail image 420 (YES in step S507), the display control unit 102 determines a display position of the menu image 430 according to a display position of the designated document icon 410 (step S508). The display position of the menu image 430 is determined at a position close to the designated document icon 410. As this distance, a distance between a center point of the designated document icon 410 and a center point of the menu image 430, a distance between a predetermined point of the designated document icon 410 and a predetermined point of the menu image 430, a distance of the closest point between the designated document icon 410 and the menu image 430, and the like may be used.
Here, a specific example of the display position of the menu image 430 determined by the display position of the document icon 410 will be given.
In the example in
In the example in
Next, the menu image output unit 105 outputs and transparently displays the menu image 430 to the display unit 40 at a position determined by the display position of the designated document icon 410 (step S509). In the example in
The operation determination unit 101 determines whether or not the cursor 200 is over the menu image 430 (step S510). In a case where the cursor 200 is not over the menu image 430 (NO in step S510), the process waits until the cursor 200 moves over the menu image 430. In a case where the cursor 200 is over the menu image 430 (YES in step S510), the menu image output unit 105 outputs the menu image 430 to the display unit 40, and the transparency is lowered and displayed as compared with a case where the cursor 200 is not over the menu image 430 (step S511). The menu image may be displayed without being transparent. In the example in
The operation determination unit 101 determines whether or not the button image 431 related to one menu is selected, among the button images 431 related to menus included in the menu image 430 (step S512). In a case where the button image 431 related to one menu is not selected (NO in step S512), the process waits until the button image 431 related to one menu is selected. In a case where the button image 431 related to one menu is selected (YES in step S512), the display control unit 102 performs control so that the enlarged thumbnail image 420 obtained by reflecting a process of the menu corresponding to the selected button image 431 in the document is displayed (step S513). Here, even in a case where the page in which the process of the selected menu is reflected and which is displayed is changed, the display position or a size of the menu image 430 is not changed.
Next, the operation determination unit 101 determines whether or not an operation of canceling the maintenance of the display of the enlarged thumbnail image 420 is performed (step S514). The operation determination unit 101 according to the present exemplary embodiment determines, for example, performing a click operation at a position other than the display area 421 or a click operation again on the maintenance instruction image 412, as an operation of canceling the maintenance of the display of the enlarged thumbnail image 420. In a case where the canceling operation is not performed in step S514 (NO in step S514), the display of the enlarged thumbnail image 420 is continued to be maintained. In a case where the canceling operation is performed (YES in step S514), the display control unit 102 cancels the maintenance of the display of the enlarged thumbnail image 420 (step S515). In a case where the canceling operation is performed, the menu image 430 is not displayed since the cursor 200 is located at a position other than the display area 421 for displaying the enlarged thumbnail image 420 as illustrated in
The process of displaying the menu image 430 is completed according to the above processing procedure.
In the above example, the display position of the menu image 430 is determined after the enlarged thumbnail image 420 is displayed, and the exemplary embodiment is not limited thereto. In a case where any of the document icons 410 is designated, the display position of the menu image 430 may be determined by a distance from the designated document icon 410 without waiting for the display of the enlarged thumbnail image 420.
Further, although the enlarged thumbnail image 420 is displayed and the display of the enlarged thumbnail image 420 is maintained by the operation of designating the enlargement instruction image 411 or the maintenance instruction image 412, the enlarged thumbnail image 420 may be displayed and the display of the enlarged thumbnail image 420 may be maintained by a predetermined operation so that the cursor 200 is located over the document icon 410 without displaying the enlargement instruction image 411 or the maintenance instruction image 412. Further, the operation for displaying the enlarged thumbnail image 420 and maintaining the display of the enlarged thumbnail image 420 may be performed by a predetermined operation such as a key operation, for example.
In a case where the display of the enlarged thumbnail image 420 is maintained, the maintenance instruction image 412 may be not displayed, or the enlargement instruction image 411 and the maintenance instruction image 412 may be independently displayed at positions different from each other. With the present exemplary embodiment, by changing and displaying the enlargement instruction image 411 to the maintenance instruction image 412, it is not necessary to move the cursor, for an operation of the user from displaying the enlarged thumbnail image 420 to maintaining the display of the enlarged thumbnail image 420.
Further, the enlarged thumbnail image 420 or the menu image 430 is displayed in a state in which the cursor 200 is located over the document icon 410 based on the operation of the input unit 20 such as a mouse of the user, and the exemplary embodiment is not limited thereto. In a case of a touch panel or the like, the input unit 20 is provided integrally with the display unit 40. In this aspect, the user may perform an operation of touching the display position of the document icon 410 or the like on the display unit 40 which is a touch panel with a finger or the like, or an operation of maintaining the contact state of the finger or the like for a longer time than a predetermined time so as to display the enlarged thumbnail image 420 or the menu image 430.
Display Position of Enlarged Thumbnail Image and Menu Image
In the above example, the enlarged thumbnail image 420 is displayed by using the entire area of the display area 421, and the exemplary embodiment is not limited thereto. The enlarged thumbnail image 420 may not be displayed by using the entire area of the display area 421.
An example in which the menu image 430 is displayed so that at least a part of the area of the menu image 430 is not superimposed on the enlarged thumbnail image 420 will be described with reference to
For convenience, in the document icon 410 illustrated in
As illustrated in
As illustrated in
Further, in a case where a document corresponding to the document icon 410 has a plurality of pages, the display position or the size of the menu image 430 is not changed even in a case where a size or a direction of the enlarged thumbnail image 420 is changed with a change of the page to be displayed on the enlarged thumbnail image 420.
In the above example, the enlarged thumbnail image 420 is displayed at the center portion of the display area 421 in the right-left direction or the up-down direction, and the enlarged thumbnail image 420 may be displayed in the center portion of the display area 421, and the menu image 430 may be displayed in the end area of the display area 421. As a result, the area superimposed on the enlarged thumbnail image 420 and the menu image 430 can be reduced while handling the enlarged thumbnail image 420 having various shapes.
Menu Image Display based on Size of Operation Screen
Further, in the example described above, the menu image 430 is displayed in a uniform shape based on the user operation, and the display mode of the menu image 430 may be based on a size of the operation screen 400.
As an example, a case where the size of the operation screen 400 is smaller than a predetermined value will be described with reference to
As illustrated in
On the other hand, in a case where the size of the operation screen 400 is smaller than the predetermined value, in the example in
Further, in the example in
In the above example, in a case where the size of the operation screen 400 is smaller than the predetermined value, the number of button images 431 related to the displayed menu is not changed, and the number of button images 431 to be displayed may be reduced. The process in which the display as the button image 431 is omitted is displayed on a screen corresponding to the omission button image 431d.
Further, the size of the button image 431 related to the menu may be reduced and displayed in one stage. The size of the button image 431 related to the reduced menu is set to such a size that the user can visually select each of the button images 431.
Further, although the button images 431 related to the menu are arranged in the right-left direction, the menu image 430 may be displayed by arranging the button images 431 in the up-down direction. In a case where the enlarged thumbnail image 420 is displayed as illustrated in
In the above example, the display of the menu image 430 is changed in a case where the size of the operation screen 400 is smaller than the predetermined value, and the display of the menu image 430 may be also changed in a case where the size of the operation screen 400 is larger than the predetermined value. As illustrated in
The process performed by the image display apparatus 1 according to the present exemplary embodiment is prepared, for example, as a program such as application software. The program can be provided by a communication section as well as provided by being stored in a recording medium such as a CD-ROM or the like.
The foregoing description of the exemplary embodiments of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, thereby enabling others skilled in the art to understand the invention for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2021-052799 | Mar 2021 | JP | national |