The present invention relates to multi-window display control for displaying a plurality of windows concurrently on one screen, and particularly to, when windows overlap one another, blending of the windows.
Conventionally, in an information processing apparatus such as a digital consumer electronics device including a personal computer, a workstation, a mobile phone, and the like, when a plurality of display contents are to be displayed concurrently on one screen, a plurality of rectangular areas referred to as “windows” are displayed by occasionally overlapping one another on a display device typified by that of CRT and that of liquid crystal.
In the above-described multi-window display, however, when an already displayed window is overlapped by a new window, all or a portion of the already displayed window is covered and hidden by the new window.
In a conventional information processing apparatus, in order to display an area hidden by a front window, the hidden area and the front window are mixedly displayed by making the front window semi-transparent in accordance with an instruction received through a key, a mouse, or the like (see Patent Document 1, for example).
In the conventional information processing apparatus, when an instruction is received from a user through a keyboard or a mouse,
In the conventional information processing apparatus, however, the determination of whether or not an already displayed window is to be hidden by a newly displayed window is made in accordance with the user instruction. As a result, there is a problem that important information to be primarily displayed may be difficult to view. The above problem is serious particularly when, for example, in a mobile phone: its screen size is small; a window is likely to hide another window present behind the window; and window display is automatically performed in accordance with an external event such as phone call reception and e-mail reception.
With reference to the drawings, the above problem will be described.
In
As described above, in a mobile phone, a window to be displayed may automatically appear regardless of the user operation. In this case, however, in the conventional information processing apparatus, the window cannot manually be made semi-transparent in accordance with the user instruction, and thus there is no choice but to uniformly determine whether a newly created window is to be displayed remaining non-transparent or to be displayed semi-transparently.
The screen 404 of the mobile phone shows an example where all of the windows to be displayed are automatically made non-transparent. 404 shows, in the mobile phone, a screen in which a pop-up display, such as the window 401, of e-mail reception appears while a television image such as the window 403 is being viewed. If displayed non-transparently, the window 401 covers and hides most of an image portion of the window 403 which has been displayed until then.
In contrast, the screen 405 of the mobile phone shows an example where all of the windows to be displayed are automatically made semi-transparent. 405 shows, in the mobile phone, a screen in which a pop-up display, such as the window 402, of a news bulletin appears while the television image such as the window 403 is being viewed. If displayed semi-transparently, the window 402 is mixed with a caption portion of the window 403 which has been displayed until then. As a result, the visibilities of the character information of the window 402 and that of the window 403 are significantly reduced.
The present invention is directed to solving the above conventional problem. An object of the present invention is to provide a display object blending apparatus capable of, when a display object which is a window or a drawn object provided within the window is newly displayed to cover and hide an already displayed display object, determining, based on a predetermined condition, the transparency of the display object which covers and hides and thus determining, in accordance with the type and the state of the display object to be covered and hidden, whether or not the display object which covers and hides is to be made semi-transparent.
To solve the above conventional problem, a first aspect of the present invention is directed to a display object blending apparatus. The present invention is a display object blending apparatus for performing display control of a display object which is a window and an object to be displayed in the window, the apparatus including: an instruction section for giving an instruction to display a new display object; an overlap determination section for, when one or more display objects are displayed, receiving from the instruction section the instruction to display the new display object and for determining whether or not the new display object and an already displayed display object overlap each other; a condition determination section for determining, as a result of the overlap determination section having determined that the already displayed display object overlaps the new display object, whether or not the already displayed display object meets a predetermined condition and for determining, based on the determination result, a transparency of an area including at least an area which is included in the new display object and which covers the already displayed display object; and a blending section for displaying, with the transparency determined by the condition determination section, a display object to be displayed.
Based on the above features, in accordance with whether or not the display object to be covered and hidden meets the predetermined condition, it is possible to determine whether or not the display object which covers and hides is to be made semi-transparent.
A second aspect of the present invention is directed to a display object blending method for performing display control of a display object which is a window and an object to be displayed in the window. The present invention includes: an instructing step of giving an instruction to display a new display object; an overlap determining step of, when one or more display objects are displayed, receiving from the instruction section the instruction to display the new display object and of determining whether or not the new display object and an already displayed display object overlap each other; a condition determining step of determining, as a result of the overlap determining step having determined that the already displayed display object overlaps the new display object, whether or not the already displayed display object meets a predetermined condition and of determining, based on the determination result, a transparency of an area including at least an area which is included in the new display object and which covers the already displayed display object; and a blending step of displaying, with the transparency determined by the condition determining step, a display object to be displayed.
A third aspect of the present invention is directed to a display object blending program for causing a computer to perform display control of a display object which is a window and an object to be displayed in the window. The present invention causes the computer to execute: an instructing step of giving an instruction to display a new display object; an overlap determining step of, when one or more display objects are displayed, receiving from the instruction section the instruction to display the new display object and of determining whether or not the new display object and an already displayed display object overlap each other; a condition determining step of determining, as a result of the overlap determining step having determined that the already displayed display object overlaps the new display object, whether or not the already displayed display object meets a predetermined condition and of determining, based on the determination result, a transparency of an area including at least an area which is included in the new display object and which covers the already displayed display object; and a blending step of displaying, with the transparency determined by the condition determining step, a display object to be displayed.
Based on a display object blending apparatus according to the present invention, in accordance with the type and the state of a display object to be covered and hidden, it is possible to flexibly determine whether or not a display object which covers and hides is to be made semi-transparent.
With reference to the drawings, an embodiment of the present invention will be described below.
In
A display object storage section 106 has stored therein display object information regarding each display object displayed on a screen. The display object information includes the display position, the size, the transparency, and the like of each display object. Note that as well as the above information, the display object information may include the display object type such as a text and an image, the shape such as a rectangle and a circle, the display priority, and the like of each display object. The display priority will be described in detail below.
An overlap determination section 102 compares the display object information regarding a new display object which is received from the instruction section 101, to the display object information regarding a display object already displayed on the screen, which is stored in the display object storage section 106, and determines the presence or absence of overlap between the new display object and the display object already displayed on the screen. When it is determined that the overlap is present, the overlap determination section 102 provides a condition determination section 103 with a notification. When it is determined that the overlap is not present, the overlap determination section 102 provides a blending section 104 with a notification.
Based on the notification provided by the overlap determination section 102, the condition determination section 103 determines whether or not the display object (a display object A) already displayed on the screen and obtained as a result of the determination that the new display object (a display object B) overlaps the display object already displayed on the screen, meets a predetermined condition. Further, based on the determination result, the transparency of the display object B is determined. Note that with reference to a specific example, the predetermined condition will be described below.
The blending section 104 receives the notification from the overlap determination section 102 or a notification from the condition determination section 103, generates display data of the display object B with the determined transparency, stores the display data into a frame memory 107, and displays the above-described two display objects on a display section 105 which is a display device such as that of CRT or that of liquid crystal. Further, when displaying the display objects on the display section 105, the blending section 104 can control the transparencies of the display objects by determining whether the transparencies are to be fixed, are to be cyclically variable, or the like.
Note that the instruction section 101 gives not only an instruction to newly display a display object on the display section 105. The instruction section 101 can also be applied to the above-described determination of the transparency and the above-described display process when the instruction section 101 gives any instruction to display a display object, regardless of the type of an operation based on which the display object is displayed. The above operation may include: displaying, by hiding an already displayed display object, another display object all or a portion of which has been hidden and appears due to hiding the already displayed display object; displaying a display object by moving the display object from the bottom to the top of a displayed hierarchy of display objects so as to be visible on the screen; displaying a display object which has newly appeared due to a coordinate change (the movement of the display position) thereof; and the like.
Although three main types of basic operations will be described in detail below, these operations may be performed separately or combined.
(Operation 1: Semi-Transparent Display Process of a Display Object)
With reference to a flow chart of
701 is the screen of the display section 105. 702 is a display object A which is displayed on the screen 701 and which meets a predetermined condition. 703 is a display object B to be newly displayed based on an instruction from the instruction section 502. 704 and 705 are dashed lines representing positions at each of which the display object B 703 is to be displayed on the screen 701.
711 shows a case where the display object B 703 is displayed at the position of the dashed line 704 and does not cover the display object A 702. On the other hand, 721 shows a case where the display object B 703 is displayed at the position of the dashed line 705 and covers a portion of the display object A 702.
Note that the predetermined condition which the display object A 702 meets may be a condition related to a display operation trigger in which, based on a specific event or a specific application, the instruction section 101 has been instructed to perform display.
Further, the predetermined condition which the display object A 702 meets may be a condition related to the shape or the appearance of a display object, such as: whether or not the display object is larger than, equal to, or smaller than a specific size; whether or not the display object is in a specific color; or whether or not the display object induces a specific figure or a specific character.
Note that in
With reference to
First, in step S501, the instruction section 101 receives an instruction to display the display object B 703 at a specific position (the position of the dashed line 704 or of the dashed line 705) provided in the screen 701.
Next, in step S502, the overlap determination section 102 determines whether or not the display object B 703 covers all or a portion of the display object A 702 already displayed on the screen 701. When displayed at the position of the dashed line 704, the display object B 703 does not cover the display object A 702. When displayed at the position of the dashed line 705, the display object B 703 covers a portion of the display object A 702.
Since the display object B 703 does not cover the display object A 702 (“No” in step S502) when displayed at the position of the dashed line 704, the overlap determination section 102 provides, in step S503, the blending section 104 with a notification, and then the blending section 104 generates, with 0% (completely-non-transparent) transparency, the display data of the display object B, displays the display object B on the display section 105, and ends the process. In
On the other hand, since the display object B 703 covers a portion of the display object A 702 (“Yes” in step S502) when displayed at the position of the dashed line 705, the overlap determination section 102 provides, in step S511, the condition determination section 103 with a notification, and then the condition determination section 103 determines the transparency of an area which is included in the display object B 703 and which covers the display object A 702. In step S512, the condition determination section 103 provides the blending section 104 with a notification, and then the blending section 104 generates, with a specific transparency obtained based on the notification, the display data of the display object B, displays the display object B on the display section 105, and ends the process. In
Note that the screen 721 shows that only the portion which is included in the display object B 703 and which covers the display object A 702 is displayed semi-transparently, but the transparency may be an arbitrary value, and so long as at least the area which is included in the display object B 703 and which covers the display object A 702 is included, a semi-transparent area (e.g., the whole area of 703) may be wider than the area which covers the display object A 702.
Further, since the display object B 703 covers a portion of the display object A 702 when displayed at the position of the dashed line 705, the area which is included in the display object B 703 and which covers the display object A 702 may be displayed while changing, in a specific cycle, the transparency of the area to an arbitrary transparency included in the range of specific transparency, in step S522.
801, 802, and 803 are the screens of the display section 105, and in the screen 801, the display object B 703 is displayed with 25% transparency (Due to the limitations of the figures, an area of 25% transparency is represented by diagonal lines from top left to bottom right). Similarly, in the screens 802 and 803, the display object B 703 is displayed with 50% transparency and 75% transparency, respectively (Due to the limitations of the figures, areas of 50% transparency and 75% transparency are represented by diagonal lines from top right to bottom left and a horizontal-line pattern, respectively).
When the transparency is cyclically changed from 25% to 50% to 75% to 50% to 25%, the screen changes from 801 to 802 to 803 to 802 to 801 with the display object B becoming gradually thicker and thinner. Consequently, even when a display object present in the front and a display object present in the rear are displayed semi-transparently with a fixed transparency and therefore the visibilities thereof are reduced, the display objects may be displayed by alternately and gradually making either one thicker than the other, whereby it is possible to improve the visibilities of both of the display objects.
Note that in
Further, in the above description, as an example, the transparency is gradually increased, is then gradually decreased, and returns to the original value. However, the cyclical change of the value of the transparency is not limited thereto.
The above-described change of the transparency is effective in semi-transparently displaying particularly a display object including characters, and an example thereof will be described below.
901, 902, 903, and 904 are the screens of the display section 105 and show a state where the window 402 including characters is displayed to cover the window 403 including characters.
It is described in the PROBLEMS TO BE SOLVED BY THE INVENTION (see the screen 405 of
The window 402 as a news bulletin pop-up window is displayed completely non-transparently with 0% transparency in the screen 901, and the transparency is gradually increased from 0% in this state to 50% in the screen 902 to 100% in the screen 903.
Thus, the characters of the window 402 gradually become invisible while the characters of the window 403 gradually become visible, and consequently, the characters of the window 403 are completely visible in the screen 903.
When the transparency of the window 402 is subsequently decreased from 100% in this state to 50% in the screen 904 again and then returns to 0% in the screen 901 again, the characters of the window 402 become visible again (Due to the limitations of the figures, the frame and the characters of the window 402 are represented in black and the window 403 present in the rear is visible through the other area of the window 402, in the screens 902 and 904 of
As described above, when the transparency of the window 402 is cyclically changed from 100% to 50% to 0% to 50% to 100%, the screen changes from 901 to 902 to 903 to 904 to 901. Consequently, the windows 402 and 403 may be displayed by alternately and gradually making either one thicker than the other, whereby it is possible to improve the visibilities of both of the windows 402 and 403.
Thus, in accordance with whether or not a display object to be covered and hidden meets a predetermined condition, it is possible to determine whether or not the display object which covers and hides is to be made semi-transparent.
Further, the transparency of a newly displayed display object may be cyclically changed, whereby it is possible to cyclically and alternately display both of an already displayed display object and the newly displayed display object.
(Operation 2: Process Performed for Displaying a Display Object which Covers a Semi-Transparently Displayed Display Object)
In the present embodiment, the determination of the transparency of a display object which covers a display object of which the transparency is 0%, is described. However, when a display object covers a display object already displayed with a specific transparency (a value other than 0%) or already displayed while changing, in a specific cycle, the transparency thereof to an arbitrary transparency, the transparency of the display object to be covered may be changed to 0%. Thus, it is possible to prevent a plurality of display objects displayed semi-transparently from overlapping each other and therefore is possible to prevent the visibilities thereof from being reduced.
With reference to a flow chart of
1101 is the screen of the display section 105. 1110 is a display object C, a portion of which is covered by the display object A 702 described in
A process for displaying the display object B 703 at the position of the dashed line 705 is first started from the screen 1101. The process of and prior to step S502 in the flow chart of
The process performed in the case of “Yes” in step S502, that is, the process performed after step S502 when the display object B 703 covers the display object A 702, will be described with reference to the flow chart of
In step S1001, the overlap determination section 102 provides the condition determination section 103 with a notification, and then the condition determination section 103 determines whether or not at least an area a (an area which is included in the display object A 702 and which overlaps an area surrounded by the dashed line 705 in the screen 1101 of
When the area a is displayed completely non-transparently (“No” in step S1001), the condition determination section 103 determines, in step S1003, the transparency of an area which is included in the display object B 703 and which covers the display object A 702. In step S1004, the condition determination section 103 provides the blending section 104 with a notification, and then the blending section 104 generates, with a specific transparency obtained based on the notification, the display data of the display object B, displays the display object B on the display section 105, and ends the process.
On the other hand, when the area a is displayed semi-transparently (the transparency other than 0%) with a specific transparency (“Yes” in step S1001), the condition determination section 103 determines, in step S1002, the transparency of the area a as 0% (completely non-transparent), and then proceeds to step S1003. The condition determination section 103 determines the transparency of an area which is included in the display object B 703 and which covers the display object A 702. In step S1004, the condition determination section 103 provides the blending section 104 with a notification, and then the blending section 104 generates, with a specific transparency obtained based on the notification, the display data of the display object B, displays the display object B on the display section 105, and ends the process.
1102 shows the screen in which the above step S1002 is performed. In the screen 1101, the pattern of even a portion which is included in the display object C 1110 and which is covered by the display object A 702 is displayed transparently therethrough. However, in the screen 1102, as a result of changing the transparency of the area a to 0%, the covered portion becomes invisible (Due to the limitations of the figures, the vertical-line pattern of 702 and a horizontal-line pattern of 1110 are displayed unchanged in portions where 703 covers 702 and 1110, in
Note that in
Further, in
Similarly, the determination condition of step S1001 in the flow chart of
Similarly, the determination condition of step S1001 in the flow chart of
Thus, in a case where a display object is newly displayed to cover a display object already displayed semi-transparently or already displayed while cyclically changing the transparency thereof, it is possible to prevent the visibilities of the display objects from being reduced when the newly displayed display object is made semi-transparent.
(Operation 3: Process Performed when Display Objects have Display Priorities)
In the above-described operation 1 and operation 2 of the present embodiment, when a display object is displayed, the determination of whether or not the display object is to be made semi-transparent is made in accordance with whether or not an already displayed display object meets a predetermined condition. However, each display object may be provided with a display priority and the determination may be made in accordance with the result of comparison between the display priorities, whereby a display object may become semi-transparent only when covering an important display object.
With reference to a flow chart of
Each element of
A process for displaying the display object B 703 at the position of the dashed line 705 is first started from the screen 701. The process of and prior to step S502 in the flow chart of
In step S501, the instruction section 101 gives an instruction to display the display object B, and in the present operation, gives an instruction to display the display object B by specifying the display priority therefor.
The display priority is a priority which is set for a display object and which is used to display the display object on the display section 105, and in the present operation, is used to determine whether or not the display object is to be made semi-transparent.
Note that the display priority is set based on the specification made by the instruction section 101, and the display priority of a display object already displayed on the display section 105 is retained in the display object blending apparatus.
The process performed in the case of “Yes” in step S502, that is, the process performed after step S502 when the display object B 703 covers the display object A 702, will be described with reference to the flow chart of
In step S1201, the overlap determination section 102 provides the condition determination section 103 with a notification, and then the condition determination section 103 determines, by comparing the display priorities of the display object A 702 and the display object B 703 to each other, whether or not the display priority of the display object A 702 is higher.
When the determination result of step S1201 is “Yes” (i.e., when the display priority of the display object A is higher), the condition determination section 103 determines, in step S1202, the transparency of an area which is included in the display object B 703 and which covers the display object A 702. In step S1203, the condition determination section 103 provides the blending section 104 with a notification, and then the blending section 104 generates, with a specific transparency obtained based on the notification, the display data of the display object B, displays the display object B on the display section 105, and ends the process. As shown in the screen 721 of
On the other hand, when the determination result of step S1201 is “No” (i.e., when the display priority of the display object B is higher), in step S1204, the condition determination section 103 generates, with 0% (completely-non-transparent) transparency, the display data of the display object B, displays the display object B on the display section 105, and ends the process.
Note that in the present embodiment, the determination is made by comparing the display priorities which are set for display objects, and when the display priority of the display object to be covered is higher, it is determined that the display object which covers is to be made semi-transparent. However, the present invention is not limited thereto. The determination method is not particularly specified so long as the transparency is determined based on the result of comparison between the display priorities. For example, the degree of transparency may be changed depending on the size of the difference between the display priorities.
Note that in the screen 721 of
Further, in the screen 721 of
Similarly, although in
Further, the display priority may not necessarily have a unique value in the whole area of a display object. When the display object is a window, the display priorities may be set separately for a border and a non-border area of the window. When the display object is an object to be displayed within the window, the display priorities may be set separately for a foreground section and a background section of the object. Thus, it is possible to perform display control based on more detailed display priorities.
With reference to
1301 is a border of the window 401. 1302 is a non-border area of the window 401. 1303 and 1304 are a foreground section and a background section, respectively, of the characters provided within the window 401. 1305 is a foreground section of a figure (an octagon) provided within the window 401. A background section of the octagon provided within the window 401 is not present such that the non-border area provided within the window 401 can be viewed unchanged behind the octagon.
1306 is a non-border area of the window 403.
When the display priorities are set as P1>P2>P3, the premise is that: the display priorities of the border 1301 and the foreground section 1303 of the window 401 are P1; the display priority of the non-border area 1306 of the window 403 is P2; and the display priorities of the non-border area 1302, the background section 1304 of the characters, and the octagonal
In this case, 1310 is a screen of a display device 501 in which the window 401 is displayed to cover the non-border area 1306 of the window 403 in a case where a display object blending section 503 displays, with 0% transparency, a display object having a higher display priority to cover a display object having a lower display priority and displays, with 100% transparency, a display object having a lower display priority to cover a display object having a higher display priority.
Since the display priority of the non-border area 1306 of the window 403 is P2, only the elements of the display object 401 of which the display priorities are P1 that is higher than P2, are displayed with 0% transparency and the other elements are displayed with 100% transparency and invisible.
As a result, only minimum necessary characters of a pop-up window used at the time of receiving an e-mail may be displayed while a television screen is being viewed, whereby it is possible to reduce an area which covers the television screen.
Thus, based on the result of comparison between the display priorities of a newly displayed display object and a display object to be covered, it is possible to determine whether or not the newly displayed display object is to be made semi-transparent.
Further, it is possible to assign the display priorities individually to a border and a non-border portion of a window, a foreground area and a background area of a drawn object provided within the window, and the like, and is possible to specify, in more detail, areas to be made semi-transparent.
Further, when the display priorities of an already displayed display object and a newly displayed display object are the same, the transparencies thereof may be cyclically and gradually increased and decreased, whereby it is possible to automatically and alternately display the already displayed display object and the newly displayed display object. Note that in the present embodiment, the overlap determination section 102, the condition determination section 103, and the blending section 104 are represented as separate blocks, but may not necessarily be separate, and may be manufactured as a single chip using an integrated circuit such as an LSI or a dedicated signal processing circuit. Alternatively, equivalents of the functions of these blocks may be separately manufactured as chips. The integrated circuit is referred to herein as an LSI, but may be referred to as an IC, a system LSI, a super LSI, an ultra LSI, etc., depending on the degree of integration. Further, the method of integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. An FPGA (Field Programmable Gate Array), which is an LSI that can be programmed after manufacture, or a reconfigurable processor capable of reconfiguring the connections and the settings of the circuit cells in the LSI may also be used. Furthermore, in a case where another integration technology replacing LSI becomes available due to improvement of a semiconductor technology or due to the emergence of another technology derived therefrom, integration of functional blocks may obviously be performed using such a new integration technology.
A display object blending apparatus according to the present invention is capable of flexibly determining, in accordance with the type and the state of an already displayed display object, whether or not a display object which covers the already displayed display object is to be made semi-transparent, and of preventing the already displayed display object from being hidden, and therefore is useful for a device and a system such as a mobile phone and a personal digital assistant, in each of which its screen is so small that a display object is likely to hide another display object. Further, the display object blending apparatus can also be applied to a digital camera, an in-car system, and the like.
Number | Date | Country | Kind |
---|---|---|---|
2005-319045 | Nov 2005 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2006/313136 | 6/30/2006 | WO | 00 | 2/7/2008 |