The present application is based on, and claims priority from JP Application Serial Number 2019-121696, filed Jun. 28, 2019, the disclosure of which is hereby incorporated by reference herein in its entirety.
The present disclosure relates to a display device and a computer-readable storage medium that stores a display control program to be executed by the display device.
Some known display devices such as smartphones or tablets include two casings with touch panel screens, and these casings are joined together via a hinge, for example, as disclosed in WO-A-2013-175751. When a display device of this type is opened up so that both the touch panel screens are arranged side by side, it is selectively operable in two modes: a full-screen mode and a double application mode. In the full-screen mode, a single application is displayed on both the touch panel screens, whereas in the double application mode, two applications are independently displayed on the respective touch panel screens.
Display devices, as described above, have some room to provide optimally improved displays.
The present disclosure is a display device that includes a display section, a determiner, and a display controller. The display section is configured to be set in a plurality of positions including a folded position and an unfolded position. In the folded position, the display section is folded at a location of a boundary between a first display area and a second display area so that the first display area and the second display area face in opposite directions. In the unfolded position, the display section is not folded at the location of the boundary so that the first display area and the second display area face in the same direction. The determiner determines in which position the display section is. The display controller controls a display operation of the display section. When the display section is in the folded position, the display controller causes the display section to display, within the first display area, a plurality of objects and specific images linked to an N number of objects out of the plurality of objects, the specific images being used to receive an operation, and not to display a specific image linked to an object other than the N number of objects out of the plurality of objects together with the specific images linked to the N number of objects. When the display section is in the unfolded position, the display controller causes the display section to display the plurality of objects within the first display area and simultaneously to display, within the second display area, specific images linked to an M number of objects out of the plurality of objects, M being larger than N.
Some embodiments of the present disclosure will be described below with reference to the accompanying drawings. It should be noted that the drawings are simply illustrative for use in describing components in the embodiments, and thus the illustrated components may lack correct proportion and consistency. Besides, not all components are illustrated.
Configuration of Terminal Device
The controller 11 controls an operation of the terminal device 10 by causing the processor or the CPU 11a to perform arithmetic processing in a working area of the RAM 11c in accordance with various programs stored in the ROM 11b and other memories. The controller 11 executes a display control program 12, which is one of the stored programs, to function as a determiner 12a and a display controller 12b.
The display section 13 has a first display area 13a and a second display area 13b. As an example, the display section 13 may be implemented by a foldable or flexible display, for example, as illustrated in
The position sensor 14 may include one or more sensors that sense positions of the terminal device 10. The terminal device 10 is configured to be set in a plurality of positions, including a folded position and an unfolded position. In the folded position, the display section 13 is folded at the location of the boundary between the first display area 13a and the second display area 13b so that the first display area 13a and the second display area 13b face in opposite directions. In the unfolded position, the display section 13 is not folded at the location of the boundary so that the first display area 13a and the second display area 13b face in the same direction. The folded, unfolded, and other positions of the display section 13 may also be regarded as those of the terminal device 10.
The wireless communication section 15 conducts wireless communication with an external device, for example, via a public communication channel or a wireless local area network (LAN). The components illustrated in
Mounted on the front surfaces of the first casing 21 and the second casing 22, each of which has a planar shape, is a display section 13 as a single flexible display. Of the display section 13, the first display area 13a is defined on the first casing 21 and the second display area 13b is defined on the second casing 22. The display section 13 has a boundary area 13c, which contains the hinge 23 and is defined between the first display area 13a and the second display area 13b. Herein, the location at which the hinge 23 is disposed in the boundary area 13c corresponds to the location of the boundary between the first display area 13a and the second display area 13b. It should be noted that the boundary area 13c does not necessarily have to be defined definitely and it may be a portion of display section 13 which is bent when the display section 13 is set in the folded position.
As illustrated in
As illustrated in
The display section 13 does not necessarily have to be implemented by a single flexible display mounted on both the first casing 21 and the second casing 22; alternatively, the display section 13 may be implemented by two flexible displays mounted independently on the first casing 21 and the second casing 22. If the display section 13 is implemented by a first flexible display mounted on the first casing 21 and a second flexible display mounted on the second casing 22, the first flexible display may define the first display area 13a and the second flexible display may define the second display area 13b. In this case, the boundary area 13c may be absent in the display section 13, and the hinge 23 may define the boundary between the first display area 13a and the second display area 13b.
Display Control Process
At Step S100, first, the determiner 12a in the controller 11 determines whether the display section 13 is in the folded position, based on a sensing signal from the position sensor 14. When determining that the display section 13 is in the folded position (Yes at Step S100), the determiner 12a makes the display control process proceed to Step S110. When determining that the display section 13 is not in the folded position, namely, is in the unfolded position (No at Step S100), the determiner 12a makes the processing proceed to Step S120.
The position sensor 14 may be any sensor that outputs a sensing signal to the controller 11 which is required to identify whether the display section 13 is in the unfolded position or in the folded position. As an example, the position sensor 14 may be disposed on the first rear surface 21a near the first side 24 or on the second rear surface 21b near the second side 25. In this case, when both the first rear surface 21a and the second rear surface 21b are positioned close to each other as illustrated in
As an alternative example, the position sensor 14 may be any sensor that outputs a sensing signal to the controller 11 which indicates an angle between the first casing 21 and the second casing 22 disposed with the hinge 23 therebetween. As another alternative example, the terminal device 10 may have a locking mechanism to be operated by the user which physically locks the terminal device 10 in the folded position. When the locking mechanism locks the terminal device 10 in the folded position, the position sensor 14 may output the sensing signal to the controller 11 which indicates that the terminal device 10 is in the folded position.
At Step S110, the display controller 12b in the controller 11 causes the display section 13 to display, within the first display area 13a, a preview image and some operation icons linked to a designated object out of a group of objects selected by the user. The preview image may be an image that is displayed before a printing operation and constituted by a group of objects selected by the user. Each object may be an original image for one page which serves as the basis for the preview image, or may be an illustration, text, a comment, a graphic, or a stamp displayed in the original image.
The designated object may be one of the objects constituting the preview image which is designated by the user. The number of designated objects is denoted by N, which is set to one in this embodiment. This means that the user is not allowed to designate two or more objects at the same time.
Each of the operation icons is used to receive a user's operation and linked to a corresponding object. Herein, each operation icon may correspond to a specific image. Examples of the user's operation may include operations of moving an object, changing the shape of the object, deleting the object, and changing the overlapping order of objects. For example, the operation of moving an object may be an operation of rotating the object; the operation of changing the shape of an object may be an operation of zooming in or out or flipping the object.
At Step S110, the display controller 12b causes the display section 13 to display the preview image within the first display area 13a. Simultaneously, the display controller 12b also causes the display section 13 to display, within the first display area 13a, operation icons linked to the designated object out of the objects constituting the preview image. In this case, the display section 13 does not display operation icons linked to the objects other than the designated object.
At Step S120, the display controller 12b causes the display section 13 to display the preview image within the first display area 13a. Simultaneously, the display controller 12b also causes the display section 13 to display, within the second display area 13b, operation icons linked to an M number of objects out of the plurality of objects constituting the preview image. In this case, M denotes the total number of objects constituting the preview image and is greater than that of the designated object. For example, if the preview image is constituted by four objects, M may be set to four.
If the preview image is constituted by many objects, for example, the display section 13 may be unable to display the operation icons linked to all the objects within the second display area 13b at one time. Therefore, the upper limit of M may be set in advance for the display controller 12b. In this case, when the number of objects constituting the preview image is less than or equal to the upper limit, the display controller 12b may cause the display section 13 to display the operation icons linked to all the objects within the second display area 13b. However, when the number of objects constituting the preview image exceeds the upper limit, the display controller 12b may cause the display section 13 to display the operation icons linked to an upper limit number of objects out of all the objects within the second display area 13b.
While the screen at Step S110 or S120 is being displayed, at Step S130, the display controller 12b determines whether to receive an instruction of finishing displaying the preview image through a user's operation. When receiving the instruction (Yes at Step S130), the display controller 12b causes the display section 13 to finish displaying the preview image and the operation icons and then concludes the display control process in the flowchart of
In
In
Displayed within a lower portion of the first display area 13a are a plurality of operation icons 40, 41, 42, and 43 linked to the designated object. In this case, in response to designating one of the plurality of objects within the first display area 13a at Step S110, the display controller 12b causes the display section 13 to display the operation icons lined to the designated object within the first display area 13a.
The operation icon 40 is an icon used to rotate the object; the operation icon 41 is an icon used to laterally flip the object; the operation icon 42 is an icon used to change the overlapping order of objects; and the operation icon 43 is an icon used to delete the object. In addition to the operation icons 40 to 43, some other icons may also be displayed at Step S110 or S120. As an example, an operation icon for use in decorating or coloring an object may be displayed.
The user can operate any operation icon within the first display area 13a. When sensing the operation of any operation icon within the first display area 13a, the display controller 12b reflects the sensed operation in the designated object within the first display area 13a. For example, the display controller 12b may change the location or shape of the designated object or the overlapping order of the designated object and other objects. By operating any operation icon within the first display area 13a in this manner, the user can perform a desired process on the designated object, such as moving it or changing its shape.
In addition to the above, thumbnail images of the original image 30 and the graphic 31 to 33 are also displayed within the second display area 13b. The reference symbol 30t denotes the thumbnail image of the original image 30. Within the second display area 13b, the operation icons 40 to 43 are arrayed next to each thumbnail image. As an example, the operation icons 40 to 43 linked to the original image 30 may be arrayed next to the thumbnail image 30t of the original image 30.
The user can operate any operation icon linked to a given object, more specifically, the thumbnail image of a given object within the second display area 13b. When sensing the operation of an operation icon within the second display area 13b, the display controller 12b reflects the sensed operation in the object linked to the operated operation icon within the first display area 13a. For example, the display controller 12b may change the location or shape of the object or overlapping order of the object and other objects. At Step S120, the display controller 12b may cause the display section 13 to display, within the second display area 13b, various operation icons in accordance with the objects constituting the preview image. In short, when the terminal device 10 is in the unfolded position, the user does not have to designate any object within the preview image as an object to be operated, although this designation is needed when the terminal device 10 is in the folded position.
When the display section 13 transmits from the folded position to the unfolded position, at Step S110, the display controller 12b hides the operation icons 40 to 43 that have been displayed within the first display area 13a, unlike the example of
At Step S110, the operation icons 40 to 43 may be arrayed in this order from the left to right of the first display area 13a, as illustrated in
As an alternative example, at Step S120, a plurality of operation icons linked to each object may be arrayed within the second display area 13b in accordance with frequencies at which these operation icons have been operated. In this case, the display controller 12b may store in advance the operating frequencies of the operation icons 40 to 43. For example, if the operating frequencies of the operation icons 42, 40, 43, and 41 decline in this order, at Step S120, the display controller 12b may cause the display section 13 to display the operation icons 42, 40, 43, and 41 so as to be arrayed in this order from the left to right of the second display area 13b.
At Step S120, the display controller 12b may cause the display section 13 to display operation icons linked to individual objects in accordance with frequencies at which these objects have been operated in the preview image at Step S110. In this case, the display controller 12b may store in advance frequencies at which the original image 30 and the graphics 31 to 33 have been operated as a designated object at Step S110. For example, if the operating frequency of the graphics 31, 33, and 32 and the original image 30 decline in this order, at Step S120 following Steps S110 and S100, the display controller 12b may cause the display section 13 to display the thumbnail images of the graphics 31, 33, and 32 and the original image 30 so as to be arrayed in this order from the top to bottom of the second display area 13b. Simultaneously, the display controller 12b may cause the display section 13 to further display the operation icons next to each thumbnail image.
As described above, at Step S120, the display controller 12b causes the display section 13 to display operation icons within the second display area 13b so as to be arrayed in accordance with frequencies at which these operation icons have been operated and to further display the thumbnail images of objects so as to be arrayed in accordance with frequencies at which these objects have been operated as designated objects. In this way, the terminal device 10 provides good usability for the user.
Since the original image 30 is the background of the graphics 31 to 33, the operation icon 42 used to change an overlapping order of the original image 30 and other objects is unnecessary. Therefore, at Step S120, the display controller 12b may cause the display section 13 to display only the operation icons 40, 41, and 43 within the second display area 13b in relation to the thumbnail image 30t of the original image 30. In other words, the display section 13 does not have to display the operation icon 42. In short, at Step S120, the display controller 12b may cause the display section 13 to display different operation icons in relation to individual objects constituting the preview image within the second display area 13b.
As described above, if the preview image is constituted by many objects, at Step S120, the display section 13 may be unable to display the operation icons linked to all the objects within the second display area 13b at one time. Therefore, when the number of objects constituting the preview image exceeds an upper limit at which operation icons can be arrayed at one time within the second display area 13b, at Step S120, the display controller 12b may cause the display section 13 to display the operation icons linked to an upper limit number of objects within the second display area 13b. Then, when receiving a scroll operation on the second display area 13b, the display controller 12b may cause the display section 13 to display the operation icons linked to the remaining objects within the second display area 13b.
Conclusion
According to an embodiment of the present disclosure, a display device includes a display section 13, a determiner 12a, and a display controller 12b. The display section 13 is configured to be set in a plurality of positions including a folded position and an unfolded position. In the folded position, the display section 13 is folded at a location of a boundary between a first display area 13a and a second display area 13b so that the first display area 13a and the second display area 13b face in opposite directions. In the unfolded position, the display section 13 is not folded at the location of the boundary so that the first display area 13a and the second display area 13b face in the same direction. The determiner 12a determines in which position the display section 13 is. The display controller 12b controls a display operation of the display section 13. When the display section 13 is in the folded position, the display controller 12b causes the display section 13 to display, within the first display area 13a, a plurality of objects and specific images linked to an N number of objects out of the plurality of objects, the specific images being used to receive an operation, and not to display a specific image linked to an object other than the N number of objects out of the plurality of objects together with the specific images linked to the N number of objects. When the display section 13 is in the unfolded position, the display controller 12b causes the display section 13 to display the plurality of objects within the first display area 13a and simultaneously to display, within the second display area 13b, specific images linked to an M number of objects out of the plurality of objects, M being larger than N. For example, positions of the display section 13 other than the folded position and the unfolded position may be those of the display section 13 in the transition between the folded position and the unfolded position.
As described above, when the display section 13 is in the unfolded position, the display controller 12b causes the display section 13 to display the plurality of objects within the first display area 13a and simultaneously to display specific images, or operation icons, linked to an M number of objects within the second display area 13b, M being larger than N. With this configuration, the display section 13 can effectively use both the first display area 13a and the second display area 13b when the display section 13 is in the unfolded position, thereby allowing a user to easily view the images of a plurality of objects and specific images linked to these objects. In this case, the display controller 12b causes the display section 13 to display the specific images linked to each object within the second display area 13b, thereby allowing the user to easily operate these objects.
In the above display device, each of the specific images may contain at least one of a plurality of icons used to receive instructions of moving a corresponding one of the objects, changing a shape of the object, deleting the object, and changing overlapping order of the objects.
The above configuration allows the user to operate a specific image acting as an operation icon to perform a desired process on an object, such as moving it, changing its shape, deleting it, or changing its overlapping order.
In the above display device, when the display section 13 is in the folded position, the display controller 12b may cause, in response to designating any object out of the plurality of objects displayed within the first display area 13a, the display section 13 to display a specific image linked to the designated object within the first display area 13a.
As described above, the display section displays the specific images linked to the designated object within the first display area 13a when the user designates any of a plurality of objects displayed within the first display area 13a as a designated object. This configuration allows the user to perform a desired operation on the designated object.
In the above display device, when the display section 13 transits from the folded position to the unfolded position and further transits to the folded position, the display controller 12b may cause the display section 13 to hide the specific images linked to the N number of objects which have been displayed within the first display area 13a and, in turn, to display the specific images linked to the M number of objects within the second display area 13b.
With the above configuration, in response to the transition from the folded position to the unfolded position of the display section 13, the display controller 12b causes the display section 13 to hide specific images from the first display area 13a and, in turn, to display these specific images within the second display area 13b.
According to another embodiment of the present disclosure, a non-transitory computer-readable storage medium that stores a display control program 12 that controls an image display operation of a display section 13. The display section 13 is configured to be set in a plurality of positions including a folded position and an unfolded position. The display control program 12 causes the display section 13 to perform a method including: displaying, when the display section 13 is in the folded position, a plurality of objects and specific images linked to an N number of objects out of the plurality of objects within the first display area 13a, the specific images being used to receive an operation, and not displaying a specific image linked to an object other than the N number of objects out of the plurality of objects together with the specific images linked to the N number of objects; and displaying, when the display section 13 is in the unfolded position, the plurality of objects within the first display area 13a and simultaneously to display, within the second display area 13b, specific images linked to an M number of objects out of the plurality of objects, M being larger than N.
Some modifications of the foregoing embodiment will be described below. It should be noted that this description will be mainly centered on differences from the embodiment and other modifications.
The determiner 12a stores a history of results of determinations that have been made since the display control process in the flowchart of
At Step S115, the display controller 12b causes the display section 13 to display a preview image within the first display area 13a. In this case, the display section 13 displays no operation icons within the first display area 13a nor the second display area 13b.
In the example of
In the first modification, as described above, when the determiner 12a determines that the display section 13 transits from the folded position to the unfolded position and then further transits to the folded position, the display controller 12b hides the specific images from both the first display area 13a and the second display area 13b. This configuration allows the user to hide operation icons from both the first display area 13a and the second display area 13b by unfolding the folded terminal device 10 that has been in the folded position and then folding it again. The user thereby can easily view the preview image within the first display area 13a.
At Step S120 in the flowchart of
In
The display controller 12b stores the history of operations that the user has performed on the preview image since the display control process started. Whenever the user operates any operation icon, the display controller 12b stores the preview image displayed upon the operation. As can be seen from the second display area 13b in
By touching any of the numbers listed within the second display area 13b, the user can conform a desired past preview image. For example, when the user touches number 1 within the second display area 13b in the case of
Number N indicating the number of designated objects may be any number smaller than M. For example, if N is set to two, the user may designate two objects at the same time. In response, at Step S110, the display controller 12b may cause the display section 13 to display specific images, or operation icons, linked to the designated objects within the first display area 13a.
In the foregoing embodiment and modifications, the specific images are implemented by the operation icons 40 to 45; however, each specific image is not limited to an icon. Alternatively, each specific image may be a character displayed by the display section 13.
Obviously, the display control processes in this embodiment and the modifications are applicable to not only a preview image to be displayed before a printing operation but also other images, such as an image constituted by a plurality of objects which is to be processed or monitored. This means that the terminal device 10 may be employed for any application other than a printing application.
Number | Date | Country | Kind |
---|---|---|---|
JP2019-121696 | Jun 2019 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
8654095 | Cho | Feb 2014 | B1 |
10416720 | Lee | Sep 2019 | B2 |
20070075915 | Cheon | Apr 2007 | A1 |
20090059497 | Kuwahara | Mar 2009 | A1 |
20090278764 | Kuwahara | Nov 2009 | A1 |
20100081475 | Chiang | Apr 2010 | A1 |
20100182265 | Kim | Jul 2010 | A1 |
20100184485 | Kim | Jul 2010 | A1 |
20100298032 | Lee | Nov 2010 | A1 |
20110230178 | Jones | Sep 2011 | A1 |
20120117495 | Sirpal | May 2012 | A1 |
20130076681 | Sirpal | Mar 2013 | A1 |
20130321340 | Seo | Dec 2013 | A1 |
20140096047 | Ha | Apr 2014 | A1 |
20140101578 | Kwak | Apr 2014 | A1 |
20140137041 | Jeon | May 2014 | A1 |
20140152606 | Kunitake | Jun 2014 | A1 |
20150338888 | Kim | Nov 2015 | A1 |
20180039410 | Kim | Feb 2018 | A1 |
20200264826 | Kwon | Aug 2020 | A1 |
20200320906 | Knarr | Oct 2020 | A1 |
Number | Date | Country |
---|---|---|
2014-145972 | Aug 2014 | JP |
2013175751 | Jan 2016 | WO |
Number | Date | Country | |
---|---|---|---|
20200409539 A1 | Dec 2020 | US |