Patent Grant
10269327
The present invention relates to a method for controlling a display, an associated device, and a computer program product.
A wide variety of portable devices include screens to display information; examples include (but are not limited to) mobile phones, smartphones, tablets and wearable devices (such as ‘smartwatches’). These devices are generally powered by an on-board battery, which can only provide power for a finite time period. One of the principal drains of battery power is the display screen, particularly those on devices with large, bright screens.
In order to conserve battery life it is desirable to minimise the power consumption of the display. For this reason, many devices have a ‘sleep’ mode whereby the screen is turned off after a predetermined period of inactivity.
Another method of reducing display power consumption by a screen is disclosed in U.S. Pat. No. 8,194,092 B2 which describes a method for processing pixels on the display to filter out particularly energy intensive aspects (such as white backgrounds). Such processing may however have a detrimental impact on a user's experience.
An alternative method of reducing display power consumption would therefore be desirable.
According to one aspect of the invention, there is provided a method for controlling a display, the method comprising: segmenting the display; assigning an importance level to at least one of the segments; and selectively setting the luminance of said segment in dependence on its importance level.
Preferably, the setting of the luminance of said segment comprises supplying power to the segment, the level of power being determined by the importance level assigned to that segment.
Preferably, the level of power supplied determines the luminance of said segment.
Preferably, the available battery charge required to power said display is determined.
Preferably, the method comprises setting the luminance of a segment in dependence on the available battery charge, and preferably setting the relative luminance of each of a plurality of segments in dependence on their relative assigned importance levels and the available battery charge.
Preferably, future battery usage is predicted.
Preferably, the luminance of a segment is set in dependence on the predicted future battery usage.
Preferably, the future battery usage comprises anticipated user behaviour.
Preferably, the predicted battery usage is determined based on anticipated usage of the battery.
Preferably, the segment is defined by software.
Preferably, said software defined segment is defined by a graphical interface element.
Preferably, the position and/or geometry of said software segment varies, preferably in dependence on the operation of an underlying software application.
Preferably, the segment is defined by a particular physical area of the display, and preferably wherein the geometry of the area is configurable.
Preferably, the assigning of an importance level to a segment is based on one or more user inputs.
Preferably, the display is a touchscreen and the user input comprises a pinch action on said display.
Preferably, the user input comprises finger proximity to a device.
Preferably, the user input comprises movement of a device.
Preferably, the device includes said display.
Preferably, the device is a separate device to the device including said display.
Preferably, importance levels are assigned without any direct user interaction.
Preferably, importance levels are determined and/or assigned based on at least one or more of the following: environmental conditions in which the display is located; a detected location of the display; a detected motion of the display; a user operating mode; and the nature and/or type of graphical interface elements being displayed.
Preferably, importance levels are determined and/or assigned based on an ambient light level.
Preferably, an importance level is assigned based on a calendar event.
Preferably, a calendar application is assigned an importance level in dependence on a calendar event.
Preferably, importance levels are determined and/or assigned based on received biometric data.
Preferably, the biometric data comprises heart rate data.
Preferably, an importance level is determined based on the information being displayed on a segment.
Preferably, the method further comprises providing a user interface for segmenting the display.
Preferably, a user interface for assigning one or more importance levels to segments of a display is provided.
Preferably, there is provided a computer program product adapted to carry out the above-mentioned method.
Preferably, there is provided a device adapted to carry out the above-mentioned method.
Preferably, there is provided a device programmed with the computer program product.
According to another aspect of the invention, there is provided a device having a display, the device comprising: means for segmenting the display; means for assigning an importance level to at least one segment; and means for selectively setting the luminance of said segment in dependence on its importance level.
Preferably, the device is portable.
Preferably, the device is in the form of a smartphone.
Preferably, the device is in the form of a wearable device.
Preferably, the device comprises a user interface for segmenting the display.
Preferably, the device comprises a user interface for assigning one or more importance levels to the segments.
Further features of the invention are characterised by the appended claims.
The invention extends to methods and/or apparatus substantially as herein described with reference to the accompanying drawings.
The invention also provides a computer program and a computer program product for carrying out any of the methods described herein and/or for embodying any of the apparatus features described herein, and a computer readable medium having stored thereon a program for carrying out any of the methods described herein and/or for embodying any of the apparatus features described herein.
The invention also provides a signal embodying a computer program for carrying out any of the methods described herein and/or for embodying any of the apparatus features described herein, a method of transmitting such a signal, and a computer product having an operating system which supports a computer program for carrying out any of the methods described herein and/or for embodying any of the apparatus features described herein.
Any apparatus feature as described herein may also be provided as a method feature, and vice versa. As used herein, means plus function features may be expressed alternatively in terms of their corresponding structure, such as a suitably programmed processor and associated memory.
Any feature in one aspect of the invention may be applied to other aspects of the invention, in any appropriate combination. In particular, method aspects may be applied to apparatus aspects, and vice versa. Furthermore, any, some and/or all features in one aspect can be applied to any, some and/or all features in any other aspect, in any appropriate combination.
It should also be appreciated that particular combinations of the various features described and defined in any aspects of the invention can be implemented and/or supplied and/or used independently.
Furthermore, features implemented in hardware may generally be implemented in software, and vice versa. Any reference to software and hardware features herein should be construed accordingly.
The invention extends to a method, computer program product and device as described herein and/or substantially as illustrated with reference to the accompanying drawings.
These and other aspects of the present invention will become apparent from the following exemplary embodiments that are described with reference to the following figures in which:
Reducing the power supplied to the display may assist in reducing power consumption of a device. For displays using technologies such as Organic Light Emitting Diodes (OLEDs), this means keeping the display largely dark to conserve battery power. Conserving battery power increases the length of time between charges, reduces the running cost of the device and extends the useful lifetime of the battery, which may degrade with each charge cycle.
Variable power user interface displays can be operated at a low power with minimum luminosity, or at a higher power for higher luminosity under certain conditions.
The terms ‘display’ and ‘screen’ are used interchangeably herein.
The first step S1 in the process is to segment the display 102. The display is segmented using either hardware segmentation, software segmentation, or a combination of both hardware and software segmentation.
Hardware segmentation involves defining segments on fixed portions of the display 102, regardless of what is being displayed in those segments. An example of this would be the bottom 320 pixel rows of the screen 102 (as illustrated by 104-4 in
Software segmentation involves defining certain displayed graphical interface elements as software segments, regardless of where such segments are located on the physical display 102. An example of this would be a particular graphical interface element of a software application (app) being displayed on the screen 102 (as illustrated by 104-1, -2 or -3 in
A segment 104 may have any shape, and may also change shape (for example, changing shape so as to conform to the shape of an app's interface). A segment 104 may be defined on a local or remote display, or on multiple displays. An example of an arrangement of multiple, separate displays is a smartwatch ‘paired’ (via a wireless link such as Bluetooth®) with a smartphone. In this case, a certain app may be displayed only on the smartwatch, or on both devices, but potentially in a different form or shape.
In the next step S2 in the process an importance level is assigned to one or more of the segments 104. One or more segments 104 may be selected to appear at a higher luminance than the rest of the display 102 and/or other segments 104 depending on their relative importance. This then enables battery power usage to be prioritised to those parts of the screen 102 (segments 104) having a higher importance. This decreases the overall power consumption without having an overall adverse impact on the user experience.
Not all information shown to the user is of the same importance. Certain information is very important, and other information is less important, depending on an operating mode.
The operating mode is a detected (or user selected) mode in which the device is operating, for example ‘social mode’, ‘work mode’ or ‘sports mode’. A collection of importance levels are assigned to particular segments when a particular mode is selected. For example, when in ‘social mode’ social media applications would be assigned a greater importance level than, say, a calendar application.
In each operating mode, each type of information provided to the end user will have an assigned importance level. Each importance level can be associated with the amount of power that should be allocated to a segment 104.
A user may also select one or more segments 104 (either defined by hardware or software), whereupon action can be taken based on the selection. Selection of segments can be performed locally and/or remotely.
Local selection involves the user interacting directly with the display 102 on which the selection is being made.
Remote selection involves a remote event causing a selection. Remote selection includes selections such as touching a neighbouring display which is adapted to control another display (for example, via a wireless link such as Bluetooth®) or selecting a time period in someone else's calendar making the calendar event (for example) of greater importance. An example of such a scenario is where a personal assistant selects a calendar item in an executive's calendar, which then increases the power only for related events on the executive's display 102.
As mentioned above, the assignment or selection of importance levels to segments can be performed automatically and/or manually.
Manual assignment involves the user directly assigning particular segments an importance level, for example, by touching the display 102, finger proximity to the display 102, or movement of the device 100 incorporating the display 102. One example of manual assignment is a user touching a (touchscreen) display, causing that part of the display to light up. Manual selection may also be performed by pointing or with a gesture, such as a three finger “pinch” action. In this manner, a user may select one or more segments and adjust their relative levels of importance, and hence their relative share of the available battery power (i.e. their relative luminance). Such manual modifications to the relative importance levels may be performed in a dedicated user interface, as is described in more detail below.
Automatic assignment includes an assignment based on one or more indirect triggers, for example an increase in ambient light, a pending calendar event, the detected location of the display or device, the detected motion of the display or device, or a change in received biometric data information. For example, if it is detected that the user is running (e.g. by an elevated heart rate), a sport application may be assigned a higher importance level than, say, a social networking application. Alternatively (or in addition) the detection of such inputs may automatically switch the device into a specific mode, assigning a collection of importance levels to a variety of segments.
The step of determining the available battery power is shown at step S3.
The anticipated available battery power is determined based on the current level of charge of the battery, in combination with known and anticipated behaviour of the user.
Such anticipated behaviour may be inputted by a user directly and/or predicted by the device based on previous user usage data.
An example of user inputted future behaviour (usage information) is a calendar appointment for a phone call, the device would be able to predict how much battery power would be needed for such a phone call and then apportion the remaining battery power to other tasks accordingly.
An example of predicted behaviour (usage information) is if a user usually uses their device to listen to music on their commute home from work, and the device detects that the user is at work; this anticipated usage—that the user will listen to music on the commute home—can then be taken into account when apportioning power usage to various segments 104 of the screen 102.
If there is little expected available battery one example of information on the device 100 display 102 that may be apportioned little or no battery power is weather information, since this may not be the most important item to show the user. This might however depend on the operating mode.
One or more of the following factors are then used to assign or apportion appropriate power levels to each of the segments based on their relative importance: anticipated user behaviour; the physical parameters of the device such as battery charge level; and the known power consumption rates for communications, screen illumination and other operations. Step S4 illustrates a power level being assigned to the or each segment based on their relative importance.
Table 1 below shows an exemplary selection of applications, their relative importance levels, corresponding allocated battery power share, and segment brightness associated with their corresponding graphical interface elements.
The allocation of battery share between different applications as shown in Table 1 might change depending on the operating mode. In Table 1 the operating mode might be a “work” mode, in which the calendar application is given a higher priority importance level, whereas if the device were in a “social” mode, the social networking application might be given a higher priority.
In the case of hardware segments, the various hardware segments would each be assigned a particular percentage of the available battery power share.
Sensing instruments 314, such as Global Positioning System (GPS) circuitry and accelerometers are also provided, with the information from these devices being similarly processed and stored. A wireless transceiver 316 may also be provided for receiving and/or transmitting information to and from remote devices (not shown).
The power management unit 306 is operable to measure the status of charge of the battery, and pass this information via the processor 310 for storage in memory 312. The processor 312 uses this state of charge information, together with known power usage rates, to determine the available battery power and then allocate this to the segments of the display 102 as described above.
The device 100 may also be provided with a segmentation interface software tool or application to display to a user the anticipated power consumption profile information for a particular operating mode (for example, expected power usage profiles based on segments having a particular assigned importance level). Such information may be used by a user to determine whether to adjust the importance levels assigned to each segment. This tool may be activated by a specific action, for example a three finger ‘pinch’ which switches from a view whereby users interact with apps etc. to one in which the user can select and adjust segments. Alternatively, activating the tool may be initiated remotely (e.g. via a connected device) or automatically (e.g. if the battery state of charge falls below a certain value).
Using the segmentation tool a user can select a segment (e.g. a particular app) and manually adjust its importance level and hence luminance. A gesture such as pinching can be used to vary the power provided to a segment or group of segments.
In use, a user may use the abovementioned segmentation tool to assign importance levels to segments and alter the importance levels assigned to segments. This may be based on known future usage, for example, (the user may lower the importance level of a weather app as the user knows she will be inside, or based on information provided to the user by the tool (e.g. a particular segment is expected to consume a large amount of power).
The assignment of importance levels may alternatively be automated by the device in dependence on known parameters and/or expected future usage. Automation is advantageous in that the power consumption can be adapted quickly when new information becomes available, which may result in improved performance (e.g. extended battery life). However, certain users may wish to customise their display and feel that automation does not accurately reflect their desired usage. A combination of automation and manual operation may be preferable in such situations, where a user can manually assign importance levels for certain segments, and the segments which are not manually assigned may be automatically assigned importance levels by the device in dependence on known parameters and/or expected future usage.
The above description has been primarily concerned with portable devices whereby battery conservation is the driving factor for controlling the luminance of the display. However, the same principle equally applies to devices where battery conservation is not necessarily an issue, such as Personal Computers (PCs), screens in vehicles, photocopier screens or supermarket checkout screens. The advantages of conserving power in such scenarios would reduce the running costs of such devices and reduce wear on screen components.
Furthermore, setting the luminance of different segments in dependence of an assigned importance level has the advantage of highlighting information perceived to be important to a user, thus improving the user's experience of the device and its efficiency. Displaying a large amount of information may overwhelm a user and increase the time taken for a user to retrieve further information.
In one embodiment, selecting a segment causes power to be applied to the selected segment, allowing that segment to be seen while saving power on other segments which remain at a lower power. In such a scenario, the entire screen may be kept at a very low (or no) luminance and when a certain segment is selected (e.g. tapped or swiped) the luminance is increased for a pre-determined length of time. Effectively, a temporarily higher importance level is assigned to a segment by a user selecting (e.g. touching) a segment.
Further features and/or advantages of the invention are provided below:
It will be understood that the present invention has been described above purely by way of example, and modifications of detail can be made within the scope of the invention.
Each feature disclosed in the description, and (where appropriate) the claims and drawings may be provided independently or in any appropriate combination.
Reference numerals and/or subtitles appearing in the claims are by way of illustration only and shall have no limiting effect on the scope of the claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 1402879.9 | Feb 2014 | GB | national |
This application is a Continuation of PCT Patent Application No. PCT/GB2015/050472 having International filing date of Feb. 18, 2015, which claims the benefit of priority of United Kingdom Patent Application No. 1402879.9 filed on Feb. 18, 2014. The contents of the above applications are all incorporated by reference as if fully set forth herein in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5327344 | Hoffman | Jul 1994 | A |
| 7623689 | Shigeta | Nov 2009 | B2 |
| 7878506 | Kelly | Feb 2011 | B1 |
| RE42366 | Horikawa | May 2011 | E |
| 9153966 | Ishida | Oct 2015 | B2 |
| 9186077 | Ma | Nov 2015 | B2 |
| 20020171646 | Kandogan | Nov 2002 | A1 |
| 20030121046 | Roy | Jun 2003 | A1 |
| 20030135288 | Ranganathan et al. | Jul 2003 | A1 |
| 20040145593 | Berkner | Jul 2004 | A1 |
| 20050267676 | Nezu | Dec 2005 | A1 |
| 20060078288 | Huang | Apr 2006 | A1 |
| 20060087502 | Karidis et al. | Apr 2006 | A1 |
| 20060101293 | Chandley et al. | May 2006 | A1 |
| 20070075950 | Yamada | Apr 2007 | A1 |
| 20070199014 | Clark | Aug 2007 | A1 |
| 20080002771 | Chen | Jan 2008 | A1 |
| 20080019574 | Scalise | Jan 2008 | A1 |
| 20080122857 | Hsuan | May 2008 | A1 |
| 20080184149 | Cohen | Jul 2008 | A1 |
| 20090077137 | Weda | Mar 2009 | A1 |
| 20100250984 | Lee et al. | Sep 2010 | A1 |
| 20100274673 | Isaac | Oct 2010 | A1 |
| 20110184810 | Dharmaji | Jul 2011 | A1 |
| 20110225494 | Shmuylovich | Sep 2011 | A1 |
| 20110304536 | Chen | Dec 2011 | A1 |
| 20120101444 | Muller-Pathle | Apr 2012 | A1 |
| 20120210277 | Bowen et al. | Aug 2012 | A1 |
| 20120324260 | Kezuka | Dec 2012 | A1 |
| 20130063404 | Jamshidi Roudbari | Mar 2013 | A1 |
| 20130100176 | Lewis | Apr 2013 | A1 |
| 20130127926 | Lewis | May 2013 | A1 |
| 20130217978 | Ma | Aug 2013 | A1 |
| 20130222396 | Confrey | Aug 2013 | A1 |
| 20130238540 | O'Donoghue | Sep 2013 | A1 |
| 20130314301 | Feehan | Nov 2013 | A1 |
| 20140075234 | Stekkelpak | Mar 2014 | A1 |
| 20140078185 | Pu | Mar 2014 | A1 |
| 20140125150 | Alberth, Jr. | May 2014 | A1 |
| 20140139486 | Mistry | May 2014 | A1 |
| 20140163707 | Logan | Jun 2014 | A1 |
| 20140285531 | Dasher | Sep 2014 | A1 |
| 20140310739 | Ricci | Oct 2014 | A1 |
| 20140350716 | Fly | Nov 2014 | A1 |
| 20150066837 | Twarog | Mar 2015 | A1 |
| 20150138203 | Nachmanson | May 2015 | A1 |
| 20150257103 | Detter | Sep 2015 | A1 |
| 20160003428 | Anderson | Jan 2016 | A1 |
| 20160198233 | Spielman | Jul 2016 | A1 |
| 20160226713 | Dellinger | Aug 2016 | A1 |
| 20160357232 | Kalyanasundaram | Dec 2016 | A1 |
| 20170140170 | DiBona | May 2017 | A1 |
| 20180144591 | Sartee | May 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| WO 2013100937 | Jul 2013 | WO |
| WO 2015124927 | Aug 2015 | WO |
| Entry |
|---|
| International Search Report and the Written Opinion dated Jun. 24, 2015 From the International Searching Authority Re. Application No. PCT/GB2015/050472. |
| Number | Date | Country | |
|---|---|---|---|
| 20170193965 A1 | Jul 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/GB2015/050472 | Feb 2015 | US |
| Child | 15239893 | US |
