Patent Application
20170178599
An embodiment described herein relates generally to a data processing device, a display control device, a semiconductor chip, a method of controlling display device, and a computer-readable medium.
For a data processing device such as a portable small data processing device including a slate terminal, a tablet terminal, or the like, an electronic POP (point of purchase advertising) and an electronic chart, improvement of power efficiency is an important technical issue. By using a low-power-consumption display such as an electronic paper as a display of such data processing device, power consumption for display-updating of the electronic paper being very small, it is possible to suppress power consumption during idle time such as a time period during which user browses a display.
Generally, in an update-process of an electronic paper, a two-stage process which includes a preprocess for data to be displayed (hereinafter referred to as update-data) and a drawing process for updating a display of an electronic paper using the preprocessed data is necessary. The preprocess for an electronic paper includes two steps which are a processing step and a selecting step. In the processing step, by processing update-data such as image data, preprocessed update-data is created. In the selecting step, information (hereinafter referred to as update-control information) including drive voltages used for updating a display of an electronic paper with the preprocessed update-data is selected, and information (hereinafter referred to as update-control-information selection information) for identifying the selected update-control information is created. Due to throughput of the steps being high, these steps required large power consumption and long process time.
Exemplary embodiments of a data processing device, a display control device, a semiconductor chip, a method of controlling display device, and a computer-readable medium will be explained below in detail with reference to the accompanying drawings.
For example, in a processing of update-data (the processing is a data converting process, for instance, and may be executed by a data converter 113a), in order to display color image data on a gray-scale electronic paper, a process of converting image data into a gray-scaled image data, a black-and-white (binary) image data, or the like, a process of inverting a black-and-white image data, a process of scaling image data for fitting a size of the image data to a display size of an electronic paper or a size of an update region in a case where an electronic paper is partially updated, and so forth, are executed.
In a selection step of update-control information (the selection step may be executed by a selector 113b of a preprocessor 113), in order to select proper update-control information enabling execution of a target update-process without unnecessary consumption of power and time, data analysis of update-data, or the like, should be executed. Because load on a data processing device may increase, when the proper update-control information was not selected, the selection step is a very important process.
The update-control information is information including descriptions on how to impress voltage for converting pixel values of pixels or sets of pixels of an electronic paper into desired gray-scale pixel values, how to impress voltage for converting a color of each pixel into a desired color in a case where an electronic paper is a color electronic paper, and so on. The update-control information can be referred to as Waveform. The update-control information may include information on how to apply voltage values, periods of impressing voltage and combinations of the voltage value and the period while changing the voltage value and the period in a certain order, or the like.
A plurality of the update-control information are arranged on the data processing device, and they need to be properly used based on an update-method of an electronic paper. For example, a proper update-control information is selected and used from among the plurality of the update-control information depending on the number of gradations of the original image data, a character of an image obtained by histogram analysis of the original image data, difference of update-methods (for instance, a difference between an update-method with which update-speed is slow but residual image of pre-update character, or the like, is small and an update-method with which update-speed is fast but residual image can easily occur, or between an update-method with which update-speed is slow but intended color is less-visible in a process of updating and an update-method of which update-speed is fast but intended color is visible), or a variation of surrounding temperature. Therefore, different update-control information may be used for the same update-data depending on a situation.
A drawing process of an electronic paper becomes available by executing such preprocess and creates a pair of preprocessed update-data and update-control-information selection information. The preprocess, as described above, takes comparatively large power consumption and long process time. Moreover, in a color electronic paper, or the like, there is a case where a sequence of voltage impression with varying voltages variation becomes complex, an update-sequence becomes complex depending on an arrangement of colors in update-data, or the like. In such case, regarding the selection step in the preprocess, processes for image analysis and character extraction become complex, and as a result, a case where power consumption and process time are increased may occur.
In the following embodiments, a data processing device, a display control device, a semiconductor chip, a method of controlling display device, and a computer-readable medium which are able to reduce the power consumption and process time necessary for a preprocess for an electronic paper will be exampled.
Firstly, a data processing device, a display control device, a semiconductor chip, a method of controlling display device, and a computer-readable medium according to a first embodiment will be described in detail with the accompanying drawings.
The memory display 140 is an electronic paper (EPD: electronic paper display), for instance. Hereinafter, the symbol 140 represents to the EPD. As a method of the electronic paper in the EPD 140, various kinds of methods such as an electrophoretic display, a quick response liquid powder display, a cholesteric liquid crystal display, or the like, can be applied.
The input device 130 includes a touch panel acting as a pointing device arranged on an outer surface of the EPD 140. The data processing device may include another input device such as a keyboard, a mouse, or the like.
The main memory 120 may be a non-volatile memory such as a MRAM (magnetoresistive random access memory), or the like. On the main memory 120, update-data to be displayed on the EPD 140 and one or more update-control information being candidates for selection in a selection step in a preprocess are stored. In the first embodiment, a preprocess cache constructed from a pair of a preprocessed update-control information obtained at a processing step in the preprocess and an update-control-information selection ID (the update-control-information selection ID is an update-control-information selection identifier, for instance, and this is the same in the following embodiments as well) created at a selection step in the same preprocess is stored on the main memory 120.
The power control device 150A powers the main memory 120 and the SoC 100, and the power control device 150B powers the EPD 140. Each of the power control devices 150A and 150B may be a PMIC (power management integrated circuit), or the like, respectively.
The data processing device 1 has an accumulator such as a solar cell, a capacitor, or the like, and may operate on electricity generated by the solar cell. In such case, the accumulator may store a surplus power generated by the solar cell at idle time. The power control device 150A and 150B execute power-controls for powering the unit of the data processing device 1 so that a peak power consumption at an active time, or the like, is covered by both the electricity stored on the accumulator and the electricity generated by the solar cell. As described above, one purpose of the embodiments is to make the data processing device operate with very small electricity. As an outline for achieving such purpose, each module of the data processing device is transited to a standby mode or a power-saving mode with low power consumption aggressively, whereby power consumption can be reduced. Therefore, it is not the only power-saving of the preprocess that is important. When process time of a preprocess is long, even if the data processing device is made to transit to a standby mode with low power consumption aggressively during idle time of the data processing device (e.g. waiting time of response from user and time without usage of the data processing device) in order to reduce the power consumption, it is difficult to obtain the expected effects with the transit to the standby mode for the active time becomes long. Furthermore, because responsiveness of the data processing device is influenced by the process time of the preprocess, when the process time is long, usability of the data processing device may be seriously impaired. Therefore, reduction of process time of the preprocess is also very important. This is the same in the other embodiments.
The SoC 100 includes a CPU (central processing unit) 101, a memory controller 103, an EPD controller 105, a preprocess accelerator 102 used for a preprocess, an internal memory 104 and a communication interface such as a wireless LAN controller 106. These units are connected with each other via a bus 107.
For effective utilization of standby modes, the SoC 100 may provide a plurality of standby modes of which power consumptions at the standby modes and electricity costs for transiting/resuming to/from the standby modes are different.
The EPD controller 105 uses the main memory 120 as a working memory. The EPD controller 105 reads out preprocessed update-data and update-control information corresponding to update-control-information selection ID from the main memory 120, and executes a drawing process for the EPD 140. The EPD controller 105 can update a plurality of partial regions on the EPD 140 in parallel.
When the EPD update controller 110 receives an instruction for updating a part or all of a region of the EPD 140 from application software, middleware, or the like, operating on the data processing device 1, by making the power manager 115, the preprocessor 113, the cache determining unit 112, the updating unit 114 and the cache manager 111 collaboratively operate, the EPD update controller 110 checks whether a result of a preprocess of an update-process using the same update-data and the same update-control information hits a preprocess cache in the main memory 120 or not (cache-hit). When the result hits the preprocess cache, the EPD update controller 110 executes a drawing process of the EPD 140 while reusing data on the preprocess cache. Thereby, it is possible to reduce the power consumption and process time for the preprocess. Furthermore, by reduction of the process time for the preprocess (hereinafter referred to as preprocess time), it is possible to prolong a period for powering off the main memory 120 constructed from a MRAM, whereby it is possible to further reduce the power consumption.
Moreover, generally, transition of the SoC 100 to a standby mode with lower power consumption requires larger power consumption and longer process time for resuming from the standby mode. Therefore, in order to reduce the total power consumption, idle time that compensates for the necessary power consumption for resuming from the standby mode is needed. In the first embodiment, as described above, because the preprocess time can be reduced, it is possible to prolong the idle time and increase chances to use the standby mode with low power consumption, and as a result, it is possible to further reduce the power consumption.
As shown in
The tag part includes a pair of an update-data ID and an update-method tag and a valid bit. An update-request of EPD issued by application software, middleware, or the like, is issued while having the pair of the update-data ID for identifying update-data and the update-method tag indicating the kind of update to be expected being added to. The cache determining unit 112 receiving such update-request executes determination of cache-hit (cache determination). In the cache determination, by searching tag parts in the cache entries, it is determined whether there is an entry in which a pair of an update-data ID and an update-method tag is matched with the one in the update-request and a valid bit indicating whether data of a corresponding cache entry is valid or invalid indicates valid.
The update-data ID is information for identifying update-data. In an update-process using the same update-data while application software or middleware manages update-data and an update-data ID with association between them, for instance, an update-request with the same update-data ID is issued to the EPD update controller 110. In the example shown in
The update-data tag is information to be added to an update-request in order to specify an update-method. For example, the update-data tag specifies an update-method including binarization of update-data, an update-method including binarization of update-data and inversion of the binarized update-data, a gray-scale update-method with which residual image scarcely remains, an update-method with which update-speed is fast but residual image can easily occur, a combination of two or more of such methods, or the like. In the example shown in
Here, for instance, the update-method “B” specifies that update is executed after binarizing update-data, the update-method “W” specifies that update is executed after binarizing update-data and inverting the binarized update-data, and the update-method “G” specifies that update is executed after converting update-data into gray-scale update-data. In the update-method “G” in which update-data is converted into gray-scale update data, when a gradation of the update-data is analyzed as eight shades of gray, update-control information for updating with eight shades of gray is selected. In this case, the same image quality as that of sixteen shades of gray can be obtained with short update time and low power consumption without using update-control information with sixteen shades of gray.
To the update-request of the EPD 140 issued by application software, middleware, or the like, instead of the pair of the update-data ID and the update-method tag, it is possible that an ID for identifying the pair of the update-data ID and the update-method tag is added. In a case of
The preprocess cache data part include a pair of an update-control-information selection ID and preprocessed update-data.
The update-control-information selection ID is information for specifying a single update-control information from among a plurality of update-control information stored in the data processing device 1. When the updating unit 114 instructs the EPD controller 105 to execute an update-process of the EPD 140 using the entry of which update-control-information selection ID is “34” shown in
In the preprocessed update-data, in addition to content data (content) of the preprocessed update-data, a data size thereof is also included.
As shown in
In step S103, the cache determining unit 112 of the EPD update controller 110 checks whether a cache entry which matches a pair of an update-data ID and an update method tag added to the update-request exists on the preprocess cache or not (cache determination) (step S103), and when the cache entry exists (step S103; YES), the EPD update controller 110 progresses to step S107. On the other hand, when the cache entry does not exist (step S103; NO), the cache manager 111 of the EPD update controller 110 decides a cache entry for registering a preprocess result (step S104). In this way, when the preprocess cache is filled with cache entries, the cache manager 111 decides the cache entry using an algorithm such as LRU (least recently used) for determining a cache entry to be replaced. Next, the preprocessor 113 of the EPD update controller 110 instructs the preprocess accelerator 102 to execute a preprocess (step S105).
The preprocess accelerator 102 executes the preprocess including an above-described processing step and selecting step based on the update-data on the main memory 120 in a response to the instruction from the preprocessor 113. After that, the preprocess accelerator 102 registers a preprocessed update-data being a result of the preprocess to the decided cache entry (step S106). Furthermore, the cache manager 111 registers an update-control-information selection ID being another result of the preprocess in the same cache entry (step S106). At the same step, the cache manager 111 also registers information about an update-data ID, an update-method tag and a valid bit (valid) of the tag part on the same cache entry (step S106). After that, the EPD update controller 110 progresses to step S107.
In step S107, the updating unit 114 of the EPD update controller 110 requests the EPD controller 105 to execute a drawing process directed to the EPD 140 while using the data registered on the preprocess cache (step S107). In response to this, the EPD controller 105 reads out update-control information corresponding to the update-control-information selection ID from the preprocess cache of the main memory 120 and the preprocessed update-data registered on the same cache, and executes the drawing process directed to the EPD 140 (step S108). After that, the EPD update controller 110 waits for completion of the update-process (step S109; NO). When the completion of the update-process is notified by an interruption handling, or the like (step S109; YES), the power manager 115 of the EPD update controller 110 powers off the main memory 120 using the power control device 150A (step S110). Thereby, power consumption is reduced. After that, the EPD update controller 110 finishes this operation.
As described above, by registering the preprocess result as the preprocess cache, it is possible to drastically reduce memory access to the main memory 120. As a result, it is possible to drastically reduce the power consumption and process time.
In the first embodiment, although the update-control-information selection ID being one of the preprocess results is stored on the preprocess cache, it is also possible that the update-control information itself is registered on the preprocess cache instead of the update-control-information selection ID. In such case, the process of reading out the update-control information based on the update-control-information selection ID is added before the process of registering the preprocess result in the cache entry (step S106). This is the same in the other embodiments.
In the first embodiment, although the case where the main memory 120 is a non-volatile memory is explained as an example, it is also possible that the main memory 120 is a volatile memory such as a DRAM. In such case, during idle time during which a process such as the drawing process directed to the EPD 140 is not executed, in order to maintain the data on the preprocess cache while reducing power consumption, it is possible to set a DRAM controller so as to be able to use a power-saving mode, such as a self-refresh mode of a DRAM, enabling to reduce the power consumption while maintaining data. This is the same in the other embodiments.
During idle time after complication of the drawing process directed to the EPD 140, it is possible to instruct the power control device 150B to stop supplying power while letting the power control device 150B itself switched to the power-saving mode. Furthermore, it is also possible to execute power gating of modules in the SoC 100 such as the EPD controller 105, stop supplying clocks, or the like. This is the same in the other embodiments. In addition, the first embodiment can be applied to a configuration without the preprocess accelerator 102.
In the first embodiment, although the preprocess accelerator 102 executes the preprocess, it is also possible that the CPU 101 or the EPD controller 105 executes the preprocess, or the CPU 101 and the EPD controller 105 share the preprocess. This is the same in the other embodiments.
The process of registering the entry of the preprocess cache is not limited to the above-described method, it is also possible that the preprocess accelerator 102 executes all of the process, or the CPU 101 and the preprocess accelerator 102 share the process. This is the same in the other embodiments.
In the first embodiment, although the EPD controller 105 integrated in the SoC 100 is used, it is also possible to use an external EPD controller with respect to the SoC 100.
Specifically, as update-data, for instance, there are various data from large-size data such as data of a whole single page in an electronic book application to small-size data such as data of a page number of a current page, data of a software button to be displayed on the EPD 140 by application software in order to be selected by a use of the data processing device 1 using a touch panel, and image data of each choice item in user interface such as a menu, a list, or the like. Therefore, to a region for registering the preprocessed update-data in each entry shown in
In the first embodiment, update of small-data image such as a button drawn on the EPD 140 as user interface is cached in a preprocess. By such configuration, according to characteristics of the EPD 140 and the EPD controller 105, there is a case where update time (a period that starts from the point the EPD controller 105 starts an actual update-process to the point the EPD controller 105 finishes the process) does not widely change depending on a data size of update-data (hereinafter referred to as update-size). Therefore, in a case where the data processing device 1 transits to a standby mode with low power consumption for the purpose of reducing the power consumption after complication of update, power-saving effect in a case with small update-size becomes equal to that in a case with large update-size. Therefore, caching by the preprocess cache in update with small data-size is very important. Furthermore, a button, each key of a keyboard, or the like, makes a large impact on user in response performance. Therefore, by caching as described above, it is possible to improve usability.
In the first embodiment, as for update-data for which preprocess has been executed once, although the preprocess result is stored on the preprocess cache, it is not limited to such configuration. For example, as for update-data of which frequent use is easily predicted, such as a home screen to be displayed at a time of boot of the data processing device 1, a menu and a list, an image of each key button of a software keyboard, software pieces being able to be shared by one or more application software, or the like, it is possible to previously execute preprocesses for them and previously register preprocess results on the data processing device 1. Here, the term “previously” may mean before shipping, at a time of installing, at a time of software update, or the like. The preprocess results previously registered are registered on the preprocess cache at a time of boot or cold boot of the data processing device 1, at a time of boot of application software, or the like. Thereby, as for a specific update-data, it is possible to reduce the power consumption in a very first update process. This is the same in the other embodiments.
In the first embodiment, although the power control device 150A powers the main memory 120 and the SoC 100 and the power control device 150B powers the EPD 140, it is not limited to such configuration. For example, the power control device 150A can power the main memory 120, the SoC 100 and the EPD 140. This is the same in the other embodiments.
In the first embodiment, the processing step in the preprocess can includes a process for creating update-data by an accelerator such as a GPU (graphics processing unit), the CPU 101, or the like. The process for creating update-data may include a rendering process in a PDF (portable document format) data or a web browser. This is the same in the other embodiments.
Next, a data processing device, a display control device, a semiconductor chip, a method of controlling display device, and a computer-readable medium according to a second embodiment will be described in detail with the accompanying drawings. In the following, for the same configurations as in the above-described embodiment(s), redundant explanations will be omitted by referring to them using the same reference numbers.
The power control device 150B powers the EPD controller 210 and the EPD dedicated memory 220 in addition to the EPD 140. Power supply to the EPD controller 210, or the like, may be conducted by the power control device 150A which powers the main memory 120, the SoC 200, and so on.
As the first embodiment, the main memory 120 is a non-volatile memory such as a MRAM. On the main memory 120, update-data to be displayed on the EPD is stored. The update-data is forwarded to the EPD dedicated memory 220 before an update-process is executed.
The EPD dedicated memory 220 may be a non-volatile memory such as a MRAM. The EPD dedicated memory 220 can be used as a working memory by the EPD controller 210.
The SoC 200 includes the bus 107, the CPU 101, the memory controller 103, the wireless LAN controller 106, and so forth. The SoC 200 can include the preprocess accelerator 102 as the first embodiment.
In the second embodiment, contrary to the first embodiment, the EPD controller 210 executes a preprocess and a drawing process (step). That is, in the second embodiment, the EPD controller 210 works as an EPD update controller. The EPD controller 210 includes an internal memory 211 such as a non-volatile MRAM. On the internal memory 211, a preprocess cache constructed from a pair of the preprocessed update-data and the update-control-information selection ID are stored. However, the update-control information can be stored on the internal memory 211.
A basic configuration of an EPD update controller according to the second embodiment is the same as the EPD update controller 110 (see
As shown in
In step S206, the cache manager 111 of the EPD update controller 110 decides a cache entry for registering a preprocess result (step S206). In this way, when the preprocess cache is filled with cache entries, the cache manager 111 decides the cache entry using an algorithm such as LRU for determining a cache entry to be replaced. Next, the data converter 113a and the selector 113b in the preprocessor 113 of the EPD update controller 110 execute a preprocess (step S207), and registers the preprocessed update-data being a result of the preprocess on the decided cache entry (step S208). Furthermore, the cache manager 111 registers the update-control-information selection ID being another result of the preprocess in the same cache entry (step S208). At the same step, the cache manager 111 also registers the information about the update-data ID, the update-method tag and the valid data (valid) of the tag part on the same cache entry (step S208). Here, when the preprocess accelerator 102 is being arranged, it is possible that the preprocessor 113 issues an instruction of preprocess to the preprocess accelerator 102 and the preprocess accelerator 102 executes the preprocess.
Next, the power manager 115 of the EPD update controller 110 powers off the EPD dedicated memory 220 after use (step S209), and the EPD update controller 110 progresses to step S210.
In step S210, the updating unit 114 of the EPD update controller 110 executes the drawing process directed to the EPD 140 while using the data registered on he preprocess cache (step S210). After that, the EPD update controller 110 waits for completion of the update-process (step S211; NO). When the completion of the update-process is notified by an interruption handling, or the like (step S211; YES), the power manager 115 of the EPD update controller 110 powers off the EPD 140 and the EPD controller 210 using the power control device 150B (step S212). Thereby, power consumption is reduced. Because the internal memory 211 is a non-volatile memory, data cached in the internal memory 211 is maintained even if the EPD controller 210 is powered off. Furthermore, because the EPD 140 is a non-volatile memory display, the image drawn on the EPD 140 is kept maintained. After which, the EPD update controller 110 finishes this operation.
As described above, by registering the preprocess result as the preprocess cache, it is possible to drastically reduce memory access to the EPD dedicated memory 220. As a result, it is possible to drastically reduce the power consumption and process time.
In the second embodiment, although the preprocess cache is stored on the internal memory 211 of the EPD controller 210, it is also possible that the preprocess cache is registered on the EPD dedicated memory 220 or both the internal memory 211 and the EPD dedicated memory 220. At this time, on the internal memory 211, a preprocess cache expected for frequent can be registered. Furthermore, in the second embodiment, although all of the update-control information is stored on the internal memory 211, it is also possible that all or a part of the update-control information is stored on the EPD dedicated memory 220. At this time, on the internal memory 211, a preprocess cache expected for frequent can be registered. This is the same in the other embodiments.
In the second embodiment, although the case where the EPD dedicated memory 220 and the internal memory 211 of the EPD controller 210 are non-volatile memories in addition to the main memory 120 is explained as an example, it is also possible that the EPD dedicated memory 220 and the internal memory 211 of the EPD controller 210 are volatile memories. In such case, during idle time during which a process such as the drawing process directed to the EPD 140 is not executed, in order to maintain the data on the preprocess cache while reducing power consumption, it is possible to use a power-saving mode, such as a self-refresh mode of a DRAM, enabling to reduce the power consumption while maintaining data, and it is also possible to supply power only to the internal memory 211 of the EPD controller 210. This is the same in the other embodiments.
As described above, the structure in that the EPD controller 210 is separated from the SoC 200 is not limited while it is also possible that the EPD controller 105 of the SoC 100 in the first embodiment executes the same operation as the EPD controller 210 of the second embodiment. In such case, it is possible that the EPD controller 105 has the internal memory 211 or the internal memory 104 is used instead of the internal memory 211.
As shown in the example, due to the characteristic that a display of the EPD 140 can be partially updated, an update-size of the preprocessed update-data cached on the preprocess cache data part may often be different by entries. Therefore, a kind of configuration in that a region for registering the preprocessed update-data of each cache entry shown in
Next, a data processing device, a display control device, a semiconductor chip, a method of controlling display device, and a computer-readable medium according to a third embodiment will be described in detail with the accompanying drawings. In the following, for the same configurations as in the above-described embodiment(s), redundant explanations will be omitted by referring to them using the same reference numbers.
A data processing device according to the third embodiment can have the same configuration as the data processing device 1 according to the first embodiment (see
The SoC 100 according to the third embodiment can receive an interruption from the input device 130 being a touch panel, a keyboard, a button or a key specialized for a specific process incorporated in the data processing device 2, or the like, while the SoC 100 is operating in a standby mode with low power consumption.
The internal memory 104 is a non-volatile memory such as a MRAM. In the third embodiment, on the internal memory 104, the preprocess cache constructed from a pair of the preprocessed update-data and the update-control-information selection ID are stored. A base configuration of a preprocess cache can be the same as the preprocess cache shown in
A base configuration of an EPD update controller according to the third embodiment is the same as the EPD update controller 110 according to the first embodiment shown in
In the operation shown in
To the update-request received from the application software, the reserved update-data ID (from 1000-th to 1002-th) is added. Therefore, the cache determining unit 112 can determine that the cache entry does not exist in the preprocess cache (cache-miss) without executing the cache determination. Accordingly, when the EPD update controller 110 is received the update-request from the application (step S303; YES), the cache manager 111 of the EPD update controller 110 decides a cache entry for registering the preprocess result (step S304). In this way, when the preprocess cache is filled with cache entries, the cache manager 111 decides the cache entry using an algorithm such as LRU for determining a cache entry to be replaced.
Next, the power manager 115 of the EPD update controller 110 confirms whether the main memory 120 is powered off or not for the purpose of aggressive power-saving (step S305). When the main memory 120 is powered off (step S305; YES), the power manager 115 powers on the main memory 120 using the power control device 150A (step S306), and the EPD update controller 110 progresses to the step S307. Thereby, access to the main memory 120 is permitted. Because the main memory 120 is a non-volatile memory such as a MRAM, data of a preprocess cache structured on the main memory 120 is maintained. On the other hand, when the main memory 120 is powered on (step S305; NO), the EPD update controller 110 directly progresses to step S307.
In step S307, because the result of the cache determination does not hits the preprocess cache (cache-miss), the preprocessor 113 of the EPD update controller 110 instructs the preprocess accelerator 102 to execute the preprocess (step S307).
The preprocess accelerator 102 executes the preprocess including an above-described processing step and selecting step based on the update-data on the main memory 120 in a response to the instruction from the preprocessor 113. After that, the preprocess accelerator 102 rewrites a preprocessed update-data being a result of the preprocess to the decided cache entry (step S308). Furthermore, the cache manager 111 registers information about an update-control-information selection ID being another result of the preprocess, and an update-data ID, an update-method tag and a VALID bit (VARID) of the tag part in the same cache entry (step S308). After that, the power manager 115 of the EPD update controller 110 powers off the main memory 120 using the power control device 150A (step S309), and the EPD update controller 110 progresses to step S310.
In step S310, the updating unit 114 of the EPD update controller 110 requests the EPD controller 105 to execute a drawing process directed to the EPD 140 while using the data registered on the preprocess cache (step S310). In response to this, the EPD controller 105 reads out update-control information corresponding to the update-control-information selection ID from the preprocess cache of the main memory 120 and the preprocessed update-data registered on the same cache, and executes the drawing process directed to the EPD 140 (step S311). After that, the EPD update controller 110 finishes this operation.
In the third embodiment, because of the premise in that the specific interruption is determined by the cache determining unit 112 of the interrupt handler for EPD-update, it is possible to omit the determination process by fixing the determination result for the update-request with the assigned update-data ID issued in step S304 to a cache-miss. Furthermore, by arranging such that the determination process is executed by another cache determining unit incorporated in a driver of the EPD controller 210 after the update-request is notified, it is possible to omit the preprocess as in the first embodiment with respect to those interruption other than the specific interruption. As the result, it is possible to achieve further power-saving and speeding-up.
Moreover, for instance, when a controller such as a microcontroller with lower power than the SoC 100 is arranged between the input device 130 and the SoC 100, the controller is powered from some place other than the power control device 150A, and the controller can control the SoC 100 and the power control device 150A, it is possible to conduct aggressive power-saving by executing hibernation in that the controller stops supplying power to the SoC 100 and the power control device 150A itself powers off during idle time after complication of the drawing process of step S311. In such case, because the internal memory 104 of the SoC 100 is a non-volatile memory, after a restore process leaded by the controller, data of a preprocess cache is maintained. Therefore, after resuming from idling, it is possible to execute the update-process of the EPD 140 with high-speed. Furthermore, when the internal memory 104 of the SoC 100 is a volatile memory such as a SRAM, hibernation may be executed after the preprocess cache on the internal memory 104 is saved to the non-volatile main memory 120. It is also possible to let only the internal memory 104 being a SRAM, or the like, powered on while letting the EPD 140 powered off. These are the same in the other embodiments.
Moreover, in the third embodiment, although a specific interrupt handler for EPD-update, a specific update-data ID and a specific update-method tag are previously arranged for an interruption, a correspondence relationship therebetween can be dynamically varied at a time of booting the application software.
In the third embodiment, although it is arranged such that all the preprocess cache is located on the internal memory 104 of the SoC 100, there is no necessity of locating the all the preprocess cache on the internal memory 104 while it is also possible to locate a part of the preprocess cache on the main memory 120. In such case, by preferentially locating frequently-used cache entry, or the like, on the internal memory 104 for the purpose of suppressing the number of executions of powering-on the main memory 120, it is possible to optimize the power consumption and the process speed.
Moreover, in the third embodiment, although the entire update-control information is located on the internal memory 104, it is also possible to locate a part of the update-control information on the main memory 120. In this way, the internal memory 104 can be used as a cache for a frequently-used update-control information.
In the third embodiment, although the EPD controller 210 integrated in the SoC 100 is used, it is also possible to use an external EPD controller with respect to the SoC 100.
Furthermore, as for an extremely-frequently-used update-data in which content to be displayed is static as a menu screen, it is acceptable that the update-control-information ID and the preprocessed update-data being the preprocess results are previously registered on the preprocess cache on the internal memory 104. In such case, because it is possible to skip the processes of step S302 to S309 in
Next, a data processing device, a display control device, a semiconductor chip, a method of controlling display device, and a computer-readable medium according to a fourth embodiment will be described in detail with the accompanying drawings. In the following, for the same configurations as in the above-described embodiment(s), redundant explanations will be omitted by referring to them using the same reference numbers.
A data processing device according to the fourth embodiment has the same configuration as the data processing device 2 according the second embodiment (see
When the controller receives a request of interruption handling from a keyboard, or the like, the controller determines whether a preprocess cache of an update-process corresponding to the interruption exists or not, and when the corresponding preprocess cache exists (cache-hit), the controller sends the update-request to the EPD controller 210 directly, and when the corresponding preprocess cache does not exist (cache-miss), the controller sends an interruption to the SoC 200 and, if needed, makes the SoC 200 issue an update-request. Therefore, when the preprocess cache exists (cache-hit), it is possible to execute the update-process using a minimum configuration while the SoC 200 and the main memory 120 are kept powered-off, whereby it is possible to drastically reduce the power consumption. For example, in a case such as an electronic book application, for opening a new electronic book, the operation is executed with a configuration including the SoC 200 and the main memory 120, and for most of time during which simple page-turnings for browsing the electronic book are repeated, the operation is executed with the minimum configuration without the SoC 200 and the main memory 120.
The input devices 130 include a keyboard, a touch panel, a network, or the like. Interruption handlings by these input devices 130 are transmitted to the microcontroller 400 arranged between the SoC 200 and the input devices 130, and will not be directly transmitted to the SoC 200.
Power consumption of the microcontroller 400 is lower than the SoC 200, and the microcontroller 400 is normally powered on. The microcontroller 400 has an internal memory 401, and a tag part of a preprocess cache is registered on the internal memory 401.
In the fourth embodiment, as the second embodiment, the EPD controller 210 executes the preprocess. The EPD controller 210 has the internal memory 211 such as a non-volatile MRAM, or the like. In the internal memory 211, also the preprocess cache constructed from a pair of the preprocessed update-data and the update-control-information selection ID is stored. The tag part of the preprocess cache is also stored on the internal memory 211 of the EPD controller 210. A consistency between the tag part of the preprocess stored on the internal memory 211 of the EPD controller 210 and the tag part of the preprocess stored on the internal memory 401 of the microcontroller 400 should be maintained. Also the update-control information is located on the internal memory 211 of the EPD controller 210.
A basic configuration of an EPD update controller is the same as the second embodiment. Also in the fourth embodiment, the EPD update controller 110 is the process in the EPD controller 210. However, a cache determining unit same as the cache determining unit 112 is also incorporated in the microcontroller 400. In addition, a power manager for powering on/off the SoC 200 can be incorporated in the microcontroller 400. A configuration of the preprocess cache stored on the internal memory 211 of the EPD controller 210 is the same as the preprocess cache exampled in the first embodiment (see
As shown in
Next, the power manager 115 being a process of the EPD controller 210 checks whether the EPD dedicated memory 220 is powered off for the purpose of aggressive power-saving or not (step S404), and when the EPD dedicated memory 220 is powered off (step S404; YES), the power manager 115 powers on the EPD dedicated memory 220 using the power control device 150B (step S405), and the EPD controller 210 progresses to step S406. Thereby, access to the EPD dedicated memory 220 is permitted. On the other hand, when the EPD dedicated memory 220 is powered on (step S404; NO), the EPD controller 210 directly progresses to the step S406.
Next, the cache manager 111 being a process of the EPD controller 210 decides the cache entry using an algorithm such as LRU for determining a cache entry to be replaced (step S406). Then, the preprocessor 113 being a process of the EPD controller 210 executes the preprocess while using the EPD dedicated memory 220 as a working memory (step S407), and registers a result of the preprocess on the decided cache entry (step S408).
Next, the power manager 115 being a process of the EPD controller 210 powers off the EPD dedicated memory 220 using the power control device 150B (step S409). Then, by transmitting information of the tag part of the preprocess from the cache manager 111 of the EPD controller 210 to the microcontroller 400 and executing a process of updating the tag part for getting synchronization on the microcontroller 400, the tag part stored on the internal memory 401 of the microcontroller 400 and the tag part stored on the internal memory 211 of the EPD controller 210 are made to synchronize with each other (step S410), and the EPD controller 210 progresses to step S411. Thereby, the consistency between the tag part stored on the internal memory 401 of the microcontroller 400 and the tag part stored on the internal memory 211 of the EPD controller 210 is maintained. Here, this step S410 can be executed via the SoC 200. Furthermore, when the update-process to be cached is limited to a number of certain pair of the preprocessed update-data ID and the update-method tag and is previously set to the data processing device 4, it is possible to omit the process of step S410.
In step S411, the updating unit 114 being a process of the EPD controller 210 reads out the update-control information corresponding to the update-control-information selection ID registered on the preprocess cache, reads out the preprocessed update-data registered on the preprocess cache, and executes a drawing process to the EPD 140 (step S411). After that, the EPD controller 210 waits for completion of the update-process (step S412; NO). When the completion of the update-process is notified by an interruption handling, or the like (step S412; YES), the power manager 115 on the microcontroller 400 powers off the EPD controller 210 using the power control device 150B (step S413). This process can be executed by the power manager of the EPD controller 210. Thereby, the power consumption of the EPD controller 210 can also be reduced. Because the internal memory 211 is a non-volatile memory, even if the EPD controller 210 is powered off, data cached on the internal memory 211 is maintained. After that, the EPD controller 210 finishes this operation.
As for conducting the above-described embodiments more effectively, there is a method of executing a preload with respect to the preprocess cache. The preload is a process in that a preprocess for update-data of an update-process likely to be executed in the future is executed beforehand and a result of the preprocess is registered on the preprocess cache. In this way, if an update-process likely to be executed in the future can be specified, by executing a preload in which a preprocess for a target update-data is executed beforehand and a result of the preprocess is registered on the preprocess cache before an actual update-request is issued, it is possible to use data on the preprocess cache in response to even the initial update-request. As a result, because it is possible to shorten the update time, it is possible to improve the responsiveness of the data processing device. Furthermore, by shortening the update time, it is possible to prolong a period for powering off the SoC 200, the memories, and so on, whereby it is possible to achieve further power saving.
The preload of preprocess can be applied to any one of the first to fourth embodiments. In the following explanation, the third embodiment in which the internal memory 104 of the SoC 200 is used for a cache is used as a basic configuration.
The preload of preprocess can be applied to various uses such as updating the next selection item or the next page in the menu, the list, the electronic book, or the like, for instance. Here, as an example, a kana-kanji conversion application is explained.
”, “
”, “
”) specified from a reading and a kanji-character table called a dictionary are displayed. After that, by the user processing the conversion key, a focus shifts to the next candidates in order. Firstly, it is assumed that the original colored data as shown in (a) of
”, “
” and “
” are displayed in black and white on the EPD 140. Specifically, in an order from a left side, the focused candidate “
” is highlighted (i.e. a background is black and a character is white), and the unfocused candidates “
” and “
” are not highlighted. Next, when the user inputs the conversion key once, as shown in (c) of
” and the other candidates “
” and “
” are not highlighted. Furthermore, when the conversion key is inputted once more, as shown in (d) of
” and the other candidates “
” and “
” are not highlighted.
In order to display the state shown in (b) of ’, ‘W’> for the candidate “
” for highlighting and preprocesses <‘
’, ‘B’> and <‘
’, ‘B’> for the candidates and “
” and “
” for not highlighting are executed. In order to display the state shown in (c) of
’, ‘B’> of the candidate “
” for not highlighting and a process <‘
’, ‘W’> of the candidate “
” for highlighting are executed. In order to display the state shown in (d) of
” and “
”, because the preprocess cache of <‘
’, ‘B’> for the candidate “
” can be reused, only a preprocess <‘
’, ‘W’> of the candidate “
” for highlighting is executed.
Because the user may expect that the focus shifts for every pressing of the conversion key, when executing the preprocess for every pressing takes time for the focus to be shifted the focus, there is a possibility of undermining the usability. Furthermore, because the main memory 120 storing the original data needs to be accessed every time, there may be problems in that the main memory 120 may need to be switched on and off repeatedly, powering off of the main memory 120 may become difficult, and so on. This may lead to difficulties in utilizing the advantage of a non-volatile memory.
Therefore, by previously executing six preprocesses <‘’, ‘W’>, <‘
’, ‘W’>, <‘¢’, ‘W’>, <‘
’, ‘B’>, <‘
’, ‘B’> and <‘
’, ‘B’> to be used for a series of processes in a lump and by registering the results on the preprocess cache located on the internal memory 104 of the SoC 200, it is possible to speed up the shift of the focus. Furthermore, because a single power-on of the main memory 120 is required, it is also possible to reduce the power consumption. When a processing time for executing the six preprocesses in a lump affects the usability, it is possible to conceal a part or all of the processing time of the preprocesses in the drawing process by taking advantage of a property that a processing time of a single drawing process for the EPD 140 is comparatively long.
’, ‘W’>, <‘
’, ‘B’> and <‘
’, ‘B’> minimum required for display the state shown in (b) of
’, ‘B’>, <‘
’, ‘W’>, <‘
’, ‘W’>, <‘
’, ‘W’>, <‘
’, ‘B’> and <‘
’, ‘B’>, and (b) of
’, ‘B’>, <‘
’, ‘W’>, <‘
’, ‘W’> for displaying the state shown in (b) of
As is evident from ’, ‘W’>, <‘
’, ‘B’> and <‘
’, ‘B’> are concealed in the drawing processes (S11), it is possible to execute the preprocesses (S2 and S3) for preload without affecting the time for displaying the state shown in (b) of
However, when the preloaded data is not used, the power consumed for the preprocess for the preload becomes waste. In such case, it is preferred that the history information about use of candidates in the kana-kanji conversion application is stored while timing and a size of preload are decided based on the history information. Furthermore, considering the time for the drawing process and the time for the preload of the preprocess, it is possible to calculate how many preloads for candidates can be concealed in the drawing time.
Moreover, it is possible to control aggressiveness of preload depending on surplus power generated by the solar cell or the remaining battery power of the accumulator of the data processing device. For instance, it is possible to structure such that when surplus power generated by the solar cell or the remaining battery power of the accumulator is plenty, aggressively execute as many preloads as possible to increases the responsiveness of the data processing device, or when the surplus power generated by the solar cell and the remaining battery power of the accumulator is small, suppress the number of preloads.
The EPD update controller 110 using the preprocess cache in the first to fourth embodiments can be combined with the preload of the preprocess cache in the fifth embodiment. In such case, by saving a state of the SoC 200 to a non-volatile memory, it is possible to speed up a restore process from a standby mode with low power consumption at a time when hibernation for powering off the SoC 200, the memories and the display is executed.
In a data processing device which uses a LCD (liquid crystal display) as a display, at a standby mode in which a suspend process of the hibernation is executed, the LCD is powered off, and nothing is shown on the display. Therefore, the restore process from the standby mode for user starts by inputting a specific key of a keyboard, turning on a power button, or the like, and finishes by displaying a screen directly before executing the suspend mode (in (a) of
On the other hand, a case of a data processing device with the EPD 140 as a display is different. Also at the suspended standby mode, on the EPD 140 being a non-volatile display, a view of the screen directly before executing the suspend mode is kept. Therefore, in the data processing device having the EPD 140 as a display, the restore process starts by an input on the currently displayed screen at the standby mode through a touch panel or a keyboard, but not by an input through a specific key, or the like. Furthermore, a response time for the user becomes a period starting from the time the process on the displayed screen during the standby mode is executed till the time a result of the process is displayed on the EPD 140 (S92 to S95) (i.e. a period until the screen of the EPD 140 is changed). Accordingly, in the data processing device having the EPD 140 as a display, in order to improve the responsiveness, it is necessary to shorten the period starting from the time the process on the displayed screen during the standby mode is executed till the time the result of the process is displayed on the EPD 140.
Influences of a period starting from the time the user finishes operation of the data processing device till the time the suspend process is started on the responsiveness for user is small. Therefore, it is possible to execute the preprocess of the update-process expected to be executed after the resuming and preloading a result thereof to the preprocess cache, before starting the suspend process as shown in S11. In such case, because it is possible to use the preprocess cache at the time of resuming, it is possible to improve the responsiveness. However, when the user faces many update-processes to come to complication of the restore process, preloads for all of the update-processes may raise costs. Therefore, for instance, it is possible to determine whether the preload should be executed or not based on the number of the branches. It is also possible to structure such that a specific image data for showing that the data processing device is in a restore process is defined, a preprocess result of that image data is always registered on the preprocess cache, and when the restore process starts, the user is instantaneously informed about the start of the restore process through a display on a specific region of the EPD 140.
As shown in
When the number of the preload items is larger than the threshold (step S601; YES), the OS progresses to step S603. On the other hand, when the number of the preload items is smaller than the threshold (step S601; NO), the OS instructs the EPD update controller 110 to execute the preprocess of the next page to be updated at a time when the NEXT key is inputted (step S602), and progresses to step S603. Thereby, the next page is preloaded to the preprocess cache. In step S603, after completion of the preload, the OS executes the hibernation (step S603). After that, when the restore process for resuming from the standby mode is started by using the input of the NEXT key as a trigger, an update-request of the next page is issued to the EPD update controller 110. In response to this, due to the preprocess cache cache-hits, the EPD update controller 110 executes the update-process using the preprocess cache. Thereby, it is possible to speedily resume from the suspend standby mode.
Here, the threshold for the preload items can be varied depending on surplus power generated by the solar cell and/or battery power of the accumulator of the data processing device. For example, when surplus power generated by the solar cell or battery power of the accumulator is much, it is possible to increase the threshold.
In the explanation, although the example of the restore process from the standby mode in the case where the hibernation is executed, it is also possible to apply the embodiment to the standby mode with low power consumption incorporated in the data processing device.
In the preprocess cache method in the first to fourth embodiments, by giving information and idea about update-process, etc., stored in the application software as hint information, it is possible to increase a cache-hit ratio of the preprocess cache. Furthermore, by ensuring a condition in which the cache-hit to the preprocess cache certainly occurs, it is possible to omit a data creating process such as rendering for preparing update-data on a frame buffer, or the like, and a process of writing the created update-data in the frame buffer, and thereby, it is possible to achieve more aggressive power-saving and speeding-up of processes.
As update-processes of the EPD 140, there are one in which probability of executing the same update-process (hereinafter referred to as high repetition probability) is high and another one in which probability of the same update-process is low (hereinafter referred to as low repetition probability). When application software, middleware, or the like, can specify the update-process with high repetition probability, by adding hint information indicating that the update-process has the high repetition probability to the update-request to be transmitted to the EPD update controller 110, it is possible to use the hint information for determining whether the cache manager 111 of the EPD update controller 110 should cache a preprocess result or not. As a result, the cache-hit ratio can be increased, and it is possible to reduce average power consumption and processing time being necessary for update-process. Furthermore, as the third embodiment, when memories capable of having the cache located and having different access speeds are arranged in the data processing device, it is also possible to use the hint information for determining which preprocess result in the update-process is to be located on a high-speed memory. The hint information, for instance, may indicate that the preprocess result of a certain update-process should not be cached, the preprocess result of a certain update-process should be cached as much as possible, the preprocess result of a certain update-process of which repetition probability is high in a case of data such as a menu, for instance, has to be cached and locked in order to prevent the preprocess result from being removed, and so on.
In
Furthermore, in
The example shown in
The example shown in
A reusable process result among process results for creating the update-data 731 can has a structure for realizing two-level cache to be cached in application software or middleware.
Furthermore, the seventh embodiment can be combined with the preload to the preprocess cache in the fifth embodiment. For instance, when it is previously decided that all pages are to be updated in order in application for conducting an examination, a questionnaire, or the like, for education, or the like, by adding hint information for preloading a N+1-th page to the preprocess cache at a time when a N-th page is updated, it is possible to have an update-process of the N-th page and a preprocess of the N+1-th page overlapped. As a result, shorter processing time can be concealed.
Other than the method of adding the hint information to the update-request each time the update-request is made, it is possible to structure such that information and idea stored in application software is transmitted to the EPD update controller 110 as hint information just before booting application software or starting a series of previously-decided processes, for instance. Thereby, in browsing with comparatively a lot of page-turnings such as browsing of an academic article, an electronic chart, or the like, with comparatively a small number of pages, by notifying a browsing method and the number of the entire pages as hint information, it is possible to determine whether caching of the entire pages is more efficient or not, or the like.
By reducing the preprocessing time by using the preprocess cache according to the first to fourth embodiment, it is possible to put forward a beginning of a follow-on update-process. As a result, because it is possible to shorten a total processing time of the update-processes, it is possible to turn the SoC 100 and the memories to the standby mode with low power consumption or power-off, and as a result, it is possible to further reduce the power consumption.
In the following, for the purpose of clarification, although the structure of the data processing device 1 (see
With referring
On the other hand, (b) of
As described above, by using the preprocess cache, it is possible to reduce the power consumption even if an update-process which is not capable of using the preprocess cache is included in the series of update-processes.
In the above-described embodiments, the update-data ID for identifying the update-data is stored in the tag part of the preprocess cache. However, the structure is not limited to such structure while it is also possible to use a structure where the update-data ID is not used, for instance. In such case, instead of the update-data ID in the structure of the preprocess cache shown in
Such configuration can be applied to all of the above-described embodiments. Here, a comparison between the update-data and the update-data registered on the preprocess cache can be executed by software or hardware.
Although the above-described embodiments have the configuration in that the single data processing device reduces the power consumption by using the preprocess cache, it is also possible to structure such that when a plurality of data processing devices execute a common preprocess, by off-loading the common preprocess to a cloud, a server, a multifunction machine, a smartphone, a tablet PC, a digital television, and so on, each data processing device will not execute the common preprocess.
An EPD update controller arranged at a side of the cloud server 1001 can be the same as the EPD update controller 110 (see
In step S1006, the cloud server 1001 sends a pair of the update-control-information selection ID, the preprocessed update-data, and so on, on the preprocess cache to the updating unit 114 in each of the data processing devices 1A to 1N (step S1006). In response to this, the updating unit 114 in each of the data processing devices 1A to 1N reads out update-control information corresponding to the received update-control-information selection ID from the main memory 120 of each of the data processing devices 1A to 1N, and instructs the EPD controller 105 of each of the data processing devices 1A to 1N to execute the drawing process to the EPD 140 of each of the data processing devices 1A to 1N by using the received preprocessed update-data (step S1007), and the EPD update controller 110 finishes this operation.
Here, the preprocess caches 1001A to 1001N created by the cloud server 1001 may be different depending on a type, a size or a resolution of the data processing devices 1A to 1N, a version of the update-control information, or a temperature.
By having a drawing process of the EPD 140, a receiving process of a next page, and a transmission process of a further next update-request (it can be a request of a preprocess preload for requesting only preprocess) overlapped on the side of the data processing devices 1A to 1N, it is possible to shorten an active time of each of the data processing devices 1A to 1N, whereby it is possible to reduce the power consumption. Furthermore, when a plurality of partial update-processes are needed in each of the data processing devices 1A to 1N in order to display one page of an electronic book or a whole screen of a browser, by executing transmission and reception with a large unit such as pages instead of executing the transmission and reception for every update-process, it is possible to reduce the power consumption for transmitting and receiving data. Moreover, by having transmission and reception by the large unit overlapped with the drawing process in each of the data processing devices 1A to 1N, it is possible to shorten the active time in each of the data processing devices 1A to 1N, and thereby, it is possible to prolong a period of being a standby mode with low power consumption which allows reduction of power consumption.
It is not necessary that the preprocess in the cloud server 1001 is executed in response to every update-request from the data processing devices 1A to 1N while it is also possible to transmit information for specifying an electronic book at a time of booting the electronic book application, for instance, executed on the data processing devices 1A to 1N, for instance, and batch executions of preprocesses for every page of the electronic book in parallel.
It is also possible to transmit the update-control information from the cloud server 1001 instead of the update-control-information selection ID. In such case, there is no necessity of storing the update-control information in the data processing devices 1A to 1N.
In the data processing devices 1A to 1N, it is not necessary to locate the update-data while locating the update-control information should be appropriate. When the preprocess is off-loaded on the cloud server 1001 every time, because the preprocess accelerator 102 in each of the data processing devices 1A to 1N becomes unnecessary, it is possible to design the data processing devices 1A to 1N to be a compact and lightweight, requiring lower power consumption. On the other hand, assuming a case where it is impossible to access a wireless LAN, the update-data can be located in the data processing devices 1A to 1N. When there is a possibility that time and power for transmission and reception via the wireless LAN dynamically vary and they may become larger than those in a case where the data processing devices 1A to 1N execute the preprocess, for instance, it is possible to conduct a test on the case where the preprocess is executed on the cloud server 1001 and a case where the preprocess is executed on each of the data processing devices 1A to 1N at a time of booting application or at a regular interval in order to determine which case is with less processing time and power consumption and to switch to the one with less processing time and power consumption.
When the preprocess caches 1001A to 1001N are arranged on a non-volatile memory such as a MRAM of a computer constructing the cloud server 1001, the power manager 115 can reduce the power consumption by powering off the MRAM during idle time.
It is also possible to control transmission and reception based on surplus power generated by the solar cell and/or battery power of the accumulator of each of the data processing devices 1A to 1N. For instance, when surplus power generated by the solar cell or residual battery power of the accumulator is plenty, in preparation for their becoming less, it is possible to execute off-loads of the preprocesses for further pages of the electronic book and receptions of the preprocess results.
It is also possible to structure such that the preprocess is executed on the cloud server 1001, and as the above-described embodiments, the preprocess caches 1001A to 1001N are managed on the side of the data processing devices 1A to 1N. In such case, after caching in each of the data processing devices 1A to 1N once, it is possible to execute the drawing process without execution of the preprocess, and thereby, it is possible to reduce the power consumption of the update-process.
In the above-described embodiments, as for a scroll bar, or the like, being an interface incorporated in a web browser, a list, or the like, when the update-processes of the electronic paper by using the same update-control information for the same update-data and the update regions of the update-processes have an overlap, it is possible to structure such that a difference between the update regions is preloaded on the preprocess cache and the drawing processes are repeatedly executed using the difference on the preprocess cache. It is also possible to structure such that caches of the update-data are preloaded, the difference is calculated based in the caches, and the drawing processes are repeatedly executed using the calculated difference. In these cases, by structuring that the drawing process is immediately executed at a time when the user of the data processing device inputs a scroll bar, or the like, it is possible to improve the responsiveness and reduce the power consumption. Furthermore, at that time, by thinning the serial update-data, because a throughput is reduced, it is possible to reduce the power consumption.
In the following, an example in which an update-mode optimized for a scroll bar is installed in an EPD update controller and an update-process is executed at the update-mode will be explained.
In the update-process of the scroll bar, before a scrolling handling starts by user, e.g. at a boot of application software, or the like, a possible usage of the update mode for a scroll bar by the application software and an update-data ID (e.g. 100-th) used for issuing the update-request of the scroll bar update region 1101 are previously notified to the EPD update controller 110 as scroll bar information to be used in the update mode. At that time, also a size of the scroll bar update region 1101, sizes of the white part 1102 and the black part 1103, and so on, are notified to the EPD update controller 110. The EPD update controller 110 executes the preprocess so as to select update-control information for suppressing a residual image of a tail part (the white part 1102), and preloads a result of the preprocess to the preprocess cache with the update-data ID=100-th. Furthermore, the EPD update controller 110 divides the black part 1103 (knob) into an overlapping part 1103a of the black part 1103 between before and after shifting by unit of a shifting pitch (for instance, update A→update B) and a remaining head part 1103b. Even if a residual image of the head part 1103b remains, it is possible to erase the residual image at a time of updating the tail part (the white part 1102). Therefore, the preprocess is executed so that an update-control information capable of showing the black part 1103 as soon as possible to the user is selected, and a result thereof is preloaded to the preprocess cache with a next update-data ID=101-th, for instance.
When the update-process is executed using update-control information for suppressing a residual image, if the update-control information can firstly display black in a middle of the update-process in order to erase a residual image, it is possible to use the update-control information for taking advantage of such characteristics. In addition, the preprocess of the overlapping part 1103a is not necessary.
When an actual scrolling handling by the user starts and the update-data ID=100-th and a position of the scroll bar update region 1101 (update start position) are notified to the EPD update controller 110 one after another, because the update-data=100-th of the preprocess cache is already defined as the update-data ID for the scroll bar at a boot of the application software, the preprocess cache with the update-data ID=100-th is additionally searched and an update-process using the cached data is executed on a predetermined update position calculated based on the scroll bar information. Specifically, firstly, the updating unit 114 instructs to update the head part 1103b, and then, the updating unit 114 instructs to update the tail part (the white part 1102). Here, because the update of the head part 1103b uses the update-control information capable of showing a change to black to the user fast, it is possible to display so that the shifting of the knob follows the scrolling handling by the user, whereby it is possible to improve the user experience. Furthermore, because the residual image is erased in the update of the tail part (the white part 1102), the residual image does not remain after the scrolling handling.
Depending on a unit of the shift pitch of the knob, update may frequently occur. In such case, it is preferred that the number of updating is reduced by thinning intermediate updatings. Thereby, it is possible to reduce the power consumption. A ratio of the thinning may be one in every several times, for instance. For example, among the updates A to E shown in
Next, a data processing device, a display control device, a semiconductor chip, a method of controlling display device, and a computer-readable medium according to a twelfth embodiment will be described in detail with the accompanying drawings. In the following, for the same configurations as in the above-described embodiment(s), redundant explanations will be omitted by referring to them using the same reference numbers.
The configuration for operating an essential part of the update-process using the microcontroller 400 in the fourth embodiment is not limited to the data processing device 4 having the EPD 140, it is also possible to apply the configuration to a smartphone, a tablet PC, a cell phone, or the like, which has a general display such as a LCD. The preprocess in such case includes a rendering process and an update-data creating process for creating a screen to be displayed. A value registered on the preprocess cache may be a content of a frame buffer used by a display, which is a result of the preprocess.
When the microcontroller 400 receives a request of interruption handling from a keyboard, or the like, the microcontroller 400 determines whether a preprocess cache of an update-process corresponding to the interruption exists or not, and when the corresponding preprocess cache exists (cache-hit), the microcontroller 400 sends the update-request to the display controller 1210 directly, and when the corresponding preprocess cache does not exist (cache-miss), the microcontroller 400 sends an interruption to the SoC 1200 and, if needed, makes the SoC 1200 issue an update-request to the display unit 1240. Therefore, when the process cache exists (cache-hit), because it is possible to maintain power supplied to the main memory 120 at power which is lower than power for normal read/write and is capable of holding contents in the memory while maintaining power-off of the SoC 1200, it is possible to execute the update-process using a minimum configuration for updating, whereby it is possible to drastically reduce the power consumption. For example, in a case such as an electronic book application, for opening a new electronic book, the operation is executed with a configuration including the SoC 1200 and the main memory 120, and for most of time during which simple page-turnings for browsing the electronic book are repeated, the operation is executed with the minimum configuration without the SoC 1200 and the main memory 120.
The data processing device 12 has the SoC 1200, the main memory 120, the display unit 1240, the display controller 1210, the display dedicated memory 1220, the power control devices 150A and 150B, the power control device 450, the microcontroller 400, and one or more input devices 130.
Power consumption of the microcontroller 400 is lower than the SoC 1200, and the microcontroller 400 is normally powered on. The microcontroller 400 has an internal memory 401, and a tag part of a preprocess cache is registered on the internal memory 401.
The display controller 1210 has the internal memory 211. On the internal memory 211, the preprocess cache formed by a plurality of update-data is stored. The tag part of the preprocess cache is also stored on the internal memory 211 of the display controller 1210. A consistency between the tag part of the preprocess stored on the internal memory 211 of the display controller 1210 and the tag part of the preprocess stored on the internal memory 401 of the microcontroller 400 should be maintained.
In the twelfth embodiment, a display update controller is a process in the display controller 1210. The configuration thereof can be the same as the EPD update controller 110 shown in
The tag part includes the preprocessed update-data and a valid bit. The application software, or the like, issues the update-request for the display unit 1240 while adding a preprocess update-data ID for identifying preprocessed update-data. The cache determining unit 112 received such update-request determines whether the cache-hit is true or false. In the cache determination, by searching the tag parts in the cache entries, it is determined whether there is an entry in which the preprocess update-data ID is matched and the VALID bit indicating whether data of a corresponding cache entry is valid or invalid indicates valid.
The preprocessed update-data ID is information for identifying preprocessed update-data. In an update-process using the same preprocessed update-data while application software or middleware manages preprocess update-data and an preprocessed update-data ID with association between them, for instance, an update-request with the same preprocessed update-data ID is issued to the display update controller.
In the preprocess cache data part, preprocess cache data is stored. A size of preprocessed update-data is a size of a frame buffer for storing data for updating a display, and in this example, the data size thereof is the same.
As shown in
Next, the power manager 115 being a process of the display controller 1210 checks whether the display dedicated memory 1220 is powered off or is set to the power-saving mode with comparatively low power consumption or not (step S1205), and when the display dedicated memory 1220 is powered off or is set to the power-saving mode (step S1205; YES), the power manager 115 powers on the display dedicated memory 1220 and resumes the display dedicated memory 1220 to a readable/writable mode (normal mode) from the power-saving mode using the power control device 150B (step S1206), and the display controller 1210 progresses to step S1207. On the other hand, when the display dedicated memory 1220 is powered on (step S1205; NO), the display controller 1210 directly progresses to the step S1207.
In step S1207, the cache manager 111 being a process of the display controller 1210 decides the cache entry using an algorithm such as LRU for determining a cache entry to be replaced (step S1207). Then, the preprocessor 113 being a process of the display controller 1210 registers a result of the preprocess executed at step S1203 on the decided cache entry (step S1208).
Next, the power manager 115 being a process of the display controller 1210 powers off the display dedicated memory 1220 or sets the display dedicated memory 1220 to the power-saving mode using the power control device 150B (step S1209). Then, by transmitting information of the tag part of the preprocess from the cache manager 111 of the display controller 1210 to the microcontroller 400 and executing a process of updating the tag part for getting synchronization on the microcontroller 400, the tag part stored on the internal memory 401 of the microcontroller 400 and the tag part stored on the internal memory 211 of the display controller 1210 are made to synchronize with each other (step S1210), and the display controller 1210 progresses to step S1211. Thereby, the consistency between the tag part stored on the internal memory 401 of the microcontroller 400 and the tag part stored on the internal memory 211 of the display controller 1210 is maintained. Here, this step S1210 can be executed via the SoC 1200.
In step S1211, the updating unit 114 being a process of the display controller 1210 reads out the preprocessed update-data registered on the preprocess cache, and executes a update-process to the display unit 1240 (step S1211). After that, the display controller 1210 finishes this operation.
Here, when the display unit 1240 is set to a standby mode while the screen of the display unit 1240 is black out after completion of the update-process, the power manager 115 powers off the display unit 1240 and the display controller 1210 using the power control device 150B. When the internal memory 211 of the display controller 1210 is a non-volatile memory, cached data is maintained even if the display controller 1210 is powered off. On the other hand, when a volatile memory is used for the internal memory 211, it is possible that data on the internal memory 211 is forwarded to the display dedicated memory 1220 and the display dedicated memory 1220 is set to a power-saving mode capable of maintaining contents thereon, that the internal memory 211 is set to the power-saving mode capable of maintaining the contents thereon, or that only the internal memory is supplied power.
In the twelfth embodiment, although the consistency between the tag part in the microcontroller 400 and the tag part in the display controller 1210 is maintained in step S1210, when update-process to be cached are limited to a plurality of specific preprocessed update-data IDs, it is possible to omit step S1210 by previously arranging the IDs to the data processing device 12.
As the twelfth embodiment, the configuration in that the internal memory 104 of the SoC 100 is used as the preprocess cache according to the third embodiment is not limited to the data processing device 4 according to the fourth embodiment, it is also possible to apply the configuration to a smartphone, a tablet PC, a cell phone, or the like, which has a general display such as a LCD. The preprocess in such case includes a rendering process and an update-data creating process for creating a screen to be displayed. A value registered on the preprocess cache may be a content of a frame buffer, which is a result of the preprocess.
Furthermore, in the configuration of the thirteenth embodiment, as the sixth embodiment, it is possible to speed up the restore process from the suspended state in hibernation. In such case, before transiting to the standby mode with low power consumption, the preprocessed update-data to be displayed after resuming may be stored on the preprocess cache on the internal memory 104.
Moreover, in the above-described embodiment, as shown in
While a certain embodiment has been described, this embodiment has been presented by way of example only, and is not intended to limit the scope of the inventions. Indeed, the novel embodiment described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiment described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2013-040169 | Feb 2013 | JP | national |
This application is a continuation of U.S. application Ser. No. 14/190,411, filed on Feb. 26, 2014, now allowed, and claims the benefit of priority from the Japanese Patent Application No. 2013-040169, filed on Feb. 28, 2013; the entire contents of which are incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 14190411 | Feb 2014 | US |
| Child | 15451638 | US |
