Embodiments described herein relate generally to a display processing device, a display processing method, and a computer program.
The popularization of mobile terminals, such as smartphones, increases opportunities to browse content data such as document data on small screens of the mobile terminals. When the whole of document data is displayed within such a small screen, characters are often displayed too small to read. Thus, in general, users browse the document data by displaying a partial area of the document data and scrolling the document data on the screen. When a row of a document fails to be fully displayed within the screen, scrolling from the end of the row to the beginning of the next row is required row by row, thereby increasing the user's burden due to scrolling operation and shifting of the visual line.
According to an embodiment, a display processing device includes a reader and a display controller. The reader is configured to read content data that is to be displayed on a display. The display controller is configured to display, on the display, virtual content data in which one end of a display target area of the content data and the other end opposite to the one end of the display target area are connected, when a width of the display target area is larger than a width of the display.
The display 11 displays content data. The content data includes documents, pictures, and diagrams. Hereinafter, data including a document (characters) is described as “document data”. The document data may include diagrams besides the document. The display 11 is a liquid crystal display, for example. The storage 12 stores therein system data such as a program and user data such as the document data. The reader 13 reads the document data and document layout data. The document layout data indicates a layout of the document data when the document data is displayed on a screen. Any data format of the document layout data that can manage the layout of the document data displayed on the screen is usable. For example, the document layout data is text data. The analyzer 14 analyzes the document layout of the document data using the document layout data. The document layout data analyzed by the analyzer 14 may be produced by the display processing device 10 or may be acquired from other devices as already produced document layout data.
The analyzer 14 may analyze whether sentences are written horizontally or vertically using information other than the document layout data. For example, the analyzer 14 may use language identification information, font type, or landscape/portrait identification information included in the content data. The language identification information indicates, for example, of which country the language is. The analyzer 14 may use a default setting when no information is available for analyzing whether sentences are written horizontally or vertically. An example of the default setting is a setting for the display processing device 10 to perform display control when the document includes horizontally written sentences.
Referring back to
The first display controller 17 performs control when the number of pixels in the horizontal width of the display 11 is larger than the number of pixels in the horizontal width of a display target area of the document data, and the document included in the document data is written horizontally. The first display controller 17 displays, on the display 11, first virtual document data in which the right end and the left end of the document data, when the document data is displayed on the display 11, are connected.
The second display controller 18 performs control when the number of pixels in the vertical width of the display 11 is larger than the number of pixels in the vertical width of the display target area of the document data, and the document included in the document data is written vertically. The second display controller 18 displays, on the display 11, second virtual document data in which the top and the bottom of the document data, when the document data is displayed on the display 11, are connected.
The display processing device 10 in the first embodiment performs the display control by the two display controllers of the first display controller 17 and the second display controller 18. The first display controller 17 and the second display controller 18 may be achieved by a single display controller.
The following describes a scrolling method performed by the display processing device 10 in the first embodiment when the document data is browsed. The display processing device 10 in the first embodiment has a connection display mode that reduces the user's burden besides a normal display mode in which the document data is displayed without any change in style (no change is performed except for magnification and reduction). In the connection display mode, a virtual display is performed in such a manner that both end sides of the document data when the document data is displayed are connected to each other. The connection display mode has a right-left connection mode and a top-bottom connection mode. For clearly describing the difference in scrolling method between the display processing device in the first embodiment and conventional display processing devices, the following description is made about the scrolling method of an exemplary conventional display processing device.
The conventional display processing device displays the left-column area in accordance with the user's operation to designate a display area (to designate the left-column area to a sentence area of interest) (step S1). The conventional display processing device displays in such a manner that the width of the sentence area of interest fits the screen. The conventional display processing device magnifies the display of the sentence area of interest in accordance with the user's operation to magnify the sentence area of interest (step S2). In
The following describes a scrolling method performed by the display processing device 10 in the first embodiment when the document data is browsed.
In the right-left connection mode, when the scrolling is further performed from left to right in the state illustrated in (c) in
The analyzer 14 analyzes, from the document layout data, the document layout when the document data is displayed on the display 11 (step S120). The analyzer 14 extracts, on the basis of the document layout data, a title, paragraphs of sentences, and diagrams in a unit regarding them as collective components, and obtains the positions and the sizes of the respective components. The analyzer 14 identifies the types of respective components and further extracts relevant information. When the component includes sentences, the analyzer 14 extracts, for each row, the length and the height of the row, the character row direction, the reading order, and the positions and sizes of respective characters included in the row.
The display processing device 10 (the first display controller 17 or the second display controller 18) determines a scale such that the whole of the document data is displayed on the display 11 (step S130). The first display controller 17 performs the display control when the document is written horizontally. The second display controller 18 performs the display control when the document is written vertically. The display processing device 10 (the first display controller 17 or the second display controller 18) displays the document data in accordance with the display mode (step S140). When the processing proceeds from step S130 to step S140, the display processing device 10 displays the whole of the document data in the normal display mode. When displaying the whole of the document data, the display processing device 10 may display, together with the image, layout information obtained by the analysis of the document layout data. The layout information is a frame (rectangle) that clearly indicates the collective components including paragraphs of sentences or diagrams, for example.
After the processing proceeds from step S130 to step S140, the display processing device 10 (the first display controller 17 or the second display controller 18) performs processing in accordance with the user's operation (command). The user's operation using the display processing device 10 in the first embodiment includes designating the sentence area of interest (step S150), canceling the sentence area of interest (step S160), magnifying or reducing the displayed document data (step S170), scrolling the display (step S180), and ending the display (step S190).
The unit through which the user performs operation (the operation unit 15) may be any unit such as a keyboard, a stylus pen, a button, a mouse, or a touch panel. The display processing device 10 in the first embodiment may be a mobile terminal including a touch panel that functions as both of the display 11 and the operation unit 15, for example. In such a mobile terminal, the display content can be scrolled by sliding a finger over the touch panel.
The following describes the designation of the sentence area of interest (step S150). When the operation unit 15 receives the designation of the sentence area of interest from the user, the display processing device 10 (the first display controller 17 or the second display controller 18) determines a scale such that the sentence area of interest is displayed (step S151). When the sentences in the sentence area of interest are written horizontally, the first display controller 17 determines a scale such that the horizontal widths of the rows of the document fit the horizontal width of the screen of the display 11, and then the processing returns to step S140, at which the first display controller 17 displays the document data. When the sentences are written vertically, the second display controller 18 determines a scale such that the vertical widths of the rows of the document fit the vertical width of the screen of the display 11, and then the processing returns to step S140, at which the second display controller 18 displays the document data.
When the operation unit 15 receives the user's operation to cancel the sentence area of interest while the sentence area of interest is designated (step S160), the display processing device 10 in the first embodiment displays an initial state (displays the whole of the document data and the layout information). The display processing device 10 (the first display controller 17 or the second display controller 18) determines a scale such that the whole of the document data is displayed on the display 11 (step S161). The processing returns to step S140, at which the display processing device 10 (the first display controller 17 or the second display controller 18) displays the document data.
The operation unit 15 receives the user's operation to magnify or reduce the display (step S170). The magnification operation is performed by spreading two fingers apart on the touch panel, for example. The display processing device 10 (the first display controller 17 or the second display controller 18) renews the scale in accordance with the distance between the two spread fingers (step S171). The display processing device 10 (the first display controller 17 or the second display controller 18), then, sets the display mode (the normal display mode, the right-left connection mode, or the top-bottom connection mode) (step S172). The processing at step S172 is described later in detail. The processing returns to step S140, at which the display processing device 10 (the first display controller 17 or the second display controller 18) displays the document data in accordance with the display mode.
The operation unit 15 receives the user's operation to scroll the display (step S180). The scrolling operation is performed by sliding a finger over the touch panel so as to scroll the display, for example. The display processing device 10 (the first display controller 17 or the second display controller 18) renews a shift amount (movement amount) of the document data in accordance with the movement amount of the finger (step S181). The display processing device 10 (the first display controller 17 or the second display controller 18) moves the document data in the direction opposite to the movement direction of the finger. The processing returns to step S140, at which the display processing device 10 (the first display controller 17 or the second display controller 18) displays the document data in accordance with the shift amount and the display mode.
When the operation unit 15 receives the user's operation to end the display (step S190), the display processing device 10 (the first display controller 17 or the second display controller 18) ends the display processing.
The display processing device 10 determines whether the sentence area of interest is set (step S20). If the sentence area of interest is set (Yes at step S20), the processing proceeds to step S21. If no sentence area of interest is set (No at step S20), the processing ends without renewing the display mode. The display processing device 10 determines whether the sentences in the sentence area of interest are written horizontally (step S21). If the sentences are written horizontally (Yes at step S21), the processing proceeds to step S22. If the sentences are not written horizontally (are written vertically) (No at step S21), the processing proceeds to step S25.
The first display controller 17 determines whether the number of pixels in the horizontal width of the sentence area of interest is larger than the number of pixels in the horizontal width of the display 11 (step S22). If the number of pixels in the horizontal width of the sentence area of interest is larger than the number of pixels in the horizontal width of the display 11 (Yes at step S22), the first display controller 17 changes the display mode to the right-left connection mode (step S23). If the number of pixels in the horizontal width of the sentence area of interest is equal to or smaller than the number of pixels in the horizontal width of the display 11 (No at step S22), the first display controller 17 changes the display mode to the normal display mode (step S24).
The second display controller 18 determines whether the number of pixels in the vertical width of the sentence area of interest is larger than the number of pixels in the vertical width of the display 11 (step S25). If the number of pixels in the vertical width of the sentence area of interest is larger than the number of pixels in the vertical width of the display 11 (Yes at step S25), the second display controller 18 changes the display mode to the top-bottom connection mode (step S26). If the number of pixels in the vertical width of the sentence area of interest is equal to or smaller than the number of pixels in the vertical width of the display 11 (No at step S25), the second display controller 18 changes the display mode to the normal display mode (step S24).
The following describes an example of an algorithm to achieve the display mode in the display processing device 10 in the first embodiment.
The display mode is defined as draw_mode. The display mode is any one of the normal display mode defined as NORMAL_MODE, the right-left connection mode defined as LR_CONNECT_MODE, and the top-bottom connection mode defined as TB_CONNECT_MODE.
The display of a value of the pixel at coordinates (I, J) in the sentence area of interest on the pixel at coordinates (i, j) on the display screen is expressed as “SCREEN(i, j)←IMAGE(I, J)”. When the coordinates (I, J) are outside the image, a background color (e.g., black) is displayed.
A function f(k, wh) is defined as follows.
function f(k, wh){while (k<0) k←k+wh, while (k>wh) k←k−wh, return k}
In this case, SCREEN(i, j) is achieved as follows.
As described above, the display processing device 10 in the first embodiment can further reduce the user's burden due to shifting of the visual line and the scrolling operation than those caused by the conventional display processing device 10.
The display processing device 10 in the first embodiment performs the display processing method on the basis of that the content data is the document data and whether the document is written horizontally or vertically. The display processing may, however, be performed without determining whether the document is written horizontally or vertically. For example, as a modification of the display processing device 10 in the first embodiment, when the number of pixels in the width, which corresponds to the width of the display 11, of a display target area of content data is larger than the number of pixels in the width of the display 11, virtual content data may be displayed on the display 11. In the virtual content data, one end of the width, which corresponds to the width of the display 11, of the display target area and the other end opposite the one end of the width, which corresponds to the width of the display 11, of the display target area are connected. When such display control is performed, the control performed by the first display controller 17 and the second display controller 18 may be achieved by a single display controller.
As another modification of the display processing device 10 in the first embodiment, a connection display mode in which virtual content data is displayed and the normal display mode in which the content data is displayed without any change may be switched on the basis of a certain condition. The certain condition is any or a combination of the content of the content data, the document layout data of the content data, information about the user's operation, and setting of the display processing device 10. The virtual content data corresponds to the first virtual document data or the second virtual document data in the first embodiment. For example, the first display controller 17 may display the content data without any change in accordance with the user's operation even though the condition is satisfied to display the first virtual document data on the display 11.
The following describes the display processing device 10 according to a second embodiment. The functional block of the display processing device 10 in the second embodiment is the same as that of the display processing device 10 in the first embodiment, and the detailed description thereof is, thus, omitted. The display processing device 10 in the second embodiment differs from the display processing device 10 in the first embodiment in display of the connection display mode (the right-left connection mode and the top-bottom connection mode).
When the document in the document data is written vertically, the second display controller 18 produces the second virtual document data such that the sentence of the nth column (n is an integer equal to or larger than one) at the bottom and the (n+1)th column at the top are connected when the bottom and the top are connected, and displays the produced second virtual document data.
As described above, the display processing device 10 in the second embodiment can further reduce the user's burden due to shifting of the visual line and the scrolling operation than those caused by the display processing device 10 in the first embodiment.
The following describes the display processing device 10 according to a third embodiment. The functional block of the display processing device 10 in the third embodiment is the same as that of the display processing device 10 in the first embodiment, and the detailed description thereof is, thus, omitted. The display processing device 10 in the third embodiment further takes into consideration the display control when the document data includes a plurality of document blocks besides the display control performed by the display processing device 10 in the first embodiment.
The first display controller 17 produces first virtual document block data in which the bottom of the Nth (N is an integer equal to or larger than one) document block and the top of the (N+1)th document block are connected (step S31). A method for determining the order of the document blocks included in the document data may be appropriately determined. For example, when the sentences in the document blocks are written horizontally, the order of the document blocks may be determined on the basis of the coordinates of the upper left corners of the respective document block areas. The first display controller 17 determines whether the number of pixels in the horizontal width of the sentence area of interest is larger than the number of pixels in the horizontal width of the display 11 (step S32). If the number of pixels in the horizontal width of the sentence area of interest is larger than the number of pixels in the horizontal width of the display 11 (Yes at step S32), the first display controller 17 changes the display mode to the right-left connection mode, and displays the first virtual document block data (step S33). If the number of pixels in the horizontal width of the sentence area of interest is equal to or smaller than the number of pixels in the horizontal width of the display 11 (No at step S32), the first display controller 17 changes the display mode to the normal display mode, and displays the first virtual document block data (step S34).
The second display controller 18 produces second virtual document block data in which the left end of the Nth (N is an integer equal to or larger than one) document block and the right end of the (N+1)th document block are connected (step S35). A method for determining the order of the document blocks included in the document data may be appropriately determined. For example, when the sentences in the document blocks are written vertically, the order of the document blocks may be determined on the basis of the coordinates of the upper right corners of the respective document block areas. The second display controller 18 determines whether the number of pixels in the vertical width of the sentence area of interest is larger than the number of pixels in the vertical width of the display 11 (step S36). If the number of pixels in the vertical width of the sentence area of interest is larger than the number of pixels in the vertical width of the display 11 (Yes at step S36), the second display controller 18 changes the display mode to the top-bottom connection mode, and displays the second virtual document block data (step S37). If the number of pixels in the vertical width of the sentence area of interest is equal to or smaller than the number of pixels in the vertical width of the display 11 (No at step S36), the second display controller 18 changes the display mode to the normal display mode, and displays the second virtual document block data (step S38).
The following describes a specific example of the first virtual document block data.
The following describes a specific example of the second virtual document block data.
The following describes a case where the shape of the document block of the document data is not a rectangle. The following description is based on a case where the sentences in the document block are written horizontally.
The screen of the display 11 is described.
The first display controller 17 produces the first virtual document block data using, as a unit area of connection, the rectangle circumscribing the Nth document block and the (N+1)th document block. The first display controller 17 sets the Nth document block to the left end of the unit area. The first display controller 17 displays a background color on the area in which neither the Nth document block nor the (N+1)th document block is provided in the unit area. Any color such as black or gray may be used as the background color. The first display controller 17 displays the document blocks in the normal display mode when the horizontal width of the first virtual document block data in
The first display controller 17 produces the first virtual document block data using, as a unit area of connection, the rectangle circumscribing the Nth document block and the (N+1)th document block. The first display controller 17 sets the (N+1)th document block to the left end of the unit area. The first display controller 17 displays a background color on the area in which neither the Nth document block nor the (N+1)th document block is provided in the unit area. Any color such as black or gray may be used as the background color. The first display controller 17 displays the first virtual document block data in
The first display controller 17 produces the first virtual document block data using, as a unit area of connection, the rectangle circumscribing the Nth document block and the (N+1)th document block. The first display controller 17 sets the (N+1)th document block to the right end of the unit area. The first display controller 17 displays a background color on the area in which neither the Nth document block nor the (N+1)th document block is provided in the unit area. Any color such as black or gray may be used as the background color. The first display controller 17 displays the first virtual document block data in
The second display controller 18 produces the second virtual document block data using, as a unit area of connection, the rectangle circumscribing the Nth document block and the (N+1)th document block. The second display controller 18 sets the Nth document block to the top of the unit area. The second display controller 18 displays a background color on the area in which neither the Nth document block nor the (N+1)th document block is provided in the unit area. Any color such as black or gray may be used as the background color. The second display controller 18 displays the document blocks in the normal display mode when the vertical width of the second virtual document block data in
The second display controller 18 produces the second virtual document block data using, as a unit area of connection, the rectangle circumscribing the Nth document block and the (N+1)th document block. The second display controller 18 sets the (N+1)th document block to the top of the unit area. The second display controller 18 displays a background color on the area in which neither the Nth document block nor the (N+1)th document block is provided in the unit area. Any color such as black or gray may be used as the background color. The second display controller 18 displays the second virtual document block data in
The second display controller 18 produces the second virtual document block data using, as a unit area of connection, the rectangle circumscribing the Nth document block and the (N+1)th document block. The second display controller 18 sets the (N+1)th document block to the bottom of the unit area. The second display controller 18 displays a background color on the area in which neither the Nth document block nor the (N+1)th document block is provided in the unit area. Any color such as black or gray may be used as the background color. The second display controller 18 displays the second virtual document block data in
As described above, the display processing device 10 in the third embodiment can reduce the user's burden due to shifting of the visual line and the scrolling operation even when a plurality of document blocks are displayed on the display 11.
The control device 31 executes a program read in the main storage device 32 from the auxiliary storage device 33. The main storage device 32 is a memory such as a read only memory (ROM) or a random access memory (RAM). The auxiliary storage device 33 is a memory card, for example. The input device 35 is an interface through which the display processing device 10 is operated. The communication device 34 is an interface that connects the display processing device 10 to a network.
The program executed by the display processing device 10 in the first to the third embodiments may be recorded on a computer-readable storage medium such as a compact disc read only memory (CD-ROM), a flexible disk (FD), a compact disc recordable (CD-R), and a digital versatile disc (DVD), as an installable or executable file, and provided as a computer program product. The program executed by the display processing device 10 in the first to the third embodiments may be stored in a computer connected to a network such as the Internet, and be provided by downloading the program via the network. The program executed by the display processing device 10 in the first to the third embodiments may be provided or distributed via a network such as the Internet. The program executed by the display processing device 10 in the first to the third embodiments may be embedded and provided in a ROM, for example.
The program executed by the display processing device 10 in the first to the third embodiments has a module structure including the functional blocks achievable by the program out of the functional blocks illustrated in
As described above, the display processing device 10 including the first display controller 17 and the second display controller 18 in the first to the third embodiments can further reduce the user's burden due to shifting of the visual line and scrolling operation than the burden caused by the conventional display processing device 10.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
This application is a continuation of International Application No. PCT/JP2013/055558, filed on Feb. 28, 2013, the entire contents of which are incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2013/055558 | Feb 2013 | US |
| Child | 14837193 | US |