This application is related to and claims priority under 35U.S.C §119(a) on Japanese Patent Application No. 2007-26860 filed on Feb. 6, 2007 in the Japan Patent Office, and incorporated by reference herein.
1. Field of the Invention
The present invention relates to a display apparatus for displaying an image in which characters are written, and a display program.
2. Description of the Related Art
Information which has been conventionally handwritten on paper is gradually inputted to a personal computer or the like with the use of a keyboard or the like and used as digital electronic data. For example, in hospitals, medical records in which patients' conditions are recorded have been replaced with digital electronic medical records. A purchase order document used for ordering a product and an order acceptance document for accepting an order of a product have also been digitalized. By handling information as digital electronic data, it becomes easy to store and copy the data. Furthermore, there is an advantage that the data can be shared via a network even if users stay at places apart from one another.
However, there are a lot of people who find it difficult to input information with the use of the keyboard of a personal computer among those who are familiar with handwriting information on paper. In consideration of this problem, an input device is known which, when a user performs drawing on the display screen of a personal computer or on a special tablet with a pen or a fingertip, detects the drawing position and acquires the contents of the drawing. According to such an input device, those who are not familiar with a keyboard can easily input information. Furthermore, additional processings, such as writing characters on an image and writing characters at a desired position, can be easily performed. Recently, a pen-input type input device has been widely applied to systems such as an electronic medical record system in which electronic medical records are inputted and managed together with patients' medical images, a delivery management system in which centralized management of the delivery state is performed by having a customer input a signature in exchange for goods, and a reception system in which visitor information and points in telephone responses are inputted to manage schedules and the like.
When multiple pieces of information are to be collectively confirmed, the pieces of information are displayed on a screen as a list. In the input device described above, it is common that characters and images written or drawn on the screen are collectively converted to an image, and page data indicating a page is generated with the whole screen as one page. Therefore, in order to execute the list display, multiple pages indicated by the respective multiple page data are arranged and displayed after being reduced. However, characters are written in each page with various sizes and thicknesses. Therefore, if the pages are reduced with the same reduction rate, a problem is caused in that small characters and thick characters are broken and the contents or description cannot be understood.
In consideration of this point, Japanese Patent Laid-Open No. 11-219260 discloses a technique for displaying each page by eliminating spaces where a character or an image is not written or drawn on the page. Japanese Patent Laid-Open No. 06-121151 discloses a technique for detecting the density of pixels in each page and judging whether or not characters are broken when reduced. By applying the techniques described in the above-mentioned patent documents to reduce each page, breakage of characters can be reduced.
According to an aspect of an embodiment, a display apparatus includes an image acquisition part which acquires image data of a page on which characters are written. An image reduction part reduces the image data of the page at a predetermined reduction rate, and an image display part displays the image data reduced by the image reduction part. A complexity degree calculation part analyzes an image structure of the image data by characters in the image data, and calculates a complexity degree on which a complexity of the image structure is reflected. A reduction control part determines the reduction rate for the image reduction by the image reduction part so that the complexity degree before the reduction is kept to a predetermined extent even after the reduction.
An embodiment of the present invention will be described below with reference to drawings.
A personal computer 10 shown in
The personal computer 10 is provided with a first unit 20 and a second unit 30. The first unit 20 and the second unit 30 are coupled with each other via a biaxial coupling part 40 so that the second unit 30 can be freely opened and closed from and over the first unit 20 in the arrow A-A direction and can freely turn in the arrow B-B direction (around a perpendicular turning axis).
The first unit 20 is provided with a keyboard 21, a trackpad 22, a left click button 23, a right click button 24, and a latch unit 25 which latches the second unit 30 when the second unit 30 is closed. The latch unit 25 is provided with a latch hole 25a into which a stopper on the second unit 30 side is inserted and a latch release button 25b which releases the latching state of the stopper inserted in the latch hole 25a. On the external surface of the side face of the first unit 20, there is an openable and closable cover 26a of an optical disk drive 26 in which an optical disk such as a CD and a DVD is mounted and which drives and accesses the optical disk. The openable and closable cover 26a of the optical disk drive 26 is provided with an eject button 26b which causes the openable and closable cover 26a to open by being pressed.
Over the front of the second unit 30 of the personal computer 10, the display screen 31 spreads. The second unit 30 is provided with some pushbuttons 32 below the display screen 31. Above the display screen 31 of the second unit 30, there is provided a stopper unit 33 equipped with a stopper to be latched with the latch unit 25 of the first unit 20 when the second unit 30 is closed. The stopper unit 33 is provided with two stoppers. In the example of
In
When the second unit 30 is closed in the arrow A direction in the normal state shown in
The second unit 30 can be turned so that the display screen 31 faces to the opposite side of the keyboard 21 after this state.
The second unit 30 is further turned so that the display screen 31 faces to the opposite side of the keyboard 21 after the position shown in
As described above, the display screen 31 is equipped with a pen input function for detecting contact by or a close position of a pen. Commonly, the personal computer 10 in this tablet mode is used by keeping it in one arm and operating the display screen with a pen (not shown) in the other hand. Because of the relationship with the line of sight when the personal computer 10 in the tablet mode is kept in the arm, the direction of a display image on the display screen 31 is turned by 90° in comparison with the normal state shown in
On the second unit 30 of the personal computer 10 in the tablet mode shown in
Now, the internal configuration of the personal computer 10 will be described.
As shown in
In the CD-ROM 210, there is stored an input/display program 300 to which an embodiment of the display program of the present invention and an embodiment of the input/display program of the present invention are applied. The CD-ROM 210 is mounted in the CD/DVD drive 109, and the input/display program 300 stored in the CD-ROM 210 is uploaded to the personal computer 10 and stored in the hard disk device 103. By the display program being activated and executed, an input/display device 400 (see
Next, description will be made on the input/display program 300 executed in this personal computer 10.
The input/display program 300 causes a computer to execute an input acceptance procedure 301, an image acquisition procedure 302, a size analysis procedure 303, a character classification procedure 304, a complexity degree calculation procedure 305, an extra space judgment procedure 306, a writing amount calculation procedure 307, an image reduction procedure 308, an image display procedure 309, an instruction procedure 310 and a reduction control procedure 311. The details of each procedure of the input/display program 300 will be described together with the operation of each part of the input/display device 400.
Though the CD-ROM 210 is shown as an example of the storage medium in which the input/display program 300 is stored, the storage medium in which the display program and the input/display program of the present invention are stored is not limited to a CD-ROM. Storage media other than a CD-ROM, such as an optical disk, an MO, an FD and a magnetic tape, are also possible. Furthermore, the display program and input/display program of the present invention may be directly provided for the computer, not via a storage medium but via a communication network.
The input/display device 400 shown in
Each component in
Hereinafter, by describing each component of the input/display device 400 shown in
The tablet 107 shown in
The image acquisition part 402 acquires the page image data generated by the input acceptance part 401. The image acquisition part 402 corresponds to an example of the image acquisition part stated in the present invention.
The size analysis part 403 analyzes the sizes of the characters included in the page image. The size analysis part 403 corresponds to an example of the size analysis part stated in the present invention.
The character classification part 404 acquires the character sizes analyzed by the size analysis part 403, and classifies the characters included in the page image data into multiple groups. The character classification part 404 corresponds to an example of the character classification part stated in the present invention.
The image reduction part 408 reduces the page image data with a predetermined reduction rate. When an instruction to suppress the reduction rate is communicated from the reduction control part 411, the image reduction part 408 reduces the page image with a suppressed reduction rate in accordance with the instruction. The image reduction part 408 corresponds to an example of the image reduction part stated in the present invention.
The extra space judgment part 406 judges whether there is an extra space or not when the reduced page image reduced by the image reduction part 408 is arranged on the display screen 31. The extra space judgment part 406 corresponds to an example of the extra space judgment part stated in the present invention.
When it is judged by the extra space judgment part 406 that there is an extra space, the writing amount calculation part 407 determines the total writing amount of the characters included in the page image. The writing amount calculation part 407 corresponds to an example of the writing amount calculation part stated in the present invention.
On the basis of the original page image before reduction and the reduced page image after reduction, the complexity degree calculation part 405 determines a complexity degree indicating the complexity of the images of characters in the page images. The complexity degree calculation part 405 corresponds to an example of the complexity degree calculation part stated in the present invention.
The reduction control part 411 adjusts the reduction rate used for reduction of the page image by the image reduction part 408, on the basis of the complexity degree, presence or absence of an extra space, the total writing amount of characters determined by the complexity degree calculation part 405, the extra space judgment part 406 and the writing amount calculation part 407, respectively. The reduction control part 411 corresponds to an example of the reduction control part stated in the present invention.
The hard disk device 103 shown in
The keyboard 21, the trackpad 22, the left click button 23 and the right click button 24 play the role of the instruction part 410, and the instruction part 410 inputs an instruction in response to a user operation. The input/display device 400 of this embodiment is equipped with a list display function of displaying multiple page images stored in the storage part 412 as a list. When the user specifies an icon prepared in the input/display device 400 in advance and displayed, with a fingertip or a pen, an instruction to execute display of a list is inputted to the input/display device 400.
The image display part 409 displays the original page image before reduction or the reduced page image reduced by the image reduction part 408, on the display screen 31. The image display part 409 corresponds to an example of the image display part stated in the present invention.
The input/display device 400 is basically configured as described above.
Description will be made below on the flow of the series of processings for displaying a list of page images in the input/display device 400 in accordance with
When a user selects an icon for “tablet PC” prepared in advance, with the use of the trackpad 22 or the like of the personal computer 10 shown in
When the user specifies an icon for “list display” prepared on the display screen 31 of the personal computer 10 in advance, an instruction to execute display of a list is instructed from the instruction part 410 to the image acquisition part 402.
The image acquisition part 402 acquires all the page image data stored in the storage part 412, and the page image data is communicated to the size analysis part 403, the extra space judgment part 406, the complexity degree calculation part 405 and the image reduction part 408.
The image reduction part 408 temporarily reduces the page image data communicated from the image acquisition part 402 with a predetermined reduction rate (operation S2 in
When the page images are temporarily reduced, breakage of the characters in the temporarily reduced page images is detected on the basis of the original page images and the temporarily reduced page images, and the reduction rate is adjusted in accordance with the detection result (operation S3 in
When the reduction rate adjustment processing is executed, the size analysis part 403 shown in
The character classification part 404 classifies the characters detected by the size analysis part 403 into multiple groups according to the sizes (operation S12 in
In
When acquiring the classification result from the character classification part 404, the reduction control part 411 sets the characters classified into the high frequency group A including characters with relatively high appearance frequency sizes (operation S13 in
Furthermore, the reduction control part 411 determines, on the basis of the character sizes communicated from the size analysis part 403 and a predetermined minimum character size, such a critical reduction rate of the page image that the sizes of the characters targeted by the complexity degree calculation are not smaller than the minimum character size (operation S15 in
The processings described above are executed by the size analysis part 403, the character classification part 404 and the reduction control part 411.
Now, processings executed by the complexity degree calculation part 405, the image reduction part 408 and the reduction control part 411 will be described.
The complexity degree calculation part 405 first determines, on the basis of the original page image data communicated from the image acquisition part 402, a complexity degree indicating the complexity of the image structure of the characters in the page image (operation S21 in
In this embodiment, the complexity degree calculation part 405 divides the page image data into multiple pixel areas, and horizontal-direction scanning is performed for each character in the page image data to check the presence or absence of drawing in each pixel area. The number of changes in the state of drawing is determined as the complexity degree. In the example shown in
The complexity degree calculation part 405 determines, on the basis of the temporarily reduced page image sent from the image reduction part 408, the complexity degree of each of the characters set as characters targeted by the complexity degree calculation in the temporarily reduced page image (operation S22 in
In this embodiment, the complexity degree is determined similarly to operation S21, on the basis of a temporarily reduced page image obtained by reducing a page image in the horizontal direction at a temporary reduction rate. In
The reduction control part 411 compares the complexity degree of each character in the original page image and the complexity degree of the character in the temporarily reduced page image with each other. If the degree of the change in the complexity degree is a predetermined degree (in this embodiment, 50% of the complexity degree in the original page image) or higher (operation S23 in
When receiving the enlargement instruction from the reduction control part 411, the image reduction part 408 changes the reduction rate so that the temporarily reduced page image becomes a little larger (operation S24 in
The complexity degree calculation part 405 determines the complexity degree of the characters in the new temporarily reduced page image (operation S22 in
The image reduction part 408 generates a new temporarily reduced page image from the original page image data, with the temporary reduction rate suppressed by a predetermined rate ( 1/15 added, in this example). The complexity degree calculation part 405 calculates the complexity degree of the characters in the new temporarily reduced page image. Then, the reduction control part 411 compares the complexity degree of the characters in the new temporarily reduced page image and the complexity degree of the characters in the original page image with each other. The series of processings is continued until the difference between the complexity degree of the characters in the original page image and the complexity degree of the characters in the temporarily reduced page image becomes less than a predetermined degree (in this embodiment, 50% of the complexity degree in the original page image).
When the difference between the complexity degree of each character in the temporarily reduced page image and that of the character in the original page image becomes less than the predetermined degree (operation S23 in
By the processings as described above being executed for each of all the page images stored in the storage part 412, the reduction rate of each page image is determined. By applying the reduction rate determined in this way, each page image can be reduced to a size which enables recognition of the characters in the page image and displayed. In this embodiment, the reduction rate is further adjusted so that the characters included in each page image can be displayed as large as possible.
In this embodiment, the complexity degree is calculated by scanning a page image in the horizontal direction. However, by scanning the page image in the vertical direction also to calculate the complexity degree, and checking change in the complexity degree in both the horizontal and vertical directions to judge the degree of breakage of the characters, the breakage judgment accuracy can be improved. In this case, for example, a reduced image obtained by reducing a page image in the horizontal direction is scanned in the horizontal direction, and, if the ratio of the number of such lines that the degree of change in the complexity degree is a predetermined degree (for example, 50% of the complexity degree of the original page image) or below to the number of all the lines is a predetermined ratio (for example, 80%) or higher, it is judged that breakage has not occurred. Subsequently, as for the vertical direction also, a reduced image obtained by reducing the page image in the vertical direction may be scanned in the vertical direction similarly. If the ratio of the number of such lines that the degree of change in the complexity degree is a predetermined degree (for example, 50% of the complexity degree of the original page image) or lower to the number of all the lines is a predetermined ratio (for example, 80%) or higher, it is judged that breakage has not occurred.
The extra space judgment part 406 acquires the size of the display area of the display screen 31 shown in
The image reduction part 408 reduces all the page images communicated from the image acquisition part 402 with the reduction rate determined for each page image by the reduction control part 411 (operation S32 in
The extra space judgment part 406 arranges all the reduced page images communicated from the image reduction part 408 together on the area having the size acquired at operation S31 (operation S33 in
If it is judged that there is an extra space (operation S34 in
The writing amount calculation part 407 acquires all the original page images from the image acquisition part 402 and, for each of all the page images, calculates the writing amount of the characters in the page image (operation S35 in
In this embodiment, the drawing area in which characters and images are drawn relative to the whole area of each page image is calculated as a writing amount. In
The writing amount calculated by the writing amount calculation part 407 is communicated to the reduction control part 411.
The reduction control part 411 judges, for each of all the page images to be displayed as a list, whether or not the writing amount calculated by the writing amount calculation part 407 exceeds a predetermined writing amount. If there is a page image with a writing amount exceeding the predetermined writing amount (operation S36 in
If there is not a page image with a writing amount exceeding the predetermined writing amount (operation S36 in
For each of all the page images, if a new reduced page image is generated, the image reduction part 408 communicates the new reduced page image to the image display part 409. As for a page image for which a new reduced page image is not generated, the reduced page image generated at operation S32 is communicated to the image display part 409.
Returning to
The reduced page images generated as described above are arranged together and displayed by the image display part 409 on the display screen 31 shown in
In this embodiment, as for page images which include a sentence written by small characters, page images with a large writing amount, and the like, the reduction rate is suppressed as shown in
The first embodiment of the present invention has been described. Now, a second embodiment of the present invention will be described. The second embodiment of the present invention has the same configuration as the first embodiment shown in
In the personal computer of this embodiment, lines drawn by a user are sampled and detected as coordinate values on the display screen 31. For example, for a Japanese hiragana character “” shown in
The determined writing amount is communicated to the reduction control part 411 shown in
Thus, by calculating a writing amount on the basis of the length of lines drawn by a user, it is possible to calculate a writing amount based on the number of characters actually written or the complexity of the character structure.
Though description has been made on a tablet PC to which the film resistance method is applied, the character input part stated in the present invention may be such as adopts the electromagnetic induction method, the infrared method, the capacitance method or the like.
Furthermore, though description has been made on an example in which the complexity degree is calculated on the basis of the number of changes between presence and absence of drawing, the complexity degree calculation part stated in the present invention may calculate the complexity degree on the basis of the number of turns of a line by using the fact that the bending parts of a line are omitted when a character is reduced.
Furthermore, though description has been made on an example in which the character-input enabling display apparatus of the present invention is applied to a tablet PC, the character-input enabling display apparatus of the present invention may be applied to an electronic notebook.
Number | Date | Country | Kind |
---|---|---|---|
2007-026860 | Feb 2007 | JP | national |