This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2011-005411 filed Jan. 14, 2011.
The present invention relates to electronic writing devices, electronic writing methods, and computer readable media.
According to an aspect of the invention, there is provided an electronic writing device including a light source, an image sensor, a detecting unit, table information, and a controller. The light source emits light to a recording medium. The image sensor receives the light reflected from the recording medium as image data. The detecting unit detects a light quantity of the image data received by the image sensor. In the table information, a light-quantity range and a control object for the image sensor or the light source are associated with each other. The light-quantity range is segmented into multiple threshold values. The controller controls the operation of the image sensor or the light source, every time the image sensor receives new image data, on the basis of the light quantity of the image data detected by the detecting unit and the table information.
An exemplary embodiment of the present invention will be described in detail based on the following figures, wherein:
An exemplary embodiment of the invention will be described below with reference to the drawings.
In
Examples of the operation modes of the digital pen 1 include a writing mode and an option mode. A writing mode is a mode in which a character or a pattern written with the digital pen 1 is transmitted to the PC 2. An option mode is a mode in which, for example, the controller 11 causes the CMOS image sensor 14 to read a code pattern image from a specific region on the sheet 3 and transmits the code pattern image to the PC 2 via the communication I/F 16. When the switch 18 is pressed, the writing mode or the option mode is alternately set in the controller 11.
The code pattern image is printed in an invisible form on the sheet 3. The code pattern image includes an identification code corresponding to identification information and a positional code corresponding to positional information. The identification information is used for identifying the sheet 3 and is, for example, a serial number. The positional information is used for specifying a position on the sheet 3. For example, the positional information is used for specifying a position on the sheet 3 on the basis of an X-Y coordinate system.
When a user uses the digital pen 1 in the writing mode to write a character or a pattern on the sheet 3, the LED 13 emits infrared light onto the sheet 3, and the CMOS image sensor 14 detects the infrared light reflected from the sheet 3 so as to read the code pattern image. From the read code pattern image, the controller 11 acquires information about the character or the pattern (i.e., positional information) and the identification information, and transmits the information about the character or the pattern and the identification information to the PC 2 via the communication I/F 16.
A tilt angle of the digital pen 1 relative to the sheet 3 varies depending on each user using the digital pen 1. Moreover, the digital pen 1 may be used indoors or outdoors. An output of the code pattern image received by the controller 11 from the CMOS image sensor 14 fluctuates depending on the state and the environment in which the digital pen 1 is used. Therefore, in order for the controller 11 to accurately read the information about the character or the pattern from the code pattern image, such fluctuations in the output of the code pattern image should be minimized. In this exemplary embodiment, the controller 11 adjusts the exposure time of the CMOS image sensor 14, the output gain of the CMOS image sensor 14, or the quantity of light emitted from the LED 13 so as to minimize fluctuations in the output of the code pattern image.
The controller 11 includes an overall control unit 31 corresponding to a detecting unit and a controller, a light-emission control unit 32, a light-reception control unit 33, an image processing unit 34, and a memory 35. The overall control unit 31 controls the light-emission control unit 32, the light-reception control unit 33, and the image processing unit 34 on the basis of signals input from the pressure sensor 12 and the switch 18. Moreover, the overall control unit 31 detects a light quantity of data input from the CMOS image sensor 14. Based on the light quantity of the data input from the CMOS image sensor 14 and table information, to be described later, stored in the memory 35, the overall control unit 31 sets the control object for the LED 13 in the light-emission control unit 32 and sets the control object for the CMOS image sensor 14 in the light-reception control unit 33.
Based on the set control object for the LED 13, the light-emission control unit 32 controls light-emission operation of the LED 13. Based on the set control object for the CMOS image sensor 14, the light-reception control unit 33 controls light-reception operation of the CMOS image sensor 14. Based on a command received from the overall control unit 31, the image processing unit 34 performs image-processing on the data input from the CMOS image sensor 14 and outputs the image-processed data to the communication I/F 16.
The image processing unit 34 includes a binarizing section 34a, a dot detecting section 34b, and a code analyzing section 34c. The binarizing section 34a binarizes and outputs the data input from the CMOS image sensor 14 for each pixel. The dot detecting section 34b detects a dot from the binarized data. The code analyzing section 34c analyzes the code pattern image from an array of detected dots, acquires information, such as the identification information and the positional information, from the analyzed code pattern image, and outputs the acquired information to the communication I/F 16. The information output from the code analyzing section 34c is temporarily stored in the information memory 15, where necessary. The binarizing process performed in the binarizing section 34a, the dot detecting process performed in the dot detecting section 34b, and the code analyzing process performed in the code analyzing section 34c are collectively referred to as a decoding process.
Each cell 40 included in the CMOS image sensor 14 includes a photodiode 41, transistors 42 and 43, a charge-transfer switch 44, a charge-transfer gate 45, reset terminals 46 and 47, a power-source terminal 48, and a charge-storage capacitor 49. Furthermore, each cell 40 also includes a row-selecting transistor 50, a charge-reading transistor 51, a row-selecting terminal 52, an amplifier 53, an output terminal 54, and a constant current source 55. The power-source terminal 48 is connected to the battery 17 (not shown). The charge-transfer gate 45, the reset terminals 46 and 47, and the output terminal 54 are connected to the controller 11 (not shown).
The photodiode 41 performs photoelectric conversion on input light and stores an electric charge. The controller 11 turns the transistor 42 on and off via the reset terminal 46 so as to determine a charge-storage time in the photodiode 41, that is, an exposure time. Furthermore, the controller 11 turns on the charge-transfer switch 44 via the charge-transfer gate 45 so as to store the electric charge into the charge-storage capacitor 49 from the photodiode 41. Moreover, the controller 11 turns the transistor 42 on and off via the reset terminal 47 so as to initialize the charge-storage capacitor 49 after the electric charge has been read therefrom. When a row selection signal is input to the row-selecting transistor 50 via the row-selecting terminal 52, the electric charge stored in the charge-storage capacitor 49 is input to the amplifier 53 as voltage. The amplifier 53 amplifies data in accordance with an output gain value from the controller 11 and outputs the data to the controller 11 via the output terminal 54. The amplifier 53 is not included in each cell 40; instead, a single amplifier 53 is included in the CMOS image sensor 14, as will be described below.
In
The vertical shift register 62 outputs a row selection signal to the row-selecting transistor 50 in each of four cells 40 in the first row when data stored in the cells 40 in the first row are to be read. When data stored in four cells 40 in the second row are to be read, the vertical shift register 62 outputs a row selection signal to the row-selecting transistor 50 in each of the cells 40 in the second row. When data stored in four cells 40 in the third row are to be read, the vertical shift register 62 outputs a row selection signal to the row-selecting transistor 50 in each of the cells 40 in the third row.
In
The vertical shift register 62 outputs row selection signals corresponding to three rows within one frame period. A period from a point at which a row selection signal is output to a point at which a subsequent row selection signal is output corresponds to one period of a horizontal synchronizing signal. Within one period of this horizontal synchronizing signal, the horizontal shift register 61 outputs four column selection signals corresponding to four cells included in a single row to the respective column-selecting transistors 63a to 63d. As a result, data are read from the 12 cells 40 within the reset period.
In
For example, in
For example, in
For example, in
For example, in
As shown in
Referring to
The table information shown in each of
Moreover, for example, the digital pen 1 may include a switch corresponding to a setting unit that sets table information to be used from among multiple pieces of table information stored in the memory 35. This switch is connected to the overall control unit 31. Alternatively, the overall control unit 31 may receive a setting command for setting table information to be used from the PC 2 via the communication I/F 16 and set this table information in the overall control unit 31 itself in response to the setting command.
First, in step S1, the overall control unit 31 causes the light-reception control unit 33 to initialize the CMOS image sensor 14. For example, the CMOS image sensor 14 is reset, and the set value 1 is set in the light-reception control unit 33.
In step S2, the overall control unit 31 detects a light quantity of data from the CMOS image sensor 14. In step S3, the overall control unit 31 determines whether or not the light quantity of the data from the CMOS image sensor 14 is greater than the threshold value 1 for the light quantity included in the table information. If the determination result in step S3 indicates “NO”, the overall control unit 31 sets the set value 1 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S4. The process then returns to step S2.
If the determination result in step S3 indicates “YES”, the overall control unit 31 determines whether or not the light quantity of the data from the CMOS image sensor 14 is greater than the threshold value 2 for the light quantity included in the table information in step S5. If the determination result in step S5 indicates “NO”, the overall control unit 31 sets the set value 2 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S6. The process then returns to step S2.
If the determination result in step S5 indicates “YES”, the overall control unit 31 determines whether or not the light quantity of the data from the CMOS image sensor 14 is greater than the threshold value 3 for the light quantity included in the table information in step S7. If the determination result in step S7 indicates “NO”, the overall control unit 31 sets the set value 3 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S8. The process then returns to step S2. If the determination result in step S7 indicates “YES”, the overall control unit 31 sets the set value 4 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S9. The process then returns to step S2.
The overall control unit 31 executes step S2 to step S9 every time new data (i.e., a new image frame) is input from the CMOS image sensor 14. The light-emission control unit 32 and/or the light-reception control unit 33 in which the set values are set in steps S4, S6, S8, and S9 control/controls at least one of the exposure time of the CMOS image sensor 14, the gain of the CMOS image sensor 14, the amount of electric current supplied to the LED 13, and the light-emission time of the LED 13 in accordance with the table information.
Accordingly, in
First, in step S11, the overall control unit 31 causes the light-reception control unit 33 to initialize the CMOS image sensor 14. For example, the CMOS image sensor 14 is reset, and the set value 1 is set in the light-reception control unit 33.
In step S12, the overall control unit 31 detects a light quantity of data from the CMOS image sensor 14. In this case, the detected value is registered as previous data only the first time. In step S13, the overall control unit 31 determines whether or not the light quantity of the data from the CMOS image sensor 14 is greater than the threshold value 1 for the light quantity included in the table information. If the determination result in step S13 indicates “NO”, the overall control unit 31 sets the set value 1 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S14. The process then returns to step S12.
If the determination result in step S13 indicates “YES”, the overall control unit 31 determines whether or not the light quantity of the data from the CMOS image sensor 14 is greater than the threshold value 2 for the light quantity included in the table information in step S15. If the determination result in step S15 indicates “NO”, the overall control unit 31 determines whether or not the light quantity of the previous data from the CMOS image sensor 14 is greater than the threshold value 2 for the light quantity included in the table information in step S16. If the determination result in step S16 indicates “NO”, the overall control unit 31 sets the set value 1 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S17. The process then returns to step S12. If the determination result in step S16 indicates “YES”, the overall control unit 31 sets the set value 2 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S18. The process then returns to step S12.
If the determination result in step S15 indicates “YES”, the overall control unit 31 determines whether or not the light quantity of the data from the CMOS image sensor 14 is greater than the threshold value 3 for the light quantity included in the table information in step S19. If the determination result in step S19 indicates “NO”, the overall control unit 31 sets the set value 2 in the light-emission control unit 32 and/or the light-reception control unit 33 in step 520. The process then returns to step S12.
If the determination result in step S19 indicates “YES”, the overall control unit 31 determines whether or not the light quantity of the data from the CMOS image sensor 14 is greater than the threshold value 4 for the light quantity included in the table information in step S21. If the determination result in step S21 indicates “NO”, the overall control unit 31 determines whether or not the light quantity of the previous data from the CMOS image sensor 14 is greater than the threshold value 3 for the light quantity included in the table information in step S22. If the determination result in step S22 indicates “NO”, the overall control unit 31 sets the set value 2 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S23. The process then returns to step S12. If the determination result in step S22 indicates “YES”, the overall control unit 31 sets the set value 3 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S24. The process then returns to step S12.
If the determination result in step S21 indicates “YES”, the overall control unit 31 sets the set value 3 in the light-emission control unit 32 and/or the light-reception control unit 33 in step S25. The process then returns to step S12.
The overall control unit 31 executes step S12 to step S25 every time new data (i.e., a new image frame) is input from the CMOS image sensor 14. Furthermore, the light-emission control unit 32 and/or the light-reception control unit 33 in which the set values are set in steps S14, S17, S18, S20, and S23 to S25 control/controls at least one of the exposure time of the CMOS image sensor 14, the gain of the CMOS image sensor 14, the amount of electric current supplied to the LED 13, and the light-emission time of the LED 13 in accordance with the table information.
Accordingly, in
As described above, in this exemplary embodiment, every time the overall control unit 31 receives new data (i.e., a new image frame) from the CMOS image sensor 14, the overall control unit 31 controls the operation of the LED 13 or the CMOS image sensor 14 on the basis of the light quantity of the data input from the CMOS image sensor 14 detected by the overall control unit 31 and the table information. Therefore, the digital pen 1 minimizes fluctuations in the output from the CMOS image sensor 14, which may occur depending on the state and the environment in which the digital pen 1 is used, whereby the digital pen 1 may accurately read an image. In addition, the image decoding process may be stably performed since the sensitivity of the CMOS image sensor 14 is adjusted.
Furthermore, because the digital pen 1 uses table information to adjust the exposure time of the CMOS image sensor 14, the exposure time of the CMOS image sensor 14 is not controlled using feedback control that requires complicated calculations as in the related art. Thus, the digital pen 1 may read an image at high speed (i.e., may have high-speed responsiveness). Furthermore, the occurrence of limit cycle oscillation may be prevented in the digital pen 1.
A storage medium that stores a software program for achieving the function of the digital pen 1 may be supplied to the PC 2, and the controller 11 may read the program stored in the storage medium from the PC 2 and execute the program. Examples of the storage medium for supplying the program include a CD-ROM, a DVD, and an SD card.
Furthermore, the controller 11 may execute the software program for achieving the function of the digital pen 1.
The foregoing description of the exemplary embodiments of the present invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, thereby enabling others skilled in the art to understand the invention for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2011-005411 | Jan 2011 | JP | national |