This application is based on and claims priority under 35 U.S.C. §119 from Japanese Patent Application No. 2006-192947 filed Jul. 13, 2006.
This invention relates to a handwriting detection sheet capable of displaying by means of an electronic paper or a manuscript paper, handwriting with an electronic pen and acquiring handwriting data, and relates to a handwriting system using the handwriting detection sheet.
According to an aspect of the invention, a handwriting detection sheet includes: a handwriting layer that can display handwriting; a code layer placed on a rear-face side of the handwriting layer, the code layer comprising a plurality of code images arranged in a matrix manner, wherein in the code images, position codes are encoded with a light absorption material that absorbs infrared light; and an optical layer placed on a rear-face side of the code layer, the optical layer that reflects infrared light and allows visible light to pass through.
Exemplary embodiments of the invention will be described in detailed with reference to the accompanying drawings wherein:
(General Configuration of System)
(Handwriting Detection Sheet)
The handwriting detection sheet 2 has such a structure that a handwriting layer 20, a code layer 21, an optical layer 22 and electronic paper 23 are stacked in order from the top layer to the bottom layer. For example, in the handwriting detection sheet 2, the handwriting layer 20, the code layer 21 and the optical layer 22 may be integrated and the electronic paper 23 may be detachable or may adopt a book form. The form of the handwriting detection sheet 2 is not limited.
The handwriting layer 20 also serves as a protective layer. An image and a character can be written onto the handwriting layer 20 with ink supplied from a pen point 410 of the electronic pen 3. The written ink is erasable by an erasing member 420 of the electronic pen 3. The handwriting layer 20 is formed of a transparent or translucent resin material for allowing visible light and infrared light to pass through, for example, a polyethylene terephthalate (PET) film.
The code layer 21 has (i) a pattern portion formed of a light absorption material for absorbing infrared light (described later in detail) and (ii) other portions than the pattern portion, formed of a resin material for allowing infrared light and visible light to pass through, for example, a polyethylene terephthalate (PET) film.
The optical layer 22 is formed of a resin material for allowing visible light to pass through and reflecting infrared light, for example, a resin material such as a PET film to which infrared reflection coating is applied with a dielectric multilayer film (hot mirror of Edmond Optics Japan, HIR series of Harrison Toshiba Lighting Company).
(Electronic Paper)
The electronic paper 23 may have a roughly thin-type rectangular shape and have a memory property for retaining a display image with no power supply. However, it should be noted that the electronic paper 23 may have no memory property. Also, the electronic paper 23 may be of a self-rewrite type having an image rewrite function. However, it should be noted that the electronic paper 23 may of a rewrite system by means of a printer. Also, the electronic paper 23 may be of a reflection type for reflecting outside light (visible light) to display an image or may be of a light emission type for emitting light to display an image.
The reflection type includes an optical-writing-type electronic paper, a thermosensitive recording medium using leuco dye, and display recording media such as an electrophoresis system for moving charged particles for switching display, a particle rotation system for rotating charged particles for switching display, and a magnetophoresis system for moving particles by magnetism for switching display.
The light emission type includes an LCD (liquid crystal display) using a liquid crystal of ferroelectric liquid crystal having a memory property or a nematic liquid crystal having no memory property; an ELD (electroluminescent display); a PDP (plasma display); a VFD (vacuum fluorescent display); an LED (light emitting diode) display; and an FED (field emission display).
In the exemplary embodiment, the electronic paper 23 uses the optical-writing type electronic paper. The optical-writing type electronic paper includes: a liquid crystal layer having a reflectivity (transmittance), which changes in accordance with an applied voltage between a pair of electrodes; and a photoconductive layer whose resistance value decreases as light is applied thereto. The liquid crystal layer has microcapsules filled with cholesteric liquid crystal, for example. The photoconductive layer includes a charge transport layer and a pair of charge generation layers deposited on both sides of the charge transport layer. Accordingly, it is made possible to apply an AC voltage to the liquid crystal layer so that degradation of the liquid crystal layer can be suppressed and the drive voltage can be made lower and a long life of electronic paper can be accomplished.
(Printer)
The printer 3 applies a drive voltage required for rewriting a display image on the electronic paper 23 to the electronic paper 23. If the electronic paper 23 is an optical-writing type electronic paper, the printer 3 applies a drive voltage to the electronic paper 23 while applying image light to the electronic paper 23 in accordance with image data. If the electronic paper 23 is a self-rewriting type electronic paper, the printer 3 is not required and the information processing apparatus 5 and the electronic paper 23 are connected so as to directly communicate with each other.
(Electronic Pen)
The electronic pen 4 includes a casing body 400 having an outer shape almost similar to that of a general pen and a handwriting pen part 41 housed in the casing body 400 so that the pen point 410 is exposed from the tip of the casing body 400. The electronic pen 4 has a function of capturing a code image of the handwriting detection sheet 2, a function of reading a code from the code image, a function of acquiring handwriting data of the pen point 410, and a function of communicating the read code from the code image. These functions of the electronic pen 4 are described in detail later.
The pen part 41 has the pen point 410 at its tip. The pen part 41 also includes at its rear an ink tank and a writing pressure detection section 411 (described later) for detecting writing pressure given to the pen point 410. Ink may include an ink material, which is writable into the handwriting layer 20, which is erasable with using the erasing member 420, which reflects visible light and which allows infrared light to pass through. For example, B type manufactured by Tokai Optical Co., Ltd. may be used as ink
(Information Processing Apparatus)
The information processing apparatus 5 includes a CPU for controlling the whole apparatus 5; a storage section, such as ROM, RAM and/or a hard disk, for storing application programs of the CPU and various data such as image data displayed on the electronic paper 23; an input device such as a keyboard and a mouse; a network interface connected to a network; a display section, such as an LCD (liquid crystal display), for displaying a screen; and an audio output section having a loudspeaker for outputting sound. The information processing apparatus 5 can be implemented as a personal computer, but may be implemented as a personal digital assistant (PDA) or a mobile telephone.
(Image on Code Layer)
The code images 30 are formed of an invisible color material for absorbing infrared light, for example, a transparent toner (far-red light absorbing polycarbonate resin manufactured by Sumitomo Dow Limited). However, the code images 30 may be formed of a visible light absorption material for absorbing infrared light, for example, a general ink material. If an invisible light absorption material for absorbing infrared light is used, it can be prevented that the code image 30 makes it difficult to recognize characters, which are handwritten on the handwriting layer 20 with the electronic pen 4.
The code image 30 includes a rotation code part 30a provided in the upper left corner, an X coordinate code part 30b provided below the rotation code part 30a, a Y coordinate code part 30c provided on the right side of the rotation code part 30a, and an identification code part 30d provided below the lower right side of the rotation code part 30a.
Information indicating a direction in which the code image 30 exists is encoded in the rotation code part 30a. ^X and Y coordinates of the code image 30 on the handwriting detection sheet 2 are encoded in the X coordinate code part 30b and the Y coordinate code part 30c. Identification information of the handwriting detection sheet 2 is encoded in the identification code part 30d. The same X coordinate is encoded in the X coordinate code parts 30b arranged in the longitudinal direction. Also, the same Y coordinate is encoded in the Y coordinate code parts 30c arranged in the lateral direction. The same code is encoded in the rotation code parts 30a. The same code is encoded in the identification code parts 30d independently of positions of the code images 30.
The identification information of the handwriting detection sheet 2 includes a size, a type of a document (such as business card, patient's chart or check), for example.
Each of the code parts 30a to 30d includes a combination of slanting line patterns 300a of slash “/” and slanting line patterns 300b of back slash “\”, as shown in
The patterns in the code image 30 are not limited to the slanting line patterns 300a, 300b, but may be two-dimensional code such as known QR code, PDF417, Data Matrix, or Maxi Code or may be one-dimensional code such as bar code, unique code, or a dot pattern. Different types of codes may be used in combination in accordance with the purpose.
(Internal Structure of Electronic Pen)
The infrared LED lamp 42 emits near-infrared light having a wavelength of 800 nm to 1000 nm. A laser or a halogen lamp may be used as the infrared LED lamp 42.
The capturing section 43 includes a visible light removal filter 430 and an infrared CCD (Charge Coupled Deice 431). The visible light removal filter 430 removes visible light from the infrared light, which is applied to the handwriting detection sheet 2 and reflected on the handwriting detection sheet 2, and allows the infrared light to pass through. The infrared CCD 431 serves as an image capturing device for capturing the infrared light passing through the visible light removal filter 430.
The infrared CCD 431 converts received light into an electric signal in accordance with the strength of the light. The infrared CCD 431 may have sensitivity from a visible region to a near-infrared region or may have sensitivity in a near-infrared region. CMOS (complementary metal oxide semiconductor) may be used as the image capturing device in place of the CCD 431.
The writing pressure detection section 411, the signal processing section 44, the decode section 45, the memory 46, the lamp drive section 47, the control section 48, the communication I/F 49, and the battery 440 are housed in the casing body 400. Some or all of the handwriting calculation functions of the signal processing section 44, the decode section 45, and the control section 48 may be removed from the electronic pen 4 and included in the information processing apparatus 5 or another external system.
The signal processing section 44 converts an analog electric signal from the CCD 431 into a digital signal and performs various types of process such as inclination correction, gamma correction and noise removal.
When the writing pressure detection section 411 detects a given or more writing pressure, the control section 48 calculates locus of the pen point 410 from the X coordinate code and the Y coordinate code which indicate the coordinates of the pen point 410 and which are decoded by the decode section 45. Then, the control section 48 stores the locus in the memory 46 as handwrite data. When the communication I/F 49 is connected to the information processing apparatus 5, the control section 48 reads the handwrite data from the memory 46 and transmits the handwrite data to the information processing apparatus 5 through the communication I/F 49.
The lamp drive section 47 drives the infrared LED lamp 42 so as to generate infrared light continuously. When handwriting data is to be acquired (code is read), the lamp drive section 47 may cause the infrared LED lamp 42 to turn on instantaneously or in a pulse manner.
The decode section 45 reads a rotation code from the rotation code part 30a of the code images 30, an X coordinate code from the X coordinate code part 30b, an Y coordinate code from the Y coordinate code part 30c, and an identification code from the identification code part 30d, as described below with reference to
The image 6 captured by the CCD 431 is made larger than the code image 30. If the size of the code image 30 is 2 mm×2 mm as described above, the size of the captured image 6 is 3×3 mm, for example. The decode section 45 combines image parts 60a, 60b, 61a, 61b, 62a, 62b, 62c, and 62d of the captured image 6 to restore the X coordinate code, the Y coordinate code, and the identification code, as shown in
(Operation of Handwriting System)
Next, the operation of the handwriting system 1 according to the exemplary embodiment will be discussed with reference to
(1) Displaying Image by Means of Electronic Paper
The CPU of the information processing apparatus 5 transmits a control signal to the printer 3 together with image data selected by a user who operates the input device from among plural pieces of image data stored in the storage section. The printer 3 applies a voltage between the pair of electrodes of the electronic paper 23 based on the image data and the control signal transmitted from the information processing apparatus 5 and applies image light to the electronic paper 23 in accordance with the image data so as to write an image onto the electronic paper 23.
As shown in
(2) Acquiring Handwriting Data
The infrared LED lamp 42 of the electronic pen 4 continuously generates infrared light while being driven by the lamp drive section 47. If the user handwrites an image and/or a character on the handwriting layer 20 of the handwriting detection sheet 2 with the pen point 410 of the electronic pen 4, the infrared light generated from the infrared LED lamp 42 passes through the handwriting layer 20 and is applied to the code layer 21. Of the infrared light applied to the code layer 21, the infrared light passing through any other portion than the slanting line pattern 300 is reflected on the optical layer 22 as shown in
The signal processing section 44 converts the analog electric signal input from the infrared CCD 431 into a digital signal and performs various types of processes such as the inclination correction, the gamma correction and the noise removal. The decode section 45 decodes the signal processed by the signal processing section 44 into a rotation code, an X coordinate code, a Y coordinate code, and an identification code. The image capturing by the infrared CCD 431, the signal processing by the signal processing section 44, and the decoding by the decode section 45 are executed in 60 to 100 cycles a second.
When the writing pressure detection section 411 detects a given or more writing pressure, the control section 48 calculates the locus of the pen point 410 based on the X coordinate code and the Y coordinate code, which indicate the coordinates of the pen point 410, of the codes acquired by the decode section 45. Then, the control section 48 stores the locus in the memory 46 as handwrite data.
The ink 412 used for handwriting on the handwriting layer 20 with the pen point 410 of the electronic pen 4 can be visually recognized because visible light is reflected on the ink 412 as shown in
(3) Transferring Handwriting Data
If the user connects the electronic pen 4 to the information processing apparatus 5 by the cable 4a, the control section 48 of the electronic pen 4 reads the handwrite data from the memory 46 and transmits the read handwrite data to the information processing apparatus 5 through the communication I/F 49 and the cable 4a. The CPU of the information processing apparatus 5 stores the handwriting data transmitted from the electronic pen 4 in the storage section and also superposes the handwriting data on the image displayed on the electronic paper 23 (display image) to generate a synthesized image. Then, the CPU of the information processing apparatus 5 controls the printer 3 to write the synthesized image onto the electronic paper 23.
Even after the synthesized image is displayed on the electronic paper 23, the image before appended may be displayed on the electronic paper 23 according to a user's selection. The synthesized image may be displayed on the display section. Further, the synthesized image may be stored in the storage section together with the display image and the handwriting data or may be transferred through a network interface to a server for management.
The ink 412 used for handwriting on the handwriting layer 20 can be erased with the erasing member 420 attached to the electronic pen 4.
Next, specific composition examples of the layers of the handwriting detection sheet 2 will be discussed with reference to
In the example 1 of the invention, an optical layer 22 is formed on an electronic paper 23. Then, slanting line patterns 300 are formed on the optical layer 22. A handwriting layer 20 is applied onto the optical layer 22 and the slanting line patterns 300, as shown in
The optical layer 22 may be a high-level interference multilayer film formed by coating plural layers of thin film, which reflect infrared light and which allow visible light to pass through, with HIR (Halogen lamp eith Infrared Reflective films) technique of Harrison Toshiba Lighting Company, for example. A stacked thin film having a sandwich structure of a titanium nitride (TiN) film having an infrared reflection characteristic and a titanium oxide (TiO2) film to raise visible light transmittance (TiO2/TiN/TiO2) may be used. (For example, refer to JP 2005-3614 A).
In the example 2 of the invention, the stack order in the example 1 is reversed. Slanting line patterns 300 are formed on a handwriting layer 20, an optical layer 22 is applied onto the handwriting layer 20 and the slanting line patterns 300, and electronic paper 23 is placed on the optical layer 22, as shown in
In the example 3 of the invention, an optical layer 22 is formed on an electronic paper 23, a substrate 24 is joined to an optical layer 22, slanting line patterns 300 are formed on the substrate 24, and a handwriting layer 20 is applied onto the substrate 24 and the slanting line patterns 300, as shown in
The example 4 of the invention is different from the example 1 in that an electronic paper 23 is not joined. Slanting line patterns 300 are formed on an optical layer 22 and a handwriting layer 20 is applied onto the optical layer 22 and the slanting line patterns 300, as shown in
In the example 5 of the invention, the stack order in the example 4 is reversed. Slanting line patterns 300 are formed on a handwriting layer 20, an optical layer 22 is applied onto the handwriting layer 20, and the slanting line patterns 300, as shown in
[Other Embodiments]
It is to be understood that the invention is not limited to the exemplary embodiment and the examples. Various modifications and changes may be made without departing from the spirit and the scope of the invention.
For example, recording media made of paper, plastic, cloth, etc., may be used in place of the electronic paper 23.
The case where the information reader for reading handwriting is applied to the pen is described in the exemplary embodiment, but it may be applied to a personal digital assistant (PDA), a mobile telephone, etc. In this case, the personal digital assistant, the mobile telephone, etc., may have no writing function.
Communications between the electronic pen 4 and the information processing apparatus 5 may be conducted by infrared communications. In this case, the information processing apparatus 5 may be provided with an infrared transmission-reception section and the electronic pen 4 may use an infrared LED lamp for image pickup or may be provided with an infrared LED lamp. Preferably, the electronic pen 4 includes a communication start button.
For example, the infrared communications can use four-valued PPM (pulse position modulation) based on IrDA (Infrared Data Association) standard, but the invention is not limited to it. The four-valued PPM is a system of emitting light for the one-slot time duration of four-slot time and transmitting two bits of “00,” “01,” “10,” or “11.”
5 INFORMATION PROCESSING APPARATUS
42 INFRARED LED LAMP
43 CAPTURING SECTION
44 SIGNAL PROCESSING SECTION
45 DECODE SECTION
46 MEMORY
47 LAMP DRIVE SECTION
48 CONTROL SECTION
49 COMMUNICATION I/F
411 WRITING PRESSURE DETECTION SECTION
431 INFRARED CCD
440 BATTERY
Number | Date | Country | Kind |
---|---|---|---|
2006-192947 | Jul 2006 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
4420682 | Huber | Dec 1983 | A |
4731526 | Knoll et al. | Mar 1988 | A |
4813077 | Woods et al. | Mar 1989 | A |
5661506 | Lazzouni et al. | Aug 1997 | A |
6118889 | Izuno et al. | Sep 2000 | A |
6418279 | Weinberger et al. | Jul 2002 | B1 |
6585341 | Walker et al. | Jul 2003 | B1 |
6651894 | Nimura et al. | Nov 2003 | B2 |
7202861 | Lynggaard | Apr 2007 | B2 |
7441183 | Burstrom et al. | Oct 2008 | B2 |
7639876 | Clary et al. | Dec 2009 | B2 |
7672513 | Bjorklund et al. | Mar 2010 | B2 |
20020020750 | Dymetman et al. | Feb 2002 | A1 |
20030132302 | Hattori | Jul 2003 | A1 |
20030160095 | Segal | Aug 2003 | A1 |
20030234294 | Uchihiro et al. | Dec 2003 | A1 |
20040035935 | Takahashi et al. | Feb 2004 | A1 |
20040074350 | Hanada | Apr 2004 | A1 |
20050184159 | Hattori et al. | Aug 2005 | A1 |
20060007255 | Chen | Jan 2006 | A1 |
20060091304 | Saint Clair | May 2006 | A1 |
20060280331 | Chosson et al. | Dec 2006 | A1 |
20070057060 | Hasuike | Mar 2007 | A1 |
20070231587 | Naito et al. | Oct 2007 | A1 |
20070276694 | Moriyama | Nov 2007 | A1 |
Number | Date | Country |
---|---|---|
A 2003-255919 | Sep 2003 | JP |
A 2004-139534 | May 2004 | JP |
A 2005-56073 | Mar 2005 | JP |
Number | Date | Country | |
---|---|---|---|
20080019616 A1 | Jan 2008 | US |