The invention relates to a reading apparatus for reading an information code displayed on a display, a reading method of the information code, and a display reading system of the information code.
Nowadays, an information code such as bar code as a 1-dimensional code or QR (Quick Response) code as a 2-dimensional code is used. In recent years, a system has been proposed in which information data is converted into a QR code, the QR code is displayed onto a display of a cellular phone or the like, and the displayed QR code is photographed and read, thereby obtaining the information data (for example, refer to
In this case, in order to accurately extract an area corresponding to the QR code from a photograph image signal obtained by photographing the QR code, it is necessary to sample the photograph image signal at each of proper coordinates position in which a position of a center of gravity of the QR code is used as a reference. In the QR code, therefore, a cutting symbol is provided for each of three corners of each QR code area so that a reference point of the sampling corresponding to the position of the center of gravity can be obtained on a reading apparatus side. In the case of photographing and reading the 2-dimensional information code such as a QR code, therefore, it is necessary to provide the symbols serving as reference points of the sampling into the area of the 2-dimensional information code. There is, consequently, such a problem that an information amount of the 2-dimensional information code which can be expressed per unit area is reduced by an amount corresponding to the area where the symbol is displayed.
Patent Document 1: Japanese Patent Kokai No. 2002-109421
It is an object of the invention to provide a reading apparatus of an information code, a reading method, and a display reading system of the information code, in which even if symbol areas serving as references when sampling a photograph image signal obtained by photographing a display screen are not provided in the information code, information code data representing the information code can be obtained from the photograph image signal.
According to the invention, there is provided a reading apparatus for reading an information code displayed on a display apparatus for displaying the information code, comprising: means for obtaining a photograph image signal by photographing a display screen of the display apparatus; first photograph image extracting means for extracting an image signal, as a first image signal, obtained from the photograph image signal when all pixel cells of the display apparatus have emitted light; second photograph image extracting means for extracting an image signal, as a second image signal, obtained from the photograph image signal within a period of time during which the information code is displayed; and sampling means for detecting a point of a center of gravity of the light emission of each of the pixel cells based on the first photograph image signal and sampling the second photograph image signal at the point of the center of gravity of the light emission, thereby obtaining information code data representing the information code.
According to the invention, there is also provided a reading method of reading an information code displayed on a display apparatus for displaying the information code, comprising: a step of obtaining a photograph image signal by photographing a display screen of the display apparatus; a first photograph image extracting step of extracting an image signal, as a first image signal, obtained from the photograph image signal when all pixel cells of the display apparatus have emitted light; a second photograph image extracting step of extracting an image signal, as a second image signal, obtained from the photograph image signal within a period of time during which the information code is displayed; and a sampling step of detecting a point of a center of gravity of the light emission of each of the pixel cells based on the first photograph image signal and sampling the second photograph image signal at the point of the center of gravity of the light emission, thereby obtaining information code data representing the information code.
According to the invention, there is provided a display reading system of an information code, comprising a display apparatus for displaying the information code and a reading apparatus for reading the information code displayed on the display apparatus, wherein the display apparatus has means for allowing all pixel cells to emit light for a predetermined first period of time within a unit display period of time and allowing each of the pixel cells to emit the light for a predetermined second period of time within the unit display period of time in accordance with a light emission pattern corresponding to the information code, and the reading apparatus has: means for obtaining a photograph image signal by photographing a display screen of the display apparatus; first photograph image extracting means for extracting an image signal, as a first image signal, corresponding to the light emission of each of the pixel cells for the first period of time from the photograph image signal; second photograph image extracting means for extracting an image signal, as a second image signal, corresponding to the light emission of each of the pixel cells for the second period of time from the photograph image signal; and sampling means for detecting a point of a center of gravity of the light emission of each of the pixel cells based on the first photograph image signal and sampling the second photograph image signal at the point of the center of gravity of the light emission, thereby obtaining information code data representing the information code.
According to the invention, even if the symbol area for sampling the photograph image signal obtained by photographing the information code displayed on the display is not provided in the information code, the photograph image signal is sampled at the proper sampling point and the data showing the information code can be obtained.
When reading an information code displayed on a display apparatus, first, an image signal obtained when all pixel cells of the display apparatus have emitted light is extracted, as a first image signal, from a photograph image signal obtained by photographing a display screen of the display apparatus. Further, an image signal obtained for a period of time during which the information code has been displayed is extracted, as a second image signal, from the photograph image signal. A point of a center of gravity of the light emission of each pixel cell is detected based on the first photograph image signal and the second photograph image signal is sampled at the point of the center of gravity of the light emission, thereby obtaining information code data representing the information code.
In
Blackboard surface image data showing a blackboard surface (for example, all in black) to be displayed on the whole display screen of the PDP 100 has previously been stored in a blackboard surface image data memory 1. The blackboard surface image data memory 1 sequentially reads out the blackboard surface image data and supplies it as blackboard surface image data DBB to an image superimposing circuit 2.
The image superimposing circuit 2 forms pixel data PD in which an image obtained by superimposing a blackboard surface image shown by the blackboard surface image data DBB, an image shown by an external input image data signal DIN, and an image shown by a trace image data signal DTR (which will be explained hereinafter) is shown every pixel cell P and supplies it to each of an SF pixel drive data forming circuit 3 and a drive control circuit 4. If a blackboard display cancel signal is supplied from the drive control circuit 4 (which will be explained hereinafter), the image superimposing circuit 2 supplies the pixel data PD in which an image obtained by superimposing the image shown by the external input image data signal DIN and the image shown by the trace image data signal DTR is shown every pixel cell P to each of the SF pixel drive data forming circuit 3 and the drive control circuit 4.
The SF pixel drive data forming circuit 3 forms pixel drive data GD1 to GD8 for setting a state of each pixel cell P into either a light-on mode or a light-off mode in each of subfields SF1 to SF8 (which will be explained hereinafter) every pixel data PD in accordance with a luminance level shown by the pixel data PD and supplies them to an address driver 5.
Every pixel block constructed by a plurality of adjacent pixel cells P, coordinates data showing a coordinates position in the display screen of the PDP 100 where the pixel block is located has previously been stored in a coordinates data memory 6. For example, every pixel block PB (area surrounded by a bold frame) constructed by the pixel cells P of n rows×m columns as shown in
First, the 2-dimensional code converting circuit 7 converts the coordinates data corresponding to each pixel block PB into a 2-dimensional code of (n×m) bits. The 2-dimensional code converting circuit 7 makes each bit of the 2-dimensional code correspond to each of the (n×m) pixel cells P in the pixel block PB and supplies the bit corresponding to each pixel cell P as pixel drive data GD0 corresponding to the pixel cell P to the address driver 5.
The drive control circuit 4 sequentially executes a 2-dimensional code display driving step and a main image display driving step within a display period of time of one frame (or one field) based on a light emission driving sequence shown in
By executing each of the resetting step R, addressing step W, and sustaining step I, the drive control circuit 4 generates various control signals for driving the PDP 100 as shown below and supplies them to each of the address driver 5 and a row electrode driver 8.
In this process, by the execution of the resetting step R, the row electrode driver 8 applies resetting pulses to all row electrodes of the PDP 100 so as to initialize states of all of the pixel cells P of the PDP 100 to a state of the light-on mode.
Subsequently, by the execution of the addressing step W, the address driver 5 generates a pixel data pulse having a voltage according to pixel drive data GD corresponding to a subfield SF to which the addressing step W belongs. That is, for example, in the addressing step W of the subfield SF1, the address driver 5 generates the pixel data pulse according to the pixel drive data GD1. In the addressing step W of the subfield SF2, the address driver 5 generates the pixel data pulse according to the pixel drive data GD2. In this instance, for example, if the pixel drive data GD showing that the pixel cells P are set into the state of the light-on mode have been supplied, the address driver 5 generates the pixel data pulse of a high voltage. If the pixel drive data GD showing that the pixel cells P are set into the state of the light-off mode have been supplied, the address driver 5 generates the pixel data pulse of a low voltage.
For such a period of time, the row electrode driver 8 sequentially applies a scanning pulse to each of the row electrodes of the PDP 100 synchronously with applying timing of the pixel data pulse group of every display line. Owing to the above operation, each of the pixel cells P of the number corresponding to one display line belonging to the row electrodes to which the scanning pulses have been applied is set into the state (light-on mode or light-off mode) responsive to the pixel data pulse.
Subsequently, by the execution of the sustaining step I, the row electrode driver 8 applies sustaining pulses to all of the row electrodes of the PDP 100 so as to allow only the pixel cells P which are in the light-on mode state to repetitively execute a discharge light emission for the light emitting period of time allocated to the subfields SF to which the sustaining step I belongs. In the embodiment shown in
By the execution of the main image display driving step (subfields SF1 to SF8) as shown in
By the execution of the 2-dimensional code display driving step (subfield SF0) as shown in
An electronic chalk 9 serving as a reading apparatus of an information code according to the invention extracts the light-on and light-off patterns based on the 2-dimensional code from the photograph image signal obtained by photographing the display screen of the PDP 100 on a unit basis of the pixel block PB as shown in
In
A noise sensor 92 generates a pulse-like noise detection signal NZ which is set to a logic level “1” when noises emitted from the display screen of the PDP 100 in association with a discharge that is caused in each pixel cell P in the PDP 100 are detected, that is, when the irradiation of infrared rays, ultraviolet rays, or electromagnetic waves is detected and supplies it to a frame sync detecting circuit 93. In this process, since various kinds of discharge are caused during the execution periods of time of the subfields SF0 to SF8 in the 1-frame (or 1-field) display period of time, each time the discharge is caused, the pulse-like noise detection signal NZ which is set to the logic level “1” as shown in
In response to the noise detection signal NZ, the frame sync detecting circuit 93 forms a frame sync signal FS which is set to the logic level “1” during the execution period of time of the 2-dimensional code display driving step (subfield SF0) shown in
In
As shown in
That is, the image sensor 91 supplies the photograph image signal SG showing the image obtained by superimposing the emission light corresponding to the 2-dimensional code (showing the coordinates position of the pixel block PB) associated with the discharge caused in the pixel cell P in the sustaining step I of the subfield SF0 in
For a period of time during which a front edge portion is pressed onto the display screen of the PDP 100, a pen pressure sensor 95 attached to the front edge portion of the electronic chalk 9 forms a drawing execution signal showing that the drawing onto the blackboard surface is being executed and supplies it to the image processing circuit 94.
Only for a period of time during which the drawing execution signal is supplied, the image processing circuit 94 fetches the photograph image signal SG supplied from the image sensor 91. At this time, when the luminance level shown by the photograph image signal SG is deviated to the luminance side higher than a predetermined luminance, the image processing circuit 94 determines that the external light is strong, and supplies the offset signal to the image sensor 91 so as to suppress the external light. The image processing circuit 94 further samples only the signal level obtained at the point of the center of gravity of the light emission of each pixel cell P from the photograph image signal SG and supplies a data series based on sampled values as 2-dimensional code data CDD to a coordinates information extracting circuit 96.
In
The reset photograph image extracting circuit 943 extracts a reset photograph image based on the light emission associated with the resetting discharge caused in the resetting step R of the subfield SF0 shown in
That is, according to the execution of the resetting step R, although the weak resetting discharge is caused in all of the pixel cells P, actually, the resetting discharge is caused only in a partial area in the pixel cell P and, in each pixel cell P, the more the position is away from the partial area, the more the light emission intensity associated with the discharge deteriorates. When the discharge is caused in, for example, a center portion of the pixel cell P, therefore, as shown in
On the basis of the reset photograph image signal RSV, every pixel cell P, the sampling point detecting circuit 945 selects the unit image pickup cell XC locating at the point of the center of gravity of the light emission from a plurality of unit image pickup cells XC each for receiving the emission light from the pixel cell P and supplies a sampling point signal SP showing its coordinates position as a sampling point to a sampling circuit 946. That is, the sampling point detecting circuit 945 detects a position of a center of gravity of a block constructed by a plurality of unit image pickup cells XC corresponding to the light-on state (shown by the white circles) as shown in
In this manner, the sampling point detecting circuit 945 detects the point of the center of gravity of the light emission of each pixel cell P based on the reset photograph image signal RSV and supplies the sampling point signal SP showing the point of the center of gravity of the light emission as a sampling point to the sampling circuit 946.
The 2-dimensional code photograph image extracting circuit 944 extracts a 2-dimensional code photograph image based on the light emission associated with the discharge caused in the sustaining step I of the subfield SF0 shown in
That is, according to the execution of the sustaining step I in the 2-dimensional code display driving step as shown in
The sampling circuit 946 samples only the value of the photograph image signal obtained at the sampling point shown by the sampling point signal SP, that is, at the point of the center of gravity of the light emission (shown by, for example, the symbol of the double circles in
Coordinates data showing the coordinates position in the display screen of the PDP 100 of each of the pixel blocks PB as shown in
First, the coordinates information extracting circuit 96 reads out the coordinates data corresponding to the 2-dimensional code shown by the 2-dimensional code data CDD supplied from the image processing circuit 94 from the coordinates 2-dimensional code memory 97 and supplies it as coordinates data ZD to a wireless transmitting circuit 98. The wireless transmitting circuit 98 executes a modulating process to the coordinates data ZD and transmits it in a wireless manner.
A receiving circuit 10 shown in
As mentioned above, the electronic chalk 9 obtains the 2-dimensional code data (CDD) showing the 2-dimensional code from the photograph image signal (SG or SGT) obtained by photographing the display screen of the PDP 100 for the display period of time (SF0) of the 2-dimensional code showing the coordinates position information (ZD). At this time, when obtaining the 2-dimensional code data from the photograph image signal, first, the image processing circuit 94 of the electronic chalk 9 extracts the image signal (RSV) corresponding to the light emission associated with the resetting discharge from the photograph image signal. Subsequently, the image processing circuit 94 detects the point (SP) of the center of gravity of the light emission of each pixel cell P based on the image signal corresponding to the light emission associated with the resetting discharge. That is, in the plasma display panel, every pixel cell P, the point of the center of gravity of the light emission in the pixel cell P is detected by using the light emission associated with the resetting discharges which are simultaneously caused in all of the pixel cells. The image processing circuit 94 samples only the signal level corresponding to the point (SP) of the center of gravity of the light emission of each pixel cell P from the photograph image signal (SG or SGT), thereby obtaining the 2-dimensional code data (CDD) corresponding to the 2-dimensional code.
According to the above construction, therefore, even if the symbol areas serving as references when sampling the photograph image signal obtained by photographing the information code are not provided in the information code, the data series corresponding to the information code can be obtained by sampling the photograph image signal at the proper sampling points. According to the invention, consequently, the information code whose information capacity has been increased by omitting the symbol areas serving as references when sampling the photograph image signal can be used.
Although the plasma display panel (PDP 100) has been used as a display apparatus in the electronic blackboard shown in the embodiment, the invention is not limited to it. In brief, the invention can be applied to any display so long as a display which can drive by such a driving sequence that all pixel cells periodically and simultaneously emit light.
In the system for obtaining the information code by photographing the information code displayed on the display, the information code in which the symbol areas to be sampled are not provided can be used.
Number | Date | Country | Kind |
---|---|---|---|
2006-084373 | Mar 2006 | JP | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/JP2007/056372 | 3/27/2007 | WO | 00 | 10/16/2008 |