This application is based upon and claims the benefit of priority from the prior Japanese Patent Application No. 2012-092471, filed on Apr. 13, 2012, the entire contents of which are incorporated herein by reference.
Embodiments described herein relate generally to a transmission system, a transmitter and a receiver.
A system is known where visible light on which data are superposed is transmitted from a transmitter to a receiver. The transmitter blinks a light source such as a light emitting diode (LED) which emits a visible light according to the data to be transmitted. The receiver receives the data by photographing and demodulating the visible light emitted from the light source by using a photo diode (PD) or an image sensor. Particularly, in a receiver using the image sensor, since the light source needs to be recognized on the sensor during the reception period, it is preferable to implement the previewing over the entire angle of viewing at the same time of the reception in order to improve usability.
In the transmission system, by setting the frequency of the light source of the transmitter to be high so that the blinking of the light source is not perceived, information can be transmitted without disturbing normal illumination or general operations of a display. On the other hand, since a low power and low cost receiver is desired, it is preferable that the frame rate of the receiver is low. In general, it is difficult for a receiver having a low frame rate to perceive blinking of the light source at a high frequency.
In order to improve an effective frame rate, a manner of accessing only a portion of the area which can be photographed by the receiver can be considered. However, since a peripheral portion of the light source is not accessed, there is a problem in that previewing over the entire angle of viewing cannot be performed. In this case, it is difficult to find the position of the light source or to handle a plurality of the light sources. On the other hand, if an image sensor having a specialized structure is used in order to perform previewing, there is a problem of an increase in costs of implementation.
In general, according to one embodiment, a transmission system includes a transmitter and a receiver. The transmitter includes a modulator configured to modulate transmission data at a chip rate to generate a modulation signal, and one or a plurality of light sources configured to emit visible light according to the modulation signal. The receiver includes a light receiver having one or more lines of light receiving elements to receive light in a first range including the visible light; and a demodulator configured to demodulate image data generated according to the light received by the light receiver to generate reception data corresponding to the transmission data. A following equation is satisfied ff<fm where fm is the chip rate, and ff is a frame rate of the light receiver.
Embodiments will now be explained with reference to the accompanying drawings.
The transmitter 100 includes a modulator 11 and a light source 12. The modulator 11 modulates transmission data Dt and supplies a modulation signal to the light source 12. The light source 12 is, for example, an LED and emits visible light according to the modulation signal. In other words, the transmission data Dt is superposed on the visible light. The light source 12 may be a light source of an illumination apparatus or a backlight of a liquid crystal display or the like. In addition, although one light source 12 is illustrated in the figure, the receiver 200 may include a plurality of the light sources 12.
The receiver 200 includes a light receiver 21, a frame buffer 22, a demodulator 23, and a display 24. The light receiver 21 is an image sensor such as a CCD camera or CMOS sensor. The light receiver 21 light-receives (photographs) a visible light emitted by the light source 12 and light in a neighboring range of the visible light. The frame buffer 22 generates image data from luminance information of the light which is light-received and photo-electrically converted by the light receiver 21 and retains the generated image data. The demodulator 23 demodulates the image data to generate reception data Dr corresponding to the transmission data Dt. The display 24 displays an image corresponding to the entire angle of viewing of the image data. The image corresponding to the entire angle of viewing of the image data may be an appropriately-resized image of the image data.
It is preferable for the modulator 11 to generate the modulation signal so that the blinking of the light source 12 is not to be recognized by human eyes. Therefore, the chip rate fm is set to be somewhat high, for example, 100 Hz or more.
Herein, as one of features of the embodiment, the chip rate fm and the frame rate ff satisfy the following equation (1).
ff<fm (1)
Hereinafter, for simplifying the description, it is assumed that the number of light receiving elements of the light receiver 21 is 8×8 (N=M=8) and 4×4 central light receiving elements light-receive the visible light emitted by the light source 12.
As illustrated in
As illustrated in the figure, a portion of the light source 12 appears in the fourth scan line 42 corresponding to the fourth line 32 of the light receiver 21 photographed at the time t2 and the sixth scan line 44 corresponding to the sixth line 34 of the light receiver 21 photographed at the time t4, and however, light source 12 does not appear in the third scan line 41 corresponding to the third line 31 of the light receiver 21 photographed at the time t1 and the fifth scan line 43 corresponding to the fifth line 33 of the light receiver 21 photographed at the time t3.
The image data 22a of
In addition,
In the above example, fm=frx. However, if the above equation (1) is satisfied, the chip rate fm may be lower than the line scan frequency frx. With respect to a case where fm=frx/2, the difference from
More generally, in the case where fm=frx/p, that is, Tm=p*Trx, the demodulator 23 may sample scan lines, the number of the sampled lines being a multiple number of p from a first scan line in the area corresponding to the light source 12. In the case where the multiple number of p is not an integer, the demodulator 23 may sample scan lines, the number of the sampled lines being closest to a rounded-off multiple number of p, for example.
In this manner, in the first embodiment, the chip rate fm of the modulation signal is set to be larger than the frame rate ff of the light receiver 21. Then, the luminance of the image data is sampled according to a ratio of the chip rate fm and the line scan frequency frx to generate the reception data Dr. In the receiver 200, the image at the entire angle of viewing can be obtained (while previewing) by the light receiver 21, and the information from the light source 12 which blinks at a frequency higher than the frame rate ff of the light receiver 21 can be received. In addition, since a specialized light receiver 21 is not used, compatibility with an existing image sensor can be secured, thereby, suppressing an increase in costs of implementation.
Note that, when the transmitter 100 includes a plurality of the light sources 12, the chip rates of the light sources 12 may be different from each other. Furthermore, the tone of luminance is not only a binary value of “0” and “1” but also a ternary value or more.
In a second embodiment described hereinafter, a position of a light source 12 is detected from image data to generate reception data Dr.
In the embodiment, a modulation signal generated by a transmitter 100 includes a synchronization signal having a predefined pattern. The light source detector 231 searches the synchronization signal from image data to detect an area corresponding to a light source 12. The integrator 232 samples luminance and combines sampled values in the detected area to generate reception data Dr.
Next, as denoted by reference numeral 23b in
In this manner, in the second embodiment, the light source detector 231 is provided so as to identify the position of the light source 12. Therefore, it is possible to generate the reception data Dr at a high accuracy.
Note that, the synchronization signal may be generated by modulating the luminance of the visible light emitted by the light source 12 instead of a combination of the value 0 and the value 1.
A third embodiment described hereinafter is a specific example of the second embodiment.
A modulation signal including the synchronization signal Sync described in the second embodiment is generated by the modulator 11 of the transmitter 100.
First, the modulator 11 adds a header to the transmission data Dt (Step S11). The header is, for example, a 1-byte signal indicating a front end of a modulation signal and a length of a data signal Dt. In addition, the length of the data signal Dt is a multiple of one byte and is in a range of 1 byte to 255 bytes. Accordingly, a signal illustrated in
Subsequently, the modulator 11 divides the header and the signal composed of the transmission data Dt generated in Step S11 in unit of four bits (Step S12). Accordingly, a signal illustrated in
Next, the modulator 11 adds a header identification bit HD to the signal generated in Step 12 and composed of the divided four bits (Step S13). The header identification bit HD is composed of one bit. If the added four bits are a header, the header identification bit HD is set to have the value 1; and if the added four bits are not a header but transmission data Dt (or a portion thereof), the header identification bit HD is set to have the value 0. Accordingly, a signal illustrated in
Next, the modulator 11 performs Manchester coding on a signal generated in Step S13 and composed of the header identification bit HD and the divided four bits (Step S14). Accordingly, a signal illustrated in
In addition, the modulator 11 adds the synchronization signal Sync to the data signal generated in Step S14 (Step S15). The synchronization signal is, for example, a Barker sequence of 5 or more and is, for example, a Barker 5 of “11101”. Accordingly, a signal illustrated in
C*Tb≧1/ff (2)
The modulator 11 performs the above-described Steps S13 to S16 on all the 4-bit signals generated in Step S12. Next, the after-repetition signals generated in Step S16 are combined, and thus, a modulation signal illustrated in
Herein, the reason why Manchester coding is performed on the data signal and the synchronization signal is set to a Barker sequence of 5 or more will be described.
The Barker sequence is a sequence whose auto correlation peak becomes maximum and is suitable to perform time synchronization at a high accuracy.
In this manner, in the third embodiment, the synchronization signal is set to a Barker sequence of 5 or more, and the Manchester coding is performed on the data signal. Therefore, the synchronization signal Sync can be detected at a high accuracy.
Note that, the Manchester coding and the Barker sequences described above are exemplary ones. The frame set may include a coded data signal and a synchronization signal which does not appear therein. In addition, the frame set may include at least the synchronization signal Sync and the transmission data Dt, and the frame set may further include information for error correction and the like.
In a fourth embodiment described hereinafter, a frame determination bit is further added to the transmission data Dt.
In addition to the header identification bit HD, the modulator 11 according to the embodiment adds frame determination bits S0 and S1 to the data signal (Step S13′). As illustrated in
When the divided four bits are the higher 4 bits of one byte before the division, each of the frame determination bits S0 and S1 is set to have the value 1; and when the divided four bits are the lower 4 bits of one byte before the division, each of the frame determination bits S0 and S1 is set to have the value 0. As a result, the frame determination bits S0 and S1 added to particular four bits have the same value, while the frame determination bits S0 and S1 added to particular four bits are different from those added to successive four bits.
Next, the modulator 11 performs Manchester coding on the signal generated in Step S13′ (Step S14) and adds the synchronization signal Sync to the resulting signal (Step S15). Accordingly, a frame set illustrated in
Next, the modulator 11 repeats the frame set predetermined times (Step S16 in
It is assumed that the modulation signal illustrated in
In the case where photographing is performed at timing shown in
On the basis that the values of the frame determination bits S0 and S1 are the same, the integrator 232 can recognize that data before the synchronization signal Sync and data after the synchronization signal Sync are a portion of the same data. Therefore, the integrator 232 can decode the data D0 by cyclically sampling and combining the scan line corresponding to the lower portion of the light source 12 from the scan line lower than the frame determination bit S1 and the scan line upper than the frame determination bit S0 from the scan line corresponding to the upper portion of the light source 12.
On the basis that the values of the frame determination bits S0 and S1 are different from each other, the integrator 232 can recognize that data before the synchronization signal Sync and data after the synchronization signal Sync are portions of different data. Therefore, the integrator 232 does not perform cyclic sampling, as illustrated in
In this manner, in the fourth embodiment, the modulation signal includes the frame determination bits S0 and S1 added before and after the synchronization signal Sync, respectively. Therefore, it can be determined whether the data before the synchronization signal Sync and data thereafter included in the light source 12 photographed are a portion of the same data or a portion of different data. Therefore, even in the case where the light source 12 photographed by the light receiver 21 is small, it is possible to stably generate the reception data Dr.
Note that, in the embodiment, although the example where the determination bits as determination data are added before and after the synchronization signal Sync is described, the determination bits may be added to at least two of a position before the divided transmission data, a position within it, and a position after it. In addition, instead of the determination bit which having one bit, a bit sequence including a plurality of bits may be added as the determination data.
In the second embodiment described above, the synchronization signal is searched from the entire image data. On the contrary, in a fifth embodiment described hereinafter, a candidate area for the position of the light source 12 is detected from the image data, and the synchronization signal is searched within the candidate area.
The candidate area detector 230 detects a candidate area corresponding to the light source 12 from the image data. For example, the candidate area detector 230 detects edges in the direction perpendicular to the scan line (hereinafter, for the convenience, referred to as a vertical direction) from the image data and sets an area where edges densely exist as a candidate area. Alternatively, the candidate area detector 230 sets an area having high correlation in luminance in the direction of the scan line (hereinafter, for the convenience, referred to as a horizontal direction) detected from the image data as a candidate area. In the case where the light source 12 emits a visible light which is sufficiently brighter than the peripheral portion, as illustrated in
Next, the light source detector 231 detects the area corresponding to the light source 12 by retrieving the synchronization signal Sync within the candidate area.
In this manner, in the fifth embodiment, the candidate area corresponding to the light source 12 is determined in advance, and the synchronization signal is searched within the candidate area instead of the entire image data. Therefore, it is possible to more accurately detect the position of the light source 12 and to reduce the processing amount and calculation time of the light source detector 231.
In a sixth embodiment described hereinafter, a focal distance of the light receiver 21 is adjusted according to the reception data Dr.
b) illustrates the image data 22a in the case where the focal distance is set properly. In other words, between the two synchronization signals Sync, the reception data Dr=“001001” of one frame set equivalent to the transmission data Dt is generated without excess or deficiency.
a) illustrates the image data 22a in the case where the focal distance is set to be too long. In this case, in addition to the data “001001” between the two synchronization signals Sync, Data “0010” are generated after the second synchronization signal Sync. The data are longer than one frame set. In this case, since the light source 12 is photographed in a large size, the light source 12 is photographed to be dark, so that there is a problem in that erroneous reception data Dr may be generated. In addition, in the case where a plurality of light sources 12 emit visible light on which the transmission data Dt are superposed, there is a problem in that only one light source 12 can be photographed. Therefore, in the case of
c) illustrates the image data 22a in the case where the focal distance is set to be too short. In this case, only data “001” shorter than one frame set are disposed after the synchronization signal Sync, and the reception data Dr become an erroneous value where a bit is omitted. Therefore, in the case of
By taking into consideration the above configuration, the sixth embodiment will be described.
In the case where the reception data Dr are too long (NO in Step S22 and NO in Step S23), the adjustor 25 generates a focal distance adjustment signal for making the focal distance of the light receiver 21 closer (Step S24).
On the other hand, in the case where the reception data Dr are too short (NO in Step S22 and YES in Step S23), the adjustor 25 generates a focal distance adjustment signal for making the focal distance of the light receiver 21 farther (Step S25).
Next, the adjustor 25 adjusts the focal distance of the light receiver 21 according to the focal distance adjustment signal (Step S26). The above-described feedback operation is repeated, so that the focal distance of the light receiver 21 is properly set.
In this manner, in the sixth embodiment, the adjustor 25 is provided so as to adjust the focal distance of the light receiver 21 according to the reception data Dr. Therefore, the light source 12 can be photographed in an appropriate size, thereby, generating the reception data Dr at a higher accuracy.
In the above-described sixth embodiment, the adjustor 25 adjusts the focal distance of the light receiver 21. On the contrary, in the below-described seventh embodiment, the adjustor 25 adjusts the pint of the light receiver 21. Note that, the internal configuration of a light receiver according to the embodiment is the same as that of
In the case where the reception data Dr are too long (NO in Step S42 and YES in Step S43), the adjustor 25 generates a pint adjustment signal for making the pint of the light receiver 21 in focus (Step S44).
On the other hand, in the case where the reception data Dr are too short (NO in Step S42 and NO in Step S43) the adjustor 25 generates a pint adjustment signal for making the pint of the light receiver 21 out of focus (Step S45).
Next, the adjustor 25 adjusts the pint of the light receiver 21 according to the pint adjustment signal (Step S46). The above-described feedback operation is repeated, so that the pint of the light receiver 21 is set so that the reception data Dr are proper.
In this manner, in the seventh embodiment, the adjustor 25 adjusts the pint of the light receiver 21 according to the reception data Dr. Therefore, the light source 12 can be photographed in an appropriate size, thereby, generating the reception data Dr at a higher accuracy.
At least a part of the transmission system explained in the above embodiments can be formed of hardware or software. When the transmission system is partially formed of the software, it is possible to store a program implementing at least a partial function of the transmission system in a recording medium such as a flexible disc, CD-ROM, etc. and to execute the program by making a computer read the program. The recording medium is not limited to a removable medium such as a magnetic disk, optical disk, etc., and can be a fixed-type recording medium such as a hard disk device, memory, etc.
Further, a program realizing at least a partial function of the transmission system can be distributed through a communication line (including radio communication) such as the Internet etc. Furthermore, the program which is encrypted, modulated, or compressed can be distributed through a wired line or a radio link such as the Internet etc. or through the recording medium storing the program.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel methods and systems described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the methods and systems described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fail within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
2012-092471 | Apr 2012 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
4809257 | Gantenbein et al. | Feb 1989 | A |
5305092 | Mimura et al. | Apr 1994 | A |
5914981 | Veintimilla | Jun 1999 | A |
7308194 | Iizuka et al. | Dec 2007 | B2 |
7715723 | Kagawa et al. | May 2010 | B2 |
8248467 | Ganick et al. | Aug 2012 | B1 |
8565607 | Kang et al. | Oct 2013 | B2 |
8576146 | Park et al. | Nov 2013 | B2 |
8957951 | Ganick et al. | Feb 2015 | B1 |
20040066363 | Yamano et al. | Apr 2004 | A1 |
20050163201 | Krasner | Jul 2005 | A1 |
20060056855 | Nakagawa et al. | Mar 2006 | A1 |
20080044188 | Kagawa et al. | Feb 2008 | A1 |
20110109782 | Park et al. | May 2011 | A1 |
20110217044 | Kang et al. | Sep 2011 | A1 |
20120155889 | Kim et al. | Jun 2012 | A1 |
20140307157 | Oshima et al. | Oct 2014 | A1 |
20140321859 | Guo et al. | Oct 2014 | A1 |
Entry |
---|
Md. Shakowat Zaman Sarker et al.: “A CMOS Imager and 2-D Light Pulse Receiver Array for Spatial Optical Communication”: IEEE Asian Solid-State Circuits Conference: Nov. 16-18, 2009: Taipei, Taiwan16 pp. 113-116 (in English). |
Shinya Itoh et al.: A CMOS Image Sensor for 10Mb/s 70m-Range LED Based Spatial Optical Communication: 2010 IEEE International Solid-State Circuits Conference: pp. 402-404 (in English). |
Number | Date | Country | |
---|---|---|---|
20130272717 A1 | Oct 2013 | US |