Patent Grant
9898637
The present invention relates to a two-dimensional code.
Compared to one-dimensional codes, two-dimensional codes are capable of storing more information in a smaller area and are thus widely utilized in a variety of applications, including inventory management and Web derivatives using mobile phones. Since two-dimensional codes are photographed (taken) at various angles, the sizes and the orientations of their images projected on a screen are not constant, and distortion, blurriness and the like of the images may occur. Further, when a two-dimensional code is dirty, a part of its image may not be recognized.
In conventional two-dimensional codes, great importance was attached to the data efficiency and this consequently made the two-dimensional codes likely to be adversely affected by contamination, out-of-focus photographing and the like. For example, in a case where an inventory is made using a plurality of two-dimensional codes projected on a single screen, it is difficult to bring all of the two-dimensional codes into focus when taking an image thereof, and an out-of-focus image is thus likely to be produced. Since it is difficult to correct an out-of-focus or blur image of a two-dimensional code and an improvement by software is thus limited, an improvement of hardware, such as an improvement of the auto-focus function and an increase in the shutter speed, is required, and this leads to a problem of an increased cost. Recently, there is a need for a two-dimensional code to be recognized by cameras mounted on mobile phones; however, because such cameras are used in an environment that is likely to create problems for the analysis of a two-dimensional code, such as image blurriness caused by tilting, movement or insufficient focusing of the cameras during photographing, and also from the standpoint of their cost and size, it is difficult to improve the mobile phone cameras and the like at present.
[Patent Document 1] Japanese Laid-open Patent Publication No. H7-254037
[Patent Document 2] Japanese Laid-open Patent Publication No. 2004-234318
[Patent Document 3] Japanese Laid-open Patent Publication No. 2007-241328
[Patent Document 4] Japanese Laid-open Patent Publication No. 2009-163720
[Patent Document 5] Japanese Laid-open Patent Publication No. 2009-075873
There have been used and proposed a variety of two-dimensional codes; however, there is still a demand for a two-dimensional code which can be accurately recognized in a short time even when it is photographed under various conditions.
An object of the present invention is to realize a two-dimensional code which is not likely to be affected by contamination thereof, out-of-focus photographing or the like and can be accurately recognized in a short time even when it is photographed under various photographing conditions.
In order to achieve the above-described object, the two-dimensional code of the present invention is a two-dimensional code comprising cells representing binary-coded data that are arranged as a pattern on a two-dimensional matrix, the two-dimensional code being characterized by comprising: a position detection pattern; plural data blocks created by dividing a region of the two-dimensional matrix that excludes the part of the position detection pattern; and a separation space arranged between adjacent plural data blocks.
Therefore, the accuracy of light-dark determination of cells in each data block is improved.
It is desired that the plural data blocks comprise a format information block indicating which of plural expressions is represented by the data blocks.
Therefore, the data capacity and redundancy of the two-dimensional code can be set as appropriate in accordance with the intended use and use environment of the two-dimensional code.
One of the plural expressions is 7-bit expression in which eight cells other than the central cell are fixed to contain four light cells and four dark cells, the 7-bit expression representing 140 patterns.
The other of the plural expressions is 6-bit expression in which eight cells other than the central cell are fixed to contain four light cells and four dark cells and the central cell is fixed to be light or dark, the 6-bit expression representing 70 patterns.
It is desired that the position detection pattern has an area larger than the data block.
Further, it is also desired that the data blocks each have a size of 3×3 cells, that the separation space have a width of one or more cells, and that the position detection pattern has a lateral width of four or more cells and a vertical length of four or more cells.
Therefore, the accuracy of detecting the position detection patterns is improved.
A method of analyzing a two-dimensional code comprising plural data blocks that contain format an information block comprises: identifying a position detection pattern; calculating the position of the format information block based on the thus identified position detection pattern; analyzing the format information block; determining which of plural expressions is represented by the data blocks; and performing an analysis in accordance with the thus determined expression of the data blocks.
Further, a system for generating the above-described two-dimensional code comprises: a position detection pattern-arranging means for arranging the position detection pattern at prescribed positions of a two-dimensional matrix; a dividing means for dividing a region of the two-dimensional matrix outside the regions where the position detection pattern is arranged into plural blocks between which a separation space is arranged; an information block-arranging means for selecting, from the plural data blocks, information block in which information required for analysis of the two-dimensional code is arranged; and a message data-arranging means for adding a message header to each message to be recorded and sequentially arranging recorded data, in which an end message header is added to the tail of each message, in a region of the two-dimensional matrix outside the regions of the position detection pattern and the information block.
By using the two-dimensional code of the present invention, even a photographed image of the two-dimensional code on which various deteriorations have occurred can be accurately analyzed.
Before describing the embodiments of the present invention, a general two-dimensional code widely used at present will be described.
As illustrate in
The data region 3 comprises bits that are densely arranged in a matrix form, and the bit matrix is divided into: alignment patterns (timing cells) 4, which are used for correction of the positions of the dots within the data region; format information of the two-dimensional code and its error correction signals; version information and its error correction signals; and data part. The alignment patterns 4, the format information of the two-dimensional code and its error correction signals, and the version information and its error correction signals are arranged at prescribed positions on the bit matrix of the code region 3. The remaining part is the data part where coded data are recorded, and the part left after recoding the necessary data is composed of remainder bits. The data bits to be recorded are distinguished from the remainder bits by an end pattern placed at the end of the data bits. The remainder bits, which are referred to as “padding”, are a string of light (“1”) bits; however, upon being recorded, they are generally subjected to a prescribed processing to be converted into a string of light and dark bits.
The alignment patterns 4 is a string of light and dark bits (dots) used for correction of the positions of the dots within the data region and, as illustrated in
In Patent Documents 3 and 4, it is described that bits of the data region 3, which are padding, are utilized to provide a bit image.
Embodiments of the present invention will now be described.
The two-dimensional code of the first embodiment has a size of 35×35 cells and is divided into 9×9 blocks, with a one-cell light separation space 23 being arranged between adjacent blocks. Accordingly, the separation space is an 8×8, one-cell-width lattice pattern having grids at block-size intervals. A first position detection pattern 12A is arranged in the part of the lower right 3×3 block and 3×3 separation space; a second position detection pattern 12D is arranged in the part of the upper left 2×2 block and 2×2 separation space; a third position detection pattern 12B is arranged in the part of the upper right 3 (lateral)×2 (vertical) block and 3×2 separation space; and a fourth position detection pattern 12C is arranged in the part of the lower left 2 (lateral)×3 (vertical) block and 2×3 separation space. Accordingly, in the two-dimensional code, no pattern other than the first to the fourth position detection patterns appear in the blocks, except in those where the first to the fourth position detection patterns are arranged.
The minimum unit of a code part of a two-dimensional code is a cell. Two-dimensional codes usually take a square or rectangular shape. A two-dimensional code can also take other shape; however, two-dimensional codes are mostly tetragonal, and the two-dimensional code of the first embodiment also has a square shape. The shape of the two-dimensional code of the first embodiment is not restricted thereto and may be rectangular or another shape.
Generally, two-dimensional codes represent data with light and dark cells, and the code part of the two-dimensional code of the first embodiment also represents data with light and dark cells. There have been proposed two-dimensional codes whose cells are distinguished by color, such as the one described in Patent Document 2, as well as mirror (laterally reversed)-type two-dimensional codes. The present invention can be applied to such two-dimensional codes; however, in these cases as well, as described below, the two-dimensional codes comprise four or more position detection patterns of different forms.
The two-dimensional code of the first embodiment is a square of 35×35 cells; however, the size thereof can be increased, or the two-dimensional code can have a shape with different vertical and lateral sizes, such as a rectangular shape. A 35×35-cell square two-dimensional code is referred to as “version 2×2”. The smallest version is “1×1”, which has a cell size of 27×27. It is defined here that a design can be embedded when the vertical and lateral versions are both 2 or higher. The reason why such a restriction of not embedding a design into a code of version 1×1 is implemented is because embedding of a design despite the small data capacity of the code further reduces the data capacity and recognition of the code would consequently yield hardly any data. The two-dimensional code of the first embodiment can be extended in each of the vertical and lateral directions. When the lateral version is 2 and the vertical version is 3, the code is denoted as “version 2×3”. An increase in the version by 1 corresponds to an increase in the cell size by 8 and an increase in the block number by 2. Accordingly, a code of version 3×4 has a cell size of 43×51. The version can be selected to be, but not limited to, 1 to 20.
The first position detection pattern 12A has dark cell parts composed of a single-cell-width square frame of 8×8 cells in size and a 2×2 square in the center of the square frame. The second position detection pattern 12D has a dark cell part of a single-cell-width square frame of 4×4 cells in size. The third position detection pattern 12B has a dark cell part of a single-cell-width laterally-elongated rectangular frame of 8×4 cells in size. The fourth position detection pattern 12C has a dark cell part of a single-cell-width vertically-elongated rectangular frame of 4×8 cells in size.
In the first embodiment, the four different position detection patterns are each arranged at the four corners of the square two-dimensional code. The phrase “different position detection patterns” means that the position detection patterns are different in terms of shape, size and arrangement orientation on the two-dimensional code, and also include cases where the position detection patterns have different line width ratios. However, since color is affected by the photographing conditions and the like, color is not included as a subject of the difference, and a difference in a light-dark binary image is considered.
In the first embodiment, the position detection patterns are arranged in the vicinity of each apex of the square or rectangle. This is because, as compared to a case where the position detection patterns are arranged in one spot, the effects of contamination can be more dispersed by arranging them as far as possible from each other. However, the arrangement positions of the position detection patterns are not restricted to the four corners. As in the first embodiment, by using not only square position detection patterns but also rectangular ones, their shapes, tilt angles and sizes can be easily distinguished, so that the position detection patterns can be quickly recognized. In addition, since hollow rectangles are easily distinguished from other projected images, the data loss is small.
As for the reason why the four position detection patterns are arranged, in two-dimensional projective transformation used for calculating the mapping of the data coordinate with high accuracy in analysis, in order to calculate the coordinate of the code cells and photographed image corresponding to the cells, it is required that a set of four coordinate be provided as a parameter. Even when only two or three position detection patterns are arranged, projective transformation can be carried out by calculating four points with interpolation of coordinate; however, since precise coordinate are not likely to be obtained due to tilted image capturing, image distortion, blurriness and the like and this greatly affects the accuracy of data extraction, four position detection patterns are arranged in the first embodiment.
Further, the reason why the position detection patterns are different from each other is because, even if a position detection pattern were not recognized, the unrecognized position detection pattern can be surely identified, and this enables estimation the coordinates of the unrecognized position detection pattern and, hence, correction of the position detection pattern. When all the same position detection patterns are used, the identification of an unrecognized position detection pattern is not as easy as in a case of using position detection patterns that are all different, and correction of the position detection pattern is thus difficult.
In the two-dimensional code, 56 blocks other than those of the four position detection patterns constitute the data region, comprising: actual data blocks; error correction code blocks; version information blocks; format information blocks; and design-embedding information blocks.
As described above, each block of the data region is constituted by 3×3 cells and data is embedded block by block. The data region comprises: version information blocks 15 and 16; format information blocks 17; and design-embedding information blocks 18A, 18B, 19A and 19B, with the remaining blocks being actual data blocks 22. As described below, in the first embodiment, some of the actual data blocks 22 are utilized for error-correcting codes and position correction patterns.
Accordingly, the blocks 22, remaining after excluding therefrom the position detection patterns, version information blocks, format information blocks, design-embedding information blocks, blocks in which a position correction pattern is arranged and error correction code blocks, are the actual data blocks. When a design is embedded, a design-embedded block(s) indicated by the design-embedding information blocks is/are also excluded from the actual data blocks. In the blocks belonging to the actual data blocks, the actual data are recorded in such a manner that the actual data are sequentially filled from the upper left to the right side and, once a row of blocks are filled, the actual data are then filled into the next lower row of blocks sequentially from the left.
The blocks each have a size of 3×3 cells with each cell representing one light or dark bit, and each block thus stores a maximum of 9-bit information (9-bit expression). In order to improve the tolerance to image blurriness and fuzziness, the data capacity per block can be set to be smaller than 9 bits. In the first embodiment, the blocks were set to have a size of 3×3 cells; however, the block size is not restricted thereto. The blocks can also have a size of 1×1 cell, which is the minimum size, or a size in which, for example, the vertical and lateral cell sizes are different.
The version information blocks record information on the size of the two-dimensional code. There are two types thereof, which are vertical version information blocks 15 and lateral version information blocks 16, and each of them records the corresponding version information. By arranging two vertical version information blocks 15 and two lateral version information blocks 16, each type of which blocks records the same information, at two distant spots, the risk of a defect caused by contamination or the like is dispersed. As version information, blocks representing a numerical version number (from 1 to 20 for each of the vertical and lateral directions) are arranged.
Each format information block 17 records format information composed of a design-embedding flag (1 bit) and data-block-type data (2 bits), and three format information blocks 17 all storing the same information are arranged at three spots. The design-embedding flag indicates the presence or absence of an embedded design, i.e., whether or not a design-embedding region is arranged. When a design is embedded, design-embedding information blocks are arranged. The data-block-type data indicates the type of the data blocks, which means the data capacity per block and is selected to be 6, 7 or 9 bits/block. The data capacity decreases in the order of 9-bit, 7-bit and 6-bit expressions (9 bits>7 bits>6 bits); however, the data can be more easily read out in the order of 6 bits>7 bits>9 bits. The type of the data blocks is thus selected taking into consideration the level of image blurriness and fuzziness as well as the data capacity. This point will be described later.
A design is embedded block by block and, when a plurality of adjacent blocks constitute a design-embedding region, the separation spaces between the blocks are also included in the design-embedding region. The design to be embedded has a tetragonal external shape, and the image thereof may be any image, without being restricted to a cell-resolution binary image. Further, a plurality of tetragonal blocks may be provided for embedding a design therein. For example, the design may be a multi-valued image having a higher resolution than the cells or a color image, or the design may be, of course, a cell-resolution binary image. In the first embodiment, as a restriction on embedding of a design, it is prescribed that no design be embedded into the two upper block rows, two left block columns, three lower block rows and three right block columns of the code. In these areas outside the design-embedding region, depending on the specification of the two-dimensional code, design-embedding information blocks having image information are arranged.
The design-embedding information blocks record information pertaining to the size of the region where a design is embedded as well as the positions of the blocks therefore in either the vertical or lateral direction.
There are two types of design-embedding information blocks, which are vertical-embedding information blocks 18A and 18B and lateral-embedding information blocks 19A and 19B, and each of them records the corresponding version information. The vertical-embedding information blocks 18A and 18B record the height of the embedded design (3 bits or 6 bits) and the offset height of the embedded design (3 bits or 6 bits). The lateral-embedding information blocks 19A and 19B specify the width of the embedded design (3 bits or 6 bits) and the offset width of the embedded design (3 bits or 6 bits). Whether 3-bit information or 6-bit information is recorded depends on the version information as described below. When the version is 2 to 4, 3-bit information is required; when the version is 5 to 20, 6-bit information is required; and when the version is 2 to 4, the vertical-embedding information block 18B and lateral-embedding information block 19B are not necessary.
The design-embedding information blocks exist only when a design-embedding flag is waved in a format information block. The first embodiment assumes a case where only one design is embedded. When it is assumed to embed plural designs into plural regions, the bit number of the design-embedding flag is increased in the format information block so as to indicate the number of design-embedding regions and, at the same time, the design-embedding information block is arranged as many as the number of the designs. The size and offset of each design are specified at a block level. The block coordinates are expressed as “(n, m)” with the block in the upper left corner being the origin, and the number of lateral blocks and that of vertical blocks are expressed as “blW” and “blH”, respectively. In the first embodiment, the design-embedding region is restricted to a rectangular region formed by an upper left corner (2, 2) and a lower right corner (blW-4, blH-4). Accordingly, the maximum number of lateral blocks of a design is blW-5 and the maximum number of vertical blocks of a design is blH-5.
With regard to the position of a design, by embedding the information on the block coordinates of the starting point (upper left) and the block size into the code as design-embedding information blocks, the position of the embedded design can be recognized when the code is analyzed. In the same manner as in the case of the version information blocks, the lateral and vertical information blocks are handled separately. Different data capacities are assigned between cases where blW-5 is less than 8 (lateral version of 2 to 4) and other cases (lateral version of 5 to 20), and the vertical information blocks are handled in the same manner. The values of blW and blH are determined by analyzing the lateral and vertical versions, respectively.
When the value of blW is less than 13, the lateral block size has a minimum of 1 block and a maximum of 8 blocks, and these 8 block sizes can all be represented by 3 bits. In the same manner, the number of the lateral offset blocks has 7 possibilities, which are 2 to 8, and these 7 numbers can also be represented by 3 bits; therefore, the total data capacity is 6 bits. Accordingly, these lateral block data are represented by 6 bits, which can be expressed using a single block. The same also applies to the vertical blocks. Meanwhile, when the value of blW is 13 or larger, the lateral block size is represented by 6 bits and, in the same manner, the number of the lateral offset blocks is also represented by 3 bits. Accordingly, these lateral block data are expressed using two blocks. The same also applies to the vertical blocks.
The lateral-embedding information blocks 19A and 19B are both arranged outside (in the upper and lower sides of) the upper-left and lower-right lateral version information blocks, and the vertical-embedding information blocks 18A and 18B are arranged outside (in the left and right sides of) the lower-left and lower-right vertical version information blocks.
When no design is embedded, i.e. when the design-embedding flag of the format information block indicates “null”, the design-embedding information blocks and the region for embedding a design are no longer necessary, making the code efficient.
The position correction patterns are used for the purpose of correcting the coordinate of the actual data blocks and error correction code blocks, as well as the coordinate of the design-embedding information blocks when a design is embedded. In the two-dimensional code, these coordinate can be approximately obtained from the position detection patterns; however, since errors occur in the coordinate of the data region due to twisting or bending of the paper, distortion of the lens or displacement during acquisition of the position detection patterns, the position correction patterns are arranged for correcting such errors. The position correction patterns are different from the position detection patterns in that they do not have to be distinguished from other noises, and the positions of the position correction patterns are easily determined as long as the position detection patterns can be calculated. Therefore, it is desired that the position correction patterns have such a form that enables fine coordinates corrections.
In the first embodiment, as position correction patterns, blocks composed of a combination of predetermined cells (position correction blocks) are arranged at regular intervals in place of actual data. If a block coordinates (7n, 7m) (wherein, n and m are each an integer of 0 or larger) is in the data region, a block in which a dark central cell is surrounded by light cells is arranged at the coordinates. However, should a position detection block, a version information block, a format information block, a design-embedding information block or a design exist at the coordinates, no position correction block is arranged. Here, the block coordinates are expressed by defining the coordinates of the upper-left block as the reference coordinates (0, 0), with the coordinates of the adjacent block on the right being (1, 0). It is noted here that the block in which the position correction patterns are arranged is not restricted to the above-described one.
As the actual data, segments each composed of a combination of a message and a header modifying the message (message type (message encode) message size) are arranged as many as the number of the messages. In addition, as a special segment, a segment which contains only an end flag without any message is generated and, when a capacity of the actual data is left unused, this end-flag segment is arranged, followed by padding. The actual data are divided into block units in accordance with the data capacity per block which is indicated by the data-block-type data. In the same manner, the error-correcting codes are also divided into block units.
When Reed-Solomon codes are used as the error-correcting codes, since the error corrections are performed word by word, it is desired that one word constitutes one block. When one word spans over a plurality of blocks, even if only one of the blocks is contaminated, all of the words associated with the block are subjected to the error correction, which impairs the correction efficiency. Contamination and spotlight-caused color fading that lead to corrections are often concentrated in one spot. The division of the actual data into blocks has an effect of putting together the data to be simultaneously corrected into one spot, and this enables efficient corrections and improves the probability of the code to be recognized.
As described above, the two-dimensional code of the first embodiment comprises the separation space 23 of a single cell in width, which is arranged between the blocks. Therefore, the position detection patterns and the blocks are all surrounded by light cells.
As compared to the two-dimensional code without the separation space 23, the two-dimensional code having the separation space 23 is larger and thus has a lower data efficiency; however, since it is not likely to be affected by the patterns of the adjacent blocks even when its photographed image is out-of-focus or blur, the accuracy of light-dark determination of each cell is improved. In fact, when an image of the two-dimensional code having the separation space 23 and that of the two-dimensional code without the separation space 23 are both subjected to binarization, blackening-out of cells is more likely to occur in the latter image. When the photographed image is out-of-focus or blur, the cells are each affected by the color of the surrounding cells. In
In this manner, by arranging the separation space 23, the risk that the cells may not be properly recognized due to blurriness or fuzziness can be reduced.
As for the position detection patterns, even the smallest second position detection pattern 12D is a square of 4×4 cell in size and the blocks of 3×3 cells in size are separated by the separation space 23, a pattern identical to any of the position detection patterns does not appear in the data block. Therefore, by arranging the separation space 23, the detection process of the position detection patterns can be easily carried out.
In the first embodiment, the data capacity per block can be selected separately for each type in accordance with the resistance to data deterioration.
When analyzing the data type of
When the data type is 6-bit expression, both (B) and (C) can be used; however, the same data type is used on the encoding and decoding sides.
When analyzing the data type of
It is demanded that a two-dimensional code be recognized under a variety of photographing environments. Light has adverse effects on photographed images, such as localized color changes and gradual color changes, and these effects are the factors that make it difficult to generate an appropriate binarized image from a photographed image.
This method is advantageous in that it does not require a binary threshold. The method has an effect of enabling to determine whether cells are light or dark based on the relationships of the relative pixel values of the cells, even without deriving a binary threshold. In addition, also against localized strong color changes caused by a spotlight or the like, since relevant cells are clustered into blocks and this increases the probability of all of the cells to be uniformly affected, even if the cells are entirely whitened, the relationships of their relative pixel values are maintained, so that the code is highly like to be recognized.
In
In the analysis method of this data type, the analysis of the surrounding cells is carried out in the same manner as in the case of 6-bit expression. In addition, in the analysis of the center pixel, the pixel value of the cell having the lowest pixel value among the four points with high pixel values and the pixel value of the cell having the highest pixel value among the four points with low pixel values are defined as G1 and G2, respectively, and the coordinates of the cell in the center of the block in the photographed image is calculated. When the thus obtained pixel value is not smaller than (G1+G2)/2, the central cell is determined to be a light cell. Otherwise, the central cell is determined to be a dark cell.
In this method, since the evaluation of the central cell utilizes a threshold value obtained from the analysis of the adjacent cells and it is highly likely that the central cell and its adjacent cells are subjected to substantially the same effects of the photographing environment, the code can be recognized with high accuracy.
In
As described above, in the first embodiment, according to the data-block-type data (2 bits) in the format information blocks 17, any one of the above-described 9-bit expression, 7-bit expression and 6-bit expression is selected. If necessary, 3-bit expression may also be included in the selectable expressions.
In the first embodiment, the version information blocks and format information blocks, which record important information, utilize a 20-pattern-expression data type, which will now be described.
By using this data type, even in a condition where the code version and the cell size are unclear in the analysis, as long as the position of a position detection pattern in a photographed image is determined, data can be extracted from the data blocks. When the version and the cell size are unclear, even if the coordinates of a position detection pattern in a photographed image is known, the data block coordinate cannot be calculated. However, data blocks can be found by scanning in the direction from a position detection pattern toward its adjacent position detection pattern (the first and second position detection patterns are adjacent to the third and fourth detection patterns). In
The version information blocks and format information blocks are data blocks that are important in the analysis process. A 20-pattern expression is carried out by arranging these data blocks to have such positional relationships with respect to each position detection pattern as illustrated in
The position detection patterns, those having various shapes can be used, and the two-dimensional code can also take a variety of sizes and the like.
(1) A first position detection pattern 52A has only a square frame composed of dark cells with no square being arranged therein. In addition, second and third position detection patterns 52B and 52C both have a rectangular shape that is nearly a square. A fourth position detection pattern 52D has the same shape as that of the position detection pattern 12D of the first embodiment.
(2) The block size and the block constitution are different. In particular, the block constitution of the outer parts sandwiched between the position detection patterns in both the lateral and vertical directions is different. In these parts, a series of blocks, which are two vertical information blocks 55, two lateral version information blocks 56, three format information blocks 57, two vertical design-embedding information blocks 58, two lateral design-embedding information blocks 59, and position correction patterns 54A and 54B, is arranged.
The remaining blocks 60 are composed of actual data blocks, error correction code blocks, blocks having position correction patterns, and design-embedding region(s).
Other parts are the same as those of the first embodiment; therefore, description thereof is omitted.
There are various sizes and forms of two-dimensional codes and any of them can be applied to the two-dimensional code of the present invention.
Preferred forms of the position detection patterns will now be examined.
In the present invention, the following points are desired for the position detection patterns: (1) the four types of position detection patterns can be distinguished from one another based on the shape, size or orientation on the two-dimensional code; (2) the types of the position detection patterns can be distinguished from one another using a simple algorithm; (3) for the thus distinguished position detection patterns, a combination thereof is easily determined (which contributes to high-speed recognition); (4) the position detection patterns have a reduced cell size; (5) the position detection patterns can be easily distinguished from a projected image other than the image of the two-dimensional code; and (6) no other position detection pattern appears within the two-dimensional code.
It can be said that the position detection patterns of
Square and rectangular position detection patterns having various combinations of frame width and identification space width, i.e., cell size, were generated. The thus generated position detection patterns were photographed such that the resulting images were blur and fuzzy, and the images were binarized to test whether or not the position detection patterns could be distinguished. Consequently, it was discovered that the position detection patterns could be easily distinguished from other projected images, depending on the presence or absence of an identification space inside the frame; that a single-cell space and a single-cell square therein are easily affected by blurriness; and that the width of the outer frame does not largely affect the tolerance to blurriness.
From these results, it was discovered that a square or rectangular frame having a two-cell identification space inside is useful. The reason for this is believed as follows. In a two-dimensional code in which the smallest cell represents 1 bit, when blurriness or fuzziness occurs over an area of one cell or larger, even if the positions of the patterns could be detected, data cannot be acquired. Under normal photographing conditions, blurriness or fuzziness rarely occurs over an area of one cell or larger; therefore, an identification space of two cells in size can handle single-cell blurriness and fuzziness in all directions.
The second position detection pattern described in the first embodiment, which is a square of 4×4 in cell size, has a constitution of the minimum cell size that has the above-described space.
The first position detection pattern has a constitution in which a single-cell-width frame, a two-cell space and a two-cell square are layered. When the center of this position detection pattern is scanned, regardless of its orientation, a dark-light-dark-light-dark pattern is obtained, which is clearly different from the second position detection pattern and noises.
As for the forms of the third and fourth position detection patterns, it is desired that the frames of the position detection patterns exist on the extension of the frames of other position detection patterns. By this, when a position detection pattern is missing, the accuracy of estimating the coordinates of the missing position detection pattern can be improved.
The forms of the third and fourth position detection patterns of the first embodiment comply with these conditions. Since these position detection patterns are each tilted by 90° and have an aspect ratio that is different from those of the first and second position detection patterns, the third and fourth position detection patterns can be easily distinguished from the first and second position detection patterns.
The second embodiment has a constitution in which the cell size occupied by the position detection patterns is the smallest. The first and second position detection patterns have the same shape but different sizes, with the second position detection pattern having a size of 5×5 cells. For the same reason as described above, the third and fourth position detection patterns are generated.
These position detection patterns have a cell size of 16+64+32+32=144 cells in the first embodiment and 16+25+20+20=81 cells in the second embodiment.
Despite the two-dimensional code illustrated in
The first embodiment has a larger cell size than the second embodiment; however, the position detection patterns of the second embodiment all have similar areas in size and their detection accuracy is thus likely to be affected when they are photographed at an angle. Meanwhile, in the first embodiment, the first and second position detection patterns have different forms and the third and fourth position detection patterns are in different orientations. The first and second position detection patterns are different from the third and fourth position detection patterns in terms of the aspect ratio. These position detection patterns can be adequately distinguished even when they are photographed at an angle, which is a constitution useful for distinguishing the position detection patterns.
Further, around each of the position detection patterns of
In the spirit of the present invention, position detection patterns of other forms can also be used and various modifications can be made.
Next, the process of generating the two-dimensional codes of the first and second embodiments (encoding process) will be described.
The generating system comprises: a user hardware which is operated by a user who determines the specifications and requests a two-dimensional code to be generated; and a system hardware which generates and provides the requested two-dimensional code.
The user hardware comprises: a user processing unit 61, such as a computer; and a memory device 62, such as a magnetic disk.
The system hardware comprises: a system processing unit 65, such as a computer; and a memory device 66, such as a magnetic disk.
The user processing unit 61 and the system processing unit 65 are configured to enable communication therebetween, being connected through a communication line or the like.
Printing is performed on the user side; however, it may also be performed on the system side or at other printing place. A two-dimensional code may be printed on any medium such as a sheet of paper, a resin plate or a casing surface. A design to be embedded may be printed on the medium in advance, and a two-dimensional code is printed after setting the medium such that the printed design to be embedded is fitted into the design region.
Any printing apparatus can be employed as long as it is capable of printing a two-dimensional code on the above-mentioned media, and the printing apparatus may be, for example, a simple printer, a precision printers, or other printing apparatus capable of performing not only monochrome printing but also color printing. The generated two-dimensional code may also be transmitted as two-dimensional code data to the user via the communication line, without being printed. The user, as required, then transmits the data to a third party display or the like so that the generated two-dimensional code is displayed.
In the step S10, the user initiates the main encoding process.
In the step S11, the user inputs a message(s) to be recorded in a two-dimensional code.
In the step S12, the user decides whether or not to embed a design into the two-dimensional code. If the user decided to embed a design, the user proceeds to the step S13 and, if the user decided not to embed a design, the user proceeds to the step S15, which is carried out in the system side. In the latter case, the user processing unit 61 notifies the system processing unit 65 about the message(s) and the absence of design to be embedded.
In the step S13, the user inputs the position of the block into which the design is embedded (design-embedding offset width, design-embedding offset height, design-embedding width and design-embedding height). The user processing unit 61 notifies the system processing unit 65 about the input message(s), the presence of a design to be embedded and the position of the block(s) into which the design is embedded.
In the step S14, in the system side, the block size of the design is determined based on the transmitted block position.
In the step S15, the block size for recoding the transmitted message(s) is determined.
In the step S16, the minimum vertical version is calculated for all lateral versions. In this calculation, from a value obtained by multiplying the number of vertical blocks by that of lateral blocks, the number of the position detection pattern blocks, the version information blocks and the format information blocks as well as, when a design is embedded, the design-embedding information blocks, the blocks corresponding to the design-embedding region and the position correction pattern blocks, is subtracted to determine the number of remaining blocks. Further, from this number of blocks, the number of error correction code blocks arranged to attain a certain error correction rate is subtracted, and the size of the message-recording actual data blocks that can be contained is indicated in a table form. The system processing unit 65 transmits the thus calculated table data to the user processing unit 61.
In the step S17, a table of the vertical-lateral versions is indicated to the user, and the user determines which version to be used. The user processing unit 61 transmits the thus determined vertical-lateral version to the system processing unit 65.
In the step S18, in the system side, based on the transmitted vertical-lateral version and the block size corresponding to the design-embedding region, the block size of the actual data is determined.
In the step S19, in the system side, based on the transmitted vertical-lateral version and the block size corresponding to the design-embedding region, the block size of the error-correcting code is determined.
In the step S20, in the system side, the positions of the version information blocks and format information blocks are determined. In addition, when a design is embedded, the positions of the design-embedding information blocks and design-embedding region blocks are also determined.
In the step S21, in the system side, it is determined whether or not a design is embedded. When a design is embedded, the system proceeds to the step S22, while when no design is embedded, the system proceeds to the step S23.
In the step S22, the design-embedding information blocks are arranged at prescribed positions on the code image part.
In the step S23, the position detection patterns and the position correction patterns are arranged on the image part.
In the step S24, the version information blocks and the format information blocks are arranged on the image part.
In the step S25, a message header is added to each message.
In the step S26, it is determined if there is still a space left for putting data. When there is a space left, the system proceeds to the step S27, while when there is no space left, the system proceeds to the step S29.
In the step S27, an end message header (end flag) is added to the end of the message data.
In the step S28, padding is added to the remaining actual data region.
In the step S29, the actual data are made into blocks and arranged on the image part.
In the step S30, the error correction code blocks are arranged on the image part.
In the step 31, the system processing unit 65 outputs and transmits a code image generated in the above-described manner to the user processing unit 61.
In the step 32, in the user side, it is determined whether or not a design is embedded. When a design is embedded, the user proceeds to the step S33, while when no design is embedded, the user proceeds to the step S34 to finish the encoding process.
In the step S33, a whole image is generated by integrating the transmitted code image with the data of the design to be embedded into the block(s) of the design-embedding region. The embedding of the design may also be performed by the system processing unit in the form of, for example, data attachment.
In the step S34, the main encoding process is finished.
In the above-described embodiment, the user side has the design data; however, the design data may be stored in the system side and specified by the user.
The two-dimensional code analyzer comprises: a reading unit 70; a computer (two-dimensional code analysis/processing unit) 74; a display 75; and a communication interface 76. The reading unit 70 comprises: a lens 71; an image sensor 72; and an analog-digital converter (AD) 73, and outputs digital image data of photographed two-dimensional code to the computer 74. The two-dimensional code analyzer illustrated in
In the step S101, the main analysis process is initiated.
In the step S102, photographed images of two-dimensional codes are input.
In the step S103, binary images of each input photographed image are generated. As for the binarization method, when the input photographed image is a color image such as an RGB image, it is once converted into a gray-scale image. An average of the maximum and minimum brightness values in the image is taken as a threshold value, and pixels with a value of not less than the threshold value are defined to be “light” and pixels with a value of less than the threshold value are defined to be “dark”. The gray-scale conversion of the color image is carried out using the RGB values of the respective pixels, in accordance with a conversion formula: Brightness=0.299R+0.587G+0.114B. The conversion method is not restricted to the above-described one as there have been proposed a variety of methods for conversion of a color image into a gray-scale image as well as for further conversion of the gray-scale image into a binary image.
In the step S104, candidate position detection patterns are detected. Specifically, starting at an upper left point of the image, the image is scanned in the X direction and, once reaching the right edge, the image is scanned in the X direction from the left edge starting at several pixels below. In other words, several pixels are omitted from the scanning. This scanning operation is repeated for the entire image. The number of the omitted pixels is: (Maximum number of omitted pixels)=(Minimum cell height of position detection pattern)×(Number of pixels per cell in photographing). Taking into consideration the rotation of the code as well, the minimum height of a position detection pattern refers to the minimum cell size in the Y direction that can be obtained by rotation of the position detection pattern and, in the present embodiment, the upper-left second position detection pattern in an unrotated state has a minimum height of 4 cells. When the number of pixels per cell in photographing is less than 1, even in an ideal image, it is difficult to distinguish a light cell from a dark cell. Considering displacement and rotation of cells in actual photographed images, it is desired that each cell have at least 3 pixels. When each cell has 3 pixels, the maximum number of the omitted pixels in the above-described case is 12 and the number of the image scanning operations is thus 1/12 of the total number of the pixels, so that the number of the scanning operations can be largely reduced.
In the step S105, the candidate position detection patterns are examined. Specifically, when a boundary between light and dark parts is found, the periphery of the dark part is scanned. In this process, the minimum and maximum X and Y coordinates of the dark part are determined. As a result, the circumscribing rectangle of the dark lump can be obtained. The upper left coordinates of this rectangle is represented as “(x1, y1)” and the lower right coordinates is represented as “(x2, y2)”. Once the periphery is scanned, no more scanning thereof is necessary.
Even if such periphery exploration is performed, the number of the image scanning operations can be sufficiently reduced. One example of worst case where the processing time becomes the longest due to such periphery exploration is when one-pixel vertical stripes are arranged at one-pixel intervals. However, such a case does not occur in the first place and, even if it did, the number of the perimeter exploration operations can be maintained to be the same as the number of the scanning operations required for scanning all pixels once; therefore, the number of the scanning operations is not increased. The same also applies to other worst case scenarios.
In the case of the two-dimensional code of
Next, the forms of the candidate position detection patterns are checked. The position detection patterns of the two-dimensional code of the first embodiment all have a frame shape, i.e., a hollowed shape. Thus, the presence or absence of a hole is verified. With the starting point being set at the central point on the left side of the circumscribing rectangle (x1, (y1+y2)/2) and the end point being set at (x2, (y1+y2)/2), scanning is performed in the x-axis direction. In this process, it is confirmed that the following condition (1) or (2) is satisfied.
(1) The presence of a dark-light-dark sequence is confirmed. It is also confirmed that the pixel in the center between the leftmost first dark pixel (l×1) and the rightmost second dark pixel (r×1) is light.
(2) A dark-light-dark-light-dark pattern is searched. It is conformed that the pixel in the center between the leftmost first dark pixel (l×2) and the rightmost second dark pixel (r×2) is dark.
Further, in the case of (1), as illustrated in
In the case of (2) as well, as illustrated in
By the above-described processing, the first position detection pattern having a dark part in a frame (a square in a square frame) can be distinguished from the second to fourth position detection patterns having only a frame (a square or rectangular frame: box-form).
A pattern that does not satisfy the condition of (1) or (2) is not a position detection pattern.
Next, the apexes of each position detection pattern are explored. Each position detection pattern is scanned in the x-axis direction from the upper-left coordinates (x1, y1) of the circumscribing rectangle to the coordinates (x2, y1). The coordinates of the first dark point coming into contact is designated as “vortex 1” (vx1, vy1). The position detection pattern is then scanned in the y-axis direction from the upper-right coordinates (x2, y1) to the coordinates (x2, y2). The coordinates of the first dark point coming into contact in this scanning is designated as “vertex 2” (vx2, vy2). The position detection pattern is further scanned in the opposite x-axis direction from the lower-right coordinates (x2, y2) to the coordinates (x1, y2). The coordinates of the first dark point coming into contact in this scanning is designated as “vertex 3” (vx3, vy3). Thereafter, the position detection pattern is scanned in the opposite y-axis direction from the lower-left coordinates (x1, y2) to the coordinates (x1, y1). The coordinates of the first dark point coming into contact in this scanning is designated as “vertex 4” (vx4, vy4). The vortexes 1 to 4 should form a rectangle (including a square). If not, the scanned pattern is not a position detection pattern. Description of
Subsequently, the aspect ratio of the rectangle is examined. The length of one side of the rectangle is determined as ((vx1−vx2)×(vx1−vx2)+(vy1−vy2)×(vy1−vy2))1/2, and the length of the other side is determined as ((vx2−vx3)×(vx2−vx3)+(vy2−vy3)×(vy2−vy3))1/2. When the rectangle has an aspect ratio, (long side):(short side), of 1:1 and the form of (1), it is the second position detection pattern; when the rectangle has an aspect ratio, (long side):(short side), of 1:1 and the form of (2), it is the first position detection pattern; and when the rectangle has an aspect ratio, (long side):(short side), of 1:2 and the form of (1), it is the third or fourth position detection pattern. So far, these three types of position detection patterns can be distinguished from each other.
Next, the area of each position detection pattern is determined. It is noted here that this “area” refers to the area of the outer rectangular frame and thus includes the area of the inside space. In the case of the first position detection pattern, the area of the square inside the frame is also included. The area of each position detection pattern can be determined by subtracting the areas of the four right-angled triangles including the four corners from the area of the outer rectangle: Area=(x2−x1)×(y2−y1)−(vx1−vx4)×(vy4−vy1)/2−(vx2−vx1)×(vy2−vy1)/2−(vx2−vx3)×(vy3−vy2)/2−(vx3−vx4)×(vy3−vy4)/2.
Then, the rotation angle is determined. For the first and second position detection patterns, since they are squares and a tilt of 90° or larger thus cannot be detected, a tilt angle is determined up to 90°. The angle is expressed in terms of clockwise rotation.
θ=arctan((vy2−vy1)/(vx2−vx1))
(wherein, θ represents a rotation angle)
For the third and fourth position detection patterns, the rotation angle is determined in a range of 0° to 180°. For the third position detection pattern, the distance between two coordinate is defined by a function: Length (x1, y1, x2, y2)=((x2−x1)2+(y2−y1)2)1/2. In a range of 0° to 45°, length (vx1, vy1, vx2, vy2)>length (vx4, vy4, vx1, vy1) and (x2−x1)>(y2−y1), and the rotation angle is determined by: θ=arctan((vy2−vy1)/(vx2−vx1)). In a range of 45° to 90°, length (vx1, vy1, vx2, vy2)>length (vx4, vy4, vx1, vy1) and (x2−x1)<(y2−y1), and the rotation angle is determined by: θ=arctan((vy2−vy1)/(vx2−vx1)). In a range of 90° to 135°, length (vx1, vy1, vx2, vy2)<length (vx4, vy4, vx1, vy1) and (x2−x1)<(y2−y1), and the rotation angle is determined by: θ=arctan((vy2−vy1)/(vx2−vx1))+90°. In a range of 135° to 150°, length (vx1, vy1, vx2, vy2)<length (vx4, vy4, vx1, vy1) and (x2−x1)>(y2−y1), and the rotation angle is determined by: θ=arctan((vy2−vy1)/(vx2−vx1))+90°. The rotation angle θ of the fourth position detection pattern is also determined in the same manner.
Next, the center coordinates of the position detection patterns are detected. The center coordinates is defined as the center of the circumscribing rectangle, which is ((x1+x2)/2(y1+y2)/2).
As a result of the above-described operations, the examination of the candidate position detection patterns is completed.
In the step S106, the position detection patterns that have already been differentiated into three types are sorted in the descending order of area for each type.
In the step S107, a combination of the four types of position detection patterns is generated. First, among the candidates for the first position detection patterns, one which has the largest area is selected. With the area of this first position detection pattern being defined as S, a candidate for the second position detection pattern which as a combination of an area of S/4 and the same rotation angle is searched. Once the second position detection pattern is found, candidates for the third and fourth position detection patterns that have an area of S/2 are searched. Further, a combination of a candidate having the same rotation angle and a candidate having a rotation angle different by 90° is searched.
When a plurality of two-dimensional codes are projected on a single screen, considering all kinds of combinations of the candidate position detection patterns, there is an enormous number of possible position detection pattern combinations. As in the present invention, by using position detection patterns that are all different from each other, the number of possible combinations can be largely reduced. In addition, by applying the characteristics determined in advance, such as shape, area and rotation, the combinations can be further narrowed down with simple comparative mathematical operation. This operation will be described later.
In the step S107, it is determined whether there is or is not any combination of the four position detection patterns left unexamined. If there is, the operation proceeds to the step S108 and, if not, the operation proceeds to the step S112.
In the step S108, information is extracted from combined position detection patterns that are considered to belong to the same two-dimensional code. This process will be described later referring to
In the step S109, depending on the result of the information extraction, when the extraction was successful, the operation proceeds to the step S110, while when the extraction failed, the combination of position detection patterns for which the extraction failed is excluded, and the operation returns back to the step S107.
In the step S110, the message of the successfully extracted information is saved.
In the step S111, the candidates used for the two-dimensional pattern from which data were successfully extracted are excluded from the candidate position detection patterns, and the operation returns back to the step S107. When an unused candidate position detection pattern is included in the range of the two-dimensional pattern from which data were successfully extracted, it is also excluded from the candidates.
By repeating the steps S107 to S111, the analysis of projected two-dimensional codes is completed. When there are still candidate position detection patterns that have not been excluded, for combinations of two or more thereof, the information extraction of the step S108 may be carried out. This will be described later.
In the step S112, an analysis completion message is transmitted to the calling source.
In the step S113, the main analysis process is finished.
Next, the information extraction process of the step S108 will be described referring to
In the step S201, the relationship of four position combination patterns in a given combination is checked. This checking is done by determining whether the below-described conditions (a) and (b) are satisfied. When any of these items is not satisfied, the presence of a problem is assumed and the information extraction process is terminated.
First, the center coordinate of the first, second, third and fourth position detection patterns are defined as pt1, pt2, pt3 and pt4, respectively, and these points are then connected in the order of pt1, pt3, pt2, pt4 and pt1. A rectangle is thereby obtained when the combination of the four position detection patterns is correct.
(a) All of the corners have a right angle.
(b) The opposing sides have the same length (1:1).
In the step S202, the presence or absence of a problem is determined based on the result of the above-described checking. When there was a problem, the operation proceeds to the step S203 where a flag indicating failed information extraction is placed, while when there was no problem, the operation proceeds to the step S204.
In the step S204, from any one of the position detection patterns, the number of pixels per cell is determined. In the case of the second position detection pattern, it has an area of 4×4=16 cells, and the number of pixels per cell is determined by an equation: Number of pixels per cell=((area)/16)1/2.
In the step S205, the distance between the center coordinate of adjacent position detection patterns is measured in each of the vertical and lateral directions and the thus obtained distance values are each divided by the value determined in the step S204, thereby the cell size of the two-dimensional code in the vertical and lateral directions can be determined. With the thus obtained lateral distance between the center coordinate being defined as “d” pixels and the number of pixels per cell being defined as “p” pixels/cell, the lateral cell size of the code is determined by an equation: Code lateral cell size=d/p+(4+6). The vertical cell size is also determined in the same manner.
In the step S205, based on the thus determined cell sizes, the version of the two-dimensional code is tentatively decided. The version number stepwisely increases every 8 cells. Since the lateral cell size of the code is determined by an equation: Code lateral cell size=lateral version×8+19, the lateral version of the code can be determined by modifying this equation to: Lateral version=(cell size−19)/8. The thus obtained lateral version number is used as a tentative lateral version. When there is no version that matches the cell size, a version with the closest cell size is designated. The tentative vertical version is also decided in the same manner. The reason why the thus decided versions are tentative is because there is the possibility that accurate values may not be obtained due to photographing at an angle, bending of the printed paper or the like is taken into consideration. The version information blocks are also used in combination so that accurate values can be obtained.
In the step S206, by scanning the two-dimensional code in the directions of each position detection pattern to its adjacent position detection patterns, the coordinates of the cells constituting the version information blocks and format information blocks in the photographed image are detected.
In the step S207, the (vertical and lateral) version information blocks are analyzed. As a result, the vertical and lateral versions are determined. Failure of the analysis leads to termination of the operation. As described above, the version information blocks and the format information blocks each indicate 20 values. As the vertical and lateral version information blocks, each type is arranged at two spots. When the values that are read out from the vertical and lateral version information blocks each arranged at two spots are identical to at least two of the three values of the tentative version information obtained from the code width, the code height and the position detection pattern size, those values are adopted.
In the step S208, the format information blocks are analyzed. The presence or absence of a design to be embedded and the data embedding method for each block are thereby determined. Failure of the analysis leads to termination of the operation. The format information blocks are arranged at three spots and, when two or more thereof yielded the same results, these results are adopted.
In the step S209, the coordinates of a position correction pattern is calculated and the coordinate of each cell in the image of the two-dimensional code are determined with high precision. Although the coordinate of the cells have already been derived, the position correction pattern allows the effects of lens distortion to be reduced. Since the coordinates of the position correction pattern in the image have already been determined, it is confirmed that the point at the coordinates is dark. Then, starting from this point, scanning is performed toward the right-hand side to find the boundary of dark and light pixels, and the periphery thereof is then scanned in the same manner as in the step S105. With the upper-left and lower-right coordinate of the circumscribing rectangle being defined as (x1, y1) and (x2, y2), respectively, the center coordinates are obtained as ((x1+x2)/2, (y1+y2)/2)).
In the step 210, the presence or absence of a design to be embedded in the format information blocks is determined. When the presence was determined, the operation proceeds to the step S211, and when the absence was determined, the operation proceeds to the step S212.
In the step S211, by referring to the design-embedding information blocks, the vertical and lateral offset width and height of the design-embedding block as well as the width and height of the design-embedding block are determined.
In the step S212, with respect to the actual data blocks and error correction code blocks, any nearest four points are selected from the center coordinate of the position detection patterns and those of the position correction patterns, and the coordinate of the cells in the photographed image are determined by projective transformation.
In the step S213, with respect to the actual data blocks and error correction code blocks, in accordance with the data type of the format information blocks, a plurality of light (1) and dark (0) data are detected.
In the step S214, from the number of the actual data blocks and error correction code blocks, the number of the error correction codes is calculated. By this, the actual data and the error correction codes are determined.
In the step S215, with respect to the data region and the error correction codes, the number and positions of errors are detected using the error correction codes. When the number of errors is 0, the operation proceeds to the step S219. Otherwise, the operation proceeds to the step S216.
In the step S216, it is determined whether or not the errors are correctable. When the errors are correctable, the operation proceeds to the step S218, while when the errors are not correctable, the operation proceeds to the step S217.
In the step S217, since no message was obtained due to the failure of information extraction, the operation is terminated.
In the step S218, using the error correction codes, the errors in the actual data are corrected.
In the step S219, the resulting actual data are composed of a header(s) (message type (message encode)-message size), a message(s), an end flag and padding. A combination of a header and a message is defined as a segment. An end flag is a special segment which does not contain any message. There may be a plurality of segments. When an end flag is found, what follows the end flag is all padding. From the data, the message(s) is/are reconstructed.
In the step S220, the information extraction process is finished.
Projective transformation requires at least 4 sets of coordinate. For the above-described analysis process, a case where four position detection patterns can be detected was described; however, due to contamination, blurriness, fuzziness or the like of the image, it is possible that only three or two position detection patterns can be detected. In the present invention, in such a case, since the detected three or two position detection patterns have different shapes, the type(s) of the undetected position detection pattern(s) is/are determined from the positional relationships of the detected three or two position detection patterns; therefore, the positions of the undetected position detection patterns can be easily estimated. For example, in the two-dimensional code of the first embodiment, when three position detection patterns are detected, since two position detection patterns that are arranged diagonally to each other can be identified based on their shapes, it can be estimated that the undetected position detection pattern is arranged, with respect to the straight line connecting the two diagonally-arranged position detection patterns, at a mirror-symmetrical position of the other position detection pattern. Further, when two position detection patterns are detected, the positional relationship of the two position detection patterns is determined based on their shapes. For example, if these two position detection patterns are arranged adjacent to each other, it is estimated that the remaining two position detection patterns exist at positions that are away from the straight line connecting the two detected position detection patterns at the same distance in the direction perpendicular to the straight line. Meanwhile, if the two detected position detection patterns are arranged diagonally to each other, it is estimated that the remaining two position detection patterns exist at the intersections of the lines extending from each side of the two detected position detection patterns. For example, when the third and fourth position detection patterns are identified, extension of the two short sides of each of these position detection patterns yields a total of four intersections, which correspond to the four apexes of the first position detection pattern. In the same manner, the four intersections formed by extending the long sides correspond to the apexes of the second position detection patterns. Also when the first and second position detection patterns are identified, the positions of the remaining two position detection patterns can be estimated by the same method. Needless to say, as compared to a case where all four position detection patterns are detected, the estimation accuracy is reduced when three of them are detected, and the estimation accuracy is further reduced when only two of them are detected. In any case, the positions of the four position detection patterns are tentatively decided in the above-described manner, and they are applied to projective transformation so as to obtain the positional information on the position correction patterns. Then, the position correction patterns are utilized for coordinate corrections, and the coordinate of the four position detection patterns are ultimately determined, based on the coordinate of the detected position detection patterns and their coordinate thus corrected by the position correction patterns.
Considering that there may be an undetectable position detection pattern(s) due to contamination or the like, a larger number of the position detection patterns is more desirable; however, an increase in the number of the position detection patterns not only increases the area ratio represented by the position detection patterns and thereby reduces the data efficiency, but also increases the work load required for detection of the position detection patterns. Therefore, it is desired that the number of the position detection patterns be decided as appropriate in accordance with the mode of use and the like of the two-dimensional code.
Next, for a case where a plurality of two-dimensional codes are projected on a single screen, the use of the two-dimensional code of the present invention is compared with the use of the two-dimensional code of
In contrast, when the position detection patterns are different as in the case of the present invention, the number of combinations of three different position detection patterns is 6C1×6C1×6C1=216 and that of four different position detection patterns is 6C1×6C1×6C1×6C1=1,296, so that the number of such combinations is largely reduced.
Further, in the above-described analysis process, the position detection patterns are detected by scanning while some parts of the screen are omitted from the scanning; however, as long as one candidate position detection pattern can be found, from its shape, it is possible to estimate the orientation and distance range of other position detection patterns to a certain extent and, by restricting the scanning to their regions, the efficiency of detecting the position detection patterns can be improved. For example, in the two-dimensional codes of the first and second embodiments, it can be estimated that the second position detection pattern exists on the extension of the long sides of the third and fourth position detection patterns and that the first position detection pattern exists on the extension of the short sides, which are perpendicular to the respective long sides, of the third and fourth position detection patterns. When two or three position detection patterns are detected, the regions in which other position detection pattern(s) can be expected to exist are further limited.
In the above-described two-dimensional codes, four different position detection patterns are arranged; however, data can be extracted with high accuracy also from a two-dimensional code having a constitution in which three different position detection patterns and one or more position correction patterns are arranged. In this case, the position detection patterns are arranged in such a manner that one of the four position detection patterns is absent.
In the analysis of such a two-dimensional code, after detecting the three position detection patterns, the coordinates of the part lacking a position detection pattern are extrapolated from the positional relationships of other position detection patterns. However, when the two-dimensional code is photographed at an angle from above, it is concerned that the extrapolated coordinates might contain an error. Therefore, from a total of four sets of coordinates, which are the coordinates of the three position detection patterns and the extrapolated coordinates, the coordinates of the position correction pattern that is closest to the part of the missing position detection pattern are obtained by projective transformation.
Then, the position correction pattern is scanned to correct its coordinates. Next, using a total of four sets of coordinates, which are the coordinates of the three position detection patterns and one position correction pattern, mapping of the data coordinates is carried out. The position correction pattern has an effect of reducing errors in coordinates and thereby enables acquisition of highly accurate coordinates, so that data can be extracted with high accuracy even from a two-dimensional code having three position detection patterns and one or more position correction patterns.
When a position correction pattern is already arranged, since the number of the position detection patterns is reduced by one, the efficiency of the code is improved. On the other hand, the redundancy of the position detection patterns is reduced, and this leads to a reduction in the tolerance to contamination and the like.
Further, it is not always that only one photographed image is input, and a case where an image synthesized from a plurality of input images is analyzed can also be considered. Examples of such a case include those cases where an image is produced from time-series consecutive images such as an animation and this image is analyzed, and those cases where a code image is divided into plural pieces and then input.
Moreover, such an application where a single data set is obtained by displaying different codes in series by animation and recognizing all of these codes can also be considered. In this case, a plurality of codes may also be arranged on a paper, not in an animation format.
The two-dimensional code of the present invention can also be applied to these cases.
Thus far, embodiments of the present invention have been described; however, these descriptions of the embodiments are provided simply for the purpose of explaining the present invention, and it will be understood by those of ordinary skill in the art that various modifications can be made within the scope of claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2012-249788 | Nov 2012 | JP | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2013/080156 | 11/7/2013 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2014/077187 | 5/22/2014 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5343031 | Yoshida | Aug 1994 | A |
| 5591956 | Longacre, Jr. | Jan 1997 | A |
| 7032823 | Nojiri | Apr 2006 | B2 |
| 7604180 | Sonoda et al. | Oct 2009 | B2 |
| 8235303 | Mizukoshi et al. | Jul 2012 | B2 |
| 8397999 | Mizukoshi et al. | Mar 2013 | B2 |
| 8413909 | Mizukoshi et al. | Apr 2013 | B2 |
| 8424775 | Mizukoshi et al. | Apr 2013 | B2 |
| 8447122 | Cheong et al. | May 2013 | B2 |
| 8515162 | Cheng | Aug 2013 | B2 |
| 8879859 | Cheong et al. | Nov 2014 | B2 |
| 20040182930 | Nojiri | Sep 2004 | A1 |
| 20070158420 | Sonoda et al. | Jul 2007 | A1 |
| 20070272755 | Chang | Nov 2007 | A1 |
| 20090242649 | Mizukoshi et al. | Oct 2009 | A1 |
| 20100246984 | Cheong et al. | Sep 2010 | A1 |
| 20110049244 | Wang et al. | Mar 2011 | A1 |
| 20110085732 | Cheng | Apr 2011 | A1 |
| 20120132721 | Mizukoshi et al. | May 2012 | A1 |
| 20120138694 | Mizukoshi et al. | Jun 2012 | A1 |
| 20120138695 | Mizukoshi et al. | Jun 2012 | A1 |
| 20120153020 | Yoshida | Jun 2012 | A1 |
| 20130230241 | Cheong et al. | Sep 2013 | A1 |
| Number | Date | Country |
|---|---|---|
| 1885311 | Dec 2006 | CN |
| 101667256 | Mar 2010 | CN |
| 0672994 | Sep 1995 | EP |
| 07254037 | Oct 1995 | JP |
| 2004206674 | Jul 2004 | JP |
| 2004234318 | Aug 2004 | JP |
| 2007179111 | Jul 2007 | JP |
| 2007241328 | Sep 2007 | JP |
| 2009075873 | Apr 2009 | JP |
| 2009163720 | Jul 2009 | JP |
| 2009259192 | Nov 2009 | JP |
| 20070050752 | May 2007 | KR |
| 201113815 | Apr 2011 | TW |
| Entry |
|---|
| Supplementary European Search Report for EP13855040 dated May 11, 2016. |
| English Abstract of KR20070050752, Publication Date: May 16, 2007. |
| Office Action for related Korean Patent Application dated Feb. 26, 2016. |
| Search Report for corresponding Chinese patent application 201380059400 dated Jun. 12, 2017. |
| International Search Report for PCT/JP2013/080156 dated Dec. 10, 2013. |
| English Abstract and Machine Translation of JP-2004206674, Publication Date: Jul. 22, 2004. |
| English Abstract of JP-2007179111, Publication Date: Jul. 12, 2007. |
| English Abstract of JP07254037, Publication Date: Oct. 3, 1995. |
| English Abstract of JP-2004/234318, Publication Date: Aug. 19, 2004. |
| English Abstract and Machine Translation of JP-2007241328, Publication Date: Sep. 20, 2007. |
| English Abstract and Machine Translation of JP-2009163720, Publication Date: Jul. 23, 2009. |
| English Abstract and Machine Translation of JP-2009075873, Publication Date: Apr. 9, 2009. |
| English Abstract of CN-101667256, Publication Date: Mar. 10, 2010. |
| Number | Date | Country | |
|---|---|---|---|
| 20160283763 A1 | Sep 2016 | US |
