This application claims the priority benefit of Taiwan application no. 104135546, filed on Oct. 29, 2015. The entirety of the above-mentioned patent application is hereby incorporated by reference herein and made a part of this specification.
The disclosure relates to a data transmission apparatus and a method thereof, a data reading apparatus and a method thereof, and a data encoding and decoding system and a method thereof.
In recent years, with popularities of portable electronic apparatuses and the Internet, developments in data exchange have been rapidly transformed from traditional paper form into electronic form. The most common data exchange formats are presented by, for example, bar code, QR (quick response) code and color code. Carriers of bar code, QR code and color code have been transferred from original paper prints to the portable electronic apparatuses. A method of applying the above is to display a data content to be exchanged on a screen of the portable electronic apparatus, so that the data content may be scanned and interpreted by a data reading apparatus. As such, bar code, QR code and color code can be found almost everywhere in our daily life. Because said data exchange manner is advantageous in high convenience, easy traceability, high efficiency ratio, anti-wear capability and high read rates, together with the popularity of the portable electronic apparatuses, said data exchange manner can be widely used in various application since messages may be transferred to consumers or uploaded to a remote system simply by utilizing a camera function of the portable electronic apparatus. Further, when information is obtained by reading bar code, QR code and color code in order to simplify a manual inputting procedure or provide a data transmission, not only is frequency of a paper operating process reduced to achieve the environmental objectives, interactions in the human machine interface may also become more convenient.
Although the aforementioned data exchange manner can provide users with convenience in various ways such as easy storage and management, an image capturing device of the data reading apparatus can be easily influenced by various screen specifications currently used by the portable electronic apparatuses in the market. Accordingly, when capturing images, property and degree of influences to the image capturing unit caused by noise interference may vary, resulting in issue of low success rate for the scanning and thereby influencing fluency for operating entire service system. In addition, a data security issue may also arise when using the aforementioned data exchange manner.
A data transmission apparatus of the disclosure includes an encoding apparatus. The encoding apparatus is configured to patternize a data. The encoding apparatus displays the patternized data in a manner of dynamic twinkling to transmit the patternized data. The patternized data twinkles in a predetermined frequency.
A data transmission method of the disclosure includes: patternizing a data; and displaying the patternized data in a manner of dynamic twinkling to transmit the patternized data. The patternized data twinkles in a predetermined frequency.
A data reading apparatus of the disclosure includes a decoding apparatus. The decoding apparatus is configured to capture a data which is patternized and dynamically twinkles in a predetermined time period. The decoding apparatus performs a data processing operation on the captured data to identify the captured data. The patternized data twinkles in a predetermined frequency.
A data reading method of the disclosure includes: capturing a data which is patternized and dynamically twinkles in a predetermined time period; and performing a data processing operation on the captured data to identify the captured data. The patternized data twinkles in a predetermined frequency.
A data encoding and decoding system of the disclosure includes an encoding apparatus and a decoding apparatus. The encoding apparatus is configured to patternize a data. The encoding apparatus displays the patternized data in a manner of dynamic twinkling. The patternized data twinkles in a predetermined frequency. The decoding apparatus is coupled to the encoding apparatus. The decoding apparatus is configured to capture the data which dynamically twinkles in a predetermined time period. The decoding apparatus performs a data processing operation on the captured data to identify the captured data.
A data encoding and decoding method of the disclosure includes: patternizing a data; displaying the patternized data in a manner of dynamic twinkling; capturing the data which dynamically twinkles in a predetermined time period; and performing a data processing operation on the captured data to identify the captured data. The patternized data twinkles in a predetermined frequency.
To make the above features and advantages of the disclosure more comprehensible, several embodiments accompanied with drawings are described in detail as follows.
The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the disclosure and, together with the description, serve to explain the principles of the disclosure.
In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the disclosed embodiments. It will be apparent, however, that one or more embodiments may be practiced without these specific details. In other instances, well-known structures and devices are schematically shown in order to simplify the drawing.
Embodiments are provided below to describe the disclosure in detail, though the disclosure is not limited to the provided embodiments, and the provided embodiments can be suitably combined. The term “coupling/coupled” used in this specification (including claims) of the application may refer to any direct or indirect connection means. For example, “a first device is coupled to a second device” should be interpreted as “the first device is directly connected to the second device” or “the first device is indirectly connected to the second device through other devices or connection means.” In addition, the term “signal” can refer to a current, a voltage, a charge, a temperature, data, electromagnetic wave or any one or multiple signals.
The disclosure is directed to a data transmission apparatus and a method thereof, a data reading apparatus and a method thereof, and a data encoding and decoding system and a method thereof, which are capable of improving security in data transmission while improving correctness and convenience in data reading.
Based on the above, according to the exemplary embodiments of the disclosure, in the data transmission apparatus and the method thereof, the data reading apparatus and the method thereof, and the data encoding and decoding system and the method thereof, the patternized data is displayed in the manner of dynamic twinkling, and the patternized data twinkles in the predetermined frequency. As a result, the security in data transmission may be improved while improving the correctness and convenience in data reading.
In the embodiment, the image frames displayed by the first electronic apparatus 100 include the data FD which is patternized and dynamically twinkles. The data FD twinkles in a predetermined frequency, and may be designed as dynamically twinkling image frames which are visible or invisible to users, and not particularly limited by the disclosure. In the embodiment, the first electronic apparatus 100 served as a data transmission apparatus may be, for example, a portable electronic apparatus capable of operating independently, such as a smart phone, a non-smart phone, a wearable electronic apparatus, a tablet computer, a personal digital assistant (PDA) or a notebook computer, but the disclosure is not limited to the above. In the embodiment, the second electronic apparatus 200 served as a data reading apparatus may be, for example, an electronic apparatus with system control functions, such as a smart home server, a smart robot, a central control system, a cloud server control center and a desktop computer, but the disclosure is not limited to the above. In addition, the second electronic apparatus 200 may also be the portable electronic apparatus capable of operating independently, such as the smart phone, the non-smart phone, the wearable electronic apparatus, the tablet computer, the personal digital assistant or the notebook computer.
In an application embodiment, the first electronic apparatus 100 may be, for example, the portable electronic apparatus, whereas the second electronic apparatus 200 may be, for example, the electronic apparatus with the system control functions, such as a point of sale terminal (POS terminal), which may be a fixed host system. The two electronic apparatuses may perform mobile ticket and payment operations, such as payment functions of an electronic wallet. In another application embodiment, the first electronic apparatus 100 and the second electronic apparatus 200 may both be the portable electronic apparatus, and the second electronic apparatus 200 is served as a host system at sale end to perform the mobile ticket and payment operations with the first electronic apparatus 100. The operations of the mobile ticket and payment are performed by the users in a handheld manner. Accordingly, the first electronic apparatus 100 can use the patternized data FD as a foreground image in a specific twinkling frequency, and embed the patternized data FD into a background image to serve as a visualized mobile ticket. After capturing the image frames by the image capturing apparatus 210, the second electronic apparatus 200 can perform an image processing analysis and a decoding process to interpret the image frames for the data content. The first electronic apparatus 100 can embed multiple-information by variations in time, space and patterns, so that the second electronic apparatus 200 can read the corresponding data FD by using different decoding parameters.
In the embodiment, the first electronic apparatus 100 and the second electronic apparatus 200 may further include functional elements including, for example, operation modules, storage modules, communication modules, power modules and so on, which are not particularly limited by the disclosure.
In the embodiment, the encoding apparatus 430 includes an encoding block 410 and an image display 420. The encoding block 410 includes a data source module 412, an encoding and modulation module 414 and a signal output and driving module 416. In application scenarios related to the mobile ticket and payment, the data DD1 includes, for example, ticket issue or electronic wallet information. The data source module 412 is used as a data transmission interface, which receives and temporarily stores the data DD1 in order to output the data DD1 to the encoding and modulation module 414. Next, the encoding and modulation module 414 patternizes the data DD1 in order to encrypt the data DD1. In the embodiment, in the same image frame, the encoding and modulation module 414 patternizes the data DD1 into the same identification pattern. In different image frames, the encoding and modulation module 414 patternizes the data DD1 into different types of identification patterns, so as to improve the security of data after encoding. Next, the encoding and modulation module 414 performs a digital signal modulation operation on the patternized data FD, such that when the signal output and driving module 416 drives the image display 420 according to the patternized data FD, the image display 420 may display the patternized data FD in the manner of dynamic twinkling. In the embodiment, the digital signal modulation operation includes, for example, amplitude-shift keying (ASK) (i.e., on-off keying modulation (OOK modulation)). In an embodiment, the encoding and modulation module 414 can further perform an image overlapping processing on the patternized data FD to use the patternized data FD as a foreground image to be overlapped with a background image in various types, so as increase the fun of using the electronic tickets. Implementation of the aforesaid step is optional and not particularly limited by the disclosure. Next, the encoding and modulation module 414 outputs the patternized data FD to the signal output and driving module 416. The signal output and driving module 416 drives the image display 420 to display the image frames according to the patternized data FD. Accordingly, the image display 420 displays the patternized data FD in the manner of dynamic twinkling. In the embodiment, an encoding operation includes, for example, patternizing the data and displaying the patternized data in the manner of dynamic twinkling.
Each of the image frames displayed by the image display 420 includes different identification patterns. For instance, the first image frame FA includes an identification pattern MA3 as depicted in
Taking the first image frame FA for example, the data DD1 includes, for example, one digital data 10101000001010100000. The encoding and modulating module 414 patternizes a first data code 0 in such digital data into ones not including the identification pattern MA3 (e.g., BK0) among blocks of the first image frame FA. The encoding and modulating module 414 patternizes a second data code 1 in such digital data into ones including the identification pattern MA3 (e.g., BK1) among the blocks of the first image frame FA. In an embodiment, the first data code 0 may also be patternized into the block including the identification pattern MA3 and the second data code 1 may also be patternized into the block not including the identification pattern MA3, which are not particularly limited by the disclosure. Therefore, according to an encoding sequence SA in the first image frame FA, the encoding and modulation module 414 patternizes such digital data 10101000001010100000 into the first image frame FA. In the embodiment, the digital data 10101000001010100000 includes 20 binary data codes. Accordingly, there are 20 patternized blocks for corresponding to the data codes in the first image frame FA, which are distributed in a concentrated and adjacent manner. However, the foregoing amount and distribution manner are not intended to limit the disclosure but may be adjusted according to the design. For example, in an embodiment, if the data codes included by the digital data are less, the patternized blocks may be distributed in the first image frame FA in a dispersed and non-adjacent manner. Further, in the embodiment, the encoding sequence SA of the digital data encodes from top to down and then left to right, but the disclosure is not limited thereto. In an embodiment, the encoding sequence SA may also encodes from left to right and then from top to down. In an embodiment, the encoding sequence SA may select the blocks corresponding to different positions among the 20 blocks arbitrarily or randomly for the encoding.
In the embodiment, the first image frame FA further includes a plurality of positioning patterns, which are located on blocks BKP at different positions and distributed surrounding the identification patterns MA3. However, the foregoing amount and distribution manner are not intended to limit the disclosure. In the embodiment, a type of the positioning pattern in the block BKP is identical to the identification pattern MA3 but in a different size, but the disclosure is not limited thereto. In an embodiment, the type of the positioning pattern of the first image frame FA may be different from the identification pattern MA3 or both of which can have the identical sizes, which may be adjusted according to the design.
In the embodiment, a method of patternizing another digital data 00100100101101000000 in the data DD1 into the second image frame FB by the encoding and modulation module 414 is similar to the method used for patternizing the first image frame FA, and a major difference between the two is, for example, types of the identification pattern MB3 and the positioning patterns. Sufficient teaching, suggestion, and description regarding an encoding method of patternizing such digital data into the second image frame FB by the encoding and modulation module 414 may be obtained from description in the embodiment of the first image frame FA in
In the embodiments of
In the embodiment, time lengths of the time period TA, the time period TB and the time period TNA are equal, but the disclosure is not limited thereto. In an embodiment, it is also possible that the time lengths of the time period TA and the time period TB are equal but greater or less than the time length of the time period TNA. In an embodiment, it is also possible that the time lengths of the time period TA and the time period TB are not equal. In an embodiment, it is also possible that the time lengths of the different time periods TNA are equal or not equal to one another, which are not particularly limited by the disclosure.
In the embodiment, the description is provided by using the image display 420 which alternately displays the two different image frames as an example, but the disclosure is not limited thereto. In an embodiment, the image display 420 may also display three or more different image frames, where the different image frames includes different identification patterns, respectively. The image display 420 periodically displays the three or more different image frames in a predetermined sequence, for example, or the image display 420 may also randomly display the different image frames in any sequence, which is not particularly limited by the disclosure.
In an embodiment, the data transmission apparatus 400 may further include functional elements including, for example, operation modules, storage modules, communication modules, power modules and so on, which are not particularly limited by the disclosure. In an embodiment, the image display 420 includes flat panel displays, curved panel displays or 3D displays, including Liquid Crystal Display (LCD), Plasma Display Panel (PDP), Organic Light Emitting Display (OLED), Field Emission Display (FED), Electro-Phoretic Display (EPD) or Light Emitting Diode Display and the like, which are not limited by the disclosure.
In an embodiment, the encoding and modulation module 414 and the signal output and driving module 416 includes, for example, Central Processing Unit (CPU), Microprocessor, Digital Signal Processor (DSP), Programmable Controller, Programmable Logic Device (PLD), or other similar devices, or a combination of the said devices, which are not particularly limited by the disclosure. Further, in an embodiment, each of the modules in the encoding block 410 in
In the embodiment, the image display 420 periodically displays the different image frames in the predetermined sequence to transmit the data FD that is encoded and encrypted into the image frames which dynamically twinkles to the data reading apparatus 500. Next, the data reading apparatus 500 captures the data FD which is patternized and dynamically twinkles in a predetermined time period TC, and performs a data processing operation on the captured data FD to identify the captured data FD, so as to generate and output a data DD2 which is identified. In the embodiment, a decoding operation includes, for example, capturing the data which dynamically twinkles in the predetermined time period, and performing a data processing operation to identify the data.
Referring to
In the embodiment, the image capturing device 510 starts capturing the image frames from a starting time point t1 of the time period TC. With elapse of time, the image capturing device 510 continuously captures the image frames. When an ending time point t2 of the time period TC is reached, the image capturing device 510 stops capturing the image frames. In the time period TC, the image capturing device 510 captures, for example, an N number of image frames, in which a 1st image frame f1 is the first image frame FA, and an Nth image frame fN is the second image frame FB, where N is a positive integer greater than or equal to 2. Next, the image capturing device 510 transmits the captured N number of image frames to the decoding block 520.
In the embodiment, the image capturing device 510 can start capturing the image frames at any time point. That is to say, the starting time point t1 does not necessarily fall within the time period TA. The time length of the time period TC may be adjusted according to the design. The image capturing device 510 can stop capturing the image frames at any time point. That is to say, the ending time point t2 does not necessarily fall within the time period TB. What illustrated in
In the embodiment, the image source module 522 of the decoding block 520 is configured to receive the image frames transmitted from the image capturing device 510. The image source module 522 is used as a data transmission interface, which receives and temporarily stores the image frames in order to output the received N number of image frames to the image processing module 524. Next, the image processing module 524 performs the data processing operation on the image frames to identify encrypted messages included in the data FD. In the embodiment, the data processing operation includes, for example, a convolution operation, a binarization operation, a summation operation and a clustering algorithm. The image processing module 524 performs the convolution operation, the binarization operation, the summation operation and the clustering algorithm on the captured data in the image frames.
Specific implementation regarding how the image processing module 524 of the embodiment performs the convolution operation, the binarization operation, the summation operation and the clustering algorithm on the data in the image frames is described as follows.
Taking the (first) convolution operation and binarization result 600A for example, the image display 420 displays the first image frame FA in the manner of dynamic twinkling in the time period TA. Accordingly, in a period starting from a time point t2-3n to a time point t2-2n, taking the 1st image frame f1 for example, the image processing module 524 performs the convolution operation on the 1st image frame f1 by utilizing the identification pattern MA3, and a result thereof indicates that one marked by 610A is a data point that is possibly corresponding to the identification patterns MA3 in the image frame f1 and one marked by 620 is a noise point in the image frame f1. In a period starting from a time point t2-n to a time point t2, taking the 15th image frame f15 for example, the image processing module 524 performs the convolution operation on the 15th image frame f15 by utilizing the identification pattern MA3, and a result thereof indicates that the data point corresponding to the identification pattern MA3 is not included in the image frame f15 and one marked by 620 is the noise point in the image frame f15.
Next, taking the (second) convolution operation and binarization result 600B for example, the image display 420 displays the second image frame FB in the manner of dynamic twinkling in the time period TB. Accordingly, in the period starting from the time point t2-3n to the time point t2-2n, taking the 1st image frame f1 for example, the image processing module 524 performs the convolution operation on the 1st image frame f1 by utilizing the identification pattern MB3, and a result thereof indicates that the data point corresponding to the identification pattern MB3 is not included in the image frame f1 and one marked by 620 is the noise point in the image frame f1. In the period starting from the time point t2-n to the time point t2, taking the 15st image frame f15 for example, the image processing module 524 performs the convolution operation on the 15st image frame f1 by utilizing the identification pattern MB3, and a result thereof indicates that one marked by 610B is a data point that is possibly corresponding to the identification patterns MB3 in the image frame f15 and one marked by 620 is the noise point in the image frame f15.
In the embodiment, the convolution operation may be implemented by using steps in any convolution operations in the related art, which are not particularly limited by the disclosure. Enough teaching, suggestion, and implementation illustration for aforesaid steps and embodiments thereof may be obtained with reference to common knowledge in the related art, which is not repeated hereinafter.
Referring to
Taking the identification pattern MB3 for example, the image processing module 524 calculates a third pixel average value of the identification pattern MB3 at 4 positions b, d, f and h, and a fourth pixel average value of the identification pattern MB3 at 5 positions a, c, e, g and i. The image processing module 524 then calculates a difference between the third pixel average value and the fourth pixel average value. If the difference between the two is greater than a predetermined threshold, the image processing module 524 determines that the blocks include the identification pattern MB3 and binarizes the blocks into the second data code 1. Conversely, if the difference between the two is less than or equal to the predetermined threshold, the image processing module 524 determines that the blocks do not include the identification pattern MB3 and binarizes the blocks into the first data code 0. In the embodiment, the pixel value refers to, for example, a gray level value of the pixel, but the disclosure is not limited thereto.
In the embodiment, after obtaining the summation operation results, the image processing module 524 performs the clustering algorithm on each of the summation operation results. For instance, the image processing module 524 performs the clustering algorithm on the summation operation result 700A. When the data points in the summation operation result 700A sufficiently satisfy a grouping relation (e.g., a standard deviation is less than a predetermined threshold), the image processing module 524 can obtain a clustering algorithm result 800A. According to the clustering algorithm result 800A, the blocks including the identification pattern MA3 (which is corresponding to the second data code 1) may be resolved by the image processing module 524 according to coordinate data of a cluster center point 810A. Similarly, according to the clustering algorithm result 800B, the blocks including the identification pattern MB3 (which is corresponding to the second data code 1) may be resolved by the image processing module 524 according to coordinate data of a cluster center point 810B. In the embodiment, the data points in a summation operation result 700N do not satisfy the grouping relation, which indicates that the summation operation result 700N does not include the data points. Accordingly, a clustering algorithm result 800N does not include the cluster center point, so that the blocks including the identification pattern MA3 or the identification pattern MB3 cannot be resolved by the image processing module 524.
In the embodiment, the clustering algorithm may be implemented by using steps in any clustering algorithms in the related art, which are not particularly limited by the disclosure. Enough teaching, suggestion, and implementation illustration for aforesaid steps and embodiments thereof may be obtained with reference to common knowledge in the related art, which is not repeated hereinafter.
Accordingly, in the embodiment, the image processing module 524 outputs an identification result to the data extracting module 526. The extracting module 526 receives and temporarily stores the identification result. The extracting module 526 converts the identified data into the data DD2 in digital form and outputs the data DD2 in digital form. The data DD2 in digital form is corresponding to the data DD1 before being encrypted and encoded.
In an embodiment, the data reading apparatus 500 may further include functional elements including, for example, operation modules, storage modules, communication modules, power modules and so on, which are not particularly limited by the disclosure. In an embodiment, the image capturing device 510 includes, for example, a charge coupled device image sensor (CCD image sensor) or a complementary metal oxide semiconductor (CMOS) image sensor or the like, which are not particularly limited by the disclosure.
In an embodiment, the image processing module 524 includes, for example, Central Processing Unit (CPU), Microprocessor, Digital Signal Processor (DSP), Programmable Controller, Programmable Logic Device (PLD), or other similar devices, a combination of the said devices, which are not particularly limited by the disclosure. Further, in an embodiment, each of the modules in the decoding block 520 in
In summary, in the exemplary embodiments of the disclosure, the data encoding method allows the data transmission apparatus to patternize and hide the data in the image frame which dynamically twinkles. The data transmission apparatus embeds the foreground image in the specific twinkling frequency into the background image by patternizing the content of data differently. The data reading apparatus decodes and identifies the data hidden in the image frame which dynamically twinkles through different decoding parameters by using the image processing in the decoding method. After capturing the image frames by the image capturing device, the data reading apparatus performs the image processing analysis to interpret the data content through the pattern detection, the denoising and the decoding process of the encoded patterns. In addition, the data transmission apparatus can embed multiple-information by variations in time, space and patterns, so that the data reading apparatus can read the corresponding data by using different decoding parameters. Accordingly, the data transmission and reading methods provided by the exemplary embodiments of the disclosure are capable of improving the security in data transmission while improving the correctness and convenience in data reading.
Although the disclosure has been described with reference to the above embodiments, it will be apparent to one of ordinary skill in the art that modifications to the described embodiments may be made without departing from the spirit of the disclosure. Accordingly, the scope of the disclosure will be defined by the attached claims and not by the above detailed descriptions.
Number | Date | Country | Kind |
---|---|---|---|
104135546 | Oct 2015 | TW | national |