Patent Application
20120153026
A digitizer is used to generate a digital representation of an image by converting analog signals into digital signals. A digital pen can be used to image handwriting, such as when a user marks on a digitizer pad with a digital pen and the marks are digitized. The digital data that represents the handwriting can be stored in the digital pen and then downloaded to a computer that processes the digital data to generate a display of the handwriting as an image or graphic on a display device. A digitizer pad is typically configured as an M×N sensor array with a large number of signal connections to the digitizer pad so that an (x,y) position of a handwriting mark on the digitizer pad can be determined, and then resolved for display.
A digital signal processor receives data signal inputs from the signal connections to the M×N sensor array and utilizes a large amount of processing resources, such as power and CPU resources, to resolve M×N sensor inputs into an (x,y) position of a handwriting mark. As the size and area of a digitizer pad is increased, the signal connections needed for the sensor array, and the processing resources needed to resolve position data, exponentially increases. The large number of signal connections needed for a sensor array, the additional power needs, and/or processor limitations are all factors that limit conventional digitizer techniques, particularly for resolution and accuracy on larger displays.
This summary is provided to introduce simplified concepts of an encoded micro pattern and a pen digitizer that are further described below in the Detailed Description. This summary is not intended to identify essential features of the claimed subject matter, nor is it intended for use in determining the scope of the claimed subject matter.
In embodiments, an encoded micro pattern includes segments of encoded bits that can be optically-imaged by a pen digitizer. The position of each segment in the encoded micro pattern can be determined from the encoded bits that are unique to a segment. Each of the segments of the encoded micro pattern also includes a fiducial marker that indicates an orientation of a segment in the encoded pattern. The encoded bits of the encoded micro pattern can be integrated into a display surface of a display device, or integrated in a display screen that is positioned over the display surface of a display device.
In other embodiments, a pen digitizer includes a light source that generates light. The pen digitizer also includes light guides, such as fiber optics, configured coaxial within the pen digitizer to transfer the light from the light source and focus the light around an imaging tip of the pen digitizer. A photo array optically-images reflected light from encoded bits in the encoded micro pattern, and a lens focuses the reflected light onto the photo array.
Embodiments of an encoded micro pattern and a pen digitizer are described with reference to the following drawings. The same numbers are used throughout the drawings to reference like features and components:
An encoded micro pattern and a pen digitizer are described. In embodiments, an encoded micro pattern can be integrated into a display surface of a display device, or integrated in a display screen that is positioned over the display surface of a display device. The encoded micro pattern is easily scalable and can be used for various sizes of displays, such as from a small phone display, to a portable laptop, to an LCD display, and for the size of a large whiteboard.
The encoded micro pattern includes segments of encoded bits that can be optically-imaged by a pen digitizer, and the position of each segment in the encoded micro pattern can be determined independently from the encoded bits that are unique to a particular segment. Processing resources are not exponentially increased as the size of the encoded micro pattern increases based on the size of a display device. A computing device utilizes approximately the same processing resources, such as power and CPU resources, independent of whether the encoded micro pattern is implemented for a small display device or a large display device. Additionally, the encoded micro pattern is a passive, non-powered digitizer pattern, while the pen digitizer is powered to illuminate the encoded bits so that they are detectable and can be optically-imaged when the light is reflected back along the optical axis of the pen digitizer.
While features and concepts of the described systems and methods for an encoded micro pattern and a pen digitizer can be implemented in any number of different environments, systems, devices, and/or various configurations, embodiments of an encoded micro pattern and a pen digitizer are described in the context of the following example devices, systems, and configurations.
The digitizer system 100 also includes an encoded micro pattern 108 that includes segments 110 of encoded bits 112. The encoded micro pattern can be integrated into a display surface of the display device 106. Alternatively, the encoded micro pattern can be integrated in a display screen 114 that is sized and designed to position over the display surface of the display device 106. The display screen can be implemented to add digitizer functionality to virtually any type of device. In an embodiment, a segment 110 of the encoded micro pattern can be implemented as a thirty-six (36) bit array of 6×6 encoded bits for a 2048×2048 resolution digitizer, and the segment may optionally include sixteen (16) additional encoded bits for an error-correction code (ECC). The 6×6 pattern can be encoded into a 80 μm×80 μm area at a resolution of three-hundred (300) dpi without interpolation. A segment of the encoded micro pattern can be implemented with more or less of the encoded bits 112 to allow less or more light through the encoded micro pattern so that a displayed image is viewable on the display device. In this example, the encoded micro pattern 108 is illustrated with large encoded bits merely for discussion. In practice, the encoded bits encompass only a small percentage of segment area, and may not be visually perceptible to a user when viewing an image displayed on the display device through the encoded micro pattern.
The position of a segment in the encoded micro pattern is determinable from the encoded bits in a segment. In embodiments, the encoded bits in a segment indicate an (x,y) position of the segment in the encoded micro pattern, which also corresponds to a display location on the display device when the encoded micro pattern is integrated with the display device. The encoded bits can include position determinable bits from which the position of a segment in the encoded micro pattern is determined. For example, a simple encoded micro pattern might include a segment with no encoded bits to indicate the (x,y) position (0,0); a segment with one encoded bit to indicate the (x,y) position (0,1); a segment with two encoded bits to indicate the (x,y) position (1,0); and so on. Generally, more complicated coding schemes with any number, combination, and arrangement of encoded bits can be used to designate the positions of segments in the encoded micro pattern. In embodiments, the encoded bits can also include error-correction bits that may be utilized to verify the determined position of a segment in the encoded micro pattern. Additional encoded bits may be included in a segment to represent other information, such as any type of an application interpreted instruction.
Note that the position of a segment 110 in the encoded micro pattern 108 (or on the display device) is not determined based on a conventional M×N sensor array, which typically requires a large number of signal connections and utilizes a large amount of processing resources, such as power and CPU resources, to resolve M×N sensor inputs into an (x,y) position of a handwriting mark. Rather, the position of each segment 110 in the encoded micro pattern 108 can be determined independently from the encoded bits 112 that are unique to a particular segment. Processing resources of the computing device 104 are not exponentially increased as the size of the encoded micro pattern increases based on the size of a display device, such as from the size of a mobile phone to the size of a tablet computer, or even a large LCD. The computing device that processes the segment data for an imaged segment of encoded bits utilizes approximately the same processing resources independent of whether the encoded micro pattern is implemented for a small display device or a large display device.
In this example of the encoded micro pattern 108, each of the segments include a fiducial marker 116 that indicates an orientation of the segment 110 in the encoded micro pattern. The fiducial marker indicates the orientation of the segment so that the encoded bits 112 are interpreted in a correct sequence or pattern at the computing device to determine the (x,y) position of the segment in the encoded micro pattern. When the encoded bits of a segment are optically-imaged by the pen digitizer 102 to generate a segment image, the image is processed to generate segment data that is then communicated to the computing device 104.
The segment data is processed by the computing device to determine the position of the segment in the encoded micro pattern, as indicated by the encoded bits of the imaged segment. Correspondingly, the computing device 104 can generate a written image for display on the display device 106 at the position that corresponds to the segment in the encoded micro pattern. Additionally, the written image that is displayed on the display device can be generated in approximate real-time when the segment is optically-imaged by the pen digitizer as a user writes with the pen digitizer 102 on the display device 106 (or on the display screen 114 that is positioned over the display device).
In this example, each segment 110 of the encoded micro pattern 108 is shown as an approximate square segment, and each square segment includes a fiducial marker 116 positioned to indicate the orientation of a segment. Although the segments of the encoded micro pattern are shown as approximate square segments, the encoded micro pattern may be designed with segments, regions, areas, and/or groups that include a related set of encoded bits that indicate a determinable position in the encoded micro pattern. Additionally, the fiducial markers may be designed in any configuration of various shapes and/or images that are distributed to each indicate the orientation of a segment when processing segment data to determine the position of a segment in the encoded micro pattern. In practice, a fiducial may not be a separate shape in a segment of the encoded micro pattern. For example, a designated group of fiducial bits 118 can be arranged in a formation 120 that is easily detected in a segment of the encoded micro pattern, and unique enough so as not to be interpreted as part of the encoded bit pattern. Rather than the fiducial marker 116, the encoded bits of the segment 110 may include fiducial bits from which the fiducial marker of the segment can be determined, and the orientation of the segment is indicated by the fiducial bits.
The encoded bits of the encoded micro pattern 108 are designed to be optically-imaged by the pen digitizer 102. The encoded micro pattern is a passive, non-powered digitizer pattern, while the pen digitizer 102 is powered to illuminate the encoded bits so that they are detectable and can be optically-imaged when the encoded bits reflect light back along the optical axis of the pen digitizer. The encoded bits can be formed as negative features in the display surface of the display device 106 or in the display screen 114, and may be silver coated, mirror coated, or similarly treated to improve reflection.
In an implementation, the encoded bits can be formed as a negative pyramid 122 in a display surface 124 (or display screen), as shown in a side view of encoded bits formed as negative pyramids 126. Alternatively, the encoded bits may be formed as a hemisphere divot 128 in a display surface 130 (or display screen). When light at 132 is directed from the pen digitizer 102 to illuminate the encoded micro pattern, the light is reflected at 134 by the encoded bits that are formed as the negative pyramids, or similarly, the light is reflected by the encoded bits that are formed as the hemisphere divots. In implementations, the display surfaces 124 and 130 for example, can be formed with the encoded bits and then covered with a protective layer or film to keep the encoded bits from collecting debris that may limit the ability to reflect light.
In this example, the segment image 204 that includes segment 202 is optically-imaged as a segment trapezoid 206 with image distortion when the pen digitizer is positioned at a tilt angle 208 with respect to a plane of the encoded micro pattern. For example, a user may hold the pen digitizer at any angle when writing with the pen digitizer, and the user may notice a parallax error as a depth-of-field discrepancy between where the pen digitizer contacts a display surface or display screen at 210 and where the written image is displayed at 212 by the display device 214. For example, a user may notice the parallax error when the imaging tip of the pen digitizer on the display surface doesn't match up with a point that a user intended to contact on a displayed page or image.
As described with reference to
The segment trapezoid 206 can then be squared at 222 to generate a squared segment image 224, which can then be processed to determine a position of the segment in the encoded micro pattern. Additionally, the tilt angle 208 can be determined from the segment trapezoid 206 and/or calculated based on the transition from the segment trapezoid to the squared segment image. A higher resolution 3× spatial oversampling can be used when processing the segment data to determine the tilt angle. A written image can then be displayed at 212 on the display device 214 with a parallax correction based on the tilt angle 208 of the pen digitizer.
The pen digitizer 300 includes a light source 306, such as an LED or an infra-red (IR) laser, to generate light that illuminates the encoded bits in the encoded micro pattern. The light source can be implemented for all colors and wavelengths, and can be operable for any type of molecular reflectors, such as quantum dots and other types of nano-structures that may be incorporated or embedded as part of the encoded micro pattern. The light is reflected to image the encoded micro pattern, and may also include regenerated light from the nano-structures.
The pen digitizer also includes light guides 308 that are configured coaxial within the housing 302 of the pen digitizer. The light guides are configured to transfer the light from the light source to focus the light around an imaging tip 310 of the pen digitizer through which the encoded bits of a segment in the encoded micro pattern are imaged. In embodiments, the light guides are implemented as fiber optics. Alternatively or in addition, the light guides can be implemented as internal channels that may be molded within the housing of the pen digitizer. The light guides are also designed to refract the light 312 where the light exits a light guide, and the refracted light 314 further illuminates the encoded micro pattern around the imaging tip. An end view 316 of the pen digitizer further illustrates the housing 302 and the light guides 308 that encircle the imaging tip 310 to uniformly distribute the light all of the way around the imaging tip so that a user can hold and rotate the pen digitizer in any direction. The configuration of the light source and the fiber optics in the pen digitizer is merely illustrative of one optical-mechanical configuration. Other configurations may implement the concept of imaging an encoded micro pattern with reflected light and fiber optics.
The pen digitizer 300 also includes a photo array 318 that optically-images reflected light from the encoded bits of the encoded micro pattern when a lens 320 focuses the reflected light from the encoded bits onto the photo array. The photo array can be implemented as a two-dimension imager array of 51×51 pixels and circuit board 322 that is electrically coupled at 324 to a digital signal processor 326. In this example, the photo array and circuit board are positioned perpendicular to the digital signal processor within the housing of the pen digitizer. The digital signal processor receives a segment image of the encoded bits from the photo array and generates segment data that represents the encoded bits of the segment that is imaged. The pen digitizer 300 also includes a transmitter (not shown) that can then communicate the segment data to a computing device that processes the segment data to determine a position of the segment in the encoded micro pattern. The digital signal processor is electrically coupled at 328 to the transmitter, such as an RF transmitter, Bluetooth, or other wireless transmitter, which may be located near the other end of the pen digitizer along with the battery.
The computing device 404 includes a digitizer application 410 that can be implemented as computer-executable instructions, such as a software application, and executed by one or more processors to implement the various embodiments described herein. For example, the digitizer application is implemented to process segment data received from the pen digitizer to orientate a segment image, square the segment image, determine a tilt angle of the pen digitizer when the segment is optically-imaged, and/or determine a position of the segment in the encoded micro pattern. In an embodiment, the pen digitizer 402 may include the digitizer application 410 and correspondingly, process the segment image as described with reference to the digitizer application. Additionally, the computing device 404 may be implemented with any number and combination of differing components as further described with reference to the example device shown in
The computing device 404 may be implemented in a variety of different configurations, such as for computer 412, mobile 414, and television 416 uses. For example, the computing device may be implemented as any type of a personal computer, desktop computer, a multi-screen computer, laptop computer, tablet, netbook, and so on. The computing device may also be implemented as any type of mobile device, such as a mobile phone, portable music player, portable gaming device, a tablet computer, a multi-screen computer, and so on. The computing device may also be implemented as any type of television device having or connected to generally larger display screens. The techniques described herein may be supported by these various configurations of the computing device and are not limited to the specific examples described herein.
Example methods 500, 600, and 700 are described with reference to respective
At block 502, a segment image from an encoded micro pattern is optically-imaged with a pen digitizer. For example, the pen digitizer 102 (
At block 504, segment data is generated from the encoded bits of the optically-imaged segment and, at block 506, the segment data is communicated to a computing device that processes the segment data. For example, the pen digitizer 102 generates segment data from the segment image, and communicates the segment data to the computing device 104 that processes the segment data to determine a position of the segment in the encoded micro pattern.
At block 508, a position of the segment in the encoded micro pattern is determined and, at block 510, a written image is generated for display on a display device at the position that corresponds to the segment. For example, the computing device 104 determines the position of the segment 110 in the encoded micro pattern 108 from the encoded bits 112 in the segment. In embodiments, the encoded bits in a segment indicate an (x,y) position of the segment in the encoded micro pattern, which also corresponds to a display location on the display device. Accordingly, the computing device generates a written image for display on the display device 106 at the position that corresponds to the segment.
At block 602, light is generated with a light source in a pen digitizer and, at block 604, the light is transferred to illuminate encoded bits of a segment in an encoded micro pattern. For example, the pen digitizer 300 (
At block 606, the light is refracted to direct the light around an imaging tip of the pen digitizer. For example, the light guides refract the light 312 where the light exits a light guide, and the refracted light 314 is directed to further illuminate the encoded micro pattern around the imaging tip 310 of the pen digitizer 300. At block 608, reflected light from the encoded bits of the encoded micro pattern is optically-imaged and, at block 610, the reflected light from the encoded bits is focused onto the photo array. For example, the photo array 318 of the pen digitizer 300 optically-images reflected light from the encoded bits 112 of the encoded micro pattern 108 when the lens 320 focuses the reflected light from the encoded bits onto the photo array.
At block 612, segment data that represents the encoded bits of the segment that is imaged is generated and, at block 614, the segment data is communicated to a computing device that processes the segment data to determine a position of the segment in the encoded micro pattern. For example, the digital signal processor 326 in the pen digitizer 300 generates segment data from the segment image, and a transmitter in the pen digitizer communicates the segment data to the computing device 104 that processes the segment data to determine a position of the segment in the encoded micro pattern.
At block 702, segment data is received from a pen digitizer that generates the segment data from a segment image of encoded bits in an encoded micro pattern. For example, the computing device 104 (
At block 704, a determination is made as to whether the segment image is orientated for processing at the computing device. For example, the digitizer application 410 at the computing device determines whether the segment image is orientated based on a fiducial marker 216 (
If the segment image is not orientated for processing (i.e., “no” from block 704), then at block 706, a determination is made as to whether the segment image needs to be rotated to orientate the segment based on a fiducial marker. If the segment image is to be rotated (i.e., “yes” from block 706), then at block 708, the segment image is rotated to orientate the segment based on the fiducial marker. For example, the digitizer application 410 at the computing device rotates the segment image at 220 to orientate the segment based on the fiducial marker 216. If the segment image does not need to be rotated (i.e., “no” from block 706), or continuing from block 708, then at block 710, a determination is made as to whether the segment image needs to be flipped to orientate the segment based on the fiducial marker of the segment.
If the segment image is to be flipped (i.e., “yes” from block 710), then at block 712, the segment image is flipped to orientate the segment based on the fiducial marker. For example, the digitizer application 410 at the computing device flips the segment image at 218 to orientate the segment based on the fiducial marker 216. If the segment image does not need to be flipped (i.e., “no” from block 710), or continuing from block 712, or if the segment image is already orientated for processing (i.e., “yes” from block 704), then at block 714, a determination is made as to whether the segment image is to be squared. For example, the segment image of the segment 202 is optically-imaged as the segment trapezoid 206 when the pen digitizer is positioned at a tilt angle 208 with respect to a plane of the encoded micro pattern.
If the segment image needs to be squared (i.e., “yes” from block 714), then at block 716, the segment trapezoid is squared for processing of the segment image and, at block 718, the tilt angle of the pen digitizer is determined from the segment trapezoid. For example, the digitizer application 410 at the computing device squares the segment trapezoid to generate the squared segment image 224 so that the encoded bits are interpreted in a correct sequence or pattern to determine the (x,y) position of the segment in the encoded micro pattern. Additionally, the digitizer application determines the tilt angle 208 from the segment trapezoid 206 and/or calculates the tilt angle based on the transition from the segment trapezoid to the squared segment image.
If the segment image does not need to be squared (i.e., “no” from block 714), or continuing from block 718, then at block 720, a position of the segment in the encoded micro pattern is determined. For example, the digitizer application 410 at the computing device determines the position of the segment 202 in the encoded micro pattern 108 from the encoded bits of the segment image. At block 722, a written image is generated for display on a display device at the position of the segment in the encoded micro pattern. For example, the computing device generates a written image for display at 212 on the display device 214, and in embodiments, the written image is displayed with a parallax correction based on the tilt angle 208 of the pen digitizer.
The device 800 includes communication devices 802 that enable wired and/or wireless communication of device data 804, such as received data, data that is being received, data scheduled for broadcast, data packets of the data, etc. The device data or other device content can include configuration settings of the device, media content stored on the device, and/or information associated with a user of the device. Media content stored on the device can include any type of audio, video, and/or image data. The device includes one or more data inputs 806 via which any type of data, media content, and/or inputs can be received, such as user-selectable inputs, messages, communications, music, television content, recorded video content, and any other type of audio, video, and/or image data received from any content and/or data source.
The device 800 also includes communication interfaces 808, such as any one or more of a serial, parallel, network, or wireless interface. The communication interfaces provide a connection and/or communication links between the device and a communication network by which other electronic, computing, and communication devices communicate data with the device.
The device 800 includes one or more processors 810 (e.g., any of microprocessors, controllers, and the like) which process various computer-executable instructions to control the operation of the device. Alternatively or in addition, the device can be implemented with any one or combination of software, hardware, firmware, or fixed logic circuitry that is implemented in connection with processing and control circuits which are generally identified at 812. Although not shown, the device can include a system bus or data transfer system that couples the various components within the device. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.
The device 800 also includes one or more memory devices 814 (e.g., computer-readable storage media) that enable data storage, such as random access memory (RAM), non-volatile memory (e.g., read-only memory (ROM), flash memory, etc.), and a disk storage device. A disk storage device may be implemented as any type of magnetic or optical storage device, such as a hard disk drive, a recordable and/or rewriteable disc, and the like. The device may also include a mass storage media device.
Computer readable media can be any available medium or media that is accessed by a computing device. By way of example, and not limitation, computer readable media may comprise storage media and communication media. Storage media include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer-readable instructions, data structures, program modules, or other data. Storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store information and which can be accessed by a computer.
Communication media typically embody computer-readable instructions or other data in a modulated data signal, such as carrier wave or other transport mechanism. Communication media also include any information delivery media. The term modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media.
A memory device 814 provides data storage mechanisms to store the device data 804, other types of information and/or data, and various device applications 816. For example, an operating system 818 can be maintained as a software application with a memory device and executed on the processors. The device applications may also include a device manager, such as any form of a control application, software application, signal processing and control module, code that is native to a particular device, a hardware abstraction layer for a particular device, and so on. In this example, the device applications 816 include a digitizer application 820. The digitizer application is shown as a software module and/or computer application. Alternatively or in addition, the digitizer application can be implemented as hardware, software, firmware, fixed logic, or any combination thereof.
The device 800 also includes an audio and/or video processing system 822 that generates audio data for an audio system 824 and/or generates display data for a display system 826. The audio system and/or the display system may include any devices that process, display, and/or otherwise render audio, video, display, and/or image data. Display data and audio signals can be communicated to an audio device and/or to a display device via an RF (radio frequency) link, S-video link, composite video link, component video link, DVI (digital video interface), analog audio connection, or other similar communication link. In implementations, the audio system and/or the display system are external components to the device. Alternatively, the audio system and/or the display system are integrated components of the example device.
Although embodiments of an encoded micro pattern and a pen digitizer have been described in language specific to features and/or methods, the subject of the appended claims is not necessarily limited to the specific features or methods described. Rather, the specific features and methods are disclosed as example implementations of an encoded micro pattern and a pen digitizer.
