This application relates generally to a writing/drawing tablet. More specifically, this application relates to utilizing a pressure sensitive display in combination with a touch screen that can capture image data from the image being drawn on the pressure sensitive display.
In general, Bistable Liquid Crystal Displays (BLCD), and in particular, Cholesteric Liquid Crystal Displays (ChLCDs), have proven to have great potential to create low cost pressure sensitive displays that are efficient power consumers and that can be utilized in a number of unique devices. These displays use a pressure sensitive feature of the ChLCDs that allows generating an image using pressure but consuming little or no power to do so, and requiring no power to maintain the image on the display for extended periods.
Recently, the pressure sensitive cholesteric liquid crystal writing tablet, Boogie Board™ of Improv Electronics has appeared on the market in which a pointed stylus or a finger of a user can be used to write or trace an image on the surface of the tablet. Such a stylus does not transfer any ink or other material to any surface. This tablet offers a considerable improvement over previous tablet technologies in that the image can be simply and instantly erased with the push of a button that applies a voltage pulse to electrodes in the tablet. In a cholesteric liquid crystal tablet, the liquid crystal is sandwiched between two substrates that are spaced to a particular gap. The upper substrate is flexible and the bottom substrate is painted with a light absorbing (black or colored) background. The cell gap is usually set by plastic or glass spacers that are either cylindrical or spherical in shape. When one presses on the top substrate with a point stylus or finger or nail tip or other object, the liquid crystal is locally displaced. Flow induced in the liquid crystal changes its optical texture from a transparent to a brilliant reflective color at the location of the pressure. The reflective lighter color contrasts well to the dark background of the lower substrate. An image traced by the stylus or finger will remain on the tablet indefinitely until erased, typically consuming no power. Erasure is accomplished by applying a voltage pulse to transparent conducting electrodes on the inner surface of the substrates that drive the cholesteric liquid crystal from its color reflective state back to its transparent state.
The above described principle is disclosed in more detail in U.S. Pat. No. 6,104,448, incorporated herein by reference. Polymer dispersions can be used to control the pressure sensitivity and resolution of the image as described in U.S. patent application Ser. No. 12/152,729, filed on May 16, 2008, and incorporated herein by reference. Other modes of operation including multiple color images and select erase are described in the patent application publication given above as well as U.S. Pat. No. 8,139,039 filed on Jul. 29, 2008, and incorporated herein by reference.
It would therefore be desirable to have a writing tablet device where an image being drawn is directly observed on the drawing pad but simultaneously (or subsequently) captured electronically and digitized so as to be observed on a computer screen as well as stored for later recall and use. It would be further useful that the device be able to operate as an input device to a connected external device. Other features such as low-cost and low-power requirements would be of further advantage.
Provided are a plurality of embodiments the invention, including, but not limited to, a writing/drawing tablet with an integrated touch screen for capturing the image written on the writing/drawing tablet into a memory; and
A writing/drawing tablet that can connect to another device for inputting drawing functionality into the other device.
Further provided is a drawing tablet device with data capture comprising: a drawing layer integrated in the device and adapted to display an image drawn upon the drawing layer by application of pressure on the drawing layer without requiring any transfer of matter to the drawing layer, and a data capture device including a data capture layer for capturing the image drawn upon the drawing layer for electronic capture by action other than detection of pressure within the data capture layer, wherein the display back to the user of the image drawn upon the drawing layer does not require the consumption of electrical power from any power source.
Also provided is a drawing tablet with data capture comprising: a pressure sensitive drawing layer including a first substrate having at least one liquid crystal layer and adapted to display back to the user a result of an image drawn upon the drawing layer by application of pressure by the user to the drawing layer to locally displace the liquid crystal to change its reflectance in a persistent manner; an inductive data capture layer including a second substrate for converting the image drawn upon the drawing layer into data only when the image is drawn using a specialized (e.g., active) stylus; and a memory device for storing the data, wherein the data is used for reproducing the image drawn upon the drawing layer.
Further provided is a drawing tablet with data capture comprising: a power supply for powering the device; a memory; a pressure sensitive drawing layer integrated in the device and including a pressure sensitive liquid crystal material, such that an image is drawn on the pressure sensitive drawing layer by providing pressure to a portion of the pressure sensitive drawing layer causing a change in state in the liquid crystal material resulting in a color change in the liquid crystal material in the portion of the pressure sensitive drawing layer for displaying the image without the pressure sensitive drawing layer consuming electrical energy; a data capture device for electronically capturing the image in the memory substantially as displayed by the drawing layer; and a data interface for connecting the device to an external device for communicating with the external device for effecting a process in the external device in real time or near real time based on the capturing.
Also provided is a drawing layer adapted to display an image drawn upon the drawing layer by application of pressure on the drawing layer without requiring any transfer of matter to the drawing layer; a data capture device including a data capture layer for capturing the image drawn upon the drawing layer as electronic data representing the image; and a layer for separating the drawing layer from the data capture layer, the layer having sufficient properties for preventing structure provided on the data capture layer from impacting the image drawn upon the drawing layer.
Further provided is a drawing tablet device with data capture comprising: a drawing layer adapted to display an image drawn upon the drawing layer by application of pressure on the drawing layer; a specialized stylus; a data capture device including a data capture layer having a wire grid provided on a surface thereof for capturing the image drawn upon the drawing layer using the specialized stylus as electronic data representing the image; and a layer for separating the drawing layer from the data capture layer, the layer having sufficient properties for preventing the wire grid from impacting the image drawn on the drawing layer during the application of pressure. An image drawn upon the drawing layer using means other than the specialized stylus results in not capturing the image as electronic data representing the image.
Also provided is a drawing tablet device with data capture comprising: a drawing layer adapted to display an image drawn upon the drawing layer by application of pressure on the drawing layer; a stylus; and a data capture device including a data capture layer for capturing the image drawn upon the drawing layer using the stylus as electronic data representing the image. A thickness of a line drawn upon the drawing layer using the stylus can be varied through interaction of the stylus and the data capture layer such that the electronic data representing the image similarly reflects the varied thickness of the line.
Further provided is a drawing tablet device with data capture comprising: a switch for selecting between a first drawing mode or a second drawing mode; a drawing layer adapted for responding to an image drawn upon the drawing layer by application of pressure on the drawing layer such that when the first drawing mode is active, the drawing layer displays the image, and when the second drawing mode is active, the drawing layer does not display the image; a specialized stylus; and a data capture device including a data capture layer for electronically capturing a motion of the specialized stylus on the drawing layer during both the first drawing mode and the second drawing mode.
Still further provided is a drawing tablet device with data capture comprising: a drawing layer adapted to display an image drawn upon the drawing layer by application of pressure on the drawing layer without requiring any transfer of matter to the drawing layer; and a data capture device including a data capture layer for capturing the image drawn upon the drawing layer as electronic data representing the image. The drawing tablet device is further adapted for accepting an electronic signal for electronically displaying an image on or through the drawing layer.
Even further provided is a drawing tablet device with data capture comprising: a switch for selecting an erase function; a stylus; a drawing layer adapted to display an image drawn upon the drawing layer by application of pressure on the drawing layer without requiring any transfer of matter to the drawing layer; and
a data capture device including a data capture layer for electronically capturing a motion of the stylus on the drawing layer; and an interface for connecting to an external device, wherein the tablet device is adapted for transmitting to the external device the electronically captured motion of the stylus to operate a cursor on the external device. Activation of the switch erases an image drawn on the drawing layer during the capturing of the motion of the stylus.
Also provided are additional embodiments of the invention, some, but not all of which, are described hereinbelow in more detail.
The features and advantages of the examples of the present invention described herein will become apparent to those skilled in the art to which the present invention relates upon reading the following description, with reference to the accompanying drawings, in which:
Provided are embodiments of an electronic writing/drawing tablet that has one or more of the desired features discussed above. The terms “drawing” and “writing” are used as synonyms throughout this disclosure. Both terms are used interchangeably to mean both the drawing of images, lines, etc. and the writing of words, letters, etc., and where only one term is used, it is equivalent to using the other term as well.
An electronic writing tablet as disclosed herein is a design that can be based on Kent Displays' Reflex technology as disclosed in U.S. Pat. No. 6,104,448 and in U.S. patent application Ser. Nos. 12/152,729; and 12/220,805, now issued as U.S. Pat. No. 8,139,039, all incorporated herein by reference, and which can be utilized for various embodiments of a writing/drawing tablet drawing surface modified to have a data capture feature. The reflex technology disclosed in these references makes use of the special pressure sensitivity of certain materials, in particular in a cholesteric polymer composite system, by converting the writing pressure on the display into visible track on the display. Furthermore, PCT application no. PCT/US10/36175 filed on May 26, 2010, incorporated herein by reference, discloses a related device with data capture capability. Various example embodiments of the tablet disclose several ways to integrate memory function and/or data capture functions into such writing/drawing tablets.
One approach is to use a state-of-the-art data capture device, such as a touch screen, to simultaneously capture the information being drawn on the tablet drawing surface. For example, a simple, low cost touch screen provided on the back of the writing/drawing surface can be utilized to capture the stylus movement by utilizing the capture features of the touch screen, as illustrated in
There are many touch input methods that can be used with the writing/drawing tablet as proposed herein to provide the data capture feature, such as are provided by capacitive, inductive, resistive, optical, acoustic, and other touch-input technologies. The touch screen can, for many applications, utilize relatively low resolution technology such as a low-cost resistive touch screen, and such a screen could even avoid the use of the traditional transparent conductor indium tin oxide (ITO), because it can be provided behind (underneath) the writing surface because the writing surface can be made flexible. Such a touchscreen may use a passive stylus. Likewise, a touch screen behind (underneath) the writing surface is also possible with such other touch screen technologies such as the inductive (Electromagnetic Resonance (EMR)) method of at least one preferred embodiment discussed herein, since the writing surface is transparent to the inductive stylus, which can be used to apply the desired pressure to the writing surface. The resistive and inductive methods are examples of touch screen technologies that will not interfere with the intended operation of the tablet. These technologies also provide the benefit that their stylus does not require a tether to the writing/drawing tablet.
The writing/drawing tablet with the integrated touch screen would not likely require extensive processing capability integrated into the device itself for most such applications. The combination writing/drawing tablet drawing surface and touch screen would preferably be adapted to be connected to an external device, such as a computer or cell phone, for example, which could then provide any necessary processing capability, such as for image processing, etc. Alternatively, some minimal processing capability can also be provided in the tablet itself in order to perform some rudimentary processing functions, such as A/D conversion, minor image processing, memory management functions, communication functions, and/or display processing functions, any or all of which can be provided where desired, for example. Features controlling the transmission of stored images to an external device, or for display on an integrated review display as an additional display, can also be supported. Of course, any amount of processing can be provided by adding a more powerful processor(s) and more complex software, if desired.
The connection between the tablet and the external device can be wired or wireless, as desirable for the intended application. Thus, as examples, a wired connection, a direct wired connection, or a USB or other serial port connection could be utilized, or even an Ethernet connection for some embodiments. For wireless connectivity, a WiFi, Bluetooth, NFC, infrared, 3G, or other connection mechanism could be utilized. In some embodiments, both wired and wireless connections might be provided, although the desire to keep the cost of the tablet low, keep it small, thin and light, and the desire to reduce power consumption as far as possible might limit the number of features that one provides in some embodiments of the tablet. A minimal tablet with just those features needed to operate the device and internally store and/or transfer images to external devices thus may be a preferred example embodiment.
An interface can be provided on the tablet to connect the tablet to an external device. Such an interface can use custom protocols, or make use of any of several commercially available standards. For example, implementing the USB Mass Storage class will permit images saved on the tablet to appear in the file system of a host computer, while the USB Human Interface Device class may be used to present the tablet as a digitizer input device or a mouse to an external host computer or other device. Additionally, a Wintab driver could be written for the tablet, such that any application written to the Wintab specification could use the tablet as an input device. Similar standards exist for Bluetooth as well, such as the File Transfer Profile and the Human Interface Device Profile. Thus, the processor of the tablet might be adapted to manage a file system in the tablet memory to support such functions.
For many applications, it is desirable to reduce the cost of the recordable writing/drawing tablet significantly by utilizing the processing capability of the external device, whenever possible. Of course, when desirable, the processing capability could be integrated into the tablet itself for applications where an external device is either not expected to be available, or does not have sufficient processing capability for the intended application(s), or to provide a more self-contained tablet more like a computer.
Thus, the tablet could have a processor (such as a microcontroller, CPU, or other type of processor) incorporated therein to provide sufficient processing in the device. Dedicated processors for implementing the desired interface (e.g., USB, Ethernet, WiFi, Bluetooth, near-field, etc.) could be utilized, and may be available off-the-shelf with either commercially available, or customized, software/firmware. The atom processor line from Intel is one example low-power processor that might be used.
Alternatively, or in addition, a dedicated processor, controller, A/D device, or other electronics might be provided to digitize, filter, or otherwise modify the image drawn on the tablet, and such devices are known to be used with some touch screen applications and some are commercially available.
Furthermore, the tablet might incorporate a memory device, such as RAM, flash, EEPROM, a hard drive, or other data storage mechanism, to store images drawn on the display within the device for later download to a computer or other device. Such a memory could enable the device to store hundreds, or even thousands or more images in the memory. Such memory devices might be removable, such as a USB drive or flash memory card commonly available for digital photography and music storage, for example. An example preferred embodiment of the tablet includes a slot for insertion of commercially available removable flash memory. Thus, in some embodiments, removable memory might avoid the need for tablet connectivity to external devices, as the memory can be removed to be used in other devices, instead.
As discussed above, there are many data capture options, including many touch input methods, that can be used with writing tablets to obtain data capture functionality, such as pressure sensitive touch screens, inductive touch screens (such as Electromagnetic Resonance (EMR) touch screens), optical touch screens, acoustic touch screens, capacitive touch screens, and others.
One preferred example embodiment utilizes an inductive (EMR) touch screen with a specialized stylus, such as an active stylus that electrically interacts with the touch screen. An example of such a touch screen device and stylus that might be utilized for such an embodiment is given in U.S. Pat. No. 5,136,125, incorporated herein by reference.
In such an embodiment, the touch screen is placed underneath the drawing pad, and thus does not interfere with the drawing and display process and hence does not require expensive transparent components. The inductive touch screen inductively (electromagnetically) detects the presence of the specialized stylus sufficiently near the touch screen in any one of a number of different ways that can be used. One manner of detection is that the specialized stylus is provided with a tuned circuit that oscillates and thereby communicates electromagnetically with a “detector” on the touch screen, which detects this oscillation. The stylus is either powered using an internal battery, or preferably it is powered electromagnetically by receiving power from the touch screen itself, such as electromagnetically (e.g., inductively). Depending on how close the stylus is to the touch screen, or how far the user presses the stylus tip into the screen (such as for a stylus with an adjustable tip), a wider or narrower width line might be detected electronically as the stylus is moved across the drawing surface. For example, a wider line might be determined when an adjustable tip is pressed into the screen, bringing the tuned circuit closer to the touch screen detector, and thus presenting a more powerful (or more coupled) connection.
However, as discussed in more detail below, in the inductive touch embodiment, the electronic version of the image is detected (to be electronically stored and/or transferred) independently of the drawn image, as the former detects electromagnetic coupling between the tuned circuit and the detector, whereas the latter uses pressure from the stylus on the writing surface to display an image. Nevertheless, when properly balanced, the two both capture very similar or identical images, and thus the user is none the wiser.
In at least some embodiments, the stylus of an inductive touchscreen can be detected even when it does not quite touch the drawing surface, in which case stylus movements might be electronically captured but nothing drawn on the pressure display. This can be useful when using the stylus to control a cursor on an attached device for implementing specific functions, and it might be desirable in other situations as well. By pressing the stylus harder (deeper) into the drawing surface, a thicker line can be both drawn on the drawing surface (due to the increased pressure of the stylus), and a thicker line can also be detected by the touch screen due to the tip of the stylus (or the electromagnetic components) being closer to the touch screen, or via the relative position of the stylus tip within the stylus (e.g., which could result in the adjustment of a variable LC circuit in the stylus that can be detected). Thus, line width can be similarly or identically adjusted in both the displayed, and the electronically captured, images.
Note that in the above embodiment using an inductive touch screen and the specialized (e.g., active) stylus, data is only captured by the touch screen when the specialized stylus is used. Thus, if one draws on the drawing surface of the tablet using a finger, or a non-specialized stylus (which may be provided expressly for the purpose of not capturing the image) or pen or pencil, for example, the result is that an image can be drawn on the drawing surface for viewing, but no data is collected by the inductive touch screen, and thus no corresponding electronic image is captured. This could be utilized to allow users to draw on the drawing surface without use of the stylus, but the user cannot capture the drawing electronically in such circumstances. This might be desirable in some situations. However, if it is desired to capture the drawing electronically, the specialized stylus should always be used in such cases. Thus, replacement specialized styluses can be made available, where the original may have been lost or damaged.
Again referring to
Alternative approaches to preventing “bleed through” might use a coating over the touch screen surface, rather than the plastic sheet. Coatings, for example, may be used that are blade coated or otherwise coated as a liquid then subsequently cured or hardened to a smooth surface. Sprayable or spreadable materials that can be gelled or hardened, such as paint, adhesives, potting material, etc., may also be used and might further serve an additional function such as gluing the layers together. Alternatively, a sheet with indentations that match and accept the wire grid 62 might also be used.
Typically, it is desirable to have the entire thickness of the device as thin as possible, in particular less than 1 cm thick in a preferred embodiment. Clearly, the thinner the drawing pad 10, the easier for the touch screen to detect the stylus (as the tuned circuit can be closer to the detectors). Also, thinner separator sheet layers are desirable, with thicknesses of 2.35 mm for injection molded ABS to 1.4 mm of acrylic working well, although thicknesses on the order of a few thousandths of an inch may be desirable wherever practical.
The drawing pad 10 of this example embodiment has a writing surface 15 and includes two flexible substrates 11, each with transparent conductive electrodes, 12 located on the inner surface. A pressure sensitive cholesteric liquid crystal dispersion, 13, rests between the electrodes 12. The data capture device includes a specialized stylus 22. Pressure from the stylus, 22, creates a smaller gap distance 18 in the drawing pad 10, compared to the relaxed distance 17, which causes the liquid crystal to flow and change the cholesteric texture from a transparent focal conic texture to a reflective, stable planar texture which becomes a visible image to the eye when contrasted on a dark, usually black background as provided by a light adsorbing layer, 30. Thus, the image is drawn on the writing surface and displayed to the user without the consumption of electrical power, as the image is formed by the distortion of the liquid crystal caused by the stylus pressure, and the image is persistent due to the bistable nature of the liquid crystal. Thus, the image remains when the pressure is removed.
In the case of an inductive touch screen of this example embodiment, pressure from the tip of the specialized stylus 22 is utilized by the user to draw on the writing surface 15 to create an image. At the same time, stylus location information is transferred through the drawing pad 10 to the touch screen 60 by electromagnetic interaction of the specialized stylus 22 and the wire grid 62 of the touch screen, by determining the position or location of the stylus (or the tuned circuit located therein, or an antenna located therein) as location data. There is no need to use pressure information of the stylus in the touch screen to determine the location data in an inductive approach. This location data from the touch screen is transferred to touch pad electronics (not shown) via electrodes 66. There can be a plurality of electrodes 66 depending upon the type of inductive touch screen utilized.
As described, for example, in U.S. Pat. Nos. 4,786,765 and 5,135,125 herein incorporated by reference, inductive touch screens utilize a special stylus, such as one that includes the tuned circuit of an inductor and capacitor connected in series. The stylus is typically provided without connection to a power supply or other device, but has a resonant frequency approximately equal to the frequency of a wave derived from a coil arrangement in a tablet. The position of the stylus on the tablet is detected by coupling energy induced in the stylus back to the electrode grid on the tablet. In a commercially available Waltop device, the Sensor Board, Control Board, and UART connection can be used to communicate with the tablet MCU Device.
Another example embodiment utilizes a pressure sensitive touch screen for the data capture feature, whereby the location of the stylus is recorded by its location on a resistive pad provided on the back side of the drawing surface of the writing tablet, as illustrated in
For this alternative embodiment, the pressure sensitive touch screen 40, is placed adjacent to the writing tablet 10 to provide an integrated writing and recording surface 50. The writing tablet is similar to that described above for
Of course, in some alternative embodiments, the image could be provided as a negative of the above described process by providing a light reflective light background that becomes transparent in response to the stylus pressure under an applied voltage exposing a dark light absorbing background. Either embodiment can be used to display an image due to the contrast between the background and the portion of the liquid crystal that was deformed by the pressure, thereby producing the desired image.
In still other embodiments, a digital camera or other optical capture device can be utilized to capture the image instead of the touch screen. The camera or image sensor may be one such as in a hand carried portable phone with processing capability to identify and capture only the writing surface of the tablet containing the image then displaying the image on the display screen of the phone as well as storing it in memory for later viewing. The camera image might also be used to sharpen the image or otherwise clean up the image by removing artifacts or reflections, for example.
For any of the above embodiments, the entire image may be erased by applying voltage pulses to the electrodes 12, via the interconnects 14, such as disclosed in U.S. Pat. No. 6,104,448 and U.S. patent application Ser. Nos. 12/152,862 and 12/220,805, incorporated by reference. In the example embodiments, these pulses are applied when the erase function is activated, either by pressing an “erase” button, or receiving an erase command from a connected device, or by some other method. In preferable embodiments, electrical power is required by the drawing pad 10 only for erasing the image and putting the liquid crystal back into a neutral state for receiving the next drawing image. There is little or no power consumption during the drawing phase using the above described embodiment. However, electrical power will typically be required for the touch sensor to capture the image data electronically, when this functionality is enabled.
Alternative embodiments may utilizes some electrical power for the drawing process, such as for various contrast improving functions, providing a negative mode (e.g., mode A discussed below), or partial (selective) erasing, as discussed below, but generally it does not require any power to maintain a stable image on the display itself due to the bistable nature of the liquid crystal utilized for the device.
In additional example embodiments with data capture features, using any of the methods and designs disclosed above, the tablet device senses the drawing operation during the drawing process (via the data capture method such as a touch screen) and temporarily stores this data into a memory device (which can preferably be integrated into the device itself, or alternatively could be provided in an external device). Upon the activation of a capture switch, such as a push button (or continuously or at specified time intervals if automatic capture is desired) the device, or an external device, converts the data stored in the memory into a file that is also stored in memory to “capture” the current image. This capture process using a capture switch is like taking a snapshot of the current image for storage. Then, the user can continue to draw on the device to modify the current image, and, if desired, capture additional images by activating the capture switch. In this manner, the progressive changes to an image can be captured by the user. Of course, at any time the user can erase the current image, and start the process all over again.
In additional embodiments, time information might also be captured during the image capture. Thus, the time of each image capture might be stored with the image, or time may be associated with individual data elements from the data capture device. For instance, (x, y, t) data might be captured, with x being one linear dimension coordinate, y being a perpendicular linear dimension coordinate, and t being the time the coordinate is drawn or captured. By storing time information, an image or sequence of images might be redrawn in a proper order piece by piece (and perhaps mapped to an audio recording, such as to recreate a presentation or lecture, for example), or an animation created by the image drawing process, or for some other purpose. In the case of a presentation or lecture synchronized with an audio recording, viewers could hear what the presenter was saying as they were writing each word, drawing each symbol in a mathematical formula, or drawing each line in an image.
Generally, as one draws on the drawing surface (using the proper stylus, if required), the touch screen interface tracks that drawing and streams drawing data to a processor, where the data is converted and stored in memory. For bitmapped file formats, such as BMP, PNG, or TIFF, the streaming data will typically be rendered to an image buffer in RAM. When the image is “captured” the data can be formatted and compressed as specified by the file format and committed to flash. For vector file formats, such as PDF, WMF, EMF, SVG, or CGM, the streaming data can be committed directly to flash or optionally compressed and stored in RAM to be transferred to flash later when the image is “captured”. One method used for such storage is to utilize the vector graphics features of Adobe® Acrobat® as the compressed format that is stored into RAM.
Note that for embodiments using a specialized stylus (such as the inductive touch screen embodiment shown in
In a preferred embodiment, the captured images are stored as Adobe® Acrobat® (pdf) files in a memory in the device. This is done by finalizing the Acrobat file when the capture switch is activated (adding any required overhead to the file) and then saving the file in the flash memory for later viewing or transfer by the user. In at least some preferable embodiments, this captured image cannot be reproduced on the drawing surface of the device subsequent to the original image being erased, and thus must be transferred to another device for viewing. Such a device without reproduction capability is greatly simplified, as the drawing surface need not incorporate display reproduction capability which would add cost, complexity, and mass.
However, in other embodiments, the device provides the capability of displaying the image on the drawing surface by providing a means of electrically drawing images on the drawing surface, such as by using technologies for changing the state of the liquid crystal layer, such as disclosed in U.S. Pat. Nos. 5,889,566 or 5,644,330. Alternatively, the image might be “drawn” on the display by using technologies that will utilize the pressure sensitivity of the drawing surface, such as by utilizing piezoelectric affects, for example.
The captured drawing (image) can be sent to a desktop PC, laptop, PDA, or cell phone via a wireless or a wire link (see
With the consideration of the compactness integration, durability, low power, and convenience of use, any of the following embodiments of the tablet, among others, could be provided to capture the image drawn on the tablet on an external device:
The general design of an example embodiment that is compact and economical is shown in the block diagram in
The flash memory 204 may be removable, such as by using a USB flash drive or other types of removable flash memory commonly used in the computer industry, such as compact flash, memory stick, MicroSD, MMC, etc. or an internal hard drive such as might be used in a laptop computer, for example. Alternatively, the memory 204 may be omitted, with the tablet relying on the memory of the external device connected via the USB, for example, to save on mass, power, and costs, in which case images could be streamed to the external device. However, this would likely require that the tablet device be tethered to the external device for most drawing operations to save drawing iterations, which may not be desirable in many circumstances.
The touch screen 40, 60 is integrated with writing/drawing tablet 10 to form a combined writing/recording surface 50, 55 for the tablet, as illustrated in
Another example embodiment is shown in
Furthermore, the images stored in the memory might be replayed by the tablet through an external display (e.g., a projector), or an additional review/preview display integrated with the tablet. For example, a scroll button could be provided that will scroll through the stored images and redraw them on the external or preview display, without downloading the entire set of images.
To further reduce the cost and improve reliability, the MCU 205, USB port 206, touch screen controller 201, and driving circuits 202 can be replaced with one customized integrated circuit 400 (ASIC), as illustrated in
A display 220 can be added to any of the embodiments of the device, such as a small format display (such as 2.5″ TFT, for example), for page review/preview, such as is illustrated in
The battery 203 in
In an example embodiment shown in
Alternatively the electrode 671 may be unpatterned and electrode 672 patterned (or vice versa) and processed in the form of an active matrix (such as described in U.S. Pat. No. 6,819,310, incorporated by reference). In this case, drive circuit 674 provides voltage waveforms (such as described in the U.S. Pat. No. 6,819,310) to electrode interconnects 673. The dual functioning electronic display and pressure sensitive writing display is integrated with a touch screen 660 having wire grid 662, electrodes 666, separator sheet 642, and light absorbing layer 630, such as described above.
There are many advantages of the integrated dual imaging device with data capture 655. The display may be electronically addressed with a template on which the user may hand write images. The template may be a form in which the user hand writes answers in the blanks of the form and the result captured. It may be the diagram of a football field or basketball floor where the user (coach) hand draws plays for the players on the template. Alternatively, the template may be something simple such as parallel lines to aid the user in writing text such as a lined tablet. The image of the template may be saved with the captured hand written image in a final composite image. Another potential application of the dual functioning device could be an interactive reader whereby a student electronically downloads text or figures and the student underlines important concepts in the text or makes additions to the figures. The handwritten changes can then be captured by the student and saved for further study. Many other applications can come from this dual functioning device.
In a related embodiment, digital images stored in memory or digital images from another source might be displayed through an external display or a display integrated with the tablet, such that images can be displayed through the drawing/writing surface, for example.
Note that for either of these examples, any of the components analogous to those described above (for the tablet designs without electronic display capability) might use designs similar to, or the same as, those described in the sections above. The images electronically drawn on the display might be taken from images that were previously captured by the tablet and stored internally (or stored externally), or that are otherwise provided for display, such as by an external device, for example, or in a networked system supporting multiple tablets, such as is described below.
On the computer 600, an application can be provided that allows the user to see in real-time (or near real-time such that the delay time is unnoticeable or negligible) on virtual screen 15′ the same image that is being drawn on the drawing device 500 (as long as the image is drawn using the specialized stylus 22), as shown by the graphical representation 515 of the device 500. The virtual erase button 501′ and virtual wake/capture button 502′ can be made to operate in the same manner as the corresponding physical buttons on the device 500 by activating the virtual buttons using a mouse cursor, for example. Thus, the application running on the computer 600 can control a functionality of the actual drawing device 500, such as commanding it to erase the drawing surface 15 at the same time the virtual screen 15′ is erased. The virtual indicator 503′ can give the user an indication of the device operation in a manner similar to the indicator 503.
Alternatively, rather than drawing the image on the computer 600 in real time, the tablet 500 could instead have the computer 600 draw the image only after the capture button 502 is pushed to capture the image. Such functionality could be made user selectable on the tablet 500 or the computer 600.
Additional features that can be provided on the computer interface include allowing the view and other settings of the virtual device 515 to be adjusted, such as by using a pop-up window. The computer interface can also be used to configure the drawing device 500. For example, the clock used by the file system in the device may be set such that new image files may have a creation timestamp associated with them. Additionally, the drawing device 500 may be configured to directly save images in a preferred format, such as PDF, WMF, TIFF, BMP, SVG, cgm, PNG, or JPG. Another interface window can be used for the user to select whether to locally save the image on the virtual screen, or to email the image using an email application, or to perform some other function with the image. Such other functions could include uploading the image to a social networking site such as Facebook or Twitter. It could also include uploading the image to a service such as Evernote, which can automatically synchronize your notes across all of your computing devices such as smartphones, personal computers, tablet computers, etc., or importing it into Microsoft OneNote, which offers similar functionality to Evernote. The image files stored in the flash memory of the tablet device 500 may be accessed for copying, opening, deleting, etc. as are files on any removable disk.
An application running on the computer (such as could be provided for installation with the drawing device 500, or be made available for download) can provide a system tray for easy accessibility to the various functions of the device, including a battery capacity indicator for showing the available capacity of the rechargeable battery of the device 500 and a device icon. An indicator showing when the device is not connected can also be provided.
Note also that a color drawing feature described in the cited applications could also be utilized for a drawing tablet with data capture. Also, selective erasure of portions of the drawing also described in that application, could also be utilized for the tablet with data capture features.
The tablet device is thus made useful as a drawing device on a PC, because it is easier to draw with a stylus while looking at the pressure sensitive display than it is to draw on a tablet device while looking up at the PC monitor. Hence, providing a localized image on the drawing surface provides a distinct advantage over devices that cannot do so.
Furthermore, the connection can be adapted for using the stylus for general mouse functionality, such as dragging and dropping rather than drawing, in which case it may not be desirable to see such actions drawn on the drawing pad. Hence, the device may have more than one mode of operation. In a first mode of operation, images drawn on the drawing surface, such as with the specialized stylus, are displayed on the surface. In another mode of operation, in order to prevent such actions from drawing on the drawing pad, the drawing surface could first be erased and then the select erase functionality (described in more detail below) would be kept in an enabled state. Such functionality could be actuated using a switch on the device, or by entering a mode of operation on a menu command. In such a mode of operation, everything drawn by the stylus will match the background color and thus not be visible (i.e., it is continuously erased while being drawn). Depending on the mode of operation, a voltage may be required across the drawing pad electrodes while the select erase functionality is enabled. Alternatively, a higher voltage waveform could be continuously applied to the drawing pad electrodes that erases the entire drawing surface to the focal conic (dark) state, or a yet higher voltage waveform that holds the liquid crystal of the entire drawing surface in a homeotropic state could be used.
The tablet device can thus have a dual usage. It may function as an input device for drawing or controlling a cursor when connected to a computer (in which case images may, or may not, be desired for display on the drawing surface) or the tablet may operate as a note taking/drawing device that stores images in onboard memory when not connected to a computer. This contrasts to single usage devices, such as graphical input tablets which only function as input devices to computers or pen and paper based electronic note taking systems that record notes but aren't useful as computer input devices.
Also, a low-cost device that is always tethered to a PC could omit the battery and flash for an additional example embodiment.
U.S. patent application Ser. No. 12/787,843, filed on May 26, 2010, and incorporated herein by reference, discloses a design for a multi-color dual-mode drawing pad 10 that allows for selective erasure of drawn images, rather than requiring erasing the entire image as discussed above. In this design, a “mode A” is provided where using pressure of a pointed stylus, an image is drawn on the pad via the liquid crystal in the focal conic state against the background liquid crystal in the planar state, and a “mode B” is provided where, using pressure, a color image is drawn on the pad via the liquid crystal in a planar state against the background liquid crystal in the focal conic state. Mode B may be considered as the negative image of Mode A. In the above described embodiment without selective erase, the primary mode of operation is mode B.
This multi-mode approach can be used in another example embodiment of the instant device by using only two colors, a foreground color and a background color, to both draw and erase images on the drawing pad. In such a device, portions of a drawing displayed on the drawing pad that was drawn using one mode can be erased by changing the mode of operation to the other mode, and then writing the background color over the drawing, essentially erasing the drawn image as described in more detail in U.S. Pat. No. 8,139,039
Hence, for example, a device using the dual-mode operation may operate for normal drawing in mode B, which requires no voltage across the drawing pad (i.e., across the liquid crystal via electrodes 12 of writing tablet 10 of
However, if the user desires to erase a part of the displayed image, the drawing pad can be transitioned to mode A for selective erasure wherein voltage is applied to electrodes 12 of writing tablet 10 during the erasure process. This might be done by activating a push switch or other actuator provided on the device, or by activating some menu item or actuator on a remote device with which the tablet is connected, or by sensing some change to the stylus, or by activating a switch on the stylus, either of which can cause a change in the detected resonance circuit of the stylus, causing the tablet to change its mode of operation from mode B to mode A.
Then, the user can erase the desired portion of the displayed image by applying pressure to that portion of the image (such as by using the stylus eraser tip, or even the user's finger, for example). Essentially, the user is overwriting the drawn portion of the image with the background color, thereby erasing that portion of the image. The tablet can then be put back into mode B for further drawing. This can be done by using the manual actuator, or by sensing that the stylus has returned to the drawing tip orientation, for example.
Such a device would still have an erase capability for erasing the entire image, as described above. Generally, no voltage is provided across the liquid crystal for drawing during mode B, whereas a voltage must be applied across the liquid crystal when drawing in mode A, and hence power can be conserved by utilizing mode B for most of the drawing operation, which consumes no power at all (in contrast to mode A, which does consume power during the writing or erasure process. However, once an image is written or erased in Mode A, voltage to electrodes 12 of
As an alternative, drawings could be done using mode A and erasures using mode B.
Such selective erasures can be captured electronically in a similar manner. Once the tablet knows that it is in an erasure mode, images drawn on the tablet that are sensed by the touch screen underlying the drawing pad, there are a number of ways to capture the erasure electronically. For example, erased portions of a “new” image in the background color can be used to overwrite the original image in the background color, thereby erasing the desired portion of the original image. This is particularly useful if the images are stored using vector graphics. Alternatively, if the original image is stored as a bitmap, either a new overwriting bitmap can be used, or the original bitmap can be modified to show the erasure.
The above concept can be modified such that the tablet can display images in color using multiple layers of liquid crystal, as discussed in the Ser. No. 12/787,843 application. In such embodiments, any of the layers could be independently operated in mode A or mode B, leading to a number of permutations of modes to allow for a very complex set of color drawing and erasing capabilities.
Alternative embodiments of the tablet device described herein could be utilized such that the tablet device operates as an input device to support various products and services.
For one example, the drawing tablet device can be utilized as an input device for connecting to a computer for use in various computer applications. For example, the device might operate a cursor as a mouse, digitizer, or trackball interface, such that the drawing device can be used to select various computer functions, such as selecting menus and activation buttons, for example. Furthermore, the device could interface with drawing software, such that rather than using a trackball or mouse, the user, such as using a cursor, for example, can draw using the drawing application. The user could select the current color in the application and then draw images using the cursor to utilize the drawing functions of the drawing software installed on the computer.
The tablet drawing device could even be adapted to allow for drawing lines of varying thickness. For example, by pressing harder on the drawing surface, the stylus is closer to the inductive touch pad of the tablet drawing device, and this closer position could be detected by the electrode grid and thus be translated into thicker lines. Another alternative including using a variable LC circuit in the stylus, such that pushing in a moveable tip on the stylus changes the resonance of the LC circuit (such as by changing settings on a variable capacitor, variable inductor, or variable resistor, for example), which can be interpreted as different line widths. Such a variable LC could also be used to modify functionality on the computer, such as a push in operating as a mouse click, and a lesser push in having a different function, for example. Alternatively, multiple styluses having different resonant frequencies could be utilized for different functions, such as for activating certain colors, line thicknesses, filling in shapes, etc.
Or, the device might interpret the speed of the stylus across the drawing surface as indicating an intended line thickness, such that faster drawing speeds lead to thinner lines, and slower drawing speeds lead to thicker lines, for example.
The recorded line thickness may be tuned based on one or more of pressure, speed, or temperature to match the thickness of the line drawn on the display, as discussed in more detail above. For example,
As another alternative, the tablet drawing device could be utilized as an input device for providing presentations on computer screens, projector screens, tablets, electronic white boards, etc. such that a lecturer or other presenter could use the device for real-time communication, much like a white board or chalk board can be used by a teacher for writing mathematical equations, for example. This is similar to the application shown in
In such an embodiment, it is desirable that the image drawn on the tablet 550 be displayed on the screen 555 in real time, or near real time, such that there is little delay in displaying the image on screen 555. To accommodate such real-time or near real-time display, it may be desirable to directly stream drawing data from the tablet 550 to the projector 552, as any intervening step, such as first storing the image in memory on the tablet, could interfere with the real-time drawing of the image on the screen 555. Note that variable line widths are shown on both the tablet 550, and the screen 555, which are provided in a manner as discussed in more detail hereinabove.
Hence, either the memory storage function could be completely eliminated in this embodiment, or the streaming of the drawing data to the projector 552 could be done prior to memory storage, or in parallel, so that no significant delay in the streaming of the data occurs.
In an alternative embodiment shown in
Such presentation formats using the above embodiment or alternatives thereof might include displaying such images on electronic whiteboards, televisions, or other display types. Furthermore, networked computers or remotely located projectors could be utilized, so that people in remote locations can view the results on local monitors or screens, such as supporting videoconferencing, for example. The advantage of having a local screen for the presenter is that the presenter can see the image on the input device (the tablet) as it is being drawn, and thus more easily continue where they left off, a shortcoming of many existing products. In a videoconference, if more than one user is equipped with a drawing tablet device, they can collaborate on the whiteboard with each user drawing in their own ink color, for instance. Modifications of such a tablet might be to change the aspect ratio of the tablet to better match that of the display screen, or allow the tablet orientation to be changed based on the display screen.
Many other example embodiments of the invention can be provided through various combinations of the above described features. Although the invention has been described hereinabove using specific examples and embodiments, it will be understood by those skilled in the art that various alternatives may be used and equivalents may be substituted for elements and/or steps described herein, without necessarily deviating from the intended scope of the invention. Modifications may be necessary to adapt the invention to a particular situation or to particular needs without departing from the intended scope of the invention. It is intended that the invention not be limited to the particular implementations and embodiments described herein, but that the claims be given their broadest reasonable interpretation to cover all novel and non-obvious embodiments, literal or equivalent, disclosed or not, covered thereby.
This application claims the benefit of U.S. provisional application Ser. No. 61/554,189, filed on Nov. 1, 2011, incorporated herein by reference. Related application Ser. No. 13/458,223 was filed on Apr. 27, 2012, and is also incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
61554189 | Nov 2011 | US |