Interactive display boards may be fabricated in the form of whiteboards and may be of varying sizes and shapes, from those that are handheld to those that span entire walls of classrooms and conference rooms. The interactivity with these boards may come in the form of peripheral devices including companion accessories that interact directly with the whiteboards, such as styluses, and may also come in the form of user-owned peripheral devices such as laptops, desktops, mobile communication devices, tablets, and personal digital assistants. The interactive whiteboards may be configured to communicate with both companion accessories as well as user-owned equipment.
Various examples will be described below referring to the following figures:
Current interactive board technologies, including virtual whiteboards, may employ peripheral devices that enable users to choose various writing preferences by interacting with a predetermined area of the interactive surface. As discussed herein, an “interactive surface” comprises any substrate or combination of substrates capable of communicating with peripheral devices to display markings resulting from the communication between the surface and the peripheral device. This is in contrast to a conventional writing surface, such as paper, a whiteboard, or a blackboard, where the markings may be left by a peripheral device such as a marker or piece of chalk. As used herein, the term “markings” may be used to collectively describe freehand-originated features such as text, drawings, stamps, images, and typeface text that may be imported from peripheral devices, as well as combinations thereof. Thus, a marking would include an image imported to an interactive surface that is then modified by, for example, freehanded writing to emphasize, modify, or deemphasize various features of the image.
Some interactive boards and surfaces may be larger than a person's arm span, with some boards extending an entire length and/or height of a wall. Since the walls containing the interactive surfaces may comprise at least one dimension greater than 30 feet, the user of the board may have to interrupt her presentation or lecture to travel across a room to perform various functions. This may be because the interactive surfaces have designated areas where peripheral devices, such as e-pens, may be used. That is, the user cannot smoothly transition between writing styles, colors, importing/exporting, and other interactive surface functions unless they are interacting with a predetermined portion of the interactive surface that is less than the entire surface and often located at an end portion of the surface. In addition, conventional interactive surfaces may require log-in credentials and/or time-consuming transition processes among and between users. The peripheral devices, such as electronic pens, may be configured to work on tablets and other devices where the user is writing at an upright angle or perpendicular to a surface, as opposed to on a whiteboard where the user may prefer to write at an angle other than perpendicular to the surface.
At least some of the systems and methods discussed herein are directed toward an electronic pen, which may be referred to herein as “the pen” or as an “e-pen.” In some examples, the electronic pen comprises a first side, a second side, and a body portion extending between the two sides. Each of the first and second sides may comprise a “communicable tip” capable of receiving and transmitting information to and from interactive surfaces and other peripheral devices. The first side of the e-pen comprises a pliable tip that may be referred to as the “front of the pen,” the “front tip,” or the “writing tip,” since its interaction with the interactive surface may generate a plurality of markings. The writing tip may be made from materials similar to those used for markers on non-electronic whiteboards, such as felt, cotton, or another textile, and the writing tip may include a polymer core for flexibility. The writing tip is electrically and mechanically coupled to a plurality of sensors and provides users with a writing experience that is closer to the tactile feel, and therefore easier to use, than previously employed pens that may be hard-tipped styluses or that may be designed to function at a limited range of angles with respect to the interactive surface.
In various examples, the writing tip at the front of the pen may take various forms and cross-sectional shapes, including domes, triangles, angled tips, blunt tips, trapezoidal tips, and combinations thereof, The writing tip communicates with the electronic whiteboard or other interactive surface to create a plurality of markings of different dimensions and colors on the interactive surface. In some examples, the writing tip may also be employed for editing functions such as selection, copying, cutting, pasting, rotation, sizing, and cropping of text and drawings. In various examples, the writing tip may be used to write original text on the interactive surface in various colors and line thicknesses, as well as edit others' text that was previously drawn and/or imported, draw figures, edit charts/graphs, and mark up documents that may be loaded onto the interactive surface, These documents may be imported onto the interactive surface from a memory in the interactive surface and/or from remote servers, and may comprise portable document format (PDF) files, plain text files, word processing files, charts, graphs, spreadsheets, video files, or other document types. In some examples, hand-written text on the interactive surface may be converted to a font style based on user selection or predetermined preferences.
The second side of the e-pen, which may also be referred to as the back of the e-pen, may comprise a compressible tip. The compressible tip may be fabricated from a polymer and may encase a sensor and/or a plurality of controls. When pressure is applied to the back of the e-pen via the compressible tip—for example, when compressed against an interactive surface such as an electronic whiteboard—a menu with selectable options is displayed on the interactive surface. This menu may be displayed in the location where the compressible tip is in contact with the interactive surface, and may present as (1) a pull-down menu originating from the compressible tip or in proximity to the compressible tip, (2) a circular, semi-circular, elliptical, or semi-elliptical menu arranged around the compressible tip for 180, 270, or 360 degrees, or (3) other configurations as further discussed below.
As discussed herein, “selectable options” include both those options for markings such as the color, font (if font conversion from handwriting is available), line size (thickness), and line style (e.g., rounded/blunt ends of text), as well as graphics options such as insertion/importing/uploading and/or editing of geometric shapes or flow chart elements, video, and still images. In some examples, the selectable options presented when pressure is applied to the compressible tip include editing options including selecting, copying, pasting, cutting, rotation, cropping, and sizing. Depending upon the example, some or all of these selectable options may be presented to the user when pressure is applied to the compressible tip in and/or around the location where the compressible tip is in contact with the interactive surface. The user may rotate, slide, move, or otherwise use the compressible tip to select an option from the displayed menu. If an option is selected such that it is changed from an initial setting, the user may save this option in an existing pen or user profile or may create a new pen or user profile. Decompressing the compressible tip may remove the display options regardless of whether or not an option was selected. In some examples, the selectable options may be in the form of categories, where the categories are color, line width, editing, or insertion, and the respective sub-categories (options) may be selected after the categories are selected. In contrast to other designs, the user may apply pressure to the compressible tip and pull up the selectable options menu(s) anywhere on the interactive surface, and therefore does not have to leave a location where he/she is already engaged with the interactive surface in order to change a writing characteristic such as a font color, style, or line thickness or style, nor to select an editing option.
Turning to the initial activation of the e-pen, in some examples, the e-pen comprises a non-transitory memory that stores a plurality of default settings for the e-pen, including a default color and line width and/or style. A line style may include the style of the ends of the line (e.g., rounded, square, angled), and/or whether the line is solid, dashed, dotted, and/or banded. When an e-pen is activated (e.g., powered on), for example, by self-activation that is automatic in response to a sensor of the e-pen detecting a predetermined proximity of the e-pen to the interactive surface (e.g., via radio frequency sensors in the writing and/or compressible tips and the interactive surface), this default profile may load, and options may be changed, as discussed above, using the compressible tip. In some examples, the non-transitory memory of the e-pen and/or of the interactive surface may store a plurality of user profiles. The e-pen may comprise an active portion on the body portion that receives a biometric input, such as a fingerprint, voice input, or ocular scan. An application on the e-pen would then either compare the biometric input to a plurality of stored profiles on the e-pen or transmit the biometric input to a remote application. This remote application may be stored on or otherwise associated with the interactive surface and may be executed by a processor located, e.g., in the interactive surface. In either example, a processor executing the application (either on the e-pen or in a remote location) compares the biometric input to a plurality of stored profiles. If the application determines that there is a profile associated with the biometric input, that profile is loaded onto and/or transmitted (e.g., via radio frequency communications) to the e-pen and/or the interactive surface such that markings made while the profile is loaded comprise the properties of that profile. The profiles may be added to expand the settings to include, for example, other settings available as selectable options. In some examples, a user can power-off the e-pen and automatically unload their profile. In another example, when a first profile associated with a first biometric input is loaded on an e-pen and the e-pen receives a second, different biometric input, a secondary confirmation may be requested by the e-pen processor prior to switching to a second profile that is associated with the second biometric input. This secondary confirmation may comprise, e.g., repeating the second biometric input and/or creating a predetermined marking using the e-pen.
The e-pen discussed herein may be used with various interactive surfaces for a smoother user experience, due to a combination of at least the pliable writing tip that creates the tactile feel of using a marker, the ability of the compressible tip to retrieve a menu of selectable options anywhere on an interactive surface, and the use of biometric inputs to link profiles to users to further enhance, ease, and customize the user experience.
In accordance with an example of the present disclosure, an electronic pen is provided. In this example, the electric pen comprises: a body portion extending from a first side to a second side along a central axis, wherein the body portion comprises: a non-transitory memory; an antenna; and a battery. In this example, the electronic pen may further comprise: a writing tip coupled to the first side of the body portion; a first sensor electrically coupled to the writing tip to communicate with the writing tip; a compressible tip coupled to the second side of the body portion; a second sensor in communication with the compressible tip to respond to compression of the compressible tip, wherein a cross-section of the writing tip comprises a polygon, a triangle, a dome, or combinations thereof. Further in this example, the antenna communicates via at least one of Bluetooth, near-field communication (NFC), or Wi-Fi, and the writing tip is a writing tip formed from a pliable material comprising foam, felt, polymer, cotton, or combinations thereof. In this example, the compressible tip, when configured in a compressed state, selects at least one option from a plurality of selectable options comprising writing options, editing options, and graphics options, wherein the plurality of selectable options are displayed on an interactive surface in communication with the compressible tip in response to the compressed state. Furthermore in this example electronic pen, the electronic pen comprises: a biometric sensor coupled to the body portion, wherein the non-transitory memory stores a plurality of profiles, wherein each profile of the plurality of profiles is associated with a biometric signature obtained via the biometric sensor, and a first plurality of controls in communication with the writing tip and a second plurality of controls in communication with the compressible tip and a first plurality of controls in communication with the writing tip and a second plurality of controls in communication with the compressible tip.
In accordance with an example of the present disclosure, an interactive surface system is provided. In this example, the interactive surface system comprises an interactive surface comprising an application stored on a non-transitory memory and executable by a processor; and an electronic pen. In this example, the electronic pen comprises: a body portion extending from a first side to a second side along a central axis, wherein the body portion comprises: a non-transitory memory; an antenna; a battery; a writing tip coupled to the first side; a first sensor electrically coupled to the writing tip to communicate with the writing tip; a compressible tip coupled to the second side; and a second sensor to respond to compression of the compressible tip. In the example interactive surface system, when the electronic pen is configured in a first state, the compressible sensor is compressed via pressurized contact in a first location on the interactive surface, wherein, in response to the compression of the compressible sensor, a plurality of selectable options are displayed on the interactive surface in proximity to the first location, wherein the plurality of selectable options comprise writing options, editing options, and graphics options, Further in this example, the interactive surface system comprises a biometric sensor coupled to the body portion, wherein the non-transitory memory stores a plurality of profiles, wherein each profile of the plurality of profiles is associated with a biometric signature obtained via the biometric sensor.
In accordance with an example of the present disclosure, a method of using an electronic pen. In this example, the method comprises: applying pressure to a first side of an electronic pen, wherein the first side comprises a compressible tip and a second side of the electronic pen comprises a writing tip, wherein the electronic pen is associated with a first profile comprising a first set of writing properties; compressing, in response to applying pressure, the compressible tip against an interactive surface; selecting, via a motion of the compressible tip of the electronic pen, at least one option of a plurality of selectable options displayed on the interactive surface subsequent to the compressing; and changing, in response to the selecting, at least one writing property of the first set of writing properties from an initial state of the first profile to a different state based on the selected option. Further in this example, the method comprises: loading, prior to the applying pressure to the first side, the first profile in response to a biometric input received via a biometric sensor coupled to the electronic pen, based on a previously stored association between the biometric input and the first profile; subsequent to changing the at least one writing property, saving, via a second motion of the compressible tip, the different state of the at least one writing property in the first profile; subsequent to changing the at least one writing property, reapplying pressure to the compressible tip and decompressing the sensor; and drawing, by applying pressure between the writing tip and the interactive surface, a plurality of writings on the electronic whiteboard, wherein the plurality of writings are associated with the different state of the at least one writing property.
The input received at block 104 may be received by a processor executing an application stored in the non-transitory memory of the pen and employed at block 106 to determine if there is a profile stored on the non-transitory memory of the pen that corresponds to the input. In some examples, if no profile is found, a default profile is loaded by the pen at block 108. This default profile may be referred to as the initial state or initial profile of the pen. In another example, if a profile is found at block 106 that corresponds to the input, that profile is loaded at block 110 and this is also referred to as an initial state or initial profile. In some examples, at block 112, a plurality of markings may be drawn on an interactive surface using the writing tip of the pen. These markings comprise properties associated with the initial profile loaded onto the pen. In some examples, this initial profile comprises a blue color and a medium line thickness.
In an example, at block 114, subsequent to the initial profile being loaded at either of blocks 108 or 110, and in some examples after the plurality of markings are drawn at block 112, the application transmits a signal to the interactive surface. This signal is transmitted by the e-pen application when the compressible tip is compressed against the interactive surface, and, subsequently, in response to receiving the signal, a plurality of selectable options are displayed in proximity to the area on the interactive surface where the compressible tip is compressed at block 114. The compression of the compressible tip at block 114 activates a sensor inside of and encased by the compressible portion of the compressible tip. The sensor communicates with a processor executing an application associated with and/or stored on a memory of the interactive surface which displays the menu in response to receiving the signal. At block 116, the pen—for example, the compressible tip end of the pen—may be used to select an option such as a category (e.g., color, line size) or an action (e.g., cut, paste) from the selectable options. This selection may be performed by rotating the compressible tip clockwise or counterclockwise while applying pressure to the compressible tip, or by dragging the compressible tip along the interactive surface to contact a portion of a selectable option. In some examples, selecting a first option at block 116 causes a plurality of sub-options to be displayed, and a sub-option may be selected in the same or a different fashion than the first option was selected. In an example, at block 118, the action selected at block 116 is performed. For example, if an action such as copying is selected at block 116, the area of the interactive surface to be copied is selected at block 118.
In an example, if a category is selected at block 116, an option within that category (e.g., the category selected is “color” and the option selected is “purple”) is selected using the compressible end of the pen (block 120). At block 122, the selected option is changed to the second state (e.g., from the initial state of blue to the second state of purple). At block 128, in some examples, this change from blue to purple may be saved to the profile loaded at block 110 if a profile was loaded at block 110. In alternate examples, at block 128, a new profile may be created and stored using the second state color in addition to the other initial state properties. The updating and/or creation of profiles at block 128 may also be initiated via the compressible tip while the sensor is compressed, and “create new profile” or “store to loaded profile” may be selectable options in some displayed menus. At block 124, the compressible tip may be decompressed against the interactive surface. Subsequently, at block 126, a second plurality of markings may be drawn using the second state properties (e.g., the purple color), regardless of whether the second state has been stored as a part of an existing or new profile at block 128.
In another example, when a profile is found at block 206 that corresponds to the input, that profile is loaded onto the pen at block 210. The state of the pen, once the profile is loaded, is also referred to as an initial state or initial profile. At block 212, subsequent to loading an initial state onto the pen at either of blocks 208 or 210, the interactive surface receives a plurality of inputs from the pen and displays a plurality of initial markings comprising properties associated with the initial state. At block 214, the interactive surface receives a signal due to compression of the back of the e-pen against the interactive surface and displays, in response to receiving the signal, a plurality of selectable options within a predetermined proximity to the compressible tip and in a prearranged order with respect to the compressible tip. This prearranged order may comprise a circular, semi-circular, elliptical, or semi-elliptical arrangement in 180, 270, or 360 degrees around the compressible tip, or it may comprise an arrangement of selectable options extending outward from the compressible tip in at least one direction (linearly).
At block 216, a processor executing the application in the interactive surface receives at least one selection from the pen. At block 218, when the at least one selection at block 216 comprises an editing action, the at least one editing action is received from the pen by the processor in the interactive surface. At block 220, when the at least one selection at block 216 comprises a category, the processor in the interactive surface receives at least one selection for a second state of a category and/or sub-category, e.g., if an initial profile comprises green color and thick line style, the change received at block 220 may comprise periwinkle color. At block 224, the processor in the whiteboard receives an input to store the change as either an update to the initial state (profile) or as a new profile. At block 222, regardless of whether the change is saved at block 224 to a new or existing profile, the interactive surface may receive a second plurality of markings via the front end (writing tip). The form and appearance of the second plurality of markings comprises the change received at block 220. Thus, the second plurality of markings at block 222 would comprise periwinkle ink and a thick line style. That is, a selectable option can be selected and used without being saved to a new or existing profile.
In some examples, a second side sensor 308 is electrically and/or mechanically coupled to the compressible tip 306a, and a plurality of secondary controls 414 are disposed in the compressible tip 306a in the portion 306b located at the second side 306. In this example, the plurality of secondary controls 414 are electrically and/or mechanically coupled to the second side sensor 308 and transmit a signal to the sensor 308 when the compressible tip 306a is compressed as discussed in
The rechargeable battery 408 powers the e-pen's functions and components, such as the first side sensor 404, the biometric sensor 406, the second side sensor 308, the pluralities of controls 402 and 414. In some examples, the first plurality of controls 402 is powered by the battery 408 and receives and processes signals such as pressure (e.g., using a pressure sensor) and angle signals (e.g., using an accelerometer, a gyroscope, or a combination thereof) from the writing tip 302a, where the angle is the relative position of the writing tip 302a with respect to an interactive surface. The signals received by the first plurality of controls 402 from the writing tip 302a may be transmitted to the first side sensor 404. The first side sensor 404 communicates with a processor executing at least one application in an electronic whiteboard or other interactive surface (not shown) to transform the motion of the writing tip 302a of the e-pen 400 to markings on the interactive surface that are drawn according to a profile that is active and loaded on the e-pen 400 and/or the whiteboard. In another example, a plurality of sensors such as a proximity sensor, touch sensor, and a plurality of active pen technology logic may be stored in either the first side 302, the second side 306, or the body portion 304, for example, as a part of the secondary controls 414.
The second plurality of controls 414 may be powered by the battery 408 and configured to communicate with components of the e-pen 400A as well as an interactive surface as discussed below in
In one example, referring to
Each of the writing tips shown in
As shown in
The above discussion is meant to be illustrative of the principles and various examples of the present disclosure. Numerous variations and modifications of the foregoing examples are contemplated. It is intended that the following claims be interpreted to embrace all such variations and modifications.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2017/041213 | 7/7/2017 | WO | 00 |