Glom widget

Information

  • Patent Grant
  • 7721226
  • Patent Number
    7,721,226
  • Date Filed
    Wednesday, February 18, 2004
    20 years ago
  • Date Issued
    Tuesday, May 18, 2010
    14 years ago
Abstract
The present invention provides a glom widget to the pen user of a PC that allows them to access contextual tools near a location where they are writing. If the user selects the glom widget, a context menu drops down that contains several of the most common tools and/or commands that a user creating handwriting might want to access. The glom widget menu can also contain contextual commands that are easier to comprehend and use since they are presented directly next to the content on the page to which they relate.
Description
BACKGROUND OF THE INVENTION

Some personal computers allow a user to “write” on their computer display much as they would write on their notepad. One such computer is a tablet Personal Computer (PC) which typically includes the functionality of a laptop computer but including more input features. For example, a tablet PC allows multi-modal input in which a user can input information into the tablet by writing on the touchscreen with a pen, using a keyboard, or even using their voice. A user can take notes just as they would using traditional pen and paper. Handwriting recognition allows the user's handwriting to be converted into digital text. The form factor of a many touchscreen PCs, however, requires a user to move their entire arm and hand to access the menus and toolbars when they want to perform some sort of command. This is much more difficult and tiring than just moving your hand and wrist a little bit with a mouse on a traditional PC.


SUMMARY OF THE INVENTION

Generally, the present invention is directed at providing a glom widget that provides the pen user of a PC contextual tools near a location where they are writing on the touchscreen.


According to one aspect of the invention, the glom widget is placed next to the node handle associated with the current handwriting. The glom widget is placed such that a user may easily access it without excessive movement of their arm.


According to another aspect of the invention, when the user selects the glom widget, a context menu opens that contains several of the most common tools and/or commands that a user creating handwriting might want to access. The contextual commands are generally easier to comprehend and use since they are presented directly next to the content on the screen to which they relate.


According to yet another aspect of the invention, the menu may be modified. For example, a user may customize the menu to contain commands they commonly use.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 illustrates an exemplary PC computing device that may be used according to exemplary embodiments of the present invention;



FIG. 2 shows an exemplary screen including a glom widget;



FIG. 3 shows an exemplary screen including a glom widget menu; and



FIG. 4 illustrates a process for utilizing a glom widget, in accordance with aspects of the invention.





DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

Generally, the present invention is directed at providing a glom widget near where they are writing on the display. The glom widget provides the pen user of a PC contextual tools near where they are writing. The glom widget is positioned such that user movement is decreased in selecting tools and/or commands when writing on a screen.


Illustrative Operating Environment


With reference to FIG. 1, one exemplary system for implementing the invention includes a computing device, such as computing device 100. In a very basic configuration, computing device 100 typically includes at least one processing unit 102 and system memory 104. Depending on the exact configuration and type of computing device, system memory 104 may be volatile (such as Random Access Memory (RAM)), non-volatile (such as Read Only Memory (ROM), flash memory, etc.) or some combination of the two. System memory 104 typically includes an operating system 105, one or more applications 106, and may include program data 107. A pen and ink interface allows a user to enter writing directly on the touchscreen. In one embodiment, application 106 may include a glom widget application 120. This basic configuration is illustrated in FIG. 1 by those components within dashed line 108.


Computing device 100 may have additional features or functionality. For example, computing device 100 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in FIG. 1 by removable storage 109 and non-removable storage 110. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. System memory 104, removable storage 109 and non-removable storage 110 are all examples of computer storage media. Computer storage media includes, but is not limited to, RAM, ROM, Electronically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computing device 100. Any such computer storage media may be part of device 100.


Computing device 100 also includes input device(s) 112 such as a touchscreen input device, a stylus (pen), voice input device (speech recognition), an on-screen keyboard and writing pad, keyboard, mouse, etc. For example, a user could use the pen and writing pad to input their handwritten text into applications, and/or use the pen with the on-screen keyboard. Computing device 100 may also include Output device(s) 114 such as an external display, speakers, printer, etc. may also be included.


Computing device 100 may also contain communication connections 116 that allow the device to communicate with other computing devices 118, such as over a network. An exemplary communications connection is a wireless interface layer that performs the function of transmitting and receiving wireless communications. The wireless interface layer facilitates wireless connectivity between computing device 100 and the outside world. According to one embodiment, transmissions to and from the wireless interface layer are conducted under control of the operating system.


Communication connection 116 is one example of communication media. Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. The term computer readable media as used herein includes both storage media and communication media.


Glom Widget



FIG. 2 shows an exemplary screen including a glom widget, in accordance with aspects of the invention. As shown, screen 200 includes glom widget 210, node handle 230, and exemplary writing 220.


Glom widget 210 provides the pen user of a PC access to contextual tools near where they are writing. Glom widget 210 appears next to handwriting 220 that an inking application recognizes. If the user clicks on the glom widget 210, a context menu (see FIG. 3) drops down that contains several of the most common tools and/or commands that a user creating handwriting might want to access. According to one embodiment, the location of the glom widget is based on the input language. For example, for left-to-right language the glom widget may be placed on the left side of the handwriting and for right-to-left language the glom widget may be placed to the right of the handwriting. According to one embodiment, the glom widget appears on the first line of the current paragraph just to the left (⅛ of an inch) of the node handle for left-to-right handwriting. The glom widget, however, may be placed anywhere that is near where the user is writing that does not interfere with the user's writing. For example, the glom widget may be placed somewhere around the text. The location on the right of writing 220 may be useful for right-to-left languages. Glom widget 210 is placed such that a user may easily access it without excessive movement of their arm. According to one embodiment, glom widget 210 is placed closest to the writing before any other icons are placed. For example, if an audio clip icon exists then the clip icon is rendered to the left of the glom widget. According to another embodiment, the user may also specify where they want the glom widget to appear. For example, the user could specify to place the glom widget a quarter of an inch above the current writing.



FIG. 3 shows an exemplary screen including a glom widget menu, in accordance with aspects of the invention. As shown, screen 300 includes glom widget 310, node handle 230, writing 220, and menu 320.


If the user hovers over the glom widget 210 (as it is shown in FIG. 2), the glom widget changes to a hover shape as illustrated by glom widget 310. The hover behavior of the glom widget appears based on the pens proximity over the glom widget icon and changes slightly when the pen hovers over the top of it.


Once glom widget 310 is clicked on by the user, context menu 320 drops down and contains several of the most common tools and/or commands that a user creating handwriting might want to access. Menu 320 can also contain contextual commands that are easier to comprehend and use since they are presented directly next to the content on the page to which they relate.


Glom widget menu 320 may include any tools and/or commands that help the user. According to one embodiment, menu 320 consists of a set of common tools and commands a pen user uses when writing handwriting on the PC input screen. These include: Bullets; Numbering; Spacer; Merge paragraph with one above; Split last line into new paragraph; Treat Ink as Drawing; Pen (cascade with pen list); Select; Erase; and Cancel which dismisses glom widget menu 320. Menu 320 may also include a list of commands defined by the user. For example, the user could customize menu 320 to only include a subset of the illustrated commands. The user could also add additional commands to menu 320.


The bullets and numbering command allows a user to add bullets or numbering to existing lines of text or the user can create a bulleted list automatically as they type or write.


The merge paragraph command allows a user to merge a node with another. According to one embodiment, the merge command merges the present node with the node above. The merge command is active when the paragraph above is at the same level as the one the user is in (paragraph corresponding to the widget they clicked, could be any individual line from a multi-line paragraph), and when clicked it merges the current paragraph with the one above.


The split command is active on multiple line paragraphs. When selected it inserts a carriage return at the front of the last line in the paragraph. For example, if you had a paragraph that looked like this,


1. This is a sample paragraph of more than one line. The part that is split is the portion on the second line.


Selecting the split command results in the following,


1. This is a sample paragraph of more than one line. The part that is


2. split is the portion on the second line.


The treat ink as drawing instructs the PC to not interpret the writing as text. Another command, “Treat ink as Text” may also be included in the menu to instruct the writing to be treated as text.


The pen command allows a user to select from a palette of pens that may be available to the user. The select command selects the current node. The erase command erases the current node, and the cancel command exits menu 320.



FIG. 4 illustrates a process for utilizing a glom widget, in accordance with aspects of the present invention. After a start block, the process flows to block 410 where the current writing location is determined. The current writing location is determined so that the glom widget may be placed in close proximity.


Moving to block 420, the glom widget is placed in close proximity to the writing location. According to one embodiment, the location of the glom widget is based on the input language. For example, for left-to-right language the glom widget may be placed on the left side of the handwriting and for right-to-left language the glom widget may be placed to the right of the handwriting. The location of the glom widget may be placed in any location near the writing that does not interfere with the user's writing. The glom widget is placed such that user movement is reduced as compared to accessing the menu or tool bar for the writing window.


Transitioning to block 430, a determination is made as to when the glom widget is selected. According to one embodiment, the glom widget is selected when a user clicks on the widget. According to one embodiment, when a user hovers over the glom widget it changes visual appearance slightly to provide feedback to the user.


Once selected, the process moves to block 440 where the glom widget menu is displayed. The menu provides the user with a set of commands without having to move their arm excessively across the display to select a menu. The process then steps to an end block and returns to processing other actions.


The above specification, examples and data provide a complete description of the manufacture and use of the composition of the invention. Since many embodiments of the invention can be made without departing from the spirit and scope of the invention, the invention resides in the claims hereinafter appended.

Claims
  • 1. A method for receiving input in a writing window from a user on a display, comprising: in response to determining a current handwriting; placing a glom widget at a location next to a node handle that is associated with current handwriting that is located near a current writing location such that the user selects the glom widget with reduced movement as compared to accessing a toolbar associated with the writing window; wherein the glom widget is represented by a single selectable graphic that includes only two states including a selected state and a non-selected state; wherein the location of the placement of the glom widget is specified in part by a user preference;maintaining the placement of the glom widget at the location next to the node handle such that the glom widget does not move while the glom widget is displayed during any current handwriting and when a glom widget menu is activated; anddisplaying the glom widget menu having menu items that are associated with handwriting near the current writing location when the glom widget is selected; wherein the glom widget menu comprises the following commands: merge paragraph with a paragraph above; split a last line into a new paragraph; and cancel which dismisses the glom widget menu from being displayed.
  • 2. The method of claim 1, wherein the glom widget menu includes the following commands: bullets; numbering; treat ink as drawing; pen; select; erase and cancel.
  • 3. The method of claim 2, wherein placing the glom widget near the current writing location further comprises placing the glom widget based on an input language being written.
  • 4. The method of claim 3, wherein placing the glom widget near the writing location further comprises placing the glom widget on a left side of the node handle that is associated with the current writing location.
  • 5. The method of claim 2, wherein the glom widget menu comprises a set of contextual commands associated with writing.
  • 6. The method of claim 5, wherein the glom widget menu may be customized.
  • 7. The method of claim 6, further comprising changing an appearance of the glom widget when a user hovers over the glom widget for a predetermined period of time.
  • 8. A system for receiving input from a user on a display, comprising: a display screen configured to receive user input from a pen; andan application configured to perform actions, including: determining a current writing location;in response to determining the current handwriting; placing a glom widget at a location next to a node handle that is associated with current handwriting that is located near a current writing location such that the user selects the glom widget with reduced movement as compared to accessing a toolbar associated with the writing window; wherein the glom widget is represented by a single selectable graphic that includes only two states including a selected state and a non-selected state; wherein the location of the placement of the glom widget is specified in part by a user preference;maintaining the placement of the glom widget at the location next to the node handle such that the glom widget does not move while the glom widget is displayed during any current handwriting and when a glom widget menu is activated; anddisplaying the glom widget menu having menu items that are associated with handwriting near the current writing location when the glom widget is selected; wherein the glom widget menu comprises the following commands: merge paragraph with a paragraph above; split a last line into a new paragraph; and cancel which dismisses the glom widget menu from being displayed.
  • 9. The system of claim 8, wherein placing the glom widget near the current writing location further comprises placing the glom widget such that user movement to access the glom widget is decreased as compared to accessing a corresponding command contained within a fixed menu.
  • 10. The system of claim 8, wherein placing the glom widget near the writing location further comprises placing the glom widget based on an input language being written.
  • 11. The system of claim 9, wherein the glom widget menu is customizable.
  • 12. The system of claim 9, further comprising changing an appearance of the glom widget when a user hovers over the glom widget for a predetermined period of time.
  • 13. A computer-readable storage medium having computer executable instructions for receiving input on a display, the instructions comprising: determining a current writing location;in response to determining the current handwriting; placing a glom widget at a location next to a node handle that is associated with current handwriting that is located near a current writing location such that the user selects the glom widget with reduced movement as compared to accessing a toolbar associated with the writing window; wherein the glom widget is represented by a single selectable graphic that includes only two states including a selected state and a non-selected state; wherein the location of the placement of the glom widget is specified in part by a user preference;maintaining the placement of the glom widget at the location next to the node handle such that the glom widget does not move while the glom widget is displayed during any current handwriting and when a glom widget menu is activated; anddisplaying the glom widget menu having menu items that are associated with handwriting near the current writing location when the glom widget is selected; wherein the glom widget menu comprises the following commands: merge paragraph with a paragraph above; split a last line into a new paragraph; and cancel which dismisses the glom widget menu from being displayed.
  • 14. The computer-readable medium of claim 13, wherein placing the glom widget near the current writing location further comprises placing the glom widget such that user movement to access the glom widget is decreased as compared to accessing a corresponding command contained within a fixed menu.
  • 15. The computer-readable medium of claim 13, wherein placing the glom widget near the writing location further comprises placing the glom widget based on an input language being used.
  • 16. The computer-readable medium of claim 14, wherein the glom widget menu comprises a set of commands associated with writing.
  • 17. The computer-readable medium of claim 14, wherein the glom widget menu is customizable.
  • 18. The computer-readable medium of claim 13, further comprising changing an appearance of the glom widget when the glom widget is hovered over for a predetermined period of time.
US Referenced Citations (154)
Number Name Date Kind
2354332 Polydorof Jul 1944 A
5063376 Chang Nov 1991 A
5063600 Norwood Nov 1991 A
5133076 Hawkins Jul 1992 A
5231698 Forcier Jul 1993 A
5321768 Fenrich Jun 1994 A
5327342 Roy Jul 1994 A
5339391 Wroblewski et al. Aug 1994 A
5347295 Agulnick et al. Sep 1994 A
5367453 Capps et al. Nov 1994 A
5390281 Luciw et al. Feb 1995 A
5404442 Foster et al. Apr 1995 A
5434929 Beernink et al. Jul 1995 A
5442742 Greyson et al. Aug 1995 A
5446882 Capps et al. Aug 1995 A
5465325 Capps et al. Nov 1995 A
5477447 Luciw et al. Dec 1995 A
5479596 Capps et al. Dec 1995 A
5491495 Ward et al. Feb 1996 A
5500937 Thompson-Rohrlich Mar 1996 A
5513309 Meier et al. Apr 1996 A
5517578 Altman et al. May 1996 A
5523775 Capps Jun 1996 A
5528743 Tou et al. Jun 1996 A
5544295 Capps Aug 1996 A
5544358 Capps et al. Aug 1996 A
5555363 Tou et al. Sep 1996 A
5559942 Gough et al. Sep 1996 A
5561446 Montlick Oct 1996 A
5579467 Capps Nov 1996 A
5583542 Capps et al. Dec 1996 A
5588105 Foster et al. Dec 1996 A
5590257 Forcier Dec 1996 A
5592566 Pagallo et al. Jan 1997 A
5594640 Capps et al. Jan 1997 A
5596350 Capps et al. Jan 1997 A
5596694 Capps Jan 1997 A
5596697 Foster et al. Jan 1997 A
5602570 Capps et al. Feb 1997 A
5613019 Altman et al. Mar 1997 A
5634102 Capps May 1997 A
5649133 Arquie Jul 1997 A
5655136 Morgan Aug 1997 A
5666139 Thielens et al. Sep 1997 A
5666552 Greyson et al. Sep 1997 A
5671438 Capps et al. Sep 1997 A
5682439 Beernink et al. Oct 1997 A
5710831 Beernink et al. Jan 1998 A
5745716 Tchao et al. Apr 1998 A
5757383 Lipton May 1998 A
5760773 Berman et al. Jun 1998 A
5764818 Capps et al. Jun 1998 A
5768418 Berman et al. Jun 1998 A
5778404 Capps et al. Jul 1998 A
5796397 Kusano Aug 1998 A
5809498 Lopresti et al. Sep 1998 A
5838326 Card et al. Nov 1998 A
5838819 Ruedisueli et al. Nov 1998 A
5864635 Zetts et al. Jan 1999 A
5867150 Bricklin Feb 1999 A
5874957 Cline et al. Feb 1999 A
5880743 Moran et al. Mar 1999 A
5911145 Arora et al. Jun 1999 A
5953735 Forcier Sep 1999 A
5963208 Dolan et al. Oct 1999 A
5970455 Wilcox et al. Oct 1999 A
6020895 Azami Feb 2000 A
6021218 Capps et al. Feb 2000 A
6035324 Chang et al. Mar 2000 A
6061472 Hullender et al. May 2000 A
6069626 Cline et al. May 2000 A
6081829 Sidana Jun 2000 A
6108445 Uehara Aug 2000 A
6128007 Seybold Oct 2000 A
6128633 Michelman et al. Oct 2000 A
6154219 Wiley et al. Nov 2000 A
6154758 Chiang Nov 2000 A
6188405 Czerwinski et al. Feb 2001 B1
6195094 Celebiler Feb 2001 B1
6199125 Cortesi Mar 2001 B1
6223145 Hearst Apr 2001 B1
6243258 Paratore Jun 2001 B1
6279014 Schilit et al. Aug 2001 B1
6295372 Hawkins et al. Sep 2001 B1
6304272 Schanel et al. Oct 2001 B1
6337698 Keely, Jr. et al. Jan 2002 B1
6340967 Maxted Jan 2002 B1
6345389 Dureau Feb 2002 B1
6348935 Malacinski et al. Feb 2002 B1
6355889 Butcher Mar 2002 B1
6380957 Banning Apr 2002 B1
6487567 Michelman et al. Nov 2002 B1
6487569 Lui et al. Nov 2002 B1
6529215 Golovchinsky et al. Mar 2003 B2
6546397 Rempell Apr 2003 B1
6559871 Brozowski et al. May 2003 B1
6565611 Wilcox et al. May 2003 B1
6570596 Frederiksen May 2003 B2
6594390 Frink et al. Jul 2003 B2
6650347 Nulu et al. Nov 2003 B1
6651221 Thompson et al. Nov 2003 B1
6654035 DeStefano Nov 2003 B1
6661409 Demartines et al. Dec 2003 B2
6678865 Pratley et al. Jan 2004 B1
6681045 Lapstun et al. Jan 2004 B1
6683600 Lui Jan 2004 B1
6690364 Webb Feb 2004 B1
6727927 Dempski et al. Apr 2004 B1
6741749 Herbert, Jr. May 2004 B2
6801190 Robinson et al. Oct 2004 B1
6833827 Lui et al. Dec 2004 B2
6836759 Williamson et al. Dec 2004 B1
6859909 Lerner et al. Feb 2005 B1
6989822 Pettiross et al. Jan 2006 B2
7002560 Graham Feb 2006 B2
7039234 Geidl et al. May 2006 B2
7055110 Kupka May 2006 B2
7079713 Simmons Jul 2006 B2
7091959 Clary Aug 2006 B1
7096432 Huapaya Aug 2006 B2
7174042 Simmons et al. Feb 2007 B1
7185278 Simmons Feb 2007 B1
7188309 Simmons et al. Mar 2007 B2
7240300 Jaeger Jul 2007 B2
7242387 Fitzmaurice et al. Jul 2007 B2
7259752 Simmons Aug 2007 B1
7259753 Keely et al. Aug 2007 B2
7353453 Simmons Apr 2008 B1
7358965 Barabe et al. Apr 2008 B2
7370288 Simmons et al. May 2008 B1
7526737 Simmons et al. Apr 2009 B2
20010000960 Dettloff May 2001 A1
20020078035 Frank et al. Jun 2002 A1
20020097270 Keely et al. Jul 2002 A1
20020126153 Withers et al. Sep 2002 A1
20030066031 Laane Apr 2003 A1
20030071850 Geidl Apr 2003 A1
20030085931 Card et al. May 2003 A1
20030119469 Karr et al. Jun 2003 A1
20030214491 Keely et al. Nov 2003 A1
20030214531 Chambers et al. Nov 2003 A1
20030215142 Gounares Nov 2003 A1
20030227491 Moehrle Dec 2003 A1
20040003350 Simmons et al. Jan 2004 A1
20040021701 Iwema et al. Feb 2004 A1
20040060000 Jaeger Mar 2004 A1
20040135824 Fitzmaurice Jul 2004 A1
20040141015 Fitzmaurice et al. Jul 2004 A1
20050028081 Arcuri et al. Feb 2005 A1
20050179647 Simmons et al. Aug 2005 A1
20050206627 Simmons Sep 2005 A1
20060001656 LaViola et al. Jan 2006 A1
20060233464 Simmons et al. Oct 2006 A1
20060267967 Hinckley et al. Nov 2006 A1
Foreign Referenced Citations (8)
Number Date Country
40 26 852 Feb 1991 DE
0 460 420 Dec 1991 EP
0 780 797 Jun 1997 EP
1 376 390 Jan 2004 EP
1 450 294 Aug 2004 EP
1 486 883 Dec 2004 EP
2 313 993 Dec 1997 GB
3-270403 Dec 1991 JP
Related Publications (1)
Number Date Country
20050183029 A1 Aug 2005 US