Some personal computers allow a user to “write” on their computer display much as they would write on their notepad. One such computer is a tablet Personal Computer (PC) which typically includes the functionality of a laptop computer but including more input features. For example, a tablet PC allows multi-modal input in which a user can input information into the tablet by writing on the touchscreen with a pen, using a keyboard, or even using their voice. A user can take notes just as they would using traditional pen and paper. Handwriting recognition allows the user's handwriting to be converted into digital text. The form factor of a many touchscreen PCs, however, requires a user to move their entire arm and hand to access the menus and toolbars when they want to perform some sort of command. This is much more difficult and tiring than just moving your hand and wrist a little bit with a mouse on a traditional PC.
Generally, the present invention is directed at providing a glom widget that provides the pen user of a PC contextual tools near a location where they are writing on the touchscreen.
According to one aspect of the invention, the glom widget is placed next to the node handle associated with the current handwriting. The glom widget is placed such that a user may easily access it without excessive movement of their arm.
According to another aspect of the invention, when the user selects the glom widget, a context menu opens that contains several of the most common tools and/or commands that a user creating handwriting might want to access. The contextual commands are generally easier to comprehend and use since they are presented directly next to the content on the screen to which they relate.
According to yet another aspect of the invention, the menu may be modified. For example, a user may customize the menu to contain commands they commonly use.
Generally, the present invention is directed at providing a glom widget near where they are writing on the display. The glom widget provides the pen user of a PC contextual tools near where they are writing. The glom widget is positioned such that user movement is decreased in selecting tools and/or commands when writing on a screen.
Illustrative Operating Environment
With reference to
Computing device 100 may have additional features or functionality. For example, computing device 100 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in
Computing device 100 also includes input device(s) 112 such as a touchscreen input device, a stylus (pen), voice input device (speech recognition), an on-screen keyboard and writing pad, keyboard, mouse, etc. For example, a user could use the pen and writing pad to input their handwritten text into applications, and/or use the pen with the on-screen keyboard. Computing device 100 may also include Output device(s) 114 such as an external display, speakers, printer, etc. may also be included.
Computing device 100 may also contain communication connections 116 that allow the device to communicate with other computing devices 118, such as over a network. An exemplary communications connection is a wireless interface layer that performs the function of transmitting and receiving wireless communications. The wireless interface layer facilitates wireless connectivity between computing device 100 and the outside world. According to one embodiment, transmissions to and from the wireless interface layer are conducted under control of the operating system.
Communication connection 116 is one example of communication media. Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. The term computer readable media as used herein includes both storage media and communication media.
Glom Widget
Glom widget 210 provides the pen user of a PC access to contextual tools near where they are writing. Glom widget 210 appears next to handwriting 220 that an inking application recognizes. If the user clicks on the glom widget 210, a context menu (see
If the user hovers over the glom widget 210 (as it is shown in
Once glom widget 310 is clicked on by the user, context menu 320 drops down and contains several of the most common tools and/or commands that a user creating handwriting might want to access. Menu 320 can also contain contextual commands that are easier to comprehend and use since they are presented directly next to the content on the page to which they relate.
Glom widget menu 320 may include any tools and/or commands that help the user. According to one embodiment, menu 320 consists of a set of common tools and commands a pen user uses when writing handwriting on the PC input screen. These include: Bullets; Numbering; Spacer; Merge paragraph with one above; Split last line into new paragraph; Treat Ink as Drawing; Pen (cascade with pen list); Select; Erase; and Cancel which dismisses glom widget menu 320. Menu 320 may also include a list of commands defined by the user. For example, the user could customize menu 320 to only include a subset of the illustrated commands. The user could also add additional commands to menu 320.
The bullets and numbering command allows a user to add bullets or numbering to existing lines of text or the user can create a bulleted list automatically as they type or write.
The merge paragraph command allows a user to merge a node with another. According to one embodiment, the merge command merges the present node with the node above. The merge command is active when the paragraph above is at the same level as the one the user is in (paragraph corresponding to the widget they clicked, could be any individual line from a multi-line paragraph), and when clicked it merges the current paragraph with the one above.
The split command is active on multiple line paragraphs. When selected it inserts a carriage return at the front of the last line in the paragraph. For example, if you had a paragraph that looked like this,
1. This is a sample paragraph of more than one line. The part that is split is the portion on the second line.
Selecting the split command results in the following,
1. This is a sample paragraph of more than one line. The part that is
2. split is the portion on the second line.
The treat ink as drawing instructs the PC to not interpret the writing as text. Another command, “Treat ink as Text” may also be included in the menu to instruct the writing to be treated as text.
The pen command allows a user to select from a palette of pens that may be available to the user. The select command selects the current node. The erase command erases the current node, and the cancel command exits menu 320.
Moving to block 420, the glom widget is placed in close proximity to the writing location. According to one embodiment, the location of the glom widget is based on the input language. For example, for left-to-right language the glom widget may be placed on the left side of the handwriting and for right-to-left language the glom widget may be placed to the right of the handwriting. The location of the glom widget may be placed in any location near the writing that does not interfere with the user's writing. The glom widget is placed such that user movement is reduced as compared to accessing the menu or tool bar for the writing window.
Transitioning to block 430, a determination is made as to when the glom widget is selected. According to one embodiment, the glom widget is selected when a user clicks on the widget. According to one embodiment, when a user hovers over the glom widget it changes visual appearance slightly to provide feedback to the user.
Once selected, the process moves to block 440 where the glom widget menu is displayed. The menu provides the user with a set of commands without having to move their arm excessively across the display to select a menu. The process then steps to an end block and returns to processing other actions.
The above specification, examples and data provide a complete description of the manufacture and use of the composition of the invention. Since many embodiments of the invention can be made without departing from the spirit and scope of the invention, the invention resides in the claims hereinafter appended.
Number | Name | Date | Kind |
---|---|---|---|
2354332 | Polydorof | Jul 1944 | A |
5063376 | Chang | Nov 1991 | A |
5063600 | Norwood | Nov 1991 | A |
5133076 | Hawkins | Jul 1992 | A |
5231698 | Forcier | Jul 1993 | A |
5321768 | Fenrich | Jun 1994 | A |
5327342 | Roy | Jul 1994 | A |
5339391 | Wroblewski et al. | Aug 1994 | A |
5347295 | Agulnick et al. | Sep 1994 | A |
5367453 | Capps et al. | Nov 1994 | A |
5390281 | Luciw et al. | Feb 1995 | A |
5404442 | Foster et al. | Apr 1995 | A |
5434929 | Beernink et al. | Jul 1995 | A |
5442742 | Greyson et al. | Aug 1995 | A |
5446882 | Capps et al. | Aug 1995 | A |
5465325 | Capps et al. | Nov 1995 | A |
5477447 | Luciw et al. | Dec 1995 | A |
5479596 | Capps et al. | Dec 1995 | A |
5491495 | Ward et al. | Feb 1996 | A |
5500937 | Thompson-Rohrlich | Mar 1996 | A |
5513309 | Meier et al. | Apr 1996 | A |
5517578 | Altman et al. | May 1996 | A |
5523775 | Capps | Jun 1996 | A |
5528743 | Tou et al. | Jun 1996 | A |
5544295 | Capps | Aug 1996 | A |
5544358 | Capps et al. | Aug 1996 | A |
5555363 | Tou et al. | Sep 1996 | A |
5559942 | Gough et al. | Sep 1996 | A |
5561446 | Montlick | Oct 1996 | A |
5579467 | Capps | Nov 1996 | A |
5583542 | Capps et al. | Dec 1996 | A |
5588105 | Foster et al. | Dec 1996 | A |
5590257 | Forcier | Dec 1996 | A |
5592566 | Pagallo et al. | Jan 1997 | A |
5594640 | Capps et al. | Jan 1997 | A |
5596350 | Capps et al. | Jan 1997 | A |
5596694 | Capps | Jan 1997 | A |
5596697 | Foster et al. | Jan 1997 | A |
5602570 | Capps et al. | Feb 1997 | A |
5613019 | Altman et al. | Mar 1997 | A |
5634102 | Capps | May 1997 | A |
5649133 | Arquie | Jul 1997 | A |
5655136 | Morgan | Aug 1997 | A |
5666139 | Thielens et al. | Sep 1997 | A |
5666552 | Greyson et al. | Sep 1997 | A |
5671438 | Capps et al. | Sep 1997 | A |
5682439 | Beernink et al. | Oct 1997 | A |
5710831 | Beernink et al. | Jan 1998 | A |
5745716 | Tchao et al. | Apr 1998 | A |
5757383 | Lipton | May 1998 | A |
5760773 | Berman et al. | Jun 1998 | A |
5764818 | Capps et al. | Jun 1998 | A |
5768418 | Berman et al. | Jun 1998 | A |
5778404 | Capps et al. | Jul 1998 | A |
5796397 | Kusano | Aug 1998 | A |
5809498 | Lopresti et al. | Sep 1998 | A |
5838326 | Card et al. | Nov 1998 | A |
5838819 | Ruedisueli et al. | Nov 1998 | A |
5864635 | Zetts et al. | Jan 1999 | A |
5867150 | Bricklin | Feb 1999 | A |
5874957 | Cline et al. | Feb 1999 | A |
5880743 | Moran et al. | Mar 1999 | A |
5911145 | Arora et al. | Jun 1999 | A |
5953735 | Forcier | Sep 1999 | A |
5963208 | Dolan et al. | Oct 1999 | A |
5970455 | Wilcox et al. | Oct 1999 | A |
6020895 | Azami | Feb 2000 | A |
6021218 | Capps et al. | Feb 2000 | A |
6035324 | Chang et al. | Mar 2000 | A |
6061472 | Hullender et al. | May 2000 | A |
6069626 | Cline et al. | May 2000 | A |
6081829 | Sidana | Jun 2000 | A |
6108445 | Uehara | Aug 2000 | A |
6128007 | Seybold | Oct 2000 | A |
6128633 | Michelman et al. | Oct 2000 | A |
6154219 | Wiley et al. | Nov 2000 | A |
6154758 | Chiang | Nov 2000 | A |
6188405 | Czerwinski et al. | Feb 2001 | B1 |
6195094 | Celebiler | Feb 2001 | B1 |
6199125 | Cortesi | Mar 2001 | B1 |
6223145 | Hearst | Apr 2001 | B1 |
6243258 | Paratore | Jun 2001 | B1 |
6279014 | Schilit et al. | Aug 2001 | B1 |
6295372 | Hawkins et al. | Sep 2001 | B1 |
6304272 | Schanel et al. | Oct 2001 | B1 |
6337698 | Keely, Jr. et al. | Jan 2002 | B1 |
6340967 | Maxted | Jan 2002 | B1 |
6345389 | Dureau | Feb 2002 | B1 |
6348935 | Malacinski et al. | Feb 2002 | B1 |
6355889 | Butcher | Mar 2002 | B1 |
6380957 | Banning | Apr 2002 | B1 |
6487567 | Michelman et al. | Nov 2002 | B1 |
6487569 | Lui et al. | Nov 2002 | B1 |
6529215 | Golovchinsky et al. | Mar 2003 | B2 |
6546397 | Rempell | Apr 2003 | B1 |
6559871 | Brozowski et al. | May 2003 | B1 |
6565611 | Wilcox et al. | May 2003 | B1 |
6570596 | Frederiksen | May 2003 | B2 |
6594390 | Frink et al. | Jul 2003 | B2 |
6650347 | Nulu et al. | Nov 2003 | B1 |
6651221 | Thompson et al. | Nov 2003 | B1 |
6654035 | DeStefano | Nov 2003 | B1 |
6661409 | Demartines et al. | Dec 2003 | B2 |
6678865 | Pratley et al. | Jan 2004 | B1 |
6681045 | Lapstun et al. | Jan 2004 | B1 |
6683600 | Lui | Jan 2004 | B1 |
6690364 | Webb | Feb 2004 | B1 |
6727927 | Dempski et al. | Apr 2004 | B1 |
6741749 | Herbert, Jr. | May 2004 | B2 |
6801190 | Robinson et al. | Oct 2004 | B1 |
6833827 | Lui et al. | Dec 2004 | B2 |
6836759 | Williamson et al. | Dec 2004 | B1 |
6859909 | Lerner et al. | Feb 2005 | B1 |
6989822 | Pettiross et al. | Jan 2006 | B2 |
7002560 | Graham | Feb 2006 | B2 |
7039234 | Geidl et al. | May 2006 | B2 |
7055110 | Kupka | May 2006 | B2 |
7079713 | Simmons | Jul 2006 | B2 |
7091959 | Clary | Aug 2006 | B1 |
7096432 | Huapaya | Aug 2006 | B2 |
7174042 | Simmons et al. | Feb 2007 | B1 |
7185278 | Simmons | Feb 2007 | B1 |
7188309 | Simmons et al. | Mar 2007 | B2 |
7240300 | Jaeger | Jul 2007 | B2 |
7242387 | Fitzmaurice et al. | Jul 2007 | B2 |
7259752 | Simmons | Aug 2007 | B1 |
7259753 | Keely et al. | Aug 2007 | B2 |
7353453 | Simmons | Apr 2008 | B1 |
7358965 | Barabe et al. | Apr 2008 | B2 |
7370288 | Simmons et al. | May 2008 | B1 |
7526737 | Simmons et al. | Apr 2009 | B2 |
20010000960 | Dettloff | May 2001 | A1 |
20020078035 | Frank et al. | Jun 2002 | A1 |
20020097270 | Keely et al. | Jul 2002 | A1 |
20020126153 | Withers et al. | Sep 2002 | A1 |
20030066031 | Laane | Apr 2003 | A1 |
20030071850 | Geidl | Apr 2003 | A1 |
20030085931 | Card et al. | May 2003 | A1 |
20030119469 | Karr et al. | Jun 2003 | A1 |
20030214491 | Keely et al. | Nov 2003 | A1 |
20030214531 | Chambers et al. | Nov 2003 | A1 |
20030215142 | Gounares | Nov 2003 | A1 |
20030227491 | Moehrle | Dec 2003 | A1 |
20040003350 | Simmons et al. | Jan 2004 | A1 |
20040021701 | Iwema et al. | Feb 2004 | A1 |
20040060000 | Jaeger | Mar 2004 | A1 |
20040135824 | Fitzmaurice | Jul 2004 | A1 |
20040141015 | Fitzmaurice et al. | Jul 2004 | A1 |
20050028081 | Arcuri et al. | Feb 2005 | A1 |
20050179647 | Simmons et al. | Aug 2005 | A1 |
20050206627 | Simmons | Sep 2005 | A1 |
20060001656 | LaViola et al. | Jan 2006 | A1 |
20060233464 | Simmons et al. | Oct 2006 | A1 |
20060267967 | Hinckley et al. | Nov 2006 | A1 |
Number | Date | Country |
---|---|---|
40 26 852 | Feb 1991 | DE |
0 460 420 | Dec 1991 | EP |
0 780 797 | Jun 1997 | EP |
1 376 390 | Jan 2004 | EP |
1 450 294 | Aug 2004 | EP |
1 486 883 | Dec 2004 | EP |
2 313 993 | Dec 1997 | GB |
3-270403 | Dec 1991 | JP |
Number | Date | Country | |
---|---|---|---|
20050183029 A1 | Aug 2005 | US |