This patent application is also related to the following non-provisional patent applications: U.S. patent application Ser. No. 10/186,388, entitled “Writing Guide for a Free-Form Document Editor”; U.S. patent application Ser. No. 10/186,847, entitled “Method and System for Editing Electronic Ink”; U.S. patent application Ser. No. 10/186,874, entitled “Method and System for Selecting Objects on a Display Device”; U.S. patent application Ser. No. 10/186,837, entitled “Space Management for Electronic Documents”; U.S. patent application Ser. No. 10/186,865, entitled “System and Method for Automatically Recognizing Electronic Handwriting in an Electronic Document and Converting to Text”; U.S. patent application Ser. No. 10/186,820, entitled “Method and System for Categorizing Data Objects with Designation Tools”; U.S. patent application Ser. No. 10/186,463, entitled “Method and System for Displaying and Linking Ink Objects with Recognized Text and Objects”. These applications and the application herein are all being filed on the same date, Jun. 28, 2002, and are assigned to the Microsoft Corporation. The subject matter of each of these applications is hereby frilly incorporated by reference.
The present invention relates to editing electronic documents and more specifically relates to a method for resolving document object collisions resulting from document editing.
Electronic document editors are widely used in homes and businesses today. Familiar examples of these editors include word processing applications that operate on personal computers (PCs) and note-taking applications that operate on personal data assistants (PDAs). These applications strive to replace paper as the simplest means to record and communicate information. However, to replace and enhance paper's utility, the electronic document editor must allow the user to place document objects on a page and to edit, move, resize, and add objects, while ensuring that the user can clearly view the individual objects.
Note-taking using a free-form document editor can be enhanced by using certain hardware devices. For example, an electronic tablet can be used to record handwriting and input the handwriting to a conventional computer. Such electronic tablets typically comprise a screen and a handheld device that is similar to a pen (also referred to as a stylus). A user can use the pen to write on the electronic tablet in a manner similar to using traditional pen and paper. The electronic tablet can “read” the strokes of the user's handwriting with the handheld device and render the handwriting in electronic form on the tablet's screen or the computer's display as “electronic ink.” Additionally, the user can create a drawing or text onto blank areas on the page using the stylus and electronic tablet or using a keyboard, pointing device, or other input device. These areas of text or images are called document objects.
Some document constraints can reduce a user's ability to take notes efficiently and effectively using a conventional document editor. A free-form document editor operates to eliminate some document constraints by enabling free-form note taking. Accordingly, the free-form document editor has a different document behavior than a word processor document editor.
By eliminating some document constraints, a free-form document editor may trigger a need for object management in free-form document editors. By adding new objects to a page, or editing, moving, or resizing existing objects, one object may collide with another object on the screen. This collision could either cause one object to cover another, obscuring information in that covered object, or, as traditional electronic document editors do, merely bump the lower object vertically down the page (a one-dimensional solution). Neither of these approaches would allow the free-form document editor to maximize its two-dimensional character. Additionally, in some cases, a user may want the objects to overlap. As such, the system uses a method that resolves collisions two-dimensionally while allowing user flexibility.
Collisions between document objects on a document page are resolved. A collision is identified and a two-dimension resolution of the collision is provided by moving the object the shortest distance from a pre-collision location that would resolve the collision. The method calculates the shortest distance to move the object. The invention also may establish logic that designates some objects as “not able to collide” and the method will not move those objects to resolve a collision.
In one aspect of an exemplary embodiment of the invention, an existing page in an electronic document is modified. By adding a new document object or editing, resizing, or moving an existing object, the boundary of one document object intersects with the boundary of another document object. When the collision occurs, the method determines the shortest distance required to move the object to resolve the collision, either straight down or straight to the right or left, and moves the object in the direction of the shortest distance. If, by moving the second object, another collision occurs, the program resolves the new collision in the same manner.
In a second aspect of an exemplary embodiment of the invention, an existing page in an electronic document is modified. By adding a new object or editing, resizing, or moving an existing object, the boundary of one object intersects with the boundary of another object that the user does not want to move. When the collision occurs, the program does not move the second object. Instead, the objects overlap until the user reconfigures the objects such that the object is then able to move.
The aspects of the present invention may be more clearly understood and appreciated from a review of the following detailed description of the disclosed embodiments and by reference to the drawings and claims.
Exemplary embodiments of the present invention provide a method for maintaining the layout of a free-form electronic document, by moving objects after collisions so that the user can clearly see the individual objects while working with the electronic document.
Personal computer 120 further includes a hard disk drive 127 for reading from and writing to a hard disk, not shown, a magnetic disk drive 128 for reading from or writing to a removable magnetic disk 129, and an optical disk drive 130 for reading from or writing to a removable optical disk 131 such as a CD-ROM or other optical media. Hard disk drive 127, magnetic disk drive 128, and optical disk drive 130 are connected to system bus 123 by a hard disk drive interface 132, a magnetic disk drive interface 133, and an optical disk drive interface 134, respectively. Although the exemplary environment described herein employs hard disk 127, removable magnetic disk 129, and removable optical disk 131, it should be appreciated by those skilled in the art that other types of computer readable media that can store data that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, RAMs, ROMs, and the like, may also be used in the exemplary operating environment. The drives and their associated computer-readable media provide nonvolatile storage of computer-executable instructions, data structures, program modules, and other data for personal computer 120.
A number of program modules may be stored on hard disk 127, magnetic disk 129, optical disk 131, ROM 124, or RAM 125, including an operating system 135, a document editor 136, a collision resolution module 138, and an electronic document 139. Program modules include routines, sub-routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types. Aspects of the present invention may be implemented in the form of a document editor 136 that can operate in concert with the collision resolution module 138 to edit the electronic document 139. The document editor 136 generally comprises computer-executable instructions for creating and editing electronic documents. The collision resolution module 138 is generally accessible to the document editor 136, but also can be implemented as an integral part of the document editor.
A user may enter commands and information into personal computer 120 through input devices, such as a keyboard 140 and a pointing device 142. Pointing devices may include a mouse, a trackball, and an electronic pen that can be used in conjunction with an electronic tablet. Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to processing unit 122 through a serial port interface 146 that is coupled to the system bus 123, but may be connected by other interfaces, such as a parallel port, game port, a universal serial bus (USB), or the like. A display device 147 may also be connected to system bus 123 via an interface, such as a video adapter 148. In addition to the monitor, personal computers typically include other peripheral output devices (not shown), such as speakers and printers.
The personal computer 120 may operate in a networked environment using logical connections to one or more remote computers 149. Remote computer 149 may be another personal computer, a server, a client, a router, a network PC, a peer device, or other common network node. While a remote computer 149 typically includes many or all of the elements described above relative to the personal computer 120, only a memory storage device 150 has been illustrated in
When used in a LAN networking environment, the personal computer 120 is often connected to the local area network 151 through a network interface or adapter 153. When used in a WAN networking environment, the personal computer 120 typically includes a modem 154 or other means for establishing communications over WAN 152, such as the Internet. Modem 154, which may be internal or external, is connected to system bus 123 via serial port interface 146. In a networked environment, program modules depicted relative to personal computer 120, or portions thereof, may be stored in the remote memory storage device 150. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
Moreover, those skilled in the art will appreciate that the present invention may be implemented in other computer system configurations, including hand-held devices (PDAs), multiprocessor systems, microprocessor based or programmable consumer electronics, network person computers, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments, where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
In the representative architecture 200 all of the hardware components are coupled to an ink processing software module 225. The ink-processing module 225 is operable to receive data from the electronic tablet 250 and to render that data as electronic ink. In one embodiment of the present invention, the ink-processing module 225 can be a collection of software modules that perform different tasks for rendering handwriting strokes as electronic ink. For example, the stylus and ink module 228 can receive data describing the positions and angles of the stylus for a series of handwriting strokes. The stylus and ink module 228 can interpret the data for rendering electronic ink. Other software modules, such as a gesture recognizer 230 and word recognizer 235 can be designed to identify certain handwriting strokes and assign them a particular significance. For example, certain gestures such as a cross-out may be recognized and associated with other editing processes. The ink-processing module 225 can also include an erasing functions module 240 for removing electronic ink that has been previously rendered.
Although ink processing modules are known in the art and necessary for an electronic tablet to function, a novel document editing module has been developed by the Microsoft Corporation of Redmond, Wash. that capitalizes on the benefits of handwriting processing technology. The module (i.e., document editor) is a free-form document editor that leverages the functionality of electronic handwriting technology to enable more effective and efficient note taking. Specifically, document editing module 205 facilitates manipulating electronic ink so that a user can create and modify an electronic document 220 with greater ease and sophistication. The document editing module 205 typically comprises a collection of software modules for controlling and manipulating electronic ink rendered on the monitor 270. For example, a parsing module 210 can be used to identify handwriting strokes that are selected by the user for editing. Selected strokes may by highlighted or shaded to assist the user in identifying which strokes are to be edited. A classifier module 215 can identify certain handwriting strokes as being part of a word or drawing and may designate document objects accordingly. Software modules such as the layout module 216 and the collision resolution module 217 can be designed to control how objects move about a page.
Exemplary embodiments of the present invention relate most directly to managing the layout in an electronic document by resolving object collisions. The functionality of embodiments may be performed by a collision resolution module 217 or may be fully integrated into the operation of the document editing module 205.
In an exemplary embodiment of the present invention a determination is made every time a document page is modified as to whether a document object collision has occurred. Modifications include editing an object (illustrated in
The cross-hatched region 410 representing a document object overlap in
An exemplary embodiment of the present invention may maintain information on objects' original positions. If a collision resolution operation moves an object, and later editing, moving, or resizing objects opens up the original position of the moved object, i.e., space on the document page originally occupied by the document object is free of any other document object, that object can be returned to its original location.
In step 1008, the original location of the object is recorded. Also in step 1008, the distance in the side-to-side direction of the page and the distance in the top-to-bottom direction of the page necessary to move the second object (the object hit as a result of the layout change) to resolve the collision is measured. If the decision step 1010 determines that the side-to-side distance is greater than or equal to the top-to-bottom distance, the object is moved straight down, step 1012. If not, the object is moved straight to the side, step 1014. At decision block 1016, this exemplary embodiment of the present invention determines if, by moving the object to the side, the object has been moved off the screen, e.g., a minimum of one inch in width of the object must be within the screen limits to be considered on the screen. If the resolution of the collision moves the object off the screen, the object is instead moved straight down from its pre-collision location, step 1018. If the object remains on the screen, the method moves to step 1020, and the object remains moved to the side. After the object has been moved as part of resolving a collision, the method, in step 1022 determines if any other collisions exist, including secondary collisions resulting from moving the object to resolve an initial collision. If additional collisions exist, the process repeats, beginning at step 1008. Otherwise, the method branches to end block 1024 and terminates. In one embodiment, the invention would return a moved object to its original location if the page is subsequently modified and the modification allows the object to return to its original location without causing a new collision.
In an alternative embodiment of the present invention, the moving an object to resolve a collision may not be desired. This alternative embodiment can best be described by reference to figures.
In step 1410, the original location of the object is recorded. Also in step 1410, the distance in the side-to-side direction of the page and the distance in the top-to-bottom direction of the page necessary to move the second object (the object hit as a result of the layout change) to resolve the collision is measured. If the decision step 1412 determines that the side-to-side distance is greater than or equal to the top-to-bottom distance, the object is moved straight down, step 1414. If not, the object is moved straight to the side, step 1416. At decision block 1418, this alternative embodiment of the present invention determines if, by moving the object to the side, the object has been moved off the screen, e.g., a minimum of one inch in width of the object must be within the screen limits to be considered on the screen. If the resolution of the collision moves the object off the screen, the object is instead moved straight down from its pre-collision location, step 1420. If the object remains on the screen, the method moves to step 1422, and the object remains moved to the side. After the object has been moved as part of resolving a collision, the method, in step 1424 determines if any other collisions exist, including secondary collisions resulting from moving the object to resolve an initial collision. If additional collisions exist, the process repeats, beginning at step 1408. Otherwise, the method branches to end block 1426 and terminates. In one embodiment, the invention would return a moved object to its original location if the page is subsequently modified and the modification allows the object to return to its original location without causing a new collision.
Number | Name | Date | Kind |
---|---|---|---|
2354332 | Polydoroff | Jul 1944 | A |
5321768 | Fenrich et al. | Jun 1994 | A |
5327342 | Roy | Jul 1994 | A |
5339391 | Wroblewski et al. | Aug 1994 | A |
5347295 | Agulnick et al. | Sep 1994 | A |
5442742 | Greyson et al. | Aug 1995 | A |
5491495 | Ward et al. | Feb 1996 | A |
5500937 | Thompson-Rohrlich | Mar 1996 | A |
5517578 | Altman et al. | May 1996 | A |
5559942 | Gough et al. | Sep 1996 | A |
5583542 | Capps et al. | Dec 1996 | A |
5590257 | Forcier | Dec 1996 | A |
5613019 | Altman et al. | Mar 1997 | A |
5649133 | Arquie | Jul 1997 | A |
5655136 | Morgan | Aug 1997 | A |
5760773 | Berman et al. | Jun 1998 | A |
5768418 | Berman et al. | Jun 1998 | A |
5809498 | Lopresti et al. | Sep 1998 | A |
5838326 | Card et al. | Nov 1998 | A |
5838819 | Ruedisueli et al. | Nov 1998 | A |
5864635 | Zetts et al. | Jan 1999 | A |
5867150 | Bricklin et al. | Feb 1999 | A |
5874957 | Cline et al. | Feb 1999 | A |
5953735 | Forcier | Sep 1999 | A |
5963208 | Dolan et al. | Oct 1999 | A |
5970455 | Wilcox et al. | Oct 1999 | A |
6061472 | Hullender et al. | May 2000 | A |
6069626 | Cline et al. | May 2000 | A |
6081829 | Sidana | Jun 2000 | A |
6108445 | Uehara | Aug 2000 | A |
6128633 | Michelman et al. | Oct 2000 | A |
6154219 | Wiley et al. | Nov 2000 | A |
6154758 | Chiang | Nov 2000 | A |
6188405 | Czerwinski et al. | Feb 2001 | B1 |
6223145 | Hearst | Apr 2001 | B1 |
6279014 | Schilit et al. | Aug 2001 | B1 |
6295372 | Hawkins et al. | Sep 2001 | B1 |
6304272 | Schanel et al. | Oct 2001 | B1 |
6337698 | Keely, Jr. et al. | Jan 2002 | B1 |
6340967 | Maxted | Jan 2002 | B1 |
6345389 | Dureau | Feb 2002 | B1 |
6355889 | Butcher et al. | Mar 2002 | B1 |
6487567 | Michelman et al. | Nov 2002 | B1 |
6487569 | Lui et al. | Nov 2002 | B1 |
6529215 | Golovchinsky et al. | Mar 2003 | B2 |
6565611 | Wilcox et al. | May 2003 | B1 |
6594390 | Frink et al. | Jul 2003 | B2 |
6651221 | Thompson et al. | Nov 2003 | B1 |
6654035 | DeStefano | Nov 2003 | B1 |
6661409 | Demartines et al. | Dec 2003 | B2 |
6678865 | Pratley et al. | Jan 2004 | B1 |
6690364 | Webb | Feb 2004 | B1 |
6741749 | Herbert, Jr. | May 2004 | B2 |
6801190 | Robinson et al. | Oct 2004 | B1 |
6833827 | Lui et al. | Dec 2004 | B2 |
6836759 | Williamson et al. | Dec 2004 | B1 |
6989822 | Pettiross et al. | Jan 2006 | B2 |
7002560 | Graham | Feb 2006 | B2 |
7039234 | Geidl et al. | May 2006 | B2 |
7079713 | Simmons | Jul 2006 | B2 |
20020078035 | Frank et al. | Jun 2002 | A1 |
20020097270 | Keely et al. | Jul 2002 | A1 |
20020126153 | Withers et al. | Sep 2002 | A1 |
20030214491 | Kelly et al. | Nov 2003 | A1 |
20030214531 | Chambers | Nov 2003 | A1 |
20030215142 | Gounares et al. | Nov 2003 | A1 |
20040003350 | Simmons et al. | Jan 2004 | A1 |
Number | Date | Country |
---|---|---|
40 26 852 | Feb 1991 | DE |
3-270403 | Dec 1991 | JP |
Number | Date | Country | |
---|---|---|---|
20040003350 A1 | Jan 2004 | US |