1. Field of the Invention
The field of the invention is data processing, or, more specifically, methods, apparatus, and products for displaying documents to a plurality of users of a surface computer.
2. Description of Related Art
Multi-touch surface computing is an area of computing that has made tremendous advancements over the last few years. Multi-touch surface computing allows a user to interact with a computer through a surface that is typically implemented as a table top. The computer renders a graphical user interface (‘GUI’) on the surface and users may manipulate GUI objects directly with their hands using multi-touch technology as opposed to using traditional input devices such as a mouse or a keyboard. In such a manner, the devices through which users provide input and receive output are merged into a single surface, which provide an intuitive and efficient mechanism for users to interact with the computer. As surface computing becomes more ubiquitous in everyday environments, readers will appreciate advancements in how users may utilize surface computing to intuitively and efficiently perform tasks that may be cumbersome using traditional input devices such as a keyboard and mouse. Specifically, readers will appreciate advancements in displaying documents to a plurality of users of a surface computer.
Methods, apparatus, and products are disclosed for displaying documents to a plurality of users of a surface computer, the surface computer comprising a surface, surface computer capable of receiving multi-touch input through the surface and rendering display output on the surface, that include: registering a plurality of users with the surface computer, the plurality of users including a moderator and a plurality of participants; assigning, to each registered user, a portion of the surface for interaction between that registered user and the surface computer; selecting, by the moderator for sharing with the plurality of participants, a document stored in the surface computer; rendering contents of the document on the moderator's assigned portion of the surface; and rendering the contents of the document on each of the participants' portions of the surface.
The foregoing and other objects, features and advantages of the invention will be apparent from the following more particular descriptions of exemplary embodiments of the invention as illustrated in the accompanying drawings wherein like reference numbers generally represent like parts of exemplary embodiments of the invention.
Exemplary methods, apparatus, and products for displaying documents to a plurality of users of a surface computer in accordance with the present invention are described with reference to the accompanying drawings, beginning with
The exemplary surface computer (152) of
In the example of
Although the exemplary surface computer (152) of
In the example of
The surface computer (152) of
Stored in RAM (156) is a document display module (120), software that includes computer program instructions for displaying documents to a plurality of users of the surface computer (152) according to embodiments of the present invention. The document display module (120) operates generally for displaying documents to a plurality of users of the surface computer (152) according to embodiments of the present invention by: registering a plurality of users with the surface computer (152), the plurality of users including a moderator and a plurality of participants; assigning, to each registered user, a portion of the surface (100) for interaction between that registered user and the surface computer (152); selecting, by the moderator for sharing with the plurality of participants, a document stored in the surface computer (152); rendering contents of the document on the moderator's assigned portion of the surface (100); and rendering the contents of the document on each of the participants' portions of the surface (100). Readers will note that in a preferred embodiment, the display surface (100) is sufficiently large to accommodate several individuals seated around the display surface such as, for example, when the surface computer serves as a conference table. The document rendered on the surface (100) may include a word processing document, an image, a video, slide show presentation, XML-based document, and so on. The moderator is a user of the surface computer (152) who shares the document with other users of the surface computer (152). The moderator may control the contents of the document that each user views in that user's portion of the surface (100). The participants are the other users of the surface computer (152) with whom the moderator shares the document.
The document display module (120) of
Also stored in RAM (168) is an operating system (154). Operating systems useful for applying displaying documents to a plurality of users of a surface computer according to embodiments of the present invention may include or be derived from UNIX™, Linux™, Microsoft Vista™, Microsoft XP™, AIX™, IBM's i5/OS™, and others as will occur to those of skill in the art. The operating system (154) and the document display module (120) in the example of
The surface computer (152) of
The example surface computer (152) of
The exemplary surface computer (152) of
The exemplary surface computer (152) of
The exemplary surface computer (152) of
The arrangement of networks and other devices making up the exemplary system illustrated in
For further explanation,
In the examples of
In
In addition to rendering the document contents (212) on the moderator's assigned portion (210) of the surface (100),
After the moderator (200) is finished sharing the document with the participants (201-206), the moderator may instruct the surface computer (152) to stop sharing the document. The surface computer (152) of
For further explanation,
The method of
After authenticating the user, the surface computer may determine the user's authorization for using the surface computer by retrieving access permissions for the authenticated user from the surface computer's authorization policy. The granularity of the access permissions may vary from one embodiment to another. For example, an authorization policy may provide either complete access to the surface computer or no access to the surface computer at all depending on the user's identity. In other embodiments, an authorization policy may provide access to view documents using the surface computer, but no authorization to add, modify, or delete documents. Readers will note that the authorization policy may not assign access permission directly to individual users. Rather, the authorization policy may assign access permissions to a group to which an individual user belongs.
The method of
The surface computer may define a region around that identified point by establishing a boundary around the identified point that extends from the edge of the surface toward the center of the surface. Combined with the edge of the surface, the boundary may resemble a rectangle, a semicircle, a triangle, or any other geometric shape. In some embodiments, the surface computer may render a line along the boundary of the region to aid the users in visualizing their portions of the surface through which they may interact with the surface computer. The boundary used to define the region may be fixed or movable by the user. The user may move the boundary by manipulating line rendered on the surface using the user's fingers. For example, if the user wants a larger portion of the surface with which to interact with the surface computer, then the user may drag the boundary line defining the user's portion of the surface away from the user. The surface computer may detect the user's input, recognize the input as an adjustment to the user's boundary, reassign the surface portion to the user based on the boundary adjustment input, and redraw the boundary line at the edge of the user's assigned portion of the surface.
Readers will note that assigning (302), to each registered user, a portion of the surface for interaction between that registered user and the surface computer as described above is carried out using input from the users of the surface computer. In some other embodiments, however, assigning (302), to each registered user, a portion of the surface for interaction between that registered user and the surface computer may be carried out without any user intervention at all. The surface computer may assign a portion of the surface to each user based on user preferences provided in the user's profile such as, for example, the user's preferred location around the surface. In other embodiments, a moderator may provide the surface computer with assignment instructions for each of the users around the surface. Readers will note that the surface computer may adjust the size of each user's assigned portion based on the surface size, the number of users sitting around the surface, and so on.
The method of
Using surface image processing to identify the computing device, for example, the surface computer analyzes an image of the surface to identify the computing device using pattern recognition software. After recognizing the computing device, the surface computer may retrieve connection information from a device data repository used to establish data communications with the computing device placed on the surface. To aid identification of the portable computing device, a small infrared tag may be affixed to the device that provides the surface computer with a device identifier for the device.
Using frustrated total internal reflection technology to identify the computer device, for example, the surface computer is able to detect that a device is placed on the surface. Upon detecting that the device is place on the surface of the surface computer, the surface computer may interrogate the device to retrieve data communication connection information. In some embodiments, the portable computing device may have affixed to it an RFID tag that the surface computer may use to retrieve a device identifier for the device, which in turn may be used by the surface computer to retrieve data communication connection information from a device data repository.
Selecting (304), by the moderator for sharing with the plurality of participants, a document stored in the surface computer according to the method of
Selecting (304), by the moderator for sharing with the plurality of participants, a document stored in the surface computer according to the method of
Selecting (304), by the moderator for sharing with the plurality of participants, a document stored in the surface computer according to the method of
After the moderator selects (304) a document for sharing with the participants, the method of
The method of
After the moderator is finished sharing the document with the participants, the method of
The method of
Readers will note that displaying documents to a plurality of users of a surface computer according to embodiments of the present invention as described above advantageously provides a common interface for viewing and manipulating a document among a group of users. Providing a common interface for interacting with personalized documents has performance advantages over traditional systems that employ multiple network-connected devices because network overhead is substantially reduced and real-time collaborative usability is enhanced.
Exemplary embodiments of the present invention are described largely in the context of a fully functional computer system for displaying documents to a plurality of users of a surface computer. Readers of skill in the art will recognize, however, that the present invention also may be embodied in a computer program product disposed on a computer readable media for use with any suitable data processing system. Such computer readable media may be transmission media or recordable media for machine-readable information, including magnetic media, optical media, or other suitable media. Examples of recordable media include magnetic disks in hard drives or diskettes, compact disks for optical drives, magnetic tape, and others as will occur to those of skill in the art. Examples of transmission media include telephone networks for voice communications and digital data communications networks such as, for example, Ethernets™ and networks that communicate with the Internet Protocol and the World Wide Web as well as wireless transmission media such as, for example, networks implemented according to the IEEE 802.11 family of specifications. Persons skilled in the art will immediately recognize that any computer system having suitable programming means will be capable of executing the steps of the method of the invention as embodied in a program product. Persons skilled in the art will recognize immediately that, although some of the exemplary embodiments described in this specification are oriented to software installed and executing on computer hardware, nevertheless, alternative embodiments implemented as firmware or as hardware are well within the scope of the present invention.
It will be understood from the foregoing description that modifications and changes may be made in various embodiments of the present invention without departing from its true spirit. The descriptions in this specification are for purposes of illustration only and are not to be construed in a limiting sense. The scope of the present invention is limited only by the language of the following claims.
Number | Name | Date | Kind |
---|---|---|---|
3873769 | Cotter | Mar 1975 | A |
4393410 | Ridge et al. | Jul 1983 | A |
4577058 | Collins | Mar 1986 | A |
4771336 | Ohtorii | Sep 1988 | A |
5574577 | Wally, Jr. et al. | Nov 1996 | A |
5630168 | Rosebrugh et al. | May 1997 | A |
5838326 | Card et al. | Nov 1998 | A |
6014662 | Moran et al. | Jan 2000 | A |
6561678 | Loughrey | May 2003 | B2 |
6571279 | Herz et al. | May 2003 | B1 |
6636831 | Profit, Jr. et al. | Oct 2003 | B1 |
6806636 | Kang et al. | Oct 2004 | B2 |
6839669 | Gould et al. | Jan 2005 | B1 |
6850252 | Hoffberg | Feb 2005 | B1 |
6938203 | Dimarco et al. | Aug 2005 | B1 |
6970821 | Shambaugh et al. | Nov 2005 | B1 |
6982649 | Blum et al. | Jan 2006 | B2 |
6999932 | Zhou | Feb 2006 | B1 |
7035804 | Saindon et al. | Apr 2006 | B2 |
7174056 | Silverbrook et al. | Feb 2007 | B2 |
7209124 | Hunt et al. | Apr 2007 | B2 |
7441706 | Schuessler et al. | Oct 2008 | B1 |
7830408 | Asthana et al. | Nov 2010 | B2 |
20020178190 | Pope et al. | Nov 2002 | A1 |
20020191072 | Henrikson | Dec 2002 | A1 |
20030066073 | Rebh | Apr 2003 | A1 |
20030078840 | Strunk et al. | Apr 2003 | A1 |
20030142135 | Hori et al. | Jul 2003 | A1 |
20030160862 | Charlier et al. | Aug 2003 | A1 |
20030204403 | Browning | Oct 2003 | A1 |
20040019482 | Holub | Jan 2004 | A1 |
20040051644 | Tamayama et al. | Mar 2004 | A1 |
20040199597 | Libbey et al. | Oct 2004 | A1 |
20040201871 | Risheq | Oct 2004 | A1 |
20040237033 | Woolf et al. | Nov 2004 | A1 |
20050110964 | Bell et al. | May 2005 | A1 |
20050149364 | Ombrellaro | Jul 2005 | A1 |
20050149620 | Kirkland et al. | Jul 2005 | A1 |
20050149621 | Kirkland et al. | Jul 2005 | A1 |
20050154595 | Bodin | Jul 2005 | A1 |
20050182680 | Jones, III | Aug 2005 | A1 |
20050183023 | Maruyama et al. | Aug 2005 | A1 |
20060001650 | Robbins et al. | Jan 2006 | A1 |
20060036944 | Wilson | Feb 2006 | A1 |
20060073891 | Holt | Apr 2006 | A1 |
20060117669 | Baloga et al. | Jun 2006 | A1 |
20060126128 | Ahmed et al. | Jun 2006 | A1 |
20060132501 | Nonaka et al. | Jun 2006 | A1 |
20060146034 | Chen et al. | Jul 2006 | A1 |
20060176524 | Willrich | Aug 2006 | A1 |
20060203208 | Thielman et al. | Sep 2006 | A1 |
20060204030 | Kogure et al. | Sep 2006 | A1 |
20060267966 | Grossman et al. | Nov 2006 | A1 |
20060287963 | Steeves et al. | Dec 2006 | A1 |
20060294247 | Hinckley et al. | Dec 2006 | A1 |
20070005500 | Steeves et al. | Jan 2007 | A1 |
20070026372 | Huelsbergen | Feb 2007 | A1 |
20070033637 | Yami et al. | Feb 2007 | A1 |
20070055929 | Giannetti et al. | Mar 2007 | A1 |
20070079249 | Pall et al. | Apr 2007 | A1 |
20070083666 | Apelbaum | Apr 2007 | A1 |
20070143103 | Asthana et al. | Jun 2007 | A1 |
20070143624 | Steeves | Jun 2007 | A1 |
20070143690 | Nakajima et al. | Jun 2007 | A1 |
20070156811 | Jain et al. | Jul 2007 | A1 |
20070201745 | Wang et al. | Aug 2007 | A1 |
20070220444 | Sunday et al. | Sep 2007 | A1 |
20070288599 | Saul et al. | Dec 2007 | A1 |
20080028321 | Weksler et al. | Jan 2008 | A1 |
20080066014 | Misra | Mar 2008 | A1 |
20080088593 | Smoot | Apr 2008 | A1 |
20080122803 | Izadi et al. | May 2008 | A1 |
20080127302 | Qvarfordt et al. | May 2008 | A1 |
20080168403 | Westerman et al. | Jul 2008 | A1 |
20080192059 | Kennedy | Aug 2008 | A1 |
20080198138 | McFarlane et al. | Aug 2008 | A1 |
20080214233 | Wilson et al. | Sep 2008 | A1 |
20080270230 | Hendrickson et al. | Oct 2008 | A1 |
20080281851 | Izadi et al. | Nov 2008 | A1 |
20080288862 | Smetters et al. | Nov 2008 | A1 |
20090002327 | Wilson et al. | Jan 2009 | A1 |
20090085877 | Chang et al. | Apr 2009 | A1 |
20090113294 | Sanghavi et al. | Apr 2009 | A1 |
20090138723 | Nyang et al. | May 2009 | A1 |
20090150983 | Saxena et al. | Jun 2009 | A1 |
20090328163 | Preece | Dec 2009 | A1 |
Number | Date | Country |
---|---|---|
19804028 | Aug 1998 | DE |
0450196 | Apr 1990 | EP |
0543566 | Nov 1992 | EP |
1 315 071 | May 2003 | EP |
1 621 989 | Feb 2006 | EP |
1621989 | Feb 2006 | EP |
2000148396 | May 2000 | JP |
2000 148396 | May 2000 | JP |
2006139615 | Jun 2006 | JP |
WO 0101391 | Jan 2001 | WO |
WO 03036415 | May 2003 | WO |
Entry |
---|
Ashdown, et al.; “Escritoire: A Personal Projected Display”; IEEE Multimedia, vol. 12, Issue 1; Jan.-Mar. 2005; pp. 34-42. |
PCT Search Report and Written Opinion, Feb. 5, 2009; PCT Application No. PCT/EP2008/063006. |
Microsoft: “Microsoft Launches New Product Category: Surface Computing Comes to Life in Restaurants, Hotels, Retail Locations and Casino Resorts” Microsoft Website, [Online] May 29, 2007, p. 13, XP00251268, Carlsbad, California, US. |
PCT Search Report; Dec. 29, 2008; PCT Application No. PCT/EP2008/063007. |
Bohte, et al.; “Market-Based Recommendation: Agents that Compete for Consumer Attention”; Nov. 2004; pp. 420-448; vol. 4, No. 4; ACM Transactions on Internet Technology; Broadway, New York. |
Lemon, et al.; “Multithreaded Context for Robust Conversational Interfaces: Context-Sensitive Speech Recognition and Interpretation of Corrective Fragments”; Sep. 2004; pp. 241-267; vol. 11, No. 3; ACM Transactions on Computer-Human Interaction; Broadway, New York. |
Gabriel, et al.; “Conscientious Software”; Oct. 2006; pp. 433-450; ACM 1-59593-348-04/06/0010; Sun Microsystems, Inc.; Portland, Oregon. |
McTear; “Spoken Dialogue Technology: Enabling the Conversational User Interface”; Mar. 2002; pp. 90-169; vol. 34, No. 1; ACM Computing Surveys. |
Jagadish, et al.; “Making Database Systems Usable”; SIGMOD'07; Jun. 12-14, 2007;pp. 13-24; ACM 978-1-59593-686-8/07/0006; Beijing, China. |
Marshall, et al.; Exploring the Relationship Between Personal and Public Annotation; JCDL'04; Jun. 7-11, 2004; pp. 3349-357; ACM 1-58113-832-6/04/0005; Tucson, Arizona. |
Athanasopoulos, et al.; Enhanced CAPTCHAs: Using Animation to Tell Humans and Computers Apart; 2006; pp. 97-108; CMS 2006-LNCS 4237; IFIP. |
Office Action, U.S. Appl. No. 11/869,313, Aug. 5, 2010. |
Office Action, U.S. Appl. No. 11/868,766, Aug. 6, 2010. |
Office Action, U.S. Appl. No. 11/868,513, Aug. 6, 2010. |
Fetzer, C., Kaefer, K., Augsten, T., Meusel, R., Kanitz, D., Stoff, T., Becker, T., Holt, C. and Baudisch, P. Multitoe: High-Precision Interation with Back-Projected Floors Based on High-Resolution Multi-Touch Input to appear in Proceedings of UIST 2010, New York, NY, Oct. 3-6, 2010, 10 pages. |
Final Office Action, U.S. Appl. No. 11/869,313, Dec. 10, 2010. |
Office Action, U.S. Appl. No. 11/868,513, Dec. 10, 2010. |
Office Action, U.S. Appl. No. 11/869,987, Nov. 30, 2010. |
Final Office Action, U.S. Appl. No. 11/868,766, Dec. 9, 2010. |
Office Action, U.S. Appl. No. 11/868,474, Oct. 29, 2010. |
Bollacker, et al.; “A System for Automatic Personalized Tracking of Scientific Literature on the Web”, Proceedings of the Fourth ACM Conference on Digital Libraries, Aug. 11-14, 1999, pp. 105-113, ACM Press, New York. |
Office Action, U.S. Appl. No. 11/869,313, Jan. 28, 2011. |
Athanasopoulos, Elias; Antonatos, Spiros, “Enhanced CAPTCHAs: Using Animation to tell Humans and Computers Apart”, IFIP 2006, pp. 97-108 (copy not furnished, already present in application). |
Izadi et al. (Dynamo: A public interactive surface supporting cooperative sharing and exchange of media; pp. 1-9; copyright 2003). |
Office Action, U.S. Appl. No. 11/868,216, Aug. 20, 2010. |
Office Action, U.S. Appl. No. 11/950,872, Oct. 15, 2010. |
Final Office Action for U.S. Appl. No. 11/868,216, mailed Mar. 3, 2011, 21 pages. |
Final Office Action for U.S. Appl. No. 11/869,313, mailed May 24, 2011, 21 pages. |
Gronbaek et al., “iGameFloor—A Platform for Co-Located Collaborative Games,” ACE'07, Jun. 13-15, 2007. |
Final Office Action for U.S. Appl. No. 11/868,513, mailed Apr. 15, 2011, 16 pages. |
Notice of Allowance for U.S. Appl. No. 11/869,987, mailed May 16, 2011, 11 pages. |
Office Action for U.S. Appl. No. 11/868,766, mailed Apr. 14, 2011, 19 pages. |
Office Action for U.S. Appl. No. 11/868,216, mailed Aug. 3, 2011, 14 pages. |
Final Office Action for U.S. Appl. No. 11/868,766, mailed Aug. 4, 2011, 19 pages. |
Office action for U.S. Appl. No. 11/868,513, mailed Jul. 28, 2011, 14 pages. |
Final Office Action for U.S. Appl. No. 11/868,216 (Do et al., “Displaying Personalized Documents to Users of a Surface Computer,” filed Oct. 5, 2007), US Patent and Trademark Office, mailed Jan. 20, 2012, 13 pages. |
Number | Date | Country | |
---|---|---|---|
20090094515 A1 | Apr 2009 | US |