This application is based on Japanese patent application No. 2015-009650 filed on Jan. 21, 2015, the contents of which are hereby incorporated by reference.
1. Field of the Invention
The present invention relates to a technology for displaying one document in a plurality of terminals.
2. Description of the Related Art
In recent years, more and more attendees (users) use portable terminals such as a smartphone, a tablet computer, or a laptop personal computer to look at a document which is a meeting material.
A system is known which enables each attendee to display a common document in his/her terminal. Such a system allows each attendee to display a part of the common document which is discussed or a part related thereto in his/her terminal in any format by enlarging or scrolling through the document.
As the technology for sharing a meeting material in a plurality of terminals, the technology described below has been proposed (Japanese Unexamined Patent Application Publication No. 2012-129626). According to the technology, when shared data is displayed on client terminals, the display state of conference data of each conference client participating in a conference is evaluated according to an evaluation rule, the degree of attention of conference data is calculated based on the evaluation value, and an initial layout for a conference client who participated in the midway of the conference is determined according to the order of the degree of attention.
Meanwhile, with a smartphone or a small tablet computer, a resolution for display is low or a screen size is limited. This often makes it difficult for an attendee to see what is described when the entirety of a document is displayed in the smartphone or the small tablet computer. When an attendee enlarges and views a common document with the intention of grasping the content of the document, only a part of the document is displayed. Therefore, a user tends to fail to keep track of a part of the document to be noticed by using such a terminal to view the document as compared to the case of using a terminal having a high resolution, e.g., a stationary display terminal. Finding the part of the document to be noticed is also hard for the user.
The present disclosure has been achieved in light of such an issue, and therefore, an object of an embodiment of the present invention is to, when a common document is displayed in a plurality of terminals and is viewed by a plurality of users, inform one of the users of a part of the document to which the other users pay attention.
According to an aspect of the present invention, a document display support device includes a first processor configured to manage a shared document displayed in three or more terminals each of which has a display device; a memory configured to store at least information corresponding to a display region, of the shared document, displayed in each of the three or more terminals; and a first communication interface configured to perform communication with each of the three or more terminals; wherein the first processor identifies a common region, the common region being common to, out of the three or more terminals, the display region in each of two or more terminals except one particular terminal, and the first processor informs said one particular terminal of the common region or a predetermined point of the common region through the first communication interface.
According to another aspect of the present invention, a document display support device includes a managing portion configured to manage a shared document displayed in three or more terminals each of which has a display device; a storage portion configured to store at least information corresponding to a display region, of the shared document, displayed in each of the three or more terminals; an identifying portion configured to identify a common region, the common region being common to, out of the three or more terminals, the display region in each of two or more terminals except one particular terminal; and an informing portion configured to inform said one particular terminal of the common region or a predetermined point of the common region.
These and other characteristics and objects of the present invention will become more apparent by the following descriptions of preferred embodiments with reference to drawings.
As shown in
The document sharing system 100 enables users who are in locations away from one another to share a document and to view the document at the same time.
The document server 1 and the individual terminals 2 are configured to perform communication with one another via the communication line 3. Examples of the communication line 3 are a public line, the Internet, and a Local Area Network (LAN) line.
The document server 1 manages data used for displaying a document and distributes the data to the individual terminals 2.
Referring to
The NIC 10e performs communication with the terminal 2 in accordance with a protocol such as Transmission Control Protocol/Internet Protocol (TCP/IP).
The ROM 10c or the large-capacity storage 10d stores, therein, a document management program 10P which is a computer program described later. The document management program 10P is loaded into the RAM 10b and is executed by the CPU 10a. Examples of the large-capacity storage 10d are a hard disk drive and a Solid State Drive (SSD). The large-capacity storage 10d or the RAM 10b function as memories for storing various types of information, e.g., the document 4, a component table, object data, and terminal data described later.
The terminal 2 is a client of the document server 1. The terminal 2 displays a document based on data received from the document server 1. The terminal 2 may be a personal computer, a smartphone, a tablet computer, or the like. The following description provides an example in which, of the plurality of terminals 2, the terminal 2A is a personal computer and the terminals 2B, 2C, and 2D are small tablet computers.
Referring to
The display 20e serves to display a part or the whole of a document in accordance with operation by a user.
The keyboard 20f and the pointing device 20g are used for the user to enter a command or information.
The NIC 20h performs communication with the document server 1 in accordance with a protocol such as TCP/IP.
The image output interface 20i is a circuit for outputting an image signal. The image output interface 20i is, for example, High-Definition Multimedia Interface (HDMI; registered trademark).
The projector 23 is connected to the image output interface 20i. The projector 23 is used to display a screen, which is the same as that displayed on the display 20e, on the projection surface 24, e.g., a wall or a cinema screen. This enables a plurality of users to view the document easily at one time.
The ROM 20c or the large-capacity storage 20d stores, therein, a document browsing program 20P which is a computer program described later. The document browsing program 20P is loaded into the RAM 20b and is executed by the CPU 20a.
Referring to
As with the display 20e, a part or the whole of a document is displayed in the touch-sensitive panel display 21e. The touch-sensitive panel display 21e detects a touched location and informs the CPU 21a of the touched location.
The operation button group 21f includes a button for returning to the start screen, a button for controlling sound volume, and a button for switching between ON and OFF of the power supply.
The wireless communication device 21g performs communication via a base station with the document server 1 in accordance with a protocol such as TCP/IP based on the standard for wireless LAN, specifically, the standard for Institute of Electrical and Electronics Engineers (IEEE) 802.11.
The ROM 21c or the flash memory 21d stores, therein, a document browsing program 21P which is a computer program described later. The document browsing program 21P is loaded into the RAM 21b and is executed by the CPU 21a.
The CPU 10a executes the document management program 10P, so that functions of an object table storage portion 101, a terminal data storage portion 102, an object data transmission portion 103, a terminal data updating portion 104, a point of focus calculation portion 105, a point of focus informing portion 106, and so on shown in
The CPU 20a executes the document browsing program 20P, or, alternatively, the CPU 21a executes the document browsing program 21P. Thereby, the functions of a document data obtaining portion 201, a screen display processing portion 202, a focus region informing portion 203, a point of focus inquiring portion 204, all of which are shown in
The description goes on to the functions of the document server 1 and the functions of the terminal 2, by taking an example in which the document (shared document) 4 shown in
[Data]
The object table storage portion 101 stores, for each document 4, the component table 5L. As shown in
In the object data 5J, an “object code” is a code for identifying the object 4J corresponding to that object data 5J. A “text” is a character string of the object 4J.
In the object data 5J, “upper left X-coordinate” and “upper left Y-coordinate” are the X-coordinate (coordinate in the lateral direction) and the Y-coordinate (coordinate in the longitudinal direction) of the upper left end of the object 4J, respectively. The origin is the lower left end of the document 4. A “width” and a “height” is the width and the height of the object 4J, respectively.
In the object data 5J, “font color”, “font type”, and “font size” are the color, type, and size of a font used in the text of the object 4J, respectively.
The document 4 is created in advance by using the terminals 2A through 2D or an external terminal, and registered, as a shared document, in the document server 1 from the terminals 2A through 2D or the external terminal via a network. When creating the document 4, the user designates, for the document server 1, the text, upper left X-coordinate, upper left Y-coordinate, width, height, font color, font type, and font size of each of the objects 4J. The details thereof may be designated by using a text editor or an editor used only for document creation.
When the user uses, for example, the terminals 2A through 2D to request the document server 1 to register a document, a component table 5L for a document 4 is newly created in the object table storage portion 101 of the document server 1, and a document identifier of the document 4 is newly issued and the document identifier is associated with the component table 5L thus created. Then, data indicating the designated details are generated for each of the objects 4J based on data on the document transmitted from the terminals 2A through 2D, and so on. The data thus created is stored (registered) as the object data 5J in the component table 5L.
As shown in
In the terminal data 5T, a “terminal code” is a code for identifying the terminal 2 corresponding to the subject terminal data 5T.
In the terminal data 5T, a “display surface width” and a “display surface height” represent the resolution of what is displayed in the width direction and the resolution of what is displayed in the height direction, respectively, of the display 20e of the terminal 2 or the touch-sensitive panel display 21e.
In the terminal data 5T, a “focus region width” and a “focus region height” are the width and height of a region of the document 4 currently displayed in the subject terminal 2, respectively. Hereinafter, of the document 4, a region currently displayed is referred to as a “focus region 4R” (see
In the terminal data 5T, an “upper left X-coordinate” and an “upper left Y-coordinate” are the X-coordinate and the Y-coordinate of the upper left end of the focus region 4R, respectively. In this embodiment, the X-coordinate and the Y-coordinate are used as the reference for identifying the focus region 4R. This embodiment is not limited thereto. The other coordinates, e.g., the upper right X-coordinate and the upper right Y-coordinate, may be used as the reference.
The terminal code, the display surface width, and the display surface height are fixed values and are indicated in advance in the terminal data 5T. The focus region width, the focus region height, the upper left X-coordinate, and the upper left Y-coordinate are not indicated in the terminal data 5T when the terminal 2 has not yet displayed the document 4. They are indicated in the terminal data 5T as described later when the terminal 2 displays the document 4. The focus region width, the focus region height, the upper left X-coordinate, and the upper left Y-coordinate are changed in accordance with operation on the terminal 2 by the user.
[Basic Process for Displaying Document 4]
The user of the terminal 2A operates the terminal 2A to run the document browsing program 20P. The user then enters a document code of the document 4.
In response to this operation, the document data obtaining portion 201 of the terminal 2A requests, from the document server 1, data used for displaying the document 4. At this time, the document server 1 is given the document code.
With the document server 1, the object data transmission portion 103 sends the data for displaying the document 4 to the terminal 2A. For example, the object data transmission portion 103 sends a plurality of sets of object data 5J stored in the component table 5L (see
With the terminal 2A, the document data obtaining portion 201 obtains, as data for display, the object data 5J and the size data 5S.
When the object data 5J and the size data 5S are obtained, the screen display processing portion 202 displays the document 4 on the display 20e.
To be specific, the screen display processing portion 202 renders a frame representing the entire range of the document 4 based on the size data 5S, and displays the frame. The screen display processing portion 202 then renders each of the objects 4J in accordance with the text, width, height, font color, font type, and font size indicated in the object data 5J of the corresponding object 4J. The screen display processing portion 202 then displays each of the objects 4J at a position corresponding to the upper left X-coordinate and the upper left Y-coordinate within the frame. The coordinates are indicated in the corresponding object data 5J.
In this example, as shown in
Since the projector 23 is connected to the terminal 2A, the projector 23 is used to display (project) the document 4 on the projection surface 24.
Likewise, with the terminals 2B, 2C, and 2D, the users thereof perform the operation similar to that described above. In response to the user operation, the document data obtaining portion 201 and the screen display processing portion 202 of each of the terminals 2B, 2C, and 2D perform the process similar to that described above.
However, in each of the terminals 2B, 2C, and 2D, the resolution of the touch-sensitive panel display 21e is lower than that of the display 20e of the terminal 2A. In addition, the touch-sensitive panel display 21e of each of the terminals 2B, 2C, and 2D is smaller than the size of the document 4. For these reasons, the entirety of the document 4 cannot be displayed unless the document 4 is reduced.
To address this, the screen display processing portion 202 of each of the terminals 2B, 2C, and 2D, first, displays a default region of the document 4 at 100% scaling factor as the focus region 4R. For example, if the default region is the central region, then the focus region 4R is displayed as shown in
The user performs predetermined operation to scroll through the document 4, enlarge or reduce the document 4.
In the case of the focus region 4R as shown in (A) of
In response to the document 4 displayed, the focus region informing portion 203 sends, to the document server 1, focus region data 5R indicating the X-coordinate and the Y-coordinate of the upper left end of the focus region 4R, and a partial size. The partial size is a size (width and height) of a part included in the focus region 4R of the document 4. In the case of display at 100% scaling factor, the partial size is equal to the resolution of display on the terminal 2. The partial size is reduced when enlarge operation is performed. The partial size is increased when reduction operation is performed.
With the document server 1, when receiving the focus region data 5R form the terminal 2, the terminal data updating portion 104 writes, onto the terminal data 5T (see
Every time when the focus region 4R is changed, the focus region informing portion 203 sends, to the document server 1, focus region data 5R indicating the post-change X-coordinate and the post-change Y-coordinate of the upper left end of the post-change focus region 4R and the post-change partial size (width and height) thereof.
In response to the receipt of the focus region data 5R, the terminal data updating portion 104 replaces the upper left X-coordinate, the upper left Y-coordinate, the display width, and the display height indicated in the terminal data 5T on the terminal 2 with the X-coordinate, the Y-coordinate, the width, and the height indicated in the focus region data 5R received.
[Movement to Portion of Interest]
For example, it is supposed that users use their terminals 2 at different locations to attend a television conference while viewing a document 4. In such a case, attendees sometimes discuss while paying attention to a specific part of the document 4. If the users, who are attendees of the conference at different locations, are allowed to use their terminals to freely view an arbitral part of a shared document, the conference progresses while each user looks at the arbitral part of the shared document. In such a case, the users cannot often find which part of the shared document 4 is focused in the discussion and fail to keep track of the conference progress. In particular, if the terminal 2 is a small tablet computer, the user easily loses track of a portion of a document to which attention is paid in the conference while he/she views the document with a specific part thereof enlarged. This is because the small tablet computer has a small display screen and a low resolution for display in many cases.
According to the document sharing system 100, a portion of interest can be displayed as described below. The description goes on to the case where the user of the terminal 2D loses track of the portion of interest.
When losing track of the portion of interest, the user of the terminal 2D performs predetermined operation on the terminal 2D to move to a point of focus. For example, the user double-taps the lower right end on the touch-sensitive panel display 21e. Alternatively, the user of the terminal 2D presses a specific software key appearing on the touch-sensitive panel display 21e. Yet alternatively, the user makes a specific gesture on the touch-sensitive panel display 21e. Yet alternatively, the user presses a specific key of the operation button group 21f of the terminal 2D. Yet alternatively, a microphone is provided in the terminal 2D and the user may give a predetermined audio command to the microphone.
In response to this operation, the point of focus inquiring portion 204 of the terminal 2D inquires of the document server 1 about the center of the portion of interest (hereinafter, referred to as a “point of focus”).
With the document server 1, when the inquiry from the terminal 2D is received, the point of focus calculation portion 105 calculates the point of focus according to the following steps.
The point of focus calculation portion 105 refers to the terminal data 5T (see
The point of focus calculation portion 105 locates a common region 4K which is common to all of the three focus regions 4R. For example, it is supposed that the focus regions 4R of the terminals 2A, 2B, and 2C are focus regions 4Ra, 4Rb, and 4Rc, respectively denoted by dotted lines of
The point of focus calculation portion 105 then calculates, as coordinates of the point of focus, the coordinates of the center 4KS of the common region 4K. When the point of focus calculation portion 105 calculates the coordinates of the point of focus, the point of focus informing portion 106 sends point of focus data 5P indicating the coordinates of the point of focus to the terminal 2D.
With the terminal 2D, when the point of focus data 5P is sent from the document server 1, the screen display processing portion 202 scrolls through the document 4 in such a manner that a point, of the document 4, corresponding to the coordinates indicated in the point of focus data 5P centers on the touch-sensitive panel display 21e. Scaling factor for display remains unchanged. This changes the position of the focus region 4Rd to the position indicated by an alternate long and short dashes line shown in
Alternatively, the point of focus calculation portion 105 may calculate a point of focus in the following manner. Similarly to the foregoing case, the point of focus calculation portion 105 locates the focus regions 4R of the other terminals 2 to designate the common region 4K.
The point of focus calculation portion 105 calculates the distance between the center of each of the objects 4J and the center of the common region 4K (center 4KS). The point of focus calculation portion 105 then obtains, as the point of focus, coordinates of the center of the object 4J having the shortest distance, i.e., the object 4J closest to the center of the common region 4K.
In the example of
With reference to the flowcharts, the description goes onto the flow of the entire processing of the document server 1 and the terminal 2 by taking an example in which users at different locations attend a conference.
Every time receiving data and so on during the conference from the terminal 2, the document server 1 performs processing as shown in
When the user designates a document code of the document 4 (YES in Step #621 of
When the document server 1 is given the document code by the terminal 2 (YES in Step #601 of
When the user flicks the touch-sensitive panel display 21e on which the document 4 is displayed, pinches in, or pinches out his/her fingers against the touch-sensitive panel display 21e (YES in Step #625), the terminal 2 works to scroll through, reduce, or enlarge the document 4 in accordance with the operation (Step #626). This makes a change to the focus region 4R. The terminal 2 transmits the focus region data 5R indicating the position and size of the new focus region 4R to the document server 1 (Step #627).
When receiving the focus region data 5R (YES in Step #603), the document server 1 updates the terminal data 5T on the terminal 2 as discussed above (Step #604).
When the user performs inquiry operation (YES in Step #628), the terminal 2 makes an inquiry to the document server 1 about the center (Step #629).
When receiving the inquiry from the terminal 2 (YES in Step #605), the document server 1 calculates coordinates of the point of focus (Step #606) to send a response to the inquiry to the terminal 2 (Step #607). The point of focus is calculated based on the subroutine shown in (A) of
When receiving the response from the document server 1 (Step #630), the terminal 2 scrolls through the document 4 in such a manner that the point of focus centers on the display 20e of the subject terminal 2 or on the touch-sensitive panel display 21e (Step #631).
According to this embodiment, it is possible to display, for a user who loses track of a part of the document 4 to which the other users pay attention, the part on the terminal 2 of the user. Stated differently, when a common document is displayed in the terminals 2 and is viewed by a plurality of users, it is possible to inform one of the users of a part of the document to which the other users pay attention. A part of the document 4 to which many users pay attention can be identified even if a device for directly detecting the point of focus by each user, e.g., a line-of-sight detection device, is not provided. This enables determination of point of focus by means of a simple device structure and system structure.
According to this embodiment, the document server 1 informs the terminal 2 of the point of focus. The embodiment is not limited thereto. The document server 1 may inform the terminal 2 of the common region 4K. In such a case, the terminal 2 preferably displays the common region 4K by enlarging or reducing the same appropriately to correspond to the size of the display 20e or the touch-sensitive panel display 21e. This is similarly applied to the following other embodiments.
When there is a plurality of parts of regions noted by two or more of the terminals 2, it is preferably to handle, as the focus region, a region noted by more terminals 2 or a region having a larger overlap area to which the terminals 2 pay attention. When the number of terminals 2 or the area of the overlap regions are the same in the parts, the focus region is preferably determined in accordance with predetermined rules (for example, to give priority to a region including a predetermined terminal, to give priority to a region including a terminal which first participated in the document sharing system.
In the first embodiment, when receiving an inquiry about a point of focus from a terminal 2, the document server 1 identifies, in Step #702 of (A) of
Alternatively, it is possible to identify, as the common region 4K, among the other terminals 2, a part common to the focus regions 4R of the terminals 2 in which a predetermined time (10 seconds, for example) has elapsed since the focus regions 4R were determined.
Determining a point of focus is probably difficult when an amount of change in focus region 4R is large. In this embodiment, in calculation of a point of focus, among the other terminals 2, a part common to terminals 2 in which an amount of change in focus region 4R per unit time is equal to or smaller than a predetermined amount (for example, speed at which the screen is scrolled through is equal to or smaller than a predetermined value) is identified as the common region 4K. In respect of the other arrangements, the third embodiment is similar to the first embodiment.
In some cases, a document is edited to create a plurality of editions, and a discussion is made based on the details of the past document in a conference, etc. In this embodiment, the individual portions of the document server 1 and the terminal 2 shown in
As shown in
As shown in
The user designates, into the terminal 2, not only the document code of the document 4 but also the time stamp of the edition he/she intends to look at.
In order to obtain data used for displaying the document 4, the document data obtaining portion 201 informs the document server 1 of the document code and time stamp designated.
The object data transmission portion 103 sends, to the requesting terminal 2, the object data 5J stored in the component table 5L corresponding to the document code and time stamp informed, and the size data 5S indicating the size corresponding thereto.
The screen display processing portion 202 displays the document 4 based on the object data 5J and the size data 55.
When the document 4 is displayed, the focus region informing portion 203 sends the focus region data 5R′ to the document server 1 (the reference 5R of
The focus region informing portion 203 sends the focus region data 5R′ to the document server 1 also when the focus region 4R is changed.
When receiving the focus region data 5R′ from the terminal 2, the terminal data updating portion 104 writes the details indicated in the focus region data 5R′ into the terminal data 5T′ of the terminal 2 as with the case where the focus region data 5R is received. Thereby, the time stamp in addition to the upper left X-coordinate, the upper left Y-coordinate, the display width, and the display height of the terminal data 5T′ are updated.
When the user fails to keep track of which part of the document is focused during the conference, for example, he/she preferably performs predetermined operation on his/her terminal 2 as discussed above. In response to this operation, the point of focus inquiring portion 204 inquires of the document server 1 about the point of focus.
In response to the inquiry from the terminal 2 received, the point of focus calculation portion 105 performs calculation according to the steps shown in FIG. 20. Hereinafter, the method for calculation is described below by taking an example in which the terminal 2D made an inquiry.
The point of focus calculation portion 105 identifies the edition of the document 4 currently displayed in the terminals 2 based on the terminal data 5T′ of the terminals 2 other than the terminal 2D (Step #721 of
The point of focus informing portion 106 sends, to the inquiring terminal 2 (terminal 2D), point of focus data 5P′ indicating the edition identified in Step #721 and the point of focus calculated in Step #724.
Documents displayed in all the terminals 2 other than the terminal 2D are not always the same edition as one another. When the documents displayed therein are different from one another in edition, the point of focus calculation portion 105 preferably identifies an edition displayed in most terminals in Step #721. In Step #722, among the terminals 2 other than the terminal 2D, the focus region 4R only of the terminal 2 displaying the identified edition is preferably identified. Stated differently, the focus region 4R in the terminal 2 displaying a different edition is not taken into consideration. In addition, as with the foregoing method, the focus region to be identified may be limited depending on the resolution for display, the amount of change, and so on.
When top two of the editions of the document 4 displayed in the terminals 2 other than the terminal 2D have the same value, the edition of a document in which a target region is to be set is preferably identified in accordance with predetermined rules (for example, to give priority to a region including a predetermined terminal 2, to give priority to a terminal 2 which first participated in the document sharing system 100.
When the point of focus data 5P′ is received, the document data obtaining portion 201 and the screen display processing portion 202 perform processes in the following manner.
The document data obtaining portion 201 obtains, from the document server 1, the object data 5J corresponding to the edition of the document 4 indicated in the point of focus data 5P′. At this time, the time stamp of the edition and the document code of the document 4 are given to the document server 1.
The screen display processing portion 202 displays the document 4 corresponding to the edition indicated in the point of focus data 5P′ based on the obtained object data 5J. At this time, the focus region 4R is so adjusted that the point of focus indicated in the point of focus data 5P′ centers on the display 20e or on the touch-sensitive panel display 21e.
In the foregoing embodiments, the example is described in which the object 4J is a rectangular object having a character string. Instead of this, however, the object 4J may be an object having the format of Joint Photographic Experts Group (JPEG) or of Graphics Interchange Format (GIF).
In the foregoing embodiments, the individual functions shown in
It is to be understood that the configurations of the document sharing system 100, the document server 1, the terminal 2, the constituent elements thereof, the content and order of the processing, the configuration of the data, the structure of the document 4, and the like can be appropriately modified without departing from the spirit of the present invention.
While example embodiments of the present invention have been shown and described, it will be understood that the present invention is not limited thereto, and that various changes and modifications may be made by those skilled in the art without departing from the scope of the invention as set forth in the appended claims and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
2015-009650 | Jan 2015 | JP | national |