This Nonprovisional application claims priority under 35 U.S.C. §119(a) on Patent Application No. 2013-204445 filed in Japan on Sep. 30, 2013, the entire contents of which are hereby incorporated by reference,
The present invention relates to information processing apparatuses and electronic conferencing systems to progress an electronic conference while displaying an image file in a shared manner.
Conventionally electronic conferencing systems to progress a conference while displaying an image at terminals at mutually distant places in a shared manner have been known. Japanese Unexamined Patent Application Publication No. K05(1993)-56425 describes an electronic conferencing system, including a plurality of terminal devices 2 to 4 that are connected via a common display device 1 and a network. When information is input from the terminal 2 in a shared mode, such information is transmitted to the common display device 1 and a shared file is created therefrom, which is then transmitted to the other terminals 3 and 4, thereby displaying a shared image at the individual terminals. Japanese Unexamined Patent Application Publication No. 2003-281101 describes another electronic conferencing system, including a server 1 and clients 3 to 6 that are mobile display pads that participants of the conference use, which are connected via a wireless LAN. The electronic conferencing system described in Japanese Unexamined Patent Application Publication No. 2003-281101 is configured so that, in response to a touch tor inputting of a touch panel that is disposed on a large-sized screen of the server 1, image data containing coordinates of the touch for inputting are transmitted to the clients 3 to 6 to display a screen to be shared. The electronic conferencing system described in Japanese Unexamined Patent Application Publication No. 2003-281101 is configured so that, when one of the clients 3 to 6 uses a predetermined application to display any document on the window to display a shared screen, then the same document will be displayed on the windows to display a shared screen of a large-sized display device 2 and the other clients 3 to 6, According to the inventions described in these patent documents, an image to be shared that is input from a terminal is displayed at the other terminals as a shared image, thereby enabling smooth progressing of the conference.
According to the inventions described in Japanese Unexamined Patent Application Publication Mo. H05(1993)-56425 and Japanese Unexamined Patent Application Publication No. 2003-281101, they are configured so that drawing information that is input from another terminal at any timing is transmitted to the terminal of the user and is drawn at any place in the screen of the display section thereof. In this case, the user of the terminal may not notice the drawing, and especially when coordinates input are simply displayed as drawn contents or when the user keeps his/her eyes on another place on the screen, the user may overlook such a drawing. To avoid this, the operation state of an operator who operates the other terminal may be captured as a video, and such a video may be delivered to each terminal, whereby such an image of the action can be directly checked visually. This can confirm the drawing operation and the drawing position, and so the possibility of overlooking can be avoided. To this end, however, a camera has to be separately disposed so as to capture an image of the display part of the terminal from, the front-face side.
It is an object of the present invention to provide an information processing apparatus and an electronic conferencing system to display information so that the input position of the information is displayed in a temporarily conspicuous drawing form, thus facilitating the checking of the input position on the side of the other information processing apparatuses.
An information processing apparatus of the present invention having a display section performs a communication with another information processing apparatus having a display section to share an image file therewith, and displays the image file at both of the display sections of the information processing apparatuses so as to progress an electronic conference therebetween. The information processing apparatus includes: an input section and a drawing information creation section. The input section receives a designation operation of a position on a screen of the display section. The drawing information creation section creates first drawing information, based on which a designation position designated by the input section is displayed in a first drawing form, and second drawing information, based on which, when a predetermined condition holds after reception of the designation position, display of the designated position is changed into a second drawing form. The information processing apparatus transmits the first and the second drawing information to the other information processing apparatus.
In
The storage section 12 includes: a first storage section 121 and a second storage section 122 to store coordinates information that is input by a conference participant who operates the main device 1 while associating the coordinates information with a drawing form; and a file storage section 123 to store various types of text files that are materials of the conference to be provided at the electronic conference. The storage section 12 further includes a storage section of a control program to run the electronic conferencing system and a work memory section to temporarily store processing data.
The display section 13 includes a liquid crystal display panel having a predetermined size, and the like to display an image under the driving by a driving section 13a. The communication section 14 enables a communication of information with other terminals 2 via a network in accordance with a communication protocol. Exemplary network includes the Internet as well as a local area network (LAN).
The tablet 15 is a plate-like pointing device receiving an input operation, using a pen-form tool such as a stylus or receiving a direct handwriting input operation, and in this example, this includes a transparent touch panel, for example, that is attached to the front face of a display face of the display section 13. The tablet 15 may be of various types such as an infrared type as well as of an optical type or a capacitance type to detect coordinates input. A detection section 15a detects pressed positions of the tablet 15 as input coordinates periodically and outputs them to the control section 11. The operating section 16 includes a pointing device such as a mouse, and a keyboard to input information and instructions, for example.
The control section 11 reads a control program stored in the storage section 12 for execution, so that the control section 11 functions as a draw processing section 111, a storage processing section 112 and a timer section 113.
Receiving an instruction from the operating section 16 during the electronic conference, the draw processing section 111 reads a text file or the like from the file storage section 123 of the storage section 12 and displays it at the display section 13. This is typically performed by writing the text file or the like in a RAM for display, which is associated with display coordinates of the display section 13, reading the same at the frame period, and displaying it at the display section 13 as a still image. The draw processing section 111 captures coordinates information on the touch for inputting to the tablet 15 periodically, which is obtained via the detection section 15a. The draw processing section 111 associates the coordinates of the tablet 15 and the display coordinates of the display section 13 beforehand, thereby performing a trace drawing processing such as drawing of a trace, for example, at a position in the screen corresponding to coordinates input by handwriting. This trace drawing processing will be described later.
The draw processing section 111 further performs, based on input coordinates information captured from the tablet 15, processing to create drawing information for special display described later and processing to rewrite the drawing information to change it from a special display to a normal display, and writes such drawing information to the first storage section 121 and the second storage section 122 via the storage processing section 112. The first storage section 121 stores drawing information for special display and the second storage section 122 stores drawing information for normal display. The drawing information contains a group of input coordinates that are captured periodically from the tablet 15 as well as predetermined color data and density data for drawing corresponding to the coordinates, which are set as a position mark. Such a position mark is drawn at the coordinates of the group of input coordinates that are captured with time, whereby the tracing image as a whole can be defined.
To execute the drawing processing at the display section 13, the draw processing section 111 reads the drawing information stored at the first storage section 121 and the second storage section 122, synthesize it with a text file and outputs the resultant to the display section 13. The draw processing section 111 also outputs the drawing information stored at the first storage section 121 and the second storage section 122 to the communication section 14 periodically via the storage processing section 112. Then, the communication section 14 transmits such drawing information to the terminals 2 of the participants who participate in the electronic conference to share the displayed contents at the electronic conference.
In response to an instruction from the draw processing section 111, the storage processing section 112 writes and reads a text file and drawing information with respect to the storage section 12. The timer section 113 manages time-based information that is necessary for special display and normal display described later. The control section 11 further performs processing to execute general management processing to manage the terminals 2 participating in the conference, for example, at the time of activation or during the progressing of the electronic conference and control communications among the terminals 2 participating in the conference.
The terminal 2 includes a control section 21 provided with a central processing unit (CPU). A storage section 22, a display section 23, a communication section 24 and an operating section 26 are connected to the control section 21. The display section 23, the communication section 24 and the operating section 26 have the same functions as those of the display section 13, the communication section 14 and the operating section 16 of the main device 1. The storage section 22 stores a sub-control program for participation to an electronic conference, and stores a text file and drawing information that are transmitted from the main device 1 during the electronic conference. The control section 21 reads the sub-control program for execution, thus functioning as a drawing processing section 211. The drawing processing section 211 draws a text file that is transmitted from the main device 1 and written in the storage section 22, and executes drawing processing in accordance with the drawing information. This allows the display contents to be shared between the main device 1 and the terminal 2.
Referring now to
The first drawing method is as follows. In response to a detection of a series of input operation (typically from pen-down to pen-up) to the tablet 15, drawing information is created for special display (a first drawing form) from the timing of the detection, until a certain condition holds, e.g., until another series of input operation starts, and is displayed at the display section 13 (and the display section 23). Next, when the otter series of input operation starts, the drawing information is rewritten with drawing information of normal display, and normal display (a second display form) is performed at the display section 13 (and the display section 23) based on the drawing information after rewriting.
The drawing information is transmitted to the terminal 2, whereby an image on the screen 130 in
The screen 130 of
Subsequently,
Referring next to the flowchart of
When the terminal 2 participating in the electronic conference receives the text file transmitted from the main device 1 (Step #1), the terminal 2 displays the same text file as that on the display section 13 to the screen of the display section 23 (Step #3).
Subsequently, a determination is made about the presence or not of an input to the screen, i.e., an input operation (pen-down operation) through the tablet 15 (Step S7). When, an input is performed on the screen, coordinates input are additionally written on the first storage section 121 (Step S9), and so the first storage section 121 stores the trace of the input coordinates as drawing information (first drawing information). Then, a special display (first drawing form) is performed at the positions of a group of the coordinates written on the first storage section 121, and a normal, display (second drawing form) is performed based on drawing information (second drawing information) corresponding to the positions of a group of coordinates written on the second storage section 122 (Step S11). That is, the coordinate positions of the input coordinates group this time are associated with image data in blue at a predetermined level, and the coordinate positions of the old input coordinates group are associated with image data in red at a predetermined level, which are then synthesized with the corresponding text files, and are guided to the display section 13 for display. Next, the coordinates groups stored in the first storage section 121 and the second storage section 122 are transmitted to the terminal 2 participating in the electronic conference (Step S13).
Receiving the drawing information containing coordinates groups transmitted from the main device 1 (Step #5), the terminal 2 participating in the electronic conference writes it to the storage section 22 and synthesizes it with the corresponding text files. The resultant is written at the screen of the display section 23, whereby the same special display as that on the display section 13 is performed (Steps #7, #9).
Next, a determination is made as to whether the input to the screen is ended (i.e., pen-up operation) or not (Step S15). The procedure returns back to Step S9 until a end of input is detected, where the storage processing of input coordinates and special display and normal display processing are repeated. Considering instability of the operation of a handwriting operation, for example, it is preferable to provide a predetermined duration of dead zone for the detection of the end of input. In this case, if coordinates before and after an operation are distant by a predetermined distance or more, for example, such an operation may be considered as a new pen-down operation in spite of within the duration of the dead-zone.
On the other hand, when the end of input is detected, then a determination is made about the presence or not of an input to the screen (Step S17). That is, a detection of another new input to the screen starts. The procedure returns to Step S11 until such a new input to the screen is detected, and similar processing is repeated.
When it is determined that a new input is performed to the screen, the coordinates group stored in the first storage section 121 are added to the second storage section 122 (Step S19), and then the stored contents in the first storage section 121 are deleted (reset) (Step S21). At Steps S19 to S21, every time a new input, operation starts on the screen, the mark displayed as a special display immediately before the operation is rewritten as a normal display, whereby a newly displayed mark and the old mark used so far can be displayed in different drawing forms. In this way, every time a new mark is displayed, the position of such a mark can be easily noted, and the old mark also can be noted again.
Referring next to
Then, when a predetermined time period has elapsed since the stating of the display, the surrounding mark 1312 in the form, of special display is changed into normal display as in a surrounding mark 1313 illustrated in
Referring next to the flowchart of
Subsequently, a determination is made about the presence or not of an input to the screen, i.e., an input operation through the tablet 15 (Step S37). When an input is performed at the screen, coordinates input are additionally written on the storage section 12 together with information on elapsed time from the “input” (Step S39), and so the trace of the input operation as drawing information is stored in the storage section 12. Then, a special display is performed at the positions of a group of the coordinates written on the storage section 12 (Step S41). That is, the coordinate positions of the input coordinates group this time are associated with image data in red at a predetermined level, which are guided to the display section 13 for blinking display at a predetermined period. Next, the coordinates group input this time stored in the storage section 12 are transmitted to the terminal 2 participating in the electronic conference (Step S43).
Receiving the coordinates group input this time as drawing information that is transmitted from the main device 1 (Step #35), the terminal 2 participating in the electronic conference writes it to the storage section 22 and synthesizes it with the text file. The resultant is then read on the screen of the display section 23, whereby the same special display as that on the display section 13 is performed (Step #37).
Next, a determination is made as to whether the input to the screen is ended or not (Step S45). When the input is not ended, a determination is made about the presence or not of a coordinate that is displayed for a first time period after the inputting of the coordinate in the coordinates group input in the storage section 12 (Step S47). When there is no input coordinate displayed for the first time period, the procedure returns to Step S39. When any input coordinate is displayed for the first time period, the display of the input that is displayed for the first time period is changed to the normal display (Step S49) to be a ended coordinate group. Next, information on this ended coordinate group is transmitted to the terminal 2 participating in the electronic conference (Step S51), and the procedure returns to Step S39.
Receiving the drawing information containing the ended coordinate group transmitted from the main device 1 (Step #39), the terminal 2 participating in the electronic conference writes it to the storage section 22, reads it on the screen of the display section 23, and changes it into the same normal display as that at the display section 13 for display (Step #41).
On the other hand, when it is determined at Step S45 that the input is ended, a time-measuring operation for the input this time starts (Step S53). Next, in the input coordinate group, a determination is made about the presence or not of a coordinate input that is displayed for a second time period (>the first time period) after the end of the input (Step S55). Similarly, also when it is determined at Step S37 that input to the screen is not performed, the procedure proceeds to Step S55.
When there is no input coordinate that is displayed for the second time period at Step S55, the procedure returns to Step S37. On the other hand, when there is an input coordinate that is displayed for the second time period, the display of the input that is displayed for the second time period is changed to the normal display (Step S57) to be a ended coordinate group. Next, information on this ended coordinate group is transmitted to the terminal 2 participating in the electronic conference (Step S59), and the procedure returns to Step S37.
Receiving the drawing information containing the ended coordinate group transmitted from the main device 1 (Step #39), the terminal 2 participating in the electronic conference writes it to the storage section 22, reads it on the screen of the display section 23, and changes it into the same normal display as that at the display section 13 for display (Step #41).
Referring next to
Referring next, to the flowchart of
Subsequently, a determination is made at the main device 1 about the presence or not of an input to the screen, i.e., an input operation through the tablet 15 by handwriting (Step S77). When an input is performed at the screen, coordinates input are additionally written on the storage section 12, and so the trace of the handwriting operation as drawing information is stored in the storage section 12, and display in red is instructed at the positions of the coordinates group written in the storage section 12 (Step S79). That is, the coordinate positions of the input coordinates group as the handwriting trace are associated with image data in red at a predetermined level, which are guided to the display section 13 for display. Next, in the input coordinates group that is stored in the storage section 12, a newly added one is transmitted to the terminal 2 participating in the electronic conference (Step S81). Then, the procedure returns to Step S77, and while the input is continued, similar processing is repeated.
Receiving the drawing information containing the input coordinates corresponding to the added one as drawing information that is transmitted from the main device 1 (Step #75), the terminal 2 participating in the electronic conference writes it to the storage section 22. Subsequently the pen icon 2323 currently being displayed is deleted (Step #77), then the input coordinates group is read from the storage section 22, and the same surrounding mark 2322 as that at the display section 13 is displayed in red on the screen 230 of the display section 23 (Step #79). Then, a new pen icon 2323 is displayed at the position of the input coordinates that are the most recently added on the screen of the display 23 (Step #81). This results in the display of both of the surrounding mark and the pen icon 2323 on the screen 230 of the display section 23 of the terminal 2 as a special display.
Such a special display may be configured so that the pen icon 2323 is deleted based on a determination that a predetermined time period has elapsed after the ending of a series of input operation or a determination that another input operation is performed.
Then, when the certain time period has elapsed, as illustrated in
In the case of a fifth drawing method illustrated in
As illustrated in
Then, when the certain time period has elapsed, as illustrated in
An image file as a display target may be a binary data file instead of a text file.
Instead of a change from blinking display to lit-up display or a change in color, a method for changing from a special display to a normal display may be a change in brightness, a change in the thickness of a line when the display includes a line drawing, a change from a cyclic display using different colors to a lit-up display using one color as Embodiment 2. In the first drawing method in
Embodiment 1 describes the position designation by a handwriting input operation to the tablet 15, and the present invention is not limited to this. For instance, as illustrated in
The electronic conferencing system illustrated in
The above described embodiments are to be considered in all respects as illustrative and not restrictive. The scope of the invention is indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are intended to be embraced therein.
Number | Date | Country | Kind |
---|---|---|---|
2013-204445 | Sep 2013 | JP | national |