Patent Application
20140143672
This application claims the benefit under 35 U.S.C. §119(a) of a Korean Patent Application No. 10-2012-0132408, filed on Nov. 21, 2012, the entire disclosure of which is incorporated herein by reference for all purposes.
1. Field
The following description relates to a collaboration screen including a variety of contents, and more particularly, to a collaboration screen apparatus and method for expanding functions by dynamically adding operable web applications onto the collaboration screen.
2. Description of the Related Art
In the past, collaboration was performed only in an off-line space and inefficient in that it had a lot of limitations in distance and time. With the development of networking technologies, however, the current trend is to perform collaboration in an on-line space as well as an off-line space.
The most representative technology for collaboration is a screen-sharing-based collaboration technology using a remote desktop protocol (RDP). The RDP is driven by allowing several users who want to establish a connection to receive screen information containing media stream of the same screen and by sending and processing a message about control to a shared screen. In case of adding a specific application onto a collaboration screen using a streaming-based collaboration technology, the specific application is installed in a host PC, and clients connecting to the host PC may perform collaboration without installing the specific application because the clients share the screen with one another. However, with the technology, the collaboration screen continuously transmits data including a compressed screen image to a receiving side. This may result in significant delay during transmission and reception processes and increase an amount of traffic in proportion to the number of user terminals. Thus, this technology may be only used in collaboration between a few local users.
Compared to a streaming-based screen sharing program, a web board technology may induce a relatively little traffic in collaboration between multiple users and enable web-server-based content sharing and co-working. The web-board-based collaboration technology prepares for a separate space for collaboration on a web server, shares a web page, a video, a picture, a document, etc., and allows multiple users to simultaneously edit the shared content on the web board. This technology presents a collaboration method that enables real-time communication between participants connecting to the web board and allows the participants to share a web page storing a work result with each other. However, the web-board-based collaboration technology has a limitation of allowing respective clients to share common data established in a web server and thus providing a fixed collaboration environment. That is, in order to add a specific function onto a web board, a web server program may be entirely modified to expand functions.
For a collaboration screen with a cloud-based virtualization technology, collaboration may be performed by remotely using an application installed in a server or sharing documents or multimedia content stored in cloud storage. However, this collaboration is just for resource sharing, and several users can not freely add or move an application to a collaboration screen according to the purpose of collaboration, that is, dynamic expansion of functions is not allowed.
A web app is a computer software that is coded in a programming language such as HTML, CSS, JavaScript, etc. and reliant on a common web browser to render the application executable. The web app is created to perform a specific function such as display of remote data, but evolves to process interactions of a variety of users, as similar to general applications. In particular, a widget can be downloaded to clients in a package form and then installed and executed. However, most web apps can be executed only independently, but cannot have been used for collaboration.
Korean Patent Application No. 10-2010-0123562 discloses a collaboration server for sharing in real time a video, a picture, a document, etc. and providing multiple tasking such that several users may work simultaneously, by sharing a screen on-line. However, this does not allow expansion of function but on-line sharing of display.
The present invention provides a function expandable collaboration screen apparatus and method by freely adding or moving web apps onto a collaboration screen including a variety of contents according to a collaboration purpose.
In one general aspect, the function expandable collaboration screen system includes: a collaboration screen apparatus configured to generate a collaboration container on the basis of received collaboration content and collaboration content information, allocate a control right for the collaboration container, convert the received collaboration content to insert the converted collaboration content into the collaboration container to perform sharing and collaboration works, and deliver a content change occurring in the collaboration content of the collaboration container; and a collaboration client configured to select collaboration content, deliver the selected collaboration content and collaboration content information, remotely connect to the collaboration screen apparatus to remotely control the collaboration content, and update a screen on the basis the received content change.
In another general aspect, the collaboration screen apparatus includes: a content conversion unit configured to classify received collaboration content on the basis of the type thereof and convert the received collaboration content such that a web application is inserted into the received collaboration content; a web app management unit configured to store a plurality of web applications and deliver the stored web application upon a request; and a collaboration page unit configured to execute the converted collaboration content to generate one or more collaboration containers that are shared with one or more other users, and add to the converted collaboration content the web application received from the web app management unit to expand functions thereof.
In still another general aspect, the content collaboration method of the function expandable collaboration screen system selects collaboration content for performing collaboration work and searches for and selects a collaboration screen apparatus for sharing the collaboration content. Depending on a result, the method transmits the collaboration content and collaboration content information to the selected collaboration screen apparatus and generates the collaboration container for sharing the collaboration content. Next, the method converts the collaboration content to insert the converted collaboration content into the collaboration container and shares the collaboration container including the converted collaboration content with one or more collaboration clients.
Other features and aspects will be apparent from the following detailed description, the drawings, and the claims.
a illustrates a configuration of collaboration content information of web-page-based content according to an embodiment of the present invention.
b illustrates a configuration of collaboration content information of local-file-based content according to an embodiment of the present invention.
c illustrates a configuration of collaboration content information of a web app according to an embodiment of the present invention.
Throughout the drawings and the detailed description, unless otherwise described, the same drawing reference numerals will be understood to refer to the same elements, features, and structures. The relative size and depiction of these elements may be exaggerated for clarity, illustration, and convenience.
The following description is provided to assist the reader in gaining a comprehensive understanding of the methods, apparatuses, and/or systems described herein. Accordingly, various changes, modifications, and equivalents of the methods, apparatuses, and/or systems described herein will be suggested to those of ordinary skill in the art. Also, descriptions of well-known functions and constructions may be omitted for increased clarity and conciseness.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Terms used herein are terms that have been selected in consideration of functions and effects in embodiments, and the meanings of the terms may be altered according to the intent of a user or operator, or conventional practice. Therefore, the meanings of terms used in the below-described embodiments confirm to definitions when defined specifically in the specification, but when there is no detailed definition, the terms should be construed as meanings known to those skilled in the art.
Referring to
The collaboration screen apparatus 100 is a screen space that is connected by multiple users to share their variety of contents and perform a collaboration work for a specific purpose. The collaboration screen apparatus 100 may be developed as a separate application program or an HTML based web page operable on a web browser. The content used in the collaboration screen apparatus 100 may be a user's own document, video, and image and include a web page or web video operable on the web. Also, the content may be an application such as a web-based operable web app. The collaboration screen apparatus 100 may be established locally or in a remote server, but is not limited thereto.
Each collaboration client 200 connects to the collaboration screen apparatus 100 to communicate data with the collaboration screen apparatus 100, i.e., to perform collaboration. Also, the collaboration client 200 may connect to the collaboration screen apparatus 100 through a relay server or directly in a local area communication system such as near field communication (NFC) or WiFi Direct.
Referring to
The collaboration page unit 110 includes one or more collaboration containers 111. Each collaboration container 111 may perform common functions required for collaboration. The collaboration page unit 110 receives collaboration content and collaboration content information from the collaboration client 200, generates the collaboration container 111, and shares the received collaboration content through the generated collaboration container 111. Most content in the collaboration container 111 may be shared, including, but not limited to, a user's local document or video in addition to web-based content.
The collaboration container 111 executes the received converted collaboration content. If the received converted collaboration content is an application, the collaboration container 111 executes the application and shares the executed application, allowing the collaboration work to be performed. The function expandable collaboration screen apparatus 100 according the present invention may share or control one or more collaboration containers 111 separately. Furthermore, the function expandable collaboration screen apparatus 100 may share or control the entire collaboration page unit 110.
If the received collaboration content is a document or video, the generated collaboration container 111 may be or include an application such as a document program or video player for replaying or showing the received converted collaboration content.
The collaboration container 111 may expand its functions by adding a web application. The web application (hereinafter, referred to as a web app) refers to an application that is reliant on a web browser and accessed by users over a network such as the Internet or an intranet. For example, if a web app for video call is added onto a shared screen, several users may perform collaboration work while making a video call with one another, thereby providing more efficient collaboration environment.
The collaboration page unit 110 delivers collaboration page unit information including a collaboration page update event to the collaboration client 200, allowing the content to be shared and allowing the collaboration work to be performed. The collaboration page unit information is information about collaboration content executed by the collaboration page unit of the collaboration screen apparatus 100, which may include an image screen of collaboration content under execution, expandable-web app information, and content change information.
The content communication unit 120 receives the collaboration content including web content, general content (picture, video, document, etc.), and web app, and information about the collaboration content from the one or more collaboration clients 200. The received collaboration content and collaboration content information for the collaboration work are delivered to the collaboration screen apparatus 100 through the content communication unit 120 for collaboration work. The content communication unit 120 delivers the received collaboration content to the content conversion unit 130. The collaboration content information may include information for restoring the collaboration content, uniform resource locator (URL) information, uniform resource identifier (URI) information, document object model information, and variable parameter information.
The content conversion unit 130 converts the collaboration content received from the content communication unit 120 such that the collaboration content may be used in collaboration work. The function expandable collaboration screen apparatus 100 according to the present invention may expand its functions by adding a web app during a collaboration content sharing process of the collaboration container 111 for the collaboration work. Accordingly, the content conversion unit 130 converts the collaboration content into data capable of being embedded in the collaboration container 111, on the basis of the type of the received collaboration content. That is, the content conversion unit 130 converts the received collaboration content such that the collaboration screen apparatus 100 may expand its functions by adding a web app. Also, the content conversion unit 130 delivers the converted collaboration content and the collaboration content information received form the content communication unit 120, to the information storage unit 140. The conversion process will be described below in detail with reference to
The information storage unit 140 stores the converted collaboration content and the collaboration content information received from the content conversion unit 130. Also, the information storage unit 140 delivers the converted collaboration content received from the content conversion unit 130, to the collaboration page unit 110. Moreover, the information storage unit 140 receives and stores content and collaboration work details under execution in the collaboration page unit 110.
The connection authority management unit 150 manages remote control and connection authority of the collaboration clients 200 and gives the remote control and connection authority to the collaboration clients 200 which want collaboration work.
The web app management unit 160 includes a plurality of web apps and delivers a web app upon the reception of a request for the web app from the collaboration container 111 of the collaboration page unit 110.
Referring to
The content selection unit 210 selects collaboration content for collaboration work and delivers the selected collaboration content in addition to information about the selected collaboration content to the collaboration screen apparatus 100 through the content transmission unit 220. The collaboration content information may include information about the purpose, object, and range of the collaboration. The collaboration client 200 performs collaboration work on the basis of the collaboration content and collaboration content information delivered to the collaboration screen apparatus 100.
The connection management unit 230 is in charge of connection between the collaboration screen apparatus 100 and the collaboration client 200. The collaboration screen apparatus 100 and the collaboration client 200 may be connected through a relay server such as the Internet network, or using a variety of communication methods such as local area network (LAN), NFC, and WiFi Direct.
The remote input/output processing unit 240 allows the collaboration clients 200 to connect to the collaboration page unit 110 of the collaboration screen apparatus 100 and perform remote control. The collaboration clients 200 connect to the collaboration screen apparatus 100 through the remote input/output processing unit 240 to share the collaboration content and perform collaboration work.
The information reception unit 250 receives from the collaboration screen apparatus 100 information about the collaboration content to be shared for the collaboration work. The collaboration content executed on the collaboration screen apparatus 100 is shared by the one or more collaboration clients 200 for the collaboration work. Accordingly, information about the collaboration content shared in the collaboration screen apparatus is collected. The information about the collaboration content may include shared collaboration content information, content editing authority, shared target, etc.
The collaboration screen output unit 260 performs restoration and display on the basis of the collaboration content information received from the collaboration screen apparatus 100. The collaboration content information received through the information reception unit 250 includes the shared collaboration content image information. The collaboration content image information may be provided by streaming image and video to directly transmit information about the image. Also, the collaboration content image information may be provided by analyzing data and starting the data on a display. For example, the information may be transmitted as an HTML document, and the browser may parse the HTML document to represent the image on the screen. The method of displaying the collaboration content image information is not limited to the above method and may include all other methods for displaying video on a screen. To perform collaboration work in the collaboration clients 200, the collaboration screen output unit 260 restores an image using the collaboration content image information and outputs the restored image to the screen.
Referring to
Next, the collaboration client 200 selects collaboration content to be shared for the collaboration work in 402. Then, the collaboration client 200 searches for collaboration screen apparatuses 100 and selects the collaboration screen apparatus 100 for performing collaboration work on the collaboration content among the searched collaboration screen apparatuses in 403. Next, the collaboration client 200 transmits the selected collaboration content to the collaboration screen apparatus 100 in 404.
Next, the collaboration screen apparatus 100 generates a collaboration container in 405. That is, the collaboration screen apparatus 100 generates the collaboration container for executing the collaboration content on the basis of the collaboration content received from the collaboration client 200 and sharing the executed collaboration content to perform collaboration work. Next, the collaboration screen apparatus 100 firstly allocates a control right for controlling the collaboration container to the collaboration client 200 that has transmitted the collaboration content in 406.
The collaboration screen apparatus 100 converts the received collaboration content such that the collaboration content may be inserted into the collaboration container in 407. The collaboration screen apparatus 100 may expand its functions by adding a web app to the collaboration content under execution in the collaboration container. Accordingly, the collaboration screen apparatus 100 converts the collaboration content received from the collaboration client 200 such that the collaboration content may be executed in the collaboration container. Next, the collaboration screen apparatus 100 inserts the converted collaboration content into the collaboration container in 408. Next, the collaboration screen apparatus 100 updates the collaboration page unit in 409.
The collaboration screen apparatus 100 may expand its functions by adding a web app to the collaboration content inserted into and executed in the collaboration container. The converted collaboration content under execution in the collaboration container may be embedded into a new web app. This may allow the new function to be added and allow the added function to be shared with the collaboration client.
Referring to
Next, the collaboration screen apparatus 100 transmits the collaboration page unit information to the first collaboration client 201 and the second collaboration client 202 in 502. The collaboration screen apparatus 100 transmits the collaboration page unit information to the connected first collaboration client 201 and second collaboration client 202. The collaboration page unit information is information about collaboration content executed by the collaboration page unit of the collaboration screen apparatus 100, which may include information required to restore the collaboration contend under execution, such as page URL, page attribute information, page DOM information, and a variety of variable parameter information. Also, if the content can not be restored, an image stream (image screen) may be transmitted. In this case, the collaboration screen apparatus 100 may perform an authentication procedure for qualification of sharing and collaboration on the first collaboration client 201 and the second collaboration client 202.
Next, the first collaboration client and the second collaboration client display the collaboration page unit when receiving the collaboration page unit information from the collaboration screen apparatus 100 in 503. The first collaboration client 201 and the second collaboration client 202 display on the screen the collaboration page including the collaboration content image on the basis of the received collaboration page unit information.
Next, the collaboration screen apparatus 100 transmits a collaboration page unit update event to the first collaboration client 201 and the second collaboration client 202 when a collaboration screen data change event occurs in 504. The collaboration screen data change event denotes all changes in collaboration content that is performed in the collaboration screen apparatus 100. As the first collaboration client 201 or the second collaboration client 202 share the collaboration content and perform collaboration work, a change in the collaboration content may occur. The collaboration screen apparatus 100 transmits the collaboration page update event including information about all the changes, to all collaboration clients sharing the collaboration content.
The first collaboration client 201 and the second collaboration client 202 update the collaboration page unit in 505. Specifically, the first collaboration client 201 and the second collaboration client 202 update a collaboration page unit, by applying the change according to the collaboration page update event received from the collaboration screen apparatus 100. In response to the updated collaboration page unit, a shared screen is updated.
Two collaboration clients for collaboration work, the first collaboration client and the second collaboration client, have been described in
Referring to
Next, the collaboration client 200 displays a collaboration page on a screen on the basis of the received collaboration page information in 603. The collaboration client 200 receives collaboration page information from the collaboration screen apparatus 100 and then displays the collaboration page on the screen on the basis of the received collaboration page information.
Next, the collaboration client 200 selects a collaboration container in 604. The collaboration client 200 searches for collaboration containers of the collaboration screen apparatus 100 and selects a collaboration container for performing collaboration work among the searched collaboration containers.
Next, the collaboration client 200 requests a control right for controlling the selected collaboration container from the collaboration screen apparatus 100 in 605. In the collaboration screen system according to the present invention, the collaboration client 200 connects to the collaboration container of the collaboration screen apparatus 100 and then remotely controls the collaboration page unit, thus perform collaboration work. Accordingly, in order to perform collaboration work, a control authority for remotely controlling the collaboration page unit should be given to each collaboration client. The control-right request of the collaboration client 200 for the collaboration container may be performed automatically upon selection of the collaboration container or performed by further instructions.
Next, the collaboration screen apparatus 100 allocates the control authority for controlling the collaboration container when receiving the control authority request for the collaboration container from the collaboration client 200 in 606. The collaboration screen apparatus 100 may allocate the control right on the basis of predetermined or stored authority information of each collaboration client 200 or authority information of the collaboration container. Alternatively, the collaboration screen apparatus 100 may allocate the control right after checking the control authority of each collaboration client 200 through an ID and a password for identification. Next, the collaboration screen apparatus 100 notifies the collaboration client 200 that the control right for the collaboration container has been allocated in 607.
Next, the collaboration client 200 generates a collaboration container control event when receiving the control right for the collaboration container from the collaboration screen apparatus 100 in 608. The collaboration container control event includes a remote control instruction that is indicated to the collaboration container by the collaboration client 200. That is, the collaboration client 200 generates a control instruction for remotely controlling the collaboration content of the collaboration container. Next, the collaboration client 200 delivers the collaboration container control event to the collaboration screen apparatus 100 in 609.
When a collaboration screen data change event occurs due to the collaboration container control event, the collaboration screen apparatus 100 transmits the collaboration page update event to the collaboration client 200 in 610. The collaboration screen data change event denotes all changes in collaboration content that is performed in the collaboration screen apparatus 100. The collaboration screen apparatus 100 transmits the collaboration page update event including information about all the changes, to all collaboration clients 200 sharing the collaboration content.
Referring to
Next, the method analyzes information about the selected content in 702. The collaboration content may have a different type or form depending on its objective or function. Accordingly, the method analyzes the information about the selected content before classifying the type of the collaboration content. The information about the selected content may include information about the type, form, objective, and capacity of the content.
Next, the method classifies the type of the collaboration content in 703. The method identifies the type of the collaboration content on the basis of the information analysis result for the selected content. The collaboration content may be largely classified into three types. The first type is a web page, the second type is a general local file, and the third type is a web app such as a widget.
If the collaboration content is a web page, the method extracts web page information in 704. The web page collectively refers to web documents on the Internet, which may include an image, sound, and video as well as a text such as a general document. If the type of the collaboration content is a web page, the method extracts web page information. The web page information includes a uniform resource locator (URL), a size of an area, DOM information, etc. If the web page is web media including an image, sound, and video, the web page information may include additional information such as type information, playing time, and codec information of the image, sound, and video, which are required for signal decoding.
If the collaboration content is a local file, the method uploads the collaboration content to the collaboration screen apparatus or an external content server in 705. In this case, if additional encoding is required, the method issues a uniform resource identifier (URI) for connecting to the content after an encoding process and allows the URI to be shared with several users.
If the collaboration content is a web app, the method extracts web app information in 706. If the collaboration content is an app such as a widget executable at a client side, the method extracts the current execution status firstly, and then collects a URL or file of the widget to extract web app information.
Next, the method transmits collaboration content information according to the classified type of the collaboration content in 707. The method transmits to the collaboration screen apparatus collaboration content information including local files and information extracted from the web page or web app and shares the collaboration content with one or more clients to allow collaboration work to be performed.
Referring to
Next, the method analyzes received collaboration content information in 803. The method analyzes the received collaboration content information and classifies the type of the received collaboration content according to the analysis result in 804. The received collaboration content may be classified into a web page type, a local file type, and a web app type, as shown in
If the collaboration content is a web page, the method reconnects to a web page and restores context in 805. If the collaboration content is a web page, the method reconnects to a web page through URL information and restores a relevant page using the received context information.
If the collaboration content is a local file, the method converts the collaboration content into web-based data in 806. If the collaboration content is a local file such as a file-based general document or video and image, the method transmits URI information acquired during the content transmission procedure, and thus converts the URI such that the URI may be embedded into the collaboration container and allows the URI to be loaded by the collaboration container.
If the collaboration content is a web app, the method downloads, installs, and then drives the web app in 807. If the collaboration content is a web app or widget, the method downloads the app using the URL specified in the web app, installs the app in the collaboration screen unit, and drives the app. In this case, the method should convert the web app or widget such that the web app or widget may be embedded into the collaboration container. The method may generate an embeddable code with downloaded widget package (a collection of HTML, JS, and CSS as a config file having an extension of wgt) and add the embeddable code to the collaboration container. The embeddable code will be described below in details with reference to
Next, the method stores a variety of information used in the container, in the collaboration screen storage in 808. The method stores the collaboration content and the information generated according to collaboration content type in an information storage. The method generates a collaboration screen data change event to update the screen of the collaboration screen apparatus in 809.
a illustrates a configuration of collaboration content information of web-page-based content according to an embodiment of the present invention.
Referring to
b illustrates a configuration of collaboration content information of local-file-based content according to an embodiment of the present invention.
Referring to
c illustrates a configuration of collaboration content information of a web app according to an embodiment of the present invention.
Referring to
As shown in Table 1, it may be utilized in configuration of collaboration screen that a collaboration container class is designated and represented as a user interface or a variety of property values are separately specified in a tag.
The function expandable collaboration screen system according to the present invention may expand its functions by dynamically adding required web apps to the screen according to the purpose of the collaboration when configuring the collaboration screen having a variety of contents, thereby establishing a new collaboration environment for providing a variety of web apps such as a video conference, schedule management, etc. as well as a simple document sharing and editing function provided by the existing web-board-based system. When the collaboration screen is locally established during operation of the collaboration screen, the collaboration screen may be usefully utilized even in a small-sized group requiring security.
A number of examples have been described above. Nevertheless, it will be understood that various modifications may be made. For example, suitable results may be achieved if the described techniques are performed in a different order and/or if components in a described system, architecture, device, or circuit are combined in a different manner and/or replaced or supplemented by other components or their equivalents. Accordingly, other implementations are within the scope of the following claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2012-0132408 | Nov 2012 | KR | national |
