Patent Application
20250068376
The present invention relates to a system and method for enabling an interactive meeting having both attendees who are in the physical meeting room, as well as attendees who are located remotely from the physical meeting room.
Existing systems for enabling interactive meetings, such as Microsoft Teams, Google Hangouts, and Zoom, allow for meetings to take place with remotely located meeting attendees, as well as any attendees who are together in the same physical room. However, the experience is not fully interactive, especially for the remote attendees, as there is usually one person in control of any content which is displayed to all the other attendees, and such content is usually limited to one document presently being shared and discussed, as well as video feeds from each of the remote attendees.
It would be very useful to have a more immersive meeting experience, for all attendees, in-room and remote, to help encourage better cooperation and free flow of ideas and input from each of the attendees. The technical means for achieving this has not yet been available.
The present invention provides a system for enabling an interactive meeting between attendees physically located in a room as well as attendees located remotely from the room, comprising: a server which runs an application for controlling the interactive meeting; a plurality of projectors located in the room; and a plurality of displays in the room for displaying content from the plurality of projectors; wherein the application is arranged so that user provided settings can be configured to select which, of a plurality of types of content, is to be displayed on which of the plurality of displays; and wherein an attendee located remotely from the room, joins an interactive meeting via a web application using a web browser, and uses the web browser to view content being displayed on the displays in the room by using the web application on a first device to access content of one of the plurality of types, and using the web application on a second device to access content of another one of the plurality of types; and
The invention also provides a method of enabling an interactive meeting between attendees located physically in a room as well as attendees located remotely from the room, comprising the steps of: controlling a first display, located in the room, to display a first type of content; controlling a second display, located in the room, to display a second type of content; and controlling a third display, located in the room, to display a third type of content; wherein a user configures an application to select, for each of the first, second and third displays, which type of content is to be displayed on which display; wherein an attendee located remotely from the room, joins an interactive meeting via a web application using a web browser and uses the web browser to view content being displayed on the displays in the room and uses the web application on a first device to access content of one of the plurality of types, and uses the web application on a second device to access content of another one of the plurality of types; wherein the web application is arranged so that user provided settings can be configured to select which of a plurality of types of content is to be displayed on which of the first or second device.
The invention also provides a computer program corresponding to the above method.
By the use of the invention as described above, an attendee who is located in the room can experience content of a different type being displayed on a different display, and the settings of content/display can be set for subsequent meetings without having to reconfigure the settings. Likewise, the attendee who is located remote from the room can simulate the rich diverse experience of the in-room attendee by viewing content of one type on one device and viewing content of another type on another device, all without having to reconfigure the settings of preferred technical choices from one meeting session to another.
In this way, a remote attendee can experience the meeting much better than in previous systems, and much more similar to the in-room attendees' experience. This greatly increases user participation and engagement in meetings, even when an attendee cannot attend the meeting in person.
According to a preferred embodiment of the present invention, a new software platform has been developed, which sits on top of an existing meeting collaboration package, such as Microsoft Teams. The new software platform integrates together various types of content, and allows each of the attendees in the meeting, whether they are in-room or remote, to view the various types of content, and to share new content of the various types with the other attendees (whether they are in-room or remote).
If the users are in-room, projectors (located in the physical room) can be used to display the various types of content onto multiple walls (or generally, displays) of the physical room.
These projectors which display content on walls can provide interactive (touch screen) displays, as well as normal displays.
Examples of the types of content which can be interactively viewed and shared via the new software platform are the following:
As also shown in
The participants (or attendees) of a meeting use the new platform by accessing it via a web browser 118 using a web browser application as will be described below. The participant also uses the Microsoft Teams Client 119 in the preferred embodiment, as the new platform is running on top of a collaborative meeting tool such as Teams. Likewise, a Microsoft Teams API 120 is used to ensure seamless integration between the new platform and Teams.
Attendees can join an interactive meeting by using a web application, via a standard web browser, to access the meeting, allowing access to the interactive white board, allowing the attendee to stream its video and audio to the meeting (a video stream showing the face of the attendee and an audio stream having the words being spoken by the attendee), and allowing the attendee to share documents with the overall meeting. The web application also enables the attendee to receive such various types of content which are originating from the other attendees in the meeting.
The web application allows the attendee to open one browser window or tab, and then use an in-application pull-out menu to switch between different types of content (interactive whiteboard, video/audio, or documents). An attendee can also open other browser windows or tabs and have one browser window/tab dedicated to each type of content. A second device, such as a tablet, can also be used to open an additional instance of the web application, to enable the attendee to view one type of content on one device (laptop) and another type of content on another device (tablet).
A remote attendee could simulate the in-room multi-screen experience by, for example, opening three instances of the web application, one on the laptop, one on the tablet and a third on a smartphone, and assigning a different type of content to each of the devices. This would enable, for example, the whiteboard to be viewed and edited on the tablet (which has a capability to use a pencil on the screen), a Word document to be viewed and edited on the laptop (which has a QWERTY keyboard allowing easy text editing), and a smartphone to be used to display a video content of an attendee who is presently speaking.
Attendees can also join a meeting by using the standalone application mentioned above, which does not require a browser to run, but instead runs on an operating system directly (such as on Microsoft Windows). This standalone application controls the content types being displayed in a physical room, including controlling multiple projectors to display content of various types on a plurality of large video screen displays in the room.
The standalone application also receives inputs from the projectors/displays when the meeting attendees interact with the content being displayed, so that the interactions can be shared with each of the other attendees, whether they be in-room or remote. Typically, for a projector-driven system, the user interactions would be conveyed from an infrared pen supplied by the projector manufacturer which, in turn, relates these details back via the projector to the server running the standalone application. It would also be possible to process touch screen movements back to the server in a similar manner, if the projector/video screen accepted these inputs.
The standalone application is capable of being set to remember which display should be used for each specific type of content, as well as how many pieces of content of each type should be displayed on a particular display (this is called tiling). For example, as shown in
Specifically, the standalone application makes use of user-provided settings to decide how to handle the displaying of content within the system. The settings are configured on installation, but can be changed within the standalone application. These settings/configurations cover:
Alternatively, another set up may use two large touch screen TVs and have one set to display the video screen and the second to display up to four tiles of whiteboard or shared documents.
The settings of the standalone application are configured via the software and can be changed by the user, with the changes persisting for the next use of the application. The user may also edit these settings during a meeting by using an in-meeting settings menu of the standalone application.
Also, the settings of the web application can be similarly configured via the software and can be changed by the user, so that the remote user, who chooses to view content of one type on one device (e.g., a laptop) and who chooses to view content of another type on another device (e.g, a mobile phone) can always view such content on such device, from one meeting session to another (the settings would persist).
At step 31, the process begins.
At step 32, the room application controls the system of
At step 33, the room application controls the system of
At step 34, the room application controls the system of
At step 35, the process ends.
An example will now be provided of an instance of a typical meeting, explaining how the new software platform produces technical advantages over existing collaborative meeting systems.
A meeting is scheduled between three people, Ahmed, Billie and Charlie.
Ahmed and Billie are sat together in a meeting room which is set up as an interactive room as described above. The room contains a Windows machine running the standalone application and it has three projector displays.
Charlie will be joining the meeting from home on his laptop.
When the meeting starts, Ahmed and Billie enter the meeting code into the standalone application, and it joins the meeting. They additionally join the meeting on a laptop to allow their video and audio to be put into MS Teams and distributed through the new platform.
When there is a video coming into the platform via MS Teams, the standalone application detects it and starts to show the video feed on the display dedicated to video.
Charlie joins the meeting in MS Teams on his laptop and also signs into the web application and joins the meeting.
When Charlie speaks, MS Teams' ‘active speaker’ video mode displays his video feed in the platform. In the room, the projector dedicated to video content displays Charlie on the wall when he is speaking, giving him a greater presence in the meeting for those in the room that are not looking at their laptop.
When Charlie shares a PowerPoint presentation he has produced about an upcoming project in the platform, the shared document appears on the display in the room that has been dedicated to shared content.
Billie wants to draw a project timeline on the whiteboard and opens a new whiteboard via her laptop. This is then displayed on the display in the room that is dedicated to the whiteboard. Charlie switches using the menu in the web application to view the whiteboard and contributes to the project timeline.
A discussion ensues, and in order to be able to watch the incoming video feed from the meeting room and see the whiteboard, Charlie uses his iPad to sign into the platform. He is now watching the video feed on his iPad while drawing on the whiteboard on his laptop.
Ahmed wants to take notes about the project timeline and opens a shared Word document via his laptop. This is tiled on the display dedicated to the shared content, meaning that half the display is given to the already open PowerPoint presentation and the other half now shows the Word document.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2112675.0 | Sep 2021 | GB | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/IB2022/058374 | 9/6/2022 | WO |
