Patent Application
20150138302
The systems and methods disclosed herein relate to conferencing systems and in particular to video conference systems.
In many instances, when a video conference is initiated, the video conference will include video from a video conference room. Nowadays, participants who are in the video conference room may bring their personal devices, such as a tablet device and login to the video conference with their personal device. This is useful since the user can share documents and give presentations using their personal device.
However, this also causes problems with how participants are viewed in the video conference. By default, the video camera in the conference room shows the image of all or most of the participants in the conference room. In addition, the same participants can be seen in the video conference based on a video camera in the participant's personal video devices. This image duplication creates a sub-optimal user experience and can cause confusion for attendees of the video conference. What is needed is a way to manage this duplication of images in a video conference.
Systems and methods are provided to solve these and other problems and disadvantages of the prior art. A video conference is established between a first video device and a second video device. The first video device captures a first participant's images in the video conference. The first participant's image is also captured as part of the video conference via the second video device (e.g., there are duplicate images of the first participant's image being captured by different devices). The first participant's image is detected as being captured by the first video device and the second video device in the video conference. For example, the duplicate images can be determined based on facial recognition. In response to detecting that the first participant's image is being captured by the first video device and the second video device in the video conference, the process automatically forbears from displaying at least one instance of the first participant's image (e.g., the first participant's image captured by the second video device or the first participant's image captured by the first video device).
The video device 101 can be or may include any device that can send or receive video information on the network 110, such as a Personal Computer (PC), a video telephone, a video system, a cellular telephone, a Personal Digital Assistant (PDA), a tablet device, a notebook device, a video camera, and the like. As shown in
The participants 102 can be anyone who is participating in a video conference. The participants 102 may be located in the conference room 104 as shown by the participants 102A-102B. Any number of participants 102 may be located in the conference room 104. The participants 102 may be located in a remote location, such as shown by the participant 102N.
The network 110 can be or may include any network that can send and receive information, such as the Internet, a Wide Area Network (WAN), a Local Area Network (LAN), a Voice over IP Network (VoIP), the Public Switched Telephone Network (PSTN), a packet switched network, a circuit switched network, a cellular network, a combination of these, and the like. The network 110 can use a variety of protocols, such as Ethernet, Internet Protocol (IP), Session Initiation Protocol (SIP), Integrated Services Digital Network (ISDN), H.264, H.263, H.261, and/or the like.
The communication system 120 may be or may include any device that can route video communications, such as a video switch, a video router, a video server, a video communication system, and/or the like. In
The video bridge 121 can be or may include any hardware/software that can route and/or bridge video communications. The video bridge 121 may mix multiple video streams from the video devices 101A-101N. The video bridge 121 may route multiple video streams sent from the video devices 101A-101N. The video monitor 122 can be or may include any hardware/software that can manage and monitor video streams.
The video bridge 121 establishes a video conference between the first video device 101A and a second video device (or devices) 101B. The video conference can be established in various ways. For example, the video conference can be established by the video bridge 121 calling the video device 101A and the video device(s) 101B-101N. The video conference can be established by the participants 102 calling into the video bridge 121 via the video devices 101A-101N.
The video bridge 121 captures the participants 102A and optionally 102B's images in the video conference via the first video device 101A. Although not shown, the video bridge 121 can capture additional participant's images if the additional participants 102 are in the conference room 104. The video bridge 121 captures the participant 102A's image in the video conference via the second video device 101B. The participant 102A may join the video conference via the second video device 101B because he/she wants to present during the meeting using the second video device 101B.
The video monitor 122 detects that the participant 102A's image is being captured by the first video device 101A and the second video device 101B in the video conference. In response to detecting that the participant 102A's image is being captured by the first video device 101A and the second video device 101B in the video conference, the video monitor 122 automatically forbears from displaying at least one of the first participant 102A's image captured by the first video device 101A and/or the second video device 101B. Which image(s) of the first participant 101A that is displayed (or not displayed) can be accomplished based on an administrative setting, based on how clear the image is, based on a resolution of the image, and/or the like. In one embodiment, the image that is not displayed is the image from the second video device 101B. Alternatively, the image that is not displayed can be the image from the communication device 101A.
As discussed above, the video monitor 122 automatically forbears from displaying at least one of the first participant 102A's image. In an alternative embodiment, the participant 102A is provided an option to automatically forbear from displaying the participant 102A's image from the first or second video device 101B. The participant 102A may elect to allow his/her image to be displayed or not and from which source the image is displayed from.
Forbearing from displaying the participant's image can be accomplished in various ways, such as by sending a message to the second video device 101B to stop sending a video stream of the participant 102A. Alternatively, the video bridge 121 (or any other device in the network 110) can disable routing the video stream so that the participant 102A's image is not displayed as part of the video conference.
The above example only discusses a single participant's (102A) image not being displayed. However, this process can be repeated for additional participants (e.g., participant 102B) if the additional participants are part of the video conference captured by the first video device 101A and the video device 101 associated with a specific participant. In another embodiment, this process can be repeated for two or more participants 102 (e.g., participant 102A and participant 102B) being captured by a single second video device 101B. In an alternative embodiment, individual ones of participants 102 being captured by a single second video device 101 may be prevented from being displayed. In one embodiment, the first video device is a conference room video device and the second video device 102B is an individual participant video device, such a notebook device.
The communication system 120 comprises the video bridge 121, the video monitor 122, a facial recognition module 223, an analysis module 224, and an authentication module 225. The facial recognition module 223 can be any hardware/software than can provide facial recognition. The analysis module 224 can be any hardware/software that can analyze a video communication.
The authentication module 225 can be any hardware/software that can authenticate a participant in a video conference. The authentication module 225 can authenticate a participant in various ways, such as based on an authentication code, based on a password, based on a voice print, based on facial recognition, based on biometrics, and/or the like.
The second illustrative system 200 can perform the same process described in
In an embodiment, the analysis module 224 determines that the participant 102A has become a presenter in the video conference. The analysis module 224 can determine that the participant 102A is a presenter in various ways, such as based on the participant 102A speaking, based on the participant 102A bringing up a document or slide show during the video conference, and/or the like. In response to the participant 102A becoming a presenter in the video conference, the analysis module 224 can automatically display the participant 102A's image in the video conference.
In another embodiment, the analysis module 224 determines that the participant 102A has become the presenter. This may be based on an audio stream from the second video device 101B (e.g., the participant is speaking), an audio stream from the first video device, based on a visual input such as the person presenting a slide or the person's talking being detected visually, and/or based on the device being used with possible information about who is using the device. In response to one or more of these, the analysis module 224 can highlight the participant 102A's image from the first video device 101A. The analysis module 224 may highlight the participant 102A's image from the first video device 101A in various ways, such as by changing a color of the participant 102A's image, drawing a circle or square around the participant 102A's image, blurring the background around the participant 102A's image, and/or the like.
In another embodiment, the participant 102A logs into the video conference from the second video device 101B using the authentication module 225. As the participant 102A logs into the video conference, the authentication module 225 can receive information (e.g., from a database) associated with the participant 102A, such as the participant 102A's name or other information associated with the participant 102A. Other information associated with the participant may include the participant 102A's location, address, nickname, title, and/or the like.
The video monitor 122 determines a location of the participant 102A's image in a view of the video conference provided by the first video device 101A. In response to determining the location of the participant 102A's image, the video monitor 122 provides the name of the participant 102A by the location of the participant 102A's image in the view of the video conference provided by the first video device 101A. The location may be determined by facial recognition by comparing the image of the participant 102A from the video device 101A and the image of the participant 102A from the second video device 101B. Alternatively, voice recognition may be used. The video monitor 122 can use a voice print of the participant 102A and match a timing of the voice print with when the participant 102A is talking.
In another embodiment, other types of information may be displayed along with or instead of the name of the participant. The information displayed can comprise information such as, a location of the participant 102, an address, a nickname, a title, and/or the like. For example, the participant's title can be displayed along with or in place of the participant's name.
In existing systems, the above described video conference would include the image of the participant 101A (302A2) and the image of participant 101B (302B) that are captured by the first video device 101A, the image of participant 102A (302A1 in window 305) that is captured by the second video device 101B, and the image of participant 102N (302N in window 306) that is captured by the video device 101N.
In one embodiment, the video monitor 122 detects that the participant 102A's image 302A2 is being captured by the first video device 101A and the participant 102A's image 302A1 is being captured by the second video device 101B. In response, the video monitor 122 automatically forbears from displaying the participant 102A's image 302A1 in the window 305. This is illustrated by the broken lines in window 305 to indicate that the window 305 may or may not be displayed. Alternatively, the video monitor could forbear from displaying the participant 102A image 302A2 instead.
The analysis module 224 can detect that the participant 102A is presenting in the video conference. In response, the analysis module 224 can display the participant 102A's image 302A1 in the window 305. Alternatively, the analysis module 224 can highlight the participant 102A's image 302A2.
The authentication module 225 can receive a name 307 of the participant 102A based on the participant 102A logging into the video conference. The video monitor 122 determines the location of the participant 102A's image (302A2) in the view provided by first video device 101A. The video monitor 122 provides the name 307 in a location by the participant 102A's image 302A2 in the view of the video conference provided by the first video device 101A. In
The process starts in step 400. The process establishes a video conference between a first video device and a second video device(s) in step 402. The first video device captures at least a first participant's (and optionally a second participant's image) in the video conference. The first participant's image is also captured as part of the video conference via the second video device.
The process detects, in step 404, if the first participant's image is being captured by the first video device and the second video device in the video conference. If the first participant's image is not being captured by the first video device and the second video device in the conference in step 404, the process goes to step 408. Otherwise, if the first participant's image is being captured by the first video device and the second video device in the video conference in step 404, the process automatically forbears from displaying at least one instance of the first participant's image captured by the first video device and the second video device.
The process determines in step 408 if the video conference is complete in step 408. The video conference may be complete in various ways, such as a moderator ending the conference, based on all the participants exiting the conference, based on a defined number of participants leaving the conference and/or the like. If the video conference is not complete in step 408, the process goes to step 404. By going to step 404, the process can repeat. For example, if another participant joins the video conference in the conference room (and is captured by the first video device) and also joins the video conference via another second video device, the process can forbear from displaying the other participant's image received from the other participant's video device. If the process determines in step 408 that the video conference is complete, the process ends in step 410.
If the process determines in step 500 that the participant is presenting in the video conference, the process, in one embodiment, automatically displays the participant's image from the second video device. In another embodiment, the process highlights the participant's image from the conference video device. The process can also do both of the steps described in step 504. The process goes to step 408.
Otherwise, if the first participant's image is being captured by the video conference room device and the second video device in the video conference in step 602, the process determines a location of the first participant's image in a view of the video conference provided by the first video device in step 604. The process provides the name for the participant by the location of the first participant in the view of the video conference provided by the first video device in step 606. The process goes to step 406.
Of course, various changes and modifications to the illustrative embodiment described above will be apparent to those skilled in the art. These changes and modifications can be made without departing from the spirit and the scope of the system and method and without diminishing its attendant advantages. The following claims specify the scope of the invention. Those skilled in the art will appreciate that the features described above can be combined in various ways to form multiple variations of the invention. As a result, the invention is not limited to the specific embodiments described above, but only by the following claims and their equivalents.
