This application claims the benefit of U.S. Provision Application No. 60/426,823, filed Nov. 18, 2002.
1. Field of the Invention
The present invention generally relates to video teleconferencing and multimedia presentations. More particularly, the present invention relates to systems, methods and computer program products for performing video teleconferences and/or delivering multimedia presentations.
2. Background
Conventional video teleconferencing and multimedia presentation systems are often difficult to install and operate due to their complexity. For example, conventional systems typically consist of disparate components, such as a camera, display, and/or telephone, that were originally designed as stand-alone devices. Such components are typically made by different manufacturers using different technology based on different standards, and as a result, are difficult to integrate without an experienced audio-visual integrator and custom software. These limitations translate directly into higher costs for system owners.
Furthermore, conventional video teleconferencing and multimedia presentation systems are limited in their ability to present high-bandwidth intensive applications, such as animated presentations using Microsoft® PowerPoint™ or Macromedia® Flash™ technology. These presentations do not translate well at local/remote sites viewing them in real time due to delays caused by network bandwidth limitations. For example, in conventional systems, network bandwidth limitations may cause the quality and speed of the presentation data received by local/remote systems to be diminished, resulting in poor slide-to-slide transitions, delays, and choppiness for those viewing the presentations in real time at the local/remote sites.
Additionally, conventional video teleconferencing and multimedia presentation systems do not provide an easy method for remotely configuring, monitoring and controlling the system, or for archiving and retrieving recorded video teleconferences and/or multimedia presentations.
A fully integrated video teleconferencing and multimedia presentation system is provided that is simple and inexpensive to install and operate. The integrated video teleconferencing and multimedia presentation system provides advanced features, including the ability to concurrently perform video teleconferencing and provide high or medium bandwidth intensive presentations in real time with no degradation in the quality of the video teleconference or the presentation at local or remote sites. Furthermore, the integrated video teleconferencing and multimedia presentation system provides an easy method for remotely configuring, monitoring and controlling the system, as well as an easy method for archiving and retrieving recorded video teleconferences and/or multimedia presentations.
The accompanying drawings, which are incorporated herein and form part of the specification, illustrate the present invention and, together with the description, further serve to explain the principles of the invention and to enable a person skilled in the relevant art(s) to make and use the invention.
The features and advantages of the present invention will become more apparent from the detailed description set forth below when taken in conjunction with the drawings in which like reference characters identify corresponding elements throughout. In the drawings, like reference numbers generally indicate identical, functionally similar, and/or structurally similar elements. The drawings in which an element first appears is indicated by the leftmost digit(s) in the corresponding reference number.
A. Overview
A video teleconferencing and multimedia presentation system in accordance with an embodiment of the present invention is provided. As will be described in more detail herein, the system is integrated and network-ready to facilitate ease of set-up and operation, and also utilizes IP and/or wireless networking to provide advanced features and functionality, such as remote access and control and the ability to perform secure archiving and retrieval of recorded video and audio data. The system further utilizes a unique peer-to-peer conference network solution in order to address the bandwidth limitations that plague conventional systems and allow enhanced viewing of high-bandwidth applications.
B. Example Operating Environment
As depicted in
Network 120 facilitates the bi-directional transmission of video and audio data between unit 110 and systems 130a-130n, and the transmission of presentation data and control signals using a control protocol from unit 110 to systems 130a-130n. In an embodiment, network 120 comprises a packet-switched local area network (LAN), and preferably comprises a TCP/IP-based LAN. However, the present invention is not so limited and network 120 may comprise any type of computer network or combination of networks including, but not limited to, circuit switched and/or packet switched networks. Additionally, network 120 may comprise a variety of transmission mediums including, but not limited to twisted pair, coaxial cable, fiber-optic and/or wireless transmission mediums. In an alternate operating environment, network 120 includes a wide area network such as the Internet.
Each of systems 130a-130n can comprise any of a variety of video teleconferencing systems, including but not limited to H.323 and SIP-compliant video teleconferencing systems. As will be appreciated by persons skilled in the relevant art(s), H.323 refers to a standard approved by the International Telecommunication Union (ITU) that defines protocols and procedures for transmitting audio and video conferencing data across networks, while SIP (Session Initiation Protocol) refers to an Internet Engineering Task Force (IETF) standard protocol for initiating an interactive user session that involves multimedia elements such as video and voice. A variety of conventional H.323-compliant and SIP-compliant video teleconferencing systems are readily available and will be known to persons skilled in the relevant art(s). Alternately, at least one of systems 130a-130n comprises a video teleconferencing and multimedia presentation system that is identical to unit 110.
C. Video Teleconferencing and Multimedia Presentation Unit
In accordance with an embodiment of the present invention, all the necessary components for conducting a network-based video teleconference and multimedia presentation are integrated into the single video teleconferencing and multimedia presentation unit 110, thereby facilitating ease of set-up and operation and providing a single low-cost video teleconferencing solution.
In an embodiment, video camera 220 comprises a pan-tilt-zoom (PTZ) video camera that is permanently affixed to unit 110 via an adjustable mount that accommodates the pan, tilt, and zoom capabilities of the camera. Video camera 220 may also comprise other types of cameras, including but not limited to a pan-tilt (PT) camera or a fixed camera. Video camera 220 is coupled to unit 110 via an internal or external port, which may comprise, for example, a Universal Serial Bus (USB) port, an RS232 port, or a PCI port. This internal or external port provides a means for delivering video data from video camera 220 to the operating system running on unit 110.
In an alternate embodiment (not shown), video camera 220 is not permanently affixed to unit 110 but instead comprises a removably affixed or stand-alone device that is coupled to unit 110 via a wired connection, such as a USB or RS232 cable, or a wireless connection, such as an 802.11b or Bluetooth™ connection, to facilitate hand-held movement and positioning of the camera. In a still further embodiment (not shown), unit 110 includes at least two video cameras 220, one of which is affixed to unit 110 and one of which comprises a removably affixed or stand-alone device.
Thus, this embodiment of the present invention also accommodates the simultaneous display of video data corresponding to a video teleconference and a multimedia presentation. In a further embodiment, unit 110 is also configured to display a GUI via display 320 and/or display 322, as will be described in more detail herein.
1. Hardware Configuration
Unit 110 essentially comprises a microprocessor-based computer system that executes necessary software components for performing the video teleconferencing and multimedia presentation features of the present invention.
As shown in
Microprocessor 402 is connected to a communication infrastructure 404 for communication with the other components of unit 110. The communication infrastructure may comprise, for example, one or more communication buses, a cross-bar, or network.
Unit 110 further includes a main memory 406, such as a random access memory (RAM), and a secondary memory 416, which may include, for example, at least one hard disk drive. In an embodiment, main memory 406 comprises at least 512 Mb of high speed SDRAM and secondary memory 416 comprises a hard drive having at least 20 Gb of storage capacity. However, the invention is not so limited, and additional forms of storage may be used for main memory 406 and secondary memory 416, as will be appreciated by persons skilled in the relevant art(s). For example, as will be discussed in more detail herein, secondary memory 416 may further include a CD-RW or DVD-RW drive for archiving video data, audio data and presentation data corresponding to a video teleconference or multimedia presentation.
Unit 110 further includes a display interface 408 that forwards video data, including images, graphics, and text, from the communication infrastructure or a frame buffer (not shown) to a display 410. As discussed above in reference to
Unit 110 also includes an audio interface 412 and microphone and speakers 414. Microphone and speakers 414 may either be internal or external with respect to unit 110. Audio interface 412 receives audio information from communication infrastructure 404 and forwards it to speakers 414. Audio interface 412 also receives audio information from microphone 414 and forwards it to communication infrastructure 404. In an embodiment, audio interface 412 comprises a sound card that supports at least an 8 KHz sampling rate.
Unit 110 also includes one or more peripheral interfaces 418 for communicating data to and from one or more peripheral devices, including at least one video camera, which may either be internal or external with respect to unit 110. A peripheral interface may comprise an adapter and one or more internal or external connection ports. In an embodiment, peripheral interface(s) 418 may include an USB interface, an RS232 interface, a PCI interface, an IEEE 1394 interface, or a combination of any of the above.
Unit 110 also includes at least one interface for network communication.
The network interface may comprise a wired network interface 420 for connecting to a wired network and/or a wireless network interface 422 for connecting to a wireless network. In an embodiment, wired network interface 420 comprises a 10/100 Mb Ethernet interface and wireless network interface 422 comprises an 802.11b network interface. However, the invention is not so limited and other wired and wireless network interfaces may be used as will be appreciated by persons skilled in the relevant art(s).
Unit 110 further includes at least one power supply and cooling system (not shown). Additional hardware components that may optionally be included in unit 110 but are not depicted in
2. Software Configuration
The microprocessor 402 of unit 110 executes computer programs, or software, necessary to execute the video conferencing and multimedia presentation features of the present invention. These computer programs may reside in main memory 406 and/or secondary memory 416, and may also be received via wired network interface 420 or wireless network interface 422. Such computer programs, when executed, enable unit 110 to perform the features of the present invention.
As used herein, the term “computer program product” may refer, in part, to a hard disk drive, a CD-ROM or DVD-ROM inserted into secondary memory 416, or to a carrier wave carrying software over a communication path to wired network interface 420 or wireless network interface 422. These computer program products comprise means for providing software to unit 110.
Exemplary software configuration 500 also includes application program interfaces (APIs) 504 that permit application programs 506 to make requests for service to operating system 502, thereby permitting application programs 506 to make use of various functions available to operating system 502. In an embodiment, APIs 504 include Microsoft® DirectX® for performing functions relating to the creation and management of graphics images and multimedia effects in application programs running under the management of the Windows® operating system, as will be appreciated by persons skilled in the relevant art(s).
In accordance with such an embodiment, DirectX® is used by video engine 510 and audio engine 512, as will be described in more detail below.
a. Graphical User Interface
As shown in
In an embodiment, GUI 508 is displayed on a touch sensitive display, which facilitates the receipt of user input by unit 110.
In an embodiment, GUI 508 is implemented using vector graphics-based animation files authored using software such as Macromedia® Flash™, published by Macromedia Inc. of San Francisco, Calif. The use of Flash™ files to implement GUI 508 provides distinct advantages over using more traditional programming languages, such as C. For example, development of GUI 508 is simpler and easier as compared to programming bit maps in C code. Furthermore, because Flash™ files are small, a complex GUI may be rendered smoothly and at very high speeds. Also, the use of Flash™ files provides a distinct separation between the presentation of GUI 508 and the underlying functionality, such that GUI 508 may be constructed, revised or upgraded without affecting underlying programs.
b. Video Engine
As shown in
Video compression is performed prior to transmitting video data to other video teleconferencing units. Conversely, video decompression is performed on compressed video data received from other video teleconferencing units, prior to display. In an embodiment, video compression and decompression is performed in accordance with the ITU-T H.263 standard, although the invention is not so limited.
In an embodiment, video engine 510 interfaces with GUI 508 to permit a user to perform video control functions, including configuring the video camera of unit 110. Alternately, video engine 510 may interface with a user interface provided by operating system 502 to perform such functions.
c. Audio Engine
As shown in
Audio encoding, and optionally compression, is performed prior to transmitting audio data to other conferencing units. Conversely, audio decoding, and optionally decompression, is performed on audio data received from other conferencing units, prior to play back. In an embodiment, audio encoding and decoding is performed in accordance with the ITU-T G.711 standard, and audio compression and decompression is performed in accordance with the ITU-T G.723 standard, although the invention is not so limited.
In an embodiment, audio engine 512 interfaces with GUI 508 to permit a user to perform audio control functions. Such audio control functions may include, for example, setting the audio volume level and/or setting the microphone gain level. Additionally, audio engine 512 may interface with GUI 508 to provide feedback to a user, such as providing a graphic indicator that indicates how much energy the microphone is picking up from a user's voice.
d. Multimedia Presentation Software
As shown in
However, these examples are not limiting, and the present invention may implement other multimedia presentation software, as will be appreciated by persons skilled in the relevant art(s).
e. Multimedia Presentation Software Interface
As shown in
When unit 110 is engaged in a video teleconference with a remote system that is the same as unit 110, multimedia presentation software interface 514 also interacts with multimedia presentation software residing on the remote system.
In accordance with this peer-to-peer network configuration, multimedia presentation software interface 514 provides the remote system with a copy of the multimedia presentation data prior to initiation of the presentation during a real-time video teleconference. After receiving the multimedia presentation data, the remote system caches it until such time as the presentation begins. When the presentation begins, unit 110 need only send low-bandwidth control signals to the remote system, such as a command to display the next slide, to control the delivery of the presentation to the remote system. Because the presentation data that is being processed by the remote system has already been stored locally with respect to the remote system, this method results in improved viewing of the presentation at the remote system. Thus, the performance of a video teleconference concurrently with the delivery of high or medium bandwidth intensive presentations in real time may be achieved with little or no degradation in the quality of the video teleconference or the presentation at local or remote sites.
In further accordance with this technique, unit 110 can advantageously send low-bandwidth control signals to the remote system to interact with a portion of the presentation even before the entire presentation has been downloaded to the remote system. For example, assume that a presentation comprises a first series of slides that have been completely downloaded to a remote system and a second series of slides that remain to be downloaded. In accordance with an embodiment of the present invention, unit 110 sends control signals to control the presentation of the first series of slides to the remote system prior to, or concurrently with, the downloading of the remainder of the presentation.
f. Call Control Software
As shown in
g. Web Server
As shown in
h. Archive and Retrieval Software
As shown in
D. Remote/Wireless Access and Control
Embodiments of the present invention provide various methods for easy remote and/or wireless access and control of integrated video teleconferencing and multimedia presentation unit 110. These methods include remote access and control via a packet-switched network, such as the Internet, as well as wireless local control by a handheld device, such as a personal digital assistant (PDA). Each of these methods will now be described.
In order to achieve this type of remote access, unit 110 is assigned an IP address, which is assigned either by an external network entity via Dynamic Host Configuration Protocol (DHCP) or may comprise a static IP address. In either case, the IP address is displayed by unit 110 via its GUI after it has been assigned so that it may be viewed by other remotely-connected video teleconferencing systems. By typing this IP address into a Web server, remote users can then access and interact with unit 110 via a Web server, such as Web server 518 described above in reference to
In accordance with an embodiment of the invention, unit 110 permits the user of remote computer system 904 to conveniently upload and download multimedia presentation data to and from unit 110, as well as download archived conference data from unit 110. The user of remote computer system 904 may also perform remote control functions, such as initiating, controlling or terminating a multimedia presentation stored on unit 110, commanding unit 110 to record a conference, or adjusting the camera of unit 110. Furthermore, the user of remote computer system 904 may perform remote monitoring functions, including determining the operating status of unit 110 (e.g., how much storage space is remaining, whether a conference is occurring, the amount of conference time elapsed, and the like). Additionally, the user of remote computer system 904 may perform remote maintenance functions, such as delivering software upgrades and patches to unit 110.
Handheld device 1004 runs a proprietary software application that utilizes the IP address of unit 110 to directly access unit 110 over wireless network 1002. The proprietary software application provides a GUI for receiving user input, interprets such input to generate one or more user commands, and then transmits those commands out via wireless network 1002 to unit 110, which receives and processes them. Control functions that may be carried out in this manner include any of the functions that could normally be carried out by using the touch-screen display of unit 110, including but not limited to setting up, initiating, operating, and recording a video teleconference and/or multimedia presentation, configuring and controlling the video camera, microphone and speakers of unit 110, altering the display configuration, and configuring aspects of video engine 510 or audio engine 512.
In the above-described embodiment, handheld device 1004 directly accesses and controls unit 110. In an alternate embodiment of the present invention, unit 110 is installed as part of a network, such as an office network, and handheld device 1004 communicates indirectly with unit 110 through a central network server. For example, commands entered into handheld device 1004 are sent by handheld device 1004 to the central server, which forwards them to unit 110. An example central network server that may be used to implement such an embodiment is described in co-pending patent application Ser. No. 10/180,500, filed Jun. 27,2002 and entitled “Method, System and Computer Program Product for Managing Controlled Residential or Non-residential Environments,” the entirety of which is incorporated by reference herein. In accordance with this network configuration, handheld device 1004 can control a variety of different devices that are connected to the network, including unit 110, via the central server.
In further accordance with this embodiment, when unit 110 is connected to the network, the central server automatically detects its presence on the network and communicates information concerning unit 110 to PDA 1004. In response, the GUI of handheld device 1004 provides a control icon for unit 110 that permits a user to control unit 110. Conversely, when unit 110 is no longer available on the network, the central server automatically detects its absence and communicates information concerning its absence to handheld device 1004. In response, the GUI of handheld device 1004 reconfigures itself to reflect this fact.
E. Archive and Retrieval of Conference Data
Embodiments of the present invention provide an easy method for recording, archiving and retrieving recorded video teleconferences and/or multimedia presentations. In particular, as discussed above in reference to
In an embodiment, the storage system may comprise one or more CD-RW or DVD-RW drives internal to unit 110. Alternately, the storage system may comprise external systems, including but not limited to network attached storage (NAS) and/or a storage area network (SAN).
F. Conclusion
While various embodiments of the present invention have been described above, it should be understood that they have been presented by way of example only, and not limitation. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. Accordingly, the breadth and scope of the present invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.
Number | Name | Date | Kind |
---|---|---|---|
5363482 | Victor et al. | Nov 1994 | A |
5471318 | Ahuja et al. | Nov 1995 | A |
5475421 | Palmer et al. | Dec 1995 | A |
5532937 | Graziano et al. | Jul 1996 | A |
5608872 | Schwartz et al. | Mar 1997 | A |
5613032 | Cruz et al. | Mar 1997 | A |
5617539 | Ludwig et al. | Apr 1997 | A |
5630067 | Kindell et al. | May 1997 | A |
5736968 | Tsakiris | Apr 1998 | A |
5764982 | Madduri | Jun 1998 | A |
5767897 | Howell | Jun 1998 | A |
5808662 | Kinney et al. | Sep 1998 | A |
5812552 | Arora et al. | Sep 1998 | A |
5822525 | Tafoya et al. | Oct 1998 | A |
5828839 | Moncreiff | Oct 1998 | A |
5838912 | Poon et al. | Nov 1998 | A |
5844979 | Raniere et al. | Dec 1998 | A |
5872923 | Schwartz et al. | Feb 1999 | A |
5896565 | Miller | Apr 1999 | A |
5931906 | Fidelibus et al. | Aug 1999 | A |
5943046 | Cave et al. | Aug 1999 | A |
5963547 | O'Neil et al. | Oct 1999 | A |
5968120 | Guedalia | Oct 1999 | A |
6073192 | Clapp et al. | Jun 2000 | A |
6091408 | Treibitz et al. | Jul 2000 | A |
6108687 | Craig | Aug 2000 | A |
6144848 | Walsh et al. | Nov 2000 | A |
6151619 | Riddle | Nov 2000 | A |
6161137 | Ogdon et al. | Dec 2000 | A |
6195683 | Palmer et al. | Feb 2001 | B1 |
6209021 | Ahimovic et al. | Mar 2001 | B1 |
6212547 | Ludwig et al. | Apr 2001 | B1 |
6233428 | Fryer | May 2001 | B1 |
6249281 | Chen et al. | Jun 2001 | B1 |
6278478 | Ferriere | Aug 2001 | B1 |
6285391 | Shibata et al. | Sep 2001 | B1 |
6314569 | Chemock et al. | Nov 2001 | B1 |
6317777 | Skarbo et al. | Nov 2001 | B1 |
6320588 | Palmer et al. | Nov 2001 | B1 |
6321252 | Bhola et al. | Nov 2001 | B1 |
6343313 | Salesky et al. | Jan 2002 | B1 |
6349286 | Shaffer et al. | Feb 2002 | B2 |
6351762 | Ludwig et al. | Feb 2002 | B1 |
6356943 | Murray et al. | Mar 2002 | B2 |
6369847 | James et al. | Apr 2002 | B1 |
6397251 | Graf | May 2002 | B1 |
6404928 | Shaw et al. | Jun 2002 | B1 |
6417933 | Szurkowski | Jul 2002 | B1 |
6421706 | McNeill et al. | Jul 2002 | B1 |
6480584 | Duran et al. | Nov 2002 | B2 |
6532218 | Shaffer et al. | Mar 2003 | B1 |
6563914 | Sammon et al. | May 2003 | B2 |
6577324 | Palmer et al. | Jun 2003 | B1 |
6598075 | Ogdon et al. | Jul 2003 | B1 |
6629107 | Ouchi et al. | Sep 2003 | B1 |
RE38284 | Allen et al. | Oct 2003 | E |
6654814 | Britton et al. | Nov 2003 | B1 |
6728753 | Parasnis et al. | Apr 2004 | B1 |
6728784 | Mattaway | Apr 2004 | B1 |
7035897 | Devereaux et al. | Apr 2006 | B1 |
7102643 | Moore et al. | Sep 2006 | B2 |
20010029457 | Shaffer et al. | Oct 2001 | A1 |
20010042096 | Ichiyoshi | Nov 2001 | A1 |
20020019845 | Hariton | Feb 2002 | A1 |
20020023081 | Bazan et al. | Feb 2002 | A1 |
20020080280 | Champion et al. | Jun 2002 | A1 |
20020087333 | Chen | Jul 2002 | A1 |
20020087638 | Rhee et al. | Jul 2002 | A1 |
20020091768 | Balasubramanian | Jul 2002 | A1 |
20020091769 | Drozdzewicz et al. | Jul 2002 | A1 |
20020091771 | Agraharam et al. | Jul 2002 | A1 |
20020095460 | Benson | Jul 2002 | A1 |
20020095462 | Beck et al. | Jul 2002 | A1 |
20020103864 | Rodman et al. | Aug 2002 | A1 |
20020116462 | DiGiano et al. | Aug 2002 | A1 |
20020149617 | Becker | Oct 2002 | A1 |
20020168621 | Cook et al. | Nov 2002 | A1 |
20030005462 | Broadus et al. | Jan 2003 | A1 |
20030080999 | Stone et al. | May 2003 | A1 |
20030090506 | Moore et al. | May 2003 | A1 |
20030105650 | Lombardo et al. | Jun 2003 | A1 |
20030110218 | Stanley | Jun 2003 | A1 |
20030118167 | Sammon et al. | Jun 2003 | A1 |
20030140348 | Stewart | Jul 2003 | A1 |
20030172174 | Mihalcheon | Sep 2003 | A1 |
20030233417 | Beyda et al. | Dec 2003 | A1 |
20040086093 | Schranz | May 2004 | A1 |
20040095461 | Monagahn et al. | May 2004 | A1 |
20040172658 | Rakib et al. | Sep 2004 | A1 |
20040203708 | Khan et al. | Oct 2004 | A1 |
20050277872 | Colby et al. | Dec 2005 | A1 |
Number | Date | Country |
---|---|---|
06169456 | Jun 1994 | JP |
2000224557 | Aug 2000 | JP |
2000341659 | Dec 2000 | JP |
2002223423 | Aug 2002 | JP |
02262251 | Sep 2002 | JP |
Number | Date | Country | |
---|---|---|---|
20040098456 A1 | May 2004 | US |
Number | Date | Country | |
---|---|---|---|
60426823 | Nov 2002 | US |