1. Field of the Invention
The present invention relates generally to conferencing systems and, more specifically, to video/speakerphone conferencing systems.
2. Description of the Related Art
Speakerphones are used in many types of telephone calls, and particularly, in conference calls between multiple people at various locations. Typically, speakerphones have several microphones to pick up voices of participants at a first location, and at least one speaker to present sound from voices of participants in a second location. A speakerphone may detect sound in a first location and send a signal over a network (e.g., a Plain Old Telephone Service (POTS) network) to another phone (e.g., another speakerphone) that may reproduce the sound in the second location. The other speakerphone may produce the sound over a speaker for multiple participants in the second location to hear. Other speakerphones in other locations may also be connected to the call.
A video conferencing system may also be used to transmit signals for sound and visual images of participants at a first location to one or more video conferencing systems in other locations. However, controlling the video conferencing system may be difficult. For example, controls for the video conference system may be restricted to the video conferencing system only.
In various embodiments, a speakerphone and/or remote control may be used to control a video conferencing system through a system codec. In some embodiments, video conferencing features may be provided through the speakerphone and/or remote control. For example, features to manage video calls, audio calls, and bridging multiple video and/or audio calls into a single conference may be accessed through a keypad on the speakerphone, a remote control, and/or through a video conference system. Options and indicators may be provided on a screen of the speakerphone and/or video conferencing system.
In some embodiments, a video call may be dialed, redialed, muted, answered, added to an existing conference, and/or terminated using a speakerphone and/or remote control. In some embodiments, a call length timer may be implemented, the volume may be adjusted, or a camera may be adjusted through a speakerphone and/or remote control.
In some embodiments, a context sensitive consult feature may be used when adding new outgoing or incoming calls. In some embodiments, the context sensitive consult feature may be used to consult new callers in a separate conference and then optionally add the new callers to an existing conference.
In some embodiments, options and indicators may be displayed on the video conference screen. In some embodiments, phone number panels may have numbers listed that are currently connected in the conference call. A “Hang up all” option may be selected to hang up all of the numbers. A “Hang up voice” option may be selected to hang up the voice callers. A “Hang up video” option may be selected to hang up the video callers. An “Add call” option may be selected to dial another number to add to the conference call. In some embodiments, an icon may be used to indicate on the screen which camera is being used.
In some embodiments, when a call is received, an incoming call panel with options to “Answer” the call or “Ignore the call”. In some embodiments, information about the incoming call may be displayed (e.g., in panel). Other options and information may also be used. In some embodiments, the number of the incoming call may also be displayed (not shown).
In some embodiments, additional options may be provided. For example, an “Answer” option may answer the incoming call. The “Consult” option may answer the call but not join it to a current conference. An “Ignore call” option may be selected to ignore the call. A “Do not disturb” option may be selected to ignore all future calls until the current call is ended (or, for example, a certain amount of time passes). In some embodiments, if a “Consult” option is selected and the incoming call is over the speakerphone, a “Voice only consult” message may be displayed.
A better understanding of the present invention may be obtained when the following detailed description is considered in conjunction with the following drawings, in which:
a and 3b illustrates a speakerphone and video conferencing system used together with an accompanying memory medium, according to an embodiment;
a and 4b illustrate numeric keypads for a speakerphone, according various embodiments;
While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the drawings and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present invention as defined by the appended claims. Note, the headings are for organizational purposes only and are not meant to be used to limit or interpret the description or claims. Furthermore, note that the word “may” is used throughout this application in a permissive sense (i.e., having the potential to, being able to), not a mandatory sense (i.e., must). The term “include”, and derivations thereof, mean “including, but not limited to”. The term “coupled” means “directly or indirectly connected”.
U.S. Provisional Patent Application titled “Speakerphone”, Ser. No. 60/619,303, which was filed Oct. 15, 2004, whose inventors are William V. Oxford, Michael L. Kenoyer, and Simon Dudley is hereby incorporated by reference in its entirety as though fully and completely set forth herein.
U.S. Provisional Patent Application titled “Speakerphone”, Ser. No. 60/634,315 which was filed Dec. 8, 2004, whose inventors are William V. Oxford, Michael L. Kenoyer and Simon Dudley which is hereby incorporated by reference in its entirety as though fully and completely set forth herein.
U.S. Provisional Patent Application titled “Video Conference Call System”, Ser. No. 60/619,210, which was filed Oct. 15, 2004, whose inventors are Jonathan W. Tracey, Craig B. Malloy, Michael L. Kenoyer, Michael V. Jenkins, Ashish Goyal, and Michael J. Burkett, is hereby incorporated by reference in its entirety as though fully and completely set forth herein.
U.S. Provisional Patent Application titled “High Definition Camera and Mount”, Ser. No. 60/619,227, which was filed Oct. 15, 2004, whose inventors are Michael L. Kenoyer, Patrick D. Vanderwilt, Paul D. Frey, Paul Leslie Howard, Jonathan I. Kaplan, and Branko Lukic, is hereby incorporated by reference in its entirety as though fully and completely set forth herein.
In various embodiments, a video conference system may be controlled by a speakerphone and/or remote control. In some embodiments, the speakerphone may be coupled to a system codec 309 to control the video conference system. While the speakerphone may be used separately, the speakerphone may also be used in conjunction with the video conference system.
As seen in
In some embodiments, the speakerphone 101 may communicate with a system codec 309 (or other system interface) over an interface such as an Ethernet cable between the speakerphone 101 and the system codec 309. For example, the speakerphone 101 may communicate with the system codec 309 to indicate which button(s) the user has pressed on the speakerphone 101. The system may then implement a functionality that corresponds to the pressed button. In some embodiments, a driver on the speakerphone 101 may facilitate communication with the video conferencing system through the system codec 309. For example, the driver on the speakerphone 101 may communicate over the Ethernet cable with the system codec 309 using Linux™ named pipes. Other communication mediums and transmission protocols may also be used (e.g., the speakerphone may communicate with the system codec 309 over a wireless connection).
In some embodiments, speakerphones may also communicate with other devices coupled to the speakerphone (e.g., a daisychained speakerphone). For example, speakerphones may pass messages over an Ethernet cable coupling the speakerphones in order to synchronize their processor clocks (this may allow the clock synchronization to be fine tuned for better echo cancellation). Other information may also be communicated from the speakerphone. In some embodiments, the speakerphones may transmit an audio signal over the Ethernet cable through a User Datagram Protocol (UDP) (other protocols are also contemplated).
In some embodiments, the system codec 309 may maintain a preferences database 335 (e.g., on a memory medium 331 in the system codec 309 as seen in
In some embodiments, a daisy chained speakerphone may also be notified that the mute button was pressed. Both speakerphones may then be muted (or each may be muted separately). In addition, pressing the mute button on one of the speakerphones may also mute the video conferencing system. The database may be accessed by other processors and other system repositories. In some embodiments, the database may have a hierarchy (e.g., similar components may be stored in the same category). Devices may have standing requests to be notified anytime any component/function in a certain category has changed. For example, the mute light may be in a category with other system lights (e.g., Lights: Speakerphone: Mute). A component with a standing request to be notified if the status of a component/function in the light category changes may be notified if the mute light status changes.
In some embodiments, the speakerphone 101 may be a general purpose speakerphone and may be a slave device to the system codec. In some embodiments, the speakerphone may be powered over ethernet (POE ethernet). In some embodiments, adaptors may be used to power the speakerphone over Ethernet. The system codec may produce the POE power over the Ethernet. In some embodiments, the speakerphone and system codec may perform handshaking so the system codec knows when the speakerphone is connected.
a and 4b illustrate embodiments of a speakerphone keypad. As seen in
Several embodiments are described below.
At 601, a user may dial a phone number on the speakerphone numeric keypad 401 (as seen in
At 603, the system may display or sound an indicator for each dialed number at the speakerphone.
At 605, the system may display the dialed numbers in the speakerphone display 405.
At 607, the user may press the video call button 407 or voice call button 409 on the speakerphone (depending on the type of call being made).
At 609, the system may set the video call or voice call button indicator to “on”. For example, a light may illuminate the video call 407 or voice call button 409 to indicate “on”. In some embodiments, an indicator in the speakerphone display 405 may be activated.
At 611, the system may set the speakerphone audio mute indicator to “live”. For example, when the speakerphone audio mute indicator is “live”, the mute button may not be illuminated. In some embodiments, a symbol (not shown) may appear on the speakerphone display 405 to indicate whether the mute feature is currently enabled.
At 613, if the call is a video call, the system may display a dialing video call screen in the on-screen display (i.e., the video screen display).
At 615, the system may sound an appropriate dial tone and/or touch tone for the dialed number at the appropriate location (e.g., speakerphone or endpoint). In some embodiments, different tones may be sounded from the speakerphone for different buttons.
At 617, the system may connect the call.
At 619, if the call is a video call, the system may display a video call screen in the on-screen display.
At 621, if the call is a voice call, the on-screen display may remain off.
At 623, the system may display a call length timer in the speakerphone display 405. For example, a timer may appear on the speakerphone display 405 and may increment upward as the call progresses. In some embodiments, the time may time out or “pop” at a preset time. The call may be ended or confirmation to continue the call may be requested when the timer times out (e.g., at a predetermined time).
At 625, the user may conduct the call.
At 701, a user may press the video call button 407 on the speakerphone.
At 703, the system may set the speakerphone video call button indicator to “on”.
At 705, the system may sound a video dial tone at the endpoint. In some embodiments, the video dial tone may sound different than the dial tone for an audio call. In some embodiments, the dial tone for an audio call and video call may be sounded through the speakerphone. In some embodiments, each may be sounded through their respective systems (e.g., audio call dial tone through speakerphone and video call dial tone through the video conference system).
At 707, the system may set the speakerphone audio mute indicator to “live”.
At 709, the system may display a “video call” message in the speakerphone display 405.
At 711, the system may display an initial video call screen in the speakerphone display 405.
At 713, the user may dial a phone number on the speakerphone numeric keypad 471.
At 715, the system may stop sounding the video dial tone.
At 717, the system may sound a touch tone for each dialed number at the endpoint.
At 719, the system may display dialed numbers in the speakerphone display 405.
At 721, the system may display dialed numbers in the on-screen display.
At 723, the system may connect the call.
At 725, the system may display a video call screen in the on-screen display.
At 727, the system may display a call length timer in the speakerphone display 405.
At 729, the user may conduct the video call.
At 801, the user may press the voice call button 409 on the speakerphone.
At 803, the system may set the speakerphone voice call button indicator to “on”. For example, as seen in
At 805, the system may sound a voice dial tone at the speakerphone.
At 807, the system may set a speakerphone audio mute indicator to “live”.
At 809, the system may display a voice call message in the speakerphone display 405. For example, as seen in
At 811, the on screen display (i.e., the video screen display) may remain off.
At 813, the user may dial the phone number on the speakerphone numeric keypad 301.
At 815, the system may stop sounding the voice dial tone.
At 817, the system may sound touch tone for each dialed number at the speakerphone.
At 819, the system may display dialed numbers in speakerphone display 405. As seen in
At 821, the system may connect the call.
At 823, the system may display a call length timer in the speakerphone display 405.
At 825, the user may conduct the voice call. In some embodiments, the user may press add to add another caller to the voice call. For example, the added call may be a video call. A video call indicator may appear in the speakerphone display 405 to indicate that a video call is also connected. In some embodiments, a caller, such as a video caller may be consulted separately instead of being added to the call. For example, after a number is dialed for a separate call, a user may choose not to add the call to the conference call, but may instead consult the separate caller and then terminate the call before rejoining the conference call. In some embodiments, adding another line may be supported for a private branch exchange (PBX) which may include a private telephone switchboard. Other PBX functions may also be supported through the speakerphone.
In some embodiments, a user may press the add video button (or voice button), dial a number and be connected without using a consult feature (e.g., the other connected callers may hear what is taking place.)
At 1101, the user may press the redial button 411.
At 1103, the system may display an appropriate call screen in the on-screen display (video only).
At 1105, the system may dial a phone number found in the contact.
At 1107, the system may set the speakerphone video call or voice call button indicator to “on” (depending on the type of call).
At 1109, the system may set the speakerphone audio mute indicator to “live”.
At 1111, the system may sound an appropriate dial tone (e.g., a video or voice dial tone) and touch tones for a dialed number at an appropriate location (endpoint or speakerphone).
At 1113, the system may display the dialed numbers in the speakerphone display 405.
At 1115, the system may display the dialed numbers in the on-screen display (video only).
At 1117, the system may connect the call.
At 1119, if a video call, the system may display a video call screen in the on-screen display.
At 1121, if a voice call, the system may mute the video monitor.
At 1123, the system may display a call length timer in the speakerphone display 405.
At 1125, the user may conduct the video call.
At 1201, the system may detect an incoming video call.
At 1203, the system may set a speakerphone video call button indicator to “ring”. For example, a light illuminating the video call button may blink. In some embodiments, an indicator may appear on the on screen display to indicate a video call “ring”.
At 1205, the system may display a video call message in the speakerphone display 405.
At 1207, the system may display an incoming call screen in the on-screen display.
At 1209, the system may sound a video call ring tone at the endpoint.
At 1211, the user may press a video call button 407 on the speakerphone.
At 1213, the system may set the speakerphone video call button indicator to “on”.
At 1215, the system may set the speakerphone audio mute indicator to “live”.
At 1217, the system may stop sounding the video call ring tone.
At 1219, the system may connect the call.
At 1221, the system may display a video call screen in the on-screen display.
At 1223, the system may display a call length timer in the speakerphone display 405.
At 1225, the user may conduct the video call.
At 1301, the system may detect an incoming voice call.
At 1303, the system may set the speakerphone voice call button indicator to “ring”. For example, a light illuminating the voice call button may blink. In some embodiments, an indicator may appear on the speakerphone display 405 to indicate a voice call “ring”.
At 1305, the system may display a voice call message in the speakerphone display 405.
At 1307, the system may sound a voice call ring tone at the speakerphone.
At 1309, the user may press a voice call button 409 on the speakerphone.
At 1311, the system may set a speakerphone voice call button indicator to “on”.
At 1313, the system may set a speakerphone audio mute indicator to “live”.
At 1315, the system may stop playing voice call ring tone.
At 1317, the system may connect the call.
At 1319, the on-screen display may remain off.
At 1321, the system may display a call length timer in the speakerphone display 405.
At 1323, the user may conduct the voice call.
At 1401, a user may press the video call button on the speakerphone.
At 1403, the system may disconnect the call.
At 1405, the system may set speakerphone video call button indicator to “off”.
At 1407, the system may set speakerphone audio mute indicator to “off”.
At 1409, the system may display the default message in the speakerphone display 405.
At 1411, the system may mute the video monitor.
At 1501, a user may press the voice call button 409 on the speakerphone.
At 1503, the system may disconnect the call.
At 1505, the system may set the speakerphone voice call button indicator to “off”.
At 1507, the system may set the speakerphone audio mute indicator to “off”.
At 1509, the system may display the default message in the speakerphone display 405.
At 1601, the system may detect a video call termination.
At 1603, the system may set the speakerphone video call button indicator to “off”.
At 1605, the system may set the speakerphone audio mute indicator to “off”.
At 1607, the system may display the default message in the speakerphone display 405.
At 1609, the system may display the main call screen in the on screen display.
At 1701, the system may detect voice call termination.
At 1703, the system may set a speakerphone voice call button indicator to “off”. For example, a light behind the speakerphone voice call button 409 may be turned off. In some embodiments, as seen in
At 1705, the system may set a speakerphone audio mute indicator to “off”.
At 1707, the system may display a default message indicating no active call in the speakerphone display 405.
At 1901, the system video call length timer may pop. For example, the call length time may pop after a call length time of approximately 8 hours. The call length timer may be used to terminate a call if a user forgets to hang up the call.
At 1903, the system may display continue call dialog in the on-screen display.
At 1905, the user may pick up the remote control 501.
At 1907, the system may enable the on screen display.
At 1909, if the user confirms call continue, the system may reset the call length timer.
At 1911, if the user cancels call continue, the system may terminate the call.
At 2001, the user may press any mute button (e.g., the mute button 413 on the speakerphone, attached to the microphone pods, or the mute button 503 on the remote control 501).
At 2003, the system may stop transmitting audio from local endpoint inputs.
At 2005, the system may set speakerphone audio mute indicator to “muted”. For example, as shown in
At 2007, the system may set the speakerphone and microphone pods mute button indicator to “muted”.
At 2009, the system may display near audio mute indicator in the on screen display (video call).
At 2201, a user may press any mute button on the speakerphone, attached microphone pods, or the remote control 501.
At 2203, the system may resume transmitting audio originating from local endpoint inputs.
At 2205, the system may set speakerphone audio mute indicator to “live”.
At 2207, the system may set speakerphone and microphone pods mute button indicator to “off”.
At 2209, the system may remove near mute indicator in on-screen display (video call).
At 2301, a user may press a volume up 315 or volume down button 317 on the speakerphone or the remote control (volume up 505, volume down 507).
At 2303, the system may increase or decrease the volume accordingly.
At 2305, the system may display the current volume in the speakerphone display 405. For example, as seen in
At 2307, the system may display the current volume in the on screen display (video call).
At 2309, the system may wait for timeout.
At 2311, the system may put a default message, indicating the timeout, in the speakerphone display 405.
At 2313, the system may remove the volume indicator in the on-screen display (video call).
At 2501, a user may press the add/conference button 319 on the speakerphone. The add/conference button 319 may be pressed during a voice only call (as seen in
At 2503, the system may set video call and voice call button indicators to “off”.
At 2505, the system may set conference button indicator to “on”.
At 2507, the system may place current conference on hold. In some embodiments, the current conference participants may continue with the conference.
At 2509, the system may display the make conference message in speakerphone display 405. For example, as seen in
At 2511, a user may initiate a new call. When the new participant connects, the user may have an isolated consult (i.e., isolated from the other conference).
At 2513, the system may set conference button indicator to “add”. For example, an add portion of the conference button 319 may be illuminated.
At 2515, the system may display add to conference message in the speakerphone display 405.
At 2517, a user may visually/aurally confirm a new connection with the other end of the call. For example, as seen in
At 2519, if the user wants to add a new call, the user may press the conference button 319 on the speakerphone and the system may add the new call to conference. For example, if the user is on a voice call and adds a video call, the resulting screen may show both a voice and video call connected to the conference (as seen in
At 2521, if the user wants to terminate the new call before adding to the conference, the user may press the video call 407 or voice call button 409 appropriately and the system may disconnect the new call.
At 2523, the system may take the conference off hold.
At 3101, the system may detect an incoming call.
At 3103, if in a video call, the system may display the incoming call dialog in the on-screen display.
At 3105, the user may accept the incoming call, and the system may place the current conference on hold.
At 3107, the system may set the conference button indicator to “add”.
At 3109, the system may display an add to conference message in the speakerphone display 405.
At 3111, the user may visually/aurally confirm the new connection.
At 3113, if user wants to add the new call, then the user may press the conference button 319 on the speakerphone, and the system may add the new call to the conference.
At 3115, if the user wants to terminate the new call before adding to the new conference, the user may press the video call 407 or voice call button 409 appropriately, and the system may disconnect the new call.
At 3117, the system may take the conference off hold.
At 3201, a user may press the video call button on the speakerphone.
At 3203, the system may display a terminate call confirmation in the on-screen display.
At 3205, the system may display a terminate call message in the speakerphone display 405.
At 3207, the user may press the video call button 407 on the speakerphone to confirm termination.
At 3209, the system may disconnect the call, including voice connections.
At 3211, the system may set the speakerphone video call button indicator to “off”.
At 3213, the system may set the speakerphone audio mute indicator to “off”.
At 3215, the system may display the default message in the speakerphone display 405.
At 3217, the system may mute the video monitor.
At 3301, the user may pick up the remote control.
At 3303, the system may enable on-screen display.
At 3305, the user may press the CALL button on the remote control.
At 3307, the system may display main call screen in on-screen display.
At 3309, the user may select the make video call on-screen option.
At 3311, the system may display video call screen in on-screen display.
At 3313, the system may display video call message in speakerphone display.
At 3315, the user may dial phone number on the remote control numeric keypad.
At 3317, the system may display dialed numbers in speakerphone display.
At 3319, the system may display dialed numbers in on-screen display.
At 3321, the user may press DPAD_ENTER or CALL button on the remote to initiate the call.
At 3323, the system may set speakerphone video call button indicator to “on”.
At 3325, the system may set speakerphone audio mute indicator to “live”.
At 3327, the system may play video dial tone and touch tons for dialed number at the endpoint.
At 3329, the system may connect call.
At 3331, the system may display video call screen in the on-screen display.
At 3333, the system may display call length timer in the speakerphone display At 3335, the user may conduct the video call.
At 3401, the user may pick up the remote control.
At 3403, the system may enable on-screen display.
At 3405, the user may press the CALL button on the remote control.
At 3407, the system may display main call screen in on-screen display.
At 3409, the user may select the make voice call on-screen option.
At 3411, the system may display voice call screen in on-screen display.
At 3413, the system may display voice call message in speakerphone display.
At 3415, the user may dial phone number on the remote control numeric keypad.
At 3417, the system may display dialed numbers in speakerphone display.
At 3419, the system may display dialed numbers in on-screen display.
At 3421, the user may press DPAD_ENTER button on the remote control to initiate the call.
At 3423, the system may set speakerphone voice call button indicator to “on”.
At 3425, the system may set speakerphone audio mute indicator to “live”.
At 3427, the system may play voice dial tone and touch tones for dialed number at the speakerphone.
At 3429, the system may connect call.
At 3431, the system may mute video monitor.
At 3433, the system may display call length timer in the speakerphone display.
At 3435, the user may conduct voice call.
At 3501, the user may pick up the remote control.
At 3503, the system may enable the on-screen display.
At 3505, the user may press the CALL button on the remote control.
At 3507, the system may display the main call screen in on-screen display.
At 3509, the user may select a call to redial.
At 3511, the system may display appropriate call screen in on-screen display (voice or video).
At 3513, the system may dial a phone number found in the redial data.
At 3515, the system may play appropriate dial tone and touch tones for dialed number in appropriate location (endpoint or speakerphone) At 3517, the system may set speakerphone VIDEO_CALL or VOICE_CALL button indicator to “on” (depending on the type of call).
At 3519, the system may set speakerphone audio mute indicator set “live”.
At 3521, the system may display dialed numbers in speakerphone display.
At 3523, the system may display dialed numbers in on-screen display.
At 3525, the system may connect call.
At 3527, if a video call, the system may display video call screen in the on-screen display.
At 3529, if a voice call, the system may mute the video and graphics monitors At 3531, the system may display call length timer in the speakerphone display At 3533, the user may conduct video call.
At 3601, the system may detect an incoming video call.
At 3603, the system may set speakerphone video call button indicator to “ring”.
At 3605, the system may display video call message in the speakerphone display.
At 3607, the system may display incoming call screen in the on-screen display.
At 3609, the system may play video call ring tone at the endpoint.
At 3611, the user may pick up the remote control.
At 3613, the system may enable the on-screen display.
At 3615, the user may press CALL or DPAD_ENTER button on the remote control.
At 3617, the system may set speakerphone VIDEO CALL button indicator to on”.
At 3619, the system may set speakerphone audio mute indicator to “live”.
At 3621, the system may stop playing video call ring tone.
At 3623, the system may connect the call.
At 3625, the system may display video call screen in the on-screen display.
At 3627, the system may display call length timer in the speakerphone display.
At 3629, the user may conduct video call.
At 3701, the system may detect an incoming voice call.
At 3703, the system may set speakerphone voice call button indicator to “ring”.
At 3705, the system may display voice call message in the speakerphone display.
At 3707, the system may play voice call ring tone at the speakerphone.
At 3709, the user may pick up the remote control.
At 3711, the system may display incoming call screen in the on-screen display.
At 3713, the user may press CALL or DPAD_ENTER button on the remote control.
At 3715, the system may set speakerphone voice call button indicator to “on”.
At 3717, the system may set speakerphone audio mute indicator to “live”.
At 3719, the system may stop playing voice call ring tone.
At 3721, the system may connect call.
At 3723, the system may mute video monitor.
At 3725, the system may display call length timer in the speakerphone display.
At 3727, the user may conduct voice call.
At 3801, the user may pick up the remote control.
At 3803, the system may enable the on-screen display.
At 3805, the user may press CALL button on the remote control.
At 3807, the system may display terminate call screen in the on-screen display.
At 3809, the user may confirm termination.
At 3811, the system may disconnect the call.
At 3813, the system may set speakerphone call button indicator to “off”.
At 3815, the system may set speakerphone audio mute indicator to “off”.
At 3817, the system may display the default message in the speakerphone display.
At 3819, the system may display main call screen in the on-screen display.
At 3901, the user may pick up the remote control.
At 3903, the remote control may send PICKED_UP IR code.
At 3905, the system may detect PICKED UP IR code.
At 3907, the system may enable the on-screen display by displaying the last screen to be displayed, enabling user input, and displaying the default navigable area of the screen.
At 4001, the user may put down the remote control.
At 4003, the remote control may send PUT-DOWN IR code (i.e., a signal that indicates the remote control has been placed on a surface).
At 4005, the system may detect PUT-DOWN IR code.
At 4007, the system may disable the on-screen display by disabling user input and unhighlighting the current navigable area.
At 4009, the on-screen display may remain displayed. In some embodiments, the display may be removed after the display depending on the behavior of a screen saver.
At 4101, the user may pick up the remote control.
At 4103, the system may enable the on-screen display.
At 4105, the user may press the CONF button on the remote control.
At 4107, the system may set VIDEO_CALL and VOICE_CALL button indicators to “off”.
At 4109, the system may set CONF button indicator to “on”.
At 4111, the system may place current conference on hold.
At 4113, the system may display the add call message in the speakerphone display.
At 4115, user may initiate a new call.
At 4117, the system may display add to conference message in the speakerphone display.
At 4119, the system may display add to conference dialog on-screen the display.
At 4121, the system may set CONF button indicator to “add”.
At 4123, the user may visually/aurally confirm new connection with other end.
At 4125, if user may wants to add a new call, then the user may press the CONF or DPAD_ENTER button on the remote control. The system may then add the new call to the conference.
At 4127, if user wants to terminate the new call before adding to conference, the user may select the cancel conference add on-screen option. The system may then disconnect the new call.
At 4129, the system may take the conference off hold.
At 4201, the system may detect an incoming call.
At 4203, the user may answer the incoming call. If the user answers the call during a video conference call, an incoming call dialog may be displayed for-incoming audio calls. The system may place current conference on hold.
At 4205, the system may set CONF button indicator to “add”.
At 4207, the system may display add to conference message in the speakerphone display.
At 4209, the system may display add to conference dialog in the on-screen display.
At 4211, the user may visually/aurally confirm new connection.
At 4213, if the user may wants to add new call, then the user may press the CONF or DPAD_ENTER button on the remote control. The system may add a new call to the conference.
At 4215, if the user wants to terminate the new call before adding to conference, the user may select the cancel conference add on-screen option. The system may disconnect the new call.
At 4217, the system may take the conference off hold.
At 4301, the user may press VOLUME_UP or VOLUME_DOWN button on the speakerphone.
At 4303, the system may change the volume of the speakerphone up or down accordingly.
At 4305, the system may display the current volume in the speakerphone display.
At 4307, the system may wait for timeout.
At 4309, the system may put default message in the speakerphone display. In some embodiments, volume control may not be displayed in on-screen display.
At 4401, the user may press VOLUME_UP or VOLUME_DOWN button on the remote control.
At 4403, the system may change the volume of the endpoint up or down accordingly.
At 4405, the system may display the current volume in the on-screen display.
At 4407, the system may wait for timeout.
At 4409, the system may remove the volume indicator in the on-screen display. In some embodiments, the speakerphone display may remain unchanged.
At 4501, the user may pick up the remote control.
At 4503, the system may enable the on-screen display.
At 4505, the user may press a CALL button on the remote control.
At 4507, the system may display a terminate call screen in the on-screen display.
At 4509, the user may select a terminate individual on-screen option.
At 4511, the system may display a selectable list of all connections in the multipoint call.
At 4513, the user may select an individual call to terminate.
At 4515, the system may display a confirm termination dialog
At 4517, the user may confirm termination.
At 4519, the system may disconnect the call.
At 4521, the system may continue conference with remaining connected calls.
At 4601, the user may activate a device connected to a video input that has been designated as the secondary input.
At 4603, the system may detect the active input signal.
At 4605, the system may display the input on one of the monitors.
At 4607, the system may transmit input to far endpoint as the secondary stream if call connected.
At 4701, the user may pick up the remote control.
At 4703, the system may enable the on-screen display.
At 4705, the user may press the NEAR button.
At 4707, the system may set last controlled near camera as current controlled camera.
At 4709, the system may not change main video input.
At 4801, the user may pick up the remote control.
At 4803, the system may enable the on-screen display.
At 4805, the user may press the FAR button.
At 4807, the system may set last controlled far camera as current controlled camera.
At 4809, the system may not change main video input.
At 4901, the user may pick up the remote control.
At 4903, the system may enable the on-screen display.
At 4905, the user may press the FAR button.
At 4907, the system may highlight currently controlled far camera in the on-screen display.
At 4909, the user may navigate to another camera to control.
At 4911, the system may set highlighted camera as current controlled camera.
At 5001, the user may pick up the remote control.
At 5003, the system may enable the on-screen display.
At 5005, the user may press the DPAD_LEFT or DPAD_RIGHT buttons on the remote control.
At 5007, the system may pan the currently controlled camera left or right accordingly.
At 5101, the user may pick up the remote control.
At 5103, the system may enable the on-screen display.
At 5105, the user may presses the DPAD_UP or DPAD_DOWN button on the remote control.
At 5107, the system may-tilt the currently controlled camera up or down accordingly.
At 5201, the user may pick up the remote control.
At 5203, the system may enable the on-screen display.
At 5205, the user may press the ZOOM_IN or ZOOM_OUT button on the remote.
At 5207, the system may zoom the currently controlled camera accordingly.
At 5301, the user may pick up the remote control. In some embodiments, a call may be connected and the near camera may be controlled.
At 5303, the system may enable the on-screen display.
At 5305, the user may press the NEAR button on the remote control
At 5307, the system may display the near video input selections in the on screen display.
At 5309, the user may select on-screen near video input option.
At 5311, the system may hide near video input selections in the on-screen display.
At 5313, the system may change near video input accordingly.
At 5401, the user may pick up the remote control. In some embodiments, the video call may be connected and the far camera may be controlled in full-screen mode.
At 5403, the system may enable the on-screen display.
At 5405, the user may press the FAR button the remote control.
At 5407, the system may display far video input selections in the on-screen display.
At 5409, the user may select on-screen far video input option.
At 5411, the system may hide far video input selections in the on-screen display.
At 5413, the system may change far video input accordingly.
At 5501, the user may pick up the remote control.
At 5503, the system may enable the on-screen display.
At 5505, the user may press and release numeric keypad 1—numeric keypad 9 on the remote control.
At 5507, the system may set associated camera with preset pan/tilt/zoom setting.
At 5601, the user may pick up the remote control.
At 5603, the system may enable the on-screen display.
At 5605, the user may press and hold numeric keypad 1—numeric keypad 9 on the remote control.
At 5607, the system may store pan/tilt zoom setting of currently controlled camera as a preset location for the held button.
At 5609, the system may provide feedback that preset has been stored.
At 5701, the user may pick up the remote control.
At 5703, the system may enable the on-screen display.
At 5705, the user may press the numeric keypad 0 button on the remote control.
At 5707, the system may move the currently controlled camera to its “center” position.
At 5801, the user may press the numeric keypad 0 button speakerphone.
At 5803, the system may move the currently controlled camera to its “center” position.
At 5901, the user may press the POWER button on the endpoint.
At 5903, the system may terminate any connected calls.
At 5905, the system may put all speakerphone indicators into “off state.
At 5907, the system may put default message in speakerphone display.
At 5909, the system may park the camera.
At 5911, the system may mute the video monitor.
At 6001, the user may press the POWER button on the endpoint.
At 6003, the system may display main call screen in the on-screen display.
At 6101, the user may press and hold the POWER button the endpoint a number of seconds.
At 6103, the system may reboot.
At 6105, after restarting, the system may display the main call screen on the on-screen display.
At 6201, the user may pick up the remote control.
At 6203, the system may enable on-screen display.
At 6205, the user may press the CALL button on the remote control.
At 6207, the system may display main call screen in on-screen display.
At 6209, the user may select address book on screen option.
At 6211, the user may select a contact from address book to dial.
At 6213, the system may display an appropriate call screen in on-screen display (voice or video).
At 6215, the system may dial a phone number found in contact.
At 6217, the system may set a speakerphone video call or voice call button indicator to “on” (depending on the type of call).
At 6219, the system may set a speakerphone audio mute indicator to “live”.
At 6221, the system may play an appropriate dial tone and touch tones for dialed number at appropriate location (EP or speakerphone).
At 6223, the system may display dialed numbers in speakerphone display.
At 6225, the system may display dialed numbers in on-screen display.
At 6227, the system may connect call.
At 6229, if a video call, the system may display video call screen in the on-screen display.
At 6231, if a voice call, the system may mute the video monitor.
At 6233, the system may display call length timer in the speakerphone display.
At 6235, the user may conduct video call.
At 6301, the system may detect an abnormal video call termination.
At 6303, the system may set speakerphone VIDEO CALL button indicator to “off”.
At 6305, the system may set the speakerphone audio mute indicator to “off”.
At 6307, the system may display reconnect dialog in on-screen display.
At 6309, the user may pick up the remote control.
At 6311, the system may enable the on-screen display.
At 6313, if user confirms reconnect, system may redial number.
At 6315, if user cancels reconnect, system may display the main call screen.
At 6711, the camera may be panned, tilted, and/or zoomed to a position a user wants to have as a preset position.
At 6713, the user may press and hold the numeric keypad 1—numeric keypad 9 on the speakerphone. In some embodiments, instead of holding down a numeric keypad number, a separate button (not shown) may be pressed prior to pressing a numeric keypad number.
At 6715, the system may store pan/tilt/zoom setting of currently controlled camera as a preset location for the held button.
At 6717, the system may provide feedback that preset has been stored. For example, an audible signal may be given and the user may stop holding down the numeric keypad 1.
At 6501, the user may press and release the numeric keypad 1—numeric keypad 9 on the speakerphone. In some embodiments, a camera move button (not shown) may be pressed prior to pressing the numeric keypad button to indicate the user wants to move the camera to a preset position.
At 6503, the system may move the associated camera to the preset pan/tilt/zoom setting.
At 6601, a user may press the numeric keypad 0 button on the speakerphone. In some embodiments, a camera move button (not shown) may be pressed prior to pressing the numeric keypad 0 to indicate the user wants to move the camera.
At 6603, the system may move the currently controlled camera to its “center” position.
In various embodiments, other features may be incorporated into the speakerphone. For example, the speakerphone buttons may flash to suggest to a user which button to press next. In some embodiments, the button may be illuminated and then may slowly fade out. Other indicators to the user of which button to press next are also contemplated.
In some embodiments, the remote control may have sensors (e.g., capacitive sensors) that detect if the remote control has been lifted off of the table. A chip set on the remote control may auto calibrate the sensors to determine what type of surface the remote control has been placed on. In addition, there may be multiple sensors on the bottom of the remote control. This may be helpful in case the user picks up the remote and covers one of the sensors (the remote may know that the remote has not been placed on the table unless both sensors register a hard surface). When the remote is detected picked up, a video menu may be presented on the screen.
Embodiments of other functions that may be supported are listed in the following table:
In some embodiments, the video menu (and symbols, shapes, etc. of the menu) may be alpha blended into view, faded in/out, may be translucent, etc. For example, video processing for the screens may use multiple layers (e.g., 16 different layers). Each layer may be alpha blended, faded, etc. Instructions to show various menus, fade menus, etc., may be encoded into the video stream being sent to other video conference systems.
In some embodiments, the menus, etc. may be displayed in a translucent color scheme that shows up even against very light or very dark backgrounds. For example, the translucent color scheme may include a bright and a dark color for displaying the menus. In some embodiments, the video menus/displays may be presented on two (or more) monitors coupled to the video conferencing system.
At 7701, a video conference may be established for several participant locations. At least one of the participant locations may have a speakerphone incorporated into its video conferencing system. The video conferencing system may receive video/audio data from a participant at a remote location and present the video/audio data to a local participant (e.g., through a display and/or speaker). In some embodiments, the speakerphone may receive user input to manipulate one or more characteristics of the video conference. For example, a user may dial/redial phone numbers, adjust the volume, implement a consult feature, etc. through the speakerphone. In some embodiments, the remote control may also be used to manipulate one or more characteristics of the video conference.
In some embodiments, the speakerphone may provide signals to the video conferencing system based on the received user input to control the one or more characteristics of the video conference. In some embodiments, the speakerphone may have a first plurality of user input elements (e.g., buttons) useable for receiving user input to place and/or receive telephone calls (e.g., a standard phone keypad). In some embodiments, the speakerphone may have a second set of user input elements for receiving user input to manipulate one or more characteristics of the video conference (e.g., additional buttons with other features for manipulating the video conference). In some embodiments, a button pressed on the speakerphone for greater than a predetermined time may specify manipulation of a characteristic of the of the video conference.
At 7703, a speakerphone functionality may be used in the video conference. In some embodiments, the functionality may include sending or receiving signals to or from the speakerphone (e.g., user input signals, microphone signals, and audio signals). In some embodiments, a video call may be placed using the speakerphone. In some embodiments, an audio call may also be placed using the speakerphone. For example, audio call signals may be provided back and forth through the video conferencing system to a Public Switched Telephone Network. In some embodiments, audio signals may be received from microphones in the speakerphone to be used in the video conference. For example, audio from participants in the video conference may be detected through the microphones in the speakerphone. In some embodiments, a speaker signal may be produced through the speakerphone. For example, audio from remote video participants may be produced through the speaker in the speakerphone.
At 7705, a caller may be added to the video conference through user input received through the speakerphone. In some embodiments, the caller may be added through a consult feature that allows a caller to be consulted before being added to the conference or disconnected. For example, the participant locations may be placed on hold. A new participant may be dialed. The new participant may be consulted apart from the other participant locations. The new participant location may be connected to the conference call with the plurality of participant locations or disconnected.
At 7707, other speakerphone functionalities may be used, including dialing a video call, redialing a video call, muting a video call, answering a video call, implementing a call length timer for a video call, adjusting a volume for a video call, terminating a video call, adding a call to an ongoing video conference call, and adjusting a camera for a video call.
At 7801, a conference call may be established for a plurality of participant locations. In some embodiments, the conference call may involve video participants and/or speakerphone participants.
At 7803, user input to consult a new participant may be received. In some embodiments, the user input may be received through a speakerphone. In some embodiments, a button signifying a “flash hook” may be pressed by the user.
At 7805, the plurality of participant locations may be placed on hold. The user may then hear a new dial tone.
At 7807, a new participant may be dialed.
At 7809, the new participant may be consulted apart from the plurality of participant locations.
At 7811, a user may choose to either connect the new participant to the conference call with the plurality of participant locations or disconnect the new participant.
In some embodiments, the speakerphone may not have separate video and voice buttons. For example, the speakerphone may use an on/off button for both. In some embodiments, if a user dials another caller, the system may assume the call is an audio call until it receives video (or indication that the remote system supports video). The system may then transition the video components of the system into the call (e.g., the system may display the remote video and may send video from a local camera). In some embodiments, the local camera and display may be inactive if the remote system is an audio only system (or if the remote system is only sending audio). In a multiway call, if the first participant is audio only, the video components (e.g., display and camera) may stay inactive until a second participant who supports video is added. The audio from the first participant may continue to come through the speakerphone while the audio (and video) for the second participant may come through the video conference system.
Audio Output in Video Conferencing and Speakerphone Based on Call Type
Referring to
In some embodiments, the components of the video conferencing system and the speakerphone may be coupled wirelessly through the system codec 7909. In some embodiments, other connection mediums (e.g., Ethernet cables) may be used. The system codec 7909 may coordinate the sound production for the video conferencing system and speakerphone.
In some embodiments, the speakerphone may be coupled to the system through a power over Ethernet (POE) cable. The speakerphone may have 16 microphones to provide high quality audio pickup using directional pickup beams from the 16 microphones. Other numbers of microphones may be used. In some embodiments, a speakerphone coupled to the system may provide audio pick-up (i.e., detection) for video and/or audio calls.
In some embodiments, video conferencing systems with an integrated speakerphone may have two distinct sound systems for reproducing the audio of a call, the one attached to and associated with the system's codec functionality (i.e., video sound system 7903), and the speakerphone itself 7905. Video calls may use both video and audio streams during the call, while audio calls may use only audio streams. In some embodiments, the video sound system 7903 may emanate from or appear to emanate from the connected monitor 7901 (e.g., television). In some embodiments, the speakerphone sound system 7907 may emanate from the speakerphone 7905. Distinct locations of the two sound systems may create a directional sound field allowing the persons 7911 within the room to discern from which direction, hence which sound subsystem, the sound emanates.
In various embodiments, both the speakerphone 7905 and the video codec may provide separate means of sound attenuation. The speakerphone 7905 may have a volume up/down button on the device, while the video codec may use a remote control with volume up/down buttons. During homogeneous type (audio or video), single or multi-connection calls, pressing either set of volume control buttons may adjust the attenuation of the sound of the call. In some embodiments, the system may not correlate button sets with a type of call. For example, during an audio only call, pressing the volume up/down buttons on the remote control may adjust the attenuation of the speakerphone sound subsystem 7907. Likewise, during a video call, pressing the volume up/down buttons on the speakerphone may adjust the attenuation of the video call.
Integrated Portable High Definition (HD) Video and Audio Conferencing System with Spatial Audio
In some embodiments, the video conference system may have an integrated speakerphone system to manage both a speakerphone and a video conferencing system. For example, a speakerphone and a video conferencing system may be coupled to the integrated video and audio conferencing system 7909 and may receive audio and/or video signals from the integrated unit 7909.
In some embodiments, an integrated fixed focus high definition lens and image sensor may be used (e.g. to deliver 1280×720 resolution at 30 frames per second (fps)). The system may also use two high quality long travel 1-inch diameter ported speakers with a frequency response of approximately 150 Hz to 22 kHz. Other speakers may also be used. In some embodiments, low noise microphones may be used at positions supporting either broad-fire or end-fire microphone array processing. In some embodiments, approximately 8 low noise microphones may be used (other numbers of microphones are also contemplated). The microphones may detect audio from a user (who may typically be approximately 3′ to 5′ from the system). Audio algorithms may direct the microphone array at the user speaking and minimize background noise and reverberation. Additional beam forming algorithms may be used to determine the horizontal angle of the user with respect to the system.
In some embodiments, the optimum viewing distance by someone with normal vision may be where the resolving power of the eye is just equal to the pixel pitch of the image. At that distance the image may appear as sharp as a live image. At closer distances, the image may appear blurry and at farther distances, some of the resolution may be wasted. Someone with normal eyesight may resolve about 1/60 of degree of arc. In some embodiments, the optimal viewing distance in inches may be calculated as approximately 3438/(pixel pitch) where the pixel pitch is the number of pixels on the monitor per inch. Other formulas for the optimal viewing distance are also contemplated. In some embodiments, a screen diagonal of approximately 17 inches with an aspect ratio of approximately 16:9 may be used. A video resolution of 1280×720 for a screen of 14.8×8.3 (width vs. height) may result in the optimum viewing distance of approximately 40 inches (3.3 feet). In some embodiments, for room systems, a screen diagonal approximately in the range of 50″ to 60″ may be used with an aspect ratio of 16:9. Other diagonals and aspect ratios may also be used. In some embodiments, the video resolution for the 50″ screen may be approximately 1280×720, with a screen width vs. height of 43.6×24.5 and an optimal viewing distance of 117 inches (9.7 feet). The optimal viewing distance of 9.7 feet may roughly match a typical viewing distance in a conference room.
In some embodiments, spatially realistic audio may be provided for a video call. In some embodiments, voices coming from the people on the left side of the screen, in a video call, may be directed through audio on the left side of the screen (e.g., at least speaker 7951a) at the unit on the other end (similarly for voices from the center (speaker 7951b) and right side (speaker 7951c) of the screen). This may result in giving the user a realistic audio experience that may match the realism of the video experience. In some embodiments, audio from a speakerphone (for example, from a speakerphone only audio participant) may come through only the speakerphone. In some embodiments, the audio from the audio only participants may be provided through other speakers on the system.
In some embodiments, two speakers may be used in the system to create synthesized stereo sound at a location specified by position information received as side information along with the existing single audio channel. As seen in
In some embodiments, a true stereo echo canceller may not be required. For example, an independent echo canceller may be used for each virtual talker position. In some embodiments, five systesized talker locations may be used across the display (other numbers of systesized talker locations may also be used). Each may be on or off resulting in a 32 collective virtual talker positions and 32 independent echo cancellers. Other numbers of collective virtual talker positions and independent echo cancellers may be used. When a set of talker positions is active, a corresponding echo canceller may be activated. In some embodiments, the compute of the system may not become large because only one echo canceller may be executing at any one time.
In some embodiments, a true stereo echo canceller may be used. For example, a 3-channel or higher echo canceller may be used (a lower channel echo canceller may also be used). A beam former may be applied to the integrated microphones 8201 to generate a left and a right beam (or left, center, and right for a 3-channel echo canceller). The beams may become inputs to the left and right channels of the echo canceller. In some embodiments, beams determined by the integrated microphones 8201 in the camera 7913 may be continuously correlated with the beams locating the talker around the speakerphone. Depending on the visual field of the camera 7913, the correct speakerphone beams may be used to produce left and right audio channels. In some embodiments, the speakerphone beam former may generate a left and right beam (or left, center, and right beam for a 3 channel echo canceller). In some embodiments, these beams may become inputs to the left and right channels for the echo canceller. In some embodiments, audio beams used for the left and right channel coming from the speakerphone may provide better audio separation due to the high quality beams. In addition, they may eliminate the need to have two separate microphones for left and right channels placed in specific locations on the table.
In some embodiments, audio beams may be used for left and right channels to provide better audio separation and eliminate the need to have two separate microphones placed on the table in front of the unit (as opposed to just left and right microphones). In some embodiments, left and right microphones may also be used.
Embodiments of these methods may be implemented by program instructions stored in a memory medium or carrier medium. A memory medium may include any of various types of memory devices or storage devices. The term “memory medium” is intended to include an installation medium, e.g., a CD-ROM, floppy disks, or tape device; a computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; or a non-volatile memory such as a magnetic media, e.g., a hard drive, or optical storage. The memory medium may comprise other types of memory as well, or combinations thereof. In addition, the memory medium may be located in a first computer in which the programs are executed, or may be located in a second different computer that connects to the first computer over a network, such as the Internet. In the latter instance, the second computer may provide program instructions to the first computer for execution. The term “memory medium” may include two or more memory mediums that may reside in different locations, e.g., in different computers that are connected over a network.
In some embodiments, the computer system may include a memory medium(s) on which one or more computer programs or software components according to one embodiment of the present invention may be stored. For example, the memory medium may store one or more programs that are executable to perform the methods described herein. The memory medium may also store operating system software, as well as other software for operation of the computer system.
Further modifications and alternative embodiments of various aspects of the invention may be apparent to those skilled in the art in view of this description. Accordingly, this description is to be construed as illustrative only and is for the purpose of teaching those skilled in the art the general manner of carrying out the invention. It is to be understood that the forms of the invention shown and described herein are to be taken as embodiments. Elements and materials may be substituted for those illustrated and described herein, parts and processes may be reversed, and certain features of the invention may be utilized independently, all as would be apparent to one skilled in the art after having the benefit of this description of the invention. Changes may be made in the elements described herein without departing from the spirit and scope of the invention as described in the following claims.
This application claims priority to U.S. provisional patent application Ser. No. 60/619,212, entitled “Video Conferencing Speakerphone” which was filed Oct. 15, 2004, whose inventors are Michael L. Kenoyer, Craig B. Malloy, and Wayne E. Mock, which is hereby incorporated by reference in its entirety as though fully and completely set forth herein. This application claims priority to U.S. provisional patent application Ser. No. 60/676,048, entitled “Speakerphone Supporting Video and Audio Features” which was filed Apr. 29, 2005, whose inventors are Wayne E. Mock, which is hereby incorporated by reference in its entirety as though fully and completely set forth herein.
Number | Date | Country | |
---|---|---|---|
60619212 | Oct 2004 | US | |
60676048 | Apr 2005 | US |