Method and system for unified audio control on a personal computer

Information

  • Patent Grant
  • 8443179
  • Patent Number
    8,443,179
  • Date Filed
    Thursday, April 12, 2012
    12 years ago
  • Date Issued
    Tuesday, May 14, 2013
    11 years ago
Abstract
A system and method for improved audio controls on a personal computer is provided. The system and method provide a unified architecture for audio controls across hardware and software interfaces of the personal computer. An intelligent facility may automatically change audio controls for users to simply interact with various communications and media applications. To this end, a configurable audio controller intelligently handles various aspects of the system's audio devices by following various rules that may be based at least in part on user-configurable settings and a current operating state. The present invention also provides audio controls so that a user may easily change audio settings such as the volume of an audio output device. There are many applications that may use the present invention for automatic control of audio devices based upon the user's context.
Description
BACKGROUND OF THE INVENTION

1. The Field of the Invention


The invention relates generally to computer systems, and more particularly to an improved method and system for unifying audio control on a personal computer.


2. The Relevant Technology


The role of contemporary computers continues to evolve as a tool used for communications and media applications. Personal computers offer many new and exciting media applications for personal entertainment such as live television, personal video recording, playing or recording digital music, displaying or creating digital photographs, playing movies recorded on a DVD, and so forth. Traditionally, sound for these media applications has been controllable by several audio controls made available on a personal computer. For example, sound may be controlled by software for soundcards that allow tuning for volume, treble, bass, and wave balance. Sound may also be controlled on a personal computer by sound synthesis software, by a media player, or by hardware controls such as a volume control on the speakers.


With the introduction of Voice-over-IP (VoIP) and other IP telephony applications, computers may also be used for handling phone calls and voice mail in addition to handling media applications and customary communication applications such as email, instant messaging, fax communications, and so forth. A personal computer with integrated telephony can enhance voice and video communication in ways that empower the user while increasing user productivity and enjoyment. For example, a personal computer may be designed that is capable of accepting incoming calls of various kinds such as analog Public Switched Telephone Network (PSTN), private branch exchange (PBX), cellular telephony or VoIP. There is the potential for such a personal computer to be connected to telephone equipment for PSTN, cellular telephony or PBX, and provide an enhanced user interface such as for handling voice mail.


What is needed is a unified architecture for audio controls across hardware and software interfaces of the personal computer. Such a system and method should operate in what is perceived to be a consistent, flexible and extensible manner. Additionally, this unified architecture should be capable of handling telephony applications, media applications, and switching between communications modalities.


BRIEF SUMMARY OF THE INVENTION

Briefly, the present invention provides an improved system and method for unifying audio controls on a personal computer. To this end, a master controller is provided that may control attributes of the audio stream, such as the volume, by communicating with the input and output drivers of the audio stream. This unified architecture also supports intelligent features for automatically changing audio controls for users to easily interact with various communications and media applications. A configurable master audio controller intelligently handles various aspects of the system's audio devices by following various rules that may be based (at least in part) on user-configurable settings and a current operating state. The master audio controller may respond to externally received events, such as incoming calls, forwarded voicemail messages, and so forth. For example, when a there is an incoming call, the master audio controller may turn down the volume on the system speakers. The master audio controller likewise responds to user actions such as plugging in headphones, playing voicemail, and so forth. In general, the system and method of the present invention supports intelligent features for automatically changing audio controls for users to simply interact with various communications and media applications.


The present invention also provides audio controls which may be placed in various locations such as on the computer housing, on a keyboard, on a monitor or a remote control. With these controls, a user may easily change audio settings such as the volume of an audio output device. In addition to the audio volume control and a speaker mute button, other audio controls may be easily added, such as a wave balance control knob, a treble control knob, a bass control knob, and so forth. Pressing the speaker mute button allows the user to quickly mute the default system audio output device such as the system speakers. A speaker system volume knob also allows the user to adjust the volume of the default system audio output device. Because the state of an individual audio control button may not be readily apparent to a user, an indicator light such as an LED may be located adjacent to or integrated into each audio control button.


There are many applications that may use the present invention for automatic control of audio devices based upon the user's context. For instance, when notified of an incoming call, a user may press a telephony control button such as a speakerphone button to answer the call. Before the call is connected to the speaker and microphone, the master audio controller may automatically mute (or pause if appropriate) any other audio, such as music that the user was listening to prior to the call. At the end of the call, the user may again press the speakerphone button to disconnect the call, and the master audio controller may restore the audio state as it was prior to the call. As another example, if the user plugs in headphones, the master audio controller may switch the default system audio output device from the PC system speakers to the headphones and mute the system speakers so that they do not disturb others. When the user unplugs the headphones, the master audio controller switches the default system audio output device from the headphones back to PC system speakers and restores their audio volume.


In general, the system and method is fairly comprehensive as well as flexible and extensible to handle any audio devices, and additional audio controls may be easily added as needed. Other advantages will become apparent from the following detailed description when taken in conjunction with the drawings, in which:





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a block diagram generally representing a computer system into which the present invention may be incorporated;



FIG. 2 is a general representation of a computer system arranged with integrated communications-related devices including audio controls, in accordance with an aspect of the present invention;



FIG. 3 is a block diagram generally representing the components in an exemplary embodiment of the audio architecture, in accordance with an aspect of the present invention;



FIG. 4 is a general representation of a partial keyboard with audio controls incorporated into the keyboard, in accordance with an aspect of the present invention;



FIG. 5 is a representation of a control panel positioned beneath a computer monitor with audio controls incorporated into the control panel, in accordance with an aspect of the present invention;



FIG. 6 is a representation of audio controls incorporated into a monitor, in accordance with an aspect of the present invention;



FIG. 7 is a representation of an alternative control panel with audio controls, in accordance with an aspect of the present invention; and



FIG. 8 is a representation of audio controls incorporated into a remote control, in accordance with an aspect of the present invention.





DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Exemplary Operating Environment



FIG. 1 illustrates an example of a suitable computing system environment 100 on which the invention may be implemented. The computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100.


The invention is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to: personal computers, server computers, hand-held or laptop devices, tablet devices, headless servers, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.


The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, and so forth, which perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in local and/or remote computer storage media including memory storage devices.


With reference to FIG. 1, an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer 110. Components of the computer 110 may include, but are not limited to, a processing unit 120, a system memory 130, and a system bus 121 that couples various system components including the system memory to the processing unit 120. The system bus 121 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.


The computer 110 typically includes a variety of computer-readable media. Computer-readable media can be any available media that can be accessed by the computer 110 and includes both volatile and nonvolatile media, and removable and non-removable media. By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by the computer 110. Communication media typically embodies computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer-readable media.


The system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic routines that help to transfer information between elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation, FIG. 1 illustrates operating system 134, application programs 135, other program modules 136 and program data 137.


The computer 110 may also include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only, FIG. 1 illustrates a hard disk drive 141 that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 152, and an optical disk drive 155 that reads from or writes to a removable, nonvolatile optical disk 156 such as a CD ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive 141 is typically connected to the system bus 121 through a non-removable memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 155 are typically connected to the system bus 121 by a removable memory interface, such as interface 150.


The drives and their associated computer storage media, discussed above and illustrated in FIG. 1, provide storage of computer-readable instructions, data structures, program modules and other data for the computer 110. In FIG. 1, for example, hard disk drive 141 is illustrated as storing operating system 144, application programs 145, other program modules 146 and program data 147. Note that these components can either be the same as or different from operating system 134, application programs 135, other program modules 136, and program data 137. Operating system 144, application programs 145, other program modules 146, and program data 147 are given different numbers herein to illustrate that, at a minimum, they are different copies. A user may enter commands and information into the computer 110 through input devices such as a tablet, or electronic digitizer, 164, a microphone 163, a keyboard 162 and pointing device 161, commonly referred to as mouse, trackball or touch pad. Other input devices not shown in FIG. 1 may include a joystick, game pad, satellite dish, scanner, or other devices including a device that contains a biometric sensor, environmental sensor, position sensor, or other type of sensor. These and other input devices are often connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). A monitor 191 or other type of display device is also connected to the system bus 121 via an interface, such as a video interface 190. The monitor 191 may also be integrated with a touch-screen panel or the like. Note that the monitor and/or touch screen panel can be physically coupled to a housing in which the computing device 110 is incorporated, such as in a tablet-type personal computer. In addition, computers such as the computing device 110 may also include other peripheral output devices such as speakers 195 and printer 196, which may be connected through an output peripheral interface 194 or the like.


The computer 110 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 180 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 110, although only a memory storage device 181 has been illustrated in FIG. 1. The logical connections depicted in FIG. 1 include a local area network (LAN) 171 and a wide area network (WAN) 173, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet. When used in a LAN networking environment, the computer 110 is connected to the LAN 171 through a network interface or adapter 170. When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173, such as the Internet. The modem 172, which may be internal or external, may be connected to the system bus 121 via the user input interface 160 or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 110, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation, FIG. 1 illustrates remote application programs 185 as residing on memory device 181. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.


Unified Audio Controls


The present invention is generally directed towards an improved method and system for unifying audio controls on a personal computer. The system and method provide a unified architecture for controlling audio across hardware and software interfaces of the personal computer. To this end, a master audio controller, also referred herein as an audio controller, is provided that may control attributes of the audio stream, such as the volume, by communicating with the input and output drivers of the audio stream. This unified architecture also supports intelligent features for automatically changing audio controls for users to easily interact with various communications and media applications. A configurable master audio controller intelligently handles various aspects of the system's audio devices by following various rules that may be based at least in part on user-configurable settings and a current operating state. The master audio controller may respond to external events received such as incoming calls, forwarded voicemail messages, and so forth. For example, when a there is an incoming call, the master audio controller may turn down the volume on the system speakers. The master audio controller likewise responds to user actions such as plugging in headphones, playing voicemail, and so forth. The present invention also provides audio controls so that a user may easily change audio settings such as the volume of an audio output device.


There are many applications that may use the present invention for automatic control of audio devices based upon the user's context. For example, if a user plugs in headphones, the master audio controller may switch the default system audio output device from the PC system speakers to the headphones and mute the system speakers so that they do not disturb others. When the user unplugs the headphones, the master audio controller switches the default system audio output device from the headphones back to PC system speakers and restores their audio volume. As will be understood, the various architecture diagrams, devices and scenarios described herein are only examples, and there are many other scenarios to which the present invention will apply.


Turning to FIG. 2 of the drawings, there is shown a computer system, such as the computer system 110 of FIG. 1, in which various communications-related devices are integrated, including audio controls. For example, the computer system 110 includes a monitor 191 having an attached camera 202, an attached telephone (e.g., handset) 204, and an attached speaker 194, which along with a microphone 163, may function as a speakerphone. Other devices not separately represented in FIG. 2 include mobile communications devices such as a cellular telephone or other mobile computing device capable of connecting in some way (e.g., by wired cradle or Bluetooth™ technology) with the computer system. Although shown as individual devices in FIG. 2, it is understood that any or all of these devices, such as the speaker 194 and microphone 163, may be combined into a unitary assembly, or built into other devices, such as the monitor 191. In any event, each of these devices may be present and if so are connected directly or indirectly by a wired or wireless connection to interfaces at the main PC housing 214 (containing at least the motherboard, but also typically containing some non-volatile storage). As used herein, the term “connect” and “couple” and their variants are equivalent and generally mean that there is some type of information capable of being transferred between one entity and another, regardless of whether directly or indirectly via any intermediaries and/or any transformation of the information.


Also represented in FIG. 2 is an auxiliary display device 220, such as for displaying caller ID data or like information. The auxiliary display 220 is typically small (relative to the main display screen 191), and may be the display of another device, such as the screen of a mobile computing device, but may also be a dedicated display, such as one that is operably coupled to the computer operating system when the computer system 110 is in a powered-up state. Further, note that the auxiliary display need not be an actual display, but can be a projection (e.g., onto a wall) of the information. The auxiliary display device 220 may provide some of its own processing and storage resources, so as to remain functional to some extent when the computer operating system is not running. The keyboard 162 and/or monitor 191 (and/or possibly the pointing device 161) may also include non-conventional buttons 222, such as buttons related to audio controls, and non-conventional LED indicators 224, such as indicators related to audio controls.


As generally represented in FIG. 3, the computer system 110 may include a master audio controller 312, primarily implemented in a software component or set of software components, that may control attributes of an audio stream, such as the volume, by communicating with an audio input driver 308 and an audio output driver 310 of the audio stream. As used herein, an audio stream means any representation or encoding of sound including a digital representation or an analog signal. The audio input driver 308 communicates with the hardware interface 320 to receive input from an audio input device 324 such as microphone 163. The audio output driver 310 likewise communicates with the hardware interface 320 to send output to an audio output device 326 such as speakers 194. For example, the master audio controller 312 may send control data to a sound card controller, or to the audio controller for the chipset incorporated on the motherboard in place of a sound card, to adjust an attribute of the audio stream such as the volume. Where there is a direct input available for a hardware volume control, any adjustment of the hardware volume control received by the sound card or audio processing chip may be forwarded to the master audio controller for setting the volume of all audio streams as appropriate on the system. In an alternative embodiment, the master audio controller may provide system-wide control of the attributes of any audio streams by having each logical audio driver redirect its audio stream to the master audio controller instead of directly sending the audio stream to its respective audio output driver. The master audio controller may then adjust any attributes of any audio stream before forwarding the audio stream to the audio output driver. Yet again, in a third embodiment, each audio input device may directly send its audio stream to the master audio controller. The master audio controller may then modify each audio stream as appropriate and directly send the audio stream to the audio output driver for the audio output device. Moreover, the master audio controller may control two or more channels or audio streams as a group in any of these embodiments, including mixing of channels.


The master audio controller also intelligently handles various aspects of the system's audio input and output devices when events are received. For example, when a there is an incoming call, the master audio controller may turn down the volume on the system speakers. Note that the master audio controller 312 need not be built into the computer system 110, but can connect thereto as an add-on device or part of an add-on device such as a communications panel, via a USB connection or other connection.


To handle the system's various audio input and output devices, the master audio controller 312 includes mode control logic 314 that follows various rules 316 and/or is based at least in part on other user-configurable settings and a current operating state 318. The mode control logic 314 responds to external events received such as incoming calls, forwarded voicemail messages, and so forth. In general, any event generated by the system software and hardware may be received by the event handling logic 306. The mode control logic 314 likewise responds to user actions such as plugging in headphones, playing voicemail, and so forth. User actions can occur and be detected in any number of ways, including essentially any way of providing user action data or intended action data to a computer system. For example, such actions can include lifting or replacing the attached handset 204, which correspondingly actuates a hook switch generating an event received by the event handling logic 306. Similarly, buttons on a device such as a talk button on the handset or buttons on the keyboard 162, (e.g., a speakerphone button, a flash button, and so on) generate events received by the event handling logic 306. Controls 420 accompanying the auxiliary display 220, such as in the form of scroll buttons and possibly an enter or select button (or equivalent button elsewhere on the system such as the flash button), can also provide user action data, as can the computer data entry mechanisms such as a keyboard 162 and mouse 161. Any microphone, such as the microphone 163, can also provide user action data, e.g., via speech recognition (command and control) performed with a speech to text recognizer. User action information may also be communicated by wireless radio, and/or from a network connection or other communication channel. Motion and/or proximity sensing can likewise serve as a user action sensor.


In response to events received, the mode control logic 314 intelligently handles various aspects of the system's audio devices by communicating with the control handling logic 302. Similarly, state changes or the like in the controls are provided to the control handling program (e.g., the operating system 134, master audio controller 312, or an application program 135), along with data that identifies the control. Via controls handling logic 302, the control handling program then acts in the current context corresponding to the control. This may include generating one or more hardware or software events or commands, such as lowering the volume in the system speakers, switching from the system speakers to headphones, muting the system audio, pausing media playback, and so forth.


The control handling program also controls any indicators 320 present as described above to convey information to the user via indicator display logic 304. In specific, the control handling logic 302 and the indicator/display logic 304 communicate with the hardware interface 320 to receive input from the audio controls 322 and send output to the indicators 328 for display. Note that the indicators need not be LEDs, but include any type of mechanism that outputs information that is capable of being sensed by a user, including visual, audible and tactile output. Each of the indicators may be related to one of the controls, and thus each indicator may be incorporated into or positioned proximate its corresponding control. Where the indicators are LEDs, colors and illumination patterns (frequencies, duty cycles, number of pulses, and so forth) may be varied to convey different information to users regarding each control.


Those skilled in the art will appreciate that the functionality implemented within the blocks illustrated in FIG. 3 may be implemented as separate components or the functionality of several or all of the blocks may be implemented within a single component. For example, a separate library may be implemented that contains the functionality of the control handling logic and the functionality of the display logic. In such an implementation, executables linked to the library may send control events directly to the control interface when they are executing on the computer system.


Further, although an operating system 134 (or master audio controller 312 or some application program 135) is shown in FIG. 3 as handling the audio controls 322, it should be noted that the computer system need not be fully operational for the audio controls 322 and/or the indicators 328 to work in accordance with the present invention. Indeed, some of the controls may still work when the computer is powered down, at least to a default extent or to an extent configured by a user. For example, the user may want the audio controls to work as a conventional appliance when the computer system is powered down, so that the user may answer incoming calls using the speakerphone and caller-ID device. Any tasks that do not require a running operating system or application program similarly may remain operational and use the audio controls when the operating system or application program is not available or in standby mode.


To handle the controls and communications in such a powered-down mode, the master audio controller and control handling logic may be loaded into executable non-volatile memory, operated with a secondary processor, and so forth, so that communication works as long as some power is available, even though the disk, main processor, main display, network card and/or other parts of the system are powered down.


Moreover, the present invention allows for automatic control of audio output devices based upon the user's context. For instance, when notified of an incoming call, a user may press a telephony control button such as a speakerphone button to answer the call. Before the call is connected to the speaker 194 and microphone 163, the master audio controller 312 may automatically mute (or otherwise control) any other audio, such as music that the user was listening to prior to the call. At the end of the call, the user may again press the speakerphone button to disconnect the call, and the master audio controller 312 may restore the audio state as it was prior to the call. As another example, if the user plugs in headphones, the master audio controller 312 may switch the default system audio output device from the PC system speakers to the headphones and mute the system speakers so that they do not disturb others. When the user unplugs the headphones, the master audio controller 312 switches the default system audio output device from the headphones back to PC system speakers and restores their audio volume.


Turning to an explanation of the operation of the present invention with particular reference to the audio controls 322, FIG. 4 presents a general representation of a partial keyboard with audio controls 322 incorporated into the keyboard 216. Note that an indicator light such as an LED may be optionally associated with one or more of the audio control buttons. For example, there may be an indicator light 402 associated with the speaker mute button 404 that illuminates as a steady red light when system speakers are muted. In addition to the speaker mute button 404 and the speaker volume knob 406 shown, there may be other audio control buttons included such as a wave balance control knob, a treble control knob, a bass control knob, and so forth.


The speaker mute button 404 allows the user to quickly mute the default system audio output device such as the system speakers 194. The speaker mute button can be integrated into a speaker volume knob 406 for “press to mute” functionality. Alternatively, it can be designed as a stand-alone button, in which case it may be located immediately adjacent the volume knob. Because the state of the speaker mute button 404 may not be readily apparent to a user, an indicator light 402 such as an LED may be used in conjunction with the speaker mute button 404. The indicator light for the speaker mute button 402 may be located adjacent to the speaker mute button 404 or integrated into the control itself. Pressing the speaker mute button 404 mutes system volume and sets the speaker mute indicator to amber. Pressing it again restores the previous volume setting and restores the indicator to green.


The speaker system volume knob 406 allows the user to adjust the volume of the default system audio output device such as the system speakers 194. The speaker system volume knob 406 may be coupled with a switch 408 for turning the volume on and off. Multiple indicators may be used to indicate the volume level such as indicator 410 shown. The speaker system volume knob 406 may be located on the lower right corner of the monitor (e.g., if speakers are built in) or in the lower right corner of the device housing the speakers. Alternatively, it may be located on the keyboard or some other location that is easily accessible to the user. It is advantageous for volume controls on the system to be HID (human interface device) compliant so that they may use HID interfaces to stay synchronized with each other. Furthermore, any USB HID-capable speakers need not have analog or power control. Otherwise, any analog volume or power controls on powered speakers may be located behind the speaker units or otherwise out of the user's immediate view.


It will be appreciate by those skilled in the art that the audio controls 322 illustrated in FIG. 4 as incorporated in a keyboard are an exemplary configuration and that the present invention may be practiced using other configurations such as the configuration illustrated in FIG. 5 with the audio controls located on a communications panel. In FIG. 5, the speaker mute button 404 and the speaker volume knob 406 are shown magnified from their location on a control panel 540 which is attached to or underneath the main display 191. This location may allow good visibility of the audio controls 322, but it may not be considered as convenient by some user to turn the speaker volume knob as it would be if it was located on the keyboard such as the speaker volume knob illustrated in FIG. 4. FIG. 6 shows another exemplary illustration of the same two audio controls located on the bezel of a monitor 191.


Another alternative control panel 720 incorporating audio controls 322 and including an auxiliary display 220 is shown in FIG. 7. It should be appreciated that one or more audio control 322 buttons need not be grouped with other audio control buttons, but may be grouped with some other set of buttons, or may be an independent button. In fact, the speaker volume knob 406 may be placed on the speaker 194. One or more of the audio controls 322 may also be an add-on to a computer system, such as by providing a button coupled to a USB or infrared port, or as a Bluetooth™ device or other wired or wireless connection. A wired or wireless audio control button, such as constructed to be held by a user, may also be provided either stand-alone or among buttons of a remote control. For example, FIG. 8 illustrates audio controls 322 on remote control 802.


Those skilled in the art will appreciate that there are many applications that may use the audio controls for controlling the default system audio output as well as automatically switching the default system audio output device among various audio output devices. For example, a user notified of receiving a new voice mail may press a play button to listen to the voice mail. The present invention may automatically mute any other audio, such as music that the user was listening to prior to the call, before playing the voice mail over the system speakers. The user may turn up the volume using the speaker volume control while listening to the voice mail play. After the voice mail has been played, the music returns playing at the previous volume setting prior to playing the voice mail.


As can be seen from the foregoing detailed description, there is provided a system and method for unifying audio control on a personal computer. The system and method allows for automatic control of audio output devices based upon the user's context. The system and method is also fairly comprehensive in its ability to control software and hardware audio interfaces, as well as flexible and extensible to handle many user scenarios and uses. Additional audio controls may be easily added. The system and method thus provide significant advantages and benefits needed in contemporary computing and communications.


While the invention is susceptible to various modifications and alternative constructions, certain illustrated embodiments thereof are shown in the drawings and have been described above in detail. It should be understood, however, that there is no intention to limit the invention to the specific forms disclosed, but on the contrary, the intention is to cover all modifications, alternative constructions, and equivalents falling within the spirit and scope of the invention.

Claims
  • 1. A method for controlling audio output rendered from a computing system, the method comprising: the computing system playing media by at least rendering audio output associated with the media;the computing system detecting an incoming telephone call;the computing system detecting user input that is operable to answer the telephone call at the computing system; andthe computing system, in response to the user input and prior to connecting the telephone call responsive to the user input, altering how the audio output is rendered by at least one of (1) pausing the media or (2) lowering a volume associated with the rendering of the audio output.
  • 2. The method of claim 1, wherein the method includes altering how the audio output is rendered by lowering the volume associated with the audio output as well as pausing the media.
  • 3. The method of claim 1, wherein the user input is detected at and entered by a user at the computing system to answer the incoming telephone call.
  • 4. The method of claim 3, wherein the user input comprises a user selection of a telephony button.
  • 5. The method recited in claim 1, wherein the method further includes automatically resuming the rendering of the audio output associated with the media at a volume that existed prior to the telephone call once the telephone call is disconnected.
  • 6. The method recited in claim 5, wherein disconnecting the telephone call occurs in response to a user entering input at the computing system.
  • 7. The method recited in claim 3, wherein the user enters input through a touch surface associated with the computing system.
  • 8. The method recited in claim 1, wherein the method includes altering how the audio output is rendered lowering the volume to a muted state.
  • 9. A computing system comprising: a touch screen;at least one audio output device configured to render audio output;telephone hardware configured for receiving a telephone call; andstorage media storing computer executable instructions for implementing a method for controlling audio output rendered from the computing system, the method comprising: the computing system rendering audio output;the computing system detecting an incoming telephone call;the computing system detecting user input that is operable to answer the telephone call at the computing system; andthe computing system, in response to the user input and prior to connecting the telephone call responsive to the user input, altering how the audio output is rendered by at least one of (1) pausing the rendering of the audio output or (2) lowering a volume associated with the rendering of the audio output.
  • 10. The computing system recited in claim 9, wherein the method further includes, in response to detecting the telephone call is disconnected, automatically resuming to render the audio output with audio attributes that existed while rendering the audio output prior to the telephone call.
  • 11. The computing system recited in claim 9, wherein the method includes altering how the audio output is rendered by lowering the volume associated with the audio output and pausing the audio output.
  • 12. The computing system recited in claim 9, wherein the method includes altering how the audio output is rendered by lowering the volume associated with the audio output to a muted state.
  • 13. The computing system recited in claim 9, wherein the user input is entered at the touch screen.
  • 14. A computer storage device storing computer executable instructions which, when executed by a computing system, implement a method for controlling audio output rendered from the computing system, the method comprising: the computing system rendering audio output;the computing system detecting an incoming telephone call;the computing system detecting user input that is operable to answer the telephone call at the computing system; andthe computing system, in response to the user input and prior to connecting the telephone call responsive to the user input, altering how the audio output is rendered by at least one of (1) pausing the rendering of the audio output or (2) lowering a volume associated with the rendering of the audio output.
  • 15. The computer storage device of claim 14, wherein the method includes altering how the audio output is rendered by lowering the volume to a muted state.
  • 16. The computer storage device of claim 14, wherein the method includes altering how the audio output is rendered by pausing the rendering of the audio output.
  • 17. The computer storage device of claim 14, wherein the method includes altering how the audio output is rendered by lowering the volume associated with the audio output as well as pausing the media.
  • 18. The computer storage device of claim 14, wherein the user input is detected at and entered by a user at a touch screen of the computing system to answer the incoming telephone call.
  • 19. The computer storage device of claim 14, wherein the method further includes automatically resuming the rendering of the audio output once the telephone call is disconnected.
  • 20. The computer storage device of claim 19, wherein the telephone call is disconnected in response to a user entering input at the computing system on a touch screen.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 12/563,026, filed on Sep. 18, 2009, now U.S. Pat. No. 8,166,287 entitled “METHOD AND SYSTEM FOR UNIFIED AUDIO CONTROL ON A PERSONAL COMPUTER” which is a continuation of U.S. patent application Ser. No. 12/431,597, filed Apr. 28, 2009, now U.S. Pat. No. 8,127,125, issued Feb. 28, 2012 and entitled “METHOD AND SYSTEM FOR UNIFIED AUDIO CONTROL ON A PERSONAL COMPUTER,” which is a continuation of U.S. patent application Ser. No. 11/685,014, filed Mar. 12, 2007, now U.S. Pat. No. 7,624,259, issued Nov. 24, 2009 and entitled “METHOD AND SYSTEM FOR UNIFIED AUDIO CONTROL ON A PERSONAL COMPUTER,” which is a continuation of U.S. patent application Ser. No. 10/677,101, filed Sep. 30, 2003, entitled “METHOD AND SYSTEM FOR UNIFIED AUDIO CONTROL ON A PERSONAL COMPUTER,” and which issued as U.S. Pat. No. 7,216,221 on May 8, 2007. The foregoing application and patents are incorporated herein by reference in their entireties. The present invention is also related to the following co-pending U.S. Patent Applications which are hereby incorporated by reference in their entireties: U.S. patent application Ser. No. 12/563,041 filed on Sep. 18, 2009, entitled “METHOD AND SYSTEM FOR UNIFIED AUDIO CONTROL ON A PERSONAL COMPUTER.” U.S. patent application Ser. No. 11/559,821 filed on Nov. 14, 2006, entitled “METHOD AND SYSTEM FOR UNIFIED AUDIO CONTROL ON A PERSONAL COMPUTER.”

US Referenced Citations (270)
Number Name Date Kind
4438527 Hammond Mar 1984 A
4860342 Danner Aug 1989 A
5128987 McDonough Jul 1992 A
5159445 Gitlin Oct 1992 A
5327486 Wolff et al. Jul 1994 A
5388268 Beach Feb 1995 A
5412417 Tozuka May 1995 A
5487181 Dailey Jan 1996 A
5491800 Goldsmith Feb 1996 A
5519772 Akman May 1996 A
5533115 Hollenbach Jul 1996 A
5542102 Smith Jul 1996 A
5546538 Cobbley Aug 1996 A
5568540 Greco Oct 1996 A
5657414 Lett Aug 1997 A
5675374 Kohda Oct 1997 A
5675810 Sellers Oct 1997 A
5694467 Young Dec 1997 A
5712911 Herigstad Jan 1998 A
5732216 Logan Mar 1998 A
5745761 Celi Apr 1998 A
5754636 Bayless et al. May 1998 A
5757901 Hiroshige May 1998 A
5764901 Skarbo Jun 1998 A
5768164 Hollon, Jr. Jun 1998 A
5802305 McKaughan Sep 1998 A
5831606 Nakajima Nov 1998 A
5907604 Hsu May 1999 A
5943055 Sylvan Aug 1999 A
5959622 Greer Sep 1999 A
5978837 Foladare Nov 1999 A
5987106 Kitamura Nov 1999 A
5991822 Mealey Nov 1999 A
5991836 Renda Nov 1999 A
5999613 Nabkel Dec 1999 A
6006115 Wingate Dec 1999 A
6006285 Jacobs Dec 1999 A
6008806 Nakajima Dec 1999 A
6018571 Langlois Jan 2000 A
6026158 Bayless et al. Feb 2000 A
6052442 Cooper Apr 2000 A
6091812 Iglehart Jul 2000 A
6101610 Beebe Aug 2000 A
6118856 Paarsmarkt Sep 2000 A
6144363 Alloul Nov 2000 A
6144644 Bajzath Nov 2000 A
6160550 Nakajima Dec 2000 A
6172703 Lee Jan 2001 B1
6192340 Abecassis Feb 2001 B1
6208373 Fong Mar 2001 B1
6215420 Harrison Apr 2001 B1
6237846 Lowell May 2001 B1
6240168 Stanford May 2001 B1
6259449 Saxena et al. Jul 2001 B1
6266714 Jacobs Jul 2001 B1
6279056 Jacobs Aug 2001 B1
6282435 Wagner Aug 2001 B1
6285891 Hoshino Sep 2001 B1
6298127 Petrunka Oct 2001 B1
6346934 Wugofski Feb 2002 B1
6362440 Karidis Mar 2002 B1
6380968 Alexander Apr 2002 B1
6390371 Armga May 2002 B1
6404860 Casellini Jun 2002 B1
6417849 Lefebvre Jul 2002 B2
6438216 Aktas Aug 2002 B1
6438585 Mousseau Aug 2002 B2
6445694 Swartz Sep 2002 B1
6453027 Kang Sep 2002 B1
6459782 Bedrosian et al. Oct 2002 B1
6463145 O'Neal et al. Oct 2002 B1
6477374 Shaffer et al. Nov 2002 B1
6483905 Kikinis Nov 2002 B1
6484019 Aklian Nov 2002 B1
6496860 Ludtke Dec 2002 B2
6507356 Jackel Jan 2003 B1
6513128 Wang Jan 2003 B1
6516356 Belknap Feb 2003 B1
6518957 Lehtinen Feb 2003 B1
6519335 Bushnell Feb 2003 B1
6529742 Yang Mar 2003 B1
6546262 Freadman Apr 2003 B1
6549621 Christie, IV et al. Apr 2003 B1
6563914 Sammon et al. May 2003 B2
6564270 Andert May 2003 B1
6573705 Tajima et al. Jun 2003 B1
6594354 Kelly Jul 2003 B1
6603855 Cannon Aug 2003 B1
6621800 Klein Sep 2003 B1
6628194 Hellebust Sep 2003 B1
6628267 Karidis Sep 2003 B2
6658095 Yoakum Dec 2003 B1
6662022 Kanamori et al. Dec 2003 B1
6671356 Lewis Dec 2003 B2
6671743 Verity Dec 2003 B1
6674457 Davies Jan 2004 B1
6675640 Ehrlich et al. Jan 2004 B2
6680845 Agata Jan 2004 B2
6690778 Kahn Feb 2004 B2
6691233 Gannage Feb 2004 B1
6718183 Blust Apr 2004 B1
6731316 Herigstad May 2004 B2
6732365 Belknap May 2004 B2
6741232 Siedlikowski May 2004 B1
6747970 Lamb et al. Jun 2004 B1
6757372 Dunlap Jun 2004 B1
6778661 Yumoto et al. Aug 2004 B1
6782086 Clapper Aug 2004 B2
6806867 Arruda Oct 2004 B1
6811940 Kita et al. Nov 2004 B2
6813344 Lemke Nov 2004 B1
6816881 Mohindra Nov 2004 B1
6819961 Jacobs Nov 2004 B2
6831657 Tsutsumi Dec 2004 B2
6845151 Peng Jan 2005 B2
6871214 Parsons et al. Mar 2005 B2
6882326 Hirayama Apr 2005 B2
6882724 Hartmeier Apr 2005 B2
6888562 Rambo May 2005 B2
6891940 Bhandari May 2005 B1
6892074 Tarkiainen May 2005 B2
6897851 Carini May 2005 B2
6902332 McLoone Jun 2005 B2
6912283 Meyerson Jun 2005 B2
6918123 Shteyn Jul 2005 B1
6931007 Jones Aug 2005 B2
6937950 Cragun Aug 2005 B2
6938174 LeKuch Aug 2005 B2
6950119 Kakii Sep 2005 B2
6952830 Madineni Oct 2005 B2
6954696 Ihara Oct 2005 B2
6970556 Wall Nov 2005 B2
6973167 Kikinis Dec 2005 B2
6976216 Peskin Dec 2005 B1
6978439 Kelley Dec 2005 B2
6980641 Stanford Dec 2005 B1
6993349 Martinez Jan 2006 B2
6996445 Kamijo Feb 2006 B1
7000237 Sinha Feb 2006 B1
7013003 Seligmann Mar 2006 B2
7035248 Wengrovitz Apr 2006 B2
7036110 Jeyaraman Apr 2006 B2
7068641 Allan Jun 2006 B1
7085814 Gandhi Aug 2006 B1
7092385 Gallant et al. Aug 2006 B2
7096391 Johnson Aug 2006 B2
7106472 Gomez Sep 2006 B2
7106851 Tang et al. Sep 2006 B2
7120238 Bednarz Oct 2006 B1
7123370 Watanabe Oct 2006 B2
7123936 Rydbeck Oct 2006 B1
7145899 Pearce et al. Dec 2006 B1
7149512 Connor Dec 2006 B2
7184522 Brunelle Feb 2007 B2
7194611 Bear et al. Mar 2007 B2
7197120 Luehrig et al. Mar 2007 B2
7209133 Eglit Apr 2007 B2
7213073 Slavin May 2007 B1
7216221 Bear et al. May 2007 B2
7221331 Bear May 2007 B2
7227511 Adan Jun 2007 B2
7231229 Hawkins Jun 2007 B1
7240228 Bear Jul 2007 B2
7243130 Horvitz Jul 2007 B2
7257201 Singh et al. Aug 2007 B2
7272660 Powers Sep 2007 B1
7292588 Milley Nov 2007 B2
7302637 Maguire Nov 2007 B1
7372371 Bear May 2008 B2
7376932 Chen May 2008 B2
7401053 Kamimura Jul 2008 B2
7424740 Bear Sep 2008 B2
7440556 Bear Oct 2008 B2
7443971 Bear Oct 2008 B2
7519911 Friedman Apr 2009 B2
7548255 Bear Jun 2009 B2
7549154 Rhoten Jun 2009 B2
7551199 Bear Jun 2009 B2
7577429 Bear Aug 2009 B2
7581034 Polivy Aug 2009 B2
7624259 Bear et al. Nov 2009 B2
7634780 Rhoten Dec 2009 B2
7697506 Narin et al. Apr 2010 B2
7702363 Cao Apr 2010 B2
7711868 Rhoten May 2010 B2
7778595 White Aug 2010 B2
7784065 Polivy Aug 2010 B2
7827232 Bear Nov 2010 B2
7913182 Bear Mar 2011 B2
7945284 Cao May 2011 B1
8127125 Bear et al. Feb 2012 B2
8166287 Bear et al. Apr 2012 B2
20010002831 Kato et al. Jun 2001 A1
20010033647 Veschi Oct 2001 A1
20010034251 Goto Oct 2001 A1
20010040551 Yates Nov 2001 A1
20020004855 Cox Jan 2002 A1
20020015003 Kato et al. Feb 2002 A1
20020015020 Mobin Feb 2002 A1
20020019812 Board Feb 2002 A1
20020021790 Corbett Feb 2002 A1
20020032907 Daniels Mar 2002 A1
20020039426 Takemoto et al. Apr 2002 A1
20020045438 Tagawa et al. Apr 2002 A1
20020073207 Widger et al. Jun 2002 A1
20020080967 Abdo Jun 2002 A1
20020087225 Howard Jul 2002 A1
20020093683 Focazio Jul 2002 A1
20020099456 McLean Jul 2002 A1
20020110121 Mishra Aug 2002 A1
20020114430 Murata Aug 2002 A1
20020131072 Jackson Sep 2002 A1
20020140627 Ohki Oct 2002 A1
20020144191 Lin Oct 2002 A1
20020162116 Read et al. Oct 2002 A1
20020167458 Baudisch Nov 2002 A1
20020167460 Baudisch Nov 2002 A1
20030025674 Watanabe Feb 2003 A1
20030041332 Allen et al. Feb 2003 A1
20030046448 Fischer Mar 2003 A1
20030074590 Fogle Apr 2003 A1
20030112325 Boyden Jun 2003 A1
20030118003 Geck Jun 2003 A1
20030122874 Dieberger Jul 2003 A1
20030146903 Yi Aug 2003 A1
20030188041 Fillmore Oct 2003 A1
20030197685 Yi Oct 2003 A1
20040001087 Warmus Jan 2004 A1
20040001101 Trajkovic et al. Jan 2004 A1
20040027375 Ellis Feb 2004 A1
20040052341 Yeh Mar 2004 A1
20040076272 Zafar et al. Apr 2004 A1
20040103144 Sallam May 2004 A1
20040110490 Steele Jun 2004 A1
20040135819 Maa Jul 2004 A1
20040141012 Tootill Jul 2004 A1
20040155956 Libbey Aug 2004 A1
20040177361 Bernhard Sep 2004 A1
20040210628 Inkinen Oct 2004 A1
20040222978 Bear Nov 2004 A1
20040223058 Richter Nov 2004 A1
20040240167 Ledbetter Dec 2004 A1
20040240650 Bear Dec 2004 A1
20040266426 Marsh Dec 2004 A1
20050005067 Culter Jan 2005 A1
20050032507 Na Feb 2005 A1
20050047395 Narin et al. Mar 2005 A1
20050063520 Michaelis Mar 2005 A1
20050174364 Malmstrom Aug 2005 A1
20050182822 Daniel Aug 2005 A1
20050186942 Griffin Aug 2005 A1
20050193396 Stafford-Fraser Sep 2005 A1
20050259032 Morris Nov 2005 A1
20050262302 Fuller Nov 2005 A1
20060048062 Adamson Mar 2006 A1
20060061516 Campbell Mar 2006 A1
20060095525 Mousseau May 2006 A1
20060100978 Heller May 2006 A1
20060168355 Shenfield Jul 2006 A1
20060236221 McCausland Oct 2006 A1
20060242590 Polivy Oct 2006 A1
20060284787 Bear Dec 2006 A1
20070071257 Bear Mar 2007 A1
20080112567 Siegel May 2008 A1
20090214014 Cadiz Aug 2009 A1
20090305695 Bear Dec 2009 A1
20100008488 Bear Jan 2010 A1
20100010653 Bear Jan 2010 A1
20100054432 Brahm Mar 2010 A1
20100144389 Cao Jun 2010 A1
Foreign Referenced Citations (53)
Number Date Country
1285674 Feb 2001 CN
0196815 Oct 1986 EP
0772327 May 1997 EP
0777394 Jun 1997 EP
0816990 Jan 1998 EP
0838934 Apr 1998 EP
0772327 Feb 1999 EP
2824980 Nov 2002 FR
63087898 Apr 1988 JP
63280524 Nov 1988 JP
1190062 Jul 1989 JP
02177642 Jul 1990 JP
05095392 Apr 1993 JP
07182372 Jul 1995 JP
08317076 Nov 1996 JP
09153929 Jun 1997 JP
9289526 Nov 1997 JP
9512690 Dec 1997 JP
10240656 Sep 1998 JP
11098252 Apr 1999 JP
11161706 Jun 1999 JP
11331895 Nov 1999 JP
2000261554 Sep 2000 JP
2000341414 Dec 2000 JP
2001043690 Feb 2001 JP
2001100838 Mar 2001 JP
2001169319 Jun 2001 JP
2001339527 Jul 2001 JP
2001320748 Nov 2001 JP
2001519101 Nov 2001 JP
2002033800 Jan 2002 JP
2002064639 Feb 2002 JP
2002101183 Apr 2002 JP
200219070 Jul 2002 JP
2002218058 Aug 2002 JP
2002232566 Aug 2002 JP
2002354518 Dec 2002 JP
2002374354 Dec 2002 JP
2003188978 Jul 2003 JP
2003219010 Jul 2003 JP
2003219469 Jul 2003 JP
2003283693 Oct 2003 JP
2003296522 Oct 2003 JP
2003324543 Nov 2003 JP
20010111729 Dec 2001 KR
20020036476 May 2002 KR
WO9602049 Jan 1996 WO
WO 0049794 Aug 2000 WO
WO 0108383 Feb 2001 WO
WO 0161946 Aug 2001 WO
WO 01-69387 Sep 2001 WO
WO 02093892 Nov 2002 WO
WO 03085960 Oct 2003 WO
Non-Patent Literature Citations (126)
Entry
Anonymous, International Search Report in Corresponding EP Application No. EP 04 00 9868.
Oxford on-line dictionary, http://dictionary.oed.com/entrance.dtl, Oxford University Press 2007, on the definition of the woed “physical” under III/7b.
Fox et al., “Integrating Information Appliances into an Interactive Workspace,” 2000, IEEE Computer Graphics and Applications, vol. 20, Iss.3, p. 54-65.
U.S. Appl. No. 11/685,014, Apr. 3, 2009, Office Action.
U.S. Appl. No. 11/685,014, Jul. 21, 2009, Notice of Allowance.
U.S. Appl. No. 10/429,931, Mar. 26, 2007, Office Action.
U.S. Appl. No. 10/429,931, Sep. 7, 2007, NOA.
U.S. Appl. No. 10/429,931, Jan. 30, 2008, NOA.
U.S. Appl. No. 10/996,557, Jul. 27, 2007, Office Action.
U.S. Appl. No. 10/996,557, Mar. 21, 2008, Office Action.
U.S. Appl. No. 10/996,557, Nov. 6, 2008, Office Action.
U.S. Appl. No. 10/996,557, Oct. 5, 2009, Notice of Allowance.
U.S. Appl. No. 10/996,371, Aug. 8, 2007, Office Action.
U.S. Appl. No. 10/996,371, Feb. 28, 2008, Office Action.
U.S. Appl. No. 10/996,371, Oct. 1, 2008, Office Action.
U.S. Appl. No. 10/996,371, Apr. 16, 2009, Notice of Allowance.
U.S. Appl. No. 10/429,932, Aug. 9, 2005, Office Action.
U.S. Appl. No. 10/429,932, Oct. 4, 2005, Office Action.
U.S. Appl. No. 10/429,932, Mar. 17, 2006, Office Action.
U.S. Appl. No. 10/429,932, Aug. 15, 2006, Office Action.
U.S. Appl. No. 10/429,932, Jan. 25, 2007, Notice of Allowance.
U.S. Appl. No. 10/429,943, Jul. 6, 2007, Office Action.
U.S. Appl. No. 10/429,943, Sep. 28, 2007, Office Action.
U.S. Appl. No. 10/429,943, Mar. 26, 2008, Office Action.
U.S. Appl. No. 10/429,943, Aug. 6, 2008, Office Action.
U.S. Appl. No. 10/429,943, Feb. 6, 2007, Office Action.
U.S. Appl. No. 10/429,943, Feb. 6, 2009, Notice of Allowance.
U.S. Appl. No. 10/429,943, Apr. 6, 2009, Notice of Allowance.
U.S. Appl. No. 10/677,118, Mar. 18, 2008, Office Action.
U.S. Appl. No. 10/677,118, Nov. 28, 2008, Office Action.
U.S. Appl. No. 10/677,118, Mar. 19, 2009, Notice of Allowance.
U.S. Appl. No. 10/429,903, Jan. 3, 2007, Office Action.
U.S. Appl. No. 10/429,903, Oct. 15, 2007, Office Action.
U.S. Appl. No. 10/429,903, Apr. 24, 2008, Notice of Allowance.
U.S. Appl. No. 10/429,933, Sep. 24, 2007, Office Action.
U.S. Appl. No. 10/429,933, Feb. 15, 2008, Office Action.
U.S. Appl. No. 10/429,933, Aug. 20, 2008, Office Action.
U.S. Appl. No. 10/429,933, Mar. 6, 2007, Office Action.
U.S. Appl. No. 10/429,905, Feb. 14, 2007, Office Action.
U.S. Appl. No. 10/429,905, May 21, 2007, Office Action.
U.S. Appl. No. 11/837,302, May 15, 2008, Office Action.
U.S. Appl. No. 11/837,302, Jan. 2, 2009, Office Action.
U.S. Appl. No. 11/837,302, Mar. 24, 2009, Notice of Allowance.
U.S. Appl. No. 10/429,930, Apr. 4, 2006, Office Action.
U.S. Appl. No. 10/429,930, Jul. 14, 2006, Office Action.
U.S. Appl. No. 10/429,930, Nov. 14, 2006, Office Action.
U.S. Appl. No. 10/429,930, Mar. 16, 2007, Notice of Allowance.
U.S. Appl. No. 11/509,431, Oct. 20, 2008, Office Action.
U.S. Appl. No. 11/509,431, Apr. 24, 2009, Office Action.
U.S. Appl. No. 11/509,431, Sep. 25, 2009, Office Action.
U.S. Appl. No. 11/509,437, Oct. 15, 2008, Office Action.
U.S. Appl. No. 11/509,437, Apr. 15, 2009, Office Action.
U.S. Appl. No. 11/509,437, Sep. 15, 2009, Office Action.
U.S. Appl. No. 10/430,369, Sep. 26, 2006, Office Action.
U.S. Appl. No. 10/430,369, Mar. 20, 2007, Office Action.
U.S. Appl. No. 10/430,369, Jul. 30, 2007, Office Action.
U.S. Appl. No. 10/430,369, Apr. 23, 2008, Notice of Allowance.
U.S. Appl. No. 10/677,084, Aug. 10, 2005, Office Action.
U.S. Appl. No. 10/677,084, Jan. 19, 2006, Office Action.
U.S. Appl. No. 10/677,084, Jul. 31, 2007, Office Action.
U.S. Appl. No. 10/677,084, Jan. 11, 2008, Office Action.
U.S. Appl. No. 10/677,084, Apr. 29, 2008, Notice of Allowance.
U.S. Appl. No. 10/677,084, Mar. 16, 2006, Office Action.
U.S. Appl. No. 10/677,084, Sep. 6, 2006, Office Action.
U.S. Appl. No. 10/677,084, Feb. 2, 2007, Notice of Allowance.
U.S. Appl. No. 11/053,186, Feb. 20, 2009, Office Action.
U.S. Appl. No. 10/996,558, Feb. 19, 2009, Office Action.
U.S. Appl. No. 10/996,558, Aug. 27, 2009, Notice of Allowance.
U.S. Appl. No. 11/112,456, May 12, 2009, Office Action.
U.S. Appl. No. 10/996,634, Nov. 5, 2008, Office Action.
U.S. Appl. No. 10/996,634, Mar. 30, 2009, Notice of Allowance.
U.S. Appl. No. 10/677,084, Nov. 1, 2006, Office Action.
U.S. Appl. No. 11/053,186, Sep. 2, 2009, Office Action.
U.S. Appl. No. 11/112,456, Nov. 30, 2009, Office Action.
U.S. Appl. No. 11/509,431, Dec. 24, 2009, Office Action.
U.S. Appl. No. 11/509,431, Feb. 22, 2010, Office Action.
U.S. Appl. No. 10/429,904, Mar. 24, 2010, Office Action.
U.S. Appl. No. 12/542,506, Apr. 29, 2010, Office Action.
U.S. Appl. No. 11/053,186, May 13, 2010, Notice of Allowance.
U.S. Appl. No. 10/429,904, Aug. 3, 2010, Notice of Allowance.
U.S. Appl. No. 11/509,437, Dec. 22, 2010, Notice of Allowance.
U.S. Appl. No. 11/559,821, Mar. 4, 2011, Office Action.
U.S. Appl. No. 12/563,026, Mar. 28, 2011, Office Action.
U.S. Appl. No. 12/431,597, Jun. 8, 2011, Office Action.
U.S. Appl. No. 11/559,821, Jul. 19, 2011, Office Action.
U.S. Appl. No. 12/563,026, Aug. 25, 2011, Office Action.
U.S. Appl. No. 12/563,041, Oct. 17, 2011, Office Action.
U.S. Appl. No. 12/431,597, Oct. 25, 2011, Notice of Allowance.
U.S. Appl. No. 11/559,821, Nov. 10, 2011, Office Action.
U.S. Appl. No. 12/563,026, Jan. 4, 2012, Notice of Allowance.
U.S. Appl. No. 12/563,041, Mar. 13, 2012, Office Action.
U.S. Appl. No. 12/370,579, filed Feb. 12, 2009, Cadiz.
Chung-Hsien Wu et al., Intelligent Call Manager Based on the Integration of Computer Telephony, Internet and Speech Processing, Jun. 1998, Consumer Electronics, Digest of Technical Papers. p. 86-87.
Partial European Search Report for EP Application No. 04012125, Applicant: Microsoft Corporation, Mailing Date: Jul. 27, 2010, 5 pages.
Ericsson Enterprise brochure entitled, “BusinessPhone Computer Telephony Platforms,” produced in Aug. 2003, http://www.ericsson.comwenter-risellibrary/brochuresdatasheets/-buisiness-hone1/0-2-3 676.pdf.
European Search Report for EP Application No. 04 02 0332, Dec. 8, 2004.
Genesys tutorial entitled, “Network Computer-Telephony (CTI) Delivering Intelligent Network (IN) Services,”http://www.komunikasi.org/acrobat/service/Network—CTI.pdf. [Last Accessed Mar. 22, 2010].
“Advanced Call Center: Computer Answering Machine Software,” http://www.voicecallcentral.com/advancescallcanter.htm, [Last Accessed May 19, 2004].
“Audio Conferenceing and Web Presentation Solutions from edial,” http://www.edial.com/, [Last Accessed May 19, 2004].
“Computer Answering Machine Software,” http://www.voicecallcentral.com, [Last Accessed May 19, 2004].
“Computer Telephony Integration CTI,” http://seimens.com/index.jsp?sdcP=pHPo1467fcis4mnu0, [Last Accessed May 19, 2004].
“Computer Telephony Integration,” http://toshiba.com/taistsd/pages/prd—cti—main.html, [Last Accessed May 19, 2004].
“Computer Telephony Integration,” http://databasesystemsscorp.com/pscti.htm, [Last Accessed May 19, 2004].
“CTI-Computer Telephony Integration-Smartphone,” http://www.oak.com.uk/cti2.htm, [Last Accessed May 19, 2004].
“e-Zest Solutions,” http://www.e-zest.net/cti-India.html, [Last Accessed May 19, 2004].
“Get Virtual, Stay Connected,” http://www.alexis.com/, [Last Accessed May 19, 2004].
Kaukonen, Saku, “Software Agents for Mobile Computer Telephone Integration,” http://control.hut.fi/Hvotvniemi/Publications/2OOOarpakannus?SakuKauukonen.pdf, pp. 18/21, Feb. 2000.
Kehradpir et al., U.S. Appl. No. 60/275,031, Mar. 13, 2001, pp. 1-11 and drawings.
Lucent Technologies paper entitled, “CTI Computer Technologies Integration,” in Index, pp. 1-12, Dec. 2000, http://www.aetech.co.uk/Products/telecomslctibrochure.pdf.
Matsushima, H., Toshiyuki, S., and Toshiaki, K., “Integration of Computer Networks and Class Telephony Systems—computer Telephony Integration,” In Itachi Review, vol. 48 (Jan. 1998), No. 2, pp. 55-58.
Strathmeyer, Carl R., “Choosing a Computer-Telephone Server,” originally published in the 1996 International VoicePower Directory and Buyer's Guide, pp. 24-26, Feb. 1996, http://www.intel.com/network/csp--df/vp96.pdf.
Zafar et al., “Appendix for United States provisional patent application for method and apparatus for a unified communication amanger via instant messaging,” Mar. 13, 2001.
U.S. Appl. No. 11/559,821, Apr. 24, 2012, Notice of Allowance.
U.S. Appl. No. 12/370,579, Apr. 18, 2011, Office Action.
U.S. Appl. No. 12/370,579, Nov. 25, 2011, Office Action.
U.S. Appl. No. 10/445,395, Nov. 2, 2006, Office Action.
U.S. Appl. No. 10/445,395, Apr. 12, 2007, Office Action.
U.S. Appl. No. 10/445,395, Nov. 15, 2007, Office Action.
U.S. Appl. No. 10/445,395, Jun. 9, 2008, Office Action.
U.S. Appl. No. 10/445,395, Mar. 18, 2009, Office Action.
U.S. Appl. No. 10/445,395, Sep. 22, 2009, Office Action.
U.S. Appl. No. 12/370,588, Nov. 21, 2011, Office Action.
U.S. Appl. No. 12/370,588, Jun. 13, 2011, Office Action.
Response to Office Action dated Dec. 19, 2012 in U.S. Appl. No. 13/612,134, filed Feb. 20, 2013.
U.S. Appl. No. 13/612,134, mailed Dec. 19, 2012, Office Action.
Office Action dated Mar. 7, 2013 cited in U.S. Appl. No. 13/612,134.
Related Publications (1)
Number Date Country
20120200518 A1 Aug 2012 US
Continuations (4)
Number Date Country
Parent 12563026 Sep 2009 US
Child 13445221 US
Parent 12431597 Apr 2009 US
Child 12563026 US
Parent 11685014 Mar 2007 US
Child 12431597 US
Parent 10677101 Sep 2003 US
Child 11685014 US