Patent Application
20150249547
The present invention relates generally to conference bridge communications and, more particularly, to methods and systems for dynamically selecting a master server for a conference bridge communication.
Conference communications, namely the capability for more than two parties to simultaneously communicate, is a fundamental feature of audio and video electronic communications. Heretofore a variety of methods exist to enable conference communications, and all involve some method to receive and deliver communications media from and to the parties in conference. In some systems, all communications are simultaneously point-to-point, while in other systems all communications are hub-and-spoke where the hub handles receiving, mixing, and sending media for all parties. Mixing media is useful in the case of audio to simulate in-person communications in the cases where individual conference parties are speaking simultaneously.
Prior art systems typically assign a single hub for a master conference server. Furthermore, prior art systems do not allow master conference servers to be dynamically selected or dynamically allocated for various failover conditions. What is needed is a system and method for dynamically selecting a master conference server in real time that has the ability to adjust for failover conditions and other call-quality requirements.
The present invention meets one or more of the above-referenced needs as described herein in greater detail.
The present invention relates generally to conference bridge communications and, more particularly, to methods and systems for dynamically selecting a master server for a conference bridge communication. Briefly described, aspects of the present embodiments include the following.
In a first aspect, the present embodiment provides a system and method for selection of a conference bridge master server. The system and method includes a load balancer for connecting a plurality of calls to at least one of a plurality of conference servers for handling call media. The load balancer receives a plurality of calls, wherein a first call of the plurality of calls contains first call media, a second call of the plurality of calls contains second call media, and the first call and the second call are each directed to a conference bridge. A master broker is provided for selecting a master conference server. The master conference server is selected from among the plurality of conference servers to which the plurality calls are connected. The master broker is configured for directing all the other conference servers to bridge their call media to the master conference server. The master conference server is configured for providing communication services including organizing and mixing the call media from each of the conference servers to facilitate a conference bridge communication session.
In still a further aspect, the present embodiments disclose that the master broker relies on load metrics monitored on each of the conference servers in selecting the master conference server. The master broker may also rely upon quality performance metrics monitored on each of the conference servers to select the master conference server. Furthermore, the selection of the master conference server by the master broker relies on geo-location information of each conference server or each connected user.
In a further embodiment the master conference server may be dynamically changed by the master broker during a conference bridge communication session based upon load metrics monitored on the master conference server and each of the other conference servers. In still another embodiment the master conference server may be dynamically changed by the master broker during a conference bridge communication session based upon quality performance metrics monitored on the master conference server and each of the other conference servers.
The above features as well as additional features and aspects of the present invention are disclosed herein and will become apparent from the following description of preferred embodiments of the present invention.
This summary is provided to introduce a selection of aspects and concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
The foregoing summary, as well as the following detailed description of illustrative embodiments, is better understood when read in conjunction with the appended drawings. For the purpose of illustrating the embodiments, there is shown in the drawings example constructions of the embodiments; however, the embodiments are not limited to the specific methods and instrumentalities disclosed. In the drawings:
Before the present methods and systems are disclosed and described in greater detail hereinafter, it is to be understood that the methods and systems are not limited to the disclosed methods, components, or implementations. It is also to be understood that the terminology used herein is for the purpose of describing particular aspects and embodiments only and is not intended to be limiting.
As used in the specification and the appended claims, the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. “Optional” or “optionally” means that the subsequently described event or circumstance may or may not occur, and the description includes instances where the event or circumstance occurs and instances where it does not.
Throughout the description and claims of this specification, the word “comprise” and variations of the word, such as “comprising” and “comprises,” mean “including but not limited to,” and are not intended to exclude, for example, other components, integers or steps. “Exemplary” means “an example of” and is not intended to convey an indication of preferred or ideal embodiment. “Such as” is not used in a restrictive sense, but for explanatory purposes.
Disclosed herein are components that can be used to perform the disclosed methods and systems. It is understood that when combinations, subsets, interactions, groups, etc. of these components are disclosed that although specific reference to each various individual and collective combinations and permutations cannot be explicitly disclosed, each is specifically contemplated and incorporated herein, for all methods and systems. This applies to all aspects of this specification including, but not limited to, steps in disclosed methods. Thus, if there are a variety of additional steps that can be performed it is understood that each of the additional steps can be performed with any specific embodiment or combination of embodiments of the disclosed methods.
As will be appreciated by one skilled in the art, the methods and systems may take the form of an entirely new hardware embodiment, an entirely new software embodiment, or an embodiment combining new software and hardware aspects. Furthermore, the methods and systems may take the form of a computer program product on a computer-readable storage medium having computer-readable program instructions (e.g., computer software) embodied in the storage medium. More particularly, the present methods and systems may take the form of web-implemented computer software. Any suitable computer-readable storage medium may be utilized including hard disks, non-volatile flash memory, CD-ROMs, optical storage devices, and/or magnetic storage devices. An exemplary computer system is detailed in the discussion of
Embodiments of the methods and systems are described below with reference to block and flowchart diagrams of methods, systems, apparatuses and computer program products. It will be understood that each block of the block diagrams and flowchart diagrams, respectively, can be implemented by computer program instructions. These computer program instructions may be loaded onto a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions which execute on the computer or other programmable data processing apparatus create a means for implementing the functions specified in the flowchart block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including computer-readable instructions for implementing the function specified in the flowchart block or blocks. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions that execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.
Accordingly, blocks contained in the block diagram and flowchart diagrams support combinations of means for performing the specified functions, combinations of steps for performing the specified functions and program instruction means for performing the specified functions. It will also be understood that each block of the block diagram and flowchart diagrams, and combinations of blocks in the block diagram and flowchart diagrams, can be implemented by special purpose hardware-based computer systems that perform the specified functions or steps, or combinations of special purpose hardware and computer instructions.
In an exemplary embodiment, one or more parties 101-104 to a conference call attempt to initiate a connection to the conferencing system 100. Each call attempt by the one or more parties 101-104 to the conference call is routed via a Call Load Balancer 110 to one or more Conference Servers 120. At least one of the individual Conference Servers 121-124 is dynamically selected by a Master Broker 130 to become the conference Master Server 140 for managing the conference call.
Further in
Each individual calling party 101-104 gets directed to a Call Load Balancer 110. The Call Load Balancer 110 is a communications networking method for distributing workloads across multiple computing resources, such as a computer server cluster, a computer cluster, network links, central processing units and the like.
A Call Load Balancer 110 is a computer networking method for distributing workloads across multiple computing resources, such as computers, a computer cluster, network links, servers, etc. Load balancing aims to optimize resource use, maximize throughput, minimize latency, and avoid overload of any one of the computing and communications resources. The load balancer is usually a software application that is listening on the port where external clients (e.g. conference call party) connect to access services. As external clients attempt to access services on a network, the Call Load Balancer 110 uses a selection algorithm to determine which of the available servers on the network is most capable of processing the external client's request. In an exemplary embodiment, the selection algorithm seeks to allocate new external client requests or calls across the available servers based on the various server's current load, capabilities, geo location, Domain Name System (DNS) addressing, and the like. Although the exemplary example relies on a Call Load Balancer 110 that directs the new external client requests or calls based on the active load at each individual server, any number of factors can be considered when distributing the incoming calls among the servers.
In an exemplary embodiment, the conference bridge number or resource URL will typically direct each individual conference call party to the same Call Load Balancer 110. However, depending on the call load, geo-location of the caller, type of calling device, etc., the call may be handled by a different Call Load Balancer 110. In an exemplary embodiment, all of the individual conference call parties connecting to the conference 101-104 are routed through the same Call Load Balancer 110. The Call Load Balancer 110 will attempt to distribute incoming conference call parties 101-104 to among one or more Conference Servers 121-124.
The Call Load Balancer 110 will balance the call load by distributing the incoming call from among the plurality of conference call parties 101-104 via one or more Conference Servers 121-124. The Conference Servers 120 are responsible for receiving communications from and sending communications directly to the individual conference call party's 101-104 specific communications device. For example, the Conference Servers 121-124 might be receiving and sending IP communications to an individual conference call party's 101-104 VoIP Phone. Each individual conference call party 101-104 is connected to an individual Conference Server 121-124. In an exemplary implementation this might mean that none of the individual conference call parties 101-104 are connected to the same Conference Server 121-124.
In addition to having the capabilities to send and receive network communications for a communications conference, the Conference Servers 120 may also have the capability to provide other or associated communication services to the individual conference parties 101-104. For example, the Conference Servers 120 have capabilities to record calls, including on demand when indicated by a user-initiated network or IP communication that identifies that call recording should start or stop.
All Conference Servers 120 are in communication across the computer network with a Master Broker 130. The Master Broker 130 is a component, which the Conference Servers 120 can notify or query when conference events occur, such as when conference communications are initiated or terminated by an individual conference call party 101-104, or when there is some kind of disruption or problem in conference communications. The Master Broker 130 may also have capabilities to monitor the system elements of the Conference Servers 120, such as their central processing unit (CPU) or memory usage or the number of concurrent processes or calls being handled by each individual Conference Server 121-124. The Master Broker 130 may also have capabilities to monitor other system components, or to read from other system monitoring components, in order to gather further information related to the performance of the Conference Servers 120, such as gathering network performance statistics from computer networking equipment or monitoring systems which might provide indicators for the conference communication quality experienced by each individual conference call party 101-104.
Furthermore, the Master Broker 130 may have its own or connected data storage system 135, such as a memory cache, a disk storage system, a database, or some combination of software and hardware systems that would allow the Master Broker 130 to store and retrieve information about the Conference Servers 120, the active conference call parties 101-104, conference communications, and any associated metrics such as load or performance metrics that the Master Broker 130 may be directly or indirectly able to gather, read, or receive from other components in the system. The Master Broker 130 may also read configuration data from the connected data storage system, which would be supplied by an administrator to identify how the Master Broker 130 should execute its logic.
Further in
The Master Broker 130 may select and designate the Master Conference Server 140 by using pre-configured logic that might be controlled or affected by administrator configuration data. For example, the Master Broker 130 may be configured to designate as the Master Conference Server 121-124, the Conference Server 120, from among the individual conference call parties, that is associated with the first calling party to the conference that is not already acting as Master Conference Server 140 for any other conference communications. The Master Broker 130 may also select the Master Conference Server 140 by using any of the dynamic system data that it has received or stored. For example, in an exemplary embodiment, the Master Broker 130 might designate a Conference Server 121-124 that has the least number of concurrent communication sessions or it might select the Conference Server 121-124 whose network location or geography is determined optimal for network communications with the plurality of Conference Servers 121-124 involved. For example, in an exemplary embodiment, there may be four callers on the conference call. Three of these callers might be located in San Francisco, Calif., and the fourth member of the conference call might be located in Miami, Fla. Therefore, the Master Broker 130 would likely chose a Master Conference Server 140 from among the Conference Servers 121-124 that are located on the western coast of the United States, in San Jose, Calif. for example; versus selecting a Conference Server 121-124 that is located in Akron, Ohio, but associated with a conference caller from Miami, Fla. In a further embodiment, the Master Broker 130, might select a Master Conference Server 140 in Huntsville, Ala. for a conference call with five participants in Baton Rouge, La. and two participants in Birmingham, Ala. if current weather conditions indicate that there is inclement weather in Louisiana. Therefore, any number of factors could be involved in the dynamic selection of the Master Conference Server 140.
The Master Broker 130 may also dynamically change the selection of the Master Conference Server 140 during the conference communications. For example, in a further exemplary embodiment, if the Master Broker 130 determines call quality, load, or other performance metrics from a previously designated Master Conference Server 140 falls below previously determined performance thresholds, then the Master Broker 130 can select a new, alternate Master Conference Server 140 from among the plurality of Conference Servers 121-124.
When a Master Conference Server 140 is selected for a specific conference communication session, the Master Broker 130 communicates the identity and other necessary information such as the IP address of the Master Conference Server 140 to all the Conference Servers 120 associated with that conference communication session. This may be done through a variety of well-known computer network communication methods, such as network broadcast or communications data push or pull. The Master Broker 130 initiates or responds to communications from each conference server 120. This allows the master conference server 140 to bridge and mix the media that is being processed by each of the other conference servers 121-123.
Turning now to
At step 215, the Call Load Balancer 110 receives the call and/or SIP Invite request from the one or more users participating in the conference call. If the conference authentication information is correct, the Call Load Balancer 110 begins the process of selecting a Conference Server 121-124 to anchor the call. The Call Load Balancer 110 may query a load balancing and configuration database or server 115 in order to determine which Conference Servers 120 are available and which of Conference Server 121-124 would be best to handle this particular call. In an exemplary embodiment, a Conference Server 121-124 that provides minimal latency (i.e. fast data transfer), high quality of service (QoS) metrics (e.g. minimal error rates, low transmission delay, low jitter, and larger bandwidth and throughput), and that is geographically close (based on the Internet Protocol address) to the conference call party 101-104 is selected. In fact, selection of the Conference Server 121-124 may be based on any number of performance, features and geographical factors. Once a Conference Server 121-124 is selected to anchor the call, a verification message containing the appropriate access credentials and communications routing information is provided to the conference call party's 101-104 SIP phone, mobile phone, computer, or other communications device. As other parties seek to join the conference, their devices are verified and anchored to a Conference Server 121-124 in a similar fashion. Once the Call Load Balancer 110 has anchored the conference calling party's 101-104 call to a Conference Server 120, the method moves on to step 230.
At step 230, the Conference Server 121-124 that was selected queries the Master Broker 130 at step 215 to get information regarding the conference call and to find out where the Master Conference Server 140 is located. In still another exemplary embodiment, a Master Conference Server 140 may be selected based on the type of conference that is being initiated. For example, a conference call that is audio only may require a different Master Conference Server 140 than a conference call that contains audio, video and data, because the selected Master Conference Server 140 must be able to handle all the types of media involved in the conference call. The Master Conference Server 140 may also be selected based on the its ability to communicate with certain other types of conference servers or even the type of device the conference calling party 101-104 is using to initiate the call, which for example, might involve using specific audio or video codecs and might require a Master Conference Server 140 capable of handling those codecs. If the Master Conference Server 140 has been selected, the method moves to step 250 where the Master Broker 130 provides the Conference Server 121-124 with address of the Master Server 140 and/or other access credentials. If no Master Server 140 has been selected, the method can select a new Master Server 140 from among the plurality of Conference Servers 121-124 based the features of each individual Conference Server 121-124 as discussed in to step 240 below.
At step 240, the Master Broker 130 dynamically selects and designates a Master Conference Server 140. The Master Broker 130 is able to make a selection of the Master Conference Server 140 by referencing information about conference servers 120 on the network. For example, as each one of the conference calling parties 101-104 calls into the network, their assigned Conference Server 120 can register their credentials and features with the Master Broker 130 and/or this information can be uploaded to a database 135. The database 135 contains information about each assigned conference server 120 and other components within the communications network. The database 135 may contain variety of analytical information including the type of Conference Servers 120 on the network, their features, current and past performance metrics, dynamic load, and call quality of services metrics and the like. The Master Broker 130 may also get information about individual conference servers 120 from a variety of means, including querying each conference server 120 for its features directly. The Master Broker 130 can also select and designate the Master Conference Server 140 by using pre-configured logic that might be controlled or affected by the analytical information available to it via one or more configuration databases 135. For example, if all of the Conference Servers 121-124 are similarly situated, the Master Broker 130 may be configured to designate as the Master Conference Server 140 the first Conference Server 121-124 that is not already acting as Master Conference Server 140 for any conference communications. The Master Broker 130 may also select the Master Conference Server 140 by using any of the dynamic system data that it has received or stored in the database 135. For example, the Master Broker 130 can designate from among the the Conference Servers 121-124, the conference server, conference server 121 for example, that has the least number of concurrent communication sessions, or it might select the Conference Server, conference server 124 for example, whose network location or geography is determined optimal for network communications with the plurality of Conference Servers 120 involved in the conference call. Once the Master Broker 130 selects a Master Conference Server 140 from among the plurality of Conference Servers 120, the Master Broker 130 begins informing and directing other conference call parties 101-104 to this Master Conference Server's location at step 250.
At step 250, once the Master Conference Server 140 is selected for a specific conference communication session, the Master Broker 130 communicates the identity, location and other necessary information such as the IP address of the Master Conference Server 140 to all the Conference Servers 121-124 associated with that conference call session. This may be done through a variety of well-known computer network communication methods, such as network broadcast or communications data push or pull. The Master Broker 130 initiates or responds to communications from each Conference Server 121-124, with the result being that Master Conference Server 140 is activated for media bridging and mixing. Each of the other Conference Servers 121-124 has the necessary network addresses or connections to the Master Conference Server 140 so that the means for bridging the conference communications media is provided. Once the Master Conference Server 140 is selected and other conference call parties 101-104 are notified, the method moves on to step 260.
At step 260, the Master Conference Server 140 bridges media from among the Conference Servers 120 and, when required, mixes media for all inter-party conference communications. In an exemplary embodiment, the Master Conference Server 140 mixes the various audio, video, data, and/or other media on the conference. The Conference Servers 120 are able to connect to any designated Master Conference Server 140, either through pre-established or dynamic network connections. The Master Conference Server 140 continues to manage the conference communications and media mixing until the conference call ends or until it is no longer designated the master. At step 270, a determination is made regarding the current Master Conference Server's 140 status as the master.
At step 270, at least one of the Master Broker 130, other network components or one of the conference servers 121-124, continually monitors performance metrics for all of the Conference Servers 120, and in particular, the Master Conference Server 140. Various network components measure call QoS metrics, network performance, dynamic load, and other analytical data so that this information can be stored in the database 135 and made available to the Master Broker 130. If at any point during the call, one or more of these performance metrics falls below a certain threshold, the Master Broker 130 can dynamically designate a new Master Conference Server 140 from among the plurality of Conference Servers 121-124 that are participating in the conference call network. Similarly if the Master Conference Server 140 fails for any other reason, a new master may also be selected at that time. Once it has been determined that a new Master Conference Server 140 is needed, the Master Broker 130 repeats steps 240-270 again.
Turning now to
The Conference Servers 330 can comprise a plurality of Conference Servers 331-334. Each of these Conference Servers 331-334 may have the same or a very different feature set. However, each of the Conference Servers 331-334 is capable of communicating with each other and all of the Conference A 310 and Conference B 320 calling parties as well as the Master Broker 340. In an exemplary embodiment, the Conference Servers 330 may have a different feature set or a different geo location.
The Master Broker 340 has access to configuration information for each of the Conference Servers 331-334 on the network. Therefore, the Master Broker 340 is aware of the location, feature set, and performance metrics of each of the Conference Servers 330. Therefore, the Master Broker 340 is capable of using its preconfigured logic to determine the optimal Master Server 140 for each conference call 310, 320. For example, the Master Broker 340 may conclude that conference servers 331, 332, and 333 have identical geo location and performance metrics; however conference servers 332 cannot handle video. The Master Broker 340 may also conclude that Conference Servers 331, 333 and 334 can handle video, audio and data. If the conference call party 311, assigned to Conference Server 331, was the first to call into the Conference A 310, the Master Broker 340 may designate Conference Server 331 as the Master Conference server for Conference A 310. Media from Call Party 311 can now be mixed on Conference Server 331; media from Call Party 312 is anchored by Conference Server 332 and mixed at Master Conference Server 331; media from Call Party 313 is anchored by Conference Server 333 and mixed at Master Conference Server 331; and media from Call Party 314 is anchored by Conference Server 334 and mixed at Master Conference Server 331.
In the exemplary embodiment in
Embodiments herein allow conference communication services to be more efficiently provided with higher reliability and quality of service in a multi-tenant server system. Multi-tenant server systems are especially effective in VoIP communications. Multi-tenancy refers to a principle in software architecture where a single instance of the software runs on a server, serving multiple client-organizations (tenants). Multi-tenancy contrasts with multi-instance architectures where separate software instances (or hardware systems) operate on behalf of different client organizations. With a multitenant architecture, a software application is designed to virtually partition its data and configuration, and each client organization works with a customized virtual application. This virtually partitioned data and individual client organization configuration ability allows these types of multi-tenant server systems to be effective Conference Servers 120 that can serve as multi-purpose communication servers providing other communication services (e.g. video and data) to various conference call users 101-104. The communication services are sometimes provided as a simultaneous part of an audio conference call. However, these communication services can sometimes be provided to the conference call users 101-104 separate from the audio call. An example of the communication services includes the ability to record calls, wherein the call recording might be used for both conference communications and other person-to-person communications. Other communication services may include collecting analytics about the various conference calls including the length, cost, number of participants, network performance, and gathering other data metrics. Conference Servers 120 can also provide other communication services to users, such as voicemail, call screening, and call forwarding. The embodiments herein provide an efficient and reliable way to dynamically establish conference communication bridges among Conference Servers 120, allowing for a more efficient use of Conference Server 120 resources in a multi-purpose communication services, multi-tenant environment.
Turning now to
The system bus 413 represents one or more of several possible types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures can comprise an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Private Branch Exchange (PBX) bus, a Video Electronics Standards Association (VESA) local bus, an Accelerated Graphics Port (AGP) bus, and a Peripheral Component Interconnects (PCI), a PCI-Express bus, a Personal Computer Memory Card Industry Association (PCMCIA), Universal Serial Bus (USB) and the like. The bus 413, and all buses specified in this description can also be implemented over a wired or wireless network connection and each of the subsystems, including the processor 403, a mass storage device 404, an operating system 405, software 406, data 407, a network adapter 408, system memory 412, an input/output interface 410, a display adapter 409, a display device 411, a human machine interface 402, can be contained within one or more remote computing devices 414a,b,c at physically separate locations, connected through buses of this form, in effect implementing a fully distributed system.
The computer 401 typically comprises a variety of computer readable media. Exemplary readable media can be any available media that are accessible by the computer 401 and comprise, for example, both volatile and non-volatile media, as well as, removable and non-removable media. The system memory 412 comprises computer readable media in the form of volatile memory, such as random access memory (RAM), and/or non-volatile memory, such as read only memory (ROM). The system memory 412 may contain data such as media, video, audio, or other data 407 and/or program modules such as an operating system 405 and software 406 capable of manipulating, translating, transcoding, or otherwise editing the data 407 that are immediately accessible to and/or presently operated on the by the processing unit 403.
In another aspect, the computer 401 can also comprise other removable/non-removable, volatile/non-volatile computer storage media. By way of example,
Optionally, any number of program modules can be stored on the mass storage device 404, including by way of example, an operating system 405 and hosted VoIP PX software 406. Both the operating system 404 and hosted VoIP PX software 406 (or some combination thereof) can comprise elements of the programming and the hosted VoIP PX software 406. Media, video, audio, or other data 407 can be stored in any of one or more databases known in the art. Examples of such databases comprise, DB2®, Microsoft® Access, Microsoft® SQL Server, Oracle®, MySQL, PostgreSQL, and the like. The databases can be centralized or distributed across multiple systems. Examples of hosted VoIP PX software include Asterisk®, FreeSwitch®, or Microsoft Lync® server software.
In another aspect, the user can enter commands and information into the computer 401 via client device or an input device (not shown). Example of such input devices comprise a keyboard, pointing device (e.g., a “mouse”), a microphone, a joystick, a scanner, tactile input devices such as gloves, and other body coverings, and the like. These and other input devices can be connected to the processing unit 403 via a human machine interface 402 that is coupled to the system bus 413, but also can be connected by other interface and bus structures, such as a parallel port, game port, IEEE 1394 Port (also known as a Firewire port), a serial port, or a universal serial bus (USB).
In yet another aspect, a display device 411 can also be connected to the system bus 413 via an interface, such as a display adapter 409. It is contemplated that the computer 401 can have more than one display adapter 409, and the computer 401 can have more than one display device 411. For example, a display device can be a monitor, an LCD (Liquid Crystal Display), or a projector. In addition to the display device 411, other output peripheral devices can comprise components such as speakers (not shown) and a printer (not shown), which can be connected to the computer 401 via input/output interface 410. Any step and/or result of the methods can be output in any form to an output device. Such output can be any form of visual representation, including but not limited to, textual, graphical, animation, audio, tactile, and the like. The display 411 and computer 401 can be part of one device, or separate devices.
The computer 401 can operate in a networked environment using logical connections to one or more remote computing devices 414a,b,c. By way of example, a remote computing device can be a personal computer, portable computer, smartphone, softphone, client device, a server, a router, a network computer, a peer device or other common network node, and so on. Logical connections between the computer 401 and remote computing device 414a,b,c can be made via a network 415, such as a local area network (LAN) and or a general wide area network (WAN). Such network connections can be through a network adapter 408. A network adapter 408 can be implemented in both wired and wireless environments. Such networking environments are conventional and commonplace in dwellings, offices, enterprise-wide computer networks, intranets, and the Internet.
For purposes of illustration, application programs and other executable program components such as the operating system 405 are illustrated herein as discrete blocks, although it is recognized that such programs and components reside at various times in different storage components of the computing device 401, and are executed by the data processor(s) of the computer. An implementation of media manipulation software 406 can be stored on or transmitted across some form of computer readable media. Any of the disclosed methods can be executed by computer readable instructions embodied on computer readable media. Computer readable media can be any available media that can be accessed by a computer. By way of example and not meant to be limiting, computer readable media can comprise “computer storage media” and “communications media.” “Computer storage media” comprises volatile and non-volatile, removable and non-removable media implemented in any methods or technology for storage of information such as computer readable instructions, data structures, program modules, or other data. Exemplary computer storage media comprises, but is not limited to RAM, ROM, EEPROM, flash memory or memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.
The methods and systems can employ Artificial Intelligence (AI) techniques such as machine learning and iterative learning. Examples of such techniques include, but are not limited to, expert systems, case-based reasoning, Bayesian networks, behavior-based AI, neural networks, fuzzy systems, evolutionary computation (e.g. genetic algorithms), swarm intelligence (e.g. ant algorithms), and hybrid intelligent system (e.g. expert interference rules generated through a neural network or production rules from statistical learning).
In the case of program code execution on programmable computers, the computing device generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. One or more programs may implement or utilize the processes described in connection with the presently disclosed subject matter, e.g., through the use of an API, reusable controls, or the like. Such programs may be implemented in a high level procedural or object-oriented programming language to communicate with a computer system. However, the program(s) can be implemented in assembly or machine language. In any case, the language may be a compiled or interpreted language and it may be combined with hardware implementations.
Although exemplary implementations may refer to utilizing aspects of the presently disclosed subject matter in the context of one or more stand-alone computer systems, the subject matter is not so limited, but rather may be implemented in connection with any computing environment, such as a network or distributed computing environment. Still further, aspects of the presently disclosed subject matter may be implemented in or across a plurality of processing chips or devices, and storage may similarly be affected across a plurality of devices. Such devices might include PCs, network servers, mobile phones, softphones, and handheld devices, for example.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
