The present invention relates generally to information processing systems and more particularly to a methodology and implementation for processing teleconference communications.
Currently, audience feedback metering is often used for evaluating speeches, seminar presentations or contestants' performances in song, dance and sports competitions. In these situations, the goal is to evaluate the presenter for their presentation, speech, singing/dancing or some other ability. Another popular example is the presidential debate series where such systems are used to measure an audience's live reaction to a candidate's speech. These solutions normally require extensive set up that may include creating a live web-based polling system or a telephone line bank for telephone-based polling or using individual hardware devices that are provided to a panel of people who can enter their feedback into the devices for subsequent measurement. Because of effort involved, these solutions are used during specific events, such as the ones mentioned above, and are unsuited for the purpose of measuring participant feedback for facilitation of everyday business meetings and the like.
There also exist webcast or web-seminar software systems that utilize instant polling mechanisms to gauge audience feedback. These solutions require the webcast or web-seminar moderator to take specific actions to set up the questions of the poll and to actively solicit feedback. These kinds of feedback systems enable a moderator to get feedback at specific times in a survey format but do not provide real-time live reaction measurement capability.
Further, many businesses are adopting telecommuting in the workplace. With an increase in telecommuting, traditional meetings that took place in a conference room are being replaced by telephone conferences. In telephone conferences, participants located at various locations dial into a “conference call.” Using a telephone as a communications medium restricts information transfer to only verbal communication. Sometimes the telephone conferences are supplemented by instant message conferences or web conferences so that the participants can share presentations or exchange text messages with each other. One of the drawbacks of teleconferences is the attenuation of immediate feedback from participants. It is difficult for a meeting moderator to determine if participants are reacting favorably to the current topic of discussion. In the absence of visual cues such as body language and facial expressions, the meeting moderator is also unable to determine the interest level of the participants. In many cases, the meeting moderator has to specifically solicit participants for feedback such as asking questions to gauge if the participants agree with the current direction the meeting is headed. In other cases, the moderators have to use their own judgment to direct the meeting which may add the risk of alienating participants.
Therefore, a solution is needed to provide meeting moderators with automated means to continuously monitor instant participant feedback on the quality of a teleconference meeting that they are moderating.
A method, medium and implementing processing system are provided for facilitating teleconference-based meeting moderation by the addition of a “live feedback” feature, with instrumentation such as by means of an instant messaging systems. When instant messaging conference systems equipped with this feature are used to supplement teleconferences, the participants provide instant feedback (anonymously, if desired) to the meeting moderator. The audience can let the moderator know their valuation of the current discussion. Based on feedback, the moderator can take appropriate action, such as to steer the conversation into areas that will be received favorably by the meeting participants. In an exemplary embodiment, a first communication channel is established for conducting an audio or video teleconference and a second communication channel is established between a meeting moderator and members or participants of the audience or meeting. The first channel enables the moderator to conduct the meeting while the second or parallel channel enables the participants to provide instant real-time feedback to the material being presented.
A better understanding of the present invention can be obtained when the following detailed description of a preferred embodiment is considered in conjunction with the following drawings, in which:
The various methods discussed herein may be implemented within a communication system which includes processing means, memory, updateable storage, input means and display means. Since the individual components of a communication system which may be used to implement the functions used in practicing the present invention are generally known in the art and composed of electronic components and circuits which are also generally known to those skilled in the art, circuit details beyond those shown are not specified to any greater extent than that considered necessary as illustrated, for the understanding and appreciation of the underlying concepts of the present invention and in order not to obfuscate or distract from the teachings of the present invention. Although the invention is illustrated in the context of a hard-wired audio teleconference, it is understood that wireless cellular or other wireless systems may also be implemented to achieve the beneficial functional features described. Further, it is understood that the principles of the invention may be implemented in any of many available and future communication devices and systems.
The present invention provides for the participants to provide feedback continuously in real time. The feedback is collected, analyzed and rendered, for example, as a moving graph on a feedback window presented to the moderator for immediate feedback. This provides the moderator with a “situational awareness” of how a teleconferenced meeting or presentation is going at all times.
Another advantage of the present invention is its automation that allows efficient management of meetings, i.e. the moderator does not have to manually set up instant polls and actively take the time to solicit feedback and analyze the feedback every so often. The participants can provide the feedback on their own, resulting in time savings.
In accordance with the present invention, methods are provided to enable a meeting moderator to obtain continuous, real-time feedback for the current discussion during teleconferences. These ratings can be used to assess the applicability of the discussion and potentially allow the moderator to change the course of the discussion. The methodology of the present invention may be applied to Instant Messaging (IM) conferences, web conferences, web services and other networked communication systems and arrangements.
In one exemplary embodiment, a histogram (not shown), or other type of bar chart or graphic device is used to show the number of participants selecting each discrete choice, rather than, or in addition to, the average value. Other specific implementations include the use of a slider bar rather than discrete choices. Further, a two-dimensional selection may also be implemented in which interest along one axis and level-of-detail along another axis are displayed. In another example, the use of VOIP allows participants to enter feedback via telephone keypad.
In the following disclosed exemplary embodiment, during a telephone conference call, a moderator starts an instant messaging conference and invites participants of the meeting to that instant messaging conference. In addition, the moderator starts the “live feedback” feature as hereinafter described. Upon feature activation, graphical feedback buttons, which made be either hardware or software implemented, and are labeled, for example, “positive”, “negative” and “neutral” are enabled in each participant's display device in a personal conference window. Depending on the embodiment, the buttons may represent any kind of feedback such “Too verbose,” “Bad Topic,” “Good Point”, etc. The buttons may also allow participants to type in text comments, or select predetermined generic text comments.
In one example, on the moderator's instant messaging window presented on his display device, a feedback meter is rendered. The moderator may share this with others if he/she wishes to. During the conference call, the participants can, anonymously, provide feedback (and type in any comments) on the relevance of current conversation. The favorability percentage is computed, which includes methods to appropriately average the favorability depending on the participants. It is to be noted that feedback meter is continuously updating as time progresses as opposed to discrete poll results. The moderator's meter reflects the feedback collected and based on this, the moderator can determine whether the participants are interested or not in the discussion that is occurring and, based on the feedback, the moderator can take appropriate action to steer the conversation into areas that will be received more favorably.
This feature is very useful to moderators of teleconferences who are interested in making the most efficient use of meeting time. They can easily determine if—in view of the majority of participants—the meeting is wasting time or discussing something useful. They may receive other participants opinions in real time without the need for manually polling participants. Having a live anonymous system that takes into account a majority's opinions also assures the moderator that if they steer the discussion in a certain direction, they will not risk alienating a majority of the participants. The disclosed invention makes a 2-way live feedback loop ability universally available to every business meeting at a “consumer level”. The current solution is a continues feedback system that does not require a moderator to setup and repeatedly poll conference members.
The following example uses an IM system although it is noted that similar methods may be used for other input solutions such as web sites, web services, phone input, etc. The present example illustrates a new computer processing system method that can be added to instant messaging software. In the exemplary embodiment illustrated, the processing includes three basic routines.
The first routine, running within the IM client software that runs on the moderator's workstation, is activated when a meeting moderator starts an instant messaging conference, invites participants and activates the “live feedback” feature by pressing a graphical button or selecting a menu option selection. With this feature enabled, this routine sends a signal to the instant message client software running on all the participant's personal computers. This activates a second routine running on the participant's personal computer that activates the feedback buttons on the participants, personal conference windows. Depending on the embodiment, the buttons may represent any kind of feedback such as “positive”, “negative” or “neutral”, “bad topic”, “interesting topic”. The buttons may also allow participants to type in text comments such as “too verbose” or “excellent point”, etc.
In addition, on the moderator's personal instant messaging window, the first routine displays a feedback device, for example a meter showing a graph of the feedback. Depending on the embodiment, this can be a running line graph that ascends or descends based on feedback or a bar graph showing number of responses in each feedback category. While the meeting is active, the second routine - running within the client instant messaging software that runs on each participant's workstation - monitors for feedback button presses or comments. Once it receives a button press event, it determines the particular feedback option selected and sends a signal to a third routine. It is to be noted that in another embodiment of the invention, the second routine that runs within the client software running on the participants' workstations may prevent a single participant from giving excessive feedback that could lead to an unnecessary bias in the feedback results. The client software may do this by ignoring more than a specific number of feedback button presses within a given time period.
The third routine running within the IM client software that runs on the moderator's workstation, monitors reception of a signal from the participants (that is, from the second routine running on participants' workstations) containing feedback data. Once it receives such a signal, it retrieves feedback data from signal and collates it. It assigns a mark or rank to each selected feedback option received from a participant and then calculates and maintains the present feedback score. Detecting the present feedback score requires analyzing feedback in distinct quanta. The first vote received starts a new data collection quanta. As each 5 additional vote is received, the quanta is extended by some fraction of the original quanta. If the quanta expires the next vote starts a new quanta. For example, consider a system selects a quanta time of 20 seconds and a quanta extension per additional vote of ⅕ quanta. The first person votes and a new quanta is started, a second person votes 6 seconds later extending the total quanta to 24 seconds (⅕th of 20). A third person votes at quanta start +14 extending the quanta to 28 seconds. Finally at quanta start+35 a vote is cast which starts a new 20 second quanta. It should be noted that this simple quanta system is exemplary in nature and embodiments may implement more accurate quanta delineation system while not deviating from the spirit of the disclosed invention.
A running average of overall feedback score is determined by summing the feedback and dividing by number of participants. Subsequently, the results are formatted for graphical display and those results are displayed on the feedback meter. These routines can continue to run for the duration of the instant message conference or until the moderator de-activates the live feedback option.
The proposed invention is not limited to instant messaging but may also allow feedback using a web site, web service or through the interception of a user's phone keypresses at a conference bridge. Such keypresses may then interpreted and transmitted to a described feedback collection service.
With specific reference to the illustrations presented in the drawings,
In the
Each of the communication or IM devices 108, 113 and 121 includes a display screen upon which a chat window 110, 117 and 125, respectively, is displayed. The moderator chat window 110 displays, inter alia, a participant feedback meter 111 as hereinbefore described. In addition, the moderator device 108 is configured to run or is selectively running IM program routines X and Z as herein before described. Each of the participant communication or IM devices 113 and 121 also includes an IM chat window 117 and 125, which, in turn, include feedback buttons such as buttons 119 and 127, respectively, for providing feedback to the moderator feedback meter 111. The feedback buttons may be implemented in hardware or software configurations. Each of the participant devices is configured to selectively run IM program routine Y as hereinbefore described. Using the arrangement illustrated in
As shown in
The present invention may have many variations. For example, the present invention may be implemented in a system to allow the moderator to define the text and meaning (values) of feedback buttons available to participants. Further, a web-based form may be used in cases where the Instant Messaging client may not be modified. A histogram or other bar chart may be implemented showing the number of participants selecting each discrete choice, rather than, or in addition to, the average value.
The method and apparatus of the present invention has been described in connection with a preferred embodiment as disclosed herein. The disclosed methodology may be implemented in a wide range of sequences, menus and screen designs to accomplish the desired results as herein illustrated. Although an embodiment of the present invention has been shown and described in detail herein, along with certain variants thereof, many other varied embodiments that incorporate the teachings of the invention may be easily constructed by those skilled in the art, and even included or integrated into a processor or CPU or other larger system integrated circuit or chip. The disclosed methodology may also be implemented solely or partially in program code stored in any media, including portable or fixed, volatile or non-volatile memory media device, including CDs, RAM and “Flash” F memory, or other semiconductor, optical, magnetic or other memory storage media from which it may be loaded and/or transmitted into other media and executed to achieve the beneficial results as described herein. Accordingly, the present invention is not intended to be limited to the specific form set forth herein, but on the contrary, it is intended to cover such alternatives, modifications, and equivalents, as can be reasonably included within the spirit and scope of the invention.