1. Field of the Disclosure
The present disclosure relates to filtering a data stream. More particularly, the present disclosure relates to a method for detecting and filtering advertisements from an audio stream.
2. Background Information
The customer service call centers of many companies record their calls for quality control purposes. As part of their efforts, quality analysts use voice search systems to search call transcripts for words or phrases that were spoken by customers and/or customer service agents. When a service call is recorded, it is stored on a media server for future playback. It is also transcribed by automatic speech recognition software. The transcript is then indexed for searching. Thereafter, a quality analyst performs searches on this index, to retrieve a list of calls that satisfy various criteria, such as calls that include specific words or phrases. The analyst can then retrieve those calls from the media server and analyze them for quality control purposes.
In view of the foregoing, the present disclosure, through one or more of its various aspects, embodiments and/or specific features or sub-components, is thus intended to bring out one or more of the advantages as specifically noted below.
According to an embodiment of the present disclosure, a method for filtering a data stream includes analyzing the data stream based on an acoustic parameter to determine whether a predetermined condition is satisfied, determining at least one extraneous portion of the data stream in which the predetermined condition is satisfied, and deleting the at least one extraneous portion from the data stream to produce a filtered data stream.
According to one aspect of the present disclosure, the method further includes segmenting the data stream into a plurality of data stream segments. According to such an aspect, each of the data stream segments is analyzed, based on the acoustic parameter, to determine whether the predetermined condition is satisfied, and each of the at least one extraneous portion comprises a plurality of consecutive data stream segments in which the predetermined condition is satisfied.
According to another aspect of the present disclosure, the predetermined condition is whether a variance of the acoustic parameter in a data stream segment exceeds a predetermined variance threshold.
According to yet another aspect of the present disclosure, the predetermined condition is whether a number of variances, of the acoustic parameter in a data stream segment that exceed a predetermined variance threshold, exceeds a predetermined number threshold.
According to still another aspect of the present disclosure, the at least one extraneous portion is deleted from the data stream only in response to a duration of the at least one extraneous portion exceeding a predetermined minimum extraneous duration.
According to an additional aspect of the present disclosure, the at least one extraneous portion is further defined as two extraneous portions, the two extraneous portions are separated by a non-extraneous portion in which the predetermined condition is not satisfied, and the method further includes deleting the non-extraneous portion from the data stream in response to a duration of the non-extraneous portion being less than a predetermined minimum non-extraneous duration.
According to another aspect of the present disclosure, the at least one extraneous portion is further defined as two extraneous portions, the two extraneous portions are separated by a non-extraneous portion in which the predetermined condition is not satisfied, the method further includes determining one of the two extraneous portions to be an erroneous extraneous portion, and the filtered data stream comprises the erroneous extraneous portion and the non-extraneous portion.
According to yet another aspect of the present disclosure, the one of the two extraneous portions that is determined to be the erroneous extraneous portion has a duration that is shorter than a duration of another of the two extraneous portions.
According to still another aspect of the present disclosure, the data stream is unknown before analyzing the data stream.
According to an additional aspect of the present disclosure, information of the data stream is known before analyzing the data stream, and the acoustic parameter and the predetermined condition are based on the information that is known of the data stream.
According to another aspect of the present disclosure, the data stream includes speech of an individual, the information comprises an acoustic model of the individual, and the acoustic parameter and the predetermined condition are based on the acoustic model of the individual.
According to yet another aspect of the present disclosure, the method further includes pre-analyzing at least a portion of the data stream to manually determine the at least one extraneous portion of the data stream, and determining at least one of the acoustic parameter and the predetermined condition based on the pre-analyzing of the at least one portion of the data stream.
According to still another aspect of the present disclosure, the method further includes post-analyzing the extraneous portion and the filtered data stream to determine an accuracy of the filtered data stream, and modifying at least one of the acoustic parameter and the predetermined condition based on the post-analyzing to improve the accuracy of the filtered data stream.
According to an additional aspect of the present disclosure, the data stream comprises post-production segments and pre-production segments, the post-production segments including post-production attributes, and the predetermined condition is whether the data stream includes the post-production attributes.
According to another aspect of the present disclosure, the method further includes replacing the deleted at least one extraneous portion with an alternative portion.
According to yet another aspect of the present disclosure, the data stream is an audio stream and the at least one extraneous portion is an advertisement.
According to another embodiment of the present disclosure, an apparatus for filtering a data stream includes a segmenter that segments the data stream into a plurality of data stream segments, an analyzer that analyzes each of the data stream segments based on an acoustic parameter to determine whether a predetermined condition is satisfied, a determiner that determines at least one extraneous portion of the data stream, each of the at least one extraneous portion comprising a plurality of consecutive data stream segments in which the predetermined condition is determined to be satisfied, and a deleter that deletes the at least one extraneous portion from the data stream to produce a filtered data stream.
According to one aspect of the present disclosure, the data stream is an audio stream and the at least one extraneous portion is an advertisement.
According to another aspect of the present disclosure, the data stream is received by a telecommunications device via a telecommunications network, and the deleter deletes the at least one extraneous portion before the telecommunications device broadcasts the at least one extraneous portion.
According to another embodiment of the present disclosure, a tangible computer-readable medium encoded with an executable computer program for filtering a data stream includes a segmenting code segment that segments the data stream into a plurality of data stream segments, a data analyzing code segment that analyzes each of the data stream segments based on an acoustic parameter to determine whether a predetermined condition is satisfied, an extraneous portion determining code segment that determines at least one extraneous portion of the data stream, each of the at least one extraneous portion comprising a plurality of consecutive data stream segments in which the predetermined condition is determined to be satisfied, and a deleting code segment that deletes the at least one extraneous portion from the data stream to produce a filtered data stream.
In a networked deployment, the computer system may operate in the capacity of a server or as a client user computer in a server-client user network environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. The computer system 100 can also be implemented as or incorporated into various devices, such as a personal computer (PC), a tablet PC, a set-top box (STB), a personal digital assistant (PDA), a mobile device, a global positioning satellite (GPS) device, a palmtop computer, a laptop computer, a desktop computer, a communications device, a wireless telephone, a land-line telephone, a control system, a camera, a scanner, a facsimile machine, a printer, a pager, a personal trusted device, a web appliance, a network router, switch or bridge, or any other machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. In a particular embodiment, the computer system 100 can be implemented using electronic devices that provide voice, video or data communication. Further, while a single computer system 100 is illustrated, the term “system” shall also be taken to include any collection of systems or sub-systems that individually or jointly execute a set, or multiple sets, of instructions to perform one or more computer functions.
As illustrated in
In a particular embodiment, as depicted in
In an alternative embodiment, dedicated hardware implementations, such as application specific integrated circuits, programmable logic arrays and other hardware devices, can be constructed to implement one or more of the methods described herein. Applications that may include the apparatus and systems of various embodiments can broadly include a variety of electronic and computer systems. One or more embodiments described herein may implement functions using two or more specific interconnected hardware modules or devices with related control and data signals that can be communicated between and through the modules, or as portions of an application-specific integrated circuit. Accordingly, the present system encompasses software, firmware, and hardware implementations.
In accordance with various embodiments of the present disclosure, the methods described herein may be implemented by software programs executable by a computer system. Further, in an exemplary, non-limited embodiment, implementations can include distributed processing, component/object distributed processing, and parallel processing. Alternatively, virtual computer system processing can be constructed to implement one or more of the methods or functionality as described herein.
The present disclosure contemplates a computer-readable medium 182 that includes instructions 184 or receives and executes instructions 184 responsive to a propagated signal so that a device connected to a network 101 can communicate voice, video or data over the network 101. Further, the instructions 184 may be transmitted or received over the network 101 via the network interface device 140.
A method for filtering a data stream 200 is generally shown in
According to the embodiment of the method 200 as shown in
Each of the data stream segments is analyzed based on an acoustic parameter at S204. The acoustic parameter may be pitch, stress, emphasis, tone, accent, frequency, or any other acoustic parameter generally known in the art. For example, in the non-limiting and exemplary embodiment of the present application in which advertisements are detected in a customer service call center recording, the acoustic parameter may be pitch variance. Of course, those skilled in the art appreciate that additional and/or alternative acoustic parameters may also be used in additional embodiments of the method 200. In the embodiment of the method 200 as shown in
For each data stream segment that is analyzed based on the acoustic parameter, it is determined whether a predetermined condition is satisfied at S206. The predetermined condition may be any condition generally understood in the art, such as, but not limited to, whether the predetermined condition exceeds a certain threshold, whether a variance of the predetermined condition exceeds a certain threshold, and whether a frequency of variances that exceed a certain threshold exceeds a certain frequency. For example, in exemplary embodiments of the method 200 wherein the acoustic parameter is pitch, the predetermined condition may be whether the maximum pitch variance or whether the average pitch variance of a data stream segment exceeds a predetermined pitch threshold. In an alternative embodiment of the method 200, the predetermined condition may be whether the number of variances, in which the pitch variance exceeds a predetermined pitch variance threshold, exceeds a predetermined pitch number threshold. Of course, those skilled in the art appreciate that the embodiments as described above are to be considered merely exemplary and are not intended to be limiting.
In the method 200, at least one extraneous portion of the data stream in which the predetermined condition is satisfied is determined at S208. The extraneous portion may be a single data stream segment in which the predetermined condition is determined to be satisfied, or, alternatively, the extraneous portion may comprise a plurality of consecutive data stream segments in which the predetermined condition is determined to be satisfied. In the exemplary and non-limiting embodiment of the method 200 in which the data stream is a customer service call center recording, the extraneous portion may be an advertisement. Of course, those skilled in the art appreciate that in additional embodiments of the method 200 the extraneous portion may be an alternative extraneous portion, such as, but not limited to, a client monologue or a customer service agent monologue.
According to the method 200, the at least one extraneous portion of the data stream is deleted from the data stream to produce a filtered data stream at S210, and the filtered data stream is output to a device, such as, but not limited to, a recorder or a player at S212. In an embodiment of the method 200, the deleted extraneous portion may be replaced with an alternative portion. For example, in the non-limiting and exemplary embodiment of the present application in which advertisements are detected in a customer service call center recording, a deleted advertisement may be replaced with an alternative advertisement, music, or silence.
According to an embodiment of the method 200, the data stream may be unknown before analyzing and filtering the data stream. In this regard, the acoustic parameter and the predetermined condition may be set without being based on known information of the data stream. For example, in the non-limiting and exemplary embodiment of the present application in which advertisements are detected in a customer service call center recording, the advertisements and the content of the customer service call center recording may be unknown to a quality control analyst that analyzes the customer service call center recording, and the quality control analyst may set the acoustic parameter and the predetermined condition without having any knowledge of the advertisements and the content of the customer service call.
In an alternative embodiment of the method 200, information of the data stream may be known before analyzing and filtering the data stream. According to such an embodiment, at least one of the acoustic parameter and the predetermined condition are based on the information that is known of the data stream. For example, in the non-limiting and exemplary embodiment of the present application in which advertisements are detected in a customer service call center recording, information of the content of the customer service call center recording may be known. The known information may then be used to distinguish the content of the customer service call center recording from the advertisements. For example, if an acoustic model of the customer service agent that is speaking in the customer service call center recording is known, then the acoustic parameter and the predetermined condition may be based on the acoustic model of the customer service agent. Of course, those skilled in the art appreciate that the embodiments as described above are to be considered merely exemplary and are not intended to be limiting.
In an additional embodiment of the non-limiting and exemplary embodiment of the present application in which advertisements are detected in a customer service call center recording, information of the advertisements may be known, and at least one of the acoustic parameter and the predetermined condition may be based on the information that is known of the advertisements. For example, if it is known that the advertisements comprise post-production segments while the segments of the customer service call center recording comprise pre-production segments, then the predetermined condition may be whether a data stream segment includes post-production attributes.
A further embodiment of a method for filtering a data stream is generally shown in
If it is determined that the variance of the acoustic parameter throughout one of the data stream segments is greater than the predetermined variance threshold, then that data stream segment is marked as an extraneous data stream segment at S308. Thereafter, it is determined whether there are additional data stream segments to be analyzed at S310. If there are no additional data stream segments to be analyzed, than at least one extraneous portion of the data stream is determined at S312, wherein each extraneous portion of the data stream comprises consecutive data stream segments in which the variance of the acoustic parameter throughout each data stream segment is greater than the predetermined variance threshold.
Each extraneous portion of the data stream is analyzed at S314. In this regard, in the embodiment of the method 300 shown in
After each extraneous portion of the data stream is analyzed to determine whether the duration of the extraneous portion exceeds the minimum extraneous duration, it is determined whether there are additional extraneous portions at S320. If it is determined that there are no additional extraneous portions of the data stream, then the data stream is output as a filtered data stream to a device such as, but not limited to, a player or a recorder at S322.
In the embodiment of the method 300 as shown in
As shown in the method 300, after the filtered data stream and the extraneous portions of the data stream are post-analyzed to determine an accuracy of the filtered data stream, the acoustic parameter and the predetermined filtering condition, such as the filtering condition of determining whether a variance of the acoustic parameter in a data stream segment exceeds a variance threshold, are modified to improve the accuracy of the filtered data stream. In an alternative embodiment of the method 300, only one of the acoustic parameter and the predetermined filtering condition is modified to improve the accuracy of the filtered data stream. For example, in a non-limiting and exemplary embodiment of the method 300, the variance threshold is modified based on the post-analyzing the filtered data stream and the extraneous portions to improve the accuracy of the filtered data stream. Of course, those skilled in the art appreciate that the embodiment as described above is to be considered merely exemplary and is not intended to be limiting.
An additional embodiment of a method for filtering a data stream is generally shown in
Thereafter, in the method 400 as shown in
If it is determined that the number of variances exceeds the predetermined number threshold, then that data stream segment is marked as an extraneous data stream segment at S412. Thereafter, it is determined whether there are additional data stream segments to be analyzed at S414. If there are no additional data stream segments to be analyzed, than at least one extraneous portion of the data stream is determined at S416, wherein each extraneous portion of the data stream comprises consecutive extraneous data stream segments.
Each extraneous portion of the data stream is analyzed at S418. In this regard, in an embodiment of the present application as shown in
After each extraneous portion of the data stream is analyzed to determine whether a duration of an adjacent non-extraneous portion is less than a minimum non-extraneous duration, it is determined whether there are additional extraneous portions at S424. If it is determined that there are no additional extraneous portions of the data stream, then the data stream is output as a filtered data stream to a device such as, but not limited to, a player or a recorder at S426.
A further embodiment of a method for filtering a data stream is generally shown in
If it is determined that the predetermined condition is satisfied, then that data stream segment is marked as an extraneous data stream segment at S508. Thereafter, it is determined whether there are additional data stream segments to be analyzed at S510. If there are no additional data stream segments to be analyzed, than at least one extraneous portion of the data stream is determined at S512, wherein each extraneous portion of the data stream comprises consecutive data stream segments in which the predetermined condition is satisfied.
Each extraneous portion of the data stream is analyzed at S514. In this regard, in the embodiment of the method 500 shown in
As shown in
After each extraneous portion of the data stream is analyzed to determine whether the extraneous portion is an erroneous extraneous portion, it is determined whether there are additional extraneous portions at S520. If it is determined that there are no additional extraneous portions of the data stream, then the data stream is output as a filtered data stream to a device such as, but not limited to, a player or a recorder at S522.
In a further embodiment of the present disclosure, as generally indicated in
According to an embodiment of the apparatus 600, the data stream is an audio stream and the at least one extraneous portion is an advertisement.
According to a further embodiment, the data stream is received by a telecommunications device via a telecommunications network and the deleter 608 deletes the at least one extraneous portion before the telecommunications device broadcasts the at least one extraneous portion. For example, in a non-limiting and exemplary embodiment of the apparatus 600, a telecommunications device may receive a voice mail message via the telecommunications network. The segmenter 602 segments the voice mail message into a plurality of data stream segments, and the analyzer analyzes each of the data stream segments based on an acoustic parameter, such as, but not limited to, pitch variance, to determine if a predetermined condition is satisfied. Thereafter, a determiner determines at least one extraneous portion of the data stream, such as, but not limited to, an advertisement in the voice mail message, wherein the advertisement comprises a plurality of consecutive data stream segments in which the predetermined condition was determined to be satisfied. The deleter 608 deletes the advertisement from the voice mail message before the telecommunications device broadcasts the advertisement.
The present disclosure also provides a tangible computer-readable medium encoded with an executable computer program for filtering a data stream. The tangible computer-readable medium includes a segmenting code segment that segments the data stream into a plurality of data stream segments. A data analyzing code segment analyzes each of the data stream segments based on an acoustic parameter to determine whether a predetermined condition is satisfied. Thereafter, an extraneous portion determining code segment determines at least one extraneous portion of the data stream based on the analyzed data stream segments, wherein each of the at least one extraneous portion comprises a plurality of consecutive data stream segments in which the predetermined condition is determined to be satisfied. A deleting code segment deletes the at least one extraneous portion from the data stream to produce a filtered data stream.
Accordingly, the present invention enables extraneous, or unwanted, portions of a data stream to be filtered from the data stream. In a non-limiting and exemplary embodiment of the present application, quality control analysts in customer service call centers often search for keywords in call transcripts. Their searches often return a large number of false positives when the search terms also appear in advertisements that customers hear while they are on hold. In this regard, the present invention provides a method, apparatus, and computer-readable medium for filtering the advertisements from the call transcripts, thereby eliminating the return of the large number of false positives.
In a non-limiting and exemplary embodiment of the present application it is relied on the fact that, in an effort to increase a listener's attention, voices in audio advertisements generally tend to vary their pitch more rapidly than voices in other kinds of speech. The difference is illustrated in the lower graph of
In the exemplary embodiment, three parameters may be optimized on training data: the minimum pitch variance vmin; the minimum gap length gmin; and the minimum advertisement length lmin. These parameters may then be used in the following procedure.
First, measure the fundamental frequency (f0) in every 10 ms frame of the call recording. Although the f0 contour is generally known to be difficult to model, it is relatively stable in the face of background noise, as long as the voice of interest remains the dominant signal. For example, many advertisements are accompanied by soft background music. In the exemplary embodiment, the auto-correlation based pitch extractor get_f0 from the ESPS/Waves toolkit may be used. However, those skilled in the art appreciate that alternative methods may also be used.
Second, filter out f0 values that are outside the typical range for human voices. Such values can arise as artifacts of the pitch extraction algorithm.
Third, compute the change in the fundamental frequency (f0′) between every two adjacent frames.
Fourth, find monotonic sequences of f0′ values that are longer than 50 ms.
Fifth, partition the call into snippets of one second each and, in each snippet (S), compute the following measure of pitch variance:
where t ranges over 10 ms time frames in the snippet. In other words, the pitch variance of each one-second snippet is measured as the maximum absolute slope of f0 values spanning at least 50 ms. For every snippet S where vs>vmin, the snippet is labeled as an advertisement snippet; the remaining snippets are labeled as non-advertisement snippets.
Sixth, fill in the gaps. If two advertisement snippets i and k are less than gmin seconds apart, then label every snippet j, where i<j<k; as an advertisement snippet.
Seventh, impose a minimum advertisement length. For every contiguous sequence of advertisement snippets (i, . . . , j), where neither i−1 nor j+1 are advertisement snippets. if j−i<lmin, then re-label snippets (i, . . . , j) as non-advertisement snippets.
Eighth, output the remaining advertisement snippets.
In the exemplary embodiment of the present application, simulated annealing, as described by S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, “Optimization by simulated annealing,” Science, col. 22 220, no. 4598, pp. 671-680, 1983, may be used to optimize the three parameters. However, those skilled in the art appreciate that alternative procedures may also be used.
In an exemplary and non-limiting test embodiment of the present application, a plurality of audio streams were analyzed and filtered according to the exemplary embodiment. The audio streams consisted of recorded customer service calls, whose duration ranged from five to twenty minutes. Five such calls were drawn uniformly at random for each of twenty consecutive business days, for a total of one hundred calls. Each of the advertisements in each call was annotated using Praat audio annotation software. Those skilled in the art appreciate that additional, or alternative, annotation software may also be used.
The customer service calls were filtered according to the exemplary embodiment of the present application as described above, and the results of the filtering were compared to a baseline method. Under the baseline method, a two-state ergodic hidden Markov model (HMM) that ranges over acoustic features was used to detect and filter the advertisements from the customer service calls. One state of the HMM represents advertisements and the other state represents everything else. In principle, any aspect of the observable data can be viewed as the HMM's output. In the baseline method, the standard 39 mel-frequency cepstral coefficients (MFCCs) from 100 ms frames were used. In the baseline method, the 100 ms frame length seemed to produce more stable results than the more common 10 ms frame length. The HMM was trained using the Forward-Backward algorithm, and applied to test data using the Viterbi algorithm.
The test embodiment of the present application was compared with the baseline method by training each method on eighty calls and testing each method on the remaining twenty calls. For each method, and for each test call, the total length of the overlaps between the hypothesized advertisement snippets and the manually-annotated advertisements was computed. Then, this length was divided by the total length of all hypothesized advertisements in the call or by the total length of all manually-annotated advertisements in the call, to get precision or recall, respectively. Next, the harmonic mean of precision and recall were computed to arrive at the F1 measure. Finally, the F1 over the twenty calls in the test set was macro-averaged. The entire procedure was repeated five times, each time using a different eighty/twenty split into training and test sets, so that each call appeared in a test set exactly once.
Although the invention has been described with reference to several exemplary embodiments, it is understood that the words that have been used are words of description and illustration, rather than words of limitation. Changes may be made within the purview of the appended claims, as presently stated and as amended, without departing from the scope and spirit of the invention in its aspects. Although the invention has been described with reference to particular means, materials and embodiments, the invention is not intended to be limited to the particulars disclosed; rather the invention extends to all functionally equivalent structures, methods, and uses such as are within the scope of the appended claims.
For example, an exemplary embodiment of the present application has been described in which audio advertisements are filtered from an audio data stream. However, those skilled in the art appreciate that in alternative embodiments of the present application video advertisements may be filtered from a video data stream. Moreover, audio advertisements have generally been described as being filtered from the audio data stream based upon pitch dynamics. In this regard, those skilled in the art appreciate that the advertisements could be filtered based upon additional and/or alternative acoustic parameters, such as, but not limited to, emphasis, stress, amplitude, tone, and accent. Additionally, those skilled in the art further appreciate that the present application is not limited to filtering advertisements from a data stream but may be applied to filter any extraneous or unwanted data stream segment from a data stream.
While the computer-readable medium is shown to be a single medium, the term “computer-readable medium” includes a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. The term “computer-readable medium” shall also include any medium that is capable of storing, encoding or carrying a set of instructions for execution by a processor or that cause a computer system to perform any one or more of the methods or operations disclosed herein.
In a particular non-limiting, exemplary embodiment, the computer-readable medium can include a solid-state memory such as a memory card or other package that houses one or more non-volatile read-only memories. Further, the computer-readable medium can be a random access memory or other volatile re-writable memory. Additionally, the computer-readable medium can include a magneto-optical or optical medium, such as a disk or tapes or other storage device to capture carrier wave signals such as a signal communicated over a transmission medium. Accordingly, the disclosure is considered to include any computer-readable medium or other equivalents and successor media, in which data or instructions may be stored.
Although the present specification describes components and functions that may be implemented in particular embodiments with reference to particular standards and protocols, the disclosure is not limited to such standards and protocols. Such standards are periodically superseded by faster or more efficient equivalents having essentially the same functions. Accordingly, replacement standards and protocols having the same or similar functions are considered equivalents thereof.
The illustrations of the embodiments described herein are intended to provide a general understanding of the structure of the various embodiments. The illustrations are not intended to serve as a complete description of all of the elements and features of apparatus and systems that utilize the structures or methods described herein. Many other embodiments may be apparent to those of skill in the art upon reviewing the disclosure. Other embodiments may be utilized and derived from the disclosure, such that structural and logical substitutions and changes may be made without departing from the scope of the disclosure. Additionally, the illustrations are merely representational and may not be drawn to scale. Certain proportions within the illustrations may be exaggerated, while other proportions may be minimized. Accordingly, the disclosure and the figures are to be regarded as illustrative rather than restrictive.
One or more embodiments of the disclosure may be referred to herein, individually and/or collectively, by the term “invention” merely for convenience and without intending to voluntarily limit the scope of this application to any particular invention or inventive concept. Moreover, although specific embodiments have been illustrated and described herein, it should be appreciated that any subsequent arrangement designed to achieve the same or similar purpose may be substituted for the specific embodiments shown. This disclosure is intended to cover any and all subsequent adaptations or variations of various embodiments. Combinations of the above embodiments, and other embodiments not specifically described herein, will be apparent to those of skill in the art upon reviewing the description.
The Abstract of the Disclosure is provided to comply with 37 C.F.R. §1.72(b) and is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, various features may be grouped together or described in a single embodiment for the purpose of streamlining the disclosure. This disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter may be directed to less than all of the features of any of the disclosed embodiments. Thus, the following claims are incorporated into the Detailed Description, with each claim standing on its own as defining separately claimed subject matter.
The above disclosed subject matter is to be considered illustrative, and not restrictive, and the appended claims are intended to cover all such modifications, enhancements, and other embodiments which fall within the true spirit and scope of the present disclosure. Thus, to the maximum extent allowed by law, the scope of the present disclosure is to be determined by the broadest permissible interpretation of the following claims and their equivalents, and shall not be restricted or limited by the foregoing detailed description.
The present application is a continuation application of U.S. patent application Ser. No. 13/867,264, filed on Apr. 22, 2013, which is a continuation application of U.S. patent application Ser. No. 12/634,981, filed on Dec. 10, 2009 and now U.S. Pat. No. 8,457,771. The disclosure of each of these documents, including the specification, drawings, and claims, is incorporated herein by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5579431 | Reaves | Nov 1996 | A |
5727121 | Chiba | Mar 1998 | A |
5870397 | Chauffour | Feb 1999 | A |
6078882 | Sato | Jun 2000 | A |
6615039 | Eldering | Sep 2003 | B1 |
6801895 | Huang | Oct 2004 | B1 |
6885986 | Gigi | Apr 2005 | B1 |
6993245 | Harville | Jan 2006 | B1 |
7260439 | Foote | Aug 2007 | B2 |
7299173 | Ma | Nov 2007 | B2 |
7490053 | Emerson, III | Feb 2009 | B1 |
7899390 | Littlejohn | Mar 2011 | B1 |
8457771 | Kim | Jun 2013 | B2 |
8606585 | Melamed et al. | Dec 2013 | B2 |
9183177 | Kim et al. | Nov 2015 | B2 |
20030023972 | Gutta | Jan 2003 | A1 |
20030112265 | Zhang | Jun 2003 | A1 |
20040001161 | Herley | Jan 2004 | A1 |
20050169114 | Ahn | Aug 2005 | A1 |
20050222901 | Agarwal | Oct 2005 | A1 |
20060277567 | Kinnear | Dec 2006 | A1 |
20080292273 | Wang | Nov 2008 | A1 |
20090005890 | Zhang | Jan 2009 | A1 |
20090088878 | Otsuka | Apr 2009 | A1 |
20090133092 | Casagrande | May 2009 | A1 |
20090254933 | Gupta | Oct 2009 | A1 |
20100111312 | Duxans Barrobes | May 2010 | A1 |
20100319015 | Remington | Dec 2010 | A1 |
20110145001 | Kim | Jun 2011 | A1 |
20110145002 | Melamed | Jun 2011 | A1 |
20130268103 | Kim | Oct 2013 | A1 |
Entry |
---|
Covell et al., “Advertising Detection and Replacement Using Acoustic and Visual Repetition”, IEEE 8th Workshop on Mulimedia Signal Processing, Oct. 2006. |
Number | Date | Country | |
---|---|---|---|
20160085858 A1 | Mar 2016 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13867264 | Apr 2013 | US |
Child | 14865979 | US | |
Parent | 12634981 | Dec 2009 | US |
Child | 13867264 | US |