After physicians and other healthcare professionals (referred to herein generally as “healthcare providers”) provide healthcare services to patients, bills for such services must be generated. The process of generating such bills based on the set of clinical reports associated with a patient encounter (referred to as a “chart”) can be a tedious, time-consuming, risky, and error-prone process for a variety of reasons, such as:
These problems are likely to be exacerbated by the transition to the ICD-10 billing code standard. Expert billing coders, who are fluent in ICD-10, are in short supply and are unlikely to meet the demand for such billing coders.
In order to address this shortfall in supply of expert billing coders, many healthcare providers have either been outsourcing their coding process to service companies or attempting to automate the coding process using Computer Assisted Coding (CAC) technology.
Both outsourcing and automation have associated drawbacks. For example, because the ability to perform billing coding accurately and completely directly impacts the cash flow and overall profitability of healthcare organizations, such organizations are reluctant to rely on an outsourced workforce. Another drawback of outsourced billing coding is that the ultimate responsibility, and legal liability, for the accuracy of billing coding lies with the healthcare organization, few (if any) outsourced billing coding providers are willing to indemnify a sizable healthcare organization against liability incurred as the result of billing coding errors. As a result, even healthcare organizations that are willing to outsource may not be able to outsource all of their billing coding needs to billing coding providers who can satisfy exacting quality and legal requirements.
CAC solutions have their own problems. CAC solutions apply Natural Language Processing (NLP) technology to compute the most likely set of billing codes from a set of clinical reports before a human coder reviews the chart. Some CAC solutions can, in addition, create confidence scores that estimate the likelihood that any given code, or the complete coding of a chart, is correct. Some CAC solutions provide the option of bypassing the human coder completely, for at least a subset of charts, if the chart-level confidence score is sufficiently high. The state of the art of such fully-automated coding, however, is not sufficiently accurate to be relied upon in practice for anything but the most simple charts. More complex charts, which are the norm in practice, cannot be accurately coded using fully-automated coding. As a result, in practice it is necessary, in most cases, for a human coder to review the automatically-generated codes for accuracy and to revise such codes as necessary.
The promise of CAC solutions, even when the codes that they generate must be reviewed by a human coder, is to provide an increase in efficiency in comparison with a system that relies solely on human coders, by providing the initial set of codes for review quickly and accurately enough that the combination of generating codes automatically followed by human review and correction of those codes is more efficient and inexpensive than purely human code generation. In practice, however, CAC systems do not always increase productivity as much as is theoretically possible. Furthermore, deploying CAC systems requires a lengthy and labor-intensive tuning process to adapt the CAC technology to the idiosyncrasies of a healthcare provider. The result is that productivity during the tuning process can be impacted negatively, and the resulting overall productivity may be lower than if no CAC system were used at all.
What is needed, therefore, are techniques for overcoming the problems of conventional CAC systems, and for otherwise improving the efficiency of generating billing codes.
A computer system increases the efficiency with which billing codes may be generated based on a chart, such as a medical chart. The computer system provides the chart to a computer-assisted coding (CAC) module, which produces an initial set of billing codes and an initial assessment of the accuracy and/or completeness of the codes. The computer system decides whether to send the initial set of billing codes to an initial human reviewer. If the computer system sends the initial set of billing codes to the initial human reviewer, then the initial human reviewer reviews the chart and the output of the CAC module, and attempts to fix errors in the CAC output. The system provides the chart and the current (initial or modified) codes to a final human reviewer, who may be more highly skilled than the initial human reviewer, for final verification and modification.
Other features and advantages of various aspects and embodiments of the present invention will become apparent from the following description and from the claims.
Embodiments of the present invention include computer systems which may be used to improve the efficiency with which billing codes may be generated. Referring to
The system 100 includes a document corpus 102, which includes a plurality of documents 104a-n, where n may be any number. The document corpus 102 is merely one example of a “data set” as that term is used herein. The term “document” is used generally herein to include any type of data record, such as a freeform text document (e.g., a plain text document or a document created using a word processing application), a structured document (such as an XML document), a scanned document (e.g., a scan of handwritten progress notes), or a data record in a database. A document may, for example, be an Electronic Medical Record (EMR) or Electronic Health Record (EHR). Structured documents in the document corpus 102 may, for example, have been created using techniques disclosed in U.S. Pat. No. 7,584,103 B2, issued on Sep. 1, 2009, entitled, “Automated Extraction of Semantic Content and Generation of a Structured Document from Speech.”
The document corpus 102 may include documents of different types, such as text documents and EHRs. Although
For ease of explanation, certain embodiments will be disclosed herein in connection with documents which take the form of clinical reports describing patient encounters. Examples of clinical reports include admission orders, discharge orders, and prescriptions. A plurality of clinical reports relating to a particular patient encounter is referred to herein as a “chart.” Often, the process of generating a set of billing codes involves generating a set of billing codes based on the clinical reports in a particular chart. The resulting billing codes may be represented in any manner, such as according to billing code standards such as any one or more of HL7 CDA v2 XML standard (ANSI-approved since May 2005), SNOMED CT, LOINC, CPT, ICD-9 and ICD-10, and UMLS.
Assume, solely for purposes of example, that the system 100 includes a chart 106, which includes documents 104a-b from the document corpus. As mentioned above, a chart may, more generally, including one or more documents relating to a particular patient encounter. Although the chart 106 is shown as being contained within the document corpus 102 in
Now assume that the chart 106 is ready to be used to generate a set of billing codes based on the chart 106. Further assume that the system 100 includes a computer-assisted coding (CAC) module 108. The CAC module 108 may include any number and type of computer hardware, computer software, networking equipment, and interconnections sufficient to enable the CAC module 108 to perform computer-assisted coding. The CAC module 108 is configured to perform, or to attempt to perform, computer-assisted coding without the involvement of a human, except that a human may provide the chart 106 to the CAC module 108 and interpret the output of the CAC module 108.
The system 100 may include a chart routing module 150, which may receive some or all of the chart 106 as input, and which may determine whether the chart 106 qualifies for fully-automated processing by the CAC module 108 (
If the chart routing module 150 determines that the chart 106 qualifies for fully-automated processing, the chart routing module 150 may provide output 106a representing the chart 106 to the CAC module 108 for processing (
The initial code assessment data 114 may include any of a variety of data. For example the initial code assessment data 114 may include any one or more of the following:
The initial code assessment data 114 may indicate that the initial billing codes 112 are likely completely correct based on, for example, a function of the completeness confidence score and/or the correctness confidence score. For example, if the correctness confidence score exceeds a first predetermined threshold (e.g., 95%) and the completeness confidence score exceeds a second predetermined threshold (e.g., 90%), then the system 100 may conclude that the initial billing codes 112 are likely completely correct.
The initial code assessment data 114 may indicate that the initial billing codes 112 contain a known deficiency if, for example, the chart 106 is missing a required report, such as a “Discharge Summary” report.
The system 100 may also include a review determination module 152, which may receive some or all of the CAC output 110 as input, and which may determine whether the initial code assessment data 114 indicates that the chart 106 has been classified as requiring review (
Although not shown in
The review determination module 152 may determine whether the initial human reviewer 116 is likely to add value to the CAC output 110 in any of a variety of ways. For example, the review determination module 152 may make this determination in any of the ways disclosed herein by which the chart routing module 150 may determine whether the chart 106 describes a complex medical procedure. The review determination module 152 may, for example, use any such technique to determine whether the CAC output 110 and/or the chart 106 describes a complex medical procedure, and not provide the CAC output 110 to the initial human reviewer 116 in response to determining that the CAC output 110 and/or the chart 106 describes a complex medical procedure.
As another example, the review determination module 152 may determine whether the initial human reviewer 116 is likely to add value to the CAC output 110 by determining whether the initial human reviewer 116 is sufficiently skilled to add value to the CAC output 110. The review determination module 152 may, for example, determine whether the initial human reviewer 116 is sufficiently skilled to add value to the CAC output 110, and not provide the CAC output 110 to the initial human reviewer 116 in response to determining that the initial human reviewer 116 is not sufficiently skilled to add value to the CAC output 110. The review determination module 152 may determine whether the initial human reviewer 116 is sufficiently skilled to add value to the CAC output 110 in any of a variety of ways. For example, the review determination module 152 may determine whether a skill value associated with the initial human reviewer 116 satisfies a skill criterion (e.g., exceeds a maximum predetermined value), and not provide the CAC output 110 to the initial human reviewer 116 in response to determining that the skill value does not satisfy the skill criterion.
If the chart routing module 150 previously determined (in operation 202 of
Any of the operations described herein as being performed in connection with the output 110′ of the CAC module 108 may alternatively be performed on the output 124′ of the initial human reviewer 116 (e.g., if the chart output 106a is provided to the initial human reviewer 116 but not to the CAC module 108). Furthermore, any operations described herein as being performed on the output 110′ of the CAC module 108 may be performed on both the output 110′ of the CAC module 108 and the output 124′ of the initial human reviewer 116.
The initial human reviewer 116 may review the initial billing codes 112 for completeness and/or correctness. Before doing so, however, the initial human reviewer 116 may determine whether to review the initial billing codes 112. For example, the initial human reviewer 116 may determine whether the chart 106 can be coded (i.e., whether the initial billing codes 112 can be modified) with high confidence. If the initial human reviewer 116 determines that the chart 106 cannot be coded with high confidence, then the initial human reviewer 116 may skip the following steps involving reviewing the initial billing codes 112 for completeness and/or correctness.
As another example, the initial human reviewer 116 may determine whether the total amount of reimbursement represented by the chart 106 and/or the initial billing codes 112 exceeds some predetermined threshold amount, such as an average reimbursement amount or an approved reimbursement amount. If the initial human reviewer 116 determines that the total amount of reimbursement exceeds the predetermined threshold amount, then the initial human reviewer 116 may skip the following steps involving reviewing the initial billing codes 112 for completeness and/or correctness.
The initial human reviewer 116 may, based on any combination of the chart 106, the initial billing codes 112, and the initial code assessment 114, modify the initial billing codes 112 in an attempt to increase their completeness and improve their correctness, thereby producing a set of modified billing codes 120. The initial human reviewer 116 may also modify the initial code assessment 114 to indicate, for example, the initial human reviewer 116's assessment of the completeness and/or correctness of the modified billing codes 120, thereby producing a modified code assessment 122. Both the modified billing codes 120 and the modified code assessment 122 may be part of modified coding output 124 produced by the initial human reviewer 116.
The initial human reviewer 116 may also perform additional tasks based on the chart 106 and/or the CAC output 110. One purpose of these additional tasks may be to assist a subsequent human reviewer in reviewing the chart 106 and/or the modified coding output 124. For example, the initial human reviewer 116 may perform any one or more of the following additional tasks based on the chart 106 and/or the CAC output 110:
Data representing the results of any such additional actions may be stored within the modified coding output 124. For example, the modified coding output 124 may include data representing the initial human reviewer 116's selected sort order of documents within the chart 106. The initial human reviewer 116, via the computing device 118, may provide output 124′ containing or otherwise representing the modified coding output 124 back to the system 100 (
The system 100 may include a coding output routing module 156. The coding output routing module 156 may provide a final human reviewer 126 with final coding output 130, which may include and/or be derived from either:
The final coding output 130 may also include the chart 106 and/or data derived from the chart 106. The coding output routing module 156 may, for example, provide the chart 106 and the final coding output 130 to the final human reviewer 126 by transmitting the chart 106 and the final coding output 130 over a network to a computing device 128 used by or otherwise associated with the final human reviewer 126 (
The final human reviewer 126 may review the chart 106 and the final coding output 130, and analyze them for any of a variety of purposes. For example, the final human reviewer 126 may choose to perform any one or more of the following, in any combination:
Although
Embodiments of the present invention have a variety of advantages, such as the following. In general, embodiments of the present invention address shortcomings of CAC technology, by allowing healthcare providers to obtain the efficiency benefits of CAC technology, while staying in full control of the coding process and without sacrificing quality. In particular, embodiments of the present invention may use a combination of automated (CAC) technology and human reviewers, structured and sequenced in a particular manner, to leverage the efficiency gains of CAC while using human reviewers to ensure accuracy.
Even more specifically, the use of the initial human reviewer 116 enables the system 100 and method 200 to catch certain errors in the CAC output 110. Using a combination of the CAC module 108 and the initial human reviewer 116 may provide a higher quality output than that produced by the CAC module 108 alone, and at a lower cost than using a highly-trained human reviewer alone, depending on the relative costs and accuracies of the CAC module 108 and the initial human reviewer 116.
Furthermore, the initial human reviewer 116 may be relatively unskilled and be capable of correcting only relatively simple errors. Even so, the system 100 as a whole may be more efficient (measured, for example, in terms of accuracy per unit cost) and/or more accurate overall than the CAC module 108 itself, when the function performed by the final human reviewer 126 is taken into account. For example, if the final human reviewer 126 is an expert billing coder, then the final human reviewer 126 may catch and correct errors produced by the CAC module 108 that were not corrected by the initial human reviewer 116, thereby increasing the accuracy of the final coding output 130. Even if the cost of the final human reviewer 126 is relatively high (as measured, e.g., in terms of hourly wages), the overall cost of the system 100 may still be acceptable if the number of codes reviewed, and therefore the amount of time spent, by the final human reviewer 126 is relatively small. The system 100's use of the CAC module 108 and the initial human reviewer 116, and in particular the system 100's use of the initial code assessment 114 and the modified code assessment 122, enables the system 100 to limit the number of codes that the final human reviewer 126 must review, so that the cost of the final human reviewer 126 is kept low and so that the final human reviewer 126 is used to review and correct only relatively complex codes for which the expert skills of the final human reviewer 126 are required.
In addition to increasing the efficiency of the coding process, the system 100 and method 200 may increase the overall accuracy of the system 100 in comparison to a purely automated system (e.g., the CAC module 108). As described above, the CAC module 108 may produce erroneous codes, especially in complex situations. The initial human reviewer 116 and the final human reviewer 126 may correct such codes. As a result, the system 100 may increase the accuracy of the final coding output 130 in comparison to the automatically-generated codes 112 produced by the CAC module 108.
One benefit of the system 100, therefore, is that it uses the CAC module 108 to produce the codes 112 automatically, and that it performs additional steps which increase the accuracy of the final coding output 130 in comparison to the codes 112 produced solely by the CAC module 108. The system 100 may, therefore, be seen as an improved computer system for generating billing codes. The system 100, therefore, solves the technical problem of how to increase the accuracy of the codes produced by a computer-automated coding module.
Furthermore, the system 100 and method 200 enable certain charts to be coded (at least in part) automatically, while also enabling codes to be generated based on charts containing clinical reports that cannot be processed automatically, such as clinical reports in the form of scanned handwritten notes. The system 100 and method 200 may code such clinical reports by routing those reports to the initial human reviewer 116, who may generate an initial set of codes, and by then routing the initial set of codes to the final human reviewer 126 for review and correction. In this way, the system 100 and method 200 obtain the advantages of both the automated CAC module 108 and of the manual skill of the initial human reviewer 116 and the final human reviewer 126.
As described above, one function performed by the chart routing module 150 is to determine whether the chart 106 is to determine whether the chart 106 qualifies for fully-automated processing by the CAC module 108. Another, related, function performed by the chart routing module 150 is to determine the right time at which to submit the chart 106 to the CAC module 108 and/or to a human coder for coding. For example, the chart routing module 150 may be adapted not to submit the chart 106 (e.g., to the CAC module 108) for coding unless and until a discharge summary has been received (e.g., unless and until the chart 106 includes a discharge summary). The chart routing module 150 may further be adapted to submit the chart 106 (e.g., to the CAC module 108) after some predetermined maximum amount of time has passed, even if no discharge summary has been received (e.g., even if the chart 106 does not include a discharge summary). This is merely one example of a way in which the chart routing module 150 may determine the right time at which to submit the chart 106 for coding.
It is to be understood that although the invention has been described above in terms of particular embodiments, the foregoing embodiments are provided as illustrative only, and do not limit or define the scope of the invention. Various other embodiments, including but not limited to the following, are also within the scope of the claims. For example, elements and components described herein may be further divided into additional components or joined together to form fewer components for performing the same functions.
Any of the functions disclosed herein may be implemented using means for performing those functions. Such means include, but are not limited to, any of the components disclosed herein, such as the computer-related components described below.
The techniques described above may be implemented, for example, in hardware, one or more computer programs tangibly stored on one or more computer-readable media, firmware, or any combination thereof. The techniques described above may be implemented in one or more computer programs executing on (or executable by) a programmable computer including any combination of any number of the following: a processor, a storage medium readable and/or writable by the processor (including, for example, volatile and non-volatile memory and/or storage elements), an input device, and an output device. Program code may be applied to input entered using the input device to perform the functions described and to generate output using the output device.
Each computer program within the scope of the claims below may be implemented in any programming language, such as assembly language, machine language, a high-level procedural programming language, or an object-oriented programming language. The programming language may, for example, be a compiled or interpreted programming language.
Each such computer program may be implemented in a computer program product tangibly embodied in a machine-readable storage device for execution by a computer processor. Method steps of the invention may be performed by one or more computer processors executing a program tangibly embodied on a computer-readable medium to perform functions of the invention by operating on input and generating output. Suitable processors include, by way of example, both general and special purpose microprocessors. Generally, the processor receives (reads) instructions and data from a memory (such as a read-only memory and/or a random access memory) and writes (stores) instructions and data to the memory. Storage devices suitable for tangibly embodying computer program instructions and data include, for example, all forms of non-volatile memory, such as semiconductor memory devices, including EPROM, EEPROM, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROMs. Any of the foregoing may be supplemented by, or incorporated in, specially-designed ASICs (application-specific integrated circuits) or FPGAs (Field-Programmable Gate Arrays). A computer can generally also receive (read) programs and data from, and write (store) programs and data to, a non-transitory computer-readable storage medium such as an internal disk (not shown) or a removable disk. These elements will also be found in a conventional desktop or workstation computer as well as other computers suitable for executing computer programs implementing the methods described herein, which may be used in conjunction with any digital print engine or marking engine, display monitor, or other raster output device capable of producing color or gray scale pixels on paper, film, display screen, or other output medium.
Any data disclosed herein may be implemented, for example, in one or more data structures tangibly stored on a non-transitory computer-readable medium. Embodiments of the invention may store such data in such data structure(s) and read such data from such data structure(s).
Number | Name | Date | Kind |
---|---|---|---|
5065315 | Garcia | Nov 1991 | A |
5148366 | Buchanan | Sep 1992 | A |
5359509 | Little | Oct 1994 | A |
5483443 | Milstein et al. | Jan 1996 | A |
5664109 | Johnson et al. | Sep 1997 | A |
5823948 | Ross et al. | Oct 1998 | A |
5933809 | Hunt | Aug 1999 | A |
6006183 | Lai et al. | Dec 1999 | A |
6345249 | Ortega | Feb 2002 | B1 |
6377922 | Brown | Apr 2002 | B2 |
6529876 | Dart et al. | Mar 2003 | B1 |
6655583 | Walsh | Dec 2003 | B2 |
6662168 | Wallach et al. | Dec 2003 | B1 |
6738784 | Howes | May 2004 | B1 |
6834264 | Lucas | Dec 2004 | B2 |
6915254 | Heinze | Jul 2005 | B1 |
7233938 | Carus | Jun 2007 | B2 |
7236968 | Seki et al. | Jun 2007 | B2 |
7313515 | Crouch et al. | Dec 2007 | B2 |
7379946 | Carus | May 2008 | B2 |
7447988 | Ross | Nov 2008 | B2 |
7467094 | Rosenfeld | Dec 2008 | B2 |
7519529 | Horvitz | Apr 2009 | B1 |
7584103 | Fritsch | Sep 2009 | B2 |
7613610 | Zimmerman | Nov 2009 | B1 |
7650628 | Zimmerman | Jan 2010 | B2 |
7716040 | Koll | May 2010 | B2 |
7725330 | Rao | May 2010 | B2 |
7818186 | Bonissone | Oct 2010 | B2 |
7869998 | Fabbrizio et al. | Jan 2011 | B1 |
7885811 | Zimmerman | Feb 2011 | B2 |
8024196 | Wodtke | Sep 2011 | B1 |
8050938 | Green, Jr. | Nov 2011 | B1 |
8311854 | Stanley | Nov 2012 | B1 |
8359297 | Garrett | Jan 2013 | B2 |
8392216 | Crockett | Mar 2013 | B2 |
8452609 | Berg | May 2013 | B2 |
8463673 | Koll | Jun 2013 | B2 |
8468167 | Sathyanarayana | Jun 2013 | B2 |
8583439 | Kondziela | Nov 2013 | B1 |
8781829 | Koll | Jul 2014 | B2 |
8781853 | Green, III | Jul 2014 | B2 |
8862483 | Scarola | Oct 2014 | B2 |
9082310 | Koll | Jul 2015 | B2 |
9275643 | Koll | Mar 2016 | B2 |
9424523 | Koll | Aug 2016 | B2 |
9679077 | Jaganathan et al. | Jun 2017 | B2 |
9704099 | Koll | Jul 2017 | B2 |
9996510 | Koll | Jun 2018 | B2 |
10156956 | Koll | Dec 2018 | B2 |
10325296 | Koll | Jun 2019 | B2 |
20010042080 | Ross | Nov 2001 | A1 |
20020029161 | Brodersen | Mar 2002 | A1 |
20020065854 | Pressly | May 2002 | A1 |
20020077819 | Girardo | Jun 2002 | A1 |
20020099717 | Bennett | Jul 2002 | A1 |
20020120466 | Finn | Aug 2002 | A1 |
20020198741 | Randazzo | Dec 2002 | A1 |
20030018470 | Golden | Jan 2003 | A1 |
20030074248 | Braud | Apr 2003 | A1 |
20030133156 | Cragun | Jul 2003 | A1 |
20030154085 | Kelley | Aug 2003 | A1 |
20030229614 | Kotler | Dec 2003 | A1 |
20040044546 | Moore | Mar 2004 | A1 |
20040078215 | Dahlin et al. | Apr 2004 | A1 |
20040128163 | Goodman | Jul 2004 | A1 |
20040240720 | Brantley | Dec 2004 | A1 |
20040243545 | Boone et al. | Dec 2004 | A1 |
20040254816 | Myers | Dec 2004 | A1 |
20050071194 | Bormann et al. | Mar 2005 | A1 |
20050102140 | Davne et al. | May 2005 | A1 |
20050137910 | Rao | Jun 2005 | A1 |
20050158767 | Haskell | Jul 2005 | A1 |
20050171819 | Keaton | Aug 2005 | A1 |
20050203775 | Chesbrough | Sep 2005 | A1 |
20050228815 | Carus et al. | Oct 2005 | A1 |
20050240439 | Covit | Oct 2005 | A1 |
20050251422 | Wolfman | Nov 2005 | A1 |
20060020492 | Cousineau | Jan 2006 | A1 |
20060020493 | Cousineau | Jan 2006 | A1 |
20060020886 | Agrawal | Jan 2006 | A1 |
20060036472 | Crockett | Feb 2006 | A1 |
20060041428 | Fritsch | Feb 2006 | A1 |
20060041836 | Gordon | Feb 2006 | A1 |
20060047539 | Huang | Mar 2006 | A1 |
20060074656 | Mathias | Apr 2006 | A1 |
20060122865 | Preiss | Jun 2006 | A1 |
20060129435 | Smitherman et al. | Jun 2006 | A1 |
20060178908 | Rappaport | Aug 2006 | A1 |
20060190263 | Finke | Aug 2006 | A1 |
20060277073 | Heilbrunn | Dec 2006 | A1 |
20060282302 | Hussain | Dec 2006 | A1 |
20070013968 | Ebaugh | Jan 2007 | A1 |
20070016450 | Bhora | Jan 2007 | A1 |
20070016451 | Tilson | Jan 2007 | A1 |
20070033073 | Tajaliawal | Feb 2007 | A1 |
20070050187 | Cox | Mar 2007 | A1 |
20070067185 | Halsted | Mar 2007 | A1 |
20070088564 | March | Apr 2007 | A1 |
20070106751 | Moore | May 2007 | A1 |
20070112599 | Liu | May 2007 | A1 |
20070118410 | Nadai | May 2007 | A1 |
20070143141 | Villasenor et al. | Jun 2007 | A1 |
20070198907 | Degala | Aug 2007 | A1 |
20070203708 | Polcyn | Aug 2007 | A1 |
20070226211 | Heinze et al. | Sep 2007 | A1 |
20070276649 | Schubert | Nov 2007 | A1 |
20070299665 | Koll | Dec 2007 | A1 |
20080004505 | Kapit | Jan 2008 | A1 |
20080077451 | Anthony | Mar 2008 | A1 |
20080168343 | Doganata | Jul 2008 | A1 |
20080228769 | Lita | Sep 2008 | A1 |
20080249374 | Morita | Oct 2008 | A1 |
20090048833 | Fritsch | Feb 2009 | A1 |
20090187407 | Soble | Jul 2009 | A1 |
20090192800 | Brandt | Jul 2009 | A1 |
20090192822 | Regulapati | Jul 2009 | A1 |
20090228126 | Spielberg | Sep 2009 | A1 |
20090228299 | Kangarloo et al. | Sep 2009 | A1 |
20090271218 | Mok | Oct 2009 | A1 |
20090287678 | Brown | Nov 2009 | A1 |
20100036680 | Familant | Feb 2010 | A1 |
20100063907 | Savani | Mar 2010 | A1 |
20100094657 | Stern | Apr 2010 | A1 |
20100100570 | Constantin et al. | Apr 2010 | A1 |
20100114598 | Oez | May 2010 | A1 |
20100125450 | Michaelangelo | May 2010 | A1 |
20100138241 | Ruark | Jun 2010 | A1 |
20100217624 | Kay | Aug 2010 | A1 |
20100250236 | Jagannathan | Sep 2010 | A1 |
20100299135 | Fritsch | Nov 2010 | A1 |
20100299320 | Claud et al. | Nov 2010 | A1 |
20100305997 | Ananian | Dec 2010 | A1 |
20110166875 | Hayter | Jul 2011 | A1 |
20110202370 | Green | Aug 2011 | A1 |
20110239146 | Dutta et al. | Sep 2011 | A1 |
20110295864 | Betz et al. | Dec 2011 | A1 |
20110301978 | Shiu | Dec 2011 | A1 |
20120010900 | Kaniadakis | Jan 2012 | A1 |
20120016690 | Ramarajan et al. | Jan 2012 | A1 |
20120041950 | Koll | Feb 2012 | A1 |
20120065987 | Farooq et al. | Mar 2012 | A1 |
20120166220 | Baldwin | Jun 2012 | A1 |
20120185275 | Loghmani | Jul 2012 | A1 |
20120215551 | Flanagan | Aug 2012 | A1 |
20120215782 | Jagannathan | Aug 2012 | A1 |
20120239429 | Corfield | Sep 2012 | A1 |
20120323572 | Koll | Dec 2012 | A1 |
20120323598 | Koll | Dec 2012 | A1 |
20130006667 | Green | Jan 2013 | A1 |
20130110547 | Englund et al. | May 2013 | A1 |
20130144651 | Rao | Jun 2013 | A1 |
20130159408 | Winn | Jun 2013 | A1 |
20130226617 | Mok | Aug 2013 | A1 |
20130238330 | Casella Dos Santos | Sep 2013 | A1 |
20140006431 | Jagannathan | Jan 2014 | A1 |
20140047375 | Koll | Feb 2014 | A1 |
20140108047 | Kinney | Apr 2014 | A1 |
20140164197 | Koll | Jun 2014 | A1 |
20140278553 | Fritsch | Sep 2014 | A1 |
20140324423 | Koll | Oct 2014 | A1 |
20140343963 | Fritsch | Nov 2014 | A1 |
20150066537 | Sheffer et al. | Mar 2015 | A1 |
20150088504 | Jagannathan | Mar 2015 | A1 |
20150134349 | Vdovjak | May 2015 | A1 |
20150278449 | Laborde | Oct 2015 | A1 |
20150310362 | Huffman | Oct 2015 | A1 |
20150356198 | D'Souza et al. | Dec 2015 | A1 |
20150356647 | Reiser et al. | Dec 2015 | A1 |
20150371145 | Koll | Dec 2015 | A1 |
20160012345 | Hewitt | Jan 2016 | A1 |
20160093010 | Vasiliu-Feltes et al. | Mar 2016 | A1 |
20160147955 | Shah | May 2016 | A1 |
20160166220 | Bar-Shalev | Jun 2016 | A1 |
20160179770 | Koll | Jun 2016 | A1 |
20160294964 | Brune | Oct 2016 | A1 |
20160335554 | Koll | Nov 2016 | A1 |
20160371447 | Koman | Dec 2016 | A1 |
20170068781 | Zasowski | Mar 2017 | A1 |
20170270626 | Koll | Sep 2017 | A1 |
20180040087 | Koll | Feb 2018 | A1 |
20180081859 | Snider | Mar 2018 | A1 |
20180101879 | Koll | Apr 2018 | A1 |
20180276188 | Koll | Sep 2018 | A1 |
20190026436 | Bender | Jan 2019 | A1 |
20190065008 | Koll | Feb 2019 | A1 |
Number | Date | Country |
---|---|---|
687987 | Jun 2003 | EP |
1361522 | Nov 2003 | EP |
2030196 | Sep 2018 | EP |
2883203 | Oct 2018 | EP |
3571608 | Nov 2019 | EP |
H09106428 | Apr 1997 | JP |
2002207823 | Jul 2002 | JP |
2004157815 | Jun 2004 | JP |
2005025418 | Jan 2005 | JP |
2005267358 | Sep 2005 | JP |
2006072436 | Mar 2006 | JP |
2006509295 | Mar 2006 | JP |
4037250 | Jan 2008 | JP |
2008108021 | May 2008 | JP |
2008250378 | Oct 2008 | JP |
2009211157 | Sep 2009 | JP |
2011118538 | Jun 2011 | JP |
6215383 | Sep 2016 | JP |
6339566 | May 2018 | JP |
6388864 | Sep 2018 | JP |
2005122002 | Dec 2005 | WO |
2009143395 | Nov 2009 | WO |
2011100474 | Aug 2011 | WO |
2011100474 | Jan 2012 | WO |
2012048306 | Apr 2012 | WO |
2012177611 | Dec 2012 | WO |
2014120501 | Aug 2014 | WO |
2015079354 | Jun 2015 | WO |
2015079354 | Jun 2015 | WO |
2018136417 | Jul 2018 | WO |
2019103930 | May 2019 | WO |
Entry |
---|
Daugherty B. et al., “Tracking Incidental Findings”, Radiology Today, Jul. 2014, vol. 15, No. 7, p. 6. |
Yildiz M.Y. et al., “A text processing pipeline to extract recommendations from radiology reports”, Journal of Biomedical Informatics, 2013, vol. 46, pp. 354-362. |
OpenVPMS, Follow-up tasks, Submitted by Matt C on Fri, Sep. 17, 2010, Available at: https://openvpms.org/project/followup-task-lists-enhancements. |
Adam E.J.et al., “ESR guidelines for the communication of urgent and unexpected findings” European Society of Radiology (ESR), 2011, vol. 3, Issue (1), pp. 1-3. |
“xPatterns Clinical Auto-Coding,” Atigeo, Whitepaper, pp. 8 (2014). |
Anonymous: “Medical transcription—Wikipedia”, Feb. 13, 2010, XP055465109, Retrieved from the Internet: URL: https://en.wikipedia.org/w/index.php?title=Medical_transcription&oldid=343657066 [Retrieved on Apr. 6, 2018]. |
Examiner's Report dated Apr. 15, 2019 in Canadian patent application No. 2,875,584, 4 pages. |
Non-Final Rejection dated Jun. 19, 2019 in U.S. Appl. No. 15/872,532 of Gilan El Saadawi, filed Jan. 16, 2018, 54 pages. |
Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by PetitionerNuance Communications, Inc., 81 pages. |
Exhibit 1003 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Declaration of Andrew Sears. |
Exhibit 1004 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Curriculum Vitae of Andrew Sears. |
Exhibit 1005 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner MModal Services Ltd., Michael Freeman Bliss, “Speech Recognition for Health Professionals”, Pearson Prentice Hall, pp. 18-24, (2005). |
Exhibit 1007 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Panzarasa et al., “Technical Solutions for Integrating Clinical Practice Guidelines with Electronic Patient Records”, pp. 141-154, (2010). |
Exhibit 1009 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Joel D. Miller and Elizabeth M. Wenzel, “Recent Developments in SLAB: A Software-Based System for Interactive Spatial Sound Synthesis”, Proceedings of 2002, Int'l Conf. on Auditory Display, pp. IDAC02 1-6, Jul. 2-5, 2002. |
Exhibit 1010 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner MModal Services Ltd., JCAHO—Specification Manual for National Implementation of Hospital Core Measures, Version 2.0 (Mar. 1, 2004). |
Exhibit 1011 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner MModal Services Ltd., JCAHO—Introduction and Background. |
Exhibit 1012 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., JCAHO—Using the Specifications Manual for National Implementation of Hospital Core Measures. |
Exhibit 1013 of Petition for Inter Parties Review of U.S. Pat. No. 8,412,524 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., W. H. Auden, “Menu Selection and Form Filling”, Semantic Organization, Chapter 3, 1970. |
Exhibit 1014 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner MModal Services Ltd., Alan J. Dix et al., “Human-Computer Interaction”, 2nd ed., pp. 130-137, (1998). |
Exhibit 1015 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Frequently Asked Questions: Signature Requirements, Cahaba Government Benefit Administrators (Mar. 2011). |
Exhibit 1016 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., WayBackMachine capture of CDC Website ICD-9-CM classification explanation, available at https://web.archive.org/web/20110430031819/https://www.cdc.gov/nchs/icd/icd9cm.htm (Apr. 30, 2011). |
Exhibit 1017 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner MModal Services Ltd., MModal's Preliminary Claim Construction Disclosure, MModal Services Ltd v. Nuance Communications, Inc., Case No. 1:18-cv-00901-WMR (N.D. Ga. Dec. 3, 2018). |
Exhibit 1018 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., JCAHO Facts, Joint Commission on Accreditation of Healthcare Organizations, (Aug. 1, 2005). |
Exhibit 1019 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Roe, D. B., & Wilpon, J. G. (Eds.). Voice communication between humans and machines. National Academies Press., pp. 165-198 (1994). |
Exhibit 1020 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner MModal Services Ltd., Win Phillips, “Introduction to Natural Language Processing, Consortium on Cognitive Science Instruction (Apr. 1999)”, available at https://web.archive.org/web/20090221020728/http:/www.mind.ilstu.edu/curriculum/protothinker/natural_language_processing.php (Sep. 1, 2006). |
Exhibit 1021 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Laurence S. Gillick, “A Rapid Match Algorithm for Continuous Speech Recognition”, HLT 1990 Proceedings of the Workshop on Speech and Natural Language, pp. 170-172, (Jun. 24, 1990). |
Exhibit 1022 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Declaration of Dr. James Mullins regarding public availability of Panzarasa, pp. 1-66. |
Exhibit 1022 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner MModal Services Ltd., Declaration of Dr. James Mullins regarding public availability of Panzarasa, pp. 67-110. |
Exhibit 1022 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Declaration of Dr. James Mullins regarding public availability of Panzarasa, pp. 111-153. |
Exhibit 1022 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Declaration of Dr. James Mullins regarding public availability of Panzarasa, pp. 154-201. |
Exhibit 1022 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner Nuance Communications, Inc., Declaration of Dr. James Mullins regarding public availability of Panzarasa, pp. 202-243. |
Exhibit 1022 of Petition for Inter Parties Review of U.S. Pat. No. 8,781,829 filed before the Patent Trial and Appeal Board on Dec. 21, 2018 by Petitioner MModal Services Ltd., Declaration of Dr. James Mullins regarding public availability of Panzarasa, pp. 244-273 end. |
Examiner's Report dated Dec. 20, 2018 in Canadian patent application No. 2,839,266, 4 pages. |
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2018/061517, dated Mar. 7, 2019, 10 pages. |
“Medical Decision Making and the Marshfield Clinic Scoring Tool FAQ,” American College of Emergency Physicians, May 24, 2017, 3 pages [online: https://www.acep.org/administration/reimbursement/reimbursement-faqs/medical-decision-making-and-the-marshfield-clinic-scoring-tool-faq/#sm.000019luk7uslud34somv72pq17x3]. |
Anonymous: “DMXzone Universal Form Validator PHP”, Sep. 2, 2009, XP055432714, [online: https://www.dmxzone.com/Downloads/Tutorial_FormValidatorPHP_update.zip/FormValidatorPHP_update.pdf ]. |
Centers for Medicare & Medicaid Services, “Medicare Physician Guide: 1995 Documentation Guidelines for Evaluation and Management Services,” 1995, 16 pages [online: https://www.cms.gov/Outreach-and-Education/Medicare-Learning-Network-MLN/MLNEdWebGuide/Downloads/95Docguidelines.pdf]. |
Centers for Medicare & Medicaid Services, “Medicare Physician Guide: 1997 Documentation Guidelines for Evaluation and Management Services ,” 1997, 49 pages [online: https://www.cms.gov/Outreach-and-Education/Medicare-Learning-Network-MLN/MLNEdWebGuide/Downloads/97Docguidelines.pdf]. |
Examination Report received in Canadian patent application No. 2,791,292 dated Sep. 19, 2018, 9 pages. |
Final Office Action dated Sep. 4, 2018 in U.S. Appl. No. 14/218,220 of Juergen Fritsch, filed Mar. 18, 2014, 46 pages. |
James Flanagan, et al. “Defining the Standards for Automated E&M Coding Through Coding Consistency Methodology,” Perspectives in Health Information Management, CAC Proceedings; Fall 2008, 7 pages [online: http://perspectives.ahima.org/defining-the-standards-for-automated-eam-coding-through-coding-consistency-methodology/]. |
Non-Final Office Action dated Sep. 4, 2018 in U.S. Appl. No. 15/839,037 of Detlef Koll, filed Dec. 12, 2017, 22 pages. |
Stephanie L. Jones “E/M Audit Tool: To be used with AAPC Specialty examinations,” 2006 reprinted by American Academy of Professional Coders, 2 pages [online: https://c.ymcdn.com/sites/www.txosteo.org/resource/resmgr/imported/EM%20AuditTool%20from%20Practicum.pdf]. |
Summons to Attend Oral Proceedings pursuant to Rule 115(1) EPC mailed Oct. 31, 2018, in European Patent Application No. 12802338.9, 8 pages. |
Slabodkin Greg, “CMS proposed rulereduces Evaluation andManagement coding burden”,Jul. 13, 2018, 4 pages, “https://www.healthdatamanagement.com/news/cms-proposed-rule-reduces-evaluation-and-management-coding-burden?reconf=1”. |
Communication pursuant to Article 94(3) EPC dated Jan. 8, 2019 by the European Patent Office in patent application No. 13809956.9, 5 pages. |
Arup 106428 et al., “Context-based Speech Recognition Error Detection and Correction,” Proceedings of HLT-NAACL 2004: Short Papers, May 2004, 4 pages. |
Communication Pursuant to Article 94(3) EPC, dated Jun. 27, 2019, in EPO application No. 14762803.6, 11 pages. |
Dimick, Chris, “Quality Check: An Overview of Quality Measures and Their Uses,” Journal of AHIMA 81, No. 9 (Sep. 2010); 34-38, Retrieved on May 14, 2013 from http://library.ahima.org/xpedio/groups/public/documents/ahima/bok1_047952.hcsp?DocName=bok1_047952. |
Examination Report received in Canadian patent application No. 2,791,292 dated Aug. 2, 2019, 7 pages. |
Examiner's Report dated Jun. 27, 2019 in Canadian Patent Application No. 2,881,564, 6 pages. |
First Examination Report in Indian patent application No. 2186/MUMNP/2012 dated Jul. 19, 2019, 7 pages. |
First Examination Report dated Aug. 29, 2019 in Indian patent application No. 448/MUMNP/2013, 6 pages. |
International Preliminary Report on Patentability, dated Aug. 1, 2019 in International Patent Application No. PCT/US2018/013868, 9 pages. |
International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2018/013868, dated Jun. 18, 2018, 14 pages. |
Summons to Attend Oral Proceedings Pursuant to Rule 115(1) EPC mailed Jun. 12, 2019 in European Patent Application No. 11748231.5, 11 pages. |
Examination Report dated Jun. 18, 2019, in Canadian patent application No. 2,811,942, 6 pages. |
Decision to Refuse European Application dated Oct. 24, 2019 in European Patent Application No. 11748231.5, 19 pages. |
Examiner's Report dated Nov. 29, 2019 in Canadian patent application No. 2,839,266, 4 pages. |
Final Rejection dated Nov. 27, 2019 for U.S. Appl. No. 15/872,532 of Gilan El Saadawi, filed Jan. 16, 2018, 33 pages. |
First Examination Report dated Dec. 24, 2019, in Indian patent application No. 336/DELNP/2014, 7 pages. |
First Examination Report dated Oct. 7, 2019 in Indian patent application No. 7449/DELNP/2012, 9 pages. |
Non-Final Rejection dated Jan. 9, 2020 for U.S. Appl. No. 15/788,522 of Detlef Koll, filed Oct. 19, 2017, 55 pages. |
Second Examiners Report dated May 20, 2020, in Canadian patent application No. 2,875,584, 5 pages. |
Notice of Allowance dated Sep. 11, 2020 for U.S. Appl. No. 16/174,503 of Detlef Koll, filed Oct. 30, 2018, 33 pages. |
Non Final Rejection dated Apr. 3, 2020 for U.S. Appl. No. 15/872,532 of Gilan El Saadawi, filed Jan. 16, 2018, 22 pages. |
Non Final Rejection dated Apr. 6, 2020 for U.S. Appl. No. 15/616,884 of Detlef Koll, filed Jun. 7, 2017, 7 pages. |
Non Final Rejection dated May 14, 2020 for U.S. Appl. No. 16/193,443 of Derek L. Nichols, filed Nov. 16, 2018, 64 pages. |
Final Rejection dated Mar. 16, 2020 for U.S. Appl. No. 15/993,958 of Detlef Koll, filed May 31, 2018, 33 pages. |
Non Final Rejection dated Mar. 19, 2020 for U.S. Appl. No. 16/174,503 of Detlef Koll, filed Oct. 30, 2018, 43 pages. |
Final Rejection dated Jul. 14, 2020 for U.S. Appl. No. 15/788,522 of Detlef Koll, filed Oct. 19, 2017, 33 pages. |
Final Rejection dated Jul. 21, 2020 in U.S. Appl. No. 15/872,532 of Gilan El Saadawi, filed Jan. 16, 2018, 38 pages. |
Non Final Rejection dated Jun. 10, 2020 for U.S. Appl. No. 15/993,958 of Detlef Koll, filed May 31, 2018, 14 pages. |
Examination Report received in Canadian patent application No. 2,791,292 dated Mar. 9, 2020, 3 pages. |
Examination Report dated Feb. 4, 2020, in Canadian patent application No. 2,904,656, 5 pages. |
Summons to Attend Oral Proceedings Pursuant to Rule 115(1) EPC mailed Mar. 24, 2020, by the European Patent Office in patent application No. 13809956.9, 10 pages. |
Number | Date | Country | |
---|---|---|---|
20160267232 A1 | Sep 2016 | US |
Number | Date | Country | |
---|---|---|---|
62132715 | Mar 2015 | US |