Patent Application
20080208596
The following disclosure relates to computer natural language processing (NLP), and more particularly to a system and method of interpreting and translating social and cultural sensitivities.
Inadequate cross-language and cross-cultural communications can present a problem in medical interpretation, which may lead to errors in medical care. For example, patients may be hesitant to communicate fully and openly with physicians due to a variety of cultural influences such as 1) embarrassment or cultural norms, 2) misunderstandings regarding offered treatments based on differing medical practices in the patient's native environment, and 3) in some cases, a lack of terminology by which western medical concepts can be easily translated to the patient.
While the demand for qualified medical interpreters remains high, there are simply not enough available interpreters to meet the demand. Consequently, only a fraction of hospitals may be able to provide professionally trained interpreters. What's worse, many of the interpreters may lack adequate training in medical terminology. Machine translation may provide a viable option. The demands of medicine, however, tend to require that the matter be approached in a manner different from or more comprehensive than those employed in translating web pages or interpreting tourism related queries and responses. Specific needs of both physicians and patients often motivate the quest for medically-accurate and culturally attuned communication.
Techniques for providing automated translation and interpretation are disclosed.
In one aspect, an automated interpretation occurs by receiving language-based content from a user. The received language-based content is processed to interpret the received language-based content into a target language. Also, a presence of a cultural sensitivity in the received language-based content is detected. Further, guidance for dealing with the detected cultural sensitivity is determined.
Implementations can optionally include one or more of the following features. Processing the received language-based content can include translating the language-based content into the target language. An output of the interpretation and translation can be generated as at least one of electronic text data and electronic speech data. Also, a presence of a social sensitivity can be detected in the received language-based content. In addition, an interlingua for an automated interpretation in a clinical encounter can be generated. The interlingua generated can include a Clinical Document Architecture—Revision 2 (CDA-2) implemented in conjunction with a formal medical vocabulary system. Also, a determination can be made to decide whether processing the language-based content requires a human review. Further, the received language-based content can be classified as having an immediate importance during a medical encounter. Alternatively, the language-based content can be classified as having a durable importance beyond a temporal scope of a medical encounter. A representation of the language-based content classified as having a durable importance can be stored in an electronic health record, and the representation of the classified content can include a CDA-2 representation. Also, one or more identifiers can be applied to the received language-based content. The identifiers can be associated with one or more warnings related to a subject matter known to have cultural sensitivities for the user in the target language. Alternatively, the identifiers can be associated with a subject matter that is difficult to translate into the target language.
In another aspect, a system for providing an automated translation include a receiving unit designed to receive a verbal communication from a user. The system also includes a processing unit in communication with the receiving unit. The processing unit is designed to identify a presence of a cultural sensitivity in the received verbal communication, determine guidance for dealing with the identified cultural sensitivity, and interpret the received verbal communication. The system further includes a storage unit in communication with the processing unit. The storage unit is designed to store medical information.
Implementations of the system can optionally include one or more of the following features. The processing unit of the system can further include a speech recognition unit designed to convert the received verbal communication into a written format, and a translation unit designed to translate the written format into a target language. An output of the interpretation and translation can be rendered as at least one of electronic text data and electronic speech data. The processing unit can be designed to detect a presence of a social sensitivity in the received verbal communication. Further, the processing unit can be designed to generate an interlingua for an automated interpretation in a clinical encounter. The generated interlingua can include a Clinical Document Architecture—Revision 2 (CDA-2) implemented in conjunction with a formal medical vocabulary system. Also, the processing unit can be designed to determine whether interpreting the received verbal communication requires a human review. The processing unit can be further designed to classify the received verbal communication as having an immediate importance during a medical encounter. Alternatively, the processing unit can be designed to classify the received verbal communication as having a durable importance beyond a temporal scope of a medical encounter. A representation of the verbal communication classified as having a durable importance can be stored in an electronic health record, and the representation can include a CDA-2 representation. The processing unit can also be designed to apply one or more identifiers to the received verbal communication. The identifiers are associated with one or more warnings related to a subject matter known to have cultural sensitivities for the user in the target language. Alternatively, the identifiers are associated with a subject matter that is difficult to translate into the target language.
In yet another aspect, techniques can be implemented as a computer program product, embodied in a computer readable medium, is operable to cause a data processing apparatus to perform operations as described herein.
These aspects can be implemented using an apparatus, a method, a system, or any combination of an apparatus, methods, and systems. The details of one or more embodiments of the invention are set forth in the accompanying drawings and the description below. Other features, objects, and advantages of the invention will be apparent from the description and drawings, and from the claims.
Like reference symbols in the various drawings indicate like elements.
Techniques are disclosed for implementing natural language processing (NLP) to automate translation between different languages during medical encounters. NLP is provided by the LifeCode® engine as described in U.S. Pat. No. 6,915,254 “Automatically Assigning Medical Codes Using Natural Language Processing,” which is incorporated herein by reference in its entirety. In some implementations, methods and techniques that extend the NLP concept of U.S. Pat. No. 6,915,254 are used. For example, techniques of co-pending patent applications entitled “Multi-magnitudinal Vectors with Resolution Based on Source Vector Features” and “Mere-Parsing with Boundary and Semantic Driven Scoping,” which are both incorporated herein by reference in their entireties, can be used.
The techniques described herein can be implemented to facilitate recognition and determine guidance for dealing with social and cultural sensitivities during the process of medical interpretation and translation. In some implementations, interpretation is used in its proper sense of dealing with spoken communication, whereas translation deals with written communication. Techniques implemented as described herein can be used to provide accurate medical interpretation and translation to assure that appropriate medical services are rendered to patients. The output of translation and/or interpretation, as described herein, is rendered as at least one of electronic text data or electronic speech data. For example, interpreted and/or translated electronic text data can be used as a part of a medical record and interpreted and/or translated electronic speech data can be used to communicate with a patient.
The language-based content 102 is forwarded to a processing system 108 and processed to determine if the language-based content 102 needs expert intervention. If the processing system 108 determines that the language-based content 102 cannot be fully understood, the automated system 100 requests expert guidance from a human practitioner, such as a specially trained medical interpreter. In some implementations, the automated system 100 can be utilized to provide on-line help and meta-data to aid the human expert. This is particularly helpful in the medical field where the sheer volume of knowledge is frequently beyond the ability of a human practitioner to keep in ready memory.
The medical knowledge needed by a human expert, such as a physician can be accessed from a medical knowledge storage 112 in communication with the processing system 108. To compile the medical knowledge stored in the medical knowledge storage 112, techniques in medical ontologies can be implemented to provide unambiguous representation of the majority of clinical concepts. The following are examples of techniques in medical ontologies that can be implemented: 1) the Systematic Nomenclature of Medicine—Clinical Terminology® (SNOMED-CT) [Available from the College of American Pathologists] for the core, multilingual nomenclature of clinical concepts and 2) the Clinical Document Architecture, Release 2® (CDA2) [Available from Health Level 7®] for the framework by which complex clinical events and communications can be represented using the core nomenclature.
In one aspect of the techniques, an automated system 100 is implemented to validate communications between a physician and a patient to provide assurance that the communications have been accurate and that the course of treatment is appropriate.
For example, physician directives for the patient to stand, bend, take a deep breath, etc. are determined to be in the first class of immediate importance. The accuracy of translations for communications of the first class can be easily judged by the actions of the patients. In addition, the translations of such communications are often augmented by signing, example, and physical manipulation. The communications of the second class include acquiring the patient history and review of systems, explaining diagnoses, prescribing medications and prescribing a course of treatment. Once the communications are categorized, the communications determined to be of the second class are designated at 206 to become part of the permanent record. For example, the durable content data (communications of the second class) can be stored in an Electronic Health Record (EHR) using CDA-2 for later physician review and revision. When verbal communication is received from a patient, the received verbal communication is processed to render a representation of the received verbal communication classified as having a durable importance. The representation is stored in the HER as a permanent record. In some implementations, a CDA-2 rendered representation is stored in the HER.
In some implementations, communications of the second class can become a basis for both current and future medical decision making, and can facilitate accurate completion of the course of care. The validation process can facilitate both the physician's understanding of the patient's needs and the patient's understanding of the nature of their condition and the planned course of treatment.
In some implementations, an automated system 100 is implemented to capture and analyze utterance from a patient 104 based on a more comprehensive communication than simple yes/no queries from the physician 110. Such patient utterance can include patient's expression of concerns about the severity and prospective outcome relative to their medical condition, and communication of issues relative to their life situation that contributed to their condition or that may affect their ability to follow medical instructions. Based on the comprehensive communication, the automated system 100 for providing medical interpretations is implemented to compensate for social and cultural sensitivities present in the patient's 104 utterance. This allows the physician 110 during medical encounters to initiate dialogue with open-ended questions such as “How did this happen?”, “Do you have any other questions?”, “Does this concern you?”, and the like.
In some implementations, an automated system 100 for medical translation is implemented based on the LifeCode® NLP system (available from A-Life Medical of San Diego, Calif.) for coding and abstracting clinical documents.
The LifeCode® NLP system is described in detail in U.S. Pat. No. 6,915,254, which is incorporated by reference in its entirety.
In some implementations, physician directed communication with yes/no patient responses are utilized. The responses are analyzed using back-translation on the physician side. On the patient side, multiple choice answer selections can be provided for capturing patient responses.
In some implementations, the automated system 100 divides the clinical encounter between a physician and a patient into at least nine aspects: 1) establishing rapport; 2) chief complaint; 3) history; 4) review of systems; 5) physical examination; 6) diagnoses; 7) procedures; 8) medications; 9) instructions. All but the first aspect correspond to sections of the traditional clinical note or report with representations in CDA2 and SNOMED-CT. CDA2 is primarily declarative with some capabilities to represent contingencies.
These eight aspects can then be used to present information using CDA2 and SNOMED-CT with much of the clinical encounter requiring query and response.
In one aspect of the techniques, an NLP system 300 is implemented to provide an NLP engine 306 to determine the appropriate context for each physician utterance and to appropriately process and route the content of the utterance. The overall communications flow for the system is illustrated in
The utterances that contain clinical questions or clinical statements for the patient 308 to affirm or deny or instructions are converted to CDA2 310. The converted instructions are processed by a style sheet 312 that produces the question/statement. The produced question/statement is sent for physician validation 314 and then forwarded to a patient-presentation module 316 by mapping to the patient language with, as needed, a request to affirm or deny. The style sheet 312 can be implemented using various computer languages. For example, Extensible Style Language Transformation (XSLT) can be used to create style sheets for transforming Extensible Markup Language (XML) documents.
The utterances with content that cannot be converted to CDA2 310 are routed to a general machine translation system 318. In some implementations, the content is routed for back-translation and physician approval before forwarding to the patient-presentation module 316 for presenting to the patient.
The utterances that contain references to subject matter that is deemed culturally sensitive or subject to misunderstanding is forward to a Cross-Cultural Advisor (CCA) module 320 for analysis.
In some implementations the NLP engine 306 appropriately directs information obtained from the utterance for storage in an Electronic Health Record (EHR) 322 via CDA2 310 for later physician review and revision.
In some implementations, the Cross-Cultural Advisor (CCA) (module 320 can be implemented based on the NLP engine's 306 capability for recognizing and flagging (e.g., by applying identifiers or flags) clinical content that requires special attention beyond what the NLP system 300 can independently provide.
In some implementations, the flags (or identifiers) are associated with warnings related to subject matter that is known to have either cultural sensitivities for patients in the target language group or that is difficult to translate into the target language. The CCA 320 can present to the physician pre-formulated queries or informational presentations that are designed to mitigate any misunderstandings, or advise that a human interpreter should be involved. In cases where the services of a human interpreter are called for, the CCA 320 identified topic can be used to select, when available, an interpreter with training or skills appropriate to the case at hand. This can be particularly useful when Video Medical Interpretation (VMI) capabilities are used, and there is a pool of remote interpreters from which to select.
In some implementations, the CDA2 310 XML is extended by using a <Question>. . . </Question> tag pair to wrap CDA observations, or, for full CDA2 compliance, the section title tags can be used as <section> <title>Question</title><entry>. . . </entry> </section>. This allows the XSLT module 312 to interpret and present CDA observations as questions to the patient 308 without having to enter them as physician remarks in the medical record until the physician 302 affirms or denies the observations.
In some implementations, a simplified encounter between a physician and a patient can be described to include at least the following communication features.
Physician: “Good morning.”
Machine Translation System: “Buenos días.”
Patient: “Buenos días.”
Physician: “What seems to be the problem?”
Machine Translation System: “What seems to be the problem?”
Machine Translation System: “ Qué se parece ser el problema?”
Patient: “Caí en la ducha y lastimé mi muñeca.” (patient points to left wrist)
Machine Translation System: “I fell in the shower and hurt my wrist.”
Physician: “You fell in the shower and you have pain in your left wrist?”
Machine Translation System: “Please confirm: fall in shower?”
Machine Translation System: “Confirme por favor: caída en ducha?”
Machine Translation System: “Please confirm: left wrist pain?”
Machine Translation System: “Confirme por favor: dolor izquierdo estructura de la región de la muñeca?”
Physician: “Do you have any other pain?”
Machine Translation System: “Do you have other pain?”
Machine Translation System: “Usted tiene otro dolor?”
Examination follows a similar course of dialogue.
Physician: “You have a bruise on the left forearm and a mild sprain of the left wrist.”
Machine Translation System: “You have: left forearm contusion; mild left wrist sprain. Do you understand?”
Machine Translation System: “Usted tiene: contusion izquierdo del antebrazo. Usted entiende?”
Machine Translation System: “Usted tiene: esguince izquierdo leve estructura de la región de la mufieca. Usted entiende?”
Physician: “Instructions: no lifting for one week; take Tylenol 650 mg qid for two days.”
Machine Translation System: “Instructions: no lifting; duration: 1 week. Medication: Tylenol, quantity: 650 millegrams, frequency: every 6 hours, duration: 2 days.”
Machine Translation System: “Instrucciones: ninguna elevación; duración: 1 semana. Usted entiende?”
Machine Translation System: “Medicación: Tylenol, cantidad: 650 millegrams, frecuencia: cada 6 horas, duración: 2 dias. Usted entiende?”
Physician: “Do you have any other concerns?”
Machine Translation System: “Do you have any other concerns?”
Machine Translation System: “ Usted tiene otras preocupaciones?”
Patient: “Estoy asustado para mi bebé.”(Patient points to abdomen) “Mi marido está enojado que pude haber lastimado al bebé.”
Machine Translation System: “I'm afraid for may baby. My husband is angry that I may have hurt the baby.”
Physician: “Are you pregnant?”
Machine Translation System: “Are you pregnant?”
Machine Translation System: “ Es usted embarazado?”
Physician: “Is your husband angry with you?”
Machine Translation System: “Warning: . . . ” (Machine Translation System produces a cultural warning relative to the importance of bearing children in Hispanic cultures, marital relations . . . The decision is made to involve an interpreter with skills in pregnancy and domestic issues.)
In another aspect of the techniques, a Clinical Document Architecture (CDA) system is created as an interlingua for automated interpretation in a clinical setting. Interlingua is a formal representation of the semantic content of a written or spoken utterance. Techniques can be implemented to use the interlingua as the basis for translation from one natural language to another.
In some implementations, CDA2 and SNOMED-CT are implemented as the interlingua for use in those portions of the encounter where clinical accuracy is essential. However, other suitable techniques in medical ontologies can also be implemented. CDA2 is a publicly available standard from the Health Level 7® (HL7) organization. A clinical document architecture system can be implemented to exploit the fact that CDA2, used in conjunction with a formal medical vocabulary (e.g. the Systematic Nomenclature of Medicine—Clinical Terminology (SNOMED-CT) which is available with a plurality of language editions all unified by use of the same numeric codes) and a natural language processing (NLP) engine to map natural language, becomes an interlingua. The strengths of CDA2 and SNOMED-CT are in the coverage of medical concepts, the ability to formally assemble concepts in a coherent representation of an encounter, and the ability to easily map that formal representation to a variety of applications via XSLT and alternate language representations.
A sample selection from a CDA2/SNOMED-CT representation from the earlier dialog is as follows:
Although nomenclatures such as SNOMED-CT provide coverage for concepts such as embarrassment, inappropriate behavior, identification of cultural and value components related to pain management, etc., they do not provide insights into the actual cultural components that affect these concepts. In some implementation, a Clinical Document Architecture system is implemented to separately develop the cultural components for building a reliable archive of cultural components. The archiving can be implemented by attaching metadata to specific semi-knowledge entries along with corresponding flags (or identifiers) and helps. The techniques can be further expanded so as to use the considerable waiting time that patients typically experience in medical settings. During the waiting time, a patient interacts with the clinical document architecture system, which would interactively provide language and culture specific materials to educate and acculturate the patient.
In some implementations, the techniques for providing automated translation and interpretation as described in
The computer readable medium may include a hard disk drive, a flash memory device, a random access memory device such as DRAM and SDRAM, removable storage medium such as CD-ROM and DVD-ROM, a tape, a floppy disk, a CompactFlash memory card, a secure digital (SD) memory card, or some other storage device
In some implementations, the computer executable code may include multiple portions or modules, with each portion designed to perform a specific function described in connection with
Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer, including graphics processors, such as a GPU. Generally, the processor will receive instructions and data from a read only memory or a random access memory or both. The essential elements of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto optical disks, or optical disks. Information carriers suitable for embodying computer program instructions and data include all forms of non volatile memory, including by way of example semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto optical disks; and CD ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
A number of embodiments of the invention have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. Accordingly, other embodiments are within the scope of the following claims.
This application claims priority under 35 USC §119(e) to U.S. Patent Application Ser. No. 60/782,694, filed on Mar. 14, 2006, the entire contents of which are hereby incorporated by reference.
| Number | Date | Country | |
|---|---|---|---|
| 60782694 | Mar 2006 | US |
