The subject matter disclosed herein relates generally to speech devices and methods. More particularly, the subject matter disclosed herein relates to intraoral speech devices, methods, systems and computer-implemented programs and products.
Speech impediments exist in greater than 8% of the population in the United States. Speech unintelligibility can have a negative impact on societal integration and psychosocial wellbeing of a person suffering from the pathology. Patients need regular, costly, speech therapy sessions to improve speech intelligibility. Thus, there is a need for a speech encouragement or correction device and/or system that can help quickly and easily improve the speech of those with speech disorders due to various causes. There is also a need to aid those who wish to affect their speech in a specific manner.
Recent studies have shown better compliance with mobile games compared to traditional methods of improving patient compliance. Thus, a system incorporating an intraoral speech device with a mobile compliance application would be an ideal solution to the speech impediments found in those with speech impediments.
In accordance with the subject matter here, intraoral speech devices, methods, systems and computer-implemented programs and products are disclosed. In some embodiments, an intraoral speech device or system can comprise a personalized intraoral speech device and mobile application that records tongue position and force with correct articulation and provides a user or patient with haptic, tactile, and/or audio-visual feedback, such as with tongue positioning, placement or pressure, and can, for example, comprise providing feedback based upon tongue position or placement relative to a desired or correct tongue position or placement associated with speech. In some embodiments, speech sounds may at the same time be detected in the mobile application. The approach involves customized construction of a variable thickness plate constructed of any suitable material, such as for example acrylic or polypropylene, with or without retentive clasps that cover the palate. A wireless-enabled (e.g., Bluetooth) touch-sensing surface or ultrasonic sensors can be included that can register a specific tongue position, placement, and force, confirm desired or correct articulation or provide information on incorrect tongue placement and/or force. A mobile gaming-style application can be provided for use in association with the intraoral device that receives the device signal with tongue positioning or placement, such as desired or correct tongue positioning or placement, to provide physical and/or audio-visual feedback. Haptic feedback can, for example, comprise plate vibration with specified tongue positioning, placement or pressure, and can, for example, comprise desired or correct tongue placement. Tactile feedback is with, for example different materials and surfaces. Haptic feedback, or any other feedback, may also occur from the mobile application to the device thus training/teaching the user or patient on the desired tongue placement and force. Speech sounds registered in the mobile application can also be displayed to provide immediate audio-visual feedback.
In one aspect, an intraoral speech device or system comprises a plate configured to fit a user's palate and upper (maxillary) dental arch, and an electronic circuit within, on or both within and on the plate and comprising one or more detection element configured to detect one or more of, or all of, a pressure applied by a tongue of the user, a position of the tongue within an intraoral cavity (mouth) of the user, or speech sounds produced by the user, wherein the electronic circuit is configured to wirelessly provide feedback to the user based on data from the one or more detection element.
In another aspect, a speech method comprises providing an intraoral speech device in a palate of a user, the device comprising an electronic circuit and one or more detection element, using the one or more detection element to detect tongue data that comprises tongue pressure data and/or tongue position data; and wirelessly providing feedback from the device to the user based on the tongue data. In addition, data may be stored or transmitted remotely for monitoring and/or telepractice use.
Although some of the aspects of the subject matter disclosed herein have been stated hereinabove, and which are achieved in whole or in part by the presently disclosed subject matter, other aspects will become evident as the description proceeds when taken in connection with the accompanying drawings as best described hereinbelow.
Features and advantages of the present subject matter will be more readily understood from the following detailed description which should be read in conjunction with the accompanying drawings that are given merely by way of explanatory and non-limiting example, and in which:
The subject matter herein discloses a custom-fitted intraoral device augmented by a computer or mobile application or program (i.e., mobile gaming application) that is configured to improve speech efficacy leading, in some cases, to rapid and sustained correction of speech intelligibility. The novel and innovative approach aims to design and develop an intraoral speech device and mobile gaming application for speech impediment patients, and the principles disclosed herein can be applied to help train a user's speech patterns in other contexts, such as for learning foreign languages, modifying speech accents, and for singing. The speech device can be in a form of a mouthpiece-type device and can be used for speech therapy applications as well as speech diagnostic applications.
Referring to
In some embodiments, the intraoral speech device 100 can have a form that is similar to a removable orthodontic retainer. In such configurations, the device can be designed with dental wire retention clasps 115, which can be embedded in the material of intraoral plate 110 and can be suitably attached to, against, or retained on or by one or more teeth as desired. In some embodiments, for example, clasps 115 are composed of metal (e.g., stainless steel) or any other suitable material that can securely hold intraoral plate 110 in position with respect to a user's palate P and dental arches. Alternatively, referring to
Referring to
Referring to
In some embodiments, one or more detection element 122 is likewise at least partially (or entirely) embedded on or within intraoral plate 110, or alternatively positioned on the surface of intraoral plate 110. Each detection element 122 can be placed in any position within the plate to identify tongue position and pressure, and/or speech sounds. The number of elements can vary from one to multiple in the one plate spaced at any distance desired. For example, three detection elements may be placed at the front of the plate at 3 mm separation and another three detection elements may be placed at the back-end of the plate for identifying correct and incorrect tongue position and pressure when making certain speech sounds (e.g. /l/, /t/, /d/, /r/). Referring to
In addition, in some embodiments, the one or more detection element 122 can include ultrasonic sensors placed along the side of intraoral plate 110 for sensing tongue position at the same time. In another example, the one or more detection element 122 can be positioned around the periphery of the dental arch to detect tongue position and pressure when making sounds, such as /z/. Each detection element 122 can be one of an electrode or sensor that is positioned to sense correct and incorrect tongue positioning, pressure, or sound during speech articulation. In some embodiments, the detection element 122 can comprise one or more force sensor or strain gauge capable of low power consumption and wireless readout, and any of a variety of other suitable sensors (e.g. capacitive Micro-Electro-Mechanical-Systems (MEMS)) can be used. In some embodiments, the one or more detection element 122 can comprise an ultrasonic element comprising a transmitter and receiver. In some embodiments, the one or more detection element 122 is coated or encapsulated with a chemically and biologically inert material to ensure waterproofing within the intraoral environment.
Regardless of the particular form of the one or more detection element 122, in some embodiments the one or more detection element 122 is configured to detect one or more of a pressure applied by a tongue of the user, a position of the tongue within a mouth of the user, or speech sounds produced by the user. It is also envisioned that a plurality of detection elements 122 can be used on the same plate where the detection elements 122 are configured to detect different features. For example, one or more of the detection elements 122 can be configured to detect the pressure applied by a tongue of the user, while one or more others of the detection elements 122 is or are configured to detect the position of the tongue within a mouth of the user, and/or to detect speech sounds produced by the user.
The one or more detection element 122 can detect tongue pressure, for example, in a range of between, and including, about 0.001 kPa and 50 kPa. In some embodiments and without limitation, the one or more detection element 122 can be configured to detect and record (for example for subsequent analysis) a tongue position of the user up to within a 0.1 mm-6.0 mm resolution. In some embodiments, however, power consumption and communications system use can be minimized in configurations in which each detection element 122 is configured to supply a signal to electronic circuit 120 only where the detected pressure exceeds a minimum detection threshold. In this way, the one or more detection element 122 can be configured to communicate with the control and feedback systems discussed below when the tongue is sensed in the correct place and pressure in the mouth for the desired speech sounds. The detection elements can also be configured to provide information on incorrect tongue placement and pressure when making speech sounds. Intraoral speech device 100 can be configured such that the detected tongue pressure and/or position data are recorded for diagnostic, therapeutic, and/or research purposes. Alternatively or in addition, intraoral speech device 100 can be configured to provide real-time feedback such that data need not necessarily be recorded.
The one or more detection element 122 can be individually in communication with electronic circuit 120 to discretely detect tongue pressure at various locations on intraoral plate 110 and/or the one or more detection element 122 can be configured to operate as an array of detection elements 122 to communicate a coordinated combination of locations at which tongue pressure is detected. In some embodiments, for example, the one or more detection element 122 can be placed around intraoral plate 110 at a location or locations that substantially correspond with positions at which the tongue needs to be for specific speech sounds. For example, in some embodiments, one or more of detection element 122 is positioned to detect the tongue as being in a normal position at rest, whereas others of the one or more of detection element 122 are positioned around the palate to detect where the tongue should move to make certain sounds. In some embodiments, the one or more of detection element 122 can provide the tongue data to electronic circuit 120.
In some embodiments, the plate comprises one or more processor or microprocessor 124 configured to wirelessly provide the feedback to the user based on readings from the one or more detection element(s) 122. In some embodiments, the one or more processor or microprocessor 124 can comprise one or more integrated circuits for data processing and communication protocols. In some embodiments, electronic circuit 120 and the one or more processor or microprocessor 124 can be combined into a single chip, or they can be separate circuit elements connected through intraoral plate 110. In some embodiments, the one or more processor or microprocessor 124 is in communication with the one or more detection element 122 and electronic circuit 120 and configured to process inputs from the one or more detection element 122 and provide electrical signals to electronic circuit 120 detailing what feedback to give the user. For example and without limitation, when the one or more detection element 122 detects tongue pressure in various locations throughout the palate while the user is speaking, the one or more processor or microprocessor 124 is configured to determine whether the tongue is moving in a desired or correct position and pressure and/or force and send signals to electronic circuit 120 detailing whether the tongue position is desired or correct while the user is saying the particular words.
In some embodiments, intraoral speech device 100 further comprises a power source 128 configured for charging the various electronic components of the device. In some embodiments, for example, power source 128 can include a rechargeable battery (e.g., a lithium polymer battery (LiPo) battery) and wireless charging circuitry and/or a wired connection for charging the battery. The particular configuration for power source 128 can be selected based on suitable charge capacity, size, and safety. In some embodiments, wired charging of the battery will take place through ports in the plate that are covered by a waterproof, inert material when not being used. Wireless charging circuitry will be designed based on battery type as well as on available real estate on electronic circuit 120 for the receiver coil and regulating/charging circuitry. The charge rate profile can correspondingly be tailored to the specific battery type. In some embodiments, transduction of power from the transmitter to intraoral speech device 100 is optimized based on coil size and frequency of operation. A lines-powered wireless charging station corresponding to power source 128 can thereby permit easy charging of intraoral speech device 100 by the user. The wireless charging circuitry will be embedded full or partially within the plate and placed in any position in the plate to facilitate effective induction of the receiver coil by the transmitter coil.
All components, including the one or more detection element 122, the one or more processor or microprocessor 124, and power source 128, can be placed at any of a variety of locations on or in intraoral plate 110 depending on the user's palatal and dental anatomy and desired speech requirements.
In some embodiments, intraoral speech device 100 is configured to wirelessly provide feedback to the user regarding the tongue position, placement and/or pressure based on readings from the one or more detection element 122 while the user is talking, the feedback being configured to encourage, enable, and facilitate desired speech by the user. In some embodiments, for example, one or more onboard feedback element 126 is positioned on or at least partially or entirely embedded within intraoral plate 110. Each onboard feedback element 126 is configured to provide a physical feedback cue on correct and incorrect tongue position and pressure to the user at one or more position on intraoral plate 110. For example and without limitation, each onboard feedback element 126 can provide a vibration, electric shock, pulse, or other haptic feedback, electro-tactile feedback, ultrasound tactile feedback, thermal feedback, force feedback, and/or any of a variety of other suitable type of feedback, to the tongue or other part of the mouth to let the user know when their tongue is placed in a predetermined, correct position or to indicate that the tongue is placed in an incorrect position for the particular word, phrase, or sentence being spoken. In some embodiments, the electronic circuit further comprises devices that are configured to provide haptic feedback.
In some embodiments, for example and without limitation, electronic circuit 120 and/or the one or more onboard feedback element 126 can comprise a piezo actuator with haptic feedback or any other suitable device capable of providing haptic feedback or any other physical feedback. The feedback given by electronic circuit 120 is configured to encourage and facilitate desired speech by the user. Regardless of the particular form of physical feedback, the feedback provided inside the mouth as the user is speaking can be controlled by logic circuits contained on electronic circuit 120. Thus, in some embodiments, intraoral speech device 100 is configured to operate on its own to change or correct the speech of the user without any communication with devices outside the mouth of the user. In other words, in some embodiments, intraoral speech device 100 can, in some embodiments, operate to change or correct the speech of the user, without transmitting data to or receiving data from outside the mouth.
Alternatively or in addition, in some embodiments, electronic circuit 120 is configured to wirelessly communicate with a remote computer or other external electronic device 200, such by an app running on a smartphone or other handheld electronic device. In some embodiments, for example, electronic circuit 120 can comprise and utilize wireless communication components such as, for example and without limitation, Bluetooth components and/or Wi-Fi components. In any form, electronic device 200 can be configured to initiate feedback that can encourage tongue placement and pressure.
Alternatively or in addition to the one or more onboard feedback element 126, in some embodiments, the feedback given can comprise audio-visual feedback provided by electronic device 200, such as on a mobile device, screen, or monitor. For example and without limitation, a visual rendering 212 of the user's mouth can be displayed for the user on a mobile device, screen, or monitor of electronic device 200. The audio-visual feedback can be provided as a visual rendering 212 of the user's mouth, including indicating on visual rendering 212 where the user's tongue should be placed, where the tongue is currently being placed, and where it should be moved to with or without the appropriate tongue pressure, or any other suitable information. Such visual feedback can also be accompanied by audio cues.
Referring to
In some embodiments, computer or mobile application 210 can comprise a mobile application game, a mobile application, a game operating on a cloud server, or any other suitable computer or mobile application. In some embodiments, computer or mobile application 210 can comprise a mobile game application that is configured to interact with intraoral speech device 110 and give the user an interface to track progress, play games that help the user improve their speech, play games that allow them to compete with other users, or other suitable gaming platform. Such apps can, for example and without limitation, include games displayed and played on electronic device 200 that electronically communicates with intraoral speech device 100. Such games can for example include interactive activities and/or exercises encouraging and even rewarding a wearer of the speech device to engage in proper, desired, and/or correct tongue positioning and placement with correct pressure applied by the tongue for desired speech. The mobile app can also be configured to provide feedback on speech sounds while the speech sounds are being made and recorded such as for further, later analysis. The apps or games can, for example and without limitation, comprise the user (wearer) of intraoral speech device 100 creating a character in the app or game.
As described herein, in some embodiments, the external processing system operating the computer or mobile application 210 can be in communication with one or more intraoral speech devices 100. For example, as shown in
In some embodiments, the computer or mobile application 210 is configured to wirelessly record and/or display data to the user (or any other person), including desired or correct tongue position, placement and/or pressure, and the correct speech sounds. In some embodiments, the computer or mobile application 210 is configured to record data (i.e., tongue position and pressure data, desired or correct tongue position, etc.) from the intraoral speech device. The computer or mobile application 210, in some embodiments, can be configured to wirelessly transmit and receive data from another computer, server, or computing system. For example and without limitation, the computer or mobile application 210 can be configured to wirelessly transmit or display helpful feedback to the user via an application on their phone, email or other means. Such feedback could include accuracy percentage, details on how to get better, high scores on particular games played, or any other suitable data. The app could also play back the sound made and related to tongue positioning provide a score on success. In some embodiments, the gamification features of the app and ability to be a part of a virtual community will provide motivational support to regular intraoral device supporting correct tongue positioning and pressure for production of the desired speech sounds. Known as the Hawthorne effect, recording of data and remote monitoring also support regular device use with associated achievement of desired speech.
In some embodiments, the computer or mobile application 210, whether it be a mobile application, mobile game, or gaming application, can be downloaded by a speech-language pathologist or other health professional with the user and the health professional can help register or input user data and prescribe various exercises to be performed with intraoral speech device 100. In some embodiments, the computer or mobile application 210 can be configured to give awards or rewards to the user in return for good compliance with daily exercises. This can further increase the success of the device. In some embodiments, the computer or mobile application 210 is configured such that the user can create an avatar and compete with others for compliance. In some embodiments, the computer or mobile application 210 is configured to register desired or correct tongue positioning and pressure and use this information to either change or correct bad placement or reward good placement and to inform the user about what steps to take to improve their speech.
In some further embodiments, the computer or mobile application 210 is configured to display daily, weekly, and/or monthly data about the tongue placement and pressure, making of speech sounds, and speech exercises allowing the speech-language pathologist and the user to see their progress. These data may be stored to aid system iterations and for remote monitoring of progress. In some embodiments, any games or exercises displayed or played on the computer or mobile application 210 are configured to improve the speech of the user. In some embodiments, the computer or mobile application 210 is configured to transmit data wirelessly or via a wired connection, from electronic device 200 on which it is operating to the speech-language pathologist or other health professional, regarding the user's engagement and results from the exercises and games as well as the user's progress, if any, for diagnostic, therapeutic, and/or research purposes. Additionally, in some embodiments, the computer or mobile application 210 is configured such that a telehealth or video chat feature can be performed (i.e., between the user and the speech-language pathologist or any other appropriate person).
In another aspect, the subject matter of the disclosure herein includes a speech system comprising one or more intraoral speech devices 100 as described herein and one or more electronic devices 200 as described herein, each electronic device 200 being configured to operate a computer or mobile application 210 in communication with one or more of the one or more intraoral speech devices 100.
In a further aspect, the subject matter of the disclosure herein includes a speech training method as illustrated in
Alternatively or in addition, in some embodiments, the identification of the tongue position, placement and/or pressure is communicated to an external electronic device 200, and an audio-visual feedback is provided to the user based on the evaluation of the correctness of the tongue position and pressure for a given speech pattern in a display step 304. As discussed above, in some embodiments, tongue position and pressure data, desired or correct tongue position, or other relevant data from intraoral speech device 100 can be stored on the electronic device 200 or communicated to another computer, server, or computing system in a data collection step 305. As discussed above, such data storage can be used to track usage of intraoral speech device 100 and document progress of the user for diagnostic, therapeutic, and/or research purposes.
The present subject matter can be embodied in other forms without departure from the spirit and essential characteristics thereof. The embodiments described therefore are to be considered in all respects as illustrative and not restrictive. Although the present subject matter has been described in terms of certain specific embodiments, other embodiments that are apparent to those of ordinary skill in the art are also within the scope of the present subject matter.
This patent application claims priority to U.S. Provisional Patent Ser. No. 63/089,891, filed Oct. 9, 2020, the disclosure of which is incorporated by reference herein in its entirety.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2021/054107 | 10/8/2021 | WO |
Number | Date | Country | |
---|---|---|---|
63089891 | Oct 2020 | US |