Earpiece with in-ear electrodes

Information

  • Patent Grant
  • 10617297
  • Patent Number
    10,617,297
  • Date Filed
    Friday, October 27, 2017
    6 years ago
  • Date Issued
    Tuesday, April 14, 2020
    4 years ago
  • Inventors
  • Original Assignees
  • Examiners
    • Winakur; Eric F
    • Liu; Chu Chuan
    Agents
    • Goodhue, Coleman & Owens, P.C.
Abstract
In some embodiments, an electronic device for monitoring EEG data, may include one or more of the following features: (a) a housing, (b) a processor disposed within the housing, (c) at least one sensor operatively connected to the processor, (d) at least two EEG electrodes operatively connected to the processor and positioned on the housing for receiving EEG signals from an ear surface, and (e) a plurality of EEG electrodes, wherein the processor measures the impedance of the plurality of EEG electrodes.
Description
FIELD OF THE INVENTION

The present invention relates to wearable devices. Particularly, the present invention relates to wireless earpieces. More particularly, but not exclusively, the present invention relates to wireless earpieces having electrodes.


BACKGROUND

There is growing market demand for personal health monitors, for example, for gauging overall health and metabolism of persons during exercise, athletic training, dieting, and physical therapy. Various physiological information, such as electrocardiogram (ECG) information, electroencephalogram (EEG) information, electrooculography (EOG) information, and other forms of physiological electrical activity, may be useful to monitor during physical activity. However, traditional monitors for measuring this type of information may be bulky, rigid, non-portable, and uncomfortable—generally not suitable for use during physical activity.


Current methods of receiving EEG signals are very cumbersome and indiscreet. In order to get an accurate reading of a user's brain waves, a medical professional or a person trained in electrode placement must place electrodes at certain spots on a user's head in order to obtain a usable reading. Problems with this method include the need for trained personnel to accurately place an electrode, attenuation of the EEG signals due to the skull, and possible infection from the electrode placement. Current research suggests, however, EEG signals may be received using an earpiece with electrodes attached at certain points make contact with an ear surface of the user. Using this method trained personnel are no longer needed and the EEG signal is less attenuated due to electrode placement within the ear canal. However, since the electrodes are so close together, it is difficult to get a good signal due to reduced spatial resolution and high impedances between the EEG electrodes and the skin.


Therefore, what is needed is a system and method of obtaining a usable EEG signal from a user using an earpiece.


SUMMARY

Therefore, it is a primary object, feature, or advantage of the present invention to improve over the state of the art.


In some embodiments, an electronic device for monitoring EEG data, may include one or more of the following features: (a) a housing, (b) a processor disposed within the housing, (c) at least one sensor operatively connected to the processor, (d) at least two EEG electrodes operatively connected to the processor and positioned on the housing for receiving EEG signals from an ear surface, and (e) a plurality of EEG electrodes, wherein the processor measures the impedance of the plurality of EEG electrodes.


In some embodiments a method of receiving an EEG signal from an ear surface may include one or more of the following steps: (a) transmitting a current to a plurality of EEG electrodes, (b) receiving at least one sensor reading from a sensor operatively connected to the processor, (c) communicating, a voltage drop associated with of the plurality of EEG electrodes to the processor, (d) determining an impedance of each of the plurality of EEG electrodes, (e) determining which of the impedances are below a programmed threshold for each of the plurality of EEG electrodes, (f) transmitting an activation signal to the plurality of EEG electrodes which have an impedance below the programmed threshold, (g) receiving an EEG signal from the plurality of EEG electrodes which have an impedance below the programmed threshold, (h) determining which of the plurality of electrodes do not have a reliable EEG signal based upon the at least one sensor reading, (i) receiving a sensor reading from a plurality of sensors, and (j) providing a reliable EEG signal based upon the EEG signal taken from the plurality of EEG electrodes which have an impedance below the programmed threshold and have the reliable EEG signal based upon the at least one sensor reading.


In some embodiments a system may include one or more of the following features: (a) a first earpiece having a housing, (b) a processor disposed within the housing, (c) at least one sensor disposed within the housing and operatively connected to the processor, wherein the at least one sensor is configured to sense user data and communicate the user data to the processor, and (d) a plurality of EEG electrodes operatively connected to the processor and positioned on the housing for receiving EEG signals from an ear surface, wherein the processor transmits a current to each of the plurality of EEG electrodes to determine an impedance from each of the plurality of EEG electrodes and subsequently communicates an activation signal to selected EEG electrodes if the impedance associated with the EEG electrode is below a programmed threshold.


One or more of these and/or other objects, features, or advantages of the present invention will become apparent from the specification and claims follow. No single embodiment need provide each and every object, feature, or advantage. Different embodiments may have different objects, features, or advantages. Therefore, the present invention is not to be limited to or by an objects, features, or advantages stated herein.





BRIEF DESCRIPTION OF THE DRAWINGS

Illustrated embodiments of the disclosure are described in detail below with reference to the attached drawing figures, which are incorporated by reference herein.



FIG. 1 is a pictorial representation of a smart case and wireless earpieces in accordance with an illustrative embodiment;



FIG. 2 is a pictorial representation of wireless earpieces having electrodes in accordance with an illustrative embodiment;



FIG. 3 is a pictorial representation of an earpiece with a plurality of EEG electrodes placed within a user's ear in accordance with an illustrative embodiment;



FIG. 4 is a block diagram of a wireless earpiece in accordance with an illustrative embodiment;



FIG. 5 is a block diagram of a wireless earpiece in accordance with an illustrative embodiment;



FIG. 6 is a block diagram for modifying a function of an earpiece using an EEG signal in accordance with an illustrative embodiment; and



FIG. 7 is a block diagram for providing a large electrode in accordance with an illustrative embodiment.





DETAILED DESCRIPTION

The following discussion is presented to enable a person skilled in the art to make and use the present teachings. Various modifications to the illustrated embodiments will be readily apparent to those skilled in the art, and the generic principles herein may be applied to other embodiments and applications without departing from the present teachings. Thus, the present teachings are not intended to be limited to embodiments shown, but are to be accorded the widest scope consistent with the principles and features disclosed herein. The following detailed description is to be read with reference to the figures, in which like elements in different figures have like reference numerals. The figures, which are not necessarily to scale, depict selected embodiments and are not intended to limit the scope of the present teachings. Skilled artisans will recognize the examples provided herein have many useful alternatives and fall within the scope of the present teachings. While embodiments of the present invention are discussed in terms of wearable devices and obtaining a useful signal from an onboard electrode, it is fully contemplated embodiments of the present invention could be used in most any electronic communications device without departing from the spirit of the invention.


While the present invention will be discussed, shown and illustrated as embodiments for a smart case and wireless earpieces, the inventor(s) fully contemplate embodiments of the present invention can be extended to all electronics and particularly to all mobile electronic devices and more particularly to all mobile electronic devices having or needing a connection to another electronic device in order to charge and/or communicate data. Examples of these devices include mobile phones, fitness monitoring devices, such as watches, eyewear, belts, etc. and implantable devices. Embodiments of the present invention can also be extended to electronic medical device applications as well including any devices which monitor and/or record physiological data and then download or report this data to a host device. The present invention could also be extended to other form of earpieces such as custom mold earpieces and/or visoelastic earplugs or earpieces. The inventor(s) further acknowledge there are many more electronic devices the present invention could be applied towards, which have not been named in the paragraph above. Therefore, the illustrative embodiments listed below in no way should be interpreted to limit the scope of embodiments of the present invention.


Embodiments of the present invention, discussed in great detail below, show many aspects of the current invention. An embodiment of the present invention details determining ideal locations and/or specific electrode(s) from which to receive an EEG signal. Another embodiment of the present invention details, being able to continuously determine ideal locations and or specific electrode(s) to receive an EEG signal. Another embodiment of the present invention details using sensor readings to ascertain ideal locations and/or electrode(s) to receive an EEG signal. Another embodiment of the present invention details using a differential amplifier in order to reduce common mode noise (when transmitting data, wires can act as antennas pick up a signal “noise” and this is undesirable). Another embodiment of the present invention details modifying one or more functions of a wireless earpiece based upon interpreted brain wave input.


In another embodiment, a wireless earpiece has a housing, a processor disposed within the housing, one or more sensor(s) operatively connected to the housing and the processor, and one or more EEG electrode(s) operatively connected to the processor and positioned on the housing for receiving EEG signals from an ear surface. Two or more of the EEG electrode(s) are positioned to contact an outer surface of an ear and to contact an inner surface of an ear canal.


One or more of the following features may be included in embodiments of the present invention. One or more of the sensor(s) may comprise an MEMS gyroscope (vibrating structure microelectromechanical systems), an electronic magnetometer (an instrument measuring magnetism—either the magnetization of a magnetic material like a ferromagnet, or the direction, strength, or relative change of a magnetic field at a particular location), or an electronic accelerometer (a device measuring acceleration). A differential amplifier (a device which amplifies the difference between two or more signals) may be disposed within the housing and operatively connected to each EEG electrode and the processor. The differential amplifier may further comprise at least one analog filter. An analog-to-digital converter may be disposed within the housing and operatively connected to the processor and the differential amplifier.


In another embodiment, a method of receiving an EEG signal from an ear surface using an earpiece is discussed in great detail below. The method includes transmitting, via a processor, a current to each EEG electrode and the processor receiving one or more sensor readings from a sensor operatively connected to the earpiece. Based upon this received sensor data, certain EEG electrodes may not be used to obtain data based upon a certain activity the user is performing which may make certain EEG electrodes unreliable or the data from them faulty. A voltage drop occurs at each EEG electrode based upon the current sent to the EEG electrode by the processor, and the processor obtains and records this voltage drop. From this voltage drop, the processor can calculate an impedance of each EEG electrode and determine which impedances are below a programmed threshold. The programmed threshold being an impedance below a certain level in which reliable data can be obtained from the EEG electrode. The processor sends an activation signal to the EEG electrodes based upon both the sensor readings and the impedances for each EEG electrode. The processor then receiving back a reliable EEG signal


One or more of the following features may be included in embodiments of the present invention. One or more EEG electrodes may be positioned on a surface within an ear canal. Specifically, the EEG electrodes may be positioned on a concha, fossa, antihelix, antihelical fold or the scapha. The EEG signal may be further amplified by a differential amplifier to create an amplified EEG signal. The amplified EEG signal may be further filtered by the differential amplifier to create a filter amplified EEG signal. The filter amplified EEG signal may be sampled with an analog-to-digital converter to create a sampled filtered amplified EEG signal. The sampled filtered amplified EEG signal may be used to modify one or more functions of the earpiece.


One or more of the following features may be included to the embodiments listed below. User data may comprise motion data, which would be detected by sensors. The differential amplifier amplifies the difference between the voltages of two separate EEG signals to reduce common mode noise in the two separate EEG signals to create an amplified EEG signal. The differential amplifier may have a high pass filter and a low pass filter. An analog-to-digital converter may be disposed within the housing operatively connected to the processor and the differential amplifier, and the analog-to-digital converter samples the amplified EEG signal and communicates a sampled amplified EEG signal to the processor. The amplified EEG signal may be sampled at a rate at the Nyquist rate.


With reference to FIGS. 1 & 2, these figures show a pictorial representation of a smart case 102 and wireless earpieces 142, 144 in accordance with an illustrative embodiment. Throughout the invention disclosure reference will be sometimes made to only one of wireless earpieces 142, 144; however, it is to be understood any discussion of one wireless earpiece 142 can be applied to the other wireless earpiece 144 unless clearly pointed out in an embodiment of the present invention. The smart case 102 may be an open or enclosed case for securing, charging and managing the wireless earpieces 142, 144. The wireless earpieces 142, 144 may be referred to as a pair (wireless earpieces) or singularly (wireless earpiece). The description may also refer to components and functionality of each of the wireless earpieces 142, 144 collectively or individually. In one embodiment, the wireless earpieces 142, 144 include a set of left and right ear pieces configured to fit into a user's ears. The wireless earpieces 142, 144 may be configured to play music or audio, receive and make phone calls or other communications, determine ambient environmental readings (e.g., temperature, altitude, location, speed, heading, etc.), read user biometrics and actions (e.g., heart rate, motion, sleeping, etc.).


In another embodiment, the wireless earpieces 142, 144 may represent wireless devices, which may be ingested or implanted into a user. For example, the smart case 102 may be configured to work with endoscopic pills, pacemakers, tracking devices, contact lenses, oral implants, bone implants, artificial organs or so forth. The smart case 102 may act as a logging tool for receiving information, data, or measurements made by the wireless devices. For example, the smart case 102 may be attached to a belt (e.g., belt clip, strap, etc.) or worn by the user to download data from the wireless device(s) in real-time. As a result, the smart case 102 may be utilized to store, charge, and synchronize data for the wireless earpieces 142, 144 in any number of embodiments.


The smart case 102 encloses a battery, and various other circuitry. The battery of the smart case 102 may be utilized to charge the wireless earpieces 142, 144 through direct contact or wirelessly. As a result, the smart case 102 may act as a custom charger for ensuring the proper power management and functionality of the wireless earpieces 142, 144. For example, the battery of the smart case 102 may be utilized to charge the wireless earpieces 142, 144 any number of times before the smart case 102 and corresponding battery may require charging. In one embodiment, the smart case 102 may include one or more solar panels, or surfaces configured to charge the smart case 102 utilizing ambient or direct sunlight. The smart case 102 ensures the duty cycle of the wireless earpieces 142, 144 are maximized by properly maintaining power levels. For example, the smart case 102 may keep the wireless earpieces 142, 144 fully charged during a time period of inactivity, such as before being purchased (e.g., on a shelf or as part of inventory) or one purchased.


In one embodiment, the smart case 102 include a housing 103. The housing 103 is a support structure for the components of the smart case 102 and may be formed of a rigid plastic, polymer, or other similar material. However, any number of other suitable materials, such as composites, rubber, wood, metal, or so forth, may be utilized. The housing 103 defines receptacles 104, 106 are configured to receive the wireless earpieces 142, 144, respectively. In one embodiment, the receptacles 104, 106 are shaped to fit the external size, shape, and configuration of the wireless earpieces 142, 144.


As a result, an interface fit may secure the wireless earpieces 142, 144 within the housing 103 while the smart case 102 is being moved or otherwise utilized. In one embodiment, the smart case 102 may include a hinged, magnetic, sleeve, or snap on lid or cover may cover the wireless earpieces 142, 144 when positioned within the receptacles 104, 106 of the smart case 102. For example, the cover may make the smart case 102 waterproof and further secure the wireless earpieces 142, 144. In another embodiment, the smart case 102 may also include a removable cover (e.g., neoprene, zip up, snapping, etc.). In yet another embodiment, the cover encases a screen, such as a touch screen. The screen may roll, bend or adapt to the shape and configuration of the smart case 102. The touch screen may also be transparent. In one embodiment, the smart case 102 may be hermetically sealed and waterproof when the cover is secured. The smart case 102 may also include one or more speakers for playing music, indicating a status of the wireless earpieces 142, 144 or otherwise communicating information to the user. Likewise, actuators may be utilized to provide tactile feedback to the user. The case may have at least one button or other manual input. The button may be touch sensitive, lighted, or mechanical. There also may be a light such as a LED in location.


The smart case includes interfaces 108, 110 within the receptacles 104, 106. The interfaces 108, 110 are hardware interfaces for electrically connecting the wireless earpieces 142, 144 to the smart case 102. The interfaces 108, 110 may include any number of contact points, busses, wires, or other physical connectors for interfacing the wireless earpieces 142, 144, with the smart case 102. The interfaces 108, 110 may alternatively include inductive chargers for charging the wireless earpieces 142, 144. In another embodiment, the interfaces 108, 110 may represent male or alternatively female) connectors for interfacing with the wireless earpieces 142, 144, such as micro-USB, or other developing miniature external connectors. The interfaces 108, 110 may be utilized to charge the wireless earpieces 142, 144. The interfaces 108, 110 may also be utilized to synchronize data between the wireless earpieces 142, 144. As previously noted, wireless charging is also contemplated utilizing an inductive charger integrated in the smart case 102 or other charging devices compatible with the wireless earpieces 142, 144.


In another embodiment, the wireless earpieces 142, 144 and the smart case 102 may interact to control a device reset function. For example, the wireless earpieces 142, 144 may synchronize captured data with the smart case 102 before moving to a low power mode in anticipation of being charged. A switch may be activated mechanically, magnetically, inductively, electrically, or wirelessly in anticipation of being charged. For example, the smart case 102 may lower the power mode of the wireless earpieces 142, 144 in response to contacts of the wireless earpieces 142, 144 coming in contact with the interfaces 108, 110. For example, the smart case 102 may detect a change in resistance when the wireless earpieces 142, 144 are electrically connected to the interfaces 108, 110 to perform the processes herein described. In another embodiment, each of the interfaces 108, 110 may include a switch activated when one of the wireless earpieces 142, 144 is positioned within the receptacles. The interfaces 108, 110 may also include a pin when depressed or contacted by one of the wireless earpieces 142, 144 turns off the wireless earpieces 142, 144. Control of the wireless earpieces 142, 144 may be controlled by the smart case 102, the wireless earpieces 142, 144 themselves, or may be shared between devices.


In one embodiment, the interfaces, 108, 110 or another portion of the smart case 102 as well as the wireless earpieces 142, 144 may include a near field communication (NFC) chip for communications. For example, NFCs may determine the wireless earpieces 142, 144 are proximate the smart case 102 for performing power management. NFC may also be utilized to identify the wireless earpieces 142, 144 associated with a particular smart case 102. In other embodiments, different communications protocols (e.g., Bluetooth, Wi-Fi, etc.), standards, or passive readers radio frequency identification tags, etc.) may be utilized for the wireless earpieces 142, 144 to communicate with the smart case 102. For example, the smart case 102 may power off the wireless earpieces 142, 144 in response to being placed in or near the smart case 102. The smart case 102 may be programmed with a threshold distance (e.g., 10 cm, 1 foot, etc.) to determine when the wireless earpieces 142, 144 are proximate the smart case 102 or may rely on the inherent maximum communications distances of the wireless standard or protocol being utilized (e.g., NFC, RFID, etc.).


With reference to FIG. 2, a pair of earpieces 150 which includes a left earpiece 142 and a right earpiece 144. The wireless earpieces 142, 144 have a housing 152. The left earpiece 142 and the right earpiece 144 may be configured to substantially encompass an outer opening of a user's ear canal (see FIG. 3) and/or fit within the user's ear canal in order to maximize the amount of space available to place an EEG electrode 180. The housing 152 may be composed of metallic material, plastic material, or any material with substantial resistance to shear and tensile forces and may also be configured to be soundproof or waterproof. EEG electrodes 180 may be located anywhere on housing 152 conducive to obtaining a EEG signal from an ear surface and more EEG electrodes than the three shown on each earpiece may be found on housing 152. A microphone 160 is shown and may be located anywhere on the wireless earpieces 142, 144 and each microphone 160 may be configured to receive one or more voice commands. Speaker 170 may be configured to communicate audio sound 190. The audio sound 190 may be communicated to the user or a third party and speaker 170 may also be configured too short out if the sound intensity of the audio sound 190 is too high or otherwise surpasses a given threshold, which may be preprogrammed into a processor 414 (FIG. 4), a memory device 540 (FIG. 5), or set by the user or a third party.



FIG. 3 illustrates a side view of the earpiece 144 and its relationship to a user's ear. The earpiece 144 may be configured to minimize the amount of external sound reaching the user's ear canal 356 and/or to facilitate the transmission of the audio sound 190 from the speaker 170 to a user's tympanic membrane 358. The earpiece 144 may also have a plurality of EEG electrodes 180 positioned throughout the outside of the earpiece 144. The EEG electrodes 180 may be of any size or shape capable of receiving an EEG signal and may be positioned anywhere along the housing 152 conducive to receiving an EEG signal. A gesture control interface 328 is shown on the exterior of the earpiece 144. The gesture control interface 328 may provide for gesture control by the user or a third party such as by tapping or swiping across the gesture control interface 328, tapping or swiping across another portion of the earpiece 144, providing a gesture not involving the touching of the gesture control interface 328 or another part of the earpiece 144, or through the use of an instrument configured to interact with the gesture control interface 328. A MEMS gyroscope 332, an electronic magnetometer 334, an electronic accelerometer 336 and a bone conduction microphone 338 are also shown on the exterior of the housing 152. The MEMS gyroscope 332 may be configured to sense rotational movement of the user's head and communicate the data to a processor, wherein the data may be used in removing any artifacts found in an EEG signal. The electronic magnetometer 334 may be configured to sense a direction the user is facing and communicate the data to the processor, which, like the MEMS gyroscope 332, may be used in removing artifacts from one or more EEG signals. The electronic accelerometer 336 may be configured to sense the force of the user's head when receiving EEG signals, which may be used by the processor in removing sound artifacts related to head movement. The bone conduction microphone 338 may be configured to receive body sounds from the user, which may be used by the processor or the differential amplifier 520 (FIG. 5) in filtering out unwanted sounds or noise from an EEG signal. The speaker 170 is also shown and may communicate the audio sound 190 in any manner conducive to facilitating the audio sound 190 to the user's tympanic membrane 358.



FIG. 4 shows a wireless earpiece 144 having an housing 152, a processor 414 disposed within the housing 152, at least one sensor 416 operatively connected to the earpiece housing 152 and the processor 414, and a plurality of EEG electrodes 418 operatively connected to the housing 152 and the processor 414, wherein at least one EEG electrode 418 is positioned to contact an outer surface of an ear canal and at least one EEG electrode 418 is positioned to contact an inner surface of an ear canal 356. The housing 152 may be made of any material suitable to hold each component of the earpiece 142, 144 together, which may include metallic, plastic, one or more polymers, or a combination thereof, and the housing 152 may be able to withstand a drop of more than three meters without breaking or having a component become loose or broken. The processor 414 may be positioned at any location within the housing 152 which is conducive to receiving or processing EEG signals and sensor readings and may have one or more additional electrical components operatively connected to processor 414 at any given time. One or more sensors 416 are operatively connected to the housing 152 and the processor 414 and positioned to sense user data from the user. One or more sensors 416 may comprise a MEMS gyroscope 332, an electric accelerometer 336, a bone conduction microphone 338, or any type of sensor conducive to helping the processor 414 read an EEG signal. As discussed briefly, the processor 414 can use the data from the sensors 416 in several ways. The processor 414 can receive data from the sensors 416, which would cause processor 414 to reject any input from certain electrodes 418 (i.e., certain movement or noise). The processor can also use the data from the sensors 416 to perform filtering of the electrode signal to eliminate any distortion or noise on the electrode signal, thus providing a better electrode signal. This decision process could be programmed into the processor based upon set limits or tolerances based on signals coming from each of the sensors or for the totality of the sensors.


For example, a MEMS gyroscope 332 may produce one or more currents due to one or more vibrating masses in response to a user head movement (which causes noise to appear on a EEG signal) in two or three axes via the Coriolis effect, which may be communicated to the processor 414 for determination of a head position. An electronic accelerometer 336 may produce a voltage in response to a user head movement (which causes noise to appear on a EEG signal) which causes a capacitance differential between two charged microstructures due to the user's head movement, which may be communicated to the processor 414 for determination of a head acceleration. Or a bone conduction microphone 338 may measure sounds from the body and communicate them to the processor 414, which may be used to improve the signal quality of one or more EEG signals.


A plurality of EEG electrodes 418 are operatively connected to the housing 152 and the processor 414, wherein at least one EEG electrode 418 is positioned to contact an outer surface of an ear surface and at least one EEG electrode 418 is positioned to contact an ear canal surface. The EEG electrodes 418 may have an outer surface composed of silver chloride to reduce the impedance between the electrode and the skin, and a conductive gel may be applied to the EEG electrodes 418 if necessary. An EEG electrode 418 positioned on either the outer or inner surface of the ear may act as a reference point to measure one or more EEG signals, and in some preferred embodiments a voltage of a single EEG signal is measured at two different electrodes relative to a reference electrode in order to improve signal quality by allowing a differential amplifier to remove any common mode gain present in both signals. An electronic filter may also be present to filter out any noise, usually in the 50-60 Hertz range, caused by consumer electrical appliances or gadgets or poor connections between the EEG electrodes 418 and one or more ear surfaces.



FIG. 5 is a block diagram of a system of an earpiece 144 comprising an housing 152, a processor 414 operatively connected to the housing 152, one or more sensors 416, which may comprise a MEMS gyroscope 332, an electronic magnetometer 334, an electric accelerometer 336 or a bone conduction microphone 338, operatively connected to the housing 152 and the processor 414, a plurality of EEG electrodes 418 operatively connected to the housing 152, a differential amplifier 520 operatively connected to the housing 152 and each EEG electrode 418, an analog-to-digital converter 522 operatively connected to the housing 152, processor 414, and differential amplifier 520, a wireless transceiver 524 operatively connected to the housing 152 and the processor 414, a microphone 160 operatively connected to the housing 152 and the processor 414, a gesture control interface 328 having an emitter 546 and a detector 548 operatively connected to the housing 152 and the processor 414, a speaker 170 operatively connected to the housing 152 and the processor 414, a memory device 540 operatively connected to the housing 152 and the processor 414, a short range transceiver 542 operatively connected to the housing 152 and the processor 414, and LEDs 544 operatively connected to the housing 152 and the processor 414.


The processor 414 is disposed within the housing 152 and operatively connected to one or more sensors 416, each EEG electrode 418, the analog-to-digital converter 522, the wireless transceiver 524, the gesture control interface 328, the speaker 160, the memory device 540, the transceiver 542, LEDs 544, and an energy source 545. The processor 414 may transmit a measurement signal of a known current to each EEG electrode in order to ascertain an impedance associated with each EEG electrode 418 via a voltage drop across each EEG electrode 418. The processor 414 may perform this continuously or intermittently at a synchronous or asynchronous rate, keeping in mind the measurement signal may interfere with any EEG signal measurements by an EEG electrode 418. Thus these measurement signals will need to be properly timed so as to not add to the problem the present invention aims to solve, namely bad or corrupted EEG data from electrodes 418. The processor 414 may receive digital signals from an EEG electrode 418, which have been sampled by an analog-to-digital converter 522 and amplified and filtered by the differential amplifier 520, in which the digital signals may be used to control the earpiece 144. For example, the EEG electrode 418 may measure changes in a user's mu waves (mu waves, also known as mu rhythms, comb or wicket rhythms, arciform rhythms, or sensorimotor rhythms, are synchronized patterns of electrical activity involving large numbers of neurons, and are most prominent when the body is physically at rest) during the performance of a certain action, such as tapping the tips of their right index finger and thumb together, which may be communicated to the processor 414 and used to turn the earpiece 144 on or off. The processor 414 may process the waves using, for example, a Fourier transform to decompose the EEG signal into its frequency components from an algorithm stored on the memory device 540 or within the processor 414 itself in order to obtain a usable signal. In addition, the processor 414 may receive one or more signals from a wireless transceiver 524, a gestural control interface 328, a memory device 540, LEDS 544, or a short range transceiver 542, which may be used to communicate information from the processor 414 or communicate information to the processor 414 to be used to control, change or otherwise modify one or more functions of the earpiece 144, such as modality.


One or more sensors 416 may be operatively connected to the housing 152, the processor 414, and the analog-to-digital converter 522 and may sense one or more pieces of user data from the user or a third party. The sensors 416 may sense motion data, biological data, or environmental data which may be used to assist the earpiece 144 in determining whether data from an EEG electrode 418 should be used or is usable. For example, a MEMS gyroscope 332 installed within the earpiece 144 may produce one or more currents in response to one or more head movements from the user. This gyroscope current or signal could be used by the processor 414 to determine a head position, which may be used in conjunction with the EEG signal to ascertain a user gesture to control one or more functions of the earpiece 10. For example, gyroscope may send a signal indicative of a head nod, which is confirmed by the EEG signal and thus a phone call coming in on earpiece 144 could be answered based upon the head nod. Further, an electronic magnetometer 34 installed within the earpiece 10 may be used to measure the direction the user is facing through one or more voltages proportional to the strength and polarity of the Earth's magnetic field which may be used by the processor 414 in ascertaining a head movement relative to a fixed direction or to refine one or more measurements from other sensors 316. An electronic accelerometer 336 may produce a voltage in response to a user head movement may be used by the processor 414 to determine one or more accelerations related to the user and/or refine one or more EEG signals. And/or a bone conduction microphone 338 may measure sounds from the body and communicate them to the processor 414, which may be used to improve the signal quality of one or more EEG signals. However, the measurements taken by one or more of the aforementioned sensors 316 need not be related to the measurement of an EEG signal at all and can be used independently of the EEG signals as well.


One or more EEG electrodes 418 may be operatively connected to the housing 152, the processor 414 and the differential amplifier 20 and may be positioned anywhere on the surface of the earpiece 144 conducive for sensing an EEG signal from an ear surface. In at least one embodiment, at least one EEG electrode 418 should be positioned to receive an EEG signal from an outer ear surface and at least one EEG electrode 418 should be positioned to receive an EEG signal from an inner ear surface. One or more EEG electrodes 418 positioned on the outer ear surface may be used as a reference electrode in ascertaining an EEG signal, as more than one reading of an EEG signal should be obtained as the signal-to-noise ratio of an EEG signal is typically quite low. The EEG electrodes 418 will receive a current from the processor 414 in order to ascertain the impedances from a voltage drop associated with each EEG electrode 418 in order to determine which EEG electrodes 418 are good candidates to read an EEG signal from. EEG electrodes 418 having lower impedances obtain better quality signals than EEG electrodes 418 having higher impedances. EEG electrodes 418 having a sufficiently low impedance will receive an activation signal from the processor 414 to receive one or more EEG signals from the user. More than one EEG electrode 418 may receive the activation signal from the processor 414, and the activated EEG electrodes 418 may receive more than one EEG signal and may receive one or more EEG signals continuously or discretely. If the impedance of one of the activated EEG electrodes 418 becomes too high after receiving another activation signal from the processor 414 then processor 414 will stop using this electrode 418 for any further processing until the impedance drops below the predetermined acceptable level.


A differential amplifier 520 may be operatively connected to the housing 152, the processor 414, and each EEG electrode 418 and may be configured to improve the signal quality of each EEG signal received from the EEG electrodes 418. The differential amplifier 520 may remove any common mode noise present in the EEG signals received from the EEG electrodes and may also filter out noise received from outside electrical sources such as consumer electronic devices or appliances. For example, the differential amplifier 520 may remove common mode noise by subtracting the sum of all voltages received by the amplifier divided by the number of signals from each signal and subsequently amplifying the difference. The amplification may be anywhere from ten times to over ten thousand times, but too high an amplification may risk damaging one or more components of the earpiece 144. The differential amplifier 520 may remove other noise, such as noise received from consumer electronics in the 50-60 Hertz range and artifacts due to sweating or other user movement through one or more filters within the differential amplifier 520 itself. The filters may be passive high-pass filters, passive low-pass filters, quartz filters, or any other type of filter conducive to removing noise with frequencies.


An analog-to-digital converter 522 may be operatively connected to the housing 152, the processor 14, and the differential amplifier 520 and may receive EEG signals amplified and/or filtered by the differential amplifier 520, signals amplified and filtered from other components of the earpiece or signals directly from other parts of the earpiece 144. The analog-to-digital converter 522 may be an 8-bit, 12-bit, or higher bit converter, and may sample each signal it receives at a rate twice as high or more than the frequency of the signal in order to preserve the informational quality of the signal. The sampling frequency may be preset or inferred from the received signal. For example, the analog-to-digital converter 522 may receive an EEG signal with a higher than normal frequency due to amplification which may be higher than one-half the sampling rate, in which case the analog-to-digital converter 522 may readjust the sampling frequency upward in order to maintain the informational quality of the signal.


A wireless transceiver 524 may be operatively connected to the housing 152 and the processor 414 and may be configured to receive one or more signals from and transmit one or more signals to one or more external electronic devices. Any signals received by the wireless transceiver 524 may be transmitted to the processor 414 for further processing. The external electronic devices the wireless transceiver 524 may be configured to receive signals from include Bluetooth devices, mobile devices, desktops, laptops, tablets, modems, routers, communications towers, cameras, watches, third-party earpieces, earpieces, or other electronic devices capable of transmitting or receiving wireless signals. The signals received or communicated by the wireless transceiver 524 may encode for sound, instructions, or information which may be used in conjunction with the operation of the EEG electrodes 418. For example, a researcher performing tests on brain function may wish to have the EEG signals transmitted to a laptop or desktop computer for further study, or a user of the earpiece 144 may wish to download one or more applications related to using brain waves to control the earpiece 144. The wireless transceiver 524 may receive or transmit more than one signal simultaneously.


One or more microphones 160 may be operatively connected to the housing 152 and the processor 414 and may be configured to receive one or more voice commands which may be used to control one or more aspects of how the earpiece 144 handles one or more EEG signals. For example, the user may issue a voice command to cease receiving EEG signals, such as, “Stop receiving EEG signals” or something similar which is understood by the earpiece 144. In addition, the user may issue a voice command setting a sampling rate of the analog-to-digital converter 522 or how much a signal should be amplified to the differential amplifier 520. Other voice commands related to earpiece 144 functions but unrelated to EEG signal processing may be issued as well.


A gesture control interface 328 having at least one emitter 546 and a detector 548 may be operatively connected to the housing 152 and the processor 414 and may be configured to allow the user or a third party to control one or more functions of the earpiece 144. For example, a menu may be prompted through the use of a gesture with the gestural control interface 328, which may allow the user or a third party to set the sampling rate of the analog-to-digital converter 522, adjust the amplification ratio of any signals received by the differential amplifier 520, turn the earpiece on or off, or other functions unrelated to EEG signals such as listen to a song, playlist, newscast, podcast, or a weather report received through the wireless transceiver 524 or stored on the memory device 540, obtain information on the user's current surroundings, or anything else may be of interest to the user or a third party, and the aforementioned list is non-exclusive. The selections may be chosen through the use of one or more additional gestures or through the use of one or more voice commands from the user and/or a third party. The types of gestures may be used with the gesture control interface 328 to control the earpiece 144 include, without limitation, touching, tapping, swiping, use of an instrument, or any combination of the aforementioned gestures. Touching gestures used to control the earpiece 144 may be of any duration and may include the touching of areas not part of the gesture control interface 328. Tapping gestures used to control the earpiece 144 may include one or more taps and need not be brief. Swiping gestures used to control the earpiece 144 may include a single swipe, a swipe changes direction at least once, a swipe with a time delay, a plurality of swipes, or any combination of the aforementioned. An instrument used to control the earpiece 144 may be electronic, biochemical or mechanical, and may interface with the gesture control interface 328 either physically or electromagnetically.


A speaker 170 may be operatively connected the housing 152 and the processor 414 and may be configured to produce audio output derived from one or more signals from the wireless transceiver 524, the memory device 540, or the short range transceiver 542. The audio output conveyed by the speaker 170 may concern EEG functions or may relate to media or information the user desires to hear. Also, the speaker 170 may short out if the audio output exceeds a certain decibel level, which may be preset or programmed by the user or a third party.


A memory device 540 may be operatively connected to the housing 152 and the processor 414 and may be configured to store data, files, programs, or other information. The memory device 540 may store programs related to creating a measurement signal to measure an EEG electrode impedance, processing an EEG signal, amplifying an EEG signal, filtering an EEG signal, sampling an EEG signal, modifying an EEG signal, or programs unrelated to the reception and processing of an EEG signal. The memory device 540 may also contain programs related to storing information encoded in signals received by the wireless transceiver 524, transmitting files and/or communicating information via either the wireless transceiver 524 or the speaker 170 or instructions related to the operation of the earpiece 144. Information encoded in signals received by the wireless transceiver 524 may relate to algorithms for processing, amplifying, or filtering EEG signals or topics unrelated to EEG signal processing such as music, sounds, instrumentals, words, soundtracks, newscasts, podcasts, entertainment shows, commentary, advertisements, instructions, information, or anything else media or information related may be communicated by the speaker 170. Preloaded files may consist of programs required by the earpiece 144 to operate basic functions or troubleshoot one or more components of the earpiece 144 or another program.


A short range transceiver 542 may be disposed within the housing 152 and may be configured to receive signals from and to transmit signals to another transceiver disposed within another electronic device or even another earpiece. The short range transceiver 542 may receive or transmit more than one signal simultaneously. The short range transceiver 542 may be of any number of types including a near field magnetic induction (NFMI) transceiver as discussed in detail above.


One or more LEDs 544 may be operatively connected to the housing 152 and the processor 414 and may be configured to emit light in order to convey information to a user concerning the earpiece 144. The LEDs 544 may be located at any position on the earpiece 144 suitable for viewing by the user or a third party and may consist of as few as one diode which may be provided in combination with a light guide. In addition, the LEDs 544 may be discernable by a human eye or an electronic device and need not have a minimum luminescence.


An energy source 545 may be operatively connected to all of the components within the earpiece 144 and may be configured to store and release charge. The charge may come preinstalled with the earpiece 144, as may be the case with a battery, or the charge may derive from one or more signals from a wearable device, an external electronic device, such as smart case 102, or a combination of the aforementioned, as may be the case with a capacitor receiving one or more signals from a transceiver. The charge stored within the energy source 545 may be used to power one or more components of the earpiece 10. In addition, alternative battery-less power sources, such as thermal harvesting elements which create energy from a voltage generated by temperature differentials between a user's skin and the ambient environment (all of which are operatively connected to one or more earpiece 144), may be used to power the earpiece 144 as well.



FIG. 5 illustrates a flowchart of one embodiment of receiving an EEG signal from an ear surface using an earpiece 144. First, in step 602, a processor transmits a current to each EEG electrode 148. The current is a known quantity so an impedance may be calculated from the voltage drop across each EEG electrode 148.


In step 604, one or more sensors 416 receives at least one sensor reading. The sensor readings may be related to environmental data affecting EEG electrode readings or may be related to motion data picked up by a MEMS gyroscope 332, an electronic magnetometer 334, an electronic accelerometer 336 or a bone conduction microphone 338.


In step 606, the voltage drop associated with each EEG electrode 148 is communicated to the processor 414. The signal may be converted into a digital form by the analog-to-digital converter 522 before being sent to the processor 414.


In step 608, the sensor readings from at least one sensor 416 are communicated to the processor 414. The sensor readings may originate from an environmental sensor or a motion sensor such as a MEMS gyroscope 332, an electronic magnetometer 334 or an electronic accelerometer 336 and the sensor readings may be used by the processor 414 or differential amplifier 520 in removing artifacts present in one or more EEG signals.


In step 610, the processor determines an impedance associated with the voltage drop across each EEG electrode 418. The processor 414 may use an algorithm programmed within the processor or a memory device 540 operatively connected to the processor 414 to determine the impedances, and the processor 414 may perform the determination continuously or discretely as the situation arises.


In step 612, the processor 414 determines which impedances are below a programmed threshold. Lower impedances allow EEG electrodes to obtain EEG signals with better signal-to-noise ratios. The programmed threshold may be preprogrammed into the processor 414 or programmed by the user or a third party. The programming may be performed by the user or a third party using an external electronic device to transmit the instructions to the earpiece 144, through voice commands or gestures read by the earpiece, or the processor 414 may modify the threshold in response to one or more stimuli such as a sensor reading following instructions in an algorithm stored within the processor 414 or an external memory device operatively connected to the processor 414.


In step 614, the processor 414 creates an activation signal derived from the sensor readings and the impedances for each sensor 416, wherein the activation signal is only sent to EEG electrodes 418 which have an impedance below the programmed threshold. The processor 414 may use the sensor readings to modify which EEG signals receive the activation signal in order to reduce the level of noise in the received EEG signals and the processor 414 may create other signals as well which may or may not be related to the reception of an EEG signal.


In step 616, the processor 414 communicates the activation signal to each EEG electrode 418 which had an impedance below the programmed threshold. A few electrodes 418 may receive the activation signal even if none of the EEG electrodes have impedances below the programmed threshold. In this embodiment, the processor 414 communicates the activation signal to the two electrodes which have the smallest impedances.


In step 618, the activation signal activates the EEG electrodes 418 having impedances below the programmed threshold. Again, the activation signal may be sent to two or more EEG electrodes 418 if none of the electrodes 418 fall below the programmed threshold in order to obtain at least one EEG signal.


In step 620, the activated EEG electrodes 148 receive an EEG signal. At least two electrodes 148 are needed in order for the differential amplifier 520 to remove common mode noise (which should have different voltages) between the two signals.


As a further embodiment, after the EEG electrodes 148 receive one or more EEG signals, the signals, in step 622, are communicated to a differential amplifier 520 for amplification. At least two signals are required in order for the differential amplifier 520 to remove common mode gain, and additional signals may be used. The differential amplifier 520 may amplify the signal from ten to over ten thousand times depending on the voltage of the EEG signal after common mode noise removal or other requirements of the earpiece 144. In addition, one or more filters may be used to remove noise related to consumer electronics or artifacts related to sweating, body secretions, or body movement affecting the EEG signal.


In step 624, the amplified EEG signal is communicated to an analog-to-digital converter 522 for sampling. The sample rate of the analog-to-digital converter 522 should be at least twice the frequency of the amplified signal frequency in order to maintain the information content of the amplified signal, and the analog-to-digital converter may sample at 8-bits, 12-bits, 16-bits, or higher if desired.


In step 626, the sampled, amplified EEG signal (modified EEG signal) is communicated to the processor 414. The processor 414 may process the modified EEG signal using one or more algorithms stored within the processor 414 or a memory device 540 operatively connected to the processor 414 in order to determine a command, which may relate to controlling one or more functions of the earpiece 144. For example, the processor 414 may use a Fourier transform on an EEG signal to determine a command from a change in mu wave brain patterns from the user, such as turning the earpiece 144 on or off, selecting the next or last choice present in a listing communicated by the earpiece 144, or another function. The Fourier transform may break the EEG signals down into their frequency components, which are less affected by noise than the time domain EEG signals, making it easier for the processor to ascertain a command from a brain pattern.


The inventor(s) would like to reemphasize no longer would it be needed to place large and bulky electrodes on a user as is currently performed. The present invention provides for a distributed network of small electrodes 148 (FIG. 3) where the sum of the EEG signals could be summed to for a “virtual” large electrode. This distributed network of electrodes 148 overcomes the need for a trained expert to place the electrodes properly. An algorithm within processor 414 is capable of determining which combinations of electrodes 418 to use based upon the electrical impedance of each electrode 148 (discussed in great detail above). Further, the EEG signals from earpieces 142 and 144 can be compared, contrasted, summated or subtracted to form data input segments from both earpieces 142 and 144.


With reference to FIGS. 3 and 7, an example and discussion of how to create a “virtual” large EEG electrode will be discussed. In FIG. 3 earpiece 144 is shown with 26 small EEG electrodes 148. In process 700, at step 702 a measurement voltage signal is sent to each EEG electrode 1 through 26. Processor 414 then calculates the voltage drop associate with each EEG electrode 148 at step 704. For purposes of this embodiment, we will say out of electrodes 1-26 only electrodes 1-9, 15-17 and 24-26 had an impedance below an accepted tolerance predetermined level (i.e., Z<predetermined threshold). Therefore, electrodes 14810-14, 18-23 will be ignored and no signal will be requested from these electrodes 148. At step 706, processor 414 receives input from the sensors 416. Next, at step 708, processor 414 makes a determination as to what electrodes can still be used to collect data based upon potential signal noise caused by the environment or the user's movement. For purposes of the current example, we can propose the following:


Electrodes 1-9 were in an X-plane orientation


Electrodes 15-17 were in a Y-plane orientation; and


Electrodes 24-26 were in a Z-plane orientation.


This information, of course, could be provided by the magnetometer 334 (FIG. 5) discussed in great detail above. If processor 414 also has an input from accelerometer 336 which states at time T, there was motion in the X-plane, then processor 414 would then eliminate electrodes 1-9 from consideration for a representative EEG signal as the possibility for a noisy or bad signal would be too great (step 710). Other examples could include no pulsatile component from a heart rate sensor and no unusual magnetic field which may disqualify a EEG electrode as being sampled. Thus, at step 712, processor 414 would request a signal from electrodes 15-17 and 24-26. The EEG signals from electrodes 15-17 and 24-26 could then be pulled together by an algorithm on processor 414 to provide a compound EEG signal.


The invention is not to be limited to the particular embodiments described herein. In particular, the invention contemplates numerous variations in earpieces with in-ear electrodes. The foregoing description has been presented for purposes of illustration and description. It is not intended to be an exhaustive list or limit any of the invention to the precise forms disclosed. It is contemplated other alternatives or exemplary aspects are considered included in the invention. The description is merely examples of embodiments, processes or methods of the invention. It is understood any other modifications, substitutions, and/or additions can be made, which are within the intended spirit and scope of the invention.

Claims
  • 1. A wireless earpiece for monitoring EEG data comprising: a housing;a processor disposed within the housing;a transceiver disposed within the housing and operatively connected to the processor;at least one sensor operatively connected to the processor; anda plurality of EEG electrodes operatively connected to the processor and positioned on the housing for receiving EEG signals from an ear surface;wherein the processor measures an impedance of each of the plurality of EEG electrodes;wherein the processor receives an EEG signal from each of the plurality of EEG electrodes;wherein the processor processes the EEG signal from each of the plurality of EEG electrodes and creates a combined EEG signal;wherein the combined EEG signal is shared with a second wireless earpiece via the transceiver.
  • 2. The wireless earpiece for monitoring EEG data of claim 1, wherein a first EEG electrode of the plurality of electrodes is configured to be positioned to contact an outer surface of an ear and a second EEG electrode of the plurality of electrodes is configured to be positioned to contact an inner surface of an ear canal.
  • 3. The wireless earpiece for monitoring EEG data of claim 1, wherein the processor will not accept any inputs from the plurality of EEG electrodes if their impedance is above a predetermined amount.
  • 4. The wireless earpiece for monitoring EEG data of claim 3, wherein the processor accepts an input from the at least one sensor and refuses input from any of the plurality of EEG electrodes if the EEG data is compromised by noise detected by the at least one sensor.
  • 5. The wireless earpiece for monitoring EEG data of claim 4, wherein the processor accepts inputs from the plurality of EEG electrodes, which have not been rejected due to impedance or sensor data and processes the EEG electrode inputs to create a reliable EEG signal.
  • 6. A method of receiving an EEG signal from an ear surface comprising the steps of: transmitting a current to a plurality of EEG electrodes;receiving at least one sensor reading from a sensor operatively connected to a processor of an earpiece;communicating, a voltage drop associated with of the plurality of EEG electrodes to the processor;determining an impedance of each of the plurality of EEG electrodes;determining which of the impedances are below a programmed threshold for each of the plurality of EEG electrodes;transmitting an activation signal to the plurality of EEG electrodes which have an impedance below the programmed threshold;receiving an EEG signal from each of the plurality of EEG electrodes which have an impedance below the programmed threshold;processing the EEG signal from each of the plurality of EEG electrodes and creating a combined EEG signal by the processor;transmitting the combined EEG signal by a transmitter of the earpiece to a second earpiece.
  • 7. The method of claim 6, further comprising the step of determining which of the plurality of electrodes do not have a reliable EEG signal based upon the at least one sensor reading.
  • 8. The method of claim 7, wherein the processor is housed within a wireless earpiece.
  • 9. The method of claim 7, further comprising the step of providing a reliable EEG signal based upon the EEG signal taken from the plurality of EEG electrodes which have an impedance below the programmed threshold and have the reliable EEG signal based upon the at least one sensor reading.
  • 10. A system comprising: a first earpiece having a housing;a processor disposed within the housing;at least one sensor disposed within the housing and operatively connected to the processor, wherein the at least one sensor is configured to sense user data and communicate the user data to the processor; anda plurality of EEG electrodes operatively connected to the processor and positioned on the housing for receiving EEG signals from an ear surface;wherein the processor transmits a current to each of the plurality of EEG electrodes to determine an impedance from each of the plurality of EEG electrodes and subsequently communicates an activation signal to selected EEG electrodes if the impedance associated with the EEG electrode is below a programmed threshold;wherein the processor communicates an activation signal to the selected EEG electrodes if the impedance associated with the EEG electrode is below a programmed threshold and the sensed user data does not indicate the electrode is unreliable;wherein the selected EEG electrodes provide an EEG signal to the processor;wherein the processor processes the EEG signal from the selected EEG electrodes and creates a combined EEG signal; andwherein the combined EEG signal is shared with a second earpiece via a transmitter within the first earpiece.
  • 11. The system of claim 10, wherein a modality of the first or the second earpiece is changed based upon the combined EEG signal.
  • 12. The system of claim 11, wherein the modality of the first and second earpiece is changed based upon the combined EEG signal and the sensed user data.
PRIORITY STATEMENT

This application claims priority to U.S. Provisional Patent Application No. 62/416,537 titled Earpiece with In-Ear Electrodes, filed Nov. 2, 2016, hereby incorporated by reference in its entirety.

US Referenced Citations (279)
Number Name Date Kind
2325590 Carlisle et al. Aug 1943 A
2430229 Kelsey Nov 1947 A
3047089 Zwislocki Jul 1962 A
D208784 Sanzone Oct 1967 S
3586794 Michaelis Jun 1971 A
3934100 Harada Jan 1976 A
3983336 Malek et al. Sep 1976 A
4069400 Johanson et al. Jan 1978 A
4150262 Ono Apr 1979 A
4334315 Ono et al. Jun 1982 A
D266271 Johanson et al. Sep 1982 S
4375016 Harada Feb 1983 A
4577639 Simon Mar 1986 A
4588867 Konomi May 1986 A
4617429 Bellafiore Oct 1986 A
4654883 Iwata Mar 1987 A
4682180 Gans Jul 1987 A
4791673 Schreiber Dec 1988 A
4852177 Ambrose Jul 1989 A
4865044 Wallace et al. Sep 1989 A
4984277 Bisgaard et al. Jan 1991 A
5008943 Arndt et al. Apr 1991 A
5185802 Stanton Feb 1993 A
5191602 Regen et al. Mar 1993 A
5201007 Ward et al. Apr 1993 A
5201008 Arndt et al. Apr 1993 A
D340286 Seo Oct 1993 S
5280524 Norris Jan 1994 A
5295193 Ono Mar 1994 A
5298692 Ikeda et al. Mar 1994 A
5343532 Shugart Aug 1994 A
5347584 Narisawa Sep 1994 A
5363444 Norris Nov 1994 A
D367113 Weeks Feb 1996 S
5497339 Bernard Mar 1996 A
5606621 Reiter et al. Feb 1997 A
5613222 Guenther Mar 1997 A
5654530 Sauer et al. Aug 1997 A
5692059 Kruger Nov 1997 A
5721783 Anderson Feb 1998 A
5748743 Weeks May 1998 A
5749072 Mazurkiewicz et al. May 1998 A
5771438 Palermo et al. Jun 1998 A
D397796 Yabe et al. Sep 1998 S
5802167 Hong Sep 1998 A
D410008 Almqvist May 1999 S
5929774 Charlton Jul 1999 A
5933506 Aoki et al. Aug 1999 A
5949896 Nageno et al. Sep 1999 A
5987146 Pluvinage et al. Nov 1999 A
6021207 Puthuff et al. Feb 2000 A
6054989 Robertson et al. Apr 2000 A
6081724 Wilson Jun 2000 A
6084526 Blotky et al. Jul 2000 A
6094492 Boesen Jul 2000 A
6111569 Brusky et al. Aug 2000 A
6112103 Puthuff Aug 2000 A
6157727 Rueda Dec 2000 A
6167039 Karlsson et al. Dec 2000 A
6181801 Puthuff et al. Jan 2001 B1
6208372 Barraclough Mar 2001 B1
6230029 Yegiazaryan et al. May 2001 B1
6275789 Moser et al. Aug 2001 B1
6339754 Flanagan et al. Jan 2002 B1
D455835 Anderson et al. Apr 2002 S
6408081 Boesen Jun 2002 B1
6424820 Burdick et al. Jul 2002 B1
D464039 Boesen Oct 2002 S
6470893 Boesen Oct 2002 B1
D468299 Boesen Jan 2003 S
D468300 Boesen Jan 2003 S
6542721 Boesen Apr 2003 B2
6560468 Boesen May 2003 B1
6654721 Handelman Nov 2003 B2
6664713 Boesen Dec 2003 B2
6690807 Meyer Feb 2004 B1
6694180 Boesen Feb 2004 B1
6718043 Boesen Apr 2004 B1
6738485 Boesen May 2004 B1
6748095 Goss Jun 2004 B1
6754358 Boesen et al. Jun 2004 B1
6784873 Boesen et al. Aug 2004 B1
6823195 Boesen Nov 2004 B1
6852084 Boesen Feb 2005 B1
6879698 Boesen Apr 2005 B2
6892082 Boesen May 2005 B2
6920229 Boesen Jul 2005 B2
6952483 Boesen et al. Oct 2005 B2
6987986 Boesen Jan 2006 B2
7010137 Leedom et al. Mar 2006 B1
7113611 Leedom et al. Sep 2006 B2
D532520 Kampmeier et al. Nov 2006 S
7136282 Rebeske Nov 2006 B1
7203331 Boesen Apr 2007 B2
7209569 Boesen Apr 2007 B2
7215790 Boesen et al. May 2007 B2
D549222 Huang Aug 2007 S
D554756 Sjursen et al. Nov 2007 S
7403629 Aceti et al. Jul 2008 B1
D579006 Kim et al. Oct 2008 S
7463902 Boesen Dec 2008 B2
7508411 Boesen Mar 2009 B2
D601134 Elabidi et al. Sep 2009 S
7825626 Kozisek Nov 2010 B2
7965855 Ham Jun 2011 B1
7979035 Griffin et al. Jul 2011 B2
7983628 Boesen Jul 2011 B2
D647491 Chen et al. Oct 2011 S
8095188 Shi Jan 2012 B2
8108143 Tester Jan 2012 B1
8140357 Boesen Mar 2012 B1
D666581 Perez Sep 2012 S
8300864 Müllenborn et al. Oct 2012 B2
8406448 Lin Mar 2013 B2
8436780 Schantz et al. May 2013 B2
D687021 Yuen Jul 2013 S
8719877 VonDoenhoff et al. May 2014 B2
8774434 Zhao et al. Jul 2014 B2
8831266 Huang Sep 2014 B1
8891800 Shaffer Nov 2014 B1
8994498 Agrafioti et al. Mar 2015 B2
D728107 Martin et al. Apr 2015 S
9013145 Castillo et al. Apr 2015 B2
9037125 Kadous May 2015 B1
D733103 Jeong et al. Jun 2015 S
9081944 Camacho et al. Jul 2015 B2
9510159 Cuddihy et al. Nov 2016 B1
D773439 Walker Dec 2016 S
D775158 Dong et al. Dec 2016 S
D777710 Palmborg et al. Jan 2017 S
9544689 Fisher et al. Jan 2017 B2
D788079 Son et al. May 2017 S
20010005197 Mishra et al. Jun 2001 A1
20010027121 Boesen Oct 2001 A1
20010043707 Leedom Nov 2001 A1
20010056350 Calderone et al. Dec 2001 A1
20020002413 Tokue Jan 2002 A1
20020007510 Mann Jan 2002 A1
20020010590 Lee Jan 2002 A1
20020030637 Mann Mar 2002 A1
20020046035 Kitahara et al. Apr 2002 A1
20020057810 Boesen May 2002 A1
20020076073 Taenzer et al. Jun 2002 A1
20020118852 Boesen Aug 2002 A1
20030002705 Boesen Jan 2003 A1
20030065504 Kraemer et al. Apr 2003 A1
20030100331 Dress et al. May 2003 A1
20030104806 Ruef et al. Jun 2003 A1
20030115068 Boesen Jun 2003 A1
20030125096 Boesen Jul 2003 A1
20030218064 Conner et al. Nov 2003 A1
20040070564 Dawson et al. Apr 2004 A1
20040160511 Boesen Aug 2004 A1
20050017842 Dematteo Jan 2005 A1
20050043056 Boesen Feb 2005 A1
20050094839 Gwee May 2005 A1
20050125320 Boesen Jun 2005 A1
20050148883 Boesen Jul 2005 A1
20050165663 Razumov Jul 2005 A1
20050196009 Boesen Sep 2005 A1
20050251455 Boesen Nov 2005 A1
20050266876 Boesen Dec 2005 A1
20060029246 Boesen Feb 2006 A1
20060073787 Lair et al. Apr 2006 A1
20060074671 Farmaner et al. Apr 2006 A1
20060074808 Boesen Apr 2006 A1
20060166715 Engelen et al. Jul 2006 A1
20060166716 Seshadri et al. Jul 2006 A1
20060220915 Bauer Oct 2006 A1
20060258412 Liu Nov 2006 A1
20070135727 Virtanen Jun 2007 A1
20080076972 Dorogusker et al. Mar 2008 A1
20080090622 Kim et al. Apr 2008 A1
20080146890 LeBoeuf et al. Jun 2008 A1
20080187163 Goldstein et al. Aug 2008 A1
20080253583 Goldstein et al. Oct 2008 A1
20080254780 Kuhl et al. Oct 2008 A1
20080255430 Alexandersson et al. Oct 2008 A1
20090003620 McKillop et al. Jan 2009 A1
20090008275 Ferrari et al. Jan 2009 A1
20090017881 Madrigal Jan 2009 A1
20090073070 Rofougaran Mar 2009 A1
20090097689 Prest et al. Apr 2009 A1
20090105548 Bart Apr 2009 A1
20090154739 Zellner Jun 2009 A1
20090191920 Regen et al. Jul 2009 A1
20090245559 Boltyenkov et al. Oct 2009 A1
20090261114 McGuire et al. Oct 2009 A1
20090296968 Wu et al. Dec 2009 A1
20100033313 Keady et al. Feb 2010 A1
20100203831 Muth Aug 2010 A1
20100210212 Sato Aug 2010 A1
20100217100 LeBoeuf et al. Aug 2010 A1
20100320961 Castillo et al. Dec 2010 A1
20110140844 McGuire et al. Jun 2011 A1
20110239497 McGuire et al. Oct 2011 A1
20110286615 Olodort et al. Nov 2011 A1
20120057740 Rosal Mar 2012 A1
20130316642 Newham Nov 2013 A1
20130346168 Zhou et al. Dec 2013 A1
20140079257 Ruwe et al. Mar 2014 A1
20140106677 Altman Apr 2014 A1
20140122116 Smythe May 2014 A1
20140153768 Hagen et al. Jun 2014 A1
20140163771 Demeniuk Jun 2014 A1
20140185828 Helbling Jul 2014 A1
20140219467 Kurtz Aug 2014 A1
20140222462 Shakil et al. Aug 2014 A1
20140235169 Parkinson et al. Aug 2014 A1
20140270227 Swanson Sep 2014 A1
20140270271 Dehe et al. Sep 2014 A1
20140335908 Krisch et al. Nov 2014 A1
20140348367 Vavrus et al. Nov 2014 A1
20150028996 Agrafioti et al. Jan 2015 A1
20150035643 Kursun Feb 2015 A1
20150036835 Chen Feb 2015 A1
20150110587 Hori Apr 2015 A1
20150148989 Cooper et al. May 2015 A1
20150245127 Shaffer Aug 2015 A1
20150373467 Gelter Dec 2015 A1
20150373474 Kraft et al. Dec 2015 A1
20160033280 Moore et al. Feb 2016 A1
20160072558 Hirsch et al. Mar 2016 A1
20160073189 Linden et al. Mar 2016 A1
20160125892 Bowen et al. May 2016 A1
20160353196 Baker et al. Dec 2016 A1
20160360350 Watson et al. Dec 2016 A1
20170059152 Hirsch et al. Mar 2017 A1
20170060262 Hviid et al. Mar 2017 A1
20170060269 Forstner et al. Mar 2017 A1
20170061751 Loermann et al. Mar 2017 A1
20170062913 Hirsch et al. Mar 2017 A1
20170064426 Hviid Mar 2017 A1
20170064428 Hirsch Mar 2017 A1
20170064432 Hviid et al. Mar 2017 A1
20170064437 Hviid et al. Mar 2017 A1
20170078780 Qian et al. Mar 2017 A1
20170078785 Qian et al. Mar 2017 A1
20170108918 Boesen Apr 2017 A1
20170109131 Boesen Apr 2017 A1
20170110124 Boesen et al. Apr 2017 A1
20170110899 Boesen Apr 2017 A1
20170111723 Boesen Apr 2017 A1
20170111725 Boesen et al. Apr 2017 A1
20170111726 Martin et al. Apr 2017 A1
20170111740 Hviid et al. Apr 2017 A1
20170127168 Briggs et al. May 2017 A1
20170142511 Dennis May 2017 A1
20170151447 Boesen Jun 2017 A1
20170151668 Boesen Jun 2017 A1
20170151918 Boesen Jun 2017 A1
20170151930 Boesen Jun 2017 A1
20170151957 Boesen Jun 2017 A1
20170151959 Boesen Jun 2017 A1
20170153114 Boesen Jun 2017 A1
20170153636 Boesen Jun 2017 A1
20170154532 Boesen Jun 2017 A1
20170155985 Boesen Jun 2017 A1
20170155992 Perianu et al. Jun 2017 A1
20170155993 Boesen Jun 2017 A1
20170155997 Boesen Jun 2017 A1
20170155998 Boesen Jun 2017 A1
20170156000 Boesen Jun 2017 A1
20170178631 Boesen Jun 2017 A1
20170180842 Boesen Jun 2017 A1
20170180843 Perianu et al. Jun 2017 A1
20170180897 Perianu Jun 2017 A1
20170188127 Perianu et al. Jun 2017 A1
20170188132 Hirsch et al. Jun 2017 A1
20170193978 Goldman Jul 2017 A1
20170195829 Belverato et al. Jul 2017 A1
20170208393 Boesen Jul 2017 A1
20170214987 Boesen Jul 2017 A1
20170215016 Dohmen et al. Jul 2017 A1
20170230752 Dohmen et al. Aug 2017 A1
20170251933 Braun et al. Sep 2017 A1
20170257698 Boesen et al. Sep 2017 A1
20170263236 Boesen et al. Sep 2017 A1
20170273622 Boesen Sep 2017 A1
Foreign Referenced Citations (19)
Number Date Country
204244472 Apr 2015 CN
104683519 Jun 2015 CN
104837094 Aug 2015 CN
1469659 Oct 2004 EP
1017252 May 2006 EP
2903186 Aug 2015 EP
2074817 Apr 1981 GB
2508226 May 2014 GB
2008103925 Aug 2008 WO
2007034371 Nov 2008 WO
2011001433 Jan 2011 WO
2012071127 May 2012 WO
2013134956 Sep 2013 WO
2014046602 Mar 2014 WO
2014043179 Jul 2014 WO
2015061633 Apr 2015 WO
2015110577 Jul 2015 WO
2015110587 Jul 2015 WO
2016032990 Mar 2016 WO
Non-Patent Literature Citations (51)
Entry
Akkermans, “Acoustic Ear Recognition for Person Identification”, Automatic Identification Advanced Technologies, 2005 pp. 219-223.
Announcing the $3,333,333 Stretch Goal (Feb. 24, 2014).
Ben Coxworth: “Graphene-based ink could enable low-cost, foldable electronics”, “Journal of Physical Chemistry Letters”, Northwestern University, (May 22, 2013).
Blain: “World's first graphene speaker already superior to Sennheiser MX400”, htt://www.gizmag.com/graphene-speaker-beats-sennheiser-mx400/31660, (Apr. 15, 2014).
BMW, “BMW introduces BMW Connected—The personalized digital assistant”, “http://bmwblog.com/2016/01/05/bmw-introduces-bmw-connected-the-personalized-digital-assistant”, (Jan. 5, 2016).
BRAGI Is on Facebook (2014).
BRAGI Update—Arrival of Prototype Chassis Parts—More People—Awesomeness (May 13, 2014).
BRAGI Update—Chinese New Year, Design Verification, Charging Case, More People, Timeline(Mar. 6, 2015).
BRAGI Update—First Sleeves From Prototype Tool—Software Development Kit (Jun. 5, 2014).
BRAGI Update—Lets Get Ready to Rumble, A Lot to Be Done Over Christmas (Dec. 22, 2014).
BRAGI Update—Memories From April—Update on Progress (Sep. 16, 2014).
BRAGI Update—Memories from May—Update on Progress—Sweet (Oct. 13, 2014).
BRAGI Update—Memories From One Month Before Kickstarter—Update on Progress (Jul. 10, 2014).
BRAGI Update—Memories From the First Month of Kickstarter—Update on Progress (Aug. 1, 2014).
BRAGI Update—Memories From the Second Month of Kickstarter—Update on Progress (Aug. 22, 2014).
BRAGI Update—New People @BRAGI—Prototypes (Jun. 26, 2014).
BRAGI Update—Office Tour, Tour to China, Tour to CES (Dec. 11, 2014).
BRAGI Update—Status on Wireless, Bits and Pieces, Testing-Oh Yeah, Timeline(Apr. 24, 2015).
BRAGI Update—The App Preview, The Charger, The SDK, BRAGI Funding and Chinese New Year (Feb. 11, 2015).
BRAGI Update—What We Did Over Christmas, Las Vegas & CES (Jan. 19, 2014).
BRAGI Update—Years of Development, Moments of Utter Joy and Finishing What We Started(Jun. 5, 2015).
BRAGI Update—Alpha 5 and Back to China, Backer Day, on Track(May 16, 2015).
BRAGI Update—Beta2 Production and Factory Line(Aug. 20, 2015).
BRAGI Update—Certifications, Production, Ramping Up.
BRAGI Update—Developer Units Shipping and Status(Oct. 5, 2015).
BRAGI Update—Developer Units Started Shipping and Status (Oct. 19, 2015).
BRAGI Update—Developer Units, Investment, Story and Status(Nov. 2, 2015).
BRAGI Update—Getting Close(Aug. 6, 2015).
BRAGI Update—On Track, Design Verification, How It Works and What's Next(Jul. 15, 2015).
BRAGI Update—On Track, on Track and Gems Overview.
BRAGI Update—Status on Wireless, Supply, Timeline and Open House@BRAGI(Apr. 1, 2015).
BRAGI Update—Unpacking Video, Reviews on Audio Perform and Boy Are We Getting Close(Sep. 10, 2015).
Healthcare Risk Management Review, “Nuance updates computer-assisted physician documentation solution” (Oct. 20, 2016).
Hoffman, “How to Use Android Beam to Wirelessly Transfer Content Between Devices”, (Feb. 22, 2013).
Hoyt et. al., “Lessons Learned from Implementation of Voice Recognition for Documentation in the Military Electronic Health Record System”, The American Health Information Management Association (2017).
Hyundai Motor America, “Hyundai Motor Company Introduces a Health + Mobility Concept for Wellness in Mobility”, Fountain Valley, Californa (2017).
International Search Report & Written Opinion, PCT/EP2016/070231 (dated Nov. 18, 2016).
Last Push Before the Kickstarter Campaign Ends on Monday 4pm CET (Mar. 28, 2014).
Nigel Whitfield: “Fake tape detectors, ‘from the stands’ footie and UGH? Internet of Things in my set-top box”; http://www.theregister.co.uk/2014/09/24/ibc_round_up_object_audio_dlna_iot/ (Sep. 24, 2014).
Nuance, “ING Netherlands Launches Voice Biometrics Payment System in the Mobile Banking App Powered by Nuance”, “https://www.nuance.com/about-us/newsroom/press-releases/ing-netherlands-launches-nuance-voice-biometrics.html”, 4 pages (Jul. 28, 2015).
Staab, Wayne J., et al., “A One-Size Disposable Hearing Aid is Introduced”, The Hearing Journal 53(4):36-41) Apr. 2000.
Stretchgoal—It's Your Dash (Feb. 14, 2014).
Stretchgoal—The Carrying Case for the Dash (Feb. 12, 2014).
Stretchgoal—Windows Phone Support (Feb. 17, 2014).
The Dash + The Charging Case & The BRAGI News (Feb. 21, 2014).
The Dash—A Word From Our Software, Mechanical and Acoustics Team + An Update (Mar. 11, 2014).
Update From BRAGI—$3,000,000—Yipee (Mar. 22, 2014).
Wertzner et al., “Analysis of fundamental frequency, jitter, shimmer and vocal intensity in children with phonological disorders”, V. 71, n.5, 582-588, Sep./Oct. 2005; Brazilian Journal of Othrhinolaryngology.
Wikipedia, “Gamebook”, https://en.wikipedia.org/wiki/Gamebook, Sep. 3, 2017, 5 pages.
Wikipedia, “Kinect”, “https://en.wikipedia.org/wiki/Kinect”, 18 pages, (Sep. 9, 2017).
Wikipedia, “Wii Balance Board”, “https://en.wikipedia.org/wiki/Wii_Balance_Board”, 3 pages, (Jul. 20, 2017).
Related Publications (1)
Number Date Country
20180116514 A1 May 2018 US
Provisional Applications (1)
Number Date Country
62416537 Nov 2016 US