Patent Grant
10448139
I. Field of the Disclosure
The illustrative embodiments relate to wireless earpieces. More specifically, but not exclusively, the illustrative embodiments relate to dynamically adjusting the wireless earpieces to enhance or filter desired sound input.
II. Description of the Art
The ability of an individual to respond to auditory cues in the environment is dependent upon and influenced by multiple factors. Background noise, task orientation and transient audio signals all play a significant role in an individual's functional capabilities. Each of these parameters compete for the attention of the individual. At times, there are multiple inputs which must be individually analyzed or at the very least, dealt with. Consequently, the individual may not be able to function most effectively in the environment in which they find themselves. What is needed is a new system and method for dealing with such competing audio input signals.
Therefore, it is a primary object, feature, or advantage to improve over the state of the art.
It is a further object, feature, or advantage to provide an earpiece or set of earpieces which enhance the ability of an individual to focus on a person or persons.
It is a still further object, feature, or advantage to provide an earpiece or set of earpieces which provide a user with enhanced ability to function in a background noise environment.
Another object, feature, or advantage is to provide an earpiece or set of earpieces which enhance the ability to remove offending and potentially damaging sound inputs.
Yet another object, feature, or advantage of the present invention is to provide an earpiece or a set of wireless earpieces with the ability to recognize user keywords to trigger actions.
According to one aspect, a system, method and one or more wireless earpieces for active filtering is provided. Active filtering is enabled for the one or more wireless earpieces. A selection of desired audio input is received. Other audio inputs are filtered to enhance the desired audio input.
Another aspect provides a wireless earpiece. The wireless earpiece includes a frame for fitting in an ear of a user. The wireless earpiece further includes a logic engine controlling functionality of the wireless earpiece. The wireless earpiece further includes several sensors reading biometric identifiers of a user to identify the user and receive noises from an environment of the user. The logic engine enables active filtering for the one or more wireless earpieces, receives a selection of a desired audio input, and filters other audio input to enhance the desired audio input.
According to another aspect, a method for selective sound field environment processing for one or more wireless earpieces, each of the one or more wireless earpieces including comprising a plurality of microphones is provided. The method includes receiving audio input of a sound field environment from the plurality of microphones of each of the one or more wireless earpieces, identifying background noise in the sound field environment, identifying audio from at least one sound source within the sound field environment, processing the audio input using one or more processors of at least one of the wireless earpieces to reduce the background noise and processing the audio input using one or more processors of the at least one of the wireless earpieces to enhance the audio from the at least one sound source within the sound field environment to provide processed audio, and transducing the processed audio at one or more speakers of the one or more wireless earpieces. The processing the audio input may be provided using one or more processors of at least one of the wireless earpieces to reduce the background noise comprises active filtering. The sound source(s) with in the sound field environment may include the voice of one or more persons, one or more machines, or other sound sources. The one or more wireless earpieces may be configured to identify the person based on the voice of the person or the machine based on the sound of the machine.
According to another aspect, a wireless earpiece includes an earpiece housing, a processor disposed within the earpiece housing, a plurality of microphones operatively connected to the processor for receiving audio input of a sound field environment. The processor provides for executing instructions stored on a machine readable non-transitory medium for identifying background noise in the sound field environment, identifying audio from at least one sound source within the sound field environment, processing the audio input using the processor to reduce the background noise and processing the audio input using the processor to enhance the audio from the at least one sound source within the sound field environment to provide processed audio. The earpiece further includes at least one speaker operatively connected to the processor for transducing the processed audio. The at least one sound source within the sound field environment may include a voice of a person or machine. The instructions may further provide for identifying the person based on the voice of the person or the machine based on audio of the machine. The instructions may further provide for receiving an input from a user of the one or more wireless earpieces wherein the input from the user specifies the person as one of the at least one sound source. The input may be a voice input such as a voice command or keyword.
Illustrated embodiments of the present invention are described in detail below with reference to the attached drawing figures, which are incorporated by reference herein, and where:
The illustrative embodiments provide a system, method, and wireless earpieces for dynamically self-configuring the wireless earpieces in response to environmental conditions and user input. Adjusting the configuration may include filtering or enhancing sound input received from any number of sources in the environment of the user. In one embodiment, the wireless earpieces may actively filter loud, repetitive (e.g., machinery, yelling, etc.), or other noises, sounds, or inputs potentially dangerous to the hearing of the user. The wireless earpieces may also adjust the output levels of speakers, sensitivity of one or more microphones of the wireless earpieces, and other hardware and software features and functionality of the wireless earpieces. The wireless earpieces may detect noise levels of the environment and then automatically adjust the configuration of the wireless earpieces to provide the best user experience possible for specified inputs (e.g., specified voices, sounds, etc.).
In one embodiment, the wireless earpieces may decrease the output levels of background noises while enhancing user voices or specified user voices. Likewise, the sensitivity of one or more microphones of the wireless earpieces may be decreased to actively filter background and unwanted noises. The wireless earpieces may also increase the input levels of the one or more microphones and tune or increase sensitivity of one or more microphones for specified user voices, warning indicators, or other sounds in noisy environments. The wireless earpieces may automatically adapt to changing environments and conditions. At any point, the user may manually adjust the configuration or settings utilized by the wireless earpieces. Each user utilizing the wireless earpieces may have a specific user profile, the user profile may establish how dynamic configurations are performed for the wireless earpieces. For example, different voices or sounds may have different maximum speaker output levels allowed for noisy environments.
The user may provide feedback at any time to manually adjust the filtering, enhancement, or other features of the wireless earpieces (e.g., volume of the speakers, sensitivity of the microphones, etc.). In one embodiment, the wireless earpieces may learn preferences of the user over time for different enhanced inputs, filtered input, and different environmental conditions to configure the wireless earpieces for the user. For example, the wireless earpieces may learn the user typically enhances user voices in environment A and enhances machine alerts when present or in environment B. The dynamic filtering, enhancement and amplification, speaker volume, and microphone sensitivity modifications may be performed to protect the hearing of the user, and hence functionality of the wireless earpieces in all environments to best assist the user.
The wireless earpieces may be configured to recognize various sounds, such as user voices, mechanical or machine sounds, animal noises, crying, and any number of other sounds or audio signals. The sounds may be characterized by different features of the sound waves or signals as processed including loudness/intensity, quality, pitch/frequency, wavelength, source location, directionality, and so forth. In one embodiment, the wireless earpieces may sample or record specified audio inputs for analysis to filter or enhance the audio input. For example, an employee at a gun range may use wireless earpieces to filter the sound of gun shots while simultaneously enhancing sounds associated with human voices. As a result, the user may be able to walk the range talking to patrons while still protecting the hearing of the user. In another example, the user may work in a manufacturing facility and may select to filter most background noises except for alerts or alarms warning of dangers, break downs, maintenance requests, or other relevant or important information.
The wireless earpieces may provide for various types of sound source identification. The wireless earpieces may include multiple microphones on each earpiece. One of the benefits of having multiple microphones present is array-based techniques may be used to identify sound sources. Various examples of array-based techniques used include any number of beamforming techniques.
The wireless earpieces are worn in the ear of the user. For example, the wireless earpieces are configured to fit at least partially into an external auditory canal of the user. The ear canal is a rich space for obtaining biometric measurements about the user as well as stabilizing the wireless earpieces as they are worn. The wireless earpieces may be utilized during any number of rigorous physical activities requiring stability. The shape and configuration of the wireless earpieces allow the wireless earpieces to be worn for long periods of time while gathering valuable information utilizing the sensors of the wireless earpieces. The sensors of the wireless earpieces may include accelerometers, gyroscopes, microphones, camera or imaging devices, contact/conductivity sensors, pulse oximeters, and so forth. Important measurements taken by the sensors may include pulse rate, blood oxygenation, sounds, position/orientation, location, temperature, altitude, cadence, calorie expenditure, and so forth.
The wireless earpieces may include any number of sensor arrays configured to capture information about the user. The large amount of data may identify the user to dynamically adjust the configuration of the wireless earpieces based on preferences associated with the identified user. The wireless earpieces may learn over time in response to user input and historical information. Alerts may be played to the user indicating the status of the configuration adjustment process (e.g., initiated, in process, pending, awaiting verification, change made, rejected, etc.).
In one embodiment, the wireless earpieces 102 includes a frame 108 shaped to fit substantially within the ears of the user 106. The frame 108 is a support structure at least partially enclosing and housing the electronic components of the wireless earpieces 102. The frame 108 may be composed of a single structure or multiple interconnected structures. The frame 108 defines an extension 110 configured to fit substantially within the ear of the user 106. The extension 110 may house one or more speakers or vibration components for interacting with the user. The extension 110 may be removably covered by one or more sleeves. The sleeves may be changed to fit the size and shape of the user's ears. The sleeves may come in various sizes and have extremely tight tolerances to fit the user 106 and one or more other users utilizing the wireless earpieces 102 during their expected lifecycle. In another embodiment, the sleeves may be custom built to support the interference fit utilized by the wireless earpieces 102 while also being comfortable while worn.
In one embodiment, the frame 108 or the extension 110 (or other portions of the wireless earpieces 102) may include sensors 112 for sensing pulse, blood oxygenation, temperature, voice characteristics, skin conduction, glucose levels, impacts, activity level, position, location, orientation, as well as any number of internal or external user biometrics. In other embodiments, the sensors 112 may be internally positioned within the wireless earpieces 102. For example, the sensors 112 may represent metallic contacts, optical interfaces, or micro-delivery systems for receiving and delivering information. Small electrical charges may be sensed as well as passed through the sensors 112 to analyze the biometrics of the user 106 including pulse, skin conductivity, blood analysis, sweat levels, band so forth. Sensors 112 may also be utilized to provide a small electrical current which may be useful for alerting the user, stimulating blood flow, alleviating nausea, or so forth.
In some applications, temporary adhesives or securing mechanisms (e.g., clamps, straps, lanyards, extenders, chargers, etc.) may be utilized to ensure the wireless earpieces 102 remain in the ears of the user 106 even during the most rigorous and physical activities. In one example, a lanyard may be secured to the extensions 110 to ensure the wireless earpieces 102 are not lost if they fall from the ears of the user 106. The lanyard may be clipped to clothing or accessories of the user. A flexible charger may also be utilized to extend the battery life of the wireless earpieces 102 while securing the wireless earpieces 102 if dropped. In another example, the wireless earpieces 102 may be utilized during marathons, swimming, team sports, biking, hiking, parachuting, or so forth.
The wireless earpieces 102 may be configured to play music or audio, receive and make phone calls or other communications, determine ambient environmental conditions (e.g., temperature, altitude, location, speed, heading, etc.), read user biometrics (e.g., heart rate, motion, temperature, sleep, blood oxygenation, voice output, calories burned, forces experienced, etc.), and receive user input, feedback, or instructions. The wireless device 104 or the wireless earpieces 102 may communicate directly or indirectly with one or more wired or wireless networks, such as a network 120. The wireless earpieces 102 may include logic for dynamically configuring components of the wireless earpieces 102, such as speakers and microphones, to the conditions of the communication environment 100.
The wireless earpieces 102 may determine their position with respect to each other as well as the wireless device 104. For example, position information for the wireless earpieces 102 and the wireless device 104 may determine proximity of the devices in the communication environment 100. For example, global positioning information, wireless triangulation, or signal strength/activity may be utilized to determine proximity and distance of the devices to each other in the communication environment 100. In one embodiment, the distance information may be utilized to determine whether the wireless earpieces 102 are both being worn (e.g., should be experiencing similar environmental conditions, noise, etc.). Sound propagation (e.g., time delay, reflections, etc.) may also be utilized to determine the position, location, or distance of the user, sounds sources, and other objects within the environment 100. As a result, dynamic enhancements and filtering may be adjusted based on the conditions, factors, position, and location of the user within the environment 100.
In one embodiment, the wireless earpieces 102 and the corresponding sensors 112 (whether internal or external) may be configured to take several measurements or log information during normal usage. The sensor measurements may be utilized to extrapolate other measurements, factors, or conditions applicable to the user 106. For example, the sensors 112 may monitor the user's heartbeat or EKG to determine the user's unique pattern or characteristics. The user 106 or another party may configure the wireless earpieces 102 directly or through a connected device and app (e.g., mobile app with a graphical user interface) to store or share information, audio, images, and other data. Some examples of standard usage may include detecting and recording a heartbeat, setting a biometric for transaction authentication, setting noise thresholds and the associated speaker volume level or microphone sensitivity, setting a gesture/input for performing an action (e.g., playing music, opening an application, providing an audio indication of biometric feedback, etc.), active participation in a conversation, listening to music, or so forth.
The wireless earpieces 102 may reconfigure themselves during an initial set up process, during start up, during regular use, or in response to a user request. In one embodiment, each of the sensors 112 of the wireless earpieces 102 may perform baseline readings to determine readings when the communications environment 100 is quiet, slightly noise, and loud. For example, the communications environment 100 may include the user's home, commute, work out areas, office, mechanical shop, sports venue, and so forth without limitation. In one embodiment, the wireless earpieces 102 may determine a default configuration for the speakers and microphones based on a determined location. The speakers and microphones may then be further self-adjusted based on the real-time noise levels, individual voices, or other specified inputs in the determined location to adjust to the optimal configuration for the wireless earpieces 102 including filtering and enhancing sounds.
The wireless earpieces 102 may include any number of sensors 112 and logic for measuring and determining user biometrics, such as pulse rate, skin conduction, blood oxygenation, temperature, calories expended, voice and audio output, position, and orientation (e.g., body, head, etc.). The sensors 112 may also determine the user's location, position, velocity, impact levels, and so forth. The sensors 112 may also receive user input and convert the user input into commands or selections made across the personal devices of the personal area network. For example, the user input detected by the wireless earpieces 102 may include voice commands, head motions, finger taps, finger swipes, motions or gestures, or other user inputs sensed by the wireless earpieces. The user input may be measured by the wireless earpieces 102 and converted into internal commands or external commands potentially sent to one or more external devices, such as the wireless device 104, a tablet computer, or so forth. For example, the user 106 may create a specific head motion and voice command when detected by the wireless earpieces 102 are utilized to automatically adjust to noise levels in the communications environment 100 or increase or decrease the volume.
The sensors 112 may make all the measurements regarding the user 106 or may communicate with any number of other sensory devices in the communication environment 100 to measure information and data about the user 106 as well as the communication environment 100 itself. In one embodiment, the communication environment 100 may represent all or a portion of a personal area network. The wireless earpieces 102 may be utilized to control, communicate, manage, or interact with several other wearable devices or electronics, such as smart glasses, helmets, smart glass, watches or wrist bands, other wireless earpieces, chest straps, implants, displays, clothing, or so forth. A personal area network is a network for data transmissions among devices, such as personal computing, communications, camera, vehicles, entertainment, and medical devices. The personal area network may utilize any number of wired, wireless, or hybrid configurations and may be stationary or dynamic. For example, the personal area network may utilize wireless network protocols or standards, such as INSTEON, IrDA, Wireless USB, Bluetooth, Z-Wave, ZigBee, Wi-Fi, ANT+ or other applicable radio frequency signals. In one embodiment, the personal area network may move with the user 106.
In other embodiments, the communication environment 100 may include any number of devices, components, or so forth potentially communicating with each other directly or indirectly through a wireless (or wired) connection, signal, or link. The communication environment 100 may include one or more networks and network components and devices represented by the network 120, such as routers, servers, signal extenders, intelligent network devices, computing devices, or so forth. In one embodiment, the network 120 of the communication environment 100 represents a personal area network as previously disclosed. The network 120 may also represent several different network types and service providers.
Communications within the communication environment 100 may occur through the network 120 or may occur directly between devices, such as the wireless earpieces 102 and the wireless device 104, or indirectly through a network, such as a Wi-Fi network. The network 120 may communicate with or include a wireless network, such as a Wi-Fi, cellular (e.g., 3G, 4G, 5G, PCS, GSM, etc.), Bluetooth, or other short range or long-range radio frequency network. The network 120 may also include or communicate with any number of hard wired networks, such as local area networks, coaxial networks, fiber-optic networks, network adapters, or so forth. Communications within the communication environment 100 may be operated by one or more users, service providers (e.g., secure, public, private, etc.), or network providers.
The wireless earpieces 102 may play, communicate, or utilize any number of alerts or communications to indicate the status of the self-configuration process including filtering or enhancing audio signals. For example, one or more alerts may indicate when dynamic adjustments are pending (e.g., self and exterior analysis), in process, require user interaction, and/or are being executed with specific tones, verbal acknowledgements, tactile feedback, or other forms of communicated messages. For example, an alert may be played when a specified user's voice is detected and enhanced. Likewise, any time filtering is performed to remove dangerous sounds, an alert may be played to the user 106 so the user 106 is aware of the hearing danger the user 106 and others may be experiencing. The corresponding alert may also be communicated to the user 106, and the wireless device 104.
In other embodiments, the wireless earpieces 102 may also vibrate, flash, play a tone or other sound, or give other indications of the automatic self-configuration process status to prompt user actions (e.g., providing a manual adjustment, select a filtering level, provide additional feedback, etc.) or implement any number of associated steps. The wireless earpieces 102 may also communicate an alert to the wireless device 104 showing up as a notification, message, or other indicator indicating the necessity for configuration/re-configuration or a changed status of the configuration process, such as an audio alert, “the volume has been automatically adjusted for dangerous background noise.”
The wireless earpieces 102 as well as the wireless device 104 may include logic for automatically implementing self-configuration and set-up for self-configuration in response to wireless earpiece set-up, start-up, condition changes (e.g., location, activities, etc.), event happenings, user requests or various other conditions and factors of the communication environment 100. For example, the wireless device 104 may communicate instructions received from the wireless earpieces 102 for the user 106 to provide feedback if the user does not agree with the filtering or enhancement performed by the wireless earpieces 102. The wireless device 104 (or the wireless earpieces 102) may include an application displaying, playing, or communicating instructions and information to the user 106 in response to configuration being needed or required. The application may allow the user 106 to specify or record voices, sounds, or other audio to be filtered or enhanced (e.g., signal processing, amplification, etc.). For example, the application may perform intensity, frequency, wavelength, time delay, and other analysis for any number of audio inputs to recognize the sounds in the future. As a result, the wireless earpieces 102 may perform automatic enhancements or filtering in response to any number or combination of specified conditions, such as location, noise or sound thresholds, detection of or proximity to an individual, animal, or machine, user activity, and so forth. The user 106 may specify preferences for implement the enhancements and filtering as are herein described.
In one embodiment, the wireless device 104 may utilize short-range or long-range wireless communications to communicate with the wireless earpieces 102 through a wireless signal or devices of the communication environment 100. For example, the wireless device 104 may include a Bluetooth and cellular transceiver within the embedded logical components. For example, the wireless signal may be a Bluetooth, Wi-Fi, ZigBee, Ant+, near-field magnetic induction (NFMI), or other short-range wireless communication.
The wireless device 104 may represent any number of wireless or wired electronic communications or computing devices, such as smart phones, laptops, desktop computers, control systems, tablets, displays, gaming devices, music players, personal digital assistants, vehicle systems, or so forth. As noted, the wireless device 104 may communicate utilizing any number of wireless connections, standards, or protocols (e.g., near field communications, NFMI, Bluetooth, Wi-Fi, wireless Ethernet, etc.). For example, the wireless device 104 may be a touch screen cellular phone communicating with the wireless earpieces 102 utilizing Bluetooth communications. The wireless device 104 may implement and utilize any number of operating systems, kernels, instructions, or applications potentially making use of the available sensor data sent from the wireless earpieces 102. For example, the wireless device 104 may represent any number of android, iOS, Windows, open platforms, or other systems and devices. Similarly, the wireless device 104 or the wireless earpieces 102 may execute any number of applications utilizing the user input, proximity data, biometric data, and other feedback from the wireless earpieces 102 to initiate, authorize, or perform configuration and the associated tasks.
As noted, the layout of the internal components of the wireless earpieces 102 and the limited space available for a product of limited size may affect where the sensors 112 and other components may be positioned. The positions of the sensors 112 within each of the wireless earpieces 102 may vary based on the model, version, and iteration of the wireless earpiece design and manufacturing process.
The communications environment 200 is one example of many potential environments where wireless earpieces 201 may be utilized. For example, the wireless earpieces 201 may be utilized in any number of indoor and outdoor conditions. The wireless earpieces 201 may be utilized for work or commercial purposes, exercise or sports, recreational activities, relaxing, or in any number of other locations or situations.
In one example, the wireless earpieces 201 may be utilized in the location 202. For example, the location 202 may represent a home, building, office space, dwelling, sports venue, school, or so forth. The user 206 may enter the location 202 and begin using the wireless earpieces 201 in the section 204. The section 204 may represent a location where the user is utilizing the wireless earpieces 201, such as an office, recreational space, commercial area, cafeteria, classroom, workspace, or so forth. The noise levels within the section 204 may vary based on other individuals, such as individuals 210, 212, machinery, activities, events, or other man-made or natural noises.
In one embodiment, the noise level of the location 202 as well as the sections 204, 206 may increase in response to the individuals 210, 212 utilizing the section 206. For example, the individuals 210, 212 may be participating in a meeting, conference call, sporting activity, discussion, or other activity increasing the noise levels within the location 202. The individuals 210, 212 as well as the equipment, devices, and natural sounds of the sections 204, 206 may generate noise 213. In one embodiment, the user may select to focus on the audio input 214. In one embodiment, the user may provide an input or selection to actively enhance or filter the voice of the user 210. For example, the user 206 may provide a verbal command to “focus on Jill” who may represent the user 210 speaking the audio input 214. As a result, the wireless earpieces 201 may 1) amplify the audio input 214, 2) clarify and amplify the audio input 214 (e.g., signal processing to clean up the audio signal, etc.), and/or 3) filter the other noises 213 (e.g., background noises, dangerously loud noises, etc.). In one example, the audio input 214 may represent the speech or vocalizations of user 210. For example, the user 210 may be the supervisor of user 206. Thus, user 206 may desire or select to enhance the speech of the user 210.
In other examples, the audio input 214 may represent warnings from equipment in the section 206 separated from the location of the user 206. The noise 214 may affect the effectiveness of the wireless earpieces 201 in playing or communicating content, information, and data to the user 206. As a result, the noise 214 may be filtered by the wireless earpieces 201. The noises 214 may also be repetitive, loud, or other noises the wireless earpieces 201 may remove, reduce in volume, or otherwise modify to protect the user 206.
In one embodiment, the location 202 may also experience audio input 216. In one embodiment, the audio input 216 may be a noise or audio dangerous to the hearing of the user 206. As a result, the wireless earpieces 201 may filter the audio input 216 so it is not communicated or played to the user 206 through the wireless earpieces 201. The audio input 216 may represent one-time noises (e.g., explosions, thunder, etc.) as well as repetitive noises (e.g., machinery, speakers, etc.). In one example, the wireless earpieces 201 may automatically filter or eliminate sounds over 85 dB potentially causing permanent hearing damage. Any number of thresholds (e.g., high and low) may be utilized to protect the user 206. The user 206 may also be protected from subliminal messages or other unknown audio sources potentially communicating unknown or dangerous communications.
In one embodiment, the wireless earpieces 201 may actively filter the audio input 216 to remove or dampen the audio input 216 to acceptable levels communicated through the wireless earpieces 201. In another embodiment, the wireless earpieces 201 may act as advanced ear plugs preventing the audio input 216 from passing directly into the ears of the user 206. For example, all audio through the wireless earpieces 201 may be momentarily stopped when the audio input 216 is generated. In yet another embodiment, the wireless earpieces 201 may generate a noise cancelling signal to further reduce the effect of the audio input 216 if transmitted through the body and head of the user 206. The noise cancelling signal may further reduce the danger to the user 206. The wireless earpieces 201 may be sized and shaped to fit users of all ages (e.g., children, adults, seniors, etc.) and with differing ear shapes and anatomy.
In one example, the wireless earpieces 201 may be utilized by the user 206 near a printing press to effectively eliminate the noise 213 potentially associated with the mechanical operation of the printing press while still allowing the user 206 to verbally communicated with the users 210, 212. As a result, the repetitive sounds. As a result, the wireless earpieces 201 may detect the noise 213 within the location 202, analyze the noise 213, and configure the wireless earpieces 201 to provide the best experience to the user 206 utilizing the wireless earpieces 201 while the noise 213 is present. For example, if the individuals 210, 212 are having a loud discussion while the user 206 is utilizing the wireless earpieces 201 to have phone conversation, the wireless earpieces 201 may detect the noise 213 and automatically increase the volume levels of the speakers of the wireless earpieces 201 as well as increasing the microphone sensitivity of the wireless earpieces 201 better detecting the voice of the user 206 (as well as the audio input 214 in some embodiments). The wireless earpieces 201 may also perform filtering or noise cancellation of the noise 213 to enhance the experience of the user 206.
Likewise, the wireless earpieces 201 may decrease the volume of the speakers and the microphone sensitivity of the wireless earpieces 201 in response to determining the audio input 214 has decreased significantly. The wireless earpieces 201 may utilize any number of thresholds to determine how the wireless earpieces 201 are configured to adapt to the communications environment 200. As a result, the experience of the user 206 utilizing the wireless earpieces 201 may be dynamically adapted to communicate desired audio input(s) to the user 206.
In another example, the amount of the noise 214 detected by the wireless earpieces 201 may vary between the section 204 and the section 206. The wireless earpieces 201 may adjust the volume level of the speakers as well as the microphone sensitivity as the user 206 moves within the location 202 for the audio inputs 214, 216 and the noise 213. The wireless earpieces 201 may also include preconfigured settings utilized for specified locations, activities, or so forth. As a result, the user 206 may have the best experience possible with the wireless earpieces 201 during their utilization.
As noted, the wireless earpieces 201 may be configured automatically, manually by the user 206, or in response to user input to selectively filter and enhance the various sounds, noises, and inputs of the location 202 (as well as other locations). In one embodiment, the wireless earpieces 201 may be configured to recognize the speech of the user 210 as detected as the audio input 214 for enhancement. Likewise, the noises 213 and audio input 216 may be recognized for filtering or blocking.
In some embodiments, the wireless device may also act as a logging tool for sensor data or measurements made by the wireless earpieces 302. For example, the wireless device may receive and share data captured by the wireless earpieces 302 in real-time including biometric information, such as a status of the user (e.g., physical, emotional, etc.). As a result, the wireless device may be utilized to store, display, and synchronize sensor data received from the wireless earpieces 302. For example, the wireless device may display user pulse rate, temperature, proximity, location, blood oxygenation, distance, calories burned, and so forth as measured by the wireless earpieces 302. The wireless device may also store information regarding known or typical conditions (e.g., noise levels, environmental conditions, etc.) for specific locations potentially utilized to perform sensor calibration or biasing. The wireless earpieces 302 may also temporarily or permanently store this information and data in the memory 312 for utilization, logging, historical information, or any number of other uses or purposes. The wireless device may be configured to receive and display alerts indicating when calibration has been initiated, processed, and completed.
In one embodiment, the wireless earpieces 302 may include a battery 308, a logic engine 310, a memory 312, a user interface 314, a physical interface 315, a transceiver 316, and sensors 317. The wireless earpieces 302 and the wireless device may have any number of electrical configurations, shapes, and colors and may include various circuitry, connections, and other components utilized to perform the illustrative embodiments.
The battery 308 is a power storage device configured to power the wireless earpieces 302. In other embodiments, the battery 308 may represent a fuel cell, thermal electric generator, piezo electric charger, solar charger, ultra-capacitor, or other existing or developing power storage technologies. The sensors 317 may also be utilized to measure the condition of internal components of the wireless earpieces 302, such as the temperature of the battery 308. The sensors 317 may also be utilized to determine data about external conditions and factors applicable to the user, the user's environment, a communicating wireless device, or so forth. Other conditions and factors sensed by the sensors 317 (e.g., water/humidity, pressure, blood oxygenation, noise levels, blood content levels, altitude, position, impact, radiation, etc.) may also be determined with the data being processed by the logic engine 310.
The logic engine 310 is the logic controlling the operation and functionality of the wireless earpieces 302. The logic engine 310 may include circuitry, chips, and other digital logic. The logic engine 310 may also include programs, scripts, and instructions potentially implemented to operate the logic engine 310. The logic engine 310 may represent hardware, software, firmware, or any combination thereof. In one embodiment, the logic engine 310 may include one or more processors. The logic engine 310 may also represent an application specific integrated circuit (ASIC) or field programmable gate array (FPGA). The logic engine 310 may utilize sensor measurements, user input, user preferences and settings, conditions, factors, and environmental conditions to determine the identity of the user, at least in part, from measurements performed by the wireless earpieces 302. The identity of the user may be utilized by the logic engine 310 to manage specific configuration of the sensors 317 as well as enabling enhancement or filtering options. For example, the logic engine 310 may detect conditions potentially necessitating increasing the amplification or volume for a voice input, such as the voice of user dropping below a threshold, and then send a command to amplifiers or speakers of the wireless earpieces 302 to increase the volume/amplitude of the voice input played by the speakers. The filtering, enhancement, volume levels, and thresholds utilized may vary based on the user identified as utilizing the wireless earpieces 302 at any given time.
In one embodiment, the logic engine 310 may manage the self-configuration based on user preferences and measurements and data from the sensors 317 as well as other connected devices. The logic engine 310 may also perform any number of mathematical functions (e.g. linear extrapolation, polynomial extrapolation, conic extrapolation, French curve extrapolation, polynomial interpretation, etc.) to determine or infer the correct sensor configuration, volume adjustments, microphone sensitivity, biasing, or adjustments potentially required. The logic engine 310 may utilize historical measurements, trends, component degradation or failures, time, and other sensor measurements as causal forces to enhance a mathematical function utilized to perform the determinations, processing, and extrapolation performed by the logic engine 310.
The logic engine 310 may also process user input to determine active filtering and enhancement commands implemented by the wireless earpieces 302 or sent to the wireless earpieces 302 through the transceiver 316. Specific configuration commands or activities may be allowed based on sensor measurements, events, environmental conditions, proximity thresholds, locations, and so forth. For example, the logic engine 310 may implement a configuration process macro allowing the user to accept or reject enhancement for a specified user's voice in response to 1) noise levels reaching a threshold, 2) participating in a specified activity (e.g., biking, concert, work, etc.), or being at a specific location (e.g., work, school, church, music performance, etc.).
In one embodiment, a processor included in the logic engine 310 is circuitry or logic enabled to control execution of a set of instructions. The processor may be one or more microprocessors, digital signal processors, application-specific integrated circuits (ASIC), central processing units, or other devices suitable for controlling an electronic device including one or more hardware and software elements, executing software, instructions, programs, and applications, converting and processing signals and information, and performing other related tasks.
The memory 312 is a hardware element, device, or recording media configured to store data or instructions for subsequent retrieval or access later. The memory may be a non-transitory machine-readable storage media. The memory 312 may represent static or dynamic memory. The memory 312 may include a hard disk, random access memory, cache, removable media drive, mass storage, or configuration suitable as storage for data, instructions, and information. In one embodiment, the memory 312 and the logic engine 310 may be integrated. The memory may use any type of volatile or non-volatile storage techniques and mediums. The memory 312 may store information related to the user, wireless earpieces 302, wireless device 304, and other peripherals, such as smart glasses, smart watch, smart case for the wireless earpieces 302, wearable device, and so forth. In one embodiment, the memory 312 may display or communicate instructions, programs, drivers, or an operating system for controlling the user interface 314 including one or more LEDs or other light emitting components, speakers, tactile generators (e.g., vibrator), and so forth. The memory 312 may also store user profiles, biometric readings, user input required for active filtering and enhancements processes, configuration data (e.g., default, standard, baseline, factory programmed, preset, normative data regarding noise thresholds—utilized for comparisons), user settings and preferences, thresholds, conditions, signal or processing activity, historical information, proximity data, and so forth.
The transceiver 316 is a component comprising both a transmitter and receiver which may be combined and share common circuitry on a single housing. The transceiver 316 may communicate utilizing NFMI, Bluetooth, Wi-Fi, ZigBee, Ant+, near field communications, wireless USB, infrared, mobile body area networks, ultra-wideband communications, cellular (e.g., 3G, 4G, 5G, PCS, GSM, etc.), infrared, or other suitable radio frequency standards, networks, protocols, or communications. For example, the transceiver 316 may coordinate communications and actions between the wireless earpieces 302 utilizing NFMI communications. The transceiver 316 may also be a hybrid transceiver supporting several different communications. For example, the transceiver 316 may communicate with wireless devices or other systems utilizing wired interfaces (e.g., wires, traces, etc.), NFC or Bluetooth communications. The transceiver 316 may also detect amplitudes and infer distance between the wireless earpieces 302 and external devices, such as the wireless device or a smart case of the wireless earpieces 302.
The components of the wireless earpieces 302 may be electrically connected utilizing any number of wires, contact points, leads, busses, wireless interfaces, or so forth. In addition, the wireless earpieces 302 may include any number of computing and communications components, devices or elements which may include busses, motherboards, circuits, chips, sensors, ports, interfaces, cards, converters, adapters, connections, transceivers, displays, antennas, and other similar components. The physical interface 315 is hardware interface of the wireless earpieces 302 for connecting and communicating with wireless devices or other electrical components, devices, or systems. For example, synching and charging may be performed by an external device through the physical interface 315.
The user interface 314 is a hardware interface for receiving commands, instructions, or input through the touch (haptics) of the user, voice commands, or predefined motions. For example, the user interface 314 may include a touch screen or sensors (including a fingerprint scanner), one or more cameras or image sensors, microphones, speakers, and so forth. One or more speakers 318 may include several speaker components (e.g., signal generators, amplifiers, drivers, and other circuitry) configured to generate sounds waves at distinct frequency ranges (e.g., bass, woofer, tweeter, midrange, etc.) or to vibrate at specified frequencies to be perceived by the user as sound waves. The speakers 318 may also generate interference signals potentially counteracting audio signals externally sensed by the sensors 317 and processed by the logic engine 310. The user interface 314 may be utilized to control the other functions of the wireless earpieces 302. The user interface 314 may include the LED array, one or more touch sensitive buttons or portions, a miniature screen or display, or other input/output components. The user interface 314 may be controlled by the user or based on commands received from the wireless device. For example, the user may adjust or cancel active filtering and/or enhancement performed by the wireless earpieces 300 utilizing the user interface 314.
The one or more microphones of the user interface 314 may include an internal or ear bone microphone receiving conduction of sound to the microphone through the bones of the skull. The internal microphone may also represent any number of other microphone types utilized to sense the user's voice, external noise, and so forth. The ear bone microphone may be positioned so it is within the ear of the user when the wireless earpieces 302 are being worn. The user interface 314 may also include an external microphone measuring noise levels outside the wireless earpieces 302. The external noise levels may be utilized to configure the wireless earpieces 302 including the filtering, enhancements, volume levels, and sensitivity of the internal or ear bone microphone.
In one embodiment, the biometric data of the user may be encrypted and stored within a secure portion of the memory 312 to prevent unwanted access or hacking. The wireless earpieces 302 may also store important user profile and biometric data, such as medical information (e.g., medical conditions, allergies, logged biometrics, contacts, etc.) and identifying biometric information, for sharing in response to an emergency or authenticated request. The profile may store information about when, where, and how active enhancement and filtering of audio is performed by the wireless earpieces 300. For example, the user may specify certain voices, sounds, or audio to be filtered or enhanced, activities or environments during which filtering and/or enhancement are performed, user input or commands utilized to implement enhancement and/or filtering (e.g., head motions, taps, swipes, or other contact with the wireless earpieces 300, voice commands, in-app selections, etc.), priorities for implementing filtering and enhancement in complex sound environments, and preferences for distinct users potentially utilizing the wireless earpieces 300.
The dynamic processing of audio content may be performed automatically in response to conditions and factors detected by the wireless earpieces 302. However, in other embodiments, the user may provide user feedback for initiating a configuration process by tapping the user interface 314 once, twice, three times, or any number of times. Similarly, a swiping or specific motion may be utilized across or in front of the user interface 314 (e.g., the exterior surface of the wireless earpieces 302) to implement a predefined action. Swiping motions in any number of directions or gestures may be associated with specific or broad filtering and enhancements as well as other activities, such as share exercise data, share music playlist, share vitals, play music, pause, fast forward, rewind, activate a digital assistant (e.g., Siri, Cortana, smart assistant, etc.), or so forth without limitation. The swiping motions may also be utilized to control actions and functionality of wireless devices or other external devices (e.g., smart television, camera array, smart watch, etc.). The user may also provide user input for authorizing or initiating a configuration process by moving his head in a direction or motion or based on the user's position, orientation, or location. The user may utilize voice commands, head gestures, or touch commands to control the wireless earpieces 300. For example, the user may say “listen to Mark” to automatically reconfigure the volume levels of the speakers and adjust the sensitivity of the microphone to Mark's voice (e.g., Mark's voice may have previously been established for enhancement). The user may be changing between activities (e.g., running, biking, swimming, etc.) and may want the sensors 317 and logic engine 310 to be specifically configured for the activity. The user interface 314 may also provide a software interface including any number of icons, soft buttons, windows, links, graphical display elements, and so forth.
In one embodiment, the user interface 314 may periodically utilize one or more microphones and speakers of the wireless earpieces 302 to authenticate or identify the user, other users, sounds, or other audio input. The microphone of the user interface 314 may measure various voice characteristics including amplitude, shimmer rates (i.e., changes in amplitude over time) frequency/pitch, jitter rates (i.e., changes in frequency data over time), accent, voice speed, inflection, and so forth. The wireless earpieces 302 may also recognize a pre-defined vocabulary, words, passwords, or phrases for authentication. For example, specific words may be required to authenticate the user and specific data associated with the user (e.g., fit of the wireless earpieces, baseline configuration readings, user preferences, etc.). The wireless earpieces 302 may also indicate or confirm the identity of the user for verification utilizing the one or more speakers of the user interface 314. The wireless earpieces 302 may also audibly confirm any number of actions, commands, activities, features, or processes performed by the wireless earpieces (e.g., initiated, status, continuing, terminating, etc.).
The sensors 317 may include pulse oximeters, accelerometers, gyroscopes, magnetometers, water, moisture, or humidity detectors, impact/force detectors, thermometers, inertial sensors, photo detectors, miniature cameras, microphones, and other similar instruments for detecting the user's status and environmental conditions as well as location, utilization of the wireless earpieces 302, orientation, motion, and so forth. The sensors 317 may also be utilized to determine the biometric, activity, location, and speed measurements of the user. In one embodiment, the sensors 317 may store data potentially shared with other components (e.g., logic engine 310 implementing a configuration process), users, and devices.
The sensors 317 may also include photodetectors, ultrasonic mapping devices, or radar scanning the ear of the user when positioned for utilization. The sensors 317 may generate a two or three-dimensional scan or topography map of the user's ear and surrounding areas when the wireless earpieces 302 are properly positioned. The mapping may include the internal and/or external portions of the user's ear. The topographical image of the user's ear may be utilized as a stand-alone biometric identifier or may be utilized with other biometric identifiers to identify the user. The topographical image may also be utilized to perform configuration based on the determined position, orientation, and fit of the wireless earpieces 302 and sensors 317. The image may include the external auditory meatus, scapha, fossa triangularis, scaphoid fossa, helix, antihelix, antitragus, lobule, the tragus, and pinna as well as other internal or external portions of the ear and surrounding head structure.
The sensors 317 may pass measurements, readings, and data to the logic engine 310 for performing configuration processes and algorithms. Likewise, the memory 312 may store the configuration programs, algorithms, steps, baseline data, sensor measurement data, and so forth. This data and information may also be communicated to a connected device for storage or analysis. The sensor measurements may be compared against the baseline data to determine variations and how to compensate or adjust the wireless earpieces 302 based on the sensor measurements. The sensors 317 may also measure a noise floor of the sensors for each sensor of the wireless earpieces 302. The noise floor may be the measure of the signal created from the sum of all the noise sources and unwanted signals for each of the sensors 317 within each of the wireless earpieces 302. The noise floor may be calculated for various environments, locations, and positions all of which may affect the sensors 317. The logic engine 310 may also perform pattern analysis with the sensor measurements to calibrate or tune the sensors 317 based on established patterns or information.
Externally connected wireless devices may include components similar in structure and functionality to those shown for the wireless earpieces 302. For example, a wireless device may include any number of processors, batteries, memories, busses, motherboards, chips, transceivers, peripherals, sensors, displays, cards, ports, adapters, interconnects, sensors, and so forth. In one embodiment, the wireless device may include one or more processors and memories for storing instructions. The instructions may be executed as part of an operating system, application, browser, or so forth to implement the features herein described. For example, the user may set preferences for the wireless earpieces 302 to perform configuration based on specified events, locations, activities, or user input. Likewise, the preferences may manage the actions taken by the wireless earpieces 302 in response to identifying specific users utilizing the wireless earpieces 302. For example, a parent user may require a first configuration process for filtering outside noises to protect hearing of the parent while a juvenile user may have a second configuration process to enhance the voice of the parent when speaking to the juvenile (in addition the volume level of music played may also be capped for the juvenile user or other users to prevent hearing loss or damage). In one embodiment, the wireless earpieces 302 may be magnetically or physically coupled to the wireless device to be recharged or synchronized.
The wireless device may also execute an application with settings or conditions for self-configuration, updating, synchronizing, sharing, saving, identifying, calibrating, and utilizing biometric and environmental information as herein described. For example, one of the sensors 317 potentially failing may be ignored in response to improper or unreliable data being gathered. As a result, the user identification process for configuration process authorization may be dynamically performed utilizing any combination of sensor measurements and the measurements of environmental conditions may likewise be adapted. For example, the number and position of the sensors 317 utilized to perform sensor measurements of the user may vary based on failures, inaccurate data, or other temporary or permanent issues with hardware and software of the wireless earpieces 302.
The process, methods, and steps of
Next, the wireless earpieces receive a selection of a desired audio input (step 504). The desired audio input may represent any number of audio inputs, sounds, or signals proximate or in the environment of the user. For example, the desired audio input may represent a user's voice. The desired audio input may also represent mechanical or machine generated sounds or voices potentially important to the user. In one embodiment, the user may specifically enter or record the desired audio input for analysis by the wireless earpieces or one or more connected communications or computing devices. For example, the user may record the voice of a parent or supervisor for distinct recognition within a group or noisy environment. The user or administrator of the wireless earpieces may select the desired audio input for purposes of recreation, work, organizational projects, sports activities, or so forth. Full signal and spectrum analysis may be performed for the desired audio input to best recognize the desired audio input in any number of situations (e.g., environments, activities, multiple individuals present, etc.).
Next, the wireless earpieces filter other audio inputs to enhance the desired audio input (step 506). The other audio inputs may include background, environmental, or other noises the user would like to actively filter. For example, the wireless earpieces may entirely remove or reduce the other audio inputs from an audio stream or audio content sensed by the wireless earpieces (e.g., ear-bone microphone, external microphones, etc.). In some embodiments, the other audio inputs may not be filtered, but instead, the desired audio input may be enhanced. For example, the desired audio input may be amplified, clarified (e.g., noise removal, etc.), and otherwise enhance for the user.
Next, the wireless earpieces terminate active filtering in response to a user selection (step 508). The active filtering may be disabled in response to any number of active or passive selections performed automatically or in response to input from the user. In one embodiment, the active filtering may be terminated in response to an affirmative input, command, or other selection received from the user. The active filtering may also be terminated or disabled in response to the wireless earpieces being powered down, placed in a smart case, removed from the ears of the user, or based on any other activity or action selected by the user.
Next, the wireless earpieces enable active filtering in response to a user selection (step 604). As previously noted, the active filtering may be performed automatically or in response to a user selection. In one example, the active filtering may prevent dangerous audio inputs from being passed through to the user regardless of the circumstances, selections, or conditions. As a result, the wireless earpieces protect the user in all situations when worn and activated (e.g., battery power is sufficient to operate the wireless earpieces, the wireless earpieces are being worn, etc.).
Next, the wireless earpieces filter selected and dangerous audio inputs (step 606). In one embodiment, the selected or dangerous audio inputs may be preselected, predetermined, or otherwise identified in advance by the wireless earpieces. In other embodiments, the dangerous audio inputs may be actively filtered based on their sound profile. For example, if an audio input is determined to exceed one or more thresholds (e.g., dB, frequency, intensity, etc.) the audio input may be classified or treated as a dangerous audio input and actively filtered by the wireless earpieces. In one embodiment, the active filtering may include removing the audio signal from the streamed audio content sent to the user through the wireless earpieces. In another embodiment, the wireless earpieces may utilize the interference fit and blocking nature of the wireless earpieces to passively prevent the dangerous audio input from being communicated to the user. Because the wireless earpieces completely fill the ear canal where audio waves typically pass into the ears of the user, the wireless earpieces may be utilized as an excellent soundwave blocker.
In one embodiment, the sound or volume levels output to the user by the speakers of the wireless earpieces may also be automatically adjusted to the environment based on a determined user profile. For example, an automatically determined dB threshold may be utilized at a pre-programmed level. As a result, the user may be able to comfortably listen to the wireless earpieces without the need to manually adjust the volume to match the environment of the user. The microphone sensitivity may also be adjusted as needed. In addition, other components of the wireless earpieces may be adjusted based on the encountered environmental conditions. In one embodiment, each step of the process of
In other embodiments subsequently described, the process of
The wireless earpieces may also sense noises from an environment of the user utilizing one or more microphones of the wireless earpieces to perform the filtering and enhancement of
In one embodiment, the wireless earpieces may automatically perform a dynamic enhancement or filtering process in response to set-up of the wireless earpieces, power up, a designated change in activities, a detected event (e.g., change in temperature beyond a threshold, sensed impact, altitude change, etc.), or environmental conditions. The configuration process may be initiated in response to one or more user or environmental thresholds being reached. In one embodiment, an indication requesting the configuration may be received directly from a user of the wireless earpieces. For example, the user may give a pre-programmed verbal command, such as “reset the filtering.” The user input may also be a default voice command, gesture, head motion, or other input potentially sensed by the wireless earpieces. As a result, the configuration process may be initiated and processed entirely utilizing the wireless earpieces. In another embodiment, an indication may be received from a wireless device, such as a cell phone in communication with the wireless earpieces. For example, the wireless device may expect the configuration is necessary based on measured or inferred conditions.
The wireless earpieces determine an audio profile associated with the environment of the user. For example, the wireless earpieces may analyze the noise from the environment to select the associated audio profile. The audio profiles may be pre-programmed or may be specifically set and programmed by the user. The wireless earpieces may also determine the location of the user, an inferred activity of the user, and any other factors or conditions of the environment or circumstances of the user potentially affecting the noise level as well as the associated audio profile. In one embodiment, the audio profile may be defined by one or more noise thresholds. For example, an audio environment with noise below a low threshold may be considered a “quiet environment”, whereas an audio environment with noise above a high threshold may be considered a “loud environment.” In addition, any number of intermediate audio profiles may be selected.
In one embodiment, to perform the filtering and enhancement features and functions of the wireless earpieces dynamically configure components of the wireless earpieces including processing audio signals to perform filtering and enhancements, adjusting microphone and speaker settings, generating noise cancelling signals, blocking all audio input, and so forth. In one embodiment, the wireless earpieces may increase or decrease the volume of the speakers of the wireless earpieces for all content or specified portions of audio streams.
The wireless earpieces may also determine an audio profile is associated with dangerously high levels of environmental noise, such as a gunshot, fireworks, sporting event, workshop with tools running, or so forth. The wireless earpieces may prevent, limit, or filter the pass-through of environmental noises in response to determining the audio profile is dangerous or potentially harmful to the user. For example, the user may have set the wireless earpieces to pass through environmental noises, but the wireless earpieces may override the selection in response to the external noise levels reaching one or more thresholds. The wireless earpieces may reinstitute the pass-through of environmental noises in response to determining the audio profile associated with dangerous levels of noises has decreased. The wireless earpieces may also utilize an ear-bone microphone to detect and receive self-voice in response to detecting self-voice in the high noise or dangerous audio profiles. The wireless earpieces may also mute external microphones or audio inputs to more accurately detect the voice and sounds from the user. As a result, the voice of the user may be more accurately detected in high noise environments.
At any time, the wireless earpieces may allow the user to override the automatic configurations or adjustments made by the logic of the wireless earpieces to ensure the user is always control. For example, if the volume level is increased to a level the user does not like or is otherwise dissatisfied with, the user may easily adjust the speakers of the wireless earpieces wireless earpieces utilizing touch, gesture, or other controls provided by the user interface.
In some embodiments, the configuration process may be or include a calibration or diagnostic activity performed for all or portions of the sensors. The diagnostic may test functionality, accuracy, and any number of other factors. The calibration may include any number of mathematical, functional, software, or hardware tests, diagnostics, resets, biasing, and adjustments. The calibration may be performed for all, or a portion, of the sensors of the wireless earpieces. For example, only specific types of sensors (e.g., audio, optical/imaging, thermal, touch sensors, audio, contact, etc.) may be tested. To ensure proper operation and fit of the wireless earpieces within the ears of the user. In one embodiment, sensor measurements may be performed for comparison against baseline, default, ideal, or standard sensor measurements.
Alerts may be generated at any time during the process of
In one embodiment, the alert is an internal alert potentially communicated to the user of the wireless device. For example, the alert may be communicated to the user as an audio, tactile, or visual alert, such as “the volume level has been configured for this environment.” The alert may also be communicated to a wireless device in communication with the wireless earpiece. For example, an alert may be sent to a cell phone in communication with the wireless earpiece to display an application specific alert to the user, such as “the pass-through feature has been disabled due to the dangerous level of noise you are experiencing.” In some embodiments, the alert may be sent through email, text message, or other designated communications technique. In other embodiments, no alert may be generated.
The illustrative embodiments provide a system, method, and wireless earpiece(s) for performing active filtering and enhancement of audio inputs automatically or based on environmental conditions, detected events, activities, thresholds or user input. The illustrative embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, embodiments of the inventive subject matter may take the form of a computer program product embodied in any tangible medium of expression having computer usable program code embodied in the medium. The described embodiments may be provided as a computer program product, or software, potentially including a machine-readable medium having stored thereon instructions, which may be used to program a computing system (or other electronic device(s)) to perform a process according to embodiments, whether presently described or not, since every conceivable variation is not enumerated herein. A machine-readable medium includes any mechanism for storing or transmitting information in a form (e.g., software, processing application) readable by a machine (e.g., a computer). The machine-readable medium may include, but is not limited to, magnetic storage medium (e.g., floppy diskette); optical storage medium (e.g., CD-ROM); magneto-optical storage medium; read only memory (ROM); random access memory (RAM); erasable programmable memory (e.g., EPROM and EEPROM); flash memory; or other types of medium suitable for storing electronic instructions. In addition, embodiments may be embodied in an electrical, optical, acoustical or other form of propagated signal (e.g., carrier waves, infrared signals, digital signals, etc.), or wireline, wireless, or another communications medium.
Computer program code for carrying out operations of the embodiments may be written in any combination of one or more programming languages, including an object-oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on a user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN), a personal area network (PAN), or a wide area network (WAN), or the connection may be made to an external computer (e.g., through the Internet using an Internet Service Provider).
It is also to be understood a user may configure their earpiece in various ways including to map names or keywords to sources. This allows a user to provide user input to one or more of the earpieces to specify a sound source. Thus, for example, a user can specify one or more sound sources they wish to focus on or else specify one or more sound sources which they wish to not focus on and which can be blocked or attenuated. The input may be in any form suitable for the earpiece including voice input from a user. Where voice input is used the voice input may include one or more keywords. The user input may also include one or more processing parameters. For example, a user can specify they wish the volume of a sound source reduced by 50 percent, or otherwise specify parameters.
The illustrative embodiments are not to be limited to the embodiments described herein. The illustrative embodiments contemplate numerous variations in the type of ways in which embodiments may be applied. The foregoing description has been presented for purposes of illustration and description. It is not intended to be an exhaustive list or limit any of the disclosure to the precise forms disclosed. It is contemplated other alternatives or exemplary aspects are considered included in the disclosure. The description is merely examples of embodiments, processes or methods of the invention. It is understood any other modifications, substitutions, and/or additions may be made, which are within the intended spirit and scope of the disclosure. For the foregoing, it can be seen the disclosure accomplishes at least all the intended objectives.
The previous detailed description is of a small number of embodiments for implementing the invention and is not intended to be limiting in scope. The following claims set forth several the embodiments of the invention disclosed with greater particularity.
This application is a continuation of U.S. patent application Ser. No. 15/635,839 filed on Jun. 28, 2017 which claims priority to U.S. Provisional Patent Application No. 62/358,792 filed on Jul. 6, 2016, all of which are titled Selective Sound Field Environment Processing System and Method and all of which are hereby incorporated by reference in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 2325590 | Carlisle et al. | Aug 1943 | A |
| 2430229 | Kelsey | Nov 1947 | A |
| 3047089 | Zwislocki | Jul 1962 | A |
| D208784 | Sanzone | Oct 1967 | S |
| 3586794 | Michaelis | Jun 1971 | A |
| 3696377 | Wall | Oct 1972 | A |
| 3934100 | Harada | Jan 1976 | A |
| 3983336 | Malek et al. | Sep 1976 | A |
| 4069400 | Johanson et al. | Jan 1978 | A |
| 4150262 | Ono | Apr 1979 | A |
| 4334315 | Ono et al. | Jun 1982 | A |
| D266271 | Johanson et al. | Sep 1982 | S |
| 4375016 | Harada | Feb 1983 | A |
| 4588867 | Konomi | May 1986 | A |
| 4617429 | Bellafiore | Oct 1986 | A |
| 4654883 | Iwata | Mar 1987 | A |
| 4682180 | Gans | Jul 1987 | A |
| 4791673 | Schreiber | Dec 1988 | A |
| 4852177 | Ambrose | Jul 1989 | A |
| 4865044 | Wallace et al. | Sep 1989 | A |
| 4984277 | Bisgaard et al. | Jan 1991 | A |
| 5008943 | Amdt et al. | Apr 1991 | A |
| 5185802 | Stanton | Feb 1993 | A |
| 5191602 | Regen et al. | Mar 1993 | A |
| 5201007 | Ward et al. | Apr 1993 | A |
| 5201008 | Amdt et al. | Apr 1993 | A |
| D340286 | Seo | Oct 1993 | S |
| 5280524 | Norris | Jan 1994 | A |
| 5295193 | Ono | Mar 1994 | A |
| 5298692 | Ikeda et al. | Mar 1994 | A |
| 5343532 | Shugart | Aug 1994 | A |
| 5347584 | Narisawa | Sep 1994 | A |
| 5363444 | Norris | Nov 1994 | A |
| 5444786 | Raviv | Aug 1995 | A |
| D367113 | Weeks | Feb 1996 | S |
| 5497339 | Bernard | Mar 1996 | A |
| 5606621 | Reiter et al. | Feb 1997 | A |
| 5613222 | Guenther | Mar 1997 | A |
| 5654530 | Sauer et al. | Aug 1997 | A |
| 5692059 | Kruger | Nov 1997 | A |
| 5721783 | Anderson | Feb 1998 | A |
| 5748743 | Weeks | May 1998 | A |
| 5749072 | Mazurkiewicz et al. | May 1998 | A |
| 5771438 | Palermo et al. | Jun 1998 | A |
| D397796 | Yabe et al. | Sep 1998 | S |
| 5802167 | Hong | Sep 1998 | A |
| 5844996 | Enzmann et al. | Dec 1998 | A |
| D410008 | Almqvist | May 1999 | S |
| 5929774 | Charlton | Jul 1999 | A |
| 5933506 | Aoki et al. | Aug 1999 | A |
| 5949896 | Nageno et al. | Sep 1999 | A |
| 5987146 | Pluvinage et al. | Nov 1999 | A |
| 6021207 | Puthuff et al. | Feb 2000 | A |
| 6054989 | Robertson et al. | Apr 2000 | A |
| 6081724 | Wilson | Jun 2000 | A |
| 6084526 | Blotky et al. | Jul 2000 | A |
| 6094492 | Boesen | Jul 2000 | A |
| 6111569 | Brusky et al. | Aug 2000 | A |
| 6112103 | Puthuff | Aug 2000 | A |
| 6157727 | Rueda | Dec 2000 | A |
| 6167039 | Karlsson et al. | Dec 2000 | A |
| 6181801 | Puthuff et al. | Jan 2001 | B1 |
| 6185152 | Shen | Feb 2001 | B1 |
| 6208372 | Barraclough | Mar 2001 | B1 |
| 6230029 | Yegiazaryan et al. | May 2001 | B1 |
| 6275789 | Moser et al. | Aug 2001 | B1 |
| 6339754 | Flanagan et al. | Jan 2002 | B1 |
| D455835 | Anderson et al. | Apr 2002 | S |
| 6408081 | Boesen | Jun 2002 | B1 |
| 6424820 | Burdick et al. | Jul 2002 | B1 |
| D464039 | Boesen | Oct 2002 | S |
| 6470893 | Boesen | Oct 2002 | B1 |
| D468299 | Boesen | Jan 2003 | S |
| D468300 | Boesen | Jan 2003 | S |
| 6542721 | Boesen | Apr 2003 | B2 |
| 6560468 | Boesen | May 2003 | B1 |
| 6563301 | Gventer | May 2003 | B2 |
| 6654721 | Handelman | Nov 2003 | B2 |
| 6664713 | Boesen | Dec 2003 | B2 |
| 6690807 | Meyer | Feb 2004 | B1 |
| 6694180 | Boesen | Feb 2004 | B1 |
| 6718043 | Boesen | Apr 2004 | B1 |
| 6738485 | Boesen | May 2004 | B1 |
| 6748095 | Goss | Jun 2004 | B1 |
| 6754358 | Boesen et al. | Jun 2004 | B1 |
| 6784873 | Boesen et al. | Aug 2004 | B1 |
| 6823195 | Boesen | Nov 2004 | B1 |
| 6852084 | Boesen | Feb 2005 | B1 |
| 6879698 | Boesen | Apr 2005 | B2 |
| 6892082 | Boesen | May 2005 | B2 |
| 6920229 | Boesen | Jul 2005 | B2 |
| 6952483 | Boesen et al. | Oct 2005 | B2 |
| 6987986 | Boesen | Jan 2006 | B2 |
| 7010137 | Leedom et al. | Mar 2006 | B1 |
| 7113611 | Leedom et al. | Sep 2006 | B2 |
| D532520 | Kampmeier et al. | Nov 2006 | S |
| 7136282 | Rebeske | Nov 2006 | B1 |
| 7203331 | Boesen | Apr 2007 | B2 |
| 7209569 | Boesen | Apr 2007 | B2 |
| 7215790 | Boesen et al. | May 2007 | B2 |
| D549222 | Huang | Aug 2007 | S |
| D554756 | Sjursen et al. | Nov 2007 | S |
| 7403629 | Aceti et al. | Jul 2008 | B1 |
| D579006 | Kim et al. | Oct 2008 | S |
| 7463902 | Boesen | Dec 2008 | B2 |
| 7508411 | Boesen | Mar 2009 | B2 |
| 7532901 | LaFranchise et al. | May 2009 | B1 |
| D601134 | Elabidi et al. | Sep 2009 | S |
| 7825626 | Kozisek | Nov 2010 | B2 |
| 7859469 | Rosener et al. | Dec 2010 | B1 |
| 7965855 | Ham | Jun 2011 | B1 |
| 7979035 | Griffin et al. | Jul 2011 | B2 |
| 7983628 | Boesen | Jul 2011 | B2 |
| D647491 | Chen et al. | Oct 2011 | S |
| 8095188 | Shi | Jan 2012 | B2 |
| 8108143 | Tester | Jan 2012 | B1 |
| 8140357 | Boesen | Mar 2012 | B1 |
| 8238967 | Arnold et al. | Aug 2012 | B1 |
| D666581 | Perez | Sep 2012 | S |
| 8300864 | Müllenborn et al. | Oct 2012 | B2 |
| 8406448 | Lin et al. | Mar 2013 | B2 |
| 8430817 | Al-Ali et al. | Apr 2013 | B1 |
| 8436780 | Schantz et al. | May 2013 | B2 |
| D687021 | Yuen | Jul 2013 | S |
| 8679012 | Kayyali | Mar 2014 | B1 |
| 8719877 | VonDoenhoff et al. | May 2014 | B2 |
| 8774434 | Zhao et al. | Jul 2014 | B2 |
| 8831266 | Huang | Sep 2014 | B1 |
| 8891800 | Shaffer | Nov 2014 | B1 |
| 8994498 | Agrafioti et al. | Mar 2015 | B2 |
| D728107 | Martin et al. | Apr 2015 | S |
| 9013145 | Castillo et al. | Apr 2015 | B2 |
| 9037125 | Kadous | May 2015 | B1 |
| D733103 | Jeong et al. | Jun 2015 | S |
| 9081944 | Camacho et al. | Jul 2015 | B2 |
| 9317241 | Tranchina | Apr 2016 | B2 |
| 9461403 | Gao et al. | Oct 2016 | B2 |
| 9510159 | Cuddihy et al. | Nov 2016 | B1 |
| D773439 | Walker | Dec 2016 | S |
| D775158 | Dong et al. | Dec 2016 | S |
| 9524631 | Agrawal et al. | Dec 2016 | B1 |
| D777710 | Palmborg et al. | Jan 2017 | S |
| 9544689 | Fisher et al. | Jan 2017 | B2 |
| D788079 | Son et al. | May 2017 | S |
| 9684778 | Tharappel et al. | Jun 2017 | B2 |
| 9711062 | Ellis et al. | Jul 2017 | B2 |
| 9711162 | Murthy | Jul 2017 | B2 |
| 9729979 | Özden | Aug 2017 | B2 |
| 9767709 | Ellis | Sep 2017 | B2 |
| 9821767 | Nixon | Nov 2017 | B2 |
| 9848257 | Ambrose et al. | Dec 2017 | B2 |
| 20010005197 | Mishra et al. | Jun 2001 | A1 |
| 20010027121 | Boesen | Oct 2001 | A1 |
| 20010043707 | Leedom | Nov 2001 | A1 |
| 20010056350 | Calderone et al. | Dec 2001 | A1 |
| 20020002413 | Tokue | Jan 2002 | A1 |
| 20020007510 | Mann | Jan 2002 | A1 |
| 20020010590 | Lee | Jan 2002 | A1 |
| 20020030637 | Mann | Mar 2002 | A1 |
| 20020046035 | Kitahara et al. | Apr 2002 | A1 |
| 20020057810 | Boesen | May 2002 | A1 |
| 20020076073 | Taenzer et al. | Jun 2002 | A1 |
| 20020118852 | Boesen | Aug 2002 | A1 |
| 20030002705 | Boesen | Jan 2003 | A1 |
| 20030065504 | Kraemer et al. | Apr 2003 | A1 |
| 20030100331 | Dress et al. | May 2003 | A1 |
| 20030104806 | Ruef et al. | Jun 2003 | A1 |
| 20030115068 | Boesen | Jun 2003 | A1 |
| 20030125096 | Boesen | Jul 2003 | A1 |
| 20030218064 | Conner et al. | Nov 2003 | A1 |
| 20040070564 | Dawson et al. | Apr 2004 | A1 |
| 20040102931 | Ellis et al. | May 2004 | A1 |
| 20040160511 | Boesen | Aug 2004 | A1 |
| 20050017842 | Dematteo | Jan 2005 | A1 |
| 20050043056 | Boesen | Feb 2005 | A1 |
| 20050094839 | Gwee | May 2005 | A1 |
| 20050125320 | Boesen | Jun 2005 | A1 |
| 20050148883 | Boesen | Jul 2005 | A1 |
| 20050165663 | Razumov | Jul 2005 | A1 |
| 20050196009 | Boesen | Sep 2005 | A1 |
| 20050197063 | White | Sep 2005 | A1 |
| 20050212911 | Marvit et al. | Sep 2005 | A1 |
| 20050251455 | Boesen | Nov 2005 | A1 |
| 20050266876 | Boesen | Dec 2005 | A1 |
| 20060029246 | Boesen | Feb 2006 | A1 |
| 20060073787 | Lair et al. | Apr 2006 | A1 |
| 20060074671 | Farmaner et al. | Apr 2006 | A1 |
| 20060074808 | Boesen | Apr 2006 | A1 |
| 20060166715 | Engelen et al. | Jul 2006 | A1 |
| 20060166716 | Seshadri et al. | Jul 2006 | A1 |
| 20060220915 | Bauer | Oct 2006 | A1 |
| 20060258412 | Liu | Nov 2006 | A1 |
| 20070021958 | Visser | Jan 2007 | A1 |
| 20070102009 | Wong et al. | May 2007 | A1 |
| 20070160243 | Dijkstra | Jul 2007 | A1 |
| 20070239225 | Saringer | Oct 2007 | A1 |
| 20070247800 | Smith et al. | Oct 2007 | A1 |
| 20070269785 | Yamanoi | Nov 2007 | A1 |
| 20080076972 | Dorogusker et al. | Mar 2008 | A1 |
| 20080090622 | Kim et al. | Apr 2008 | A1 |
| 20080102424 | Holljes | May 2008 | A1 |
| 20080146890 | LeBoeuf et al. | Jun 2008 | A1 |
| 20080187163 | Goldstein et al. | Aug 2008 | A1 |
| 20080215239 | Lee | Sep 2008 | A1 |
| 20080253583 | Goldstein et al. | Oct 2008 | A1 |
| 20080254780 | Kuhl et al. | Oct 2008 | A1 |
| 20080255430 | Alexandersson et al. | Oct 2008 | A1 |
| 20080298606 | Johnson et al. | Dec 2008 | A1 |
| 20090003620 | McKillop et al. | Jan 2009 | A1 |
| 20090008275 | Ferrari et al. | Jan 2009 | A1 |
| 20090017881 | Madrigal | Jan 2009 | A1 |
| 20090041313 | Brown | Feb 2009 | A1 |
| 20090073070 | Rofougaran | Mar 2009 | A1 |
| 20090097689 | Prest et al. | Apr 2009 | A1 |
| 20090105548 | Bart | Apr 2009 | A1 |
| 20090154739 | Zellner | Jun 2009 | A1 |
| 20090164212 | Chan | Jun 2009 | A1 |
| 20090182913 | Rosenblatt et al. | Jul 2009 | A1 |
| 20090191920 | Regen et al. | Jul 2009 | A1 |
| 20090226017 | Abolfathi et al. | Sep 2009 | A1 |
| 20090240947 | Goyal et al. | Sep 2009 | A1 |
| 20090245559 | Boltyenkov et al. | Oct 2009 | A1 |
| 20090261114 | McGuire et al. | Oct 2009 | A1 |
| 20090296968 | Wu et al. | Dec 2009 | A1 |
| 20090303073 | Gilling et al. | Dec 2009 | A1 |
| 20090304210 | Weisman | Dec 2009 | A1 |
| 20100007805 | Vitito | Jan 2010 | A1 |
| 20100033313 | Keady et al. | Feb 2010 | A1 |
| 20100075631 | Black et al. | Mar 2010 | A1 |
| 20100131269 | Park | May 2010 | A1 |
| 20100166206 | Macours | Jul 2010 | A1 |
| 20100203831 | Muth | Aug 2010 | A1 |
| 20100210212 | Sato | Aug 2010 | A1 |
| 20100290636 | Mao et al. | Nov 2010 | A1 |
| 20100320961 | Castillo et al. | Dec 2010 | A1 |
| 20110018731 | Linsky et al. | Jan 2011 | A1 |
| 20110103609 | Pelland et al. | May 2011 | A1 |
| 20110137141 | Razoumov et al. | Jun 2011 | A1 |
| 20110140844 | McGuire et al. | Jun 2011 | A1 |
| 20110239497 | McGuire et al. | Oct 2011 | A1 |
| 20110286615 | Olodort et al. | Nov 2011 | A1 |
| 20110293103 | Park | Dec 2011 | A1 |
| 20110293105 | Arie et al. | Dec 2011 | A1 |
| 20120057740 | Rosal | Mar 2012 | A1 |
| 20120155670 | Rutschman | Jun 2012 | A1 |
| 20120159617 | Wu et al. | Jun 2012 | A1 |
| 20120162891 | Tranchina et al. | Jun 2012 | A1 |
| 20120163626 | Booij et al. | Jun 2012 | A1 |
| 20120197737 | LeBoeuf et al. | Aug 2012 | A1 |
| 20120215519 | Park | Aug 2012 | A1 |
| 20120235883 | Border et al. | Sep 2012 | A1 |
| 20120309453 | Maguire | Dec 2012 | A1 |
| 20130106454 | Liu et al. | May 2013 | A1 |
| 20130154826 | Ratajczyk | Jun 2013 | A1 |
| 20130178967 | Mentz | Jul 2013 | A1 |
| 20130200999 | Spodak et al. | Aug 2013 | A1 |
| 20130204617 | Kuo et al. | Aug 2013 | A1 |
| 20130293494 | Reshef | Nov 2013 | A1 |
| 20130316642 | Newham | Nov 2013 | A1 |
| 20130346168 | Zhou et al. | Dec 2013 | A1 |
| 20140002357 | Pombo et al. | Jan 2014 | A1 |
| 20140004912 | Rajakarunanayake | Jan 2014 | A1 |
| 20140014697 | Schmierer et al. | Jan 2014 | A1 |
| 20140020089 | Perini, II | Jan 2014 | A1 |
| 20140072136 | Tenenbaum et al. | Mar 2014 | A1 |
| 20140072146 | Itkin et al. | Mar 2014 | A1 |
| 20140073429 | Meneses et al. | Mar 2014 | A1 |
| 20140079257 | Ruwe et al. | Mar 2014 | A1 |
| 20140106677 | Altman | Apr 2014 | A1 |
| 20140122116 | Smythe | May 2014 | A1 |
| 20140146973 | Liu et al. | May 2014 | A1 |
| 20140153768 | Hagen et al. | Jun 2014 | A1 |
| 20140163771 | Demeniuk | Jun 2014 | A1 |
| 20140185828 | Helbling | Jul 2014 | A1 |
| 20140219467 | Kurtz | Aug 2014 | A1 |
| 20140222462 | Shakil et al. | Aug 2014 | A1 |
| 20140235169 | Parkinson et al. | Aug 2014 | A1 |
| 20140237518 | Liu | Aug 2014 | A1 |
| 20140270227 | Swanson | Sep 2014 | A1 |
| 20140270271 | Dehe et al. | Sep 2014 | A1 |
| 20140276227 | Pérez | Sep 2014 | A1 |
| 20140279889 | Luna | Sep 2014 | A1 |
| 20140310595 | Acharya et al. | Oct 2014 | A1 |
| 20140321682 | Kofod-Hansen et al. | Oct 2014 | A1 |
| 20140335908 | Krisch et al. | Nov 2014 | A1 |
| 20140348367 | Vavrus et al. | Nov 2014 | A1 |
| 20150028996 | Agrafioti et al. | Jan 2015 | A1 |
| 20150035643 | Kursun | Feb 2015 | A1 |
| 20150036835 | Chen | Feb 2015 | A1 |
| 20150056584 | Boulware et al. | Feb 2015 | A1 |
| 20150110587 | Hori | Apr 2015 | A1 |
| 20150124058 | Okpeva et al. | May 2015 | A1 |
| 20150148989 | Cooper et al. | May 2015 | A1 |
| 20150181356 | Krystek et al. | Jun 2015 | A1 |
| 20150230022 | Sakai et al. | Aug 2015 | A1 |
| 20150243271 | Goldstein | Aug 2015 | A1 |
| 20150245127 | Shaffer | Aug 2015 | A1 |
| 20150256949 | Vanpoucke et al. | Sep 2015 | A1 |
| 20150264472 | Aase | Sep 2015 | A1 |
| 20150264501 | Hu et al. | Sep 2015 | A1 |
| 20150317565 | Li et al. | Nov 2015 | A1 |
| 20150358751 | Deng et al. | Dec 2015 | A1 |
| 20150359436 | Shim et al. | Dec 2015 | A1 |
| 20150364058 | Lagree et al. | Dec 2015 | A1 |
| 20150373467 | Gelter | Dec 2015 | A1 |
| 20150373474 | Kraft et al. | Dec 2015 | A1 |
| 20150379251 | Komaki | Dec 2015 | A1 |
| 20160029122 | Domingo Yaguez | Jan 2016 | A1 |
| 20160033280 | Moore et al. | Feb 2016 | A1 |
| 20160034249 | Lee et al. | Feb 2016 | A1 |
| 20160071526 | Wingate | Mar 2016 | A1 |
| 20160072558 | Hirsch et al. | Mar 2016 | A1 |
| 20160073189 | Lindén et al. | Mar 2016 | A1 |
| 20160094550 | Bradley et al. | Mar 2016 | A1 |
| 20160100262 | Inagaki | Apr 2016 | A1 |
| 20160119737 | Mehnert et al. | Apr 2016 | A1 |
| 20160124707 | Ermilov et al. | May 2016 | A1 |
| 20160125892 | Bowen et al. | May 2016 | A1 |
| 20160140870 | Connor | May 2016 | A1 |
| 20160142818 | Park | May 2016 | A1 |
| 20160162259 | Zhao et al. | Jun 2016 | A1 |
| 20160209691 | Yang et al. | Jul 2016 | A1 |
| 20160226713 | Dellinger et al. | Aug 2016 | A1 |
| 20160253994 | Panchapagesan et al. | Sep 2016 | A1 |
| 20160324478 | Goldstein | Nov 2016 | A1 |
| 20160353196 | Baker et al. | Dec 2016 | A1 |
| 20160360350 | Watson et al. | Dec 2016 | A1 |
| 20160381450 | Taite | Dec 2016 | A1 |
| 20170021257 | Gilbert et al. | Jan 2017 | A1 |
| 20170046503 | Cho et al. | Feb 2017 | A1 |
| 20170048609 | Schnell | Feb 2017 | A1 |
| 20170059152 | Hirsch et al. | Mar 2017 | A1 |
| 20170060262 | Hviid et al. | Mar 2017 | A1 |
| 20170060269 | Förstner et al. | Mar 2017 | A1 |
| 20170061751 | Loermann et al. | Mar 2017 | A1 |
| 20170061817 | Mettler May | Mar 2017 | A1 |
| 20170062913 | Hirsch et al. | Mar 2017 | A1 |
| 20170064426 | Hviid | Mar 2017 | A1 |
| 20170064428 | Hirsch | Mar 2017 | A1 |
| 20170064432 | Hviid et al. | Mar 2017 | A1 |
| 20170064437 | Hviid et al. | Mar 2017 | A1 |
| 20170078780 | Qian et al. | Mar 2017 | A1 |
| 20170078785 | Qian et al. | Mar 2017 | A1 |
| 20170096065 | Katsuno et al. | Apr 2017 | A1 |
| 20170100277 | Ke | Apr 2017 | A1 |
| 20170108918 | Boesen | Apr 2017 | A1 |
| 20170109131 | Boesen | Apr 2017 | A1 |
| 20170110124 | Boesen et al. | Apr 2017 | A1 |
| 20170110899 | Boesen | Apr 2017 | A1 |
| 20170111723 | Boesen | Apr 2017 | A1 |
| 20170111725 | Boesen et al. | Apr 2017 | A1 |
| 20170111726 | Martin et al. | Apr 2017 | A1 |
| 20170111740 | Hviid et al. | Apr 2017 | A1 |
| 20170127168 | Briggs et al. | May 2017 | A1 |
| 20170131094 | Kulik | May 2017 | A1 |
| 20170142511 | Dennis | May 2017 | A1 |
| 20170146801 | Stempora | May 2017 | A1 |
| 20170150920 | Chang et al. | Jun 2017 | A1 |
| 20170151085 | Chang et al. | Jun 2017 | A1 |
| 20170151447 | Boesen | Jun 2017 | A1 |
| 20170151668 | Boesen | Jun 2017 | A1 |
| 20170151918 | Boesen | Jun 2017 | A1 |
| 20170151930 | Boesen | Jun 2017 | A1 |
| 20170151957 | Boesen | Jun 2017 | A1 |
| 20170151959 | Boesen | Jun 2017 | A1 |
| 20170153114 | Boesen | Jun 2017 | A1 |
| 20170153636 | Boesen | Jun 2017 | A1 |
| 20170154532 | Boesen | Jun 2017 | A1 |
| 20170155985 | Boesen | Jun 2017 | A1 |
| 20170155992 | Perianu et al. | Jun 2017 | A1 |
| 20170155993 | Boesen | Jun 2017 | A1 |
| 20170155997 | Boesen | Jun 2017 | A1 |
| 20170155998 | Boesen | Jun 2017 | A1 |
| 20170156000 | Boesen | Jun 2017 | A1 |
| 20170164890 | Leip et al. | Jun 2017 | A1 |
| 20170178631 | Boesen | Jun 2017 | A1 |
| 20170180842 | Boesen | Jun 2017 | A1 |
| 20170180843 | Perianu et al. | Jun 2017 | A1 |
| 20170180897 | Perianu | Jun 2017 | A1 |
| 20170188127 | Perianu et al. | Jun 2017 | A1 |
| 20170188132 | Hirsch et al. | Jun 2017 | A1 |
| 20170193975 | Butts | Jul 2017 | A1 |
| 20170193978 | Goldman | Jul 2017 | A1 |
| 20170194021 | Butts | Jul 2017 | A1 |
| 20170195829 | Belverato et al. | Jul 2017 | A1 |
| 20170208393 | Boesen | Jul 2017 | A1 |
| 20170214987 | Boesen | Jul 2017 | A1 |
| 20170215016 | Dohmen et al. | Jul 2017 | A1 |
| 20170230752 | Dohmen et al. | Aug 2017 | A1 |
| 20170248955 | Banvait | Aug 2017 | A1 |
| 20170251295 | Pergament et al. | Aug 2017 | A1 |
| 20170251933 | Braun et al. | Sep 2017 | A1 |
| 20170257698 | Boesen et al. | Sep 2017 | A1 |
| 20170258329 | Marsh | Sep 2017 | A1 |
| 20170263236 | Boesen et al. | Sep 2017 | A1 |
| 20170263376 | Verschueren et al. | Sep 2017 | A1 |
| 20170266494 | Crankson et al. | Sep 2017 | A1 |
| 20170273622 | Boesen | Sep 2017 | A1 |
| 20170280257 | Gordon et al. | Sep 2017 | A1 |
| 20170297430 | Hori et al. | Oct 2017 | A1 |
| 20170301337 | Golani et al. | Oct 2017 | A1 |
| 20170361213 | Goslin et al. | Dec 2017 | A1 |
| 20170366233 | Hviid et al. | Dec 2017 | A1 |
| 20180007994 | Boesen et al. | Jan 2018 | A1 |
| 20180008194 | Boesen | Jan 2018 | A1 |
| 20180008198 | Kingscott | Jan 2018 | A1 |
| 20180009447 | Boesen et al. | Jan 2018 | A1 |
| 20180011006 | Kingscott | Jan 2018 | A1 |
| 20180011682 | Milevski et al. | Jan 2018 | A1 |
| 20180011994 | Boesen | Jan 2018 | A1 |
| 20180012228 | Milevski et al. | Jan 2018 | A1 |
| 20180013195 | Hviid et al. | Jan 2018 | A1 |
| 20180014102 | Hirsch et al. | Jan 2018 | A1 |
| 20180014103 | Martin et al. | Jan 2018 | A1 |
| 20180014104 | Boesen et al. | Jan 2018 | A1 |
| 20180014107 | Razouane et al. | Jan 2018 | A1 |
| 20180014108 | Dragicevic et al. | Jan 2018 | A1 |
| 20180014109 | Boesen | Jan 2018 | A1 |
| 20180014113 | Boesen | Jan 2018 | A1 |
| 20180014140 | Milevski et al. | Jan 2018 | A1 |
| 20180014436 | Milevski | Jan 2018 | A1 |
| 20180034951 | Boesen | Feb 2018 | A1 |
| 20180040093 | Boesen | Feb 2018 | A1 |
| 20180042501 | Adi et al. | Feb 2018 | A1 |
| 20180056903 | Mullett | Mar 2018 | A1 |
| 20180063626 | Pong et al. | Mar 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| 204244472 | Apr 2015 | CN |
| 104683519 | Jun 2015 | CN |
| 104837094 | Aug 2015 | CN |
| 1469659 | Oct 2004 | EP |
| 1017252 | May 2006 | EP |
| 2903186 | Aug 2015 | EP |
| 2074817 | Apr 1981 | GB |
| 2508226 | May 2014 | GB |
| 06292195 | Oct 1998 | JP |
| 2008103925 | Aug 2008 | WO |
| 2008113053 | Sep 2008 | WO |
| 2007034371 | Nov 2008 | WO |
| 2011001433 | Jan 2011 | WO |
| 2012071127 | May 2012 | WO |
| 2013134956 | Sep 2013 | WO |
| 2014046602 | Mar 2014 | WO |
| 2014043179 | Jul 2014 | WO |
| 2015061633 | Apr 2015 | WO |
| 2015110577 | Jul 2015 | WO |
| 2015110587 | Jul 2015 | WO |
| 2016032990 | Mar 2016 | WO |
| 2016187869 | Dec 2016 | WO |
| Entry |
|---|
| Stretchgoal—The Carrying Case for the Dash (Feb. 12, 2014). |
| Stretchgoal—Windows Phone Support (Feb. 17, 2014). |
| The Dash + The Charging Case & The BRAGI News (Feb. 21, 2014). |
| The Dash—A Word From Our Software, Mechanical and Acoustics Team + An Update (Mar. 11, 2014). |
| Update From BRAGI—$3,000,000—Yipee (Mar. 22, 2014). |
| Weisiger; “Conjugated Hyperbilirubinemia”, Jan. 5, 2016. |
| Wertzner et al., “Analysis of fundamental frequency, jitter, shimmer and vocal intensity in children with phonological disorders”, V. 71, n.5, 582-588, Sep./Oct. 2005; Brazilian Journal of Othrhinolaryngology. |
| Wikipedia, “Gamebook”, https://en.wikipedia.org/wiki/Gamebook, Sep. 3, 2017, 5 pages. |
| Wikipedia, “Kinect”, “https://en.wikipedia.org/wiki/Kinect”, 18 pages, (Sep. 9, 2017). |
| Wikipedia, “Wii Balance Board”, “https://en.wikipedia.org/wiki/Wii_Balance_Board”, 3 pages, (Jul. 20, 2017). |
| Akkermans, “Acoustic Ear Recognition for Person Identification”, Automatic Identification Advanced Technologies, 2005 pp. 219-223. |
| Alzahrani et al: “A Multi-Channel Opto-Electronic Sensor to Accurately Monitor Heart Rate against Motion Artefact during Exercise”, Sensors, vol. 15, No. 10, Oct. 12, 2015, pp. 25681-25702, XPO55334602, DOI: 10.3390/s151025681 the whole document. |
| Announcing the $3,333,333 Stretch Goal (Feb. 24, 2014). |
| Ben Coxworth: “Graphene-based ink could enable low-cost, foldable electronics”, “Journal of Physical Chemistry Letters”, Northwestern University, (May 22, 2013). |
| Blain: “World's first graphene speaker already superior to Sennheiser MX400”, htt://www.gizmag.com/graphene-speaker-beats-sennheiser-mx400/31660, (Apr. 15, 2014). |
| BMW, “BMW introduces BMW Connected—The personalized digital assistant”, “http://bmwblog.com/2016/01/05/bmw-introduces-bmw-connected-the-personalized-digital-assistant”, (Jan. 5, 2016). |
| BRAGI is on Facebook (2014). |
| BRAGI Update—Arrival of Prototype Chassis Parts—More People—Awesomeness (May 13, 2014). |
| BRAGI Update—Chinese New Year, Design Verification, Charging Case, More People, Timeline(Mar. 6, 2015). |
| BRAGI Update—First Sleeves From Prototype Tool—Software Development Kit (Jun. 5, 2014). |
| BRAGI Update—Lets Get Ready to Rumble, A Lot to Be Done Over Christmas (Dec. 22, 2014). |
| BRAGI Update—Memories From April—Update on Progress (Sep. 16, 2014). |
| BRAGI Update—Memories from May—Update on Progress—Sweet (Oct. 13, 2014). |
| BRAGI Update—Memories From One Month Before Kickstarter—Update on Progress (Jul. 10, 2014). |
| BRAGI Update—Memories From the First Month of Kickstarter—Update on Progress (Aug. 1, 2014). |
| BRAGI Update—Memories From the Second Month of Kickstarter—Update on Progress (Aug. 22, 2014). |
| BRAGI Update—New People @BRAGI—Prototypes (Jun. 26, 2014). |
| BRAGI Update—Office Tour, Tour to China, Tour to CES (Dec. 11, 2014). |
| BRAGI Update—Status on Wireless, Bits and Pieces, Testing-Oh Yeah, Timeline(Apr. 24, 2015). |
| BRAGI Update—The App Preview, The Charger, The SDK, BRAGI Funding and Chinese New Year (Feb. 11, 2015). |
| BRAGI Update—What We Did Over Christmas, Las Vegas & CES (Jan. 19, 2014). |
| BRAGI Update—Years of Development, Moments of Utter Joy and Finishing What We Started(Jun. 5, 2015). |
| BRAGI Update—Alpha 5 and Back to China, Backer Day, on Track(May 16, 2015). |
| BRAGI Update—Beta2 Production and Factory Line(Aug. 20, 2015). |
| BRAGI Update—Certifications, Production, Ramping Up (Nov. 13, 2015). |
| BRAGI Update—Developer Units Shipping and Status(Oct. 5, 2015). |
| BRAGI Update—Developer Units Started Shipping and Status (Oct. 19, 2015). |
| BRAGI Update—Developer Units, Investment, Story and Status(Nov. 2, 2015). |
| BRAGI Update—Getting Close(Aug. 6, 2015). |
| BRAGI Update—On Track, Design Verification, How It Works and What's Next(Jul. 15, 2015). |
| BRAGI Update—On Track, On Track and Gems Overview (Jun. 24, 2015). |
| BRAGI Update—Status on Wireless, Supply, Timeline and Open House@BRAGI(Apr. 1, 2015). |
| BRAGI Update—Unpacking Video, Reviews on Audio Perform and Boy Are We Getting Close(Sep. 10, 2015). |
| Healthcare Risk Management Review, “Nuance updates computer-assisted physician documentation solution” (Oct. 20, 2016). |
| Hoffman, “How to Use Android Beam to Wirelessly Transfer Content Between Devices”, (Feb. 22, 2013). |
| Hoyt et. al., “Lessons Learned from Implementation of Voice Recognition for Documentation in the Military Electronic Health Record System”, The American Health Information Management Association (2017). |
| Hyundai Motor America, “Hyundai Motor Company Introduces a Health + Mobility Concept for Wellness in Mobility”, Fountain Valley, Californa (2017). |
| International Search Report & Written Opinion, PCT/EP16/70245 (dated Nov. 16, 2016). |
| International Search Report & Written Opinion, PCT/EP2016/070231 (dated Nov. 18, 2016). |
| International Search Report & Written Opinion, PCT/EP2016/070247 (dated Nov. 18, 2016). |
| International Search Report & Written Opinion, PCT/EP2016/07216 (dated Oct. 18, 2016). |
| International Search Report and Written Opinion, PCT/EP2016/070228 (dated Jan. 9, 2017). |
| Jain A et al: “Score normalization in multimodal biometric systems”, Pattern Recognition, Elsevier, GB, vol. 38, No. 12, Dec. 31, 2005, pp. 2270-2285, XP027610849, ISSN: 0031-3203. |
| Last Push Before the Kickstarter Campaign Ends on Monday 4pm CET (Mar. 28, 2014). |
| Lovejoy: “Touch ID built into iPhone display one step closer as third-party company announces new tech”, “http://9to5mac.com/2015/07/21/virtualhomebutton/” (Jul. 21, 2015). |
| Nemanja Paunovic et al, “A methodology for testing complex professional electronic systems”, Serbian Journal of Electrical Engineering, vol. 9, No. 1, Feb. 1, 2012, pp. 71-80, XP055317584, Yu. |
| Nigel Whitfield: “Fake tape detectors, ‘from the stands’ footie and UGH? Internet of Things in my set-top box”; http://www.theregister.co.uk/2014/09/24/ibc_round_up_object_audio_dlna_iot/ (Sep. 24, 2014). |
| Nuance, “ING Netherlands Launches Voice Biometrics Payment System in the Mobile Banking App Powered by Nuance”, “https://www.nuance.com/about-us/newsroom/press-releases/ing-netherlands-launches-nuance-voice-biometirics.html”, 4 pages (Jul. 28, 2015). |
| Staab, Wayne J., et al., “A One-Size Disposable Hearing Aid is Introduced”, The Hearing Journal 53(4):36-41) Apr. 2000. |
| Stretchgoal—Its Your Dash (Feb. 14, 2014). |
| Number | Date | Country | |
|---|---|---|---|
| 20180359554 A1 | Dec 2018 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62358792 | Jul 2016 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15635839 | Jun 2017 | US |
| Child | 16044318 | US |
