Patent Application
20220238091
The present invention relates in general to the field of information handling system audible information presentation, and more particularly to an information handling system selective noise cancellation.
As the value and use of information continues to increase, individuals and businesses seek additional ways to process and store information. One option available to users is information handling systems. An information handling system generally processes, compiles, stores, and/or communicates information or data for business, personal, or other purposes thereby allowing users to take advantage of the value of the information. Because technology and information handling needs and requirements vary between different users or applications, information handling systems may also vary regarding what information is handled, how the information is handled, how much information is processed, stored, or communicated, and how quickly and efficiently the information may be processed, stored, or communicated. The variations in information handling systems allow for information handling systems to be general or configured for a specific user or specific use such as financial transaction processing, airline reservations, enterprise data storage, or global communications. In addition, information handling systems may include a variety of hardware and software components that may be configured to process, store, and communicate information and may include one or more computer systems, data storage systems, and networking systems.
Information handling systems often present audio information at speakers, both in cooperation with visual information and as a separate output. For instance, audio information often accompanies visual information in applications like movie players, videoconferencing, and gaming. In some instances, audio information is presented without visual images, such as music players and audio conferences. Contemporary information handling systems generally have sufficient processing capability to simultaneously play music and perform complex computational tasks. End users will often work with entertainment applications playing in the background, such as music, to drown out background noise distractions. This practice has likely grown more common as an increasing number of employees have begun working from home, where distractions from children, pets, neighbors and life generally can make concentration on work tasks more difficult.
One option available to reduce the impact of background noise on work productivity is to use headphones that include active noise cancellation. Active noise cancellation seeks to eliminate background noise by generating sounds at the headphone that are out of phase background noise. As an example, a microphone captures the background hum of a home heater or air conditioner and includes sounds output at the headphones that have an inverse pressure of the background sounds, effectively cancelling the background sounds. Active noise cancellation works particularly well with low frequency and consistent background noise that low power processors can adapt to manage, such as airplane noise or car noise. In a videoconference application, noise cancellation may be used to also cancel noise captured by a microphone before audible sounds are sent through a network to other participants and to cancel background noise capture at other nodes of the videoconference. Active noise cancellation has more difficulty with irregular and high pitch sounds, such as a doorbell ringing, a dog barking or a baby crying. Effective cancellation of these types of noises take more processing power and audio models directed towards the specific noise of interest. As such active noise cancellation headphones have improved, end users have benefited by reduced distractions and improved ability to concentrate so that many ordinary household sounds have become indiscernible once the end user places the headphones over her ears.
Therefore, a need has arisen for a system and method which selectively applies noise cancellation for an end user based upon end user context and preferences.
In accordance with the present invention, a system and method are provided which substantially reduce the disadvantages and problems associated with previous methods and systems for managing active noise cancellation. Noise cancellation is selectively applied for detected environmental noise based upon a context at an information handling system, such as applications executing on the information handling system and end user preferences stored based upon a type of detected environmental noise.
More specifically, a noise cancellation engine generates audible noise to play in headphone speakers that cancel out sound waves of environmental noise. For example, a machine learning derived model associated with plural types of noise is selectively applied or not applied when associated noise is detected based upon a context at the information handling system. An end user provides preferences for whether or not to apply noise cancellation so that the end user can balance a desire for quiet to concentrate, such as when performing a work task, with a need to monitor environmental conditions, such as when in a home environment where a child can get hurt or a visitor may come to the door. End users are provided with a notice of noise types when first detected or when detected at a low threshold of confidence so that the end user can provide a confirmation of how to manage noise cancellation related to the noise in different contexts. Noise cancellation data is stored for analysis to help more efficiently target different noise types and then applied to the headphone speakers as indicated by the end user's configuration preferences. Visual or audible alerts of detected noise may be provide to the end user when noise cancellation is enforced for a type of noise.
The present invention provides a number of important technical advantages. One example of an important technical advantage is that an end user has noise cancellation selectively applied in a manner that enhances the mixed demands of a work-from-home situation. Noise cancellation is provided based upon multiple factors derived as a combination of the user's environment, such as noise of a baby crying, a dog barking, a doorbell ringing, etc . . . , and data from the system, such as applications executing, interactions associated with work or personal matters, end user presentation to others at the system, the system on mute and the system volume setting. The data and noise cancellation types are monitored to selectively apply noise cancelling for different types of noise based upon context, such as with a Recurrent Neural Network (RNN) that provides noise cancellation when the type of noise and context indicate a minimum confidence. A self-improving machine learning model applies the end user's preference and stored conditions to improve the noise cancellation application over time, such as by setting a threshold associated with the confidence that detected noise and context fall in a particular state that calls for noise cancellation by the model.
The present invention may be better understood, and its numerous objects, features and advantages made apparent to those skilled in the art by referencing the accompanying drawings. The use of the same reference number throughout the several figures designates a like or similar element.
Noise cancellation of various background noise is selectively enabled and disabled at an information handling system based upon context. For purposes of this disclosure, an information handling system may include any instrumentality or aggregate of instrumentalities operable to compute, classify, process, transmit, receive, retrieve, originate, switch, store, display, manifest, detect, record, reproduce, handle, or utilize any form of information, intelligence, or data for business, scientific, control, or other purposes. For example, an information handling system may be a personal computer, a network storage device, or any other suitable device and may vary in size, shape, performance, functionality, and price. The information handling system may include random access memory (RAM), one or more processing resources such as a central processing unit (CPU) or hardware or software control logic, ROM, and/or other types of nonvolatile memory. Additional components of the information handling system may include one or more disk drives, one or more network ports for communicating with external devices as well as various input and output (I/O) devices, such as a keyboard, a mouse, and a video display. The information handling system may also include one or more buses operable to transmit communications between the various hardware components.
Referring now to
In a typical workday, end users interact with information handling system 10 through a variety of different applications that perform a variety of different functions, each of which call for varying degrees and types of concentration from the end user. For example, an engineer may run a computer aided design (CAD) application or software design editor to perform a primary job duty of designing mechanical or software components. While performing these types of functions, the end user typically desires quiet for concentration to perform tasks that call for deep thought. Throughout the workday, the end user may also meet with members of her design team through a videoconference that presents the team and shared data at display 26 and supports conversations through headphone speakers 30. At other times during the workday, the end user may perform more mundane daily tasks, such as reading emails and performing administrative tasks. In addition to such work related interactions, end users may also interact with the information handling system through applications that provide non-work functions including entertainment. For instance, an end user may browse the Internet with a web browser or execute an audiovisual player application to watch a movie. Some end users find it helpful to concentration to listen to music while performing work tasks. In particular, as is described in greater detail below, end users often use noise cancellation headphone speakers 30 during work tasks to play audio of quiet music while blocking background noise that can distract the end user. Conventional noise cancellation, however, can block out background noises in a work-from-home environment that an end user may need to hear, such as a baby crying that needs attention, a doorbell or dog barking that indicates a home visitor or other common home background noises.
To help manage noise cancellation in the work-from-home environment, a noise cancellation engine 34 selectively enables and disables noise cancellation based upon a context at the information handling system. For example, noise cancellation engine 34 generates out of phase audio information that creates sounds at speaker headphones 30 to cancel background noise as the background noise is sensed at microphone 28. For instance, microphone 28 captures environmental noise and provides the environmental noise to noise cancellation engine 34. Noise cancellation engine 34 references user data 36 to determine types of noise cancellation for application to cancel environmental noise based upon context determined from end user preferences and other information, such as system location and time of day. In one example embodiment, noise cancellation engine executes a noise cancellation model developed with a Recurrent Neural Network (RNN) that selectively cancels different types of environmental noise, such as a baby crying or dog barking, and generates cancellation noises to play in headphone speakers 30 that cancels out the associated background noise. If the context indicates that noise cancellation should be applied, noise cancellation engine 34 generates the cancelling noise output for presentation at headphone speakers 30. If the context indicates that noise cancellation is not desired, noise cancellation engine 34 does not apply noised cancellation for that background environmental noise. Although the particular noise cancellation may not be applied, other background noises may be cancelled based upon the context and user preferences. For instance, noise cancellation engine 34 might cancel out a doorbell while ignoring background environmental noise that matches a baby crying.
Whether or not a particular background noise is cancelled, the background noise and context may be provided to a noise artificial intelligence or machine learning engine 32, which evaluates the data to improve recognition and cancellation of noise by noise cancellation engine 34. In various embodiments, noise cancellation engine 34 may be supported across various hardware elements. For example, noise cancellation engine 34 may distribute executables to processing elements located in headphone speakers 30 so that noise cancellation is applied in a rapid manner when background noise is picked up microphones 28 integrated with headphone speakers 30. A user interface manager of noise cancellation engine 34 then selectively activates and deactivates selected of plural noise cancellation types executing on processing elements of headphone speakers 30 with commands communicated through audio chipset 24 and WNIC 20. For example, operating system drivers may be used to manage selection and de-selection of noise cancellation on headphone speaker processing resources as noise cancellation engine 34 detects changes in context. Generally, logic of the noise cancellation engine listens to environmental noise and monitors context at the system to determine for detected background noise whether or not to generate noise cancellation with degree of confidence. If cancellation is determined within a defined threshold, such as 80%, noise cancellation is generated at the headphone speakers. If cancellation is determined with less than the threshold, an inquiry to an end user may be made to help define if noise cancellation should take place and thereby train the noise cancellation model.
In the example embodiment, noise cancellation engine 34 presents a configuration user interface 38 that aids end user inputs to define context for selective application and removal of application of noise cancellation. For instance, when noise cancellation engine 34 detects a noise pattern associated with a particular background noise, such as a baby crying, that is not in user data 36, noise cancellation engine 34 presents configuration user interface 38 to accept end user inputs regarding the preferred manner for managing the background noise. In the example user interface, the end user is provided with a list of detected background noises and an opportunity to configure how noise cancellation is applied for each type of background noise. For example, the end user may select non-cancellation of dog barking while cancelling baby crying or vice versa. For each type of background noise, the end user may select specific contexts in which to apply and not apply noise cancellation. For instance, when a videoconference application is active on the system, the user may accept background noise from a baby crying so that the user can respond to the baby while cancelling noise from a dog barking so that the videoconference is not interrupted. The end user may also set other context, such as cancellation preferences based upon time of day, location, and/or other types of applications executing on the system, like audiovisual player applications that play entertainment versus work content, web browsing applications, email applications, CAD applications or other types of applications. In the example embodiment, an end user is also provided with an opportunity to select alternative alerts, such as an audible alert or a visual alert. For instance, if a noise type, like a baby crying, has noise cancellation active, the end user may elect to receive a visual alert, such as at the display, or an audio alert, such as a spoken voice or a tone, to let the end user know that the cancelled noise is detected. In some instances, the end user may elect to have such alerts posted for non-cancelled noise so that a muffled noise that may be difficult to detect under earphones will be temporarily highlighted.
Noise cancellation configuration user interface 38 may come up to display 26 automatically when a new background noise type is detected so that the end user can provide a preference for managing the new type of noise. Alternatively, an end user may activate configuration user interface 38 at any time to adjust user data 36 for a desired noise cancellation response. In another embodiment, the presentation of noise cancellation configuration user interface may be based upon a confidence that a detected background noise falls within a type of noise modeled for cancellation. For instance, if a dog barking is detected with a very low confidence of below a threshold, the end user may be asked to confirm that type of noise is of interest for cancellation. As another example, if the dog barking type of noise is detected with a high confidence of above a threshold but for a first incidence, the end user may be asked to confirm that the noise is one that the end user has an interest in cancelling. In some instances, all background noises are selectively canceled when threshold confidence is met, whether or not the type of noise is recognized.
Referring now to
Referring now to
Referring now to
Although the present invention has been described in detail, it should be understood that various changes, substitutions and alterations can be made hereto without departing from the spirit and scope of the invention as defined by the appended claims.
