Patent Application
20150365743
This disclosure is related to producing sounds corresponding to an exterior of a source vehicle through an interior audio system.
The statements in this section merely provide background information related to the present disclosure. Accordingly, such statements are not intended to constitute an admission of prior art.
Occupants located within an internal cabin, e.g., passenger compartment, of a vehicle can listen to internal sounds, such as music, navigational instructions, and telephone communications, produced by an audio system of the vehicle. Internal sounds can further include conversations between occupants of the vehicle, roadway noises from passing vehicles, roadway infrastructure, weather, etc. However, these latter sounds and noises are shut-out from penetrating into the internal cabin and from being heard by the occupants of the vehicle due to closed windows and the internal sounds of the vehicle. Additionally, vehicles are often designed with the objective of isolating sounds exterior to the vehicle from the internal cabin.
While restricting sounds from the external environment of the vehicle reduces the chance of annoying (or overloading) occupants of the vehicle, restricting too much sound from the external environment can result in a driver of the vehicle not being aware of certain situations or occurrences that the driver desires to be aware of. For example, it would be desirable for the driver to hear a motorcycle travelling in a blind spot of the vehicle so that the driver does not collide with the motorcycle when making a lane change. Sound capturing devices, such as microphones, can be utilized for capturing sounds within the internal cabin of the vehicle. Further, sounds captured by sound capturing devices that are faint, or at an otherwise low level of loudness, can be amplified.
A method for producing sounds corresponding to an exterior of a source vehicle through an audio system corresponding to an interior of the source vehicle includes receiving an input audio signal corresponding to an undefined sound originating from a source within an external environment of the source vehicle and determining the undefined sound to be indicative of a specific external sound to be produced at a desired loudness by one or more output sound devices located within an internal cabin of the source vehicle. An output audio signal is generated based upon the input audio signal and a desired loudness for the specific external sound to be produced. The output audio signal is transmitted to the one or more output sound devices located within an internal cabin of the source vehicle to produce the specific external sound mixed in combination with internal sound that originates from one or more infotainment sources.
One or more embodiments will now be described, by way of example, with reference to the accompanying drawings, in which:
Referring now to the drawings, wherein the showings are for the purpose of illustrating certain exemplary embodiments only and not for the purpose of limiting the same,
The sound capturing device 150 captures an undefined sound originating from a source within the external environment of the source vehicle and converts the undefined sound to an input audio signal that is ultimately received by the ASCM 170. As used herein, the term “sound capturing device” refers to an acoustic-to-electric transducer or sensor, such as a microphone, that converts sound in air to an electrical signal (e.g., input audio signal). The sound capturing device 150 is not limited to any one specific device capable of capturing sounds within the external environment. In some implementations, the sound capturing device 150 is positioned on the exterior of the source vehicle 100. In other implementations, the sound capturing device 150 advantageously corresponds to an existing sound capturing device that is positioned within the internal cabin for receiving speech inputs by the user of the vehicle. Speech inputs can be received for communicating with the HMI device 160, such as speaking over a telephone and commanding a desired functionality of one or more infotainment sources of the source vehicle 100. This disclosure is not limited to a single sound capturing device 150, and may include multiple sound capturing devices 150 positioned in any combination for capturing undefined sounds within the external environment of the source vehicle 100. The amplifier 155 can be utilized to amplify the input audio signal. In some implementations, the amplifier 155 may be configured to amplify input audio signals corresponding to undefined sounds originating from a source in a specified direction within the external environment.
The ASCM 170 generates an output audio signal corresponding to a specific external sound if the input audio signal received from the sound capturing device 150 is determined to be indicative of the specific external sound. Discussed in greater detail with reference to the non-limiting example illustrated in
The ASCM 170 may receive inputs from one or more of an object detection device (camera device 120 and/or range device 125), GPS device 140, wireless communication device 150, and vehicle operation sensors for (1) detecting an object indicating a classified source within the external environment of the source vehicle at which an undefined sound is originated from, and (2) determining a position of the detected object in relation to the source vehicle 100. The camera device 120 includes a camera or image capturing device taking periodic or sequential images representing a view from the vehicle. The range device 125 includes a device to detect other vehicles or objects located near the source vehicle 100. The range device 125 can be used to determine a range from the source vehicle 100 to a detected object. The range device 125 may include a radar device, lidar device, or combination thereof. The camera device 120 and range device 125 can be referred to as an object detection device, and may be used together or separately, to detect, track and/or determine a range to an object of interest. A number of known in-vehicle sensors are widely used within a vehicle to monitor vehicle speed, engine speed, wheel slip, and other parameters that indicate the operation of the vehicle. Vehicle speed sensor 130 corresponds to one such in-vehicle sensor, but the scope of the disclosure includes any such sensors for use by the ASCM 170. GPS and wireless communication devices 140, 150, respectively, communicate with resources outside of the vehicle, for example, satellite system 195 and cellular communications tower 190. GPS device 140 may be utilized in conjunction with a 3D map database including detailed information indicating a global coordinate received by the GPS device 140 regarding the current location/position of the source vehicle. The wireless communication device 145 may be utilized for vehicle to vehicle communication, and in some implementations, the wireless communication device 145 can be utilized to update databases associated with the ASCM 170.
Control module, module, control, controller, control unit, processor and similar terms mean any one or various combinations of one or more of Application Specific Integrated Circuit(s) (ASIC), electronic circuit(s), central processing unit(s) (preferably microprocessor(s)) and associated memory and storage (read only, programmable read only, random access, hard drive, etc.) executing one or more software or firmware programs or routines, combinational logic circuit(s), input/output circuit(s) and devices, appropriate signal conditioning and buffer circuitry, and other components to provide the described functionality. Software, firmware, programs, instructions, routines, code, algorithms and similar terms mean any instruction sets including calibrations and look-up tables. The control module has a set of control routines executed to provide the desired functions. Routines are executed, such as by a central processing unit, and are operable to monitor inputs from sensing devices and other networked control modules, and execute control and diagnostic routines to control operation of actuators. Routines may be executed at regular intervals, for example each 100 microseconds, 3.125, 6.25, 12.5, 25 and 100 milliseconds during ongoing engine and vehicle operation. Alternatively, routines may be executed in response to occurrence of an event.
A second zone 250 corresponds to the external environment of the source vehicle. The term “external sounds” refer to sounds originating from the external environment that are indicative of sounds that occupants of the source vehicle would hear if the occupants were outside of the source vehicle instead of being located within the internal cabin. These external sounds may originate from a plurality of non-inclusive sources within the external environment, including, but not limited to, a motorcycle 252, announcements 254, music 256, other vehicles 258, sirens of emergency vehicles 260, school buses 262, collisions 264 and trains 266. Generally, external sounds are restricted from being heard by the user due to closed windows and internal sounds such as conversations and audio produced by the internal audio system. However, external sounds can beneficially provide the user of the vehicle with information about the immediate external environment. Too much external sound entering the vehicle can be annoying and overloading to occupants of the vehicle whereas too much external sound restricted from entering the vehicle can result in a user being unaware of information that may be pertinent. Exemplary implementations herein are directed toward only providing specific external sounds within the internal cabin of the source vehicle in a manner that provides pertinent information about the immediate external environment while restricting information from the immediate external environment that is not pertinent.
When pressed, an internal sound button 302 receives the user input indicating a desired loudness for a specific external sound to be produced within the internal cabin by the internal audio system. The ASCM 170 of
When pressed, an internal sound button 304 receives the user input indicating a desired loudness for internal sound to be produced within the internal cabin by the internal audio system. As used herein, the term “internal sound” refers to sounds originating from one or more infotainment sources of the source vehicle. The ASCM 170 of
Referring now to
The processing device 400 executes an external sound module 410 and an audible alert module 412. The external sound module 410 receives the input audio signal from the sound capturing device 150 of
In some implementations, the external sound module 410 determines the input audio signal indicates the specific external sound by comparing the input audio signal to a plurality of prospective audio signals stored within an audio signal database at the ASCM 170. Here, each prospective audio signal corresponds to a different prospective external sound selected to be produced through the internal audio system. For instance, the user may utilize the HMI device 160 to select predetermined prospective audio signals that the user deems as important, or otherwise interested in hearing. Likewise, the manufacturer of the source vehicle may select predetermined prospective audio signals. Additionally, the prospective audio signals stored within the audio signal database may be learned by a training set of audio signals that occur regularly and then selected by the user for storage within the audio signal database. Thereafter, the external sound module 410 may determine the undefined sound to be indicative of the specific external sound when the input audio signal matches one of the prospective audio signals. If the input audio signal does not match one of the prospective audio signals, the specific external sound will not be indicated or produced through the internal audio system. As a result, non-pertinent external sounds are filtered out from being produced through the internal audio system. The audio signal database may be maintained by the user of the source vehicle 100 or a manufacturer of the source vehicle. Prospective audio signals can be added to the audio signal database via downloading or data conversion.
In some implementations, the external sound module 410 determines the input audio signal indicates the specific external sound by obtaining a classification of the source at which the undefined sound is originated from using the input audio signal. Here, the prospective audio signals may each be assigned a respective classification stored within the audio signal database and retrieved by the input audio signal to obtain the classification of the source. In other words, the specific external sound to be produced can be selected by the user by identifying the specific classification of the source that originates the specific external sound. Thereafter, the object detection device (e.g., camera device 120 and range device 125) detects an object indicating the classified source within the external environment. For instance, audio signals corresponding to warning sirens may be associated with a classified source such as an ambulance whereat the object detection device attempts to detect an object or feature indicative of the ambulance. Additionally or alternatively, the wireless communications device 145 can be utilized to detect the object indicating the classified source based upon vehicle-to-vehicle communication. For instance, the source vehicle 100 can receive a notification from the ambulance en route to an accident indicating that the sirens are on and/or geometric coordinates of the ambulance. The position of the source vehicle can be obtained using the GPS device 140 and vehicle operational sensors as described above with reference to
In some implementations, the classification of the source at which the undefined sound is originated from can further be obtained from the audio signal database using the input audio signal for determining the desired loudness for the specific external sound. Some specific external sounds may be more important or urgent than others, requiring the user's prompt attention. For instance, and in a non-limiting example, a collision in an adjacent lane of the source vehicle can be deemed more urgent than a motorcycle travelling in the adjacent lane of the source vehicle. Accordingly, specific external sounds can be weighted based upon the classification of the source at which the undefined sound originates. Here, the classified source obtained from the audio signal database can be used to retrieve a source-dependent weighted factor from a weighting factor database. The weighting factor database can include a plurality of source-dependent weighted factors ranging from low importance to high importance whereat each factor is associated with—and assigned to—one or more sources. In some implementations, the audio signal database can further assign each classification the source-dependent weighted factor. Accordingly, the desired loudness for the specific external sound can be determined based upon the retrieved source-dependent weighted factor. In the non-limiting example, the collision in the adjacent lane can include a high source-dependent weighted factor resulting in a higher magnitude of desired loudness than that of the motorcycle traveling in the adjacent lane.
The external sound module 410 generates an output audio signal based on the input audio signal and the desired loudness for the specific external sound to be produced when the input audio signal indicates the specific external sound. Thereafter, the generated output audio signal is transmitted to the at least one output sound device 180-1 and/or 180-2 located within the internal cabin of the source vehicle. While the non-limiting illustrated example of
In some implementations, the transmitted output audio signal to at least one output sound device 180-1 and 180-2 is partitioned by the external sound module 410 such that the specific external sound is produced from a direction that conveys a position of the source from which the specific external sound originated from in relation to the source vehicle. For instance, when the specific external sound is indicative of warning sirens originating from an emergency response vehicle, the warning sirens can be partitioned through the internal audio system of the source vehicle such that a portion of the specific external sound (e.g., sirens) is produced by a rear-left side output sound device in the internal cabin of the source vehicle and a remaining portion of the specific external sound is produced by a rear-right side output sound device when the emergency response vehicle includes a position that is behind the source vehicle. As aforementioned, the source of the external sound and the position of the source can be determined by obtaining the classification of the source from the audio signal database and using the object detection device to detect the source and the position of the source.
Conventionally, the internal audio system produces internal sounds originating from an infotainment source. The term “internal audio system” can collectively refer to one or more of the HMI device 160, the sound capturing device 150 and the output sound devices 180-1 and 180-2. The internal sounds are described above with reference to the non-limiting example illustrated in
In further implementations, the amplifier 155 can be utilized to amplify the input audio signals captured by the sound capturing device 150 of the exemplary source vehicle 100 of
Still referring to
The communication device 402 is a device that allows the ASCM 170 to communicate with systems, devices and components (e.g., features 140, 145, 120, 160, 125, 140, 160, 180, 190 and 195) of the source vehicle 100 of
The memory device 404 is a device that stores data that is generated or received by the ASCM 170. The audio signal and weighted factor databases, or similar structures, can be stored in the memory device 404. The user or vehicle manufacturer may maintain the databases stored in the memory device 404. Databases can be removed and additional databases can be stored within the memory device 404
Referring now to
The exemplary flowchart 500 starts at block 502 and proceeds to block 504 whereat the flowchart 500 receives an input audio signal corresponding to an undefined sound originating from a source within an external environment of the source vehicle. The sound capturing device 150, e.g., microphone, captures the undefined sound and converts the undefined sound to the input audio signal. The input audio signal is transmitted to the ASCM 170.
Block 506 determines the undefined sound to be indicative of a specific external sound to be produced at a desired loudness by one or more output sound devices located within an internal cabin of the source vehicle. The input audio signal may be amplified in some implementations. When the input audio signal matches one of a plurality of prospective audio signals stored within an audio signal database, the ASCM 170 may determine the undefined sound to be indicative of the specific external sound. In another implementation, the ASCM 170 may determine the undefined sound to be indicative of the specific external sound when a detected object that originates the undefined sound is determined to violate a threshold condition. For instance, a train whistle can be indicative of the specific external sound when the train is in close proximity of the source vehicle. Likewise, a thumping sound of a preceding vehicle that hits a road obstruction in close proximity of the vehicle can be indicative of the specific external sound.
Block 508 generates an output audio signal based upon the input audio signals and the desired loudness for the specific external sound to be produced. The specific external sound can be produced by one or more output sound devices (e.g., output sound devices 180-1 and 180-2 of
A second step 602 determines what portions of the detected vehicle are positioned within one or more of the four partitioned quadrants. In the illustrated non-limiting example, the detected vehicle is not positioned in either of the first and third quadrants, as denoted by a “1=0” and a “3=0”. About 30% (3/10) of the detected vehicle is positioned in the second quadrant and about 70% (7/10) of the detected vehicle is positioned in the fourth quadrant.
A third step 603 illustrates audio waves 615 and 617 representing the specific external sound originated by the detected vehicle and produced by respective ones of the front-right and rear-right speakers 680-2, 680-4, respectively, at the desired loudness. Here, the speakers produce the specific external sound from a direction that conveys a position of the source (e.g., detected vehicle) from which the specific external sound originated from in relation to the source vehicle. The total loudness produced by speakers 680-2 and 680-4 is equal to the desired loudness. In the illustrated example, the front-right speaker 680-2 produces about 3/10 of the specific external sound and the rear-right speaker 680-4 produces about 7/10 of the specific external sound based on the generated output signal. The audio waves produced by the speakers may dynamically pan to convey changes in position of the detected vehicle in relation to the source vehicle. The speakers may produce more than one specific external sound simultaneously, each corresponding to a respective detected object and a position for each respective detected object.
Referring now to block 510, the ASCM 170 transmits the output audio signal to the one or more output sound devices located within the internal cabin of the source vehicle to produce the specific external sound mixed in combination with internal sound that originates from one or more infotainment devices. In the non-limiting example of
The disclosure has described certain preferred embodiments and modifications thereto. Further modifications and alterations may occur to others upon reading and understanding the specification. Therefore, it is intended that the disclosure not be limited to the particular embodiment(s) disclosed as the best mode contemplated for carrying out this disclosure, but that the disclosure will include all embodiments falling within the scope of the appended claims.
