This invention in general relates to systems and methods for organizing communications in an ad hoc communication network, and more specifically in a vehicle.
Communication systems, and especially wireless communication systems, are becoming more sophisticated, offering consumers improved functionality to communicate with one another. Such increased functionality has been particularly useful in the automotive arena, and vehicles are now being equipped with communication systems with improved audio (voice) wireless communication capabilities. For example, On Star™ is a well-known communication system currently employed in vehicles, and allows vehicle occupants to establish a telephone call with a service center by activating a switch. Additionally, vehicles are now being equipped with hands-free systems that allow a vehicle operator to place a call to a third party, including third parties that are located in another vehicle.
Existing vehicle-to-vehicle communications are relatively crude, and there is room for improvement. For example, two vehicles that are communicating with each other may have multiple occupants. But when each vehicle's user interface is equipped with only a single microphone and speaker(s), communication can become confused. For example, when one occupant in a first vehicle calls a second vehicle, other occupant's voices in the first vehicle will be picked up by the microphone. As a result, the occupants in the second vehicle may become confused as to who is speaking in the first vehicle. Moreover, an occupant in the first vehicle may wish to only speak to a particular occupant in the second vehicle, rather than having his voice broadcast throughout the second vehicle. Similarly, an occupant in the second vehicle may wish to know who in the first vehicle is speaking at a particular time, and may wish to receive communications from only particular occupants in the first vehicle. Additionally, if the vehicles are traveling or “caravanning” together, communication between them would be benefited by a more realistic feel that gave the occupants in vehicles a sense of where each other is located (to the front, to the right, the relative distance between them, etc.).
In short, there is much about the organization of vehicle wireless-based communications systems that could use improvement to enhance its functionality, and to better utilize the resources that the system is capable of providing. This disclosure presents several different means to so improve these communications.
It is, therefore, desirable to provide an improved procedure for organizing communications in an ad hoc communication network, and more specifically in a vehicle.
While the invention is susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and will be described in detail herein. However, it should be understood that the invention is not intended to be limited to the particular forms disclosed. Rather, the invention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the invention as defined by the appended claims.
What is described is an improved system and procedure for controlling processing of outputs to a vehicle's wireless communication interface. Disclosed herein are systems and methods for organizing communications in a vehicular wireless communication system. In one embodiment, there is a method for broadcasting communications in a vehicle having a plurality of speakers, comprising wirelessly coupling a control unit in the vehicle to a communication network to allow voice communications with another user or push-to-talk (PTT) group coupled to the communication network, determining data indicative of an angle between the trajectory of the vehicle and the position of the other user relative to the vehicle, and selectively engaging the speakers in the vehicle to broadcast the voice communications in accordance with the determined angle so that the broadcast voice substantially correlates with the position of the user relative to the vehicle.
In another embodiment, there is a method for broadcasting communications in a vehicle having at least one speaker, comprising wirelessly coupling a control unit in the vehicle to a communication network to allow voice communications with another user or PTT group coupled to the communication network, determining a distance between the vehicle and the other user, and providing through the at least one speaker the other user's voice, wherein the other user's voice is modified in a manner indicative of the distance to the other user. Moreover, the determined distance may be used to further determine a priority with respect to relative distance of a particular within a PTT group.
In a further embodiment, there is a method for broadcasting communications in a vehicle having a plurality of speakers, comprising having a first user engage a user interface in the vehicle to enable the first user to wirelessly communicate with another user (whether alone or within a PTT group), receiving the other user's voice at the vehicle, and broadcasting the other user's voice through at least one of the plurality of speakers, wherein the broadcasted other user's voice is modified in a manner indicative of either the distance between the vehicle and the other user or the angular orientation between the vehicle and the other user.
In yet another embodiment, there is a method for broadcasting communications in a vehicle having a plurality of speakers, comprising having a first user engage a user interface in the vehicle to enable the first user to wirelessly communicate with another user, receiving the other user's voice at the vehicle, broadcasting the other user's voice through at least one of the plurality of speakers, and displaying the location of the other user by a pointer which points to the location of the other user relative to the location of the vehicle.
In still another embodiment, a method is disclosed for broadcasting communications in a vehicle having a plurality of speakers, comprising having a first user in the vehicle establish a wireless voice communication with a second user, receiving the second user voice data at the first vehicle, determining the location of the first user in the vehicle, and broadcasting the second user's voice data only through at least one of the plurality of speakers that is nearest to the first user.
Now, turning to the drawings, an example use of the present invention in an automotive setting will be explained.
The head unit 50 may also comprise a navigation unit 62, which typically includes a Global Positioning Satellite (GPS) system for allowing the vehicle's location to be pinpointed, which is useful, for example, in associating the vehicle's location with mapping information the system provides. As is known, such a navigation unit communicates with GPS satellites (such as satellites 32) via a receiver. Also present is a positioning unit 66, which determines the direction in which the vehicle is pointing (north, north-east, etc.), and which is also useful for mapping a vehicle's progress along a route.
Ultimately, user and system inputs are processed by a controller 56 which executes processes in the head unit 50 accordingly, and provides outputs 54 to the occupants in the vehicle, such as through a speaker 78 or a display 79 coupled to the head unit 50. The speakers 78 employed can be the audio (radio) speakers normally present in the vehicle, of which there are typically four or more, although only one is shown for convenience. Moreover, in an alternative embodiment, the output 54 may include a text to speech converter to provide the option to hear an audible output of any text that is contained in a group communication channel that the user may be monitoring. This audio feature may be particular advantageous in the mobile environment where the user is operating a vehicle. Additionally, a memory 64 is coupled to the controller 56 to assist it in performing regulation of the inputs and outputs to the system. The controller 56 also communicates via a vehicle bus interface 58 to a vehicle bus 60, which carries communication information and other vehicle operational data throughout the vehicle.
The Telematics control unit 40 is similarly coupled to the vehicle bus 60, via a vehicle bus interface 48, and hence the head unit 50. The Telematics control unit 40 is essentially responsible for sending and receiving voice or data communications to and from the vehicle, i.e., wirelessly to and from the rest of the communications system 10. As such, it comprises a Telematics controller 46 to organize such communications, and a network access device (NAD) 42 which include a wireless transceiver. Although shown as separate components, one skilled in the art will recognize that aspects of the head unit 50 and the Telematics control unit 40, and components thereof, can be combined or swapped.
In an alternative embodiment, enablement of a particular microphone need not be keyed to the pressing of a particular push-to-talk switch 100a-d. Instead, each of the microphones may detect the noise level at a particular microphone 106a-d, and enable only that microphone having the highest noise level. In this regard, and referring to
In still another alternative embodiment, beam steering may be used with the embodiments of
For example, suppose the occupant in seat 102b is speaking. Assume further for simplicity that that occupant is basically equidistant from microphones 106a and 106d, which are directly to the left of and behind the occupant. When the occupant speaks, the beam steering analyzer 110 will see a pattern in the occupants speech from microphone 106b at a first time, and will see that same pattern from microphones 106a and 106d at a later second time, and then finally will see that same pattern from microphone 106c (the furthest microphone) at a third later time. As is known, such assessment of the relative timings of the arrival of the speech signals at the various microphones 106a-d can be performing using convolution techniques, which attempt to match the audio signals so as to minimize the error between them, and thus to determine a temporal offset between them. In any event, from the arrival of the speech at these different points in time, .the beam steering analyzer will infer that the occupant speaking must be located in seat 102b, and thus enable microphone 106b for transmission accordingly. This approach may also be used in conjunction with a physically steerable microphone located on the roof of the vehicle 26 to compliment the microphones 106a-d, or the microphones 106a-d may only be used to perform beam steering, with audible pick up being left to the physically steerable microphone.
The foregoing embodiments are useful in that they provide means for organizing the communication in the first vehicle by emphasizing speech by occupants intending to speak to the second vehicle, while minimizing speech from other occupants. This makes the received communications at the second vehicle less confused. However, the occupants in the second vehicle may still not know which of the occupants in the first vehicle is speaking to them. In this regard, communication between the vehicles is not as realistic as it could be, as if the occupants were actually conversing in a single room. Moreover, the second vehicle may desire ways to organize the communication it receives from the first vehicle, such as by not receiving communications for particular occupants in the first vehicle, such as children in the back seat.
Accordingly, in a further improvement to the previously mentioned techniques, and as shown in
There are several ways in which the user ID module can associate particular occupants in the first vehicle with their user IDs. Regardless of the method used, it is preferred that such association be established prior to a trip in the first vehicle, such as when the occupants first enter the vehicle, although the association can also be established mid-trip.
Once associated, the controller 56 knows, based on engagement of a particular microphone 106a-d (
In an alternative embodiment, the user, instead of the system, sends his user ID. In this embodiment, the head unit 50 does not associate a particular microphone or seat location with a user ID. Rather, the speaking user affirmatively sends his user ID, which may constitute the pressing of a switch or second switch on the user interface 51. Alternatively, schemes could be used such as a push-to-talk switch capable of being pressed to two different depths or hardnesses, with a first depth or hardness establishing push-to-talk communication, and further pressing to a second depth or hardness further sending the speaker's user ID (which could be pre-associated with the switch using the techniques disclosed earlier).
In yet another embodiment, the user ID is associated with a particular occupant in the first car via a voice recognition algorithm. In this regard, voice recognition module 70 (which also may constitute part of the controller 56) is employed to process a received voice in the first vehicle and to match it to pre-stored voice prints stored in the voice recognition module 70, which can be entered and stored by the occupants at an earlier time (e.g., in memory 64). Many such voice recognition algorithms exist and are useable in the head unit 50, as one skilled in the art will appreciate. When a voice recognition module 70 is employed, communications are made more convenient, as an occupant in the first vehicle can simply start speaking, perhaps by first speaking a command to engage the system. Either way, the voice recognition algorithm identifies the occupant that is speaking, and associates that occupant with his user ID, and transmits that occupant's voice data and user ID data as explained above.
Once the user ID is transmitted to the second vehicle, the occupants of the second vehicle can further tailor communications with the first vehicle. For example, using the second vehicle's user interface, the occupants of the second vehicle can cause their user interface to treat communications differently for each of the occupants in the first vehicle. For example, suppose those in the second vehicle do not wish to hear communications from a particular occupant in the first vehicle, perhaps a small child who is merely “playing” with the communication system and confusing communications or irritating the occupants of the second vehicle. In such a case, the user interface in the second vehicle may be used to block or modify (e.g., reduce the volume of) that particular user in the first vehicle, or to override that particular user in favor of other users in the first vehicle wishing to communicate. Thus, the occupants in the second vehicle can store the suspect user ID in its controller 56, or in the server 24 if network based, along with instructions to block, modify, or override data streams having the user's user ID in its header. Such blocking, modifying, or overriding can be accomplished in several different ways. First, it can be affected off-line, i.e., prior to communications with the first vehicle or prior to a trip with the first vehicle if prior communication experiences with the first vehicle or its passengers suggests that such treatment is warranted. Or, it can be affected during the course of communications. For example, and referring to
If desirable, blocking, modifying, or overriding of a particular user can be transmitted back to the user interface in the first vehicle to notify the occupants in the first vehicle as to how communications have been modified, which might keep certain occupants in the first vehicle from attempting to communicate with the second vehicle in vain.
While the foregoing techniques and improvements will improve inter-vehicle communications, further improvements can make their communications more realistic, in effect by simulating communications to mimic the experience of all participants communicating in a single room to the largest extent possible. In such a realistic setting, communication participants are benefited from audible cues: certain speakers are heard from the left or right, and distant participants are heard more faintly than closer participants. Remaining embodiments address these issues.
Moreover, when a first user or vehicle 26a is participating in a push-to-talk (PTT) group with other vehicles, the server 24 can determine the distance of other vehicles in the PTT group. The server 24 may then prioritize the audio output to the first vehicle 26a based on the distance of the other vehicles in the PTT group. For instance, other users or vehicles in the PTT group that are closest to the first vehicle 26a may have greater priority than those that are further away from the first vehicle 26a.
Referring to
Of course, as they drive, the distances and angular orientations of the vehicles will change. Parameters necessary to compute these variables may be computable by the head units 50 in the respective vehicles or by the server 24, if the system is network based. As discussed earlier, the head units 50 of the vehicles include navigation units 62 which receive GPS data concerning the location (longitude and latitude) of each of the vehicles 26a, 26b. Additionally, the head units 50 can also comprise positioning units 66 which determine the trajectory or headings 120a and 120b of each of the vehicles (e.g., so many degrees deviation from north, etc.). This data can be shared between the two vehicles when they are in communication by including such data in the header of the data stream, in much the same way that the user ID can be included. Alternatively, the data may be shared centrally at the server 24. When location data is shared, the distance D and angular orientation 121 between them can be computed. Distance D is easily computed, as the longitude and latitude data can essentially be subtracted from one another. Angular orientation 121 is only slightly more complicated to compute once the first vehicle's trajectory 120a is known. Both computations can be made by the controllers 56 which ultimately receive the raw data for the computations.
From this distance and angular orientation data, communications between the two vehicles can be made more realistic and informative by adjusting the output of the user interfaces in the vehicles 26a and 26b in different ways.
For example, computation of the distance, D, can be used to scale of the volume of the voices of occupants in the second vehicle 26b that are broadcast through the speakers 78 in the first vehicle 26a, such that the broadcast volume is high when the vehicles are relatively near and lower when relatively far. This provides the occupants an audible cue indicative of the distance between them. Referring to
Such a distance/volume-scaling or volume prioritization scheme can be modified at the user interfaces 51 to suit user preferences. For example, the extent of volume scaling, volume priority, or the distance over which it will occur, etc. can be specified by the vehicle occupants.
In another modification used to indicate distance, the distance module 130 can modify the audio signal sent to the speaker in other ways. For example, instead of reducing volume, as the second vehicle 26b becomes farther away from the first vehicle 26a, the distance module 130 can add increasing level of noise or static to the voice communication received from the second vehicle. This effect basically mimics older style CB analog communication system, in which increasing levels of static will naturally occur with increased distance. In any event, again this scheme provides occupants in the first vehicle an audible cue concerning the relative distance between the two communicating vehicles.
In another modification to make communications more realistic and informative, the speakers 78 within a particular vehicle can be selectively engaged to give its occupants a relative sense of the location of the second vehicle. In one embodiment, this scheme relies on computation of an angle 121, i.e., the angular orientation of the second vehicle 26b relative to the first 26a, as may be accomplished by the incorporation of an angular orientation module 132 to the controller 52, as shown in
Essentially, the speaker volume adjustment techniques disclosed herein are akin to balancing (from left to right) and fading (from front to back) the volume of the speakers 78, a functionality which generally exists in currently-existing vehicle radios. In this regard, adjustment of the speaker volume may be effected by controlling the radio, which can occur through the vehicle bus 60, as one skilled in the art understands.
The foregoing speaker modification adjustment techniques can be combined. For example, as well as adjusting speaker 78 enablement on the basis of the angular orientation 121 between the two vehicles (
Still other modifications are possible using the system of
In yet another embodiment, receipt of voice communications from the second vehicle is not broadcast throughout the entirety of the first vehicle, but is instead broadcast only through that speaker or speakers which are closest to the passenger in the first vehicle that initiated the communication. In this way, the conversation is selectively only broadcast to this initiating passenger, which can be determined by monitoring which of the push-to-talk switches in the first vehicle have been pressed, by electronic beam steering, or by other techniques. Once that passenger's location is determined, the control unit 56 will thereafter only route the communications through that speaker or speakers that are nearest to the passenger that initiated the conversation. Thereafter, if another passenger in the first vehicle engages in communication, the activated speaker can be switched.
The various techniques disclosed herein have been illustrated as involving various computations to be performed by the controller 56 in the head unit 50 within the vehicle. However, one skilled in the art will recognize that the processing and data storage necessary to perform the functions disclosed herein could be made at the server 24 (
Moreover, while largely described with respect to improving communications within vehicles, one skilled in the art will understand that many of the concepts disclosed herein could have applicability to communicative user interfaces not contained within vehicles.
Although several discrete embodiments are disclosed, one skilled in the art will appreciate that the embodiments can be combined with one another, and that the use of one is not necessarily exclusive of the use of other embodiments. Moreover, the above description of the present invention is intended to be exemplary only and is not intended to limit the scope of any patent issuing from this application. The present invention is intended to be limited only by the scope and spirit of the following claims.
The present application is related to the following co-pending, commonly assigned patent applications, which were filed concurrently herewith and incorporated by reference in their entirety: Ser. No. ______, entitled “Selectively Enabling Communications at a User Interface Using a Profile,” attorney docket TC00167, filed concurrently herewith. Ser. No. ______, entitled “Method for Enabling Communications Dependent on User Location, User-Specified Location, or Orientation,” attorney docket TC00168, filed concurrently herewith. Ser. No. ______, entitled “Methods for Sending Messages Based on the Location of Mobile Users in a Communication Network,” attorney docket TC00169, filed concurrently herewith. Ser. No. ______, entitled “Methods for Displaying a Route Traveled by Mobile Users in a Communication Network,” attorney docket TC00170, filed concurrently herewith. Ser. No. ______, entitled “Conversion of Calls from an Ad Hoc Communication Network,” attorney docket TC00172, filed concurrently herewith. Ser. No. ______, entitled “Method for Entering a Personalized Communication Profile Into a Communication User Interface,” attorney docket TC00173, filed concurrently herewith. Ser. No. ______, entitled “Methods and Systems for Controlling Communications in an Ad Hoc Communication Network,” attorney docket TC00174, filed concurrently herewith. Ser. No. ______, entitled “Methods for Controlling Processing of Inputs to a Vehicle Wireless Communication Interface,” attorney docket TC00175, filed concurrently herewith. Ser. No. ______, entitled “Programmable Foot Switch Useable in a Communications User Interface in a Vehicle,” attorney docket TC00177, filed concurrently herewith.