This invention relates to systems and methods for organizing communications in an ad hoc communication network, and more specifically in a vehicle.
Communication systems, and especially wireless communication systems, are becoming more sophisticated, offering consumers improved functionality to communicate with one another. Such increased functionality has been particularly useful in the automotive arena, and vehicles are now being equipped with communication systems with improved audio (voice) wireless communication capabilities. For example, On Star™ is a well-known communication system currently employed in vehicles, and allows vehicle occupants to establish a telephone call with others (such as a service center) by activating a switch.
However, existing communications schemes lack flexibility to tailor group communications and other ad hoc communications. For instance, existing approaches depend heavily on establishing communication from one end of a communication (namely, a service center) and do not provide means for all parties to dynamically change the nature of the communications or the definition of the group. This lack of flexibility may prohibit group users from communicating as freely as they might wish.
Moreover, vehicles that are trying to communicate with each other may have multiple occupants. But when each vehicle's user interface is equipped with only a single microphone and speaker(s), communication can become confused. For example, when one occupant in a first vehicle calls a second vehicle, other occupant's voices in the first vehicle will be picked up by the microphone. As a result, the occupants in the second vehicle may become confused as to who is speaking in the first vehicle. Moreover, an occupant in the first vehicle may wish to only speak to a particular occupant in the second vehicle, rather than having his voice broadcast throughout the second vehicle. Similarly, an occupant in the second vehicle may wish to know who in the first vehicle is speaking at a particular time, and may wish to receive communications from only particular occupants in the first vehicle. Additionally, if the vehicles are traveling or “caravanning” together, communication between them would be benefited by a more realistic feel that gave the occupants in vehicles a sense of where each other is located (to the front, to the right, the relative distance between them, etc.).
In short, there is much about the organization of vehicle wireless-based communications systems that could use improvement to enhance its functionality, and to better utilize the resources that the system is capable of providing. This disclosure presents several different means to so improve these communications.
It is, therefore, desirable to provide procedures for organizing communications in an ad hoc communication network, and more specifically in a vehicle.
a, 10b illustrate a display useable with the control system of
While the invention is susceptible to various modifications and alternative forms, specific embodiments have been shown by way of example in the drawings and will be described in detail herein. However, it should be understood that the invention is not intended to be limited to the particular forms disclosed. Rather, the invention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the invention as defined by the appended claims.
What is described is a system and method for organizing communications in a vehicular wireless communication system. In one embodiment, a method is disclosed for operating a communication system in a first vehicle having a plurality of push-to-talk switches and a microphone, comprising having an occupant in the first vehicle press one of the plurality of push-to-talk switches, and physically steering the microphone in the direction of the pressed push-to-talk switch. In another embodiment, a method is disclosed for operating a communication system in a first vehicle having a plurality of push-to-talk switches, each push-to-talk switch being associated with a microphone, comprising having an occupant in the first vehicle press one of the plurality of push-to-talk switches, and enabling at least one microphone associated with the pressed push-to-talk switch to send voice data from the occupant to a recipient. In another embodiment, a method is disclosed for operating a communication system in a first vehicle having a plurality of microphones, comprising having an occupant in the first vehicle speak, electronically steering the microphones to enable at least one of the plurality of microphones that are nearest to the speaking occupant to receive voice data, and associating a user ID with the enabled at least one microphone. In another embodiment, a method is disclosed for operating a communication system in a first vehicle, comprising having a first occupant speak in the first vehicle to provide voice data, associating the voice data with the occupant's user ID, and wirelessly transmitting the voice data and the user ID to a user interface.
Now, turning to the drawings, an example use of the present invention in an automotive setting will be explained.
Further details of a typical wireless communications device 22 as employed in a vehicle 26 are shown in
The head unit 50 also comprises a navigation unit 62, which typically includes a Global Positioning Satellite (GPS) system for allowing the vehicle's location to be pinpointed, which is useful, for example, in associating the vehicle's location with mapping information the system provides. As is known, such a navigation unit communicates with GPS satellites (such as satellites 32) via a receiver. Also present is a positioning unit 66, which determines the direction in which the vehicle is pointing (north, north-east, etc.), and which is also useful for mapping a vehicle's progress along a route.
Ultimately, user and system inputs are processed by a controller 56 which executes processes in the head unit 50 accordingly, and provides outputs 54 to the occupants in the vehicle, such as through a speaker 78 or a display 79 coupled to the head unit 50. The speakers 78 employed can be the audio (radio) speakers normally present in the vehicle, of which there are typically four or more, although only one is shown for convenience. Moreover, in an alternative embodiment, the output 54 may include a text to speech converter to provide the option to hear an audible output of any text that is contained in a group communication channel that the user may be monitoring. This audio feature may be particular advantageous in the mobile environment where the user is operating a vehicle. Additionally, a memory 64 is coupled to the controller 56 to assist it in performing regulation of the inputs and outputs to the system. The controller 56 also communicates via a vehicle bus interface 58 to a vehicle bus 60, which carries communication information and other vehicle operational data throughout the vehicle.
The Telematics control unit 40 is similarly coupled to the vehicle bus 60, via a vehicle bus interface 48, and hence the head unit 50. The Telematics control unit 40 is essentially responsible for sending and receiving voice or data communications to and from the vehicle, i.e., wirelessly to and from the rest of the communications system 10. As such, it comprises a Telematics controller 46 to organize such communications, and a network access device (NAD) 42 which include a wireless transceiver. Although shown as separate components, one skilled in the art will recognize that aspects of the head unit 50 and the Telematics control unit 40, and components thereof, can be combined or swapped.
The wireless communications device 22 can provide a great deal of communicative flexibility within vehicle 26. For example, an occupant in a first vehicle 26a can call a second vehicle 26b to speak to its occupants either by pressing a switch on the keypad 72 of the head unit 50 or by simply speaking if the head unit is equipped with a voice recognition module 70. In one embodiment, the pressing of a switch or speaking into a voice recognition module initiates a cellular telephone call with a second vehicle 26b. In this case, users in either the first vehicle 26a or the second vehicle 26b can speak with each other without pressing any further switches. Moreover, the system may be configured to include a voice activated circuit such as a voice activated switch (VAS) or voice operated transmit (VOX). This would also provide for hands-free operation of the system by a user when communicating with other users.
In an alternative embodiment, the switch may be configured to establish a push-to-talk communication channel over a cellular network. Here, the controller 56 is configured to only allow audio by occupants in the first vehicle 26a through microphone 68 to be transmitted through the Telematics control unit 40 when a user in the first vehicle 26a is pressing down on the push-to-talk switch. The controller 56 is further configured to only allow audio received from the second vehicle 26b (or server 24) to be heard over speakers 78 when the operator of the first vehicle 26a is not pressing down on the switch. Alternatively, to avoid the need of holding down a switch to speak, the system may be configured to allow a user to push a button a first time to transmit audio and push the button a second time to receive audio.
In any event, a user in the second vehicle 26b can, in like fashion, communicate back to the first vehicle 26a, with the speaker's voice being heard on speaker(s) 78 in the first vehicle. Or, an occupant in the first vehicle 26a can call the server 24 to receive services. Additionally, such a system 10 can have utility outside of the context of vehicle-based applications, and specifically can have utility with respect to other portable devices (cell phones, personal data assistants (PDAs), etc.). The use of the system in the context of vehicular communications is therefore merely exemplary.
In another embodiment using the directional microphone 106, the controller 56 uses the voice recognition unit 70 to filter out any unwanted noise or unwanted user speech patterns. For instance, when a vehicle occupant selects a push-to-talk switch 100a-d, the controller 56 may access a user profile for the occupant that allows the voice recognition unit 70 to determine the voice pattern or sequence for the particular vehicle occupant. The controller 56 and voice recognition unit 70 would then only transmit to the Telematics control unit 40 any voice activity associated with the vehicle occupant that has selected their associated push-to-talk switch 100a-d.
In an alternative embodiment, enablement of a particular microphone need not be keyed to the pressing of a particular push-to-talk switch 100a-d. Instead, each of the microphones may detect the noise level at a particular microphone 106a-d, and enable only that microphone having the highest noise level. In this regard, and referring to
In still another alternative embodiment, beam steering may be used with the embodiments of
The foregoing embodiments are useful in that they provide means for organizing the communication in the first vehicle by emphasizing speech by occupants intending to speak to the second vehicle, while minimizing speech from other occupants. This makes the received communications at the second vehicle less confused. However, the occupants in the second vehicle may still not know which of the occupants in the first vehicle is speaking to them. In this regard, communication between the vehicles is not as realistic as it could be, as if the occupants were actually conversing in a single room. Moreover, the second vehicle may desire ways to organize the communication it receives from the first vehicle, such as by not receiving communications for particular occupants in the first vehicle, such as children in the back seat.
Accordingly, in a further improvement to the previously mentioned techniques, and as shown in
There are several ways in which the user ID module can associate particular occupants in the first vehicle with their user IDs. Regardless of the method used, it is preferred that such association be established prior to a trip in the first vehicle, such as when the occupants first enter the vehicle, although the association can also be established mid-trip.
Once associated, the controller 56 knows, based on engagement of a particular microphone 106a-d (
In an alternative embodiment, the user, instead of the system, sends his user ID. In this embodiment, the head unit 50 does not associate a particular microphone or seat location with a user ID. Rather, the speaking user affirmatively sends his user ID, which may constitute the pressing of a switch or second switch on the user interface 51. Alternatively, schemes could be used such as a push-to-talk switch capable of being pressed to two different depths or hardnesses, with a first depth or hardness establishing push-to-talk communication, and further pressing to a second depth or hardness further sending the speaker's user ID (which could be pre-associated with the switch using the techniques disclosed earlier).
In yet another embodiment, the user ID is associated with a particular occupant in the first car via a voice recognition algorithm. In this regard, voice recognition module 70 (which also may constitute part of the controller 56) is employed to process a received voice in the first vehicle and to match it to pre-stored voice prints stored in the voice recognition module 70, which can be entered and stored by the occupants at an earlier time (e.g., in memory 64). Many such voice recognition algorithms exist and are useable in the head unit 50, as one skilled in the art will appreciate. When a voice recognition module 70 is employed, communications are made more convenient, as an occupant in the first vehicle can simply start speaking, perhaps by first speaking a command to engage the system. Either way, the voice recognition algorithm identifies the occupant that is speaking, and associates that occupant with his user ID, and transmits that occupant's voice data and user ID data as explained above.
Once the user ID is transmitted to the second vehicle, the occupants of the second vehicle can further tailor communications with the first vehicle. For example, using the second vehicle's user interface, the occupants of the second vehicle can cause their user interface to treat communications differently for each of the occupants in the first vehicle. For example, suppose those in the second vehicle do not wish to hear communications from a particular occupant in the first vehicle, perhaps a small child who is merely “playing” with the communication system and confusing communications or irritating the occupants of the second vehicle. In such a case, the user interface in the second vehicle may be used to block or modify (e.g., reduce the volume of) that particular user in the first vehicle, or to override that particular user in favor of other users in the first vehicle wishing to communicate. Thus, the occupants in the second vehicle can store the suspect user ID in its controller 56, along with instructions to block, modify, or override data streams having the user's user ID in its header. Such blocking, modifying, or overriding can be accomplished in several different ways. First, it can be affected off-line, i.e., prior to communications with the first vehicle or prior to a trip with the first vehicle if prior communication experiences with the first vehicle or its passengers suggests that such treatment is warranted. Or, it can be affected during the course of communications. For example, and referring to
If desirable, blocking, modifying, or overriding of a particular user can be transmitted back to the user interface in the first vehicle to notify the occupants in the first vehicle as to how communications have been modified, which might keep certain occupants in the first vehicle from attempting to communicate with the second vehicle in vain.
While the foregoing techniques and improvements will improve inter-vehicle communications, further improvements can make their communications more realistic, in effect by simulating communications to mimic the experience of all participants communicating in a single room to the largest extent possible. In such a realistic setting, communication participants are benefited from audible cues: certain speakers are heard from the left or right, and distant participants are heard more faintly than closer participants. Remaining embodiments address these issues.
Referring to
Of course, as they drive, the distances and angular orientations of the vehicles will change. Parameters necessary to compute these variables are computable by the head units 50 in the respective vehicles. As discussed earlier, the head units 50 of the vehicles include navigation units 62 which receive GPS data concerning the location (longitude and latitude) of each of the vehicles 26a, 26b. Additionally, the head units 50 also comprise positioning units 66 which determine the trajectory or headings 120a and b of each of the vehicles (e.g., so many degrees deviation from north, etc.). This data can be shared between the two vehicles when they are in communication by including such data in the header of the data stream, in much the same way that the user ID can be included. In particular, when location data is shared between the vehicles, the distance D and angular orientation 121 between them can be computed. Distance D is easily computed, as the longitude and latitude data can essentially be subtracted from one another. Angular orientation 121 is only slightly more complicated to compute once the first vehicle's trajectory 120a is known. Both computations can be made by the controllers 56 which ultimately receive the raw data for the computations.
From this distance and angular orientation data, communications between the two vehicles can be made more realistic and informative by adjusting the output of the user interfaces in the vehicles 26a and b in different ways.
For example, computation of the distance, D, can be used to scale of the volume of the voices of occupants in the second vehicle 26b that are broadcast through the speakers 78 in the first vehicle 26a, such that the broadcast volume is high when the vehicles are relatively near and lower when relatively far. This provides the occupants an audible cue indicative of the distance between them. Referring to FIG. 13, this distance computation and scaling of volume is accomplished by a distance module 130 in the controller 56.
Such a distance/volume-scaling scheme can be modified at the user interfaces 51 to suit user preferences. For example, the extent of volume scaling, or the distance over which it will occur, etc. can be specified by the vehicle occupants. In this regard, it may be preferable to specify a minimum volume to ensure that communications can be heard even when the vehicles are far apart.
In another modification used to indicate distance, the distance module 130 can modify the audio signal sent to the speaker in other ways. For example, instead of reducing volume, as the second vehicle 26b becomes farther away from the first vehicle 26a, the distance module 130 can add increasing level of noise or static to the voice communication received from the second vehicle. This effect basically mimics older style CB analog communication system, in which increasing levels of static will naturally occur with increased distance. In any event, again this scheme provides occupants in the first vehicle an audible cue concerning the relative distance between the two communicating vehicles.
In another modification to make communications more realistic and informative, the speakers 78 within a particular vehicle can be selectively engaged to give its occupants a relative sense of the location of the second vehicle. This scheme relies on computation of an angle 121, i.e., the angular orientation of the second vehicle 26b relative to the first 26a, as may be accomplished by the incorporation of an angular orientation module 132 to the controller 52, as shown in
Essentially, the speaker volume adjustment techniques disclosed herein are akin to balancing (from left to right) and fading (from front to back) the volume of the speakers 78, a functionality which generally exists in currently-existing vehicle radios. In this regard, adjustment of the speaker volume may be effected by controlling the radio, which can occur through the vehicle bus 60, as one skilled in the art understands.
The foregoing speaker modification adjustment techniques can be combined. For example, as well as adjusting speaker 78 enablement on the basis of the angular orientation 121 between the two vehicles (
Still other modifications are possible using the system of
In yet another embodiment, receipt of voice communications from the second vehicle is not broadcast throughout the entirety of the first vehicle, but is instead broadcast only through that speaker or speakers which are closest to the passenger in the first vehicle that initiated the communication. In this way, the conversation is selectively only broadcast to this initiating passenger, which can be determined by monitoring which of the push-to-talk switches in the first vehicle have been pressed, by electronic beam steering, or by other techniques. Once that passenger's location is determined, the control unit 56 will thereafter only route the communications through that speaker or speakers that are nearest to the passenger that initiated the conversation. Thereafter, if another passenger in the first vehicle engages in communication, the activated speaker can be switched.
The various techniques disclosed herein have been illustrated as involving various computations to be performed by the controller 56 in the head unit 50 within the vehicle. However, one skilled in the art having the benefit of this disclosure will recognize that the processing and data storage necessary to perform the functions disclosed herein could be made at the server 24 (
While largely described with respect to improving communications within vehicles, one skilled in the art will understand that many of the concepts disclosed herein could have applicability to other portable communicative user interfaces not contained within vehicles, such as cell phones, personal data assistants (PDAs), portable computers, etc., what can be referred to collectively as portable communication devices.
Although several discrete embodiments are disclosed, one skilled in the art will appreciate that the embodiments can be combined with one another, and that the use of one is not necessarily exclusive of the use of other embodiments. Moreover, the above description of the present invention is intended to be exemplary only and is not intended to limit the scope of any patent issuing from this application. The present invention is intended to be limited only by the scope and spirit of the following claims.
The present application is related to the following co-pending, commonly assigned patent applications, which were filed concurrently herewith and incorporated by reference in their entirety: Ser. No.______, entitled “Selectively Enabling Communications at a User Interface Using a Profile,” attorney docket TC00167, filed concurrently herewith. Ser. No.______,entitled “Method for Enabling Communications Dependent on User Location, User-Specified Location, or Orientation,” attorney docket TC00168, filed concurrently herewith. Ser. No.______, entitled “Methods for Sending Messages Based on the Location of Mobile Users in a Communication Network,” attorney docket TC00169, filed concurrently herewith. Ser. No.______, entitled “Methods for Displaying a Route Traveled by Mobile Users in a Communication Network,” attorney docket TC00170, filed concurrently herewith. Ser. No.______,entitled “Conversion of Calls from an Ad Hoc Communication Network,” attorney docket TC00172, filed concurrently herewith. Ser. No.______, entitled “Method for Entering a Personalized Communication Profile Into a Communication User Interface,” attorney docket TC00173, filed concurrently herewith. Ser. No.______, entitled “Methods and Systems for Controlling Communications in an Ad Hoc Communication Network,” attorney docket TC00174, filed concurrently herewith. Ser. No.______, entitled “Methods for Controlling Processing of Outputs to a Vehicle Wireless Communication Interface,” attorney docket TC00176, filed concurrently herewith. Ser. No.______, entitled “Programmable Foot Switch Useable in a Communications User Interface in a Vehicle,” attorney docket TC00177, filed concurrently herewith.