REMOTE CONTROL SERVER PROTOCOL SYSTEM

Abstract

A remote control server protocol system transports data to a client system. The client system communicates with the server application using a platform-independent communications protocol. The client system sends commands and audio data to the server application. The server application may respond by transmitting audio and other messages to the client system. The messages may be transmitted over a single communications channel.

Description

BACKGROUND OF THE INVENTION

1. Technical Field

This disclosure relates to a communications protocol, and more particularly to a protocol that transports control, configuration, and/or monitoring data used in a speech enhancement system in a vehicle.

2. Related Art

Vehicles may include wireless communication systems. A user may communicate with the wireless communication system through a hard-wired interface or through a wireless interface, which may include a hands-free headset. Such wireless communication systems may include or may be coupled to a noise reduction system. The noise reduction system may include a plurality of noise reduction modules to handle the various acoustic artifacts.

To optimize the noise reduction system, a technician may manually adjust the noise reduction system based on the specific acoustic chamber corresponding to the vehicle or vehicle model. Adjusting the noise reduction system by depressing buttons and indicators on the head-end or noise reduction system may be time consuming and expensive. Once the noise reduction system has been initialized, activating and/or deactivating individual modules may require rebooting of the system, which may be time consuming.

SUMMARY

A remote control server protocol system transports data to a client system. The client system communicates with the server application using a platform-independent communications protocol. The client system sends commands and audio data to the server application. The server application may respond by transmitting audio and other messages to the client system. The messages may be transmitted over a single communications channel.

Other systems, methods, features, and advantages will be, or will become, apparent to one with skill in the art upon examination of the following figures, and detailed description. It is intended that all such additional systems, methods, features and advantages be included within this description, be within the scope of the invention, and be protected by the following claims.

BRIEF DESCRIPTION OF THE DRAWINGS

The system may be better understood with reference to the following drawings and description. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention. Moreover, in the figures, like-referenced numerals designate corresponding parts throughout the different views.

FIG. 1 is a vehicle environment.

FIG. 2 is an application-to-client environment.

FIG. 3 is a speech enhancement system.

FIG. 4 is an application-to-client environment.

FIG. 5 is a speech enhancement process.

FIG. 6 is a remote control server (RCS) protocol SET message.

FIG. 7 is an RCS protocol GET message.

FIG. 8 is an RCS protocol STREAM message.

FIG. 9 is an RCS protocol HALT message.

FIG. 10 is an RCS protocol STREAMAUDIO message.

FIG. 11 is an RCS protocol HALTAUDIO message.

FIG. 12 is an RCS protocol INJECTAUDIO message.

FIG. 13 is an RCS protocol STARTAUDIO message.

FIG. 14 is an RCS protocol RESET message.

FIG. 15 is an RCS protocol RESTART message.

FIG. 16 is an RCS protocol INIT message.

FIG. 17 is an RCS protocol VERSION message.

FIG. 18 is an RCS protocol GENERIC ERROR message.

FIG. 19 is an RCS protocol USER DEFINED RESPONSE message.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The system provides platform and transport independent methods for transferring character and embedded data (e.g., binary data). It allows for the same interface to be used for monitoring multiple channels of audio data and sending and receiving configuration and control parameters. The protocol may handle sending signals to trigger application events in speech signal enhancement systems. FIG. 1 is a vehicle environment 102, which may include an application-to-client environment 106. The application-to-client environment 106 may include a client system 110 and an “application” or speech enhancement system 116. The speech enhancement system 116 may be coupled to or communicate with a wireless communication device 120, such as a wireless telephone system or cellular telephone.

FIG. 2 is the application-to-client environment 106. The speech enhancement system 116 may be an “application” or a “server application.” The application or speech enhancement system 116 may be incorporated into the wireless communication device 120 or may be separate from the wireless communication device. The application or speech enhancement system 116 may be part of a head-end device or audio component in the vehicle environment 102.

The client system 110 may be a portable computer, such as laptop computer, terminal, wireless interface, or other device used by a technician or user to adjust, tune, or modify the speech enhancement system 116. The client system 110 may be separate and independent from the speech enhancement system 116, and may run under a Windows® operating system. Other operating systems and/or computing platforms may also be used.

The application-to-client environment 106 may provide a platform and transport independent system for transferring commands, messages, and data, such as character data, embedded data, binary data, audio streams, and other data, between the client system 110 and the speech enhancement system 116 by using a remote control server (RCS) protocol 202. The RCS protocol 202 may be a communications protocol that may transport control data, configuration data and/or for monitoring data between the speech enhancement system 116 and the client system 110. Data may be sent over a single or common interface or channel. The RCS protocol 202 may permit a user to efficiently tune and adjust the speech enhancement system 116 in the vehicle for optimum performance through the client system 110. Because the acoustic “chamber” may differ from vehicle to vehicle and from vehicle model to vehicle model, a user may tune and adjust the parameters of the speech enhancement system 116 for each specific acoustic environment loudly or remotely.

The client system 110 may include an RCS protocol client application 210, which may comprise a software “plug-in.” The RCS protocol client application 210 may translate commands issued by the client system 110 under user control into an RCS protocol format 202. The speech enhancement system 116 may include a corresponding RCS protocol server application 220, which may comprise a software “plug-in.” The RCS protocol server application 220 may translate data and commands received from the client system 110 in an RCS protocol format 202 into control commands and data, which may be processed by the speech enhancement system 116. By using the software 210 and 220, communication may occur independent of the platform.

FIG. 3 is the speech enhancement system 116. The speech enhancement system 116 may include a plurality of software and/or hardware modules or processing modules 304. The speech enhancement system 116 may be implemented in software, hardware, or a combination of hardware and software. Each processing module 304 may perform a speech enhancement or noise reduction process to improve the speech quality of the wireless communication device 120 with which it communicates. The speech enhancement system 116 may improve or extract speech signals in the vehicle environment 102, which may be degraded by cabin noise due to road surface conditions, engine noise, wind, rain, external noise, and other noise.

In some systems, the processing modules 304 may comprise a collection of routines and data structures that perform tasks, and may be stored in a library of software programs. The processing module may include an interface that recognizes data types, variables and routines in an implementation accessible only to the module. The processing modules may be accessed to process a stream of audio data received from or sent to the wireless communication device 120. Any of the processing modules 304 may process the audio data during operation of the speech enhancement system 116. The speech enhancement system 116 may process a stream of audio data on a frame-by-frame basis. A frame of audio data may include, for example, 128 samples of audio data. Other frame lengths may be used. Each sample in a frame may represent audio data digitized at a basic sample rate of about 8 KHz or about 16 KHz, for example.

The processing modules 304 may be “created” or generated during initialization of the speech enhancement system 116 or during normal operation of the speech enhancement system that may be under control of the client system 110. During the generation process 304, memory may be mapped, allocated, and configured for some or all of the modules, and various parameters may be set. The processing modules 304 may be uninstalled during initialization or during normal operation of the speech enhancement system 116 under the control of the client system 110.

Each processing module 304 or software process (or hardware) that performs the speech enhancement processing may be accessed and copied from a library of speech enhancement processes into memory. The speech enhancement system 116 may include processing modules, such as an echo-cancellation module 310, a noise reduction module 312, an automatic gain control module 314, a parametric equalization module 316, a high-frequency encoding module 318, a wind buffet removal module 320, a dynamic limiter module 322, a complex mixer module 324, a noise compensation module 326, and a bandwidth extension module 328. For example, a signal enhancement module may be included, which may be described in application Ser. Nos. 10/973,575, 11/757,768, and 11/849,009, which are incorporated by reference. Such processing modules may process data on the receive side or the transmit side. A diagnostic support module 340 may be included to facilitate debugging of the speech enhancement system 116. Other noise reduction or speech enhancement modules 304 may be included. The speech enhancement system 116 may be a compiled and linked library of processing modules available from Harman International of California under the name of Aviage Acoustic Processing System.

FIG. 4 shows an application-to-client environment 106. The processing modules 304 may receive a “receive-in” audio signal 410 from the wireless communication device 120. The processing modules 304 may process the “receive-in” audio signal 410 to enhance the signal, and may transmit a “receive-out” audio signal 420 to a loudspeaker 424. The loudspeaker 424 may be part of a hands-free set 430, which may be coupled to the wireless communication device 120. A microphone 440 or other transducer may receive user speech and may provide a “microphone-in” signal 442 to the processing modules 304. The processing modules 304 may process the “microphone-in” signal 442 to enhance the signal and may transmit the audio signal (“microphone-out” 448) to the wireless communication device 120.

The speech enhancement system 116 may include a processor 450 or other computing device, memory 456, disk storage 458, a communication interface 460, and other hardware 462 and software components. The processor 450 may communicate with various signal processing components, such as filters, mixers, limiters, attenuators, and tuners, which may be implemented in hardware or software or a combination of hardware and software. Such signal processing components may be part of the speech enhancement system 116 or may be separate from the speech enhancement system. The client system 110 or portable computer may also include a processor 470 or other computing device, memory 472, disk storage 474, a communication interface 476, and other hardware and software components.

FIG. 5 is a speech enhancement process 500, which may be executed by the speech enhancement system 116. The processor 450 may determine which group of the processing modules to create (Act 502), which may be based on initialization parameters stored in memory or may be based on initialization commands issued by the client system 110 under user control. The processor 450 may perform a “create” process, which may allocate buffer space in the memory for storing parameters and flags corresponding to the processing modules (Act 510). Depending on the processing modules activated, the processor 450 may initialize corresponding hardware components (Act 520).

The processing modules 304 may process the audio data from the wireless communication device 120 serially or in a parallel manner (Act 530). The processor 450 may periodically determine if a request (message and/or command) has been received from the client system 110 (Act 540). In some systems, the client request may request service from the processor 450.

When a request is received from the client system 110, the processor 450 may call the RCS protocol server application 220 to translate an RCS protocol message received from the client system 110 (Act 544). The RCS protocol server application 220 may be an API (application programming interface) program. The API 220 may recognize the commands, instructions, and data provided in RCS protocol format and may translate such information into signals recognized by the speech enhancement system 116. The processor 450 may execute a process (Act 550) specified by the client system 110. If a terminate signal is detected (Act 560), the link between the client system and the application may be terminated. If no terminate signal is received, processing by the processing modules 304 may continue (Act 530).

FIGS. 6-19 are RCS protocol messages or commands. FIG. 6 is an RCS protocol SET message 600. The RCS protocol messages may follow XML formatting rules or rules derived or substantially derived from XML formatting rules. Each message or command may open with a left-hand triangular bracket “<” 602 and may close with a right-hand triangular bracket preceded with a slash “/>” 604. Each message may include the name of the message 610 followed by the appropriate attributes 620 and their values 624. The value of each attribute 620 may be enclosed within matched triangular brackets < . . . >630. Single quotation marks may also be used to enclose the attribute value depending on the XML software version used. Attributes may be separated by white space. Each message or command may include a sequence identifier 636, shown as “id.” The RCS client application 210 may increment the message “id” 636 for each of its calls, while the RCS server application 220 may increment the “id” of each of its responses. This permits matching of a particular call with its response.

A response (“rset” 646) sent by the application 116 in response to the message sent by the client system 110 may include attributes 650 returned by the message call. An “error” parameter 656 may contain a code 658 indicating that an error has occurred or that no error has occurred. A “no error” indication means that the “set” message was received correctly. The types of information described above may apply to each of the messages described in FIGS. 6-19. The format of the values associated with each attribute may be defined as follows:

tQuaU32 = unsigned thirty-two bit integer value
tQuaU16 = unsigned sixteen bit integer value
tQuaU8 = unsigned eight bit integer value
tQuaInt = integer value
tQuaChar = character

The SET message 600 may be used to set or define parameters or variables in the processing modules 304. For example, a noise reduction floor, which may be a parameter in the noise reduction module 312, may be set to 10 dB using this message. A character string “noise reduction floor” may be entered into a “param” field 662 to identify the parameter to be set, and the value of 10 may be entered into a “data” field 664.

FIG. 7 is an RCS protocol GET message 700. The GET message 700 may be sent by the client system 110 to obtain the value of a parameter stored in the memory of the speech enhancement system 116. A “param” attribute 704 may identify a name of the parameter to retrieve and a “data” attribute 706 returned may contain the requested value.

FIG. 8 is an RCS protocol STREAM message 800. The STREAM message 800 may perform a similar function as the GET message 700, but rather than returning a single parameter value, the STREAM message may cause the application 116 to return a continuous stream of the requested parameter data on a frame-by-frame basis. Transmission of the stream may continue until terminated by a halt command. For example, if a “param” attribute 804 is set to “clipping status” and a “frameskip” attribute 810 is set to a value of 10, the server application, in this example, the speech enhancement system 116, may return a sequential stream of messages. A “data” value 812 in the returned message 820 may represent whether a frame exhibited audio clipping, and such data may be returned for every 10^th frame of audio data. This may reduce data transfer bandwidth, depending on the value of the “frameskip” attribute 810. The client system 110 may save the data returned 812 by the STREAM message 800 in a queue or memory for analysis.

FIG. 9 is an RCS protocol HALT message 900. The HALT message 900 may terminate the STREAM message 800 data transmission of FIG. 8. When the application 116 receives the HALT message 900, the transmission of STREAM data 812 may be terminated.

FIG. 10 is an RCS protocol STREAMAUDIO message 1000. The STREAMAUDIO message 1000 may obtain an audio stream from the wireless communication device 120 before it is processed by the application or speech enhancement system 116. For example, the speech enhancement system 116 may receive audio data (speech) on four channels, based on multiple microphones. To analyze the audio stream prior to processing by the speech enhancement system 116, the client system 110 may set a “chantype” attribute (channel type) 1004 to a value of “mic-in.” This may indicate that microphone audio data is requested. A “chanid” attribute 1006 may be set to a value of about two, which may indicate that a second microphone channel is desired. Once the application 116 receives the STREAMAUDIO command 1000, it will continue to send the audio data (microphone data) to the client system 110 on a continuous frame-by-frame basis, until terminated by a halt command.

FIG. 11 is an RCS protocol HALTAUDIO message 1100. The HALTAUDIO message 1100 may terminate the STREAMAUDIO message 1000 data transmission shown in FIG. 10. When the application 116 receives the HALTAUDIO message 1100, transmission of STREAMAUDIO data may be terminated.

FIG. 12 is an RCS protocol INJECTAUDIO message 1200. The INJECTAUDIO message 1200 may inject or direct an audio stream, such as a test audio pattern, from the client system 110 to the speech enhancement system 116, by bypassing audio inputs. This message may be used to evaluate and debug various processing modules 304 in the speech enhancement system 116. The client system 110 may send, for example, 512 bytes of data to the speech enhancement system 116 using the INJECTAUDIO command 1200, which may be specified in a “length” attribute 1204. Other payload lengths may be used.

FIG. 13 is an RCS protocol STARTAUDIO message 1300. The STARTAUDIO message 1300 may synchronize audio streams transmitted in response to the STREAMAUDIO message 1000 shown in FIG. 10. Streams of audio data from multiple channels may be synchronized or transmitted from the application 116 to the client system 110 such that each channel transmission may be aligned in frame number. Use of the STARTAUDIO message 1300 assumes that the STREAMAUDIO message 1000 has been previously transmitted. The STARTAUDIO message 1300 acts as the trigger to begin stream transmission.

FIG. 14 is an RCS protocol RESET message 1400. The RESET message 1400 may cause the speech enhancement system 116 to reset parameters of the speech enhancement system 116 or application to factory defined default values. In some applications, the command resets all of the programmable parameters.

FIG. 15 is an RCS protocol RESTART message 1500. The RESTART message 1500 may cause the speech enhancement system 116 to de-allocate the memory corresponding to all of the processing modules 304. After the memory has been de-allocated, the speech enhancement system 116 may allocate the memory corresponding to all of the processing modules 304 to be activated.

FIG. 16 is an RCS protocol INIT message 1600. The INIT message 1600 may define which of the processing modules 304 will be created in response to the RESTART message 1500 shown in FIG. 15. A “param” attribute 1604 may contain the name of the processing module to be created. The speech enhancement system 116 may save the names of the processing modules in a queue or buffer based on the transmission of one or more INIT messages 1600. When the RESTART message 1500 is received, the speech enhancement system 116 may then create or allocate memory for all of the processing modules whose names or identifiers have been saved in the queue or buffer.

FIG. 17 is an RCS protocol VERSION message 1700. The VERSION message 1700 may provide a version identifier of the RCS protocol 202 and the processing modules 304. FIG. 18 is an RCS protocol GENERIC ERROR message 1800. The GENERIC ERROR message 1800 may inform the client system 110 that an unrecognizable message has been received by the application or speech enhancement system 116. FIG. 19 is an RCS protocol USER DEFINED RESPONSE message. The USER DEFINED RESPONSE message 1900 may be used to provide a customized message from the application 116 to the client system 110.

In some systems, the processing modules 304 may be created and/or destroyed individually by the appropriate commands sent by the client system 110. It is not necessary that memory for all of the processes be created or destroyed at one time.

The logic, circuitry, and processing described above may be encoded in a computer-readable medium such as a CDROM, disk, flash memory, RAM or ROM, an electromagnetic signal, or other machine-readable medium as instructions for execution by a processor. Alternatively or additionally, the logic may be implemented as analog or digital logic using hardware, such as one or more integrated circuits (including amplifiers, adders, delays, and filters), or one or more processors executing amplification, adding, delaying, and filtering instructions; or in software in an application programming interface (API) or in a Dynamic Link Library (DLL), functions available in a shared memory or defined as local or remote procedure calls; or as a combination of hardware and software.

The logic may be represented in (e.g., stored on or in) a computer-readable medium, machine-readable medium, propagated-signal medium, and/or signal-bearing medium. The media may comprise any device that contains, stores, communicates, propagates, or transports executable instructions for use by or in connection with an instruction executable system, apparatus, or device. The machine-readable medium may selectively be, but is not limited to, an electronic, magnetic, optical, electromagnetic, or infrared signal or a semiconductor system, apparatus, device, or propagation medium. A non-exhaustive list of examples of a machine-readable medium includes: a magnetic or optical disk, a volatile memory such as a Random Access Memory “RAM,” a Read-Only Memory “ROM,” an Erasable Programmable Read-Only Memory (i.e., EPROM) or Flash memory, or an optical fiber. A machine-readable medium may also include a tangible medium upon which executable instructions are printed, as the logic may be electronically stored as an image or in another format (e.g., through an optical scan), then compiled, and/or interpreted or otherwise processed. The processed medium may then be stored in a computer and/or machine memory.

The systems may include additional or different logic and may be implemented in many different ways. A controller may be implemented as a microprocessor, microcontroller, application specific integrated circuit (ASIC), discrete logic, or a combination of other types of circuits or logic. Similarly, memories may be DRAM, SRAM, Flash, or other types of memory. Parameters (e.g., conditions and thresholds) and other data structures may be separately stored and managed, may be incorporated into a single memory or database, or may be logically and physically organized in many different ways. Programs and instruction sets may be parts of a single program, separate programs, or distributed across several memories and processors. The systems may be included in a wide variety of electronic devices, including a cellular phone, a headset, a hands-free set, a speakerphone, communication interface, or an infotainment system.

While various embodiments of the invention have been described, it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the invention. Accordingly, the invention is not to be restricted except in light of the attached claims and their equivalents.

Claims

1. A remote control server protocol system for transporting data, comprising: a client system having a processor and memory;a server application in communication with the client system, the server application having a plurality of modules, where the client system communicates with the server application remotely using a platform-independent communications protocol configured control operation of the server application;the client system configured to send command messages and/or audio stream data messages to the server application, and the server application is configured to send response messages and/or audio stream data messages to the client system in response to the command messages sent from the client system; andwhere the messages are sent over a single communications channel using the platform-independent communications protocol.

2. The system of claim 1, where the server application is a speech enhancement system.

3. The system of claim 2, where each module of the speech enhancement system performs a speech enhancement process.

4. The system of claim 2, where at least one module is a noise reduction module.

5. The system of claim 3, where the speech enhancement processes are selected from the group consisting of an echo-cancellation process, an automatic gain control process, a noise reduction process, a parametric equalization process, a high-frequency encoding process, a wind buffet removal process, a dynamic limiting process, a complex mixing process, a noise compensation process, and a bandwidth extension process.

6. The system of claim 1, where the communications protocol is in an XML or an XML-derived language format.

7. The system of claim 3, where at least one speech enhancement processes is created and corresponding memory space is allocated remotely under control of the client system using the platform-independent communications protocol.

8. The system of claim 3, where at least one speech enhancement processes is destroyed and corresponding memory space is de-allocated remotely under control of the client system using the platform-independent communications protocol.

9. A method for transporting data, comprising: providing a client system;providing a server application in communication with the client system, the server application having a plurality of modules;sending command messages and/or audio stream data messages from the client system to the server application to remotely control operation of the server application;sending response messages and/or audio stream data messages from the server application to the client system in response to the command messages sent from the client system; andwhere the messages are sent over a single communications channel using the platform-independent communications protocol.

10. The method of claim 9, where the server application is a speech enhancement system.

11. The method of claim 10, where each module of the speech enhancement system performs a speech enhancement process.

12. The method of claim 10, where at least one module performs a noise reduction process.

13. The method of claim 11, where the speech enhancement processes are selected from the group consisting of an echo-cancellation process, an automatic gain control process, a noise reduction process, a parametric equalization process, a high-frequency encoding process, a wind buffet removal process, a dynamic limiting process, a complex mixing process, a noise compensation process, and a bandwidth extension process.

14. The method of claim 9, where the communications protocol is in an XML or an XML-derived language format.

15. The method of claim 11, further comprising creating at least one speech enhancement process by allocating corresponding memory under control of the client system remotely using the platform-independent communications protocol.

16. A computer-readable storage medium having processor executable instructions to transport data by performing the acts of: providing a client system operable by a user;providing a server application in communication with the client system, the server application having a plurality of modules;sending command messages and/or audio stream data messages from the client system to the server application to remotely control operation of the server application;sending response messages and/or audio stream data messages from the server application to the client system in response to the command messages sent from the client system; andwhere the messages are sent over a single communications channel using the platform-independent communications protocol.

17. The computer-readable storage medium of claim 16, further comprising processor executable instructions to cause a processor to perform the act of providing a speech enhancement system in the server application.

18. The computer-readable storage medium of claim 17, further comprising processor executable instructions to cause a processor to perform the act of performing a noise reduction process.

19. The computer-readable storage medium of claim 17, further comprising processor executable instructions to cause a processor to perform the act of selecting a speech enhancement process from the group consisting of an echo-cancellation process, an automatic gain control process, a noise reduction process, a parametric equalization process, a high-frequency encoding process, a wind buffet removal process, a dynamic limiting process, a complex mixing process, a noise compensation process, and a bandwidth extension process.

20. The computer-readable storage medium of claim 16, further comprising processor executable instructions to cause a processor to perform the act of providing communications protocol in an XML or an XML-derived language format.

21. The computer-readable storage medium of claim 17, further comprising processor executable instructions to cause a processor to perform the act of creating at least one speech enhancement process by allocating corresponding memory under control of the client system remotely using the platform-independent communications protocol.

22. The computer-readable storage medium of claim 17, further comprising processor executable instructions to cause a processor to perform the act of destroying at least one speech enhancement process by de-allocating corresponding memory space under control of the client system remotely using the platform-independent communications protocol.

23. A remote control server protocol that transports data comprising: a memory that retains control and configuration data; anda processor in communication with the memory that is configured to transport control, configuration, and monitoring data.

24. A method for transporting data, comprising: providing a server application having a plurality of modules;the server application receiving command messages and/or audio stream data messages, the command messages configured to control operation of the server application;sending response messages and/or audio stream data messages from the server application in response to the command messages received; andwhere the messages are sent over a single communications channel using the platform-independent communications protocol.

25. A method for transporting data, comprising: providing a client system;sending command messages and/or audio stream data messages from the client system to remotely control operation of an external application;the client system receiving response messages and/or audio stream data messages in response to the command messages sent from the client system; andwhere the messages are sent over a single communications channel using the platform-independent communications protocol.