Patent Application
20060029139
1. Priority Claim
The application claims the benefit of priority from EPO 04017386.6, filed Jul. 22, 2004, which this application incorporates by reference.
2. Technical Field
This invention relates to data transmission schemes for networks. In particular, the invention relates to system for real-time data transmission over a communication link in a vehicle and for re-synchronization at the receiving site.
3. Related Art
Vehicles may include information and entertainment components. Vehicles may use a high-speed network as an infrastructure for managing interacting components in the vehicle. The MOST (Media Oriented Systems Transport) technology standard may be used for high-speed multimedia busses in vehicles. This bus allows a cost efficient communication between all functional blocks of entertainment and information systems such as CD and DVD players, CD changers, cell phones, video systems, in-car PC's and the like. The network bus described by the MOST standard offers a speed of 24.8 Mbits/second which makes it about 100 times faster than control-area network (CAN) busses. CAN busses are typically used in power train applications. The MOST specification defines the hardware interface needed to communicate over the bus, which may be a plastic optical fiber.
The communication on a MOST bus is based on predefined frames including a synchronous area and an asynchronous area. The synchronous and asynchronous areas of a frame may have an arbitrary length where a message to be transmitted may be distributed over a number of frames. The MOST standard also defines an asynchronous packet-transfer mechanism where each packet includes a header portion and a data portion. The MOST bus is a synchronous, circuit-switch network. “Synchronous” means that a single timing master sets the clock for the whole network. All other devices are correspondingly synchronized.
Each MOST frame contains 512 bits and is divided into three separate portions. A first portion having a length of one byte is intended for synchronization administration of the frames. A second portion contains the data to be transmitted, and a last portion with a length of one byte enables a detection of transmission errors. 62 bytes per frame remain for data transmission. This data area may be divided into three different segments intended for transmission of different types of data: synchronized data, asynchronous data, and control and status data.
Although the MOST bus configuration is scalable in that the network can run at any clock frequency that the timing master sets, the bus will only run at that frequency for which the individual MOST bus implementation is provided. Generally, the MOST bus provided in vehicles has a fixed synchronizing scheme with a clock rate of 44.1 kHz. The clock rate is adapted to the transmission of audio data over the communication link. One problem with such MOST bus implementations is that other data to be transmitted between information and entertainment devices within a vehicle may require other clock rates. The individual devices may convert their data stream and clock rate to the bus configuration. Data rate conversion requires additional computational effort for adapting the data rate to the fixed communication link data rate. Also, transmission of a different kind of data may not be accomplished with the same efficiency.
This invention provides a data transmission synchronization method for transmitting a stream of continuous audio and/or video data from a transmitter to a receiver on a communication link. The system determines if signal synchronization information, such as a time stamp, is present in the data stream, and either generates new information or corrects existing synchronization information if necessary before inserting the information into a transmitted data stream. The system may be used in a vehicle information and entertainment system to insure reliable transmission of data stream formats such as MPEG video where isynchronous transmission may be used.
The data transmission synchronization system also may check for auxiliary information in the data stream, and generate new auxiliary information or insert the present auxiliary information into a data stream. By processing and/or generating auxiliary information in the data stream, the invention is adaptable to changing data formats available to the system.
The data transmission synchronization system also provides a transmitter with an analyzing unit for determining whether synchronization information is present in the data stream or is accurate. The transmitter may include a time stamp generator to generate new information or correct inaccurate information. The transmitter also may include a multiplexer for inserting the synchronization information into the data to be transmitted to an external system.
Other systems, methods, features and advantages of the invention will be, or will become, apparent to one with skill in the art upon examination of the following figures and detailed description. It is intended that all such additional systems, methods, features and advantages be included within this description, be within the scope of the invention, and be protected by the following claims.
The invention can be better understood with reference to the following drawings and description. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention. Moreover, in the figures, like referenced numerals designate corresponding parts throughout the different views.
The elements in the Figures interoperate as explained in more detail below. Before setting forth the detail explanation, however, it is noted that all of the discussion below, regardless of the particular implementation being described, is exemplary in nature, rather than limiting. For example, although selected aspects, features, or components of the implementations are depicted as being stored in memories, all or part of systems and methods consistent with the display systems may be stored on, distributed across, or read from other machine-readable media, for example, secondary storage devices such as hard disks, floppy disks, and CD-ROMs; a signal received from a network; or other forms of ROM or RAM either currently known or later developed.
Although specific components of the architecture will be described, methods, systems, and articles of manufacture consistent with the architecture may include additional or different components. For example, a processor may be implemented as a microprocessor, microcontroller, application specific integrated circuit (ASIC), discrete logic, or a combination of other type of circuits or logic. Similarly, memory, may be DRAM, SRAM, Flash, or any other type of memory. Flags, data, databases, tables, and other data structures may be separately stored and managed, may be incorporated into a single memory or database, may be distributed, or may be logically and physically organized in many different ways. Programs may be parts of a single program, separate programs, or distributed across several memories and processors.
The data source 101 may supply the data to be transmitted to an interface 105, which may configure the data for transmission over the communication link 102. The data processed by interface 105 may be supplied to bus transceiver 107, which inserts the data on the communication link 102. The interface 105 and the bus transceiver 107 are not required to be separate devices. The interface 105 and the bus transceiver 107 may be integrated as one device such as a vehicle interface unit or other interface unit. The communication link 102 may be implemented through a MOST network connecting the different devices connected sequentially.
A receiving unit also may include a receiver bus transceiver 108 to establish connection to the communication link 102. The received data may be supplied to an interface 109 to reconstruct the continuous data stream sent from a transmitter. Again, the interface 105 and the receiver bus transceiver 108 may be incorporated into a single unit as already described in connection with an interface 105 and a transmitter bus transceiver 107 of the transmitter. The reconstructed data may then be supplied to the data receiver 113 for further processing.
The transmission system may include an inner synchronization scheme of the MOST network and an outer synchronization scheme for synchronizing the receiver's clock to the source clock. The data to be transmitted may be transferred over the communication link 102 based on the fixed synchronization scheme between the transmitter bus transceiver 107 and the receiver bus transceiver 108. A resynchronization of the transmitted data may be achieved in the receiver interface 109 based on time stamps inserted into the transmitted stream of data on the transmission side.
The transmitter bus transceiver 107 may first divide the continuous stream of data 110 from the transmitting site into a plurality of data packets 111. These data packets may be inserted on the communication link 102. In a receiver interface 109, the data packets 111 may be received from the communication link 102 and reconstructed in order to output a continuous stream of data 110 that corresponds to the original stream of data. The application facilitates the data transmission in the form of data packets 111 by a control scheme, which enables an accurate reconstruction of the original continuous data stream 110 and re-synchronization with the transmitter's clock.
The interfaces 105 and 109 on the receiver and transmitter side respectively may be configured to process a number of different user data formats. Examples include video data encoded with MPEG, JPEG, WMA, WMV, MOV, or audio data encoded with PCM, MP3, WMA, AC3, or other formats. Based on the predefined positions or indications for user data and auxiliary data portions 219, 221, and 223 within the different types of data streams, a reliable separation of audio/video data 214 and its auxiliary data portions 219, 221, and 223 may be accomplished.
The received data packets 312 of a particular receiver may be processed to form a data stream 330 to be output to a reproducing device. Examples of reproducing devices include video displays, audio devices, vehicle information and entertainment devices, and other multimedia devices. The extracted synchronization information 325 is employed to reconstruct the transmitter's clock at the receiving side. The original stream of data 110 may be reliably reconstructed and synchronized.
The communications link 102 may first supply the received stream of continuous data 110 to a separating unit 435. The separating unit 435 may analyze the individual data and may identify the kind of data to be transmitted. The received stream of continuous audio and/or video data 110 may first be supplied to the separating unit 435 and an analyzing unit 437. The analyzing unit 437 may analyze the received data 110 and may identify the kind of data to be transmitted. In particular, the data format may be determined. The data format may include at least one of the following: the type of compression if present, the type of packeting (for example, program stream, transport stream, no packeting), and the data rate. Another data format includes the MPEG international standard, where reference time stamps may be retrieved from a transport stream syntax, a program stream syntax or packetized elementary stream syntax of the continuous stream of audio and/or video data 214.
Depending on the identification result, the appropriate approach for providing synchronization information for the new synchronization scheme may be selected. Specifically, the interface 107 may determine whether or not available synchronization information 325 from the data stream 110 may be retrieved and appropriately incorporated into the data transmitted on the communication link 102. The determination procedure may be performed based on data format properties that may be stored in advance in a memory 426 connected to the analyzing unit 437. The memory 426 may store appropriate processing information, such as the data stream format, packet timing and rate information, compression scheme, and other data information.
The memory 426 may be a solid state memory such as volatile or non-volatile memory, flash, or hard disk drive. The memory 426 may store the analysis information in the form of look-up-table data. According to the format and/or synchronization details of the data stream 110, processing information indicates how to process the data by transmitter 104. In particular, the look-up-table may indicate the conditions for which particular kinds of synchronization information 325 may be generated. The separate memory 426 may supply its content to the analyzing unit 437. The memory 426 also may integrate with the analyzing unit 435 to form a single unit. The memory 426 allows update of new types of data, such as new compression standard or packet formats. The analyzing unit 437 functionality may be enhanced or reconfigured based on the memory 426 contents.
The separating unit 435 may provide audio and/or video data 214 which may or may not contain any auxiliary information 219, 221, and 223. The auxiliary information 219, 221, and 223 may be output separately. When the received data 110 does not include any auxiliary information 219, 221, and 223, the analyzing unit 437 may analyze the received data stream 110 to extract particular parameters. The analyzing unit 437 may analyze the received data 110 based on audio and/or video formats that are configured in the system in advance from the look-up-table data stored in the memory 426. Depending on the detected format of the data, the analyzing unit 437 may separate the audio and/or video sample values from the auxiliary information 219, 221, and 223, and determine the type of synchronization information 325 to be generated.
The memory 426 may be configured in advance to enable analyzing unit 435 to analyze and identify any of the relevant data formats such as transmission formats like MPEG (PS—Program Stream, TS—Transport Stream), interface formats like S/PDIF (Sony/Phillips Digital Interface—a standard audio transfer format) or 12S, and data type formats like PCM, MP3, WMA, AC3, AAC, DTS or MLP.
The separating unit 435 may extract existing time stamps or any kind of clock reference information—if available—from the received data stream 110 for further use in the multimedia system. The extraction operation is automatically initiated upon detection of a data format including such synchronization information. The received data 110 also may be converted into a particular data format different from the received data format before transmission. The received data format will then be transmitted as auxiliary information 219, 221, and 223 in the header portion 217 of a data packet 111 in order to enable reconstruction and/or further processing of the received data format on the receiver side. Although the data transmission is performed based on the fixed clock rate of the communication link 102, the clock rate for re-synchronization of the receiver 400 to the transmitter 500 is independent of the transmission clock rate. In particular, the resynchronization clock rate may be higher or even a fractional multiple of the communication link clock rate. This is accomplished by using an independent synchronization scheme over the fixed synchronization of the communication link 102.
No synchronization of the transmitter 500 and receiver 400 to the clock of the communication link 102 is required, as the receiver 400 will automatically synchronize to the transmitter's clock—independently of the clock on the communication link 102. Thus, an isynchronous transmission, i.e., an asynchronous transmission over a synchronous communication link of real time data, may be achieved.
A multiplexer 450 may combine the audio and/or video data 214 with the header information 217 containing the auxiliary information 219, 221, and 223, time stamps 425 and additional control information needed for the multimedia network control (not shown). The time stamps 425 are received from a time stamp generator 455. The generator 455 provides clock reference information to enable a resynchronization of the transmitted data on the receiver side in accordance with control information received from analyzing unit 437. The multiplexer 450 may receive the separate information from the respective sources and may combine the separate information to provide the individual data packets 111 for transmission on communication link 102.
The time stamp generator 426 may produce time data or count values as reference clock information 427. These data may be generated based on an internal clock or by a clock received from an external device. The reference clock information 427, in particular the time stamps 425, which are extracted from the continuous input data stream 110, may be used. The continuous stream of audio and/or video data 214 may bein a transport stream format in accordance with the MPEG international standard and the existing time stamps 425 may be the program clock reference time stamps of the transport stream, program stream, or packetized elementary stream.
The time stamp extractor 562 may extract the synchronization information 325 from the received data packets 112 and may apply the extracted synchronization information 325 to the clock generator 566. The clock generator 566 may generate a new clock 577 based on the received synchronization information 325. The audio and/or video data 570, the auxiliary information 571 and the new clock 577 may be applied to a post processing device 575 to further process the received data. The post-processing device 575 may, for instance, decode the received audio and/or video data 214 for reproduction purposes. For example, the post-processing device 575 may process the data 214 for multichannel sound output, video sizing or spatial and/or temporal effects, and other audio and/or video processing effects. The post-processing (in particular a decoding processing) may be simplified by the auxiliary data 219, 221, and 223. Based on the data properties included in the auxiliary data 219, 221, and 223, the system may avoid time consuming detection and processing capacity. If the user data have been converted to a common data format, the extracted data 512 may be reconverted in a data converter 576 which may replace or may be included in the de-packetizer 564. The extracted data 214 may be reconverted to the original data format 567 based on format information transmitted within the auxiliary data 219.
Processing capacity needed for analyzing the data stream and identifying the particular details thereof may be shifted from the receiving side to the transmitting side. This is advantageous when transmitting data from a small number of transmitters to a large number of receivers. The total amount of processing power needed within such an information and entertainment system may be reduced without adversely affecting the processing results.
The reproduced/received data 101 may be supplied to the processing unit 642. The processing unit 642 may be configured to process the received data 101 to transmit the processed data 643 to a remote device. The data source 101 may be from a data storage device like a CD or a DVD, received from a data network or broadcasting network like the Internet or radio/tv network, or from a wireless connection such as a WiFi, Bluetooth, or infrared connection to a data stream. The processing unit 642 may be a CD or DVD player, a DVB receiver, a car navigation system, a cell phone, car radio, vehicle information and entertainment units, or other devices. The processed data 110 may generally be in compliance with a standard data format such as MPEG (PS—Program Stream, TS—Transport Stream), interface formats like S/PDIF (Sony/Phillips Digital Interface—a standard audio transfer format) or 12S, and data type formats like PCM, MP3, WMA, AC3, AAC, DTS or MLP.
The processed data 110 are output from the processing unit 642 to the transmitting interface 105, where the transmitting interface 105 transmits the transmitted data 112 to a remote device on the communication link 102. The data 110 to be transmitted are first supplied to the audio format adapting device (AFA) 646 which corresponds to the separating unit 435 and the analyzing unit 437 of
The AFA unit 646 determines the data transmission format from the received data stream 643. Depending on the detection result, the AFA unit 646 may either: extract synchronization information 325 from the received data stream 101 for use as reference clock information or may generate reference clock information. The synchronization information 325 extracted from the received data stream 101 may be inserted into the transmitted data packets. In addition, an external clock reference signal 644 may be applied to the time stamp generator 652 for generating or adapting the synchronization information 325. The stream of audio or video data 214 may be supplied to the packetizer 650 for dividing the continuous stream of data into data packets of a predefined size. The resulting data packets may be supplied to the MOST multiplexer 654.
The multiplexer 654 may add the header portion to the data packets 111 received from the packetizer 650. The data portion may include control information mandatory for the packet handling on communication link 102, auxiliary information 219, 221, and 223 extracted from the original data stream 101 and reference clock information 653. The data packets 112 may be output to the communication link 102, such as a MOST network. An encryption unit 656 may process the data packets 112 before inserting the data packets 655 on the communication link 102. Encrypting the data packets prevents unauthorized access to the data transmitted over the communication link 102. The encryption unit 656 may be incorporated into the transmitter interface 105, allowing the encryption unit 656 to encrypt the data output from the packetizer 650. The data also may be decrypted on the receiving side 109 and 113. The decrypting unit may be provided ahead of the receiver interface 109 or may integrate with the receiver interface 109.
The synchronization information 325 may be in the form of time stamps 425 inserted into the data packet 111, for example into the header portion 217. The transfer rate of the communication link 102 may exceed the data rate required for the continuous stream of data 110 when segmenting the data into packets based on the received continuous stream of data 110. The transmission of data packets may require “stuffing” packets 320 to adapt the communication link's 102 data rate to that required for the transmission of the continuous stream of data 110.
The time stamp values for each of the time stamps 425 may be calculated based on the clock signal of the continuous stream of data 110. For instance, an audio data stream may be based on a system clock of 27 MHz. Based on this clock signal, a time stamp counter may calculate time stamp values to be inserted into the stream of data 310 to be transmitted.
The transmitter 400 as well as the receiver 500 may require a constant processing delay 805 and 825 when processing the continuous stream of data 110. While the generation of time stamp values 425 for the data stream 110 may take into account the individual packet position, such as offsets resulting from stuffing packets 820, the constant processing delay of the receiver may enable an extraction of the received data packet 112, each having a correct position for its time stamp value 425.
To correct the available time stamp values 425 into the corrected time stamp values 920, the time stamp generator 426 may initiate a counting procedure starting from a present value 763. The preset value 763 may correspond to the obtained time stamp 425 from the continuous stream of data 110. The count value is incremented according to the system clock 644 received together with the continuous stream of data 110. The existing time stamp values 425 may be corrected with the insertion position within the stream of data 110 transmitted on communication link 102. The constant preprocessing delays 805 and 825 may enable the reconstruction of the output stream 330 while each packet 111 has a position corresponding to its time stamp value 425.
The receiver 400 first may determine the position of each received data packet 111 and may adjust the received data packet 111 based on the correction value 1050. The receiver may apply a constant delay 1070 (preferably a constant memory delay) to each received data packet and may extract the individual data packet 111 based on an individual offset value 1080 obtained from the correction value 1050. The constant delay value 1070 for buffering all received data packets may be a constant value exceeding the maximum time shift 1080. A synchronization may be achieved, even if no external clock signal for the data to be transmitted is available. By employing the synchronization scheme of the application, audio and video data 110 may be transmitted on the same communication link 102 without any costly hardware for adapting the data rate of the continuous stream of data 110 to the communication link 102 clock.
The application avoids a synchronized transmission and enables the use of a packetized transmission mechanism for a synchronous transmission of data, in particular for real time applications of audio and/or video data. Available synchronization information within the data is identified and reused for efficient transmission and resynchronization purposes to adapt the synchronization scheme to the data format. A transparent and efficient transmission of data may be achieved over a packet-based transmission network.
The sequence diagrams of
A “computer-readable medium,” “machine-readable medium,” “propagated-signal” medium, and/or “signal-bearing medium” may include any means that contains, stores, communicates, propagates, or transports software for use by or in connection with an instruction executable system, apparatus, or device. The machine-readable medium may selectively be, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. A non-exhaustive list of examples of a machine-readable medium would include: an electrical connection “electronic” having one or more wires, a portable magnetic or optical disk, a volatile memory such as a Random Access Memory “RAM” (electronic), a Read-Only Memory “ROM” (electronic), an Erasable Programmable Read-Only Memory (EPROM or Flash memory) (electronic), or an optical fiber (optical). A machine-readable medium also may include a tangible medium upon which software is printed, as the software may be electronically stored as an image or in another format (e.g., through an optical scan), then compiled, and/or interpreted or otherwise processed. The processed medium may then be stored in a computer and/or machine memory.
While various embodiments of the invention have been described, it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the invention. Accordingly, the invention is not to be restricted except in light of the attached claims and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 04017386.6 | Jul 2004 | EP | regional |
