Patent Application
20070198878
The present invention relates to a two-way communication method, apparatus, system, and computer program. More specifically, the present invention relates to a two-way communication method, apparatus, system, and computer program suitable for achieving reduction of quality degradation of a medium, which is caused by a data loss produced in a transmission line, and communication with a stable quality in two-way communication for picture images, sounds, or the like via a network. Further, the present invention relates to a method, apparatus, and program which can allow setting of trade-offs of maintenance of a quality and increase of a delay in two-way communication depending upon conditions of a transmission line and user's demands for a delay/quality.
Recently, there has been rapidly popularized two-way communication, called VolP (Voice over IP) or TVoIP (TV over IP), for communicating encoded data of picture images or sounds via a network with use of packets. Several kinds of encoding methods are used for such two-way communication. For example, methods of transmitting encoded data compressed at a high efficiency based on an interframe prediction are often used as encoding methods for moving picture images. In these methods, prediction parameters and prediction residue picture image data obtained by predicting encoded picture image data from temporally adjacent frames are encoded to reduce the amount of information of moving picture image data that are temporally correlative. Further, the prediction residue picture image data are compressed and encoded at a high efficiency by transform encoding or quantization, thereby allowing communication at a small transmission band.
The typical examples include methods using compression encoding such as MPEG (Moving Picture Experts Group)-1, MPEG-2, and MPEG-4. In these compression encoding methods, interframe prediction using motion compensation is performed on each macroblock, which is a rectangular area having a predetermined size, in input image frames. Two-dimensional discrete cosine transform and quantization are performed on the obtained motion vectors and the prediction residue picture image data to convert the compressed signal data into variable length codes.
Further, with regard to sounds, there are sound (music) encoding methods including G.722, G.729, AMR-NB (Adaptive Multi Rate-Narrow Band), AMR-WB (Adaptive Multi Rate-Wide Band), MPEG-4_AAC (Advanced Audio Codec), and the like. In each method, highly efficient encoding is conducted on a predetermined amount of a sample to thereby allow sound data to be transmitted with a high sound quality at a small transmission band.
There are many methods of distributing such encoded data of picture images or sounds to an IP (Internet Protocol) network employing a packet switching method.
Further, it is expected that mobile stations formed by PHS (Personal Handyphone System) and cellular phones or portable devices using PHS and cellular phones as communication means will henceforth develop to a two-way communication system in a mobile communication system connected to a wireless base station via a radio channel.
Technical Document 1 (M. Handley, H. Schulzrinne, E. Schooler, J. Rosenberg, “SIP: Session Initiation Protocol”, RFC2543, March 1999, the Internet URL <http://www.ietf.org/rfc/rfc2543.txt>) and Technical Document 2 (M. Handley, V. Jacobson, “SDP: Session Description Protocol”, RFC2327, April 1998, the Internet URL <http://www.ietf.org/rfc/rfc2327.txt>) refer to SIP (Session Initiation Protocol)/SDP (Session Description Protocol), which will be described later. Further, Technical Document 3 (H. Schulzrinne, S. Casner, R. Frederick, V. Jacobson, “RTP: A Transport Protocol for Real-Time Applications”, RFC3550, January 2003, the Internet URL <http://www.ietf. org/rfc/rfc3550.txt>) refers to RTP, which will be described later.
In conventional two-way communication, if there is a data error or a missing transmission packet in a transmission line, then received encoded data cannot be decoded correctly, so that quality degradation of a medium is caused.
Further, in order to achieve two-way communication, it is necessary to reduce a delay so as not to be larger than a predetermined value. It is difficult to request resending of lost data and to resend the data.
Furthermore, in a case where interframe prediction is used in an encoding method of picture images or sounds, once disturbance of picture images or sounds is produced, the disturbance is problematically propagated to subsequent frames.
From this point of view, there is a method of performing an interleave process before transmission to a transmission line so as to disperse burst losses produced in a wireless transmission line within an interleave process unit to thereby prevent a consecutive data loss, and a method of recovering errors or lost data with use of an error correcting code such as FEC (Forwards Error Correction). However, direct application of these methods causes an increase of a delay and has a difficulty in use in two-way communication.
Accordingly, the present invention has been made in view of the above drawbacks. A major object of the present invention is to provide a method, apparatus, system, and program which can achieve two-way communication with a possible stablest quality based on setting of trade-offs of users' demands for a quality of a medium, a delay, a band, and a delay.
Further, another object of the present invention is to provide a method, apparatus, system, and program which can achieve two-way communication capable of coping with users' demands for a quality and a delay even in a transmission line in which an up-link and a down-link are asymmetric.
Furthermore, still another object of the present invention is to provide a method, apparatus, system, and program which can achieve two-way communication capable of reducing stability of a quality and an increase of a process delay depending upon varied data errors or loss conditions in a transmission line.
According to a first aspect, a communication system according to the present invention has means for capturing a medium signal, means for encoding the captured medium data, interleave process means, transmitting means to a transmission line, receiving means from the transmission line, de-interleaving means, means for decoding the encoded data, and means for playing back the decoded medium data, and may further have means for setting encoding setting of the encoding means, interleave process setting, and transmission setting of the transmitting means, and means for communicating at least one of the encoding setting, the interleave process setting, the transmission setting, and a receiving status of the encoded data. The communication system encodes and transmits the captured signal of a medium, and receives, decodes, and plays back the encoded data.
According to a second aspect, a communication system according to the present invention has means for capturing a medium signal, means for encoding the captured medium data, means for generating error correcting code data from the encoded data, transmitting means to a transmission line, receiving means from the transmission line, means for recovering data with the error correcting code when the received encoded data have an error or a missing part, means for decoding the encoded data, and means for playing back the decoded medium data, and may further have means for setting encoding setting of the encoding means, error correcting code data generation process setting, and transmission setting of the transmitting means, and means for communicating at least one of the encoding setting, the error correcting code data generation process setting, the transmission setting, and a receiving status of the encoded data. The communication system encodes and transmits the captured signal of a medium, and receives, decodes, and plays back the encoded data.
According to a third aspect, a communication system according to the present invention has at least two communication apparatuses for communicating with each other via a transmission line. At least one of the two communication apparatuses has encoding means for encoding an inputted medium, interleaving means for performing an interleave process on the encoded data with a predetermined unit, and transmitting means for transmitting the interleaved encoded data to the transmission line. At least another of the two communication apparatuses has receiving means for receiving the encoded data from the transmission line, de-interleaving means for rearranging the encoded data that have been subjected to the interleave process and received into an original order with a predetermined method, decoding means for decoding the encoded data and outputting the decoded data, and playback means for playing back the decoded data.
According to a fourth aspect, a communication method according to the present invention includes a step of encoding an inputted medium, a step of interleaving the encoded data with a predetermined unit, a step of outputting the interleaved encoded data, a step of receiving the encoded data, a step of de-interleaving the received encoded data with a predetermined method, and a step of decoding and playing back the encoded data.
According to a fifth aspect, a computer program according to the present invention includes a program for executing a procedure with a computer (processor) constituting a two-way communication apparatus. The procedure includes a process of encoding an inputted medium, a process of interleaving the encoded data with a predetermined unit, a process of outputting the interleaved encoded data, a process of receiving the encoded data, a process of de-interleaving the received encoded data with a predetermined method, and a process of decoding and playing back the encoded data.
In the present invention, the encoded data to be transmitted and the encoded data to be received may be different from each other in at least one of items including:
A) existence of the interleave process,
B) a unit of the interleave process,
C) an order of the interleaving,
D) a bit rate,
E) a frame rate, and
F) a sampling frequency.
In the present invention, at least one of items of the encoded data including:
A) existence of the interleave process,
B) a unit of the interleave process,
C) an order of the interleaving,
D) a frame rate, and
E) a sampling frequency
may be set by at least one of items including an available band in a transmission line, a data loss pattern in the transmission line, and a user's demand inputted via input means.
In the present invention, at least one of setting information including:
A) existence of the interleave process,
B) a unit of the interleave process,
C) an order of the interleaving,
D) a bit rate,
E) a frame rate, and
F) a sampling frequency
may be communicated to a correspondent by a call connection process.
In the present invention, at least one of setting information including:
A) existence of the interleave process,
B) a unit of the interleave process,
C) an order of the interleaving,
D) a bit rate,
E) a frame rate, and
F) a sampling frequency
may be obtained from a correspondent by a call connection process to decode the received encoded data.
In the present invention, an arrival status of received data including a loss ratio of the received encoded data and a burst length may be transmitted to a correspondent, and
at least one of items of encoded data to be transmitted including:
A) existence of the interleave process,
B) a unit of the interleave process,
C) an order of the interleaving,
D) a bit rate,
E) a frame rate, and
F) a sampling frequency
may be reset in accordance with the arrival status when the arrival status is received from the correspondent.
In the present invention, a sequence number indicative of an order of the encoded data may be provided, or the encoded data may be transmitted in accordance with a format which allows an order of the encoded data to be recognized.
In the present invention, the communication method may include:
a step of generating error correcting code data from the encoded data with a predetermined unit;
a step of outputting at least a portion of at least one of the encoded data and the error correcting code data;
a step of receiving at least a portion of at least one of the encoded data and the error correcting code data;
a step of recovering lost encoded data from at least one of satisfactorily received encoded data and satisfactorily received error correcting code data when the received encoded data has a loss; and
a step of decoding the encoded data.
In the present invention, the error correcting code data to be transmitted and the error correcting code data to be received may be different from each other in at least one of items including:
A) an error correcting encoding method,
B) existence of transmission of the error correcting code data,
C) a bit rate of the error correcting code data, and
D) a unit of error correcting code data generation.
In the present invention, at least one of items of the error correcting code data including:
A) an error correcting encoding method,
B) existence of transmission of the error correcting code data,
C) a bit rate of the error correcting code data, and
D) a unit of error correcting code data generation
may be set by at least one of items including:
an available band in a transmission line,
a data loss pattern in the transmission line, and
a user's demand inputted via input means.
In the present invention, at least one of setting information including:
A) an error correcting encoding method,
B) existence of transmission of the error correcting code data,
C) a bit rate of the error correcting code data, and
D) a unit of the error correcting code data generation
may be communicated to a correspondent by a call connection process.
In the present invention, at least one of setting information of a correspondent including:
A) an error correcting encoding method,
B) existence of transmission of the error correcting code data,
C) a bit rate of the error correcting code data, and
D) a unit of the error correcting code data generation
may be obtained by a call connection process to recover the encoded data when the encoded data has a loss.
In the present invention, an arrival status of received data including a loss ratio and a burst length may be transmitted to a correspondent, and
at least one of items of error correcting code data to be transmitted including:
A) an error correcting encoding method,
B) existence of transmission of the error correcting code data,
C) a bit rate of the error correcting code data, and
D) a unit of the error correcting code data generation
may be reset in accordance with the arrival status when the arrival status is received.
In the present invention, a corresponding relationship of identifiers for identifying the encoded data and the error correcting code data may be communicated to a correspondent, and
the identifiers corresponding to the encoded data and the error correcting code data may be provided and transmitted.
Preferred embodiments of the present invention will be described below. A communication system according to a first embodiment of the present invention has a means (203) for capturing a signal of a medium, an encoding means (204) for encoding the captured medium data, an interleave process means (206), a transmitting means (207) to a transmission line, a receiving means (208) from the transmission line, a de-interleave process means (209), a decoding means (211) for decoding the encoded data, and a means (212) for playing back the decoded medium data. Further, the communication system has a means (202) for determining encoding setting of the encoding means (204), interleave process setting of the interleave process means (206), and transmission setting of the transmitting means (207), and a means (202) for communicating at least one of the encoding setting, the interleave process setting, the transmission setting, and a receiving status of the encoded data. The communication system encodes and transmits the captured signal of a medium, and receives, decodes, and plays back the encoded data.
For example, picture images or voice signals from a camera, a microphone, or the like, which is not shown in the drawings, are subjected to an analog-digital conversion and captured by the medium signal capturing part 203. The conversion is performed based on the following items set by the setting/call connection process part 202 and communicated to the correspondent two-way communication apparatus, or alternatively on the following preset items.
The captured medium data are encoded by the medium encoding part 204 based on the following encoding setting that has been set by the setting/call connection process part 202 and communicated to the correspondent two-way communication apparatus, or alternatively on the following preset encoding setting.
The encoded data are provided with a sequence number so that the order of the encoded data can be recognized, and packetized by the packetizing process part 205, in accordance with a medium data unit and a pay load format set by the setting/call connection process part 202 or a preset medium data unit and a preset pay load format.
Here, for example, when packetizing is conducted based on RTP (Real-time Transport Protocol), a sequence number contained in an RTP header can show the order of the encoded data (see Non-patent Document 3 as to RTP).
The packetized encoded data are outputted from the transmitting part 207 to the transmission line 214 toward a destination address and port communicated from the correspondent two-way communication apparatus or a preset destination address and port.
The two-way communication apparatus 201 receives a packet from the transmission line 214 with the receiving part 208 at a port determined by the setting/call connection process part 202 or a preset port. The de-interleaver 209 rearranges the packet subjected to an interleave process based on the sequence number provided to the packet.
The pay load extraction part 210 extracts the encoded data from the packet rearranged by the de-interleaver 209, and the encoded data are decoded by the medium decoding part 211 based on the following items communicated from the correspondent two-way communication apparatus obtained by the setting/call connection process part 202 or on the following preset items.
Further, the packet is played back based on the following items communicated from the correspondent two-way communication apparatus obtained by the setting/call connection process part 202 or on the following preset items.
As shown in
If a burst data error or loss of the transmission stream is produced in transmission line 304, then the correspondent apparatus receives a stream such as a receiving stream 305. Here, the encoded data 7, 2, and 5 in the receiving stream 305 represent that data errors or losses were produced in the transmission line.
The de-interleaver 306 rearranges the encoded data into an original order so as to obtain a de-interleaved stream 307. As a result, the burst data errors/losses are dispersed so as to reduce quality degradation of the medium as compared to consecutive data errors/losses.
This is particularly effective in sound encoded data. Degradation of a quality of long-time sounds due to consecutive data errors/losses is interspersed so as to be unlikely to be perceived auditorily.
It is more effective to set the interleave process unit to be longer than a burst length of a data error or loss that is produced in the transmission line. Specifically, by increasing the interleave process unit, it is possible to widen a width so as to cope with a burst length of a data error or loss in the transmission line. However, when the interleave process unit is increased, a process delay increases. Accordingly, when a quality required for a medium to be played back is different between a pair of two-way communication apparatuses, it is possible to reduce a delay by setting the interleave process size so as to accord with a quality required by the correspondent.
For example, in
Further, it is desirable that the interleave process unit is changed depending upon a transmission line. Accordingly, in the following cases, it is possible to stabilize a quality and reduce a delay by setting the interleave process units to be asymmetric.
Similarly, a frame rate at which picture images are captured or a sampling frequency at which sounds are captured may be increased in the medium signal capturing part 203 in order to reduce a delay.
When a frame rate of picture images is increased, a picture quality per frame played back by the correspondent two-way communication apparatus is lowered but a delay is reduced unless a bit rate is changed.
Further, for example, in a case where sounds are encoded with AAC, if a sampling frequency of sounds is increased, the encoded data unit per time is increased to thereby increase an overhead. A bit rate assigned to a medium is still lowered unless a bit rate is changed. A quality of sounds played back by the correspondent two-way communication apparatus is lowered but a delay is reduced.
Accordingly, as with the interleave process unit, it is possible to perform communication with setting of trade-offs of demands for a quality and a delay by setting the following items so as to accord with a quality required by the correspondent and communicating the correspondent two-way communication apparatus with the setting/call connection process part 202.
Further, it is possible to change the interleave process unit during the communication by communicating statistical information of the following items of the encoded data, received by the receiving part 208, to the correspondent two-way communication apparatus with SR (Sender Report) or RR (Receiver Report) of RTCP (RTP Control Protocol) by the receiving status transmitting and receiving part 213 (see Non-patent Document 3 as to RTCP).
Here, the interleave process unit can readily be changed by adjusting a break of the interleave unit on the transmitting side, and the size of the interleave process unit can be increased by increasing an interleave buffer on the receiving side. However, with regard to reduction of the size on the receiving side, the size should be changed such that interruption of playback sounds is reduced as much as possible. Accordingly, if the last of a buffer in the de-interleaver 209 is empty, then reduction is conducted from that empty portion. If the buffer is filled with received data, then reduction is conducted from received data that are silent or have a level close to silence, so that it is possible to change the buffer size while interruption of sounds is reduced.
As a result, even in a transmission line having a varied data error/loss pattern, it is possible to achieve effective stabilization of a quality of a medium and reduction of a delay.
In a case where a data error may occur but a data loss or a rearrangement of the order of the packet data do not occur in the transmission line 214, the provision of a sequence number is unnecessary in the packetizing process part 205 if an interleave order in the interleaver 206 is communicated from the setting/call connection process part 202 to the correspondent two-way communication apparatus or is predetermined.
Further, in some encoding methods, such as AMR, an interleave/de-interleave process may be included in a mechanism of a pay load format process. In such a case, the interleaver 206 and the de-interleaver 209 are unnecessary. In this case, the interleave process unit is described in a=fmtp attribute of SDP with “interleaving=” and communicated to the correspondent.
Further, as a matter of course, functions and processes of the setting/call connection process part 202, the medium signal capturing part 203, the medium encoding part 204, the packetizing process part 205, the interleaver 206, the transmitting part 207, the receiving part 208, the de-interleaver 209, the pay load extraction part 210, the medium decoding part 211, and the playback part 212 in the two-way communication apparatus 201 can be implemented by a program control executed in a computer constituting the two-way communication apparatus 201.
A communication system according to a second embodiment of the present invention has a means (203) for capturing a signal of a medium, a means (204) for encoding the captured medium data, a means (403) for generating error correcting code data from the encoded data, a transmitting means (207) to a transmission line, a receiving means (208) from the transmission line, a means (404) for recovering received encoded data with an error correcting code when the data has an error or a missing part, a means (211) for decoding the encoded data, and a means (212) for playing back the decoded medium data. Further, the communication system may have a means (402) for determining encoding setting of the encoding means (204), error correcting code data generation process setting, and transmission setting of the transmitting means (207), and a means (402) for communicating at least one of the encoding setting, the error correcting code data generation process setting, the transmission setting, and a receiving status of the encoded data. The captured signal of the medium is encoded and transmitted. The received encoded data is decoded and played back.
Next, the second embodiment of the present invention will be described below in detail only with regard to portions different from the aforementioned first embodiment with reference to the drawings.
The error correcting encoding part 403 generates error correcting code data from packetized encoded data based on an error correcting encoding method and error correcting code data generation unit set by the setting/call connection process part 402 and communicated to the correspondent two-way communication apparatus or on a preset error correcting encoding method and error correcting code data generation unit, and outputs the error correcting code data from the transmitting part 207 to the transmission line 214 together with the encoded data. For example, an LDPC (Low Density Parity Check) method or a code called FEC (Forward Error Correction), such as a Reed-Solomon code, is generally used in an error correcting encoding method. Such an error correcting code employs existing technology, and hence details thereof will be omitted.
As shown in
Further, in the present embodiment, three error correcting code data units are generated from six encoded data units. However, the number of error correcting data in each error correcting code generation unit is illustrated by way of example and is not limited to the illustrated example as a matter of course.
The transmission stream 503 is transmitted to the correspondent via the transmission line 504.
If the transmission line 504 is, for example, a wireless transmission line and a data error or loss is produced therein, then the correspondent receives a stream such as a receiving stream 505. Here, the encoded data 3, 4, and 5 in the receiving stream 505 represent that data errors or losses were produced in the transmission line.
The error correcting decoding part 506 recovers the encoded data 3, 4, and 5 having data errors/losses from the encoded data and the error correcting code data satisfactorily received. As a result, an influence from the errors/losses in the transmission line is eliminated, and it is possible to perform a playback with an original quality of the medium.
For example, if a packetizing process based on RTP (Real-time Transport Protocol) is used to distinguish between the encoded data of the medium and the error correcting code data in the receiving stream 505, a pay load type contained in an RTP header, SSRC (Synchronization Source identifier), or CSRC (Contributing Source identifier) can be used as an identifier. Different values are set for the encoded data of the medium and the error correcting code data, and a combination of types and values of the data is communicated to the correspondent. Thus, it is possible to identify the encoded data of the medium and the error correcting code data in the error correcting decoding part 506.
Further, in some error correcting encoding methods, only error correcting code data may be transmitted without transmission of encoded data of a medium. In such an encoding method, medium encoded data transmitted and received between the medium code transmitting part 604 and the medium code receiving part 606 are unnecessary.
Here, it is effective to prepare a check matrix for checking error correcting code data with an LDPC method so as to accord with a pattern of data errors or losses produced in the transmission line. Further, the amount of error correcting code data to encoded data of a medium and a unit to generate the error correcting code data are determined by the check matrix.
A process delay by an error correcting code data generation unit is needed to generate error correcting code data. By increasing the generation unit, it is possible to enhance a ratio of recovery from data errors/losses with a smaller amount of error correcting code data. However, on the other hand, a delay increases. Accordingly, when a quality required for a medium to be played back is different between a pair of two-way communication apparatuses, it may be possible to reduce a delay by setting the check matrix so as to accord with a quality required by the correspondent.
For example, in
Further, when a transmission band is limited, it is possible to determine trade-offs between the stability of a quality of a medium and a degree of the quality by changing encoding of a medium and assignment of a bit rate in error correcting code data. This can be set according to a quality required for a medium to be played back by the respective two-way communication apparatuses.
As described above, it is desirable that setting of the check matrix is changed depending upon transmission lines. Accordingly, when different transmission lines are used for an up-link and a down-link, or when an up-link and a down-link have different data error/loss characteristics, it is possible to stabilize a quality and reduce a delay by setting the check matrix to be asymmetric.
In the present embodiment, a frame rate at which picture images are captured and a sampling frequency at which sounds are captured are the same as the first embodiment.
Further, it is possible to grasp error/loss characteristics of the transmission line by communicating statistical information of a data error/loss ratio and an error/loss burst length of encoded data received by the receiving part 208 to the correspondent two-way communication apparatus with, for example, SR (Sender Report) or RR (Receiver Report) of RTCP (RTP Control Protocol). Thus, by communicating the statistical information to the correspondent two-way communication apparatus via the setting/call connection process part 202,
an error correcting encoding method can be changed during the communication,
a check matrix can be changed during the communication, i.e., a bit rate of error correcting code data and a unit to generate the error correcting code data can be changed, and
transmission of the error correcting code data can be stopped/restarted.
For example, when conditions of a transmission line are so good that encoded data of a medium can be transmitted and received with a sufficient high quality, transmission of the error correcting code may be stopped. When the conditions of the transmission line deteriorate, transmission of the error correcting code may be restarted.
Further, the error correcting code data may be transmitted selectively, Thus, it is possible to achieve effective stabilization of a quality of a medium and reduction of a delay even in a transmission line having a varied data error/loss pattern.
In the two-way communication apparatus of the present embodiment, the interleave process (interleaver 206) and the de-interleave process (de-interleaver 209), which have been described in the first embodiment shown in
Further, functions and processes of the setting/call connection process part 402, the medium signal capturing part 203, the medium encoding part 204, the packetizing process part 205, the error correcting encoding part 403, the transmitting part 207, the receiving part 208, the error correcting decoding part 404, the pay load extraction part 210, the medium decoding part 211, and the playback part 212 in the two-way communication apparatus 401 can be implemented by a program control executed in a computer constituting the two-way communication apparatus 401. For example, the two-way communication apparatus 401 constitutes a voice communication apparatus.
Furthermore, functions and processes of the setting/call connection process part 602, the medium signal capturing part 203, the medium encoding part 204, the packetizing process part 205, the error correcting encoding part 603, the medium code transmitting part 604, the error correcting code transmitting part 605, the medium code receiving part 606, the error correcting code receiving part 607, the error correcting decoding part 608, the pay load extraction part 210, the medium decoding part 211, and the playback part 212 in the two-way communication apparatus 601 can be implemented by a program control executed in a computer constituting the two-way communication apparatus 601. For example, the two-way communication apparatus 601 constitutes a voice communication apparatus.
Although the present invention has been described with the above embodiments, the present invention is not limited to the arrangement in the above embodiments. As a matter of course, the present invention includes various changes and modifications which would be made by those skilled in the art without departing from the scope of the present invention.
According to the present invention, it is possible to achieve two-way communication with a possible stablest quality based on setting of trade-offs of user's demands for a quality of a medium, a delay, and a band, and a delay.
Further, according to the present invention, it is possible to achieve two-way communication capable of coping with user's demands for a quality and a delay even in a transmission line in which an up-link and a down-link are asymmetric.
Furthermore, according to the present invention, it is possible to achieve the stability of a quality and two-way communication capable of reducing an increase of a process delay depending upon varied data errors/losses in a transmission line.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2004-176035 | Jun 2004 | JP | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/JP05/11186 | 6/13/2005 | WO | 12/12/2006 |
