Embodiments described herein relate generally to transmission and reception of images.
In order to transmit high-definition video data with high quality on real time within a limited transmission band, such as a wireless band, there is a need for low-latency image compression/decompression technique with capability to follow changing transmission rate and with robustness against transmission errors.
A video-data processing apparatus described in Jpn. Pat. Appln. KOKAI. Publication No. H06-22288 subsamples an image in accordance with pixel phases to separate the image into a plurality of subsampled images, and compresses the plurality of subsampled images. According to this video-data processing apparatus, errors can be concealed based on remaining normal subsampled images even when part of the plurality of subsampled images has been lost due to some errors.
In an image communication method described in Jpn. Pat. Appln. KOKAI Publication No. H11-18086, images are subjected to variable-length compression in units of blocks, and compressed data of each block is transmitted, added with a size of the compressed data. According to this method, a receiving side knows a position of the compressed data of each block in advance, and random access is therefore possible. That is, this image communication method can reduce a propagation range of transmission errors to a block level.
The video data processing apparatus described in Jpn. Pat. Appln. KOKAI. Publication No. H06-22288 does not assume wireless transmission of video data. When video data is wirelessly transmitted, a transmission environment including a transmission error rate changes moment by moment. In general, a subsampling processing deteriorates spatial correlation of an image, and therefore decreases efficiency of image compression which utilizes spatial directional prediction. Therefore, the subsampling processing is adequate for a transmission environment at a high transmission error rate although the subsampling processing is not always adequate for a transmission environment with a low transmission error rate. Since the video-data processing apparatus performs a subsampling processing even at a low transmission error rate, the video-data processing apparatus is inadequate for image compression of high efficiency. Error concealment based on the subsampling processing does not function in a transmission environment in which the transmission error rate is remarkably high (as to make most of a plurality of subsampled images have been lost).
In the image communication method described in Jpn. Pat. Appln. KOKAI Publication No. H11-18086, a compressed data size for each block is stored in data to be transmitted. Therefore, a large amount of information is required for describing the compressed data sizes. Further, when an error occurs in an area of describing such a compressed data size, random access to compressed data in a corresponding block fails, and the error may propagates over a block level.
A general architecture that implements the various features of the embodiments will now be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate the embodiments and not to limit the scope of the invention.
Various embodiments will be described hereinafter with reference to the accompanying drawings.
In general, according to one embodiment, an image transmission apparatus includes a division module, a video processor and an output module. The division module is configured to divide an input image into at least one predetermined unit images. The video processor is configured to generate video data by applying one of first to fourth video processing to the predetermined unit image, the first to fourth video processing being (a) the first video processing of generating the predetermined unit image as the video data, (b) the second video processing of generating the video data by compressing the predetermined unit image, (c) the third video processing of performing a subsampling processing of performing pixel-separation of the predetermined unit image into subsampled images in accordance with pixel phases, and of generating each of the subsampled images as the video data, and (d) the fourth video processing of performing the subsampling processing of separating the predetermined unit image into the subsampled images in accordance with pixel phases, and of generating the video data by compressing each of the subsampled images. The output module is configured to output transmission data comprising a frame number of the predetermined unit image, coordinate information of the predetermined unit image, information for identifying whether the video data has been subsampled or not, pixel phase information of the video data when the subsampling processing has been performed on the video data, information for identifying whether the video data has been compressed or not, size information of the video data, and the video data.
A term of “image-compression/decompression” in this description of the present application may be understood to be substitutive with a term “image-encoding/decoding”.
As shown in
The division module 101 divides the input image 104 into predetermined unit images. Here, the input image 104 is, for example, an image corresponding to one frame included in a video as a target to transmission. The division module 101 spatially divides the input image 104. The division module 101 divides the input image 104 into a plurality of predetermined unit images, for example, as shown in
The video processor 102 applies one of first to fourth video processing described later to each predetermined unit image, to generate video data. Depending on a transmission rate and a transmission error rate, the video processor 102 selects and applies one of the first to fourth video processing to each predetermined unit image. Selection of the video processing in the video processor 102 may be performed either before or after application of the first to fourth video processing. The transmission rate and transmission error rate may be obtained by an arbitrary conventional method.
As shown in
The first video processor 201 performs a first video processing on a predetermined unit image 205. The first video processing includes neither a compression processing nor a subsampling processing for the predetermined unit image 205. Specifically, the first video processor 201 generates video data 208 directly from the predetermined unit image 205. The video data 208 generated by the first video processing contains a large amount of data and has a low error robustness. Therefore, the first video processing is adequate for a transmission environment in which the transmission rate 206 is high and the transmission error rate 207 is low.
The second video processor 202 performs a second video processing on the predetermined unit image 205. The second video processor 202 generates video data 208 by performing a compression processing on the predetermined unit image 205. The second video processing includes no subsampling processing. An arbitrary compression scheme and an arbitrary compression rate may be employed in the second video processing. The video data 208 generated by the second video processing contains a small amount of data and has a low error robustness. Therefore, the second video processing is adequate for a transmission environment in which the transmission rate 206 and the transmission error rate 207 are both low.
The third video processor 203 performs a third video processing on the predetermined unit image 205. The third video processing includes a subsampling processing on the predetermined unit image 205. Specifically, the third video processor 203 separates pixels in the predetermined unit image 205 into a plurality of subsampled images in accordance with pixel phases, and generates each of the subsampled images as video data 208. The third video processing includes no compression processing. An arbitrary subsampling processing scheme may be employed in the third video processing. The video data 208 generated by the third video processing contains a large amount of data and has a high error robustness. Therefore, the third video processing is adequate for a transmission environment in which the transmission rate 206 and the transmission error rate 207 are both high.
The fourth video processor 204 performs a fourth video processing on the predetermined unit image 205. The fourth video processing includes a subsampling processing and a compression processing on the predetermined unit image 205. Specifically, the fourth video processor 204 separates pixels in the predetermined unit image 205 into a plurality of subsampled images in accordance with pixel phases, and performs the compression processing for each of the subsampled images to outputs video data 208. An arbitrary subsampling processing scheme, an arbitrary compression scheme, and an arbitrary compression rate may be employed in the fourth video processing. The video data 208 generated by the fourth video processing contains a small amount of data and has a high error robustness. Therefore, the fourth video processing is adequate for a transmission environment in which the transmission rate 206 is low and the transmission error rate 207 is high.
The subsampling processing has been described to be adequate for a transmission environment with a high transmission error rate 207. However, when the transmission error rate 207 is remarkably high, there is a risk that error concealment based on the subsampling processing does not function in a receiving side. In this case, the video processor 102 may apply a video processing, assuming retransmission of data. For example, the video processor 102 may generate video data 208 by performing the second or fourth video processing at a higher compression rate than usual and may temporarily store the video data 208 in an buffer (not shown) for subsequent retransmission.
Hereinafter, a specific example of the subsampling processing in the third and fourth video processing will be described. The third video processor 203 and fourth video processor 204 each may employ any one fixed subsampling processing or may adaptively select and employ one of a plurality of subsampling processing. When a plurality of subsampling processing are made switchable, information for identifying an applied subsampling processing may be stored in the transmission data 105 (described later).
For example, as shown in
In the subsampling processing, two subsampled images may be generated by separating pixels in a predetermined unit image in a horizontal, vertical, or diagonal (checker board type) direction for even and odd properties.
To the output module 103, the video processor 102 inputs, a frame number of the predetermined unit image, coordinate information of the predetermined unit image, information for identifying subsampled/non-subsampled, pixel phase information, and information for identifying compressed/uncompressed, along with the video data 208 obtained by applying one of the first to fourth video processing. The information for identifying subsampled/non-subsampled indicates whether a subsampling processing has been performed to generate the video data 208. When a plurality of subsampling processing are switched, the information for identifying subsampled/non-subsampled includes identification information for each of the subsampling processing. The pixel phase information indicates a subsampled image expressed by the video data 208 when the subsampling processing has been performed. The information for identifying compressed/uncompressed indicates whether or not a compression processing has been performed to generate the video data 208. The size information of the video data 208 indicates, for example, a total size of the video data 208.
The output module 103 generates transmission data 105 by arranging a format of the data from the video processor 102, and outputs the transmission data 105. The transmission data 105 is transmitted to an image reception apparatus through a transmission channel (for example, a wireless transmission channel) at a transmission rate and a transmission error rate which vary over time. The format of the transmission data 105 is, for example, as shown in
As has been described above, the image transmission apparatus according to the present embodiment switches application/non-application of video processing such as a compression processing and a subsampling processing, based on the transmission rate and transmission error rate which vary over time. Therefore, the image transmission apparatus according to the present embodiment can stably transmit high-quality videos even when the transmission rate or transmission error rate varies.
As shown in
The input module 301 inputs the transmission data 105 to the video-data extraction module 302. When the input module 301 detects an error in the transmission data 105, the input module 301 may request the transmitting side (e.g., an image transmission apparatus 100) to retransmit part or all of the transmission data 105. To detect an error, for example, an existing error correction code may be used.
The video-data extraction module 302 extracts video data 208 from the transmission data 105 in accordance with the size information of the video data included in the transmission data 105. When the information for identifying compressed/uncompressed in the transmission data 105 indicates that a compression processing has been performed on the video data 208, the video data 208 is input to the decompression module 302. Otherwise, when the information for identifying compressed/uncompressed in the transmission data 105 indicates that no compression processing has been performed on the video data 208 and when the information for identifying subsampled/non-subsampled in the transmission data 105 indicates that a subsampling processing has been performed on the video data 208, the video data 208 is input to the inverse subsampling module 304. Still otherwise, when the information for identifying compressed/uncompressed in the transmission data 105 indicates that no compression processing has been performed on the video data 208 and when the information for identifying subsampling/non-subsampling in the transmission data 105 indicates that no subsampling processing has been performed on the video data 208, the video data 208 is input as a predetermined unit image to the display-area determination module 305.
The decompression module 302 decompresses the input video data. Decompression processing performed by the decompression module 303 corresponds to compression processing applied in the transmitting side (such as the image transmission apparatus 100). When the information for identifying subsampled/non-subsampled in the transmission data 105 indicates that a subsampling processing has been performed on the video data 208, the decompressed video data is input to the inverse subsampling module 304. Otherwise, the decompressed video data is input as a predetermined unit image to the display-area determination module 305.
The inverse subsampling module 304 is input with video data corresponding to subsampled images obtained by performing pixel separation on a predetermined unit image. The inverse subsampling module 304 reconstructs a predetermined unit image by performing an inverse subsampling processing (image composition) on a plurality of video data items, in accordance with the pixel phase information in the transmission data 105. When part of subsampled images has been lost, the inverse subsampling module 304 may interpolate (spatially or temporally) lost pixels based on adjacent normal pixels. The inverse subsampling processing performed by the inverse subsampling module 304 corresponds to the subsampling processing applied in the transmitting side (such as the image transmission apparatus 100). For example, when the subsampling processing as shown in
The display-area determination module 305 determines a display area (spatial position) for the predetermined unit image, in accordance with the coordinate information of the predetermined unit image in the transmission data 105 (for example, see
As has been described above, the image reception apparatus according to the present embodiment corresponds to the image transmission apparatus also according to the present embodiment. Therefore, the image reception apparatus according to the present embodiment can stably output high-quality videos even when the transmission rate or the transmission error rate varies.
As shown in
The block division module 401 generates a plurality of image blocks by dividing a predetermined unit image 404. The shape and size of each of the image blocks are not limited. The block division module 401 inputs the plurality of image blocks to the compression module 402.
The compression module 402 compresses the image blocks in accordance with a predetermined size 405. The predetermined size 405 is a parameter which specifies a data amount after compression of each of the image blocks. Specifically, the compression module 402 compresses the image blocks each so as not to exceed the predetermined size 405. The predetermined size 405 may be a variable value or a fixed value. When the predetermined size 405 is a variable value, the value may be varied so as to follow variation of the transmission rate. The compression module 402 inputs compressed data items of the image blocks (hereinafter simply referred to as compressed block data) to the output module 403.
As shown in
As has been described above, the image transmission apparatus according to the present embodiment divides each predetermined unit image into a plurality of image blocks, and compresses each of the plurality of image blocks in accordance with a predetermined size. The image transmission apparatus according to the present embodiment transmits the plurality of compressed block data items with the predetermined size information and total size information. Therefore, by the image transmission apparatus according to the present embodiment, random access to individuals of compressed block data items is possible, and a propagation range of errors is reduced to a block level. That is, even when the transmission error rate temporarily increases, high-quality images can be transmit stably.
As shown in
The input module 501 inputs the transmission data 406 to the separation module 502. When the input module 501 detects an error in the transmission data 405, the input module 501 may request a transmitting side (e.g., an image transmission apparatus 400) to retransmit part or all of the transmission data 406.
The separation module 502 separates the predetermined size information and the set of plurality of compressed block data items, based on the total size information in the transmission data 406. The separation module 502 inputs the predetermined size information and the set of plurality of compressed block data items to the decompression module 503.
The decompression module 503 determines positions (for example, start position) of individuals of the compressed block data items in the set of the plurality of compressed block data items, based on the predetermined size information. Since a predetermined size is assigned to each of the plurality of compressed block data, the decompression module 503 can uniquely identify positions of individuals of the plurality of compressed block data items. The decompression module 503 generates an output image 504 by decompressing the individuals of the plurality of compressed block data items. A decompression processing performed by the decompression module 503 corresponds to the compression processing applied in the transmitting side (such as the image transmission apparatus 400).
When the decompression module 503 detects an error in part of the plurality of compressed block data items, the decompression module 503 may discard corresponding one of the plurality of compressed block data items, and interpolate (spatially or temporally) a corresponding image block, based on an adjacent normal image block. Alternatively, when the decompression module 503 detects an error in part of the compressed block data items, the decompression module 503 may discard a corresponding compressed block data item, and request the transmitting side to retransmit the corresponding compressed block data item. The decompression module 503 may decompress the retransmitted compressed block data item. These two types of processing may be switched, for example, based on the transmission rate. Specifically, the decompression module 503 may be configured to interpolate the image block when the transmission rate is low and to request retransmission when the transmission rate is high.
As has been described above, the image reception apparatus according to the present embodiment corresponds to the image transmission apparatus according to the present embodiment. Therefore, the image reception apparatus according to the present embodiment can randomly access individuals of compressed block data items, and a propagation range of errors is reduced to a block level. That is, even when the transmission error rate temporarily increases, high-quality images can be output stably.
As shown in
The block division module 601 generates a plurality of image blocks by dividing a predetermined unit image 604. The shape and size of each of the image blocks are not limited. The block division module 601 inputs the plurality of image blocks to the compression module 610.
The compression module 610 compresses the image blocks in accordance with a predetermined size 605. The predetermined size 605 is a parameter which specifies a data amount after compression of each of the image blocks. Specifically, the compression module 610 compresses the image blocks each so as not to exceed the predetermined size 605. The predetermined size 605 may be a variable value or a fixed value. When the predetermined size 605 is a variable value, the value may be varied so as to follow variation of the transmission rate. The compression module 610 can select and apply one of a plurality of compression schemes for a block. For example, as shown in
The first compression module 611 applies, to the image block, a first compression processing (lossless compression) such as a differential pulse code modulation (DPCM) which compresses differences between pixels. The second compression module 612 applies, to the image block, a second compression processing (lossy compression) such as a discrete cosine transform (DCT) which utilizes energy concentration onto a low frequency area, accompanied by an orthogonal transform. The third compression module 613 applies, to the image block, a third compression processing (fixed-length compression for a pixel) of a so-called color palette scheme. A compressed block data item generated by the color palette scheme includes a correspondence table (color palette) between pixel values and index numbers, and index numbers assigned respectively to pixels in a block.
The compression module 610 may select a compression scheme depending on a property of each image block. For example, in general, the second compression processing is more adequate for natural images than the third compression processing, and the third compression processing is more adequate for artificial images (such as computer graphics) than the second compression processing. The compression module 610 may experimentally apply the first to third compression processing, and then select a compression processing which minimizes compression distortion. As shown in
As shown in
As has been described above, the image transmission apparatus according to the present embodiment divides each predetermined unit image into a plurality of image blocks, and compresses each of the plurality of image blocks in accordance with a predetermined size. The image transmission apparatus transmits the compressed image blocks together with predetermined size information and total size information. Therefore, by the image transmission apparatus according to the present embodiment, random access to individuals of compressed block data items is possible, and a propagation range of errors can be reduced to a block level. That is, even when the transmission error rate temporarily increases, the image transmission apparatus according to the present embodiment can stably transmit high-quality videos. Further, the image transmission apparatus according to the present embodiment can switch a plurality of compression schemes for a block. Therefore, the image transmission apparatus according to the present embodiment can apply a compression processing adequate for a property of each of the image blocks.
As shown in
The input module 701 inputs the transmission data 606 to the separation module 702. When the input module 701 detects an error in the transmission data 606, the input module 701 may request a transmitting side (e.g., an image transmission apparatus 600) to retransmit part or all of the transmission data 606.
The separation module 702 separates the predetermined size information and the set of the plurality of compressed block data items, based on the total size information in the transmission data 606. The separation module 702 inputs the predetermined size information and the set of the plurality of compressed block data items to the decompression module 710.
The decompression module 710 determines positions (for example, start position) of individuals of the compressed block data items in the set of the plurality of compressed block data items, based on the predetermined size information. Since a predetermined size is assigned to each of the plurality of compressed block data items, the decompression module 710 can uniquely identify the positions of individuals of the plurality of compressed block data items. The decompression module 710 generates an output image 704 by decompressing the individuals of the plurality of compressed block data items in accordance with the identifiers of compression schemes. Decompression processing performed by the decompression module 710 corresponds to compression processing applied in the transmitting side (such as the image transmission apparatus 600). For example, as shown in
The first decompression module 711 corresponds to the first compression module 611 in
When the decompression module 710 detects an error in part of the plurality of compressed block data items, the decompression module 710 may discard a corresponding compressed block data item, and interpolate (spatially or temporally) a corresponding image block, based on an adjacent normal image block. Alternatively, when the decompression module 710 detects an error in part of the compressed block data items, the decompression module 710 may discard a corresponding compressed block data item, and request the transmitting side to retransmit the corresponding compressed block data item. The decompression module 710 may decompress the retransmitted compressed block data item. These two types of processing may be switched, for example, based on the transmission rate. Specifically, the decompression module 710 may be configured to interpolate the image block when the transmission rate is low and to request retransmission when the transmission rate is high.
As has been described above, the image reception apparatus according to the present embodiment corresponds to the image transmission apparatus according to the present embodiment. Therefore, the image reception apparatus according to the present embodiment can randomly access individuals of compressed block data items, and a propagation range of errors is reduced to a block level. That is, even when the transmission error rate temporarily increases, high-quality images can be output stably. The image reception apparatus according to the present embodiment switches and applies a plurality of decompression schemes in accordance with identifiers of compression schemes. Therefore, the image reception apparatus according to the present embodiment can output high-quality images adapted for properties of individuals of image blocks.
An image transmission apparatus 800 according to the fourth embodiment is equivalent to a configuration obtained by substituting the compression module 402 in the image transmission apparatus 400 in
The compression module 810 performs the same compression processing as the compression module 402. Specifically, image blocks each are compressed so as not to exceed a predetermined size 405. Here, the size of each compressed block data item is not always equal to the predetermined size 405 but may generate a residual area (padding area). The residual area is usually filled with meaningless padding bits. The compression module 810 stores a predetermined bit pattern in the residual area, as shown in
As has been described above, the image transmission apparatus according to the present embodiment stores a bit pattern generated in accordance with a common rule, into residual areas which do not reach a predetermined size in each compressed block data item. Therefore, by the image transmission apparatus according to the present embodiment, an error can be determined, depending on equality/inequality concerning bit patterns between the transmitting and receiving sides. That is, high-quality images can be stably transmitted even when the transmission error rate temporarily increases.
An image reception apparatus 900 according to the present embodiment is equivalent to a configuration of the image reception apparatus 500 in
The decompression module 910 performs the same decompression processing as the decompression module 503. Further, when decompressed data of an image block dose not reach a predetermined size, the decompression module 910 generates a bit pattern in accordance with a rule common to the image transmission apparatus 800. The decompression module 910 compares the generated bit pattern with a bit pattern stored in a compressed block data item. When both bit patterns disagree with each other, the decompression module 910 detects an error in the compressed block data item.
Otherwise, when decompressed data of an image block exceeds the predetermined size, the decompression module 910 also detects an error in the compressed block data item. When the decompression module 910 detects an error in a compressed block data item, the decompression module 910 performs interpolation for a corresponding image block or requests retransmission, as in the decompression module 503.
As has been described above, the image reception apparatus according to the present embodiment corresponds to the image transmission apparatus according to the present embodiment. Therefore, by the image reception apparatus according to the present embodiment, an error can be determined, depending on agreement/disagreement between bit patterns in the transmitting and receiving sides. That is, high-quality images can be output even when the transmission error rate temporarily increases.
When “PartitionEnable” described later is 0 (pixel separation is off), 0 is always set in the “partition_type”, which means no pixel separation done.
In order to perform pixel separation in a line direction (vertical direction) in image compression for a predetermined number of lines (eight lines here), a number of vertical lines of a predetermined unit image before the pixel separation need be doubled (to sixteen lines here). Doubling of the number of vertical lines causes an increase of a delay amount and an image memory amount related to compression. Further, when the number of vertical lines is doubled, there is an increase in a delay amount and an image memory amount to scan-convert predetermined unit images into an output image in units of lines, also in image decompression. However, when the pixel separation is limited to the horizontal direction, pixels can be separated into groups of two phases with maintaining the number of lines of a predetermined unit image. Therefore, increases of delay amounts and image memory amounts related to the compression and decompression processing can be suppressed.
Further, when “PartitionEnable” described later is 0, i.e., when the pixel separation is off, slices may be formed by compressing each consecutive eight lines as a predetermined unit. Overhead for slice headers and packetization can then be suppressed. When “PartitionEnable” is 1, i.e., when the pixel separation is on, a pixel separation type is selected, for each consecutive eight lines, from the horizontal right/left division of separating the consecutive eight lines into left and right halves without separation in units of pixels, the horizontal even/odd pixel separation in units of pixels, and the checkerboard-type pixel separation in units of pixels. Compressed transmission with less deterioration in image quality can be achieved by selecting a pixel separation type which optimizes a balance between an error robustness and coding efficiency, depending on a transmission rate and an error rate which vary moment by moment in shorter cycles than one frame. In any of the pixel separation types selected, consecutive eight lines are compressed into two slices, and therefore, the packetizing module 16 and transmitter 17 in a subsequent process can simply operate without considering the pixel separation types (regardless of the pixel separation types).
“h_subsampling”=2 indicates that all image signal components (for example, R, G, and B, or Y, Cb, and Cr) have, been compressed by horizontal reduction to ½. In the receiving side, when “h_subsampling”=1, an enlargement processing is performed, for a decompressed and pixel-composed image, to horizontally double color differential signals. Otherwise, when “h_subsampling”=2, an enlargement processing is performed to horizontally double all image signal components.
No horizontal reduction, reduction of only color differential signals, and reduction of all components are switched for each predetermined unit image, depending on the transmission rate or a property of an image (compression difficulty) for a predetermined unit which vary moment by moment in shorter cycles than one frame. Then, transmission with high image quality can be achieved, optimizing a balance between compression distortion and deterioration of resolution due to size reduction.
A total number NB of blocks (8×8 pixel blocks) of all components that form a slice is calculated as follows.
As shown in
Horizontal left/right division maintains continuity of pixels and does therefore not cause much quality loss, compared with a case of performing no pixel separation, although compression efficiency is expected to deteriorate due to horizontal division into two slices.
Therefore, the compression efficiency deteriorates in an order of the horizontal left/right division or no pixel separation, the horizontal even/odd pixel separation, and the checkerboard-type pixel separation. Further, when a receiving error occurs in one of two separated phases, interpolation pixels are generated from pixels in a normally received phase. Since an image signal subjected to the horizontal even/odd pixel separation maintains only a ½ band in the horizontal direction as shown in
For example, a program which performs each of the embodiments described above can be provided, stored in storage media which are readable from computers. The storage media may employ any type of storage formats insofar as the storage media can store the program and be readable from computers, such as a magnetic disk, an optical disc (such as CD-ROM, CD-R, or DVD), a magneto-optical disc (MO), and a semiconductor memory.
The program which performs processing described in the above embodiments may be stored in a computer (server) connected to a network such as the Internet and may be downloaded by a computer (client) through the network.
The various modules of the systems described herein can be implemented as software applications, hardware and/or software modules, or components on one or more computers, such as servers. While the various modules are illustrated separately, they may share some or all of the same underlying logic or code.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.
Number | Date | Country | Kind |
---|---|---|---|
PCT/JP09/65356 | Sep 2009 | JP | national |
This is a Continuation Application of PCT Application No. PCT/JP2009/066832, filed Sep. 28, 2009, which was published under PCT Article 21(2) in Japanese. This application is based upon and claims the benefit of priority from PCT Application No. PCT/JP2009/065356, filed Sep. 2, 2009; the entire contents of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP09/66832 | Sep 2009 | US |
Child | 13098536 | US |