Patent Application
20190222881
The present disclosure relates to an information processing apparatus and an information processing method, and more particularly to an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams.
In recent years, OTT-V (Over The Top Video) has become mainstream in the streaming services on the Internet. One technique that has started to come into wide use as the fundamental technology for OTT-V is MPEG-DASH (Moving Picture Experts Group phase-Dynamic Adaptive Streaming over HTTP (HyperText Transfer Protocol)) (see, for example, NPL 1).
According to MPEG-DASH, a distribution server provides encoded streams having different bit rates for one moving-image content, and a playback terminal demands encoded streams having an optimum bit rate, thereby realizing adaptive streaming distribution.
MPEG-DASH SRD (Spatial Relationship Description) extension defines SRD indicating the position on a screen of one or more individually encoded regions into which an image of a moving-image content has been divided (see, for example, NPLs 2 and 3). The SRD makes it possible to realize a ROI (Region of Interest) function of spatial adaptation for selectively acquiring an encoded stream of an image of a desired regions, using a bitrate adaptation method for selectively acquiring encoded streams having desired bit rates.
Images of moving-image contents include not only images captured through angles of field by a single camera, but also entire celestial sphere images where images captured horizontally around 360° or vertically around 180° are mapped onto 2D (Two-Dimensional) images (planar images), and panoramic images captured horizontally around 360°. For example, if an entire celestial sphere image is to be divided horizontally into three or more regions and the regions are to be encoded, then since the regions at both horizontal ends represent contiguous images, they can be encoded as one image.
However, inasmuch as the positions on the screen of the regions at both ends are discrete, there are a plurality of positions on the screen of objects to be encoded. According to MPEG-DASH, therefore, the positions on the screen of the regions at both ends cannot be described using an SRD. In other words, an SRD is unable to describe the position on a screen of an image made up of a plurality of divided images compatible with encoded streams.
According to an SRD, the positions on a screen of respective regions and positions on images compatible with encoded streams are described as identical to each other. Therefore, if the positions on a screen of respective regions and positions on images compatible with encoded streams are different from each other, the positions on the screen of the respective regions cannot be described using the SRD. In other words, if the positions on the screen of respective divided images that make up an image and positions on images compatible with encoded streams are different from each other, then an SRD is unable to describe the positions on the screen of the respective divided linages.
[NPL 1]
MPEG-DASH (Dynamic Adaptive Streaming over HTTP) (URL: http://mpeg.chiariglione.org/standards/mpeg-dash/media-presentation-description-and-segment-formats/text-isoiec-23009-12012-dam-1)
[NPL 2]
“Text of ISO/IEC 23009-1:2014 FDAM 2 Spatial Relationship Description, Generalized URL parameters and other extensions,” N15217, MPEG111, Geneva, February 2015
[NPL 3]
“WD of ISO/IEC 23009-3 2 nd edition AMD 1 DASH Implementation Guidelines,” N14629. MPEG109, Sapporo, July 2014
Therefore, it has been desirous of reliably describing the position on a screen of an image made up of a plurality of divided images or the positions on a screen of divided images compatible with encoded streams, so that they can be recognized.
The present disclosure has been made under the circumstances described above, and is aimed at reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on a screen of divided images compatible with encoded streams.
An information processing apparatus according to a first aspect of the present disclosure is an information processing apparatus including a setting section that sets a position protruding out of a screen as a position on the screen of an image made up of a plurality of divided images compatible with encoded streams.
An information processing method according to the first aspect of the present disclosure corresponds to the information processing apparatus according to the first aspect of the present disclosure.
According to the first aspect of the present disclosure, a position protruding out of a screen is set as a position on the screen of an image made no of a plurality of divided images compatible with encoded streams.
An information processing apparatus according to a second aspect of the present disclosure is an information processing apparatus including an allocator that places an image obtained by decoding encoded streams on a screen, on the basis of a position protruding oat of the screen which is set as a position on the screen of the image which is made up of a plurality of divided images compatible with the encoded streams.
An information processing method according to the second aspect of the present disclosure corresponds to the information processing apparatus according to the second aspect of the present disclosure.
According to the second aspect of the present disclosure, an image obtained by decoding encoded streams is placed on a screen on the basis of a position protruding out of the screen which is set as a positron on the screen of the image which is made up of a plurality of divided images compatible with the encoded streams.
An information processing apparatus according to a third aspect of the present disclosure is an information processing apparatus including a setting section that sets positions on a screen of respective divided images of an image which is made up of a plurality of divided images compatible with encoded streams, in association with positions of the divided images on the image
An information processing method according to the third aspect of the present disclosure corresponds to the information processing apparatus according to the third aspect of the present disclosure.
According to the third aspect of the present disclosure, positions on a screen of respective divided images of an image which is made up of a plurality of divided images compatible with encoded streams are set in association with positions of the divided images on the image.
An information processing apparatus according to a fourth aspect of the present disclosure is an information processing apparatus including an allocator that places divided images of an image obtained by decoding encoded streams on a screen, on the basis of positions on the screen of the divided images of the image which are set in association with positions on the image which is made up of a plurality of divided images compatible with the encoded streams.
An information processing method according to the fourth aspect of the present disclosure corresponds to the information processing apparatus according to the fourth aspect of the present disclosure.
According to the fourth aspect of the present disclosure, divided images of an image obtained by decoding encoded streams are placed on a screen on the basis of positions on the screen of the divided images of the image which are set in association with positions on the image which is made up of a plurality of divided images compatible with the encoded streams.
The information processing apparatus according to the first through fourth aspects can be implemented by a computer when it executes programs.
In order to implement the information processing apparatus according to the first through fourth aspects, the programs to be executed by the computer can be provided by being transmitted through a transmission medium or recorded on a recording medium.
According to the first aspect of the present disclosure, information can be set. According to the first aspect of the present disclosure, information can be set in a manner to be able to reliably recognize the position on a screen of an image made up of a plurality of divided images compatible with encoded streams.
According to the second aspect of the present disclosure, information can be acquired. According to the second aspect of the present disclosure, the position on a screen of an image made up of a plurality of divided images compatible with encoded streams can reliably be recognized.
According to the third aspect of the present disclosure, information can be set. According to the third aspect of the present disclosure, information can be set in a manner to be able to reliably recognize positions on a screen of divided images of an image compatible with encoded streams.
According to the fourth aspect of the present disclosure, information can be acquired. According to the fourth aspect of the present disclosure, positrons on a screen of divided images of an image compatible with encoded screams can be reliably recognized.
The advantages described above are not necessarily restrictive in nature, but any of the advantages described in the present disclosure are applicable.
Modes (hereinafter referred to as “embodiments”) for carrying out the present disclosure will be described below. The description will be given in the following order,
1. First embodiment: Information processing system (
2. Second embodiment: Information processing system (
3. Third embodiment: Information processing system (
4. Fourth embodiment: Computer (
An information processing system 10 depicted in
In the information processing system 10, the Web server 12 distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to the moving-image playback terminal 14 according to a process equivalent to MPEG-DASH.
In the present specification, the entire celestial sphere image refers to an image according to equidistant cylindrical projection for spheres, where an image captured horizontally around 360° or vertically around 180° (hereinafter referred to as “omnidirectional image”) is mapped onto a spherical plane. However, the entire celestial sphere image may be an image representing a development of a cube, where an omnidirectional image is mapped onto the cube.
The file generating apparatus 11 (information processing apparatus) of the information processing system 10 encodes a low-resolution entire celestial sphere image to generate a low-resolution encoded stream. The file generating apparatus 11 also independently encodes images divided from a high-resolution entire celestial sphere image to generate high-resolution encoded streams of the respective divided images. The file generating apparatus 11 generates image files by converting the low-resolution encoded stream and the high-resolution encoded streams into files each per time unit called “segment” ranging from several to ten seconds. The file generating apparatus 11 uploads the generated image files to the Web server 12.
The file generating apparatus 11 (setting section) also generates an MPD file (management file) for managing image files, etc. The file generating apparatus 11 uploads the MPD file to the Web server 12.
The Web server 12 stores the image files and the MPD file uploaded from the file generating apparatus 11. In response to a request from the moving-image playback terminal 14, the Web server 12 sends the image files, the MPD file, etc. that have been stored therein to the moving-image playback terminal 14.
The moving-image playback terminal 14 executes software 21 for controlling streaming data (hereinafter referred to as “control software”), moving-image playback software 22, and client software 23 for accessing HTTP (HyperText Transfer Protocol) (hereinafter referred to as “access software”), etc.
The control software 21 is software for controlling data streaming from the Web server 12. Specifically, the control software 21 enables the moving-image playback terminal 14 to acquire the MPD file from the Web server 12.
Based on the MPD file, the control software 21 instructs the access software 23 to send a request for sending encoded streams to be played which are designated by the moving-image playback software 22.
The moving-image playback software 22 is software for playing the encoded streams acquired from the Web server 12. Specifically, the moving-image playback software 22 indicates encoded streams to be played to the control software 21. Furthermore, when the moving-image playback software 22 receives a notification of having started receiving streams from the access software 23, the moving-image playback software 22 decodes the encoded streams received by the moving-image playback terminal 14 into image data. The moving-image playback software 22 combines the decoded image data and outputs the combined image data.
The access software 23 is software for controlling communication with the Web server 12 over the internet 13 using HTTP. Specifically, in response to the instruction from the control software 21, the access software 23 controls the moving-image playback terminal 14 to send a request for sending encoded streams to be played that are included in image files. The access software 23 also controls the moving-image playback terminal 14 to start receiving she encoded streams that are sent from the Web server 12 in response to the request, and supplies a notification of having started receiving streams to the moving-image playback software 22.
As depicted in
The stitching processor 151 equalizes the colors and lightnesses of omnidirectional images supplied from muiti-cameras, not depicted, and join them while removing overlaps. The stitching processor 151 supplies an omnidirectional image obtained as a result to the mapping processor 152.
The mapping processor 152 maps the omnidirectional image supplied from the stitching processor 151 onto a sphere, thereby generating an entire celestial sphere image. The mapping processor 152 supplies the entire celestial sphere image to the resolution downscaler 153 and the divider 155. The stitching processor 151 and the mapping processor 152 may be integrated with each other.
The resolution downscaler 153 reduces the horizontal and vertical resolutions of the entire celestial sphere image supplied from the mapping processor 152 to one-half, thereby downscaling the resolution of the image and generating a low-resolution entire celestial sphere image. The resolution downscaler 153 supplies the low-resolution entire celestial sphere image to the encoder 154.
The encoder 154 encodes the low-resolution entire celestial sphere image supplied from the resolution downscaler 153 according to an encoding process such as AVC (Advanced video Coding)HEV (High Efficiency Video Coding), or the like, thereby generating a low-resolution encoded stream. The encoder 154 supplies the low-resolution encoded stream to the storage 157, which records the supplied low-resolution encoded stream therein.
The divider 155 divides the entire celestial sphere image supplied as a high-resolution entire celestial sphere image from the mapping processor 152 vertically into three regions, and divides the central region horizontally into three regions such that no boundary lies at the center. The divider 155 downscales the resolution of the upper and lower regions among the five divided regions such that the horizontal resolution is reduced to one-half, for example.
The divider 155 supplies a low-resolution upper image, which represents the upper region whose resolution has been downscaled, to the encoder 156-1, and supplies a low-resolution lower image, which represents the lower region whose resolution has been downscaled, to the encoder 156-2.
The divider 155 combines the left end of the left end region of the central region with the right end of the right end region thereof, thereby generating an end image. The divider 155 supplies the end image to the encoder 156-3. The divider 155 also supplies the central one of the central region as a central image to the encoder 156-4.
The encoders 156-1 through 156-4 encode the low-resolution upper image, the low-resolution lower image, the end image, and the central image supplied from the divider 155, according to an encoding process such as AVC, HEVC, or the like. The encoders 156-1 through 156-4 supply encoded streams thus generated as high-resolution streams to the storage 157, which records the supplied high-resolution streams therein.
The storage 157 records therein the single low-resolution encoded stream supplied from the encoder 154 and the four high-resolution encoded streams supplied from the encoders 156-1 through 156-4.
The generator 158 reads the single low-resolution encoded stream and the four high-resolution encoded streams from the storage 157, and converts each of them into files each per segment. The generator 158 transmits the image files thus generated to the Web server 12 depicted in
If the resolution of an entire celestial sphere image 170 is 4 k (3840 pixels×2160 pixels), as depicted in
As depicted in
The upper image 171 and the lower image 172 have their horizontal resolution reduced to one-half, generating a low-resolution upper image and a low-resolution lower image. Since the entire celestial sphere image is an image that spreads horizontally and vertically through 360 degrees, the left end image 173-1 and the right end image 173-2 that face each other are actually continuous images. The left end of the left end image 173-1 is combined with the right end of the right end image 173-2, generating an end image. The low-resolution upper image, the low-resolution lower image, the end image, and the central image 174 are encoded independently of each other, generating four high-resolution encoded streams.
Generally, the entire celestial sphere image 170 is generated such that the front of the entire celestial sphere image 170 at a position on the entire celestial sphere image 170 that is located at the center of the field of view in the standard direction of sight lies at the center O of the entire celestial sphere image 170.
According to an encoding process such as AVC, HEVC, or the like where information is compressed by temporal motion compensation, when a subject moves on a screen, the appearance of a compression distortion is propagated between frames while being kept in a certain shape. However, if a screen is divided and the divided images are encoded independently of each other, then since motion compensation is not carried out across boundaries, a compression distortion tends to increase. As a result, a moving image made up of decoded divided images has a stripe generated therein where the appearance of a compression distortion varies at the boundaries between the divided images. This phenomenon is known to occur between slices of AVC or tiles of HEVC. Therefore, image quality is likely to deteriorate at the boundaries between the low-resolution upper image, the low-resolution lower image, the end image, and the central image 174 that have been decoded.
Consequently, the entire celestial sphere image 170 is divided such that no boundary lies at the center O of the entire celestial sphere image 170 which it is highly possible for the user to see. As a result, image quality does not deteriorate at the center O which it is highly possible for the user to see, making any image quality deterioration unobtrusive in the entire celestial sphere image 170 that has been decoded.
The left end image 173-1 and the right end image 173-2 are combined with each other and encoded. Therefore, if the areas of the end images and the central image 174 are the same, then a maximum of high-resolution encoded streams of an entire celestial sphere image from a given viewpoint which are required to display the entire celestial sphere image are two high-resolution encoded streams of either one of the low-resolution upper image and the low-resolution lower image and either one of the end image and the central image 174, independently of the viewpoint. Therefore, the number of high-resolution streams to be decoded by the moving-image playback terminal 14 is the same independently of the viewpoint.
An SRD refers to information that can be described in an MPD file, and represents information indicating the position on a screen of one or more individually encoded regions into which an image of a moving-image content has been divided.
Specifically, an SRD is given as <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2015” value= “source_id, object_x, object_y, object_width, object_height, total_width, total_height, spatial_set_id”/>.
“source_id” refers to the ID (identifier) of a moving-image content corresponding to the SRD. “object_z” and “object_y” refer respectively to the horizontal and vertical coordinates on a screen of an upper left corner of a region, corresponding to the SRD. “object_width” and “object_height” refer respectively to the horizontal and vertical sizes of the region corresponding to the SRD. “total_width” and “total_height” refer respectively to the horizontal and vertical sizes of a screen where the region corresponding to the SRD is placed.
“spatial_set_id” refers to the ID of the screen where the region corresponding to she SRD is placed.
As depicted in
Information indicating that an usage of a moving-image content is a panoramic image (panorama image) or an entire celestial sphere image (celestial sphere dynamic) may be described in an MPD file. In this case, the definition of SRD in the present embodiment is depicted in
As described above with reference to
Therefore, the file generating apparatus 11 sets the position of the left end image 173-1 on a screen 180 to the right side of the right end image 173-2, for example. As depicted in
Specifically, the file generating apparatus 11 describes the horizontal and vertical coordinates of the position on the screen 180 of an upper left corner of the right end image 173-2 as “object_x” and “object_y” of the SRD of the end image 173, respectively. The file generating apparatus 11 also describes the horizontal and vertical sizes of the end image 173 as “object_width” and “object_height” of the SRD of the end image 173, respectively.
The file generating apparatus 11 also describes the horizontal and vertical sizes of the screen 180 as “total_width” and “total_height” of the SRD of the end image 173, respectively. The file generating apparatus 11 thus sets the position protruding out of the screen 180 as the position of the end image 173 on the screen 180.
By contrast, if the definition of an SRD is limited such that the sum of “object_x” and “object_width” is equal to or smaller than “total_width” and the sum of “object_y” and “object_height” is equal to or smaller than “total height,” as depicted in
Therefore, the positions on the screen 180 of the right end image 173-2 and the left end image 173-1 that make up the end image 173 are not contiguous, and the positions on the screen 180 of both the right end image 173-2 and the left end image 173-1 need to be described as the position of the end image 173 on the screen 180. As a consequence, the positron of the end image 173 on the screen 180 cannot be described by an SRD.
As depicted in
Specifically, the first “AdaptationSet” in
The second “AdaptationSet” in
The third “AdaptationSet” in
The fourth “AdaptationSet” in
The fifth “AdaptationSet” in
In step S11 depicted in
In step S12, the mapping processor 152 generates an entire celestial sphere image 170 from the omnidirectional image supplied from the stitching processor 151, and supplies the entire celestial sphere image 170 to the resolution downscaler 153 and the divider 155.
In step S13, the resolution downscaler 153 downscales the resolution of the entire celestial sphere image 170 supplied from the mapping processor 152, generating a low-resolution entire celestial sphere image 161. Tins resolution downscaler 153 supplies the low-resolution entire celestial sphere image 161 to the encoder 154.
In step S14, the encoder 154 encodes the low-resolution entire celestial sphere image 161 supplied from the resolution downscaler 153, thereby generating a low-resolution encoded stream. The encoder 154 supplies the low-resolution encoded stream to the storage 157.
In step S15, the divider 155 divides the entire celestial sphere image 170 supplied from the mapping processor 152 into an upper image 171, a lower image 172, a left end image 173-1, a right end image 173-2, and a central image 174. The divider 155 supplies the central image 174 to the encoder 156-4.
In step S16, the divider 155 downscales the resolution of the upper image 171 and the lower image 172 such that their horizontal resolution is reduced to one-half. The divider 155 supplies a low-resolution upper image obtained as a result to the encoder 156-1 and also supplies a low-resolution lower image, which represents the lower region whose resolution has been downscaled, to the encoder 156-2.
In step S17, the divider 155 combines the left end of the left end image 173-1 with the right end of the right end image 173-2, thereby generating an end image 173. The divider 155 supplies the end image 173 to the encoder 156-3.
In step S18, the encoders 156-1 through 156-4 encode the low-resolution upper image, the low resolution lower image, the end image 173, and the central image 174, respectively, supplied from the divider 155. The encoders 156-1 through 156-4 supply encoded streams generated as a result as high-resolution streams to the storage 157.
In step S19, the storage 157 records therein the single low-resolution encoded stream supplied from the encoder 154 and the four high-resolution encoded streams supplied from the encoders 156-1 through 156-4.
In step 520, the generator 158 reads the single low-resolution encoded stream and the four high-resolution encoded streams from the storage 157, and converts each of them into files each per segment, thereby generating image files. The generator 158 transmits the image files to the Web server 12 depicted in
The streaming player 190 depicted in
The MPD acquirer 191 of the streaming player 190 acquires an MPD file from the Web server 12, and supplies the MPD file to the MPD processor 192.
Based on the direction of sight of the user supplied from the line-of-sight detector 197, the MPD processor 192 selects two of the upper image 171, the lower image 172, the end image 173, and the central image 174 as selected images that may possibly be included in the field of view of the user. Specifically, when the entire celestial sphere image 170 is mapped onto a spherical plane, the MPD processor 192 selects one of the upper image 171 and the lower image 172 and one of the end image 173 and the central image 174 which may be possibly included in the field of view of the user when the user that exists within the sphere looks along the direction of sight, as selected images.
The MPD processor 192 extracts information such as URLs of the image files of the low-resolution entire celestial sphere image 161 and the selected images in the segments to be played, from the MPD file supplied from the MPD acquirer 191, and supplies the extracted information to the image file acquirer 193. The MPD processor 192 also extracts the SRDs of the low-resolution entire celestial sphere image 161 and the selected images in the segments to be played, from the MPD file, and supplies the extracted SRDs to the allocator 195.
The image file acquirer 193 requests the Web server 12 for the encoded streams or the image files that are specified by the URLs supplied from the MPD processor 192, and acquires the encoded streams. The image file acquirer 193 supplies the acquired love-resolution encoded stream to the decoder 194-1. The image file acquirer 193 also supplies the high-resolution encoded stream of one of the selected images to the decoder 194-2, and supplies the high-resolution encoded stream of the other selected image to the decoder 194-3.
The decoder 194-1 decodes the low-resolution encoded stream supplied from, the image file acquirer 193 according to a process corresponding to an encoding process such as AVC, HEVC, or the like, and supplies the low-resolution entire celestial sphere image 161 obtained as a result of the decoding process to the allocator 195.
The decoders 194-2 and 194-3 decode the high-resolution encoded streams of the selected images supplied, from the image file acquirer 193 according to a process corresponding to an encoding process such as AVC, HEVC, or the like. The decoders 194-2 and 194-3 then supply the selected images obtained as a result of the decoding process to the allocator 195.
The allocator 195 places the low-resolution entire celestial sphere image 161 supplied from the decoder 194-1 on the screen on the basis of the SRD supplied from the MPD processor 192. Thereafter, the allocator 195 superposes the selected images supplied from the decoders 194-2 and 194-3 on the screen where the low-resolution entire celestial sphere image 151 has been placed, on the basis of the SRD.
Specifically, the horizontal and vertical sizes of the screen where the low-resolution entire celestial sphere image 161 indicated by the SRD is placed are one-half of the horizontal and vertical sizes of the screen where the selected images are placed. Therefore, the allocator 195 increases twice the horizontal and vertical sizes of the screen where the low-resolution entire celestial sphere image 161 is placed, and superposes the selected images thereon. The allocator 195 maps the screen on which the selected images have been superposed onto a sphere, and supplies a spherical image obtained as a result to the renderer 196.
The renderer 196 projects the spherical image supplied from the allocator 195 onto the field of view of the user supplied from the line-of-sight detector 197, thereby generating an image in the field of view of the user. The tenderer 196 then controls a display device, not depicted, to display the generated image as a display image.
The line-of-sight detector 197 detects the direction of sight of the user. The direction of sight of the user may be detected by a detecting method based on the gradient of a device worn by the user, for example. The line-of-sight detector 197 supplies the detected direction of sight of the user to the MPD processor 192.
The line-of-sight detector 197 also detects the position of the user. The position of the user may be detected by a detecting method, based on a captured image of a marker or the like that is added to a device worn by the user, for example. The line-of-sight detector 197 determines a field of view of the user based on the detected position of the user and the line-of-sight vector, and supplies the determined field, of view of the user to the tenderer 196.
In step S41 depicted in
In step S42, the MPD processor 192 selects two of the upper image 171, the lower image 172, the end image 173, and the central image 174 as selected images that may possibly be included in the field of view of the user, on the basis of the direction of sight of the user supplied from the line-of-sight detector 197.
In step S43, the MPD processor 192 extracts information such as URLs of the image flies of the low-resolution entire celestial sphere image 161 and the selected images in the segments to be played, from the MPD file supplied from the MPD acquirer 191, and supplies the extracted information to the image file acquirer 193. In step S44, the MPD processor 192 extracts the SRDs of the low-resolution entire celestial sphere image 161 and the selected images in the segments to be played, from the MPD file, and supplies the extracted SRDs to the allocator 195.
In step S45, the image file acquirer 193 requests the Web server 12 for the encoded streams of the image files that are specified by the URLs supplied from the MPD processor 192, and acquires the encoded streams. The image file acquirer 193 supplies the acquired low-resolution encoded stream to the decoder 194-1. The image file acquirer 193 also supplies the high-resolution encoded stream of one of the selected images to the decode 194-2, and supplies the high-resolution encoded stream of the other selected image to the decoder 194-3.
In step S46, the decoder 194-1 decodes the low-resolution encoded stream supplied from the image file acquirer 193, and supplies the low-resolution entire celestial sphere image 161 obtained as a result of the decoding process to the allocator 195.
In step S47, the decoders 194-2 and 194-3 decode the high-resolution encoded streams of the selected images supplied from the image file acquirer 193, and supplies the selected images obtained as a result of the decoding process to the allocator 195.
In step S48, the allocator 195 places the low-resolution entire celestial sphere image 151 supplied from the decoder 194-1 on the screen on the basis of the SRD supplied from the MPD processor 192. Thereafter, the allocator 195 superposes the selected images supplied from the decoders 194-2 and 194-3 on the screen. The allocator 195 maps the screen on which the selected images have bees superposed onto a sphere, and supplies a spherical image obtained as a result to the renderer 196.
In step S49, the renderer 196 projects the spherical image supplied from the allocator 195 onto the field of view of the user supplied from the line-of-sight detector 197, thereby generating an image to be displayed. The renderer 196 then controls the display device, not depicted, to display the generated image as a display image. The playback process is now ended.
According to a second embodiment of the image processing system to which the present disclosure is applied, different levels (to be described in detail later) are set for the encoded stream of the left end image 173-1 and the encoded stream of the right end image 173-2, among the encoded streams of the end image 173. As a consequence, if an SRD is defined as depicted in
Specifically, the second embodiment of the image processing system to which the present disclosure is applied is the same as the first, embodiment except the segment structure of the image file of the end image 173 generated, by the file generating apparatus 11 and the MPD file. Therefore, only the segment structure of the image file of the end image 173 and the MPD file will be described below.
As depicted in
The stbl box includes an sgpd box, etc. placed therein where Tile Region Group Entry indicating the position of the left end image 173-1 as part of the end image 173 on the end image 173 and Tile Region Group Entry indicating the position of the right end image 173-2 on the end image 173 are successively described. Tile Region Group Entry is standardized by HEVC Tile Track of HEVC File Format.
The mvex box includes an leva box, etc. placed therein where 1 is set as the level for the left end image 173-1 corresponding to the first Tile Region Group Entry and 2 is set as the level for the right end image 173-2 corresponding to the second Tile Region Group Entry.
The leva box sets 1 as the level for the left end image 173-1 and 2 as the level for the right end image 173-2 by successively describing information of the level corresponding to the first Tile Region Group Entry and information of the level corresponding to the second Tile Region Group Entry. The level functions as an index when part of an encoded stream is designated from an MPD file,
The leva box has assignment_type described therein that indicates whether the object for which a level is to be set is an encoded stream placed on a plurality of tracks or not as information of each level. In the example depicted in
The leva box also has the type of Tile Region Group Entry corresponding to the level described therein as information of each level. In the example depicted in
A media segment includes one or more subsegments including an sidx box, an ssix box, and pairs of moof and mdat boxes. The sidx box has positional information placed therein which indicates the position of each subsequent in the image file. The ssix box includes positional information of the encoded streams of respective levels placed in the mdat boxes.
A subsegment is provided per desired time length. The mdat boxes have encoded streams placed together therein for a desired time length, and the moof boxes have management information of those encoded streams placed therein.
Tile Region Group Entry describes successively therein the ID of the Tile Region Group Entry, horizontal and vertical coordinates of an upper left corner of the corresponding region on an image corresponding to the encoded stream, and horizontal and vertical sizes of the image corresponding to the encoded stream.
As depicted in
The MPD file depicted in
The fifth “AdaptationSet” depicted in
Therefore, the “SubRepresentation” of level “1” has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,2880,540,960,1080,3840,2160,2”/> which represents the SRD of the left end image 173-1 described therein. The SRD of the left end image 173-1 is thus set in association with the position on the end image 173 of the left end image 173-1 indicated by the Tile Region Group Entry corresponding to level “1.”
The “SubRepresentation” of level “2” has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,0, 540, 960, 1080, 3340, 2160, 2”/> which represents the SRD of the right end image 173-2 described therein. The SRD of the right end image 173-2 is thus set in association with the position on the end image 173 of the right end image 173-2 indicated by the Tile Region Group Entry corresponding to level “2.”
According to the second embodiment, as described above, different levels are set for the left end image 173-1 and the right end image 173-2. Therefore, positions on the screen 180 of the left end image 173-1 and the right end image 173-2 that make up the end image 173 corresponding to the encoded stream can be described by the SRD.
The streaming player 190 places the left end image 173-1 in she position indicated by the Tile Region Group Entry corresponding to level “1” of the decoded end image 173, on the screen 180 on the basis of the SRD of level “1” set in the MPD file. The streaming player 190 also places the right end image 173-2 in the position indicated by the Tile Region Group Entry corresponding to level “2” of the decoded end image 173, on the screen 180 on the basis of the SRD of level “2” set in the MPD file.
According to the second embodiment, the encoded stream of the end image 173 is placed on one track. However, if the left end image 173-1 and the right end image 173-2 are encoded as different tiles according to the HEVC process, then their respective slice data may be placed on different tracks.
If the slice data of the left end image 173-1 and the right end image 173-2 are placed on different tracks, then three tracks are placed in the image file of the end image 173, as depicted in
The track box of each track has Track Reference placed therein. The Track Reference represents reference relationship of a corresponding track to another track. Specifically, the Track Reference represents an ID (hereinafter referred to as “track ID”) inherent in another track to which the corresponding track has reference relationship. A sample of each track is managed by Sample Entry.
The track whose track ID is 1 is a base track that does not include the slice data of the encoded stream of the end image 173. Specifically, a sample of the base track has parameter sets placed therein which include VPS (Video Parameter Set), SPS (Sequence Parameter Set), SEI (Supplemental Enhancement Information), PPS (Picture Parameter Set), etc., of the encoded stream of the end image 173. The sample of the base track also has extractors in the unit of samples of the other tracks than the base track, placed therein, as subsamples. An extractor includes the type of the extractor and information indicating the position of the sample of the corresponding track in the file and the size thereof.
The track whose track ID is 2 is a track that includes slice data of she left end image 173-1 of the encoded stream of the end image 173, as a sample. The track whose track ID is 3 is a track that includes slice data of the right end image 173-2 of the encoded stream of the end image 173, as a sample.
The segment structure of the image file of the end image 173 in the case where she slice data of the left end image 173-1 and she right end image 173-2 are placed on different tracks is the same as the segment structure depicted in
As depicted in
The leva box depicted in
In
In
The MPD file depicted in
Specifically, in the MPD file depicted in
The track of the track ID “2” corresponding to level “2” has a dependent relationship to the base track of the track ID “1.” Consequently, dependencyLevel representing the level corresponding to the track in the dependent relationship, which is described as an element of “SubRepresentation, ”is set to “1.”
The track of the track ID “2” corresponding to level “2” is HEVC Tile Track. Therefore, codecs representing the type of encoding described as an element of “SubRepresentation” is set to “hvt1.1.2.H93.B0” that indicates HEVC Tile Track.
In the MPD file depicted in
The track of the track ID “3” corresponding to level “3” has a dependent relationship to the base track of the track ID “1.” Consequently, dependencyLevel described as an element of “SubRepresentation” is set to “1.”
The track of the track ID “3” corresponding to level “3” is HEVC Tile Track. Therefore, codecs described as an element of “SubRepresentation” is set to “hvt1.1.2.H93.B0.”
As described above, if the left end image 173-1 and the right end image 173-2 are encoded as different tiles, then the decoder 194-2 or the decoder 194-3 depicted in
In the above description, the slice data of the left end image 173-1 and the right end image 173-2 that are encoded as different tiles are placed on different tracks. However, they may be placed on one track.
In the first and second embodiments, the image of the moving-image content represents an entire celestial sphere image. However, it may be a panoramic image.
Of the configurational details depicted in
The configuration of an information processing system 210 depicted
In the information processing system 210, the Web server 12 distributes encoded streams of a mosaic image as an image of a moving-image content to the moving-image playback terminal 14 according to a process equivalent to MPEG-DASH. The mosaic image refers to an image made up of thumbnail images of moving images from a plurality of broadcast programs.
The file generating apparatus 211 of the information processing system 210 encodes a mosaic image at a plurality of encoding rates (bit rates), thereby generating encoded streams. The file generating apparatus 211 generates image files by converting the encoded streams at the respective encoding rates into files each per time unit called “segment” ranging from several to 10 seconds. The file generating apparatus 211 uploads the generated image files to the Web server 12.
The file generating apparatus 211 (setting section) also generates an MPD file (management file) for managing image files, etc. The file generating apparatus 211 uploads the MPD file to the Web server 12.
The file generating apparatus 211 depicted in
The encoding processor 231 of the file generating apparatus 211 encodes a mosaic image as an image of a moving-image content at a plurality of encoding rates, thereby generating encoded streams. The encoding processor 231 supplies the encoded streams at the respective encoding rates to the image file generator 232.
The image file generator 232 converts the encoded streams at the respective encoding rates supplied from the encoding processor 231 into files each per segment, thereby generating image files. The image file generator 232 supplies the generated image files to the MPD generator 233.
The MPD generator 233 determines an URL, etc. of the Web server 12 for storing the image files supplied from the image file generator 232. The MPD generator 233 then generates an MPD file containing URLs, etc. of the image files. The MPD generator 233 supplies the generated MPD file and the image files to the server uploading processor 234.
The server uploading processor 234 uploads the image files and the MPD file supplied from the MPD generator 233 to the Web server 12 depicted in
In the example depicted in
The segment structure of the image files of the mosaic image 250 depicted in
Since the mosaic image 250 is made up of the four thumbnail images 251 through 254, fear Tile Region Group Entries are described in the sgpd box or the image files of the mosaic image 250, as depicted in
In the example depicted in
The leva box has information of levels corresponding to the respective Tile Region Group Entries described therein successively from the information of the level corresponding to the first Tile Region Group Entry. The level for the thumbnail image 251 is set to 1, the level for the thumbnail image 252 to 2, the level for the thumbnail image 253 to 3, and the level for the thumbnail image 254 to 4.
assignment_type described as the information of each level is set to 0, and the type of Tile Region Group Entry is set to “trif” which represents the type of Tile Region Group Entry described in the sgpd box.
As depicted in
Therefore, the “SubRepresentation” of level “1” has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,0,0,960,540,1920,1080”/> which represents the SRD of the thumbnail image 251 described therein. The SRD of the thumbnail image 251 is thus set in association with the position on the mosaic image 250 of the thumbnail image 251 indicated by the Tile Region Group Entry corresponding to level “1.”
The “SubRepresentation” of level “2” has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,960,0,960,540,1920,1080”/> which represents the SRD of the thumbnail image 252 described therein. The SRD of the thumbnail image 252 is thus set in association with the position on the mosaic image 250 of the thumbnail image 252 indicated by the Tile Region Group Entry corresponding to level “2.”
The “SubRepresentation” of level “3” has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,0,540,960,540,1920,1080”/> which represents the SRD of the thumbnail image 253 described therein. The SRD of the thumbnail image 253 is thus set in association with the position on the mosaic image 250 of the thumbnail image 253 indicated by the Tile Region Group Entry corresponding to level “3.”
The “SubRepresentation” of level “4” has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,960,540,960,540,1920,1080”/> which represents the SRD of the thumbnail image 254 described therein. The SRD of the thumbnail image 254 is thus set in association with the position on the mosaic image 250 of the thumbnail image 254 indicated by the Tile Region Group Entry corresponding to level “4.”
As described above, in the MPD file depicted in
The “SubRepresentation” of each level also has URLs of moving images corresponding to the thumbnail images 251 through 254 of the level described therein. Specifically, the “SubRepresentation” of level “1” has the URL “http://example.com/a_service/my.mpd” of the moving image corresponding to the thumbnail image 251 described therein. The “SubRepresentation” of level “2” has the URL “http://example.com/b_service/my.mpd” of the moving image corresponding to the thumbnail image 252 described therein.
The “SubRepresentation” of level “3” has the URL “http://example.com/c_service/my.mpd” of the moving image corresponding to the thumbnail image 253 described therein. The “SubRepresentation” of level “4” has the URL “http://example.com/d_service/my.mpd” of the moving image corresponding to the thumbnail image 254 described therein.
The MPD file depicted in
Specifically, an the MPD file depicted in
The “SubRepresentation” of level “4” has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,960,0,960,540,1920,1080”/> which represents the SRD of the thumbnail image 254 described therein.
The “SubRepresentation” of level “1” has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,0,540,960,540,1920,1080”/> which represents the SRD of the thumbnail image 251 described therein.
The “SubRepresentation” of level “2” has <SupplementalProperty schemeIdUri=“urn:mpeg:dash:srd:2014” value=“1,960,540,960,540,1920,1080”/> which represents the SRD of the thumbnail image 252 described therein.
As described above, in the MPD file depicted in
However, the horizontal and vertical coordinates on the mosaic image 250 indicated by Tile Region Group Entry corresponding to each level, are different from the horizontal and vertical positions on the screen indicated by the SRD corresponding to the level. When the MPD file depicted in
The SRD of the thumbnail image 251 described in the MPD file depicted in
The SRD of the thumbnail image 252 indicates that the coordinates of an upper left corner of the thumbnail image 252 on the screen 270 are (960,540). Therefore, as depicted in
The SRD of the thumbnail image 253 indicates that the coordinates of an upper left corner of the thumbnail image 253 on the screen 270 of 1920 pixels×1080 pixels are (0,0). Therefore, as depicted in
The SRD of the thumbnail image 254 indicates that the coordinates of an upper left corner of the thumbnail image 254 on the screen 270 are (960,0). Therefore, as depicted, in
As described above, with the MPD file depicted in
In step S191 depicted in
In step S192, the image file generator 232 converts the encoded streams at the respective encoding rates supplied from the encoding processor 231 into files each per segment, thereby generating image files. The image file generator 232 supplies the generated image files to the MPD generator 233.
In step S193, the MPD generator 233 generates an MPD file containing URLs, etc. of the image files. The MPD generator 233 supplies the generated MPD file and the image flies to the server uploading processor 234.
In step S194, the server uploading processor 234 uploads the image files and the MPD file supplied from the MPD generator 233 to the Web server 12. The process now comes to an end.
Of the configurational details depicted in
A streaming player 230 depicted in
The MPD processor 292 of the streaming player 290 extracts information such as URLs, etc. of the image files of segments to be played from the MPD file supplied from the MPD acquirer 191, and supplies the extracted information to the image file acquirer 293. The MPD processor 292 also supplies the MPD file to the moving image acquirer 297. The MPD processor 292 extracts the SRDs of the divided images of a mosaic image of the segments to be played from the MPD file, and supplies the extracted SRDs to the display controller 295.
The image file acquirer 293 requests the Web server 12 for the encoded streams of the image files that are specified by the URLs supplied from the MPD processor 292, and acquires the encoded streams. The image file acquirer 293 supplies the acquired encoded stream to the decoder 294.
The decoder 294 decodes the encoded streams supplied from the image file acquirer 293. The decoder 294 supplies a mosaic image obtained as a result of the decoding process to the display controller 295.
The display controller 295 (allocator) places the divided images of the mosaic image supplied from the decoder 294 on the screen on the basis of the SRDs supplied from the MPD processor 292. The display controller 235 superposes a cursor on the screen where the divided images are placed, and supplies the divided images with the superposed cursor to a display device, not depicted, which displays them.
In response to an instruction to enlarge a given region of the screen supplied from the acceptor 296, the display controller 295 enlarges the size of a partial mosaic image, of the screen where the mosaic image is placed, that includes only a thumbnail image contained in the region, up to the size of the screen. The display controller 295 superposes a cursor on the given thumbnail image in the screen where the enlarged partial mosaic image is placed, and supplies the thumbnail image with the superposed cursor to the display device, not depicted which displays them.
The display controller 295 supplies a moving image, supplied from the moving image acquirer 297, that corresponds to one of the thumbnail images being displayed, to the display device, not depicted, which displays the supplied moving image.
The acceptor 296 accepts an instruction from the user, etc. and supplies the instruction to the moving image acquirer 297 or the display controller 295.
In response to an instruction about a position supplied from the acceptor 296, the moving image acquirer 297 acquires the URL of a moving image corresponding to the position from the MPD file supplied from the MPD processor 292. The moving image acquirer 297 acquires a moving image from the Web server 12 or the like on the basis of the acquired URL, and supplies the acquired moving image to the display controller 295.
As depicted in a left section of
At this time, the user gives an instruction to enlarge a desired region while seeing the screen of the mosaic image 310 with the cursor 312 superposed thereon. In the example depicted in
In response to the enlarging instruction, the display controller 295 enlarges the size of a partial mosaic image 313 which is made up of only the 2×2 thumbnail images 311, of the screen where the mosaic image 310 is placed, to the size of the screen. Then, as depicted in a central section of
At this time, the user moves the cursor 314 to a desired thumbnail image 311 and performs an action such as a double tap or the like thereon, indicating a position for the cursor 314, In the example depicted in FIG, 27, the user indicates the position of an upper right thumbnail image 311.
In response to the user's instruction, the moving image acquirer 297 acquires the URL of the moving image corresponding to the SRD that indicates the position on the screen of the mosaic image 310 corresponding to the position on the indicated partial mosaic image 313, from the MPD file, as the URL of a moving image corresponding to the indicated position. Then, based on the acquired URL, the moving image acquirer 297 acquires a moving image 315 from the Web server 12 or the like, and supplies the acquired moving image 315 to the display controller 295. As depicted in a right section of
In step S211 depicted in
In step S212, the MPD processor 292 extracts information such as URLs, etc. of the image files of segments to be played from the MPD file supplied from the MPD acquirer 191, and supplies the extracted information to the image file acquirer 293. The MPD processor 292 also supplies the MPD file to the moving image acquirer 297. The MPD processor 292 extracts the SRDs of the divided images of a mosaic image of the segments to be played from the MPD file, and supplies the extracted SRDs to the display controller 295.
In step S213, the image file acquirer 293 requests the Web server 12 for the encoded streams of the image files that are specified by the URLs supplied from the MPD processor 292, and acquires the encoded streams. The image file acquirer 293 supplies the acquired encoded stream to the decoder 294.
In step S214, the decoder 294 decodes the encoded streams supplied from the image file acquirer 293. The decoder 294 supplies a mosaic image obtained as a result of the decoding process to the display controller 295.
In step S215, the display controller 295 places the divided images of the mosaic image from the decoder 294 on the screen OR the basis of the SRDs from the MPD processor 292, superposes a cursor or the like on the screen, and supplies the divided images with the superposed cursor to the display device, not depicted, which displays them.
In step S216, the acceptor 296 determines whether it has accepted an instruction to enlarge a given region of the screen from the user or not. If the acceptor 296 decides that it has not accepted an instruction to enlarge a given region of the screen from the user in step S216, then the acceptor 296 waits until it accepts an instruction to enlarge a given region of the screen.
If the acceptor 296 decides that it has accepted an instruction to enlarge a given region of the screen from the user in step S216, then the acceptor 296 supplies the enlarging instruction to the display controller 295. In step S217, in response to the enlarging instruction supplied from the acceptor 296, the display controller 295 enlarges the size of a partial mosaic image, of the screen where the mosaic image is placed, that includes only a thumbnail image contained in the region instructed to be enlarged, up to the size of the screen.
In step S218, the display controller 295 superposes a cursor or the like on a given thumbnail image in the screen where the enlarged partial mosaic image is placed, supplies the thumbnail image with the superposed cursor to the display device, not depicted, which displays them. At this time, the user moves the cursor to a desired thumbnail image and performs an action such as a double tap or the like thereon, indicating a position for the cursor on the screen.
In step S219, the acceptor 296 determines whether it has accepted an instruction for a position on the screen from the user or not. If the acceptor 296 decides that it has not accepted an instruction for a position on the screen in step S219, then the acceptor 296 waits until it accepts an instruction for a position on the screen.
If the acceptor 296 decides that it has accepted an instruction for a position on the screen in step S219, then the acceptor 296 supplies the instruction to the moving image acquirer 297. In step S220, in response to the instruction from the acceptor 296, the moving image acquirer 297 acquires the URL of a moving image corresponding to the indicated position from the MPD file supplied from the MPD processor 292.
In step S221, the moving image acquirer 297 acquires a moving image from the Web server 12 or the like on the basis of the acquired URL, and supplies the acquired moving image to the display controller 295.
In step S222, the display controller 295 supplies the moving image supplied from the moving image acquirer 297 to the display device, not depicted, which displays it. The process is now ended.
In the third embodiment, a partial mosaic image is displayed after a mosaic image has been displayed, and a position on the partial mosaic image is indicated by the user. However, a partial mosaic image say not be displayed, and a position on the mosaic image may be indicated directly by the user.
The above sequence of processes may be hardware-implemented or software-implemented. If the sequence of processes is software-implemented, then software programs are installed in a computer. The computer may be a computer incorporated in dedicated hardware or a general-purpose personal computer which is capable of performing various functions by installing various programs.
A computer 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, and a RAM (Random Access Memory) 903 that are connected to each other by a bus 904.
An input/output interface 905 is connected to the bus 904. To the input/output interface 905, there are connected an input unit 906, an output unit 907, a storage unit 908, a communication unit 909, and a drive 910.
The input unit 906 includes a keyboard, a mouse, and a microphone, etc. The output unit 907 includes a display and a speaker, etc. The storage unit 908 includes a hard disk and a non-volatile memory, etc. The communication unit 909 includes a network interface, etc. The drive 910 works on a removable medium 911 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like.
In the computer 900 thus constructed, the CPU 901 loads programs stored in the storage unit 908, for example, through the input/output interface 905 and the bus 904 into the RAM 903 and executes the programs to perform the processes described above.
The programs run by the computer 900 (the CPU 901) can be recorded on and provided by the removable medium 911 as a package medium or the like, for example. The programs can also be provided through a wired or wireless transmission medium such as a local area network, the Internet, or a digital satellite broadcast.
In the computer 900, the programs can be installed in the storage unit 908 through the input/output interface 905 when the removable medium 911 is inserted into the drive 910. The programs can also be received by the communication unit 909 through a wired or wireless transmission medium and installed in the storage unit 908. The programs can alternatively be pre-installed in the ROM 902 or the storage unit 908.
The programs that are executed by the computer 900 may be programs in which processes are carried out in chronological order in the sequence described above, or may be programs in which processes are carried out parallel to each other or at necessary timings as when called for.
In the present specification, the term “system” means a collection of components (apparatus, modules (parts), or the like), and it does not matter whether all the components are present in the same housing or not. Therefore, both a plurality of apparatus housed in each housing and connected by a network, and a single apparatus having a plurality of modules housed in one housing may be referred to as a system.
The advantages referred to above in the present specification are only illustrative, but not limitative, do not preclude other advantages.
The embodiments of the present disclosure are not limited to the above embodiments, and various changes may be made therein without departing from the scope of the present disclosure.
The present disclosure may be presented in the following configurations:
(1)
An information processing apparatus including:
a setting section that sets a position protruding out of a screen as a position on the screen of an image made up of a plurality of divided images compatible with encoded streams.
(2)
The information processing apparatus according to (1), in which the plurality of divided images are images of facing ends which are part of an entire celestial sphere image or a panoramic image.
(3)
The information processing apparatus according to (1) or (2), in which the setting section sets the position of the image on the screen in a management file for managing files of the encoded streams.
(4)
An information processing method including:
a setting step that sets a position protruding out of a screen as a position on the screen of an image made up of a plurality of divided images compatible with encoded streams in an information processing apparatus.
(5)
An information processing apparatus including: an allocator that places an image obtained by decoding encoded streams on a screen, on the basis of a position protruding out of the screen which is set as a position on the screen of the image which is made up of a plurality of divided images compatible with the encoded streams.
(6)
The information processing apparatus according to (5), in which the plurality of divided images are images of facing ends which are part of an entire celestial sphere image or a panoramic image.
(7)
The information, processing apparatus according to (5) or (6), in which the position of the image on the screen is set in a management file for managing files of the encoded streams.
(8)
An information processing method including:
an allocating step that places an image obtained by decoding encoded streams on a screen, on the basis of a position protruding out of the screen which is set as a position on the screen of the image which is made up of a plurality of divided images compatible with the encoded streams in an information processing apparatus.
(9)
An information processing apparatus including:
a setting section that sets positions on a screen of respective divided images of an image which is made up of a plurality of divided images compatible with encoded streams, in association with positions of the divided images on the image.
(10)
The information processing apparatus according to (9), in which the image is part of an entire celestial sphere image or a panoramic image, or a mosaic image.
(11)
The information processing apparatus according to (9) or (10), in which the encoded streams are encoded streams representing the divided images encoded as different tiles.
(12)
The information processing apparatus according to any one of (9) through (11), in which the setting section sets the position of the image on the screen in a management file for managing files of the encoded streams.
(13)
An information processing method including:
a setting step that sets positions on a screen of respective divided images of an image which is made up of a plurality of divided images compatible with encoded streams, in association with positions of the divided images on the image in an information processing apparatus.
(14)
An information processing apparatus including:
an allocator that places divided images of an image obtained by decoding encoded streams on a screen, on the basis of positions on the screen of the divided images of the image which are set in association with positions on the image which is made up of a plurality of divided images compatible with the encoded streams.
(15)
The information processing apparatus according to (14), in which the image is part of an entire celestial sphere image or a panoramic image, or a mosaic image.
(16)
The information processing apparatus according to (14) or (15), in which the encoded streams are encoded streams representing the divided images encoded as different tiles.
(17)
The information processing apparatus according to any one of (14) through (16), in which the position of the image on the screen is set in a management file for managing files of the encoded streams.
(18)
An information processing method including:
an allocating step that places divided images of an image obtained by decoding encoded streams on a screen, on the basis of positions on the screen of the divided images of the image which are set in association with positions on the image which is made up of a plurality of divided images compatible with the encoded streams in an information processing apparatus.
11 File generating apparatus, 14 Moving-image playback terminal, 170 Entire celestial sphere image, 173-1 Left end image, 173-2 Right end image, 180 Screen, 195 Allocator, 211 File generating apparatus, 250 Mosaic image, 251 Through 254 Thumbnail image
| Number | Date | Country | Kind |
|---|---|---|---|
| 2015-119360 | Jun 2015 | JP | national |
This application is a continuation of U.S. patent application Ser. No. 15/564,883(filed on Oct. 6, 2017), which is a National Stage Patent Application of PCT International Patent Application No. PCT/JP2016/065865 (filed on May 30, 2016) under 35 U.S.C. § 371, which claims priority to Japanese Patent Application No. 2015-119360 (filed on Jun. 12, 2015), which are all hereby incorporated by reference in their entirety.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15564883 | Oct 2017 | US |
| Child | 16368075 | US |
