Patent Application
20140302826
The present invention is related to a mobile terminal, a data terminal, and a server. In particular, the present invention is related to a mobile terminal that can collectively use and browse image data stored in various locations, and send them to a Web service using both the mobile terminal and the data terminal.
Various mobile terminals such as mobile phones, tablet devices, and mobile game devices have a wireless communication function and an imaging function. In particular, in recent years, smart phones arranged with large display devices and touch sensors and including a flexible user interface with display large amounts of data have spread rapidly. As a result, a large number of images have been taken using mobile terminals such as smart phones including a wireless communication function. Actually, it is known that many users take images using both camera and mobile phones.
Images taken by a mobile terminal having a wireless communication function such as a smart phone are stored in a storage means in the mobile terminal or a storage medium such as a micro SD card, and are viewed using a display means in the mobile terminal. Furthermore, images taken by a mobile terminal may also be sent to a Web service provided on the Internet using a wireless communication function. For example, users can post an image taken by smart phones directly SNS (Social Networking Service) using the wireless communication function or back up the images to a storage service connected to the Internet.
On the other hand, image data taken by a digital camera is stored in a storage medium having non-volatile semiconductor memory such as an SD card or CompactFlash (registered trademark) that can be attached to the camera. Furthermore, a user connects the memory card in which images are stored to a data terminal such as a personal computer, and copies and stores an image to one data terminal and browses the image using the display means of the data terminal. Because many cameras do not have a communication function, images taken by a camera are often sent to the Internet after first being copied to the data terminal.
Mobile phones are carried around much more often than cameras. For this reason, when a user uses both a mobile terminal having an imaging capability and a camera, the number of images taken by a single user increases much more than those taken using only a camera. Furthermore, in recent years, with the miniaturization of semiconductor technology, the memory capacity of a storage medium such as a memory card used digital cameras has increased, which has led to the number of images taken increasing. A camera user can select just good images and store them by taking a large amount of images and organizing them later without having to worry about costs and limitations of the storage capacity.
Under such circumstances, the situation arises whereby a large amount of image data taken by a user using both a digital camera and a mobile terminal having a wireless communication function becomes dispersed and stored in memory cards attached to a camera, mobile terminals such as a mobile phone, data terminals such as a personal computer and Web services.
Therefore, regardless of the storage location of the image data distributed and stored by a user, the demand for browsing, using and sending to a Web service the image data using both a mobile terminal and data terminal arises. For example, viewing an image taken by a camera together with an image taken using a smartphone, or reversely viewing a high quality image taken using a smart phone together with an image taken using a camera on a personal computer is one example of this demand.
In order to browse, use, and send to a Web service etc., image data dispersed and stored in various storage locations by a user using both a mobile terminal and a data terminal, methods such as copying images across storage locations or centralized storage of image data on a server have been adopted. However, these methods have the following five problems.
The first problem is that the copy operation is complicated. For example, all images taken using a mobile phone are copied to a personal computer and reversely, all images taken by a digital camera and stored in a plurality of memory cards are copied to a mobile phone, which is complicated copy operation. In particular, in the case of taking a large number of images using both a digital camera and a mobile phone, this problem becomes serious. In addition, for example, in the case of using a communication function of a mobile phone and submitting an image taken by a camera outside to a Web service such as SNS, it is necessary to copy the image taken by the camera to the mobile phone. However, it is often the case that it is not possible to connect a memory card which can be attached and removed to and from a digital camera to a mobile phone. Therefore, an operation such as submitting an image taken by a camera to a Web service after it is copied to a personal computer once has become necessary.
Since transfer of image data by a camera to the Internet taken is more complicated than a mobile terminal having a wireless communication function such as a smart phone, connecting a memory card or a digital camera directly to the internet has been proposed (for example, see Patent Document 1, Patent Document 2, and Patent Document 3). Furthermore, a proposal to store the taken image data in a memory card of an imaging terminal or selecting or setting to upload the image data to a server on a network directly is disclosed (for example, see Patent Document 4). Any of these previous attempts are intended to establish a communication path for copying, the copy operation was not necessarily required and therefore a user was free from the complexity of the copy operation.
The second problem is that the maintaining consistency between storage locations becomes difficult by the copy operation. A large number of images taken by a single user end up being scattered across a plurality of memory cards, mobile terminals, and servers after copy operations, and maintenance of consistency of data between each storage location is difficult. For example, it is difficult for a user with thousands of images to maintain a state where all the images taken by the previous camera can be browsed at all times on a display unit of a mobile terminal is difficult due to the copy operation. In addition, when an image taken with a camera is copied to a personal computer and the copy operation is performed of the same image again after having forgotten this operation, the same image data of the two images end up being stored in the personal computer.
The third problem is that the storage capacity of a mobile terminal is not large enough to store all image data for many users. Therefore, in order to view and use an image taken by a camera on a mobile terminal such as a smart phone, an image is taken using the camera and a part of the image data stored in a memory card or a personal computer is copied to the mobile terminal. It is often the case that an image to be viewed using a mobile terminal is not stored in a mobile phone using this operation. In addition, when a part of the image data is copied to the mobile terminal, the problem of consistency of the image data mentioned above as the second problem increases the difficulty.
The fourth problem is that transfer of images between terminals using wireless communication has many restrictions with regards to where a network can be used and how large its transfer rate is. For example, there are many places where a so-called 3G network of a mobile phone can be used and by copying or uploading image data between the data terminal to a server using the network, it is possible to immediately synchronize image data between a mobile terminal, an information terminal, and a server. However, since the communication line of a mobile phone such as a 3G line is slow, a lot of time is necessary for transferring a large amount of image data. Consequently, a method of not using a line of a mobile phone for transferring image data or uploading to a server is used either by direct connection of a mobile terminal to a local area network or via high-speed wireless communications such as Wi-Fi. Although it is possible to save transfer time, the places where local area networks or Wi-Fi communications can be used is severely limited in comparison with a 3G network, and the immediacy of linking image data between a mobile phone, an information terminal, and a server is significantly impaired. In the conventional method it is impossible to eliminate this trade-off.
The fifth problem is that transferring the image data presses a mobile communication line having a limited bandwidth. With the rapid spread of smart phones, browsing the Web and sending and receiving image data has increased significantly. As a result, the bandwidth of mobile phone lines such as 3G which are operated by a mobile communication operator becomes insufficient and the mobile network operator may not be able to maintain the line infrastructure under a flat rate scheme for users. Consequently, mobile communication operators shift to pay-per-use for the amount of communication data from the flat rate and are setting limits on the total amount of data transfer via a 3G network from a smartphone. However, this has made the first to fourth problems described above more sever and a fundamental solution of all of these problems is an urgent need.
The sixth problem is that the cost of managing a server is increased in the case of centralized management of image data using a server. As described above, one conventional method for storing with consistently a large amount of image data stored in both a mobile terminal and data terminal and also browse and use the image data on both terminals centrally stores the image data in advance in a server. Regardless of low-speed lines such as 3G or high-speed lines such as local area networks or Wi-Fi, it is possible to view and use all image data via a Web browser on both the mobile terminal and information terminal. However, a problem of centralized management by such a server is that when a large amount of image data taken by a user with a camera and a mobile terminal is all stored in a server, the cost for the server maintenance is increased and a burden on the user occurs. For example, as in Non-Patent Document 3, when image data that exceeds a certain storage amount is stored in a server, most Web services require the user to bear the cost and this prevents the spread of centralized management of the images by the server.
The present invention has been made in view of such circumstances and provides a mobile terminal, a data terminal, a server, a memory card system, and a method whereby after having taken images using a plurality of imaging terminals such as a mobile phone or a camera, the image data stored in various location such as a mobile phone, a memory card, a data terminal and a personal computer, it is possible to collectively use, browse and send the image data to a the Web service using both the mobile terminal and data terminal.
As one embodiment of the present invention, a mobile terminal comprising: a first sending and receiving means configured to communicate with a server via a first network; a second sending and receiving means configured to communicate with the server via a second network having a slower speed than that of the first network; an imaging means; and a display means; wherein the imaging means generates a first real image data; the first real image data is stored in a memory card; a first summary image data is generated from the first real image data; the second sending and receiving means sends via the second network and the server the first summary image data to a data terminal configured to communicate with the server; the second sending and receiving means receives, via the second network and the server from the data terminal storing a second real image data, a second summary image data generated from the second real image data by the data terminal; the second summary image data is stored in the memory card; and the display means simultaneously performs a first image display for expressing the first real image data and a second image display for expressing the second summary image data.
As one embodiment of the present invention, a mobile terminal comprising: a first sending and receiving means configured to communicate with a server via a first network; a second sending and receiving means configured to communicate with the server via a second network having a slower speed than that of the first network; an imaging means; and a display means; wherein the imaging means generates a first real image data; the first real image data is stored in a memory card; a first summary image data is generated from the first real image data; the second sending and receiving means sends via the second network and the server the first summary image data to a data terminal configured to communicate with the server; the second sending and receiving means receives, via the second network and the server from the data terminal storing a second real image data, a second summary image data generated from the second real image data by the data terminal; the mobile terminal stores the second summary image data; and the display means simultaneously performs a first image display for expressing the first real image data and a second image display for expressing the second summary image data.
As one embodiment of the present invention, a mobile terminal comprising: a first sending and receiving means configured to communicate with a server via a first network; a second sending and receiving means configured to communicate with the server via a second network having a slower speed than that of the first network; an imaging means; and a display means; wherein the imaging means generates a first real image data; the first real image data is stored; a first summary image data is generated from the first real image data; the second sending and receiving means sends via the second network and the server the first summary image data to a data terminal configured to communicate with the server; the second sending and receiving means receives, via the second network and the server, from the data terminal storing a second real image data, a second summary image data generated from the second real image data by the data terminal; the second summary image data is stored; and the display means simultaneously performs a first image display for expressing the first real image data and a second image display for expressing the second summary image data.
As one embodiment of the present invention, a mobile terminal comprising: a first sending and receiving means configured to communicate with a server via a first network; a second sending and receiving means configured to communicate with the server via a second network having a slower speed than that of the first network; an imaging means; and a display means; wherein the imaging means generates first real image data; the first real image data and a first image ID for specifying the first real image data and is stored in a memory card wherein the first real image data and the first image ID are correlated; the first image ID and a memory card ID for specifying the memory card are stored in a table wherein the first image ID the memory card ID are correlated; the mobile terminal generates a first summary image data from the first real image data; the second sending and receiving means sends via the second network and the server the first summary image data to a data terminal configured to communicate with the server; the second sending and receiving means receives, via the server and the second network from the data terminal storing a second real image data, a second image ID for specifying the second real image data and a second terminal ID for specifying the data terminal, and a second summary image data generated from the second real image data by the data terminal; the mobile terminal stores the second summary image data and the second image data in a memory card wherein the second summary image data and the second image data are correlated; and the mobile terminal stores the second real image ID and the second terminal ID in the table wherein the second real image ID and the second terminal ID are correlated.
As one embodiment of the present invention, a mobile terminal comprising: a first sending and receiving means configured to communicate with a server via a first network; a second sending and receiving means configured to communicate with the server via a second network having a slower speed than that of the first network; an imaging means; and a display means; wherein the imaging means generates a first real image data; the first real image data and a first image ID for specifying the first real image data are stored in a first table wherein the first real image data and the first image ID are correlated; the first image ID and a terminal ID for specifying the mobile terminal are stored in a second table wherein the first image ID and the terminal ID are correlated; a first summary image data is generated from the first real image data; the second sending and receiving means sends via the second network and the server the first summary image data to a data terminal configured to communicate with the server; the second sending and receiving means receives via the server and the second network from the data terminal storing a second real image data, a second image ID for specifying the second real image data, a second terminal ID for specifying the data terminal from the data terminal, and a second summary image data generated from the second real image by the data terminal; the second summary image data and the second image data are stored in the first table wherein the second summary image data and the second image data are correlated; the second real image ID and the second terminal ID are stored in the second table wherein the second real image ID and the second terminal ID are correlated.
As one embodiment of the present invention, a server comprising: a sending and receiving means configured to communicate with a first network and a second network having a slower speed than that of the first network; wherein a first summary image data generated from a first real image data imaged by a mobile terminal and stored in a memory card connected to the mobile terminal is received via the second network from the mobile terminal; the first summary image data is stored; the first summary image data is sent to a data terminal via the second network; a second summary image data generated from second real image data stored by the data terminal is received via the second network from the data terminal; the second summary image data is stored; the second summary image data is sent to the mobile terminal via the second network; the first real image data is received via the first network from the mobile terminal; the first real image data is sent to the data terminal via the first network; the second real image data is received via the first network from the data terminal; and the second real image data is sent to the mobile terminal via the first network.
As one embodiment of the present invention, a data terminal comprising: a sending and receiving means capable of communicating with a mobile terminal via a first network, the mobile terminal including a first mobile terminal sending and receiving means communicating with the first network and a second mobile terminal sending and receiving means communicating with a second network having a slower speed than that of the first network; and a display means; wherein a first real image data is stored; a first summary image data is generated from the first real image data; the sending and receiving means sends the first summary image data to the mobile terminal via the first network, the second network, and the second mobile terminal sending and receiving means; the sending and receiving means receives, via the second mobile terminal sending and receiving means the second network, and the first network from the mobile terminal storing a second real image data, a second summary image data generated from the second real image data by the mobile terminal; the second summary image data is stored; and the display means simultaneously performs a first image display for expressing the first real image data and a second image display for expressing the second summary image data.
As one embodiment of the present invention, a system comprising: a data terminal capable of communicating with a first network; a mobile terminal capable of being connected to the first network and a second network having a slower speed than that of the first network; and a server; wherein while the mobile terminal is connected to the second network, the mobile terminal sends a first summary image data generated from a first real image data stored by the mobile terminal to the data terminal via the second network, the server, and the first network; the data terminal stores the first summary image data; a second summary image data generated from a second real image data stored by the data terminal is sent to the mobile terminal by the data terminal via the first network, the server, and the second network; the mobile terminal stores the second summary image data; while the mobile terminal is connected to the first network, the mobile terminal sends the first real image data to the data terminal via the first network; the data terminal stores the first real image data; the data terminal sends the second real image data to the mobile terminal via the first network; and the mobile terminal stores the second real image data.
As one embodiment of the present invention, a mobile terminal comprising; an imaging means; a sending and receiving means capable of communicating with a data terminal via a server and a network; a network speed measurement means; and a display means; wherein the network speed measurement means measures the communication speed of the network by communicating with the server via the sending and receiving means and the network; a first communication speed related data is generated from a first measurement result; the imaging means generates a first real image data; the first real image data is stored; a first summary image data of a first data amount determined according to the first communication speed related data is generated from the first real image data; the first summary image data and the first communication speed related data are stored wherein the first summary image data and the first communication speed related data are correlated; the sending and receiving means sends the first summary image data and the first communication speed related data to the data terminal via the network; the sending and receiving means receives, via the network from the data terminal storing a second real image data, a second summary image data of the first data amount, the second summary image data being generated from the second real image data by the data terminal; and the second summary image data and the first communication speed related data are stored wherein the second summary image data and the first communication speed related data are correlated.
As one embodiment of the present invention, a system comprising: a network; a mobile terminal capable of communicating with the network; and a data terminal capable of communicating with the network; wherein after measuring a network communication speed, the mobile terminal generates a first communication speed related data from a first result of the measurement; the mobile terminal generates an image and stores the image as a first real image data; the mobile terminal generates a first summary image data of a first data amount determined by the first communication speed related data, the first summary image data being generated from the first real image data; the mobile terminal sends the first summary image data and the first communication speed related data to the data terminal via the network; the data terminal stores the first summary image data and the first communication speed related data wherein the first summary image data and the first communication speed related data are correlated; a second summary image data of the first data amount is generated from second real image data stored by the data terminal; the data terminal sends the second summary image data to the mobile terminal; the mobile terminal stores the second summary image data and the first communication speed related data wherein the second summary image data and the first communication speed related data are correlated; a second communication speed related data is generated from a first result of measuring the network communication speed by the mobile terminal; the mobile terminal compares the firs communication speed related data and the second communication speed related data; a third summary image data is generated from the first real image data, the third summary image data being of a second data amount determined by the second communication speed related data, in the case where the second communication speed related data is larger than the first communication speed related data; the mobile terminal sends the third summary image data and the second communication speed related data to the data terminal via the network; the data terminal stores the third summary image data and the second communication speed related data wherein the third summary image data and the second communication speed related data are correlated; the data terminal generates a fourth summary image data of the second data amount from the second real image data; the data terminal sends the fourth summary image data to the mobile terminal via the network; and the mobile terminal stores the fourth summary image data and the second communication speed related data wherein the fourth summary image data and the second communication speed related data are correlated.
As one embodiment of the present invention, a mobile terminal comprising: a sending and receiving means capable of communicating with a first server and a second server via a network; a display means; and a cache table; wherein a first communication speed related data representing the communication speed of the network is received from the first server; the first communication speed related data is stored; a first image list display data including an image display expressing a real image data stored by the second server is received from the first server; the display means displays a first image list generated from the first image list display data; a second communication speed related data which is generated from the real image data and is correlated with a first summary image data which is stored in the cache table is compared with the first communication speed related data; the sending and receiving means sends a request for a second summary image data, the second summary image data being generated from the real image data the second summary image data being of a first data amount corresponding to the first communication speed related data, and the first communication speed related data to the second server wherein the request for the second image data and the first communication speed related data are correlated, in the case where the first communication speed related data is larger than the second communication speed related data; the sending and receiving means receives the second summary image data from the second server; and the cache table stores the second summary image data and the first communication speed related data wherein the second summary image data and the first communication speed related data are correlated.
As one embodiment of the present invention, a mobile terminal comprising: a sending and receiving means capable of communicating with a first server and a second server via a network; a display means; and an image cache table; wherein a first communication speed related data representing the communication speed of a network is received from the first server; the first communication speed related data is stored; a first image list display data including an image display expressing a real image data stored by the second server is received from the first server; the display means displays a first image list generated from the first image list display data; the sending and receiving means sends a request for a second summary image data generated from the real image data, the second summary image data being of a first data amount corresponding to the first communication speed related data, and the first communication speed related data to the second server wherein the request for the second summary image data and the first communication speed related data are correlated, in the case where summary image data generated from the real image data is not stored in the image cache table; the sending and receiving means receives the second summary image data from the second server; and the image cache table stores the second summary image data with the first communication speed related data wherein the second summary image data with the first communication speed related data are correlated.
As one embodiment of the present invention, a mobile terminal comprising: a sending and receiving means capable of communicating with a first server and a second server via a network; a display means; an input means; and a cache table; wherein a first communication speed related data representing the communication speed of the network is received from the first server; the first communication speed related data is stored; a first image list display data including a first image ID is received from the first server; the first communication speed related data and the first image ID are sent to the second server; a first thumbnail data stored by the second server, the first thumbnail being correlated with the first image ID, being of a first data amount, and being generated from the first real image data, the first data amount corresponding to the first communication speed related data, is received from the second server; the display means display a first image list generated from the first image list display data and including the first thumbnail data; a second communication speed related data expressing the communication speed of the network is received from the first server; the second communication speed related is stored; a second image list display data including a second image ID is received from the first server; the second communication speed related data and the second image ID are sent to the second server; a second thumbnail data stored by the second server with the second image ID, the second thumbnail data being correlated with the second image ID, being of a second data amount, and generated from second real image data, the second data amount corresponding to the second communication speed related data, is received from the second server; and the display means displays a second image list generated from the second image list display data and including the second thumbnail data.
According to the present invention, after having taken images using a plurality of imaging terminals such as a mobile phone or a camera, the image data stored in various location such as a mobile phone, a memory card, a data terminal, and a personal computer, it is possible to collectively use, browse and send to a Web service the image data using both the mobile terminal and the data terminal. In addition, according to the present invention, by utilizing multiple networks having different communication speeds, the cost for implementing these is reduced compared to conventional methods.
The best mode presently contemplated for carrying out the present invention is explained below. Since the scope of the present invention is clearly defined by the scope of the appended claims, the scope of the present invention should not be interpreted in a limited since and the explanation below is only intended to merely illustrate the general principles of the invention.
In the present specification, image data taken by an imaging terminal or a mobile terminal and also stored in a memory card, the mobile terminal, the data terminal or a server is called an original image. In addition, an image obtained by processing an original image is referred to a processed image of that original image. When comparing two images either an original image or a processed image, an image with a larger amount of data is referred to as a real image and a data with a smaller amount of data is referred to as a summary image. For example, when an original image having RAW format is converted to a JPEG (Joint Photographic Experts Group) format image with a smaller amount of data, the original image is a real image and the process image of this original image is a summary image. Furthermore, in the case where two processed images are generated from one original image, the processed image with a large amount of data is a real image and the processed image with a small amount of data is a summary image. If a real image is image data stored in an image storage means of an imaging terminal, for example, the image may be of any image format such as RAW, JPEG, JPEG2000, TIFF (Tagged Image File Format) or GIF (Graphics Interchange Format) specific to that imaging terminal. A summary image may also be of any format such as JPEG, RAW, PNG (Portable Network Graphic), TIFF (Tagged Image File Format) or GIF. In addition, in the present invention, image data may a still image or video. In the case where image data is video, a real image or a summary image may be of any format such as MPEG-1 (Moving Picture Experts Group), MPEG-2, MPEG-4, AVI (Audio Video Interleave) or MOV (Quicktime format). In the description below, regardless of whether an image data is a still image or video, when there are two image data generated from the same original image, the image with the larger amount of data is called a real image and the image with a smaller amount of image data is called a summary image.
Using the flow diagram in
A user A who uses the mobile terminal 100 and the data terminal 120 connects the mobile terminal 100 to the second network 192 (step S801). This corresponds to connecting the mobile phone 100 to a 3G line for example. Next, the user A takes an image using the imaging means 104 of the mobile terminal. A real image data produce by the imaging means 104 is sent to the memory card M180 via the memory card input and output means 103 along with a real image ID for specifying the real image data. In the example in
Next, the input and output means of the memory card 180 sends a card ID for specifying the memory card M and which is stored in the card ID storage means 182 to the mobile terminal. When the memory card input and output means 103 of the mobile terminal receives this, the card ID is correlated with the real image ID of the image taken in step S802 and stores MIDm in the image attribute table 105 (step S803). Furthermore, the image data amount change means 107 of the mobile terminal generates a summary image of the image taken in step S802 and a summary image ID which uniquely specifies the summary image. Next, the image attribute table 105 of the mobile terminal correlates this with the real image ID and stores the summary image ID generated at this time. In addition, at this time, the generated summary image data is correlated with the summary image ID and stored in the image data table 106 (step S804). An example of the image data table 106 after step S804 has been carried out is shown in
Next, the second network sending and receiving means 101 of the mobile terminal sends a summary image data, a summary image ID and a real image storage location correlated with a real image ID to the application server 104 via the second network 192 (step S805). When the application server 140 receives these, the real image ID and the summary image data are correlated and stored in the summary image data table 142, and the real image ID, the real image storage location, and the summary image ID are correlated and stored in the image attribute table 143. Furthermore, the sending and receiving means 141 sends a real image ID, a summary image ID, a summary image data, and a real image storage location, which are received from the mobile terminal 100 to the data terminal via the first network 191 (step S806). An example of the summary image data table 142 after step S806 has been carried out is shown in
Next, when the network sending and receiving means 121 of the data terminal 120 receives a real image ID, a summary image ID, a summary image data, and a real image storage location sent from the application server 140 in step S806, the real image ID, the summary image ID, and the real image storage location are correlated and stored in the image attribute table 123, and the summary image ID and the summary image data are correlated and stored in the image data table 124 (step S807). It is possible to provide the image attribute table 123 and the image data table 124 of the data terminal 120 with the same structure as the image attribute table 105 and the image data table 106 of the mobile terminal 100 respectively.
Next, user A connects the memory card N185 to the memory card input and output means 122 of the data terminal (step S808). At this time, a real image data taken by an imaging terminal such as a camera and stored in the memory card N is stored in the image storage means 187 of the memory card N. Next, the input and output means 186 of the memory card N sends a real image ID and the real image data stored in the image storage means 187 and a memory card ID stored in the card ID storage means 188 to the data terminal 120. In the example in
When the memory card input and output means 122 of the data terminal receives these, the image data table 124 correlates and stores the real image ID and the real image data. In addition, the received MIDn and the terminal ID of the data terminal 120 stored in the terminal ID storage means 128 are correlated with the real image ID and stored in the image attribute table 123 (step S809). An example of the image data table 124 after step S809 has been carried out is shown in
Next, the user A requests an image list screen by operating the input means 126 of the data terminal. Then, after generating an image list screen the display means displays the screen using the data of the image data table 124. An example of the image list screen in the data terminal 120 after step S809 has been carried out is shown in
In the example in
Next, the user A moves the cursor 1202 displayed in the display means 127 by operating the input means 126, selects image 1211 and the display means 127 displays an enlarged version of this image. The image 1211 in
In general, a user wishes to collectively manage image data taken with a mobile terminal and image data taken with a dedicated imaging terminal such as a camera and stored in a data terminal via a memory card. In the case where the second network 192 is a low speed line such as a mobile phone 3G line, it was necessary to send a real image taken using the mobile terminal 100 to the data terminal 120 via the 3G line in order to collectively manage images of a mobile terminal and images of a data terminal under the conventional method. However, in this type of method, since a large amount of time is required for transferring real image data using a low speed line, convenience for a user is lost. Furthermore, under the conventional method, there is the problem whereby the limited bandwidth of providers of mobile communication is consumed by the transfer of real image data.
Under the method of the present invention explained so far, only summary images of images taken using the mobile terminal 100 are sent to the data terminal 120 via the second network 192 immediately after images being taken. As a result, as is shown in
Next, the image data amount change means 125 generates a summary image data and a summary image ID for specifying the summary image data from the real image data received from the memory card N. Next, the image attribute table 123 of the data terminal correlated the summary image ID with the real image idea and stored the summary image ID generated at this time (step S810).
Next, the network sending and receiving means 121 of the data terminal sends the summary image ID and the summary image data generated in step S810 to the application server 140 via the first network together with card ID of the memory card N and the terminal ID of the data terminal (step S811). The sending and receiving means 141 of the application server receives these, correlates the received summary image ID and the summary image data and stores them in the summary image data table 142. In addition, the real image ID, the summary image ID, the card ID of the memory card N, and the terminal ID of the data terminal, which are received, are each correlated and stored in the image attribute table 143. An example of the summary image data table 142 and image attribute table 143 after this process is carried out is shown in
Next, the sending and receiving means of the application server sends the real image ID, the summary image ID, the summary image data and the real image storage location, which has been received from the data terminal 120, to the mobile terminal 100 via the second network 192 (step S812). When these are received by the second network sending and receiving means 101 of the mobile terminal, the summary image ID and the summary image data, which are received, are correlated and stored in the image attribute table 106. In addition, the real image ID, the summary image ID, the card ID of the memory card N and the terminal ID of the data terminal, which are received, are correlated and stored in the image attribute table 105 (step S813). An example of the image data table 106 and image attribute table 105 after step S813 has been carried out is shown in
Next, by the operation by the user A of the input means 109 of the mobile terminal, the user A requests an image list screen. Then, the display means 110 displays an image list screen using the data of the image attribute table 106. An example of an image list screen in the mobile terminal 100 after step S813 has been carried out is shown in
Here, supposing that the memory card M180 is removed from the mobile terminal 100, because the image list screen in
As already explained using
Next, the first embodiment is explained using the flow chart shown in
The mobile terminal is connected to the relay device 196, for example, and when a communication via the first network sending and receiving means 102 becomes possible, the search means 111 of the mobile terminal searches the real image storage location column 906 of the image attribute table 105, TID2, which is the terminal ID of the data terminal 120, is not stored, and the real image ID of an image stored with MIDm, which is the card ID of the memory card M, is searched (step S1802). This is a state whereby real image data cannot be used in the data terminal 120 from the image data table 105 and means that the mobile terminal 100 searches for an image in a state whereby real image data can be used. Again referring to FIG. 16, as a result of this, the real image IDs 915 and 925 are obtained. Because each of the real image storage locations 916 and 926 correlated and stored with these real image IDs are the card ID of the memory card M, the search means 111 searches the image storage means 183 of the memory card M using the real images IDs 915 and 925 as a search result via the memory card input and output means 103. Next, the mobile terminal 100 obtains the real image data, which is to be searched, via the memory card input and output means 103, correlated with each real image ID respectively and sends to the data terminal 120 from the first network sending and receiving means 102 (step S1803).
In the first embodiment, as is shown in
Next, when the network sending and receiving means 121 of the data terminal receives a real image ID and a real image data sent from the mobile terminal 100 in the step S1803, these are stored in the image data table 124 (step SS1804). An example of the image data table 124 and image attribute table 123 after step S1804 has been carried out is shown in
Next, the display means 127 displays an image list screen based on the image data in the refreshed image data table 124 (step S1805). An example of the refreshed image display screen is shown in
In addition, when it is detected that the mobile terminal is connected to the relay device 196 (step S1801) and that the mobile terminal is connected to the first network sending and receiving means 102, this is notified to the data terminal 120 via the first network sending and receiving means 102 or the second network sending and receiving means 101. When the data terminal 120 receives this notification, the search means 129 of the data terminal searches the real image storage location column 1106 of the image attribute table 123, TID1 which is a terminal ID of the mobile terminal 100 or MIDm which is a card ID of the memory card M are not stored and a real image ID of an image stored with TID2 which is a terminal ID of the data terminal 120 is searched (step S1806). Again referring to
In the first embodiment, as is shown in
Next, when the first sending and receiving means 102 of the mobile terminal receives the real image ID and the real image data sent from the data terminal 120 in step S1807, these are stored in the image data table 106 (step S1808). Before step S1808 is carried out, the image data table 106 in the state shown in
Next, the display means 110 displays an image list screen based on the image data in the refreshed image data table 106 (step S1809). An example of the refreshed image display screen is shown in
In the present invention, as explained above, after the mobile terminal 100 is connected to the first network or after direct communication with the data terminal 120 is possible (step S1801), real image data which can be used by the mobile terminal 100 is sent to the data terminal 120 and real image data which can be used by the data terminal 120 is sent to the mobile terminal 100 via the first network or by direct communication and stored respectively. In this way, it is possible to use real image data taken with the mobile terminal 100 in the data terminal and reversely it is possible to use real image data stored in the data terminal 120 in the mobile terminal.
The contents explained referring to
The display means of the data terminal shown in
As can be seen from
In the first embodiment, an image data is received by one mobile terminal 100 and one data terminal 120 via the first network 191 and the second network 192. In the method of the present invention, a reception of image data can also be performed between a plurality of mobile terminals, a plurality of data terminals and between a plurality of mobile terminals and data terminals.
In addition, in the first embodiment and example of the present invention is explained assuming that a real image data taken by the storage means mobile terminal 100 is not stored but only a summary image data is stored. The capacity of a storage means of a mobile terminal is often small and in such a case the method of the first embodiment is effective. However, in the present invention, a real image data may be stored not in the memory card M180 but in the storage means of the mobile terminal 100.
In addition, in the present invention, when the mobile terminal 100 is connected to the first network, a real image data stored in the mobile terminal 100 is sent to the data terminal 120 and a real image data of the data terminal 120 is sent to the mobile terminal 100. While in the explanation in the first embodiment, sending and receiving these real image data is performed with the mobile terminal 100 being a trigger, for example, the application server 140 or the data terminal 120 may be a trigger for sending and receiving real image data after the application server 140 or the data terminal 120 periodically enquires to the mobile terminal 100 whether the mobile terminal is connected to the first network 191 and searching for a connection to the first network 191.
In addition, in the first embodiment, after connecting the first network 191, sending and receiving of a real image data is performed both from the mobile terminal 100 to the data terminal 120 and from the data terminal 120 to the mobile terminal 100. However, sending and receiving of a real image data after connection to the first network 191 in the present invention may also be performed either from the mobile terminal 100 to the data terminal 120 or from the data terminal 120 to the mobile terminal 100.
In addition, in the first embodiment, the user A selects an image from a list display screen in the mobile terminal 100 and the data terminal 120 and an enlarged display of the image is displayed in a display means. However, use of a real image data or a summary image data stored in the image data table of the mobile terminal 100 and the data terminal 120 is not limited to an enlarged display. For example, a real image data or a summary image data stored in the image data table of the mobile terminal 100 and the data terminal 120 may be printed by each device or submitted to a Web service via a network.
In addition, in the first embodiment, a summary image data of an image taken by the mobile terminal 100 and a summary image data of an image stored in the data terminal 120 are stored by the application server 140. However, in the present invention, the mobile terminal 100 and data terminal 120 may receive a summary image data and a real image data using a method such as in the first embodiment and a summary image data does not need to be stored by the application server. In this case, the fifth effect described below cannot be obtained.
Next, the operational effects of the present invention related to the first embodiment are explained using
The first effect is that it is possible to manage and use images taken by a mobile terminal in a data terminal together with images stored in the data terminal. In a conventional method, in order for a user to use image data taken by a mobile terminal in a data terminal, complex operations are necessary such as connecting the mobile terminal via the first network of the data terminal and then copying real image data. Referring to
The second effect is that images taken by a camera, stored in a memory card or copied from a memory card to a data terminal and managed by the data terminal may be managed and used by a mobile terminal together with images taken by the mobile terminal. In a conventional method, in order for a user to use image data taken by a camera and managed by a data terminal in a mobile terminal, complex operations are necessary such as connecting the mobile terminal with data terminal via the first network and then copying real image data. Referring to
The third effect of the present invention is that if a mobile terminal cannot be connected to a first network such as Ethernet (registered trademark) or Wi-Fi but can connect to a second network such as a 3G line, it is possible to immediately obtain the first and second effects. Generally, a low speed network such as a mobile phone 3G line can be used in many locations by moving users, however, use of a high speed network such as Ethernet (registered trademark) or Wi-Fi is limited to locations such as homes, in places of work, at hotels, and places where public Wi-Fi services are provided. According to the conventional method, in order for image data taken by a mobile terminal and image data stored in a data terminal to be collectively managed, it is necessary to either directly connect a mobile terminal to a data terminal or copy real images in a state where communication is possible via a high speed network limited to certain locations. According to the present invention, simply by connecting a mobile terminal to a low speed network such as a 3G line which is used over a wide area range, it is possible to automatically and collectively manage image data stored in a mobile terminal and data terminal in both terminals.
The fourth effect is that even if it is possible to manage and use image data of a mobile terminal and image data of a data terminal, the transfer time of the second network is short in a state where a high speed line such as Ethernet (registered trademark) or Wi-Fi cannot be used. Conventionally, a method for managing images of a mobile terminal and image data of a data terminal entails synchronizing images between a mobile terminal, an application server, and a data terminal via a second network. However, in this method, a large amount of exchange of real image data with a large amount of data via the second network is necessary. In particular, when a large amount of real image data having a data amount of a few megabytes per image is sent via a mobile phone 3G line for example, a significant amount of transfer time is required, which is not practical. In the present invention, since data transfer using a low speed line is limited summary images, the time required for transferring image data using a second network is significantly reduced.
The fifth effect is that it is possible for a user to browse all images managed using a mobile terminal and data terminal from a mobile terminal and a data terminal which include a Web browser. In the present invention, when summary image data is exchanged between a mobile terminal and a data terminal via a second network, the summary image data is stored by the application server 140 in the summary image table. Again referring to
The sixth effect is that it is possible to reduce the costs for an operator of a second network while simultaneously providing a user with the first to fifth effects since the amount of data of images transferred using the second network is reduced compared to the conventional method. With the spread of smartphones in recent years, and the increase use of still images and video services using smartphones, the amount of transferred data using a low speed line such as 3G has increased dramatically. As a result, the necessity for new equipment investment due to a shortage in mobile phone communication capacity or deterioration in profitability of a mobile phone communication operator adopting flat-rate services have become significant problems. In order to tackle with this problem, mobile communication operators have resorted to measures such as forbidding transfer of real images via a second network such as 3G or charging users according to the amount of data transferred. However, in either case, user convenience is lost. According to the present invention, as can be seen from
The seventh effect is that it is possible to reduce the costs to an operator of an application server compared to a conventional method in which real image data are stored in a server. Conventionally, a method for browsing images via a Web browser by storing the images of a data terminal or of a mobile terminal in a server and synchronizing real image data between a plurality of data terminals has been disclosed and similar services have been provided. However, when all real images data is stored in a server, the costs to an application server operator increases significantly, which is a problem. As a result, in most services, users are required to pay a charge for storing real image data which exceeds a predetermined data amount in an application server. However, according to the present invention, since only summary image data is stored in an application server it is possible to reduce the amount of data stored in the application server.
In the first embodiment, a structure is described whereby summary image data in the case where the mobile terminal 100 is connected to the low speed second network 192 and real image data in the case where the mobile terminal 100 is connected to the high speed first network is received between the mobile terminal 100 and the application server 140. In the second embodiment explained next as another example of an embodiment of the present invention, an image data amount change means 107 of a mobile terminal and an image data amount change means 125 of a data terminal controls the data amount of summary image data and controls the amount of data of summary image data received between the mobile terminal 100 and the data terminal 120 according to the communication speed of a network. The second embodiment produces effects in the case for example where the communication speed of the second network 192 changes over time. In addition, the second embodiment is also effective when it is possible to connect the mobile terminal 100 to a plurality of networks having different speeds and switching between these networks. Furthermore, the second embodiment is effective in the case where a service provides of the second network 192 wishes to control the total amount of data of image data via the second network 192 in order to control congestion for example.
In the second embodiment, in addition to the processes in the first embodiment, a data amount flag of summary image data stored in each table is stored in the a data amount flag columns 903, 1103, and 1003 which exist in the image data table 106, the image data table 124, and the summary image table 142 respectively. Other than this, the processes are the same as in the first embodiment explained using
In the example of the second embodiment, the data transfer speed of the second network 192 may change. In addition, a communication speed prediction means 113 of a mobile terminal periodically performs a communication request to the application server 140 via the second network sending and receiving means 101 and second network 192. For example, while there is a method whereby the second network sending and receiving means 101 issues a GET command for arbitrary data to the application server, the second network sending and receiving means 101 obtains a delay and throughput until data is received from the application server 140, and the communication speed predication means 113 determines the communication speed of the second network 192 from this data, in the present invention, any method may be used as long as it is possible for the mobile terminal to predict the communication speed of the second network 192. In addition, in the present invention, communication speed data predicted and generated by the communication speed prediction means 113 may include a delay, a return communication time with the application server, and an error rate in addition to network speed.
Again referring to
Next, the same processes as step S805, S806, and S807 in the first embodiment are carried out. However, in the second embodiment, in addition to these processes, the data amount flags of summary image data represented by 2411 and 2412 and generated by the image data amount change means 107 of a mobile terminal are stored in the summary image data table 142 of the application server and image data table 124. Each of these processes is the processes 2302 an 2303 in
Next, similar to the first embodiment, real image data obtained by the data terminal 120 from the memory card N is stored in (2322) in the image data table 124 of the data terminal. In addition, TID2 and MIDn are correlated with a real image ID and stored in the image attribute table 123 as a real image storage location (corresponding to step S809 in the first embodiment). An example of the image data table 124 after process 2322 has been carried out is shown in
Reference to
Next, the image data 2518 and 2528 in the image data table 106 is rewritten with the newly generated summary image data and the data amount flags 2519 and 2529 are changed to the new data amount flag 20 (2308 in
the data terminal 120, which receives these, replaces the image data 2512 and 2522 in the image data table 124 with the new image data corresponding to the data amount flag 20 and the data amount flags 2413 and 2423 are replaces with the new data amount flag 20 (2309 in
As can be seen from
Next, the effects of the present invention related to the second embodiment are explained while referring to
The eighth effect of the present invention is that the first, second, fourth and fifth effects can be obtained even in the case where the network communication speed changes over time. For example, when the second network speed drops, a summary image data with a small amount of data is received between the mobile terminal 100 and the data terminal 120 and thus user A can obtain the convenience of rapid syncronisity of the summary image data between the mobile terminal 100 and data terminal 120 provided by the present invention. On the other hand, it is possible to reduce transfer time by not sending and receiving summary image data with a large amount of data in the state where the speed of the first network drops. When time elapses and the transfer speed of the first network improves, image data with a large amount of data can be received between the mobile terminal and the data terminal according to the transfer speed which is measured. In this way, it is possible for the user A to use better quality image data between the mobile terminal and the data terminal.
The ninth effect is that the first, second and fifth effects can be obtained even in the case where it is possible to connect the mobile terminal to a plurality of networks having different speeds and switch between these networks. Up until now, as is shown in
The tenth effect is that it is possible for an operator which manages a second network 192 such as a mobile communication operator to control the amount of data of images received via the second network 192. In recent years, bandwidth management of a 3G line with the spread of smartphones has led to a deterioration in profitability for mobile phone service providers. In the second embodiment, the communication speed prediction means 113 measures the communication data of the second network and stores the result as communication speed data. The data amount change means 107 and 125 determines a data amount of summary image data generated based on the communication speed data. However, in the present invention, communication speed data stored by the communication speed prediction means 113 is sent to a mobile terminal by a server of an operator of the second network via the second network or the first network and this may be stored by the communication speed prediction means 113. In this case, the data amount change means 107 and 125 determines the data amount of the summary image data which is generated according on the communication speed data sent from the server of the operator of the second network. In this way, the operator of the second network can control the data mount of image data handled by a second network at an arbitrary timing.
In the first and second embodiments, the application server 140 stores summary image data in the summary image data table 142. This reduces the costs related to a storage means by not storing real image data and it is possible to browse all summary image data via a Web browser in the mobile terminal 100 or the data terminal 120 (2232 and 2234 in
Next, the processes of the third embodiment are explained using the flow diagram shown in
An example of the real image table 162 after step S2602 has been carried out is shown n
Next, as is shown in
Next, the HTML generation means 145 of the application server generates an HTML code for displaying an image list of the user A based on the summary data stored in step S2601 and S2602. Next, the sending and receiving means 141 sends the HTML code to the mobile terminal 100 via the second network (step S2605). When the second network sending and receiving means 101 of the mobile terminal receives the HTML code, the HTML analysis means 112 analyzes the code and the display means 110 displays an image list display. In the case where the application 160 does not store summary image data in steps S2601 and 2602, a real image ID maybe embedded in the HTML code in advance, and summary image data required for generating an image list display may be obtained from the image server 160 when the mobile terminal 100 generated an image list display screen in step S2606.
An example of an image list display displayed in the display means 110 is shown in
Next, the user A moves the cursor 2802 displayed on the display means 110 by operating the input means 109 of the mobile terminal and selects 2812 (step S2606). In the explanation of the third embodiment, in steps S2601 and 2602 described above, real image data and summary image data are only sent to the application server 140 and image server 140 respectively and image data is not stored in the image data table 106 of the mobile terminal. Therefore, there is no data amount flag correlated with a selected image and stored in the image data table 106. As a result, the process goes to the branch of “NO” in step S2607 shown in the flow diagram in
Next, the second network sending and receiving means 101 of the mobile terminal sends a request for image data to the image server 160. At this time, a real image ID which shows that image 2813 is selected and 10 which is a data amount flag calculated in step S604 are sent to the image server and correlated with the request (step S2609). When the sending and receiving means 161 of the image server receives these, the search means 164 searches the real image data table 162 using the real image ID sent from the mobile terminal 100 in step S2609 as a search key, and obtains a real image data 2732. Next, summary image data determined by the data amount flag (value 10) sent from the mobile terminal 100 in step S2906 from the real image data 2732 by the image data change means 163 and a summary image ID which expresses it are generated. Next, the sending and receiving means 161 of the image server sends the summary image data and data amount flag to the mobile terminal 100 via the second network (step S2610).
When the second network sending and receiving means 101 of the mobile terminal receives these, the summary image ID, the summary image data and the data amount flag are correlated and stored by the image data table 106 (step S2611). The image data table 106 after step S2611 is carried out is shown in
Next, the user A removes the mobile terminal 100 from the relay device 296, which is shown in
Next, the HTML generation means 145 of the application server generates an HTNL code for display an image list display of the user A based on the summary image data stored in step S2601 and S2602 described above. Next, the sending and receiving means 141 sends the HTML code to the mobile terminal 100 via the first network (step S2506). When the first network sending and receiving means 102 of the mobile terminal receives this HTML code, the HTML analysis means 112 analyzes the code and the display means 110 display an image list display. In the case where the application server 160 does not store summary image data in steps S2601 and S2602, a real image ID is embedded in the HTML code, and when the mobile terminal 100 generates an image list display screen in step S2606, the summary image data required for generating an image list display may be obtained from the image server 160. In this example, the image list screen displayed in the display means 110 is the same as that shown in
Next, the user A moves the cursor 2802 displayed in the display mean 110 by operating the input means 109 of the mobile terminal and selects 2813 the same as before (step S2606). However, unlike before, the summary image data 2912 of an image selected in step S2606 as is shown in
Next, the first sending and receiving means 102 of the mobile terminal sends a request for image data to the image server 160. At this time, a real image ID which shows that image 2813 is selected and 20 which is the value of the newly calculated data amount flag in step S2604 are correlated with this request and sent to the image server 160 (step S2609). When the sending and receiving means 161 of the image server receives this, the search means 164 searches the real image data table 162 with a real image ID sent from the mobile terminal 100 as a search key in step S2609, and a real image data 2732 is obtained. Next, the image data change means 163 generates a new summary image data from real image data 2732 according to the data amount flag (value 20) sent from the mobile terminal 100 and a summary image ID which represents it in step S2906. Therefore, the summary image data presently generated includes a data amount larger than the summary image data sent previously to the mobile terminal 100 via the second network 292. Next, the sending and receiving means 161 of the image server sends a summary image ID generated here, the new summary image data and 20 which is the value of the data amount flag which represents this to the mobile terminal 100 via the first network (step S2610).
When the first network sending and receiving means 102 of the mobile terminal receives these, the summary image ID, the summary image data and the data amount flag received by the image data table 106 are stored and correlated (step S2611). The image data table 106 after step S2611 presently carried out is shown in
Furthermore, in the explanation in the third embodiment, the mobile terminal 100 switching between the first network and the second network is explained as is shown in
Next, the effects of the third embodiment which is one embodiment of the present invention are explained. In the third embodiment, the user A requests image data to an image server via a Web browser of a mobile terminal. At this time, the mobile terminal stores a summary image data in advance, and if the communication speed of a network which can be connected to by the mobile terminal is larger than when the summary image data is received, the image server is requested to obtain a new summary image data (NO in step S2608). On the other hand, even when the mobile terminal stores summary image data, in the case where the communication speed of a network to which a mobile terminal can be connected is lower than when the summary data is received, the summary image data already stored in the mobile terminal is displayed (YES in step S2608). In this way, in the third embodiment, the following two effects can be obtained in addition to the ten effects explained in the first to second embodiments.
The eleventh effect of the present invention according to the third embodiment is that it is possible to optimize the data amount of image data sent to a mobile terminal from a server in response to the communication speed of a network even in the case where a real image data is stored in an image server and used in a Web browser of the mobile terminal. When connecting to a network with a low transfer speed, when a real image data or a summary image data with a large data amount is sent to the mobile terminal from the server, the transfer time of image data is large and convenience is lost. On the other hand, when connected to a network with high transfer speed, when summary image data with a small data amount is sent to a mobile terminal from a server, only a low quality image can be used in the mobile terminal. According to the present invention, it is possible to automatically optimize this contradictory relationship and transfer optimum image data in response to the communication speed of a network between a mobile terminal and data terminal.
The twelfth effect is that the total data amount of image data via a network is reduced compared to providing an image browsing service to the same extent as in a method using a conventional Wen service even in the case where real image data is stored in an image server and this data is used in the Web browser of a mobile terminal. Similar to the sixth effect and tenth effect described above, in the third embodiment, in the case where the communication speed of a network to which a mobile terminal is connected is low, it is possible to reduce the total amount of data via a network compared to a conventional method by reducing the data amount of summary image data sent from an image server.
This application is a continuation application under 35 U.S.C. §111(a), of International Application PCT/JP2011/072808 filed Oct. 3, 2011, designating the U.S., the entire contents of which are incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2011/072808 | Oct 2011 | US |
| Child | 14243947 | US |
