Patent Grant
8150807
The present invention relates to the field of file sharing and, in particular to image content file sharing.
Digital imaging capture and storage continues to increase in popularity and is now the dominant form of consumer image capture, processing and storage in most major commercial markets. However, the challenges associated with successfully storing such image content files remains. Generally consumers entrust their digital image content files to the hard drive of their computer. Unlike the shoebox full of prints, hard drives are unforgiving. Frequently, when the hard drive fails, the options for restoration of files are limited at best. Backing up on removable media is no better. Compact disks, memory cards, and jump drives all have a finite life. In most cases, the options for restoration of lost files are non-existent. The prints in the shoebox may fade, or become ripped or worn along the way, but those perfect digital image content files are completely gone when their storage medium fails.
Many attempts have been made to combat this problem. Redundant arrays of independent disks (RAID) systems use redundant copies of files on separate disks within a server or server farm for safety. The odds of more than one disk failing at any particular moment in time are very small. Thus when a single drive fails, it is replaced with a new blank drive and the files it held are replicated from the other drives. The multiple drives and disk health monitoring software used in such an arrangement can be expensive.
Commercial records are backed up on a regular basis. At regular intervals, files are moved to media such as CDs or tape. This collection of files is representative of the records at a particular point in time is stored for some length of time, depending upon the type of records. This can lead to very large, costly, and cumbersome storage facilities.
An additional need for long-term storage is to migrate data. Every so often, storage hardware and/or media type and/or file formats become obsolete. Before any of these become completely obsolete, it is necessary to migrate data to a current model of hardware and/or media and/or file format. The timing of the decision to migrate data is often a difficult one for the user. To migrate too soon adds unnecessarily to the cost of storage. To migrate too late means that files are no longer accessible. It also calls for conscious action on the part of the user.
An image sharing system, an image sharing device and a method for operating a plurality of image sharing devices are provided. Each image sharing device has a memory with image content files stored therein and a communication system to provide an image sharing system. In one embodiment, the method comprises the steps of: identifying image sharing devices to be included in the image sharing system; establishing a communication link between the identified image sharing devices, said communication link providing the ability to transfer image content files; identifying sharable image content files in each of the image sharing devices; and determining manifest data useable in copying the sharable image content files from one of the image sharing devices to at least one other of the image sharing devices so that each of the shareable image content file is stored in at least two of the image sharing devices in the image sharing system.
The sharable image content files are automatically copied from one of the image sharing devices to at least one other of the image sharing devices according to the manifest data; index data is created indicating the at least two image sharing devices in which each sharable image content file is stored.
Subsequently, the content of each of the image sharing devices is monitored to identify any image sharing device that has a sharable image content stored therein that differs from the sharable image content that the index data indicates should be stored in the image sharing device; and copying image content files from other image sharing devices with the copied image content being selected so that each shared image content file in the index data is stored in at least two of the image sharing devices.
Turning now to
In this embodiment, each of image sharing devices 20a-20n has a transceiver 22 that is adapted to cooperate with an antenna 24 to transmit and receive radio frequency signals carrying digital data containing text, audio and video communications. In one useful embodiment, a radio-frequency transceiver 22 is adapted to communicate using the high rate consumer wireless communication standard defined in Institute of Electrical and Electronic Engineers standard IEEE 802.15.3. In other embodiments transceiver 22, can be adapted to communicate using the standards set forth in Institute of Electrical and Electronic Engineers standard IEEE 802.11b. Alternatively, radio transceiver 22 can employ any useful radio frequency communication scheme to send and receive data.
Transceiver 22 can be adapted to transmit communication signals directly to transceivers 22 in others of the image sharing devices 20a-20n. Alternatively, transceiver 22 can transmit signals to others of the image sharing devices 20a-20n by way of a separate intermediary 90 such as, for example, and without limitation a cellular tower, a web site, a data server, a satellite system, wireless repeater, wide area network, wireless router, or by way of other image sharing devices. Such an intermediary 90 can be a passive or reactionary intermediary, or it can actively be involved in the communication process, and in this regard, it can have a display or other output and/or a user input as desired for allowing review of images or for other purposes.
Transceiver 22 is also adapted to cooperate with antenna 24 to receive digital radio frequency signals from other devices. The digital radio frequency data is converted into digital data. The digital data is transferred to controller 26 and converted into digital data.
Transceiver 22 can also use other forms of wired or wireless communication as are compatible with the purposes described herein including, but not limited to, Ethernet or other wired or optical fiber networks, optical type communication systems such as the Infrared Data Associate Standards.
As is shown in
In the embodiment of
The digital data representing the image is converted into an image content file. As used herein, the term image content file denotes any form of data that preserves a record that can be reproduced visually and includes, but is not limited, to video streams, video data, sequences of still images, still images, graphical icons, text or other forms of such information. The image content file can then be transferred to a memory 36 which can comprise, for example and without limitation, a semiconductor memory such as a Flash Memory or other form of Random Access Memory, a magnetic memory such as a disk drive or an optical memory such as a compact disk or digital video disk.
The digital data representing the image can also be transmitted to a display driver 40 which converts the digital data into signals that cause a video display 42 such as a liquid crystal display or organic light emitting diode display to present the captured image to the user. Digital data representing the image can also be provided to transceiver 22. Typically, this is done by providing the image content file to transceiver 22. Transceiver 22 converts the digital data into a digital radio frequency signal which is transmitted using antenna 24.
Transceiver 22 also receives digital radio frequency signals from other of image sharing devices 20a-20n containing image content files or other digital data by way of antenna 24. The digital data is transferred to controller 26 and converted into digital image data. Such digital image data is stored in memory 36. In embodiments having a video display, such digital image data can be transferred to display driver 40 and converted into images that are viewable on video display 42.
Imaging system 28 can optionally also be used for displaying a wide variety of images including still images, motion video, sequences of still images icons and text images on video display 42. The presented images can comprise image content files and can also comprise other images or image components that indicate the status of the image sharing device. Imaging system 28 can also be used to also display the content of communications such as text and iconic messages received from other of image sharing devices 20a-20n or from other sources.
One or more of the components of imaging system 28 can be integrated onto a single silicon substrate. For example, image sensor 32 can be formed on a semiconductor having a “camera on chip” type architecture wherein a single semiconductor substrate provides structures to perform image sensing, image processing, image storage functions. One example of such a camera on a chip is the OVT7635 Camera Chip™ sold by Omnivision Technologies of Santa Clara, Calif., U.S.A. An alternative example of a camera-on-a-chip architecture found in the COACH LC and COACH II image processors sold by Zoran Corp. of Santa Clara, Calif., U.S.A., which incorporate image processing, memory, memory management, display control and other functions on a single substrate. In this way, the cost and complexity of image sharing devices 20a-20n can be reduced.
In the embodiment of
Each of image sharing devices 20a-20n is also shown as having an optional audio system 50. Audio system 50 is adapted generate audio signals based upon signals from controller 26 and, optionally, as shown can also be adapted to capture audio signals and to generate digital data based upon such signals. In the embodiment shown, sound input is entered by way of microphone 52. Microphone 52 converts acoustical energy from the sound input into an electronic signal. This electronic signal is transmitted to analog to digital (A/D) converter 54 that renders digital signals representing the sound. Controller 26 receives the digital signals representing the sound. Controller 26 processes these signals for storage in memory 36 or for use by radio transceiver 22.
Radio frequency signals containing audio data are received by radio transceiver 22. Radio transceiver 22 extracts digital data from radio frequency signals and provides this digital data to controller 26. As will be discussed in greater detail below, controller 26 processes this data if necessary and provides a stream of digital audio data to A/D converter 54. A/D converter 54 converts the data into an analog signal that is provided to speaker 56 which in turn converts the analog signal into acoustical energy.
In the embodiment of
It will be appreciated that an image sharing devices 20a-20n can be acquired in a form that is adapted for use as described herein or that it can be received in a generic form and adapted for service in any manner described herein, such as by being programmed for such use. Image sharing devices 20a-20n can be bought or rented, or otherwise made available for use using any known commercial business model.
In a first step of the method, image sharing devices 20a-20n to be included in image sharing system 10 are identified (step 102). This can be done using any known method for identifying devices to be included in any known form of communication network. In one example embodiment, image sharing devices 20a-20n to be included in image sharing system 10 can be identified by manually compiling a list of addresses or other identification information necessary to allow image sharing devices 20a-20n in image sharing system 10 to exchange images. An “Online Pal List” like a so-called “buddy list” of the type conventionally used in on-line Instant Messaging could constitute one example of such an address list. In certain embodiments, direct communication between image sharing devices 20a-20n may be possible such as where all of image sharing devices 20a-20n use a common type of communication protocol. For example, where all of image sharing devices 20a-20n are Bluetooth enabled and are within range of each other then communication between image sharing devices 20a-20n in image sharing system 10 can be made. Alternatively, communications may be made by way of an intermediary 90 as discussed above with the intermediary 90 acting in this example as a conduit for data communications between image sharing devices 20a-20n in the image sharing system and can additionally act as keeper of index data 94.
The image sharing devices to be included in image sharing system 10 can also be identified in other ways. For example, and without limitation, it is noted that in the embodiment of
Contact circuit 74 can detect contact between a contact surface 72 to which it is connected and another contact surface 72 of another image sharing device 20a-20n in a variety of ways. For example, where contact surface 72 and the other contact surface are electrically conductive, each contact circuit 74 can cause an electro-magnetic field to form on contact surface 72. When contact surface 72 is in contact with another contact surface, the electromagnetic fields combine. By monitoring the intensity, waveform, or signal content on each contact surface 72 each contact circuit 74 can detect when contact surface 72 is in contact with another contact surface. Other electro-magnetic methods for detecting contact can be used. For example, contact between two contact surfaces can be detected by noting variations in capacitance, electrostatic charge, and/or inductance at the contact surface. Electro-mechanical structures can also be used to register contact between two contact surfaces, such as vibrational, sonic or ultra sonic signal generators and detectors. Electro-optical detection structures can also be used, for example, when a contact surface 72 of, for example, image sharing device 20a is brought into contact with a contact surface 72 of second image sharing device 20b, e.g., the contact surfaces can be mechanically moved, deflected and/or otherwise mechanically changed. In this example, contact circuit 74 determines these changes and causes a particular light to emit. Contact circuit 74 detects light of the type emitted in response to contact and determines that contact has been made with another image sharing device. Membership in the image sharing system 10 can be spread virally through contact in this fashion if desired. Various embodiments of communication circuits, systems and methods for using contact between communication devices to build a communication network are described in commonly assigned U.S. Pat. No. 7,027,836 entitled “Communication System and Method”, filed by Zacks et al. on Oct. 10, 2002, which is incorporated herein by reference to provide non-limiting embodiments of such circuits, systems and/or methods.
It will be appreciated that the above described examples of methods for identifying image sharing devices 20a-20n for inclusion an image sharing system 10 are not limiting. As is also appreciated, that there are a wide variety of other well known methods, circuits and systems that allow manual, automatic or semi-automatic identification of image sharing devices 20a-20n that are to be included in any known communication network and that can be used for the purpose of identifying image sharing devices 20a-20n that are to be included in image sharing system 10. Communication data is stored indicating which image sharing devices 20a-20n are to be included in an image sharing system. Such communication data can be stored in any of the image sharing devices 20a-20n or in intermediary 90.
A communication link is then established between the identified image sharing devices (step 104). The communication link can be established using any known manner for forming a wired or wireless communication network that allows image sharing devices 20a-20d to exchange images.
The communication link provides the ability to transfer image content files and, optionally, other data and signals between the identified image sharing devices 20a-20n. In certain embodiments, controller 26 of each image sharing devices 20a-20n will be able to automatically determine a communication path to the other image sharing devices that are identified as being included in image sharing system 10 based upon communication information provided or obtained in the identification process. Manual intervention or involvement can be obtained in order to establish or to help establish communication links or information necessary to enable communication between any of the individual image sharing devices 20a-20n that are included in the image sharing system 10. In some embodiments, intermediary 90 can be used to enable communication between image sharing devices 20a-20n and can provide one or more common points of communication such as the Internet or other on line data routers, hosts, servers and/or networks can be used to enable such communication.
Intermediary 90 can also optionally provide transcoding or other adjustments to enable data communication between devices in image sharing system 10. Such transcoding can involve modifying image content files in any known fashion to better facilitate storage of such image content files using particular ones of the image sharing devices. Examples of such transcoding include, but are not limited, to generating image content files with modified compression, image resolution, file type, image content frame rates for video type image content files or any other aspects of an image content file. Such transcoding preferably does not negatively impact the perceived quality of the image content of the image content files. For example, it may be possible in certain circumstances to reduce the resolution or increase the compression of an image content file in a manner that reduces the amount of storage consumed by aspects of the image content that will not be readily apparent to an observer of the image content under normal viewing conditions. Similarly, adjustments in frame rates for video files may not be readily apparent. Additionally, such transcoding can adjust the nature of the image as necessary to convert image content depicted in an image content file, for example, from a conventional two-dimensional image into an image content file that can be viewed using viewing techniques including but not limited to stereo imagery, lenticular imaging techniques, or holography as can be used to create three dimensional viewing effects. However, in any circumstance in which the image content file is transcoded, such transcoding should maintain at least a minimum level of image quality.
Communication between image sharing devices 20a-20n can be made directly or indirectly through intermediary 90 as desired. For example, as shown in
In the embodiment that is shown, image sharing devices 20a and 20b communicate with a wireless router 90a that is connected to the Internet 90b or other data communication network. At the same time, image sharing device 20c can use cellular telephone technology including but not limited to digital or analog cellular voice or data communications technology to exchange data with a cellular phone system 90c, which in turn communicates, in this embodiment, with the Internet or other data communication network 90b. Desktop personal computer type image sharing device 20d is shown using a wired connection to a router 90d which in turn communicates with the Internet or other data communication network 90b.
Image content files that are stored in at least one of image sharing devices 20a-20n are then identified as sharable image content files (step 106). As used herein the term sharable is used to reflect a identification of an image content file as being one that is to be made available for storage in image sharing system 10, however such identification is made. This identification can be made in any number of fashions. In one embodiment, sharable image content files are identified on the basis of a manual determination made by a user. For example, a user of image sharing devices 20a-20n can use user interface 60 to manually tag or otherwise designate image content files that are important and/or that the user wants to share within the image sharing system. For example, certain digital cameras from the Eastman Kodak Company provide a “Share” or “Favorite” button. When such buttons are pressed during review of image content from an image content file, metadata is stored indicating that the reviewed image content file has been designated as one for sharing or as a favorite. It can automatically be determined that the image content file is sharable when such designation is noted.
For example, and without limitation, a decision as to whether an individual image content file should be designated shared can also be made based upon automatic analysis of the image content files, such as by analysis of the image content or of metadata that is associated with the image content files.
Similarly, well-known automatic algorithms that assess image quality, image usage or image content can be used to provide comparative information that can be used to determine which images are to be shared can also be employed to identify sharable image content files. Examples of such automatic algorithms are described in U.S. patent application Ser. No. 11/403,686, entitled “Value Index from Incomplete Data”, filed Apr. 13, 2006 in the names of Fedorovskaya et al.; and Ser. No. 11/403,352, entitled “In-Camera Dud Image Management”, filed Apr. 13, 2006 in the names of Fredlund et al. Manifest data is then generated that determines which of the identified image content files are copied to which of image sharing devices 20a-20n that are in the image sharing system 10. The manifest data is determined in a manner that provides that each shareable image content file is stored in at least two of image sharing devices 20a-20n of image sharing system 10 (step 108). The manifest data can also optionally provide data from which a schedule or prioritization for the copying process can be determined. There are a wide variety of ways in which determinations of about the distribution of the copies of image content files are to be made and the timing of such distributions.
In certain embodiments, aspects of the implementing technology supporting the image sharing system 10 and or the individual image sharing devices 20a-20d involved in image sharing system 10 can be used to make distribution and timing determinations that support generation of the manifest data. The manifest data can be determined, for example, based upon the technical capabilities of an image sharing device or technical capabilities of a communication link between the image sharing devices and the attributes of the shareable image data files in a manner that causes the manifest data to directs the sharable image files to a combination of the image sharing devices that provides a relatively high level of system performance in accordance with the capacity of the image sharing devices to share and store the sharable image content files and/or in accordance with the ability of the communication link to share such files. It will be appreciated that in some embodiments of image sharing system 10, hand held and portable forms of image sharing devices 20a-20n typically have lower memory, processing, and/or data transfer rates than fixed location devices. Accordingly, where such differences exist, copies of larger image content files such as those that contain for example and without restriction full resolution images, RAW format image files, video files, image streams, image sequences can be preferentially directed for distribution to fixed position type image sharing devices, while smaller sized image content files, image content files that have lower image values, or image content files that are otherwise determined to be of low priority can be copied to the portable type image sharing devices.
In another alternative embodiment of this type, a smaller number of larger image content files can be scored in such portable type image sharing devices. Optionally, the selection of and storage of such larger sized image content files in such portable image sharing devices can be made according to a prioritization scheme.
Similarly, it will be appreciated that differences in the characteristics of the communication links provided in a particular image sharing system 10 can be used as a factor in determining the distribution and timing of copies of image content files used to generate the manifest data. For example, where a fixed position type of image sharing devices 20a-20n is connected to other devices using a slow data rate communication link or a data communication link that is shared between many users then this factor may mitigate against the use of the fixed position type of image sharing device to store comparatively large data files, or perhaps, such large data files will be stored in such a device but the timing of such storage will be arranged such that storage occurs at times when the data rate may be effectively increased because the fewer shared users are requiring access to the bandwidth that is available on line.
Personal preferences can also constitute a factor in the distribution or timing determined during the generation of manifest data. For example, a user of one of image sharing devices 20a can determine that specific ones of the sharable image content files should not be copied on to other ones of image sharing devices 20a-20n, such as onto a sibling or child's image sharing device in a manner that allows the image content of such image content files to be viewed by the recipient. In such cases, such image content files can be stored in other ones of the image sharing device or can be stored in a password protected or in an encrypted or other form of inaccessible format. Such preferences can be individual or group based. Further, a user can indicate a preference that no image content files be stored on certain image sharing devices in the image sharing system 10. For example, a user may wish to prohibit storing image content files on a digital camera. These personal or group preferences can be expressed using image sharing devices 20a-20n or an intermediary 90 or any other device that can communicate therewith and that can express such a preference. Default settings such as instructions to share only favorites or to share all image content data files can be provided.
Another way to determine which of image sharing devices 20a-20n, is a copy of a sharable image content file will be distributed is to analyze the content of the image content file. In one embodiment of this type, such analysis is done in order to identify people, places or things in the image content and, preferentially, store image content that such people, places or things with particular image sharing devices that can be determined to have some relationship with such people, places or things. In one non-limiting embodiment of this type, image content files that have image content that includes a participant and/or his or her family in them can be shared only among image sharing devices owned or operated by family members. This helps to ensure image content data files are stored on image sharing devices in which there will be some degree of interest in preserving and protecting the image content files and a greater willingness to allow a portion of the memory capacity of their image sharing devices to be used for storing such image content files. For example, image content files captured by one image sharing device can depict children from a family that owns a different one of the image sharing devices in the network. When such children are identified in the image content of image content files of that image sharing device, a copy of the image content file can be sent to the image sharing device owned by that family. In another example, an image content file captured on a first one of image sharing devices 20a-20n includes image content depicting an owner of another one of image sharing devices 20a-20n then that image can directed for storage in the image sharing device owned by that person. It will be appreciated that a wide variety of strategies can be developed.
Still another factor that can be used in determining manifest data is the typical geographic distribution of image sharing devices 20a-20n. In particular, it will be understood that unfortunate events that might impose the operation of one of the image sharing devices 20a-20n, typically only impact regional or local areas, thus by insuing broad geographic distribution of image content files can serve to increase the probability that at least one copy of an image content file will survive such an event.
Any or all image content files can be encrypted. This can be a global encryption for all image content files stored, unique for a group of image of image content files or may be unique for each image content file. Then when sharing is desired, a decryption key can be sent. The high resolution image already resides with image sharing devices 20a-20n receiving the high resolution image, so sharing is expedited. If the image is encrypted, the image need only be decrypted for viewing, which typically takes much less time than transmitting a large file. Additionally, if the image content files are encrypted or not, an image sharing device 20a-20n can send a viewing file to another image sharing device which calls out specific portions of images, zooms and pans, order of presentation, or storylines with audio or text supplied. For viewing, the image sharing device need only access the desired images for display. Particularly if encrypted image content files are only a small percentage of the total number shared and stored, on a particular one of the image sharing devices 20a-20n the encrypted image content files may be hidden from the receiving image sharing device so that it is difficult to determine if encrypted images are present.
The manifest data can optionally be prioritized. In particular, image sharing system 10 can determine the manifest data to reflect an ordering scheme for copying image content files. In this way, the manifest data can direct or suggest that certain image content files be copied first with others copied later. Any prioritization of the manifest data can be based upon any rational criterion. For example, and without limitation, greater priority can be assigned to particular image content files based upon personal preferences, image value, image quality, metadata that is associated with the image content file, or characteristics of the image content files.
Index data can then be created indicating the at least two image sharing devices 20a-20n in which each sharable image content file is stored. In one embodiment, this can involve determining which sharable image content files were identified on which of image sharing devices 20a-20n (step 110) and then supplementing this information with data identifying which other image sharing devices have been used to store a copy of the content data file (step 114). The index data can take any of a variety of forms. In one embodiment, index data can be stored in the form of an index data file that can be shared with each of image sharing devices 20a-20n in the image sharing system 10. This can be done by storing copies of the index data file with each of image sharing devices 20a-20n in image sharing system 10, or by storing the index data file with an intermediary 90 or with selected ones of image sharing devices 20a-20n in a manner that allows the stored index data file. Alternatively, this can be done by storing index data in each of the image content files stored in image sharing system 10, this can be done for example, and without limitation using metadata associated with image content files using digital watermarking techniques or by using digital data stored, for example, in a header portion of a content data file providing data files that are separate from the image content files, but associated therewith in some logical manner.
The sharable image content files are then automatically copied according to the manifest data so that each shareable image content file is stored in at least two of image sharing devices 20a-20n of image sharing system 10 (step 112). Typically, each shareable image content file is stored both on the image sharing device in which it is originally found and one other of image sharing devices 20a-20n. However, other storage arrangements can be used. This creates an increased probability that such sharable image content files will be preserved from destruction in the event that image sharing devices 20a-20n upon which the sharable image content file was found is disabled, damaged, replaced or otherwise unavailable.
For example as shown in
It will be appreciated that by storing sharable image content files on more than two of image sharing devices 20a-20n it is greatly more probable that one of a copy or the original of such a sharable image content file will be available after a catastrophic or other event in which, for example, one of image sharing devices 20a-20n in which the content data file is stored, is damaged or otherwise compromised. It will also be appreciated that it can be useful to store such image files in more than two of image sharing devices 20a-20n, however, the data storage requirements of the overall system increase significantly when this is done. In particular, the present invention teaches against storage of all of the image content files in each of image sharing devices 20a-20n in image sharing system 10.
Accordingly, in yet another alternative embodiment, the manifest data can be generated so that only those image content files that have high image values, image content files that have been identified for high priority copying, or image content files that otherwise meet any logical criteria for enhanced redundancy can be copied such that after copying such image content files can be found on more than two of the image sharing devices.
During or after copying the image content file, supplemental data can optionally be stored with the index data associated with the image content file (step 114). The supplemental data can include other information regarding sharable image content files, including but not limited to, information from which it later can be determined whether an image content file has been changed after it has originally been copied. There are a number of ways in which this can be done and any can be used. Specific non-limiting examples of particular ways in which this might be performed are as follows. For example, time and date information can be stored indicating when the version of a shared image content file was last created or modified so that at a later time, the time and date of last storage or modification of a copy can be compared to the stored time and date to help to ensure that the image is in its original form. Alternatively, other data can be stored in the image content files such as for example, watermark or other data the presence of which will be altered or impaired by a modification of the image content of the image content file.
In still other embodiments, supplemental data can be extracted or derived from the image content file that is representative of the image content in some prescribed manner that can be repeatably performed. The extracted or derived data is then stored and the extracted or derived supplemental data can be re-extracted from the image content in the prescribed manner and compared to the previously extracted data.
One example of a way in which this can be done is described in commonly assigned U.S. patent application Ser. No. 09/966,678, entitled “System and Method of Authenticating a Digitally Captured Image”, filed on Sep. 28, 2001 in the names of Fredlund et al., in which there is provided a method of processing for later authentication a digital still image captured using a digital image capture device. In one embodiment thereof, a method is provided that comprises the steps of transmitting signature data from a remote location to the digital image capture device; associating an image identification with the digital still image; applying the signature data to the captured digital still image to produce an authentication signature representative of the captured digital still image; associating the authentication signature with the image identification; transmitting the authentication signature to the remote location; and storing the signature data, authentication signature, and image identification at the remote location. To process the image for later authentication, signature data is transmitted from a remote location to the digital image capture device. Upon capturing the digital still image, an image identification is associated with the digital still image. The signature data is then applied to the captured digital still image to produce an authentication signature representative of the captured digital still image. The authentication signature is associated with the image identification and transmitted from the digital still image to the remote location for storage at the remote location. To later authenticate the digital still image, the digital still image is transmitted to the remote location. The signature data for the transmitted digital still image is accessed and applied to the transmitted digital still image to produce a verification signature. The authentication signature and the verification signature are compared to determine the authentication of the transmitted digital still image. While this process is described in a manner that relates generally to signature steps that are performed at or about the time of capture, such steps can also be performed at a time of image sharing or access.
After an optional delay period or after the occurrence of an event suggesting that it is appropriate to verify that the image content files are situated as suggested by the index data (step 116), the sharable image content files stored in each of image sharing devices 20a-20n in the image sharing system are monitored to determine whether any of the identified shareable image content files is missing from or changed on any of the at least two image sharing devices on which it is stored (step 118). The monitoring can be performed by any of the controllers 26 of any of image sharing devices 20a-20n. As will be discussed in greater detail below, the monitoring can be performed by intermediary 90. If it is determined that no image shareable image content files have been modified or deleted, then the process returns to step 106 to allow the identification of any new sharable image content files.
If, however, any identified sharable image content file is missing from or found to be in a changed form on a first image sharing device of the at least two image sharing devices onto which it has been copied then the controller 26 or intermediary 90 can automatically copy an original copy of that image content file to the first image sharing device (step 122). The process then returns to step 106 where sharable image content files stored on image sharing devices 20a-20n are identified and the process repeats.
As is also shown in
Decisions made by the owner or by a person using the owner device can be decisive as to whether a deletion or change to a sharable image is to be allowed. If a user of image sharing system 10 who is not the “owner” attempts to delete or change a sharable image content file, then such an attempt can be ignored unless the requested action is either approved by or made by the owner of the image content file. Alternatively, the attempt can be allowed with the possibility of later undoing the deletion or change if approval is not obtained. This step can include providing a warning to an owner of the image content file or to one or more of image sharing devices 20a-20n such as “Danger-your images are not resident at Image Sharing Device #1.” An owner or user of an image sharing device 20a-20n can ignore such a warning, indicate that such changes are approved or that such conditions are not approved.
Alternatively, where the decision is not approved other actions can be taken such as the creation of a new image content file and owner identification data based upon the image content that has been modified by a non-owner user of an image content file. Where a deletion of an image content file is approved by an owner, image content file is deleted from all image sharing devices and the manifest data can be changed to reflect the deletion of the image content file. Because it may take a period of time to delete such a file from all such image sharing devices, icons or other symbols representing the image content file in any indexing, windowing or other file lists can be visually modified to suggest that the particular image content file has been or will be deleted. In one embodiment of this type, activation of the visually modified identifier can be interpreted as a decision to rescind the act of authorizing deletion of the image content file and any remaining copies of image content files can be used to replace any copies of the image content files that were deleted before the decision to rescind deleting the image content file was made. The index data can be modified to remove any reference to a deleted image content file or to maintain a record indicating that the particular image content file was deleted.
The user initiating the image sharing system in this manner can also provide an image sharing device 20a-20n for prospective image sharing members. This is in the best interests of both because it entices other image sharing system members to more readily agree to participate. The members of the image sharing system 10 can provide reciprocal sharing. Under most conditions, any user within image sharing system 10 can identify image content files for sharing. However, there may be times when one way only sharing is advantageous.
As part of the identification process (step 102), the amount of storage space that is available for saving image content files between image sharing devices 20a-20n in image sharing system 10 can be specified. Participants can optionally indicate limits on the amount of space that will be allotted to image content files supplied by any given member or by the overall system 10. This serves to minimize the amount of resources that a particular user must devote when agreeing to participate in image sharing system 10. The amount of resources may be determined as an absolute number of files, absolute number of bytes, a percentage of total storage, a percentage of available storage, a distribution of file types or other measures.
Alternatively, the amount of resources committed to image sharing can be defined in reciprocal terms with participants in an image sharing system agreeing to share memory or other resource capacity with other image sharing devices to the same extent that others are willing to share image sharing resource capacity with them. For example, a participant in an image sharing system 10 can agree to share a comparable number of image content files, memory capacity, percentage of memory capacity, resource capacity or percentage of resource capacity. Notifications can be given when allotted storage space nears limits, and corrective action can be initiated. Sharing and backup and distribution rights can be suspended as a result of reaching limitations.
In a first step of this process, system resource testing can be performed (step 130). Where the system resource testing (step 130) indicates that memory capacity or other resources necessary to execute the storage function are insufficient for the demands, an alert can be sent to one or more of the members of the image sharing system 10 (step 132) A user can respond to this alert by agreeing to adjust available resources or by reducing the users demands upon the system. Where a user refuses, the step of identifying sharable image content files can be adjusted to conform to available resources. This process can be done, for example, and without limitation as a part of the storage steps 112 or 120, or as a part of determining index data, manifest data or feedback data.
In this embodiment, the manner in which the image content files or other data is exchanged or copied is transparent to the user. System 10 copies image content files as necessary background, only alerting the user when necessary.
In this embodiment, image sharing device 20a comprises a home system image sharing system taking the form of a personal computer onto which image content files can be loaded from sources including, but not limited to, a digital camera, cellular phone, scanner, disk or graphics package, video editor, or animator. When it is determined that image sharing device 20a has a new image content file A, it automatically identifies such it as one of a non-sharable image content file or a sharable image content file. Here image content file A is determined to be shareable and it is uploaded to the Kodak EasyShare Gallery 90e (step 106). In this embodiment, an analysis of the inventory of image content files stored in image sharing device 20a can take place at image sharing device 20a so that only the identified image content files are uploaded to the Kodak EasyShare Gallery 90e. Alternatively, an intermediary 90 such as Kodak EasyShare Gallery 90e can perform this function. The identified image content files can be reduced and compressed for better use of bandwidth or memory capacity as desired.
As is illustrated in
As is illustrated in
As is also illustrated in
In the illustrated embodiment, the image content files are uploaded in full resolution. This requires that large image files be uploaded and stored in the Kodak EasyShare Gallery 90e. However, as is illustrated in
In this embodiment, the Kodak EasyShare Gallery 90e periodically checks the image content data files stored in each to see that all of the sharable image content files are located where index data 94 suggests that such sharable image content files A, B, C and D should be located and to ensure that all of the sharable image content files A, B, C and D are not damaged or modified. It will be appreciated that as a part of this process it is necessary for the Kodak EasyShare Gallery 90e to communicate with each of image sharing devices 20a-20d. Under a wide variety of circumstances, it may not be possible to communicate with each of image sharing devices 20a-20n included in image sharing system 10 at the same time. For example, a cellular phone embodiment of image sharing device 20a can be turned off of otherwise rendered incommunicado.
Accordingly, as shown in
If however, it is determined that an excessive number of failures has occurred, then a warning or adaptation process can be executed (substep 118e). In one example of this step one or more of image sharing devices 20a-20n used in image sharing system 10 is caused to provide a visual or audio warning indicating that there has been difficulty in communicating with the image sharing device that has the excessive number of communication failures. A user can take appropriate action based upon this information such as determining the cause of the failure to communicate and correcting it or such other action as the user deems to be appropriate. In the case of a disaster, system 10 can prompt the user of image sharing devices 20a-20n that has suffered from the disaster to copy images from another source. Alternatively, this can happen automatically once system 10 has detected the disaster. Image sharing system 10 can also notify the user that there has been a disaster, since it may not be obvious. Additionally, image sharing system 10 can monitor and make notification if there is sporadic failure indicating an impending larger problem.
Alternatively, in another embodiment, image sharing system 10 can adapt (step 118e) by modifying the manifest data so that the image sharing device with which system 10 cannot communicate is not relied upon to store image content files. This can be done by readjusting the allocation of identified image content files so that identified image content files are shared with at least two of the remaining image sharing devices 20a-20n in image sharing system 10.
There are various possible versions for the architecture of image sharing system 10. The first has been generally discussed with reference to
For example, in this embodiment, a user of a cellular picture phone type embodiment of image sharing device 20a wishes to share captured images with associated image sharing devices 20b and 20c comprising a personal computer and a networked hard drive. The user has previously identified that these three image sharing devices 20a-20c are to be included in an image sharing system sponsored by Kodak EasyShare Gallery 90e. This information is stored as communication data 92 at Kodak EasyShare Gallery 90e. However, the user of image sharing device 20a is apart from either of image sharing devices 20b and 20c. Accordingly, the user approaches a Kodak kiosk 90f and establishes a communication session with kiosk 90f. Kiosk 90f is programmed to cooperate with Internet 90b, Kodak EasyShare Gallery 90e to enable communication with image sharing devices 20a-20c in order to form an image sharing system 10. As necessary, any of kiosk 90f, or Internet 90b can temporarily store any of the image content files A-D for a period of time necessary to establish communication with an image sharing device that is not immediately accessible or that cannot otherwise receive an image content file.
As shown in
In this embodiment, image sharing device 20c is capable of communicating directly with wireless router 90a and offers a significant amount of data storage capability. Accordingly, still image files A and B are sent to home computer image sharing device 20b while video image content file C is sent directly to hard drive image sharing device 20c. Optionally, original or imagette forms of still image files A and B can be sent to hard drive image sharing device 20c, while an imagette form of video image content file C can be sent to home computer image sharing device 20b. Similarly, imagettes 98 representing the image content of the image content files stored in image sharing devices 20a-20d can be retained at the Kodak EasyShare Gallery 90e or any other Internet or data hosting site. It will also be appreciated that in this embodiment image content files can be requested by camera phone image sharing device 20a from either of home computer image sharing device 20b or hard drive image sharing device 20c.
In a further embodiment, sharing between image sharing devices is performed directly in a peer-to-peer architecture with the controllers 26 of the various image sharing devices 20a-20n being adapted to perform all steps of any method described herein.
Image Viewing
As is illustrated in
It will be assumed for the purpose of this example that a request has been submitted for access to one identified image content file and after the request for the image content file is received, the index data is accessed (step 144) and the index data is then used to determine which of the image sharing devices 20a-20n in image sharing system 10 have been used to store the identified image content file is stored (step 146).
As is illustrated in the embodiment of
As is noted above, access can be controlled by limiting access to index data indicating the location of the image content file that has been requested. Alternatively, access to the actual image content file can be restricted or the image content file can be decrypted and a decryption key that can be used to access the image content file is only provided when access is granted for the image content file. Other known forms of access control to data files can also be used to limit access according to supplemental data.
Where access is not granted the process of
In this embodiment, if the image content file is found in the first image sharing devices (step 150), then the image content data file is accessed (step 152) and an optional feedback process begins (steps 160-164). In a first portion of the feedback process, image content from the accessed image content file is presented to the requester (step 154) and a feedback signal is determined from one or more of the observers of the presented image content (step 156).
The feedback signal can be determined in any of a variety of methods. In one example embodiment, the feedback signal is determined based upon responses that are manually entered or otherwise entered through the user interface 60 of one of image sharing devices 20a-20n. Typically this is done using the user interface 60 of the image sharing devices 20a-20n that is used to present the image content. In the embodiment of
Such a response can be voluntary such as the above described icon selection process, or detecting voluntary actions or involuntary actions. Examples of such voluntary actions include, but are not limited to, the amount of time that a user dwells upon the presented image content, the extent to which the user zooms, pans, or makes use of the presented image content or audible responses made by a user to the presented image content and can include, but is not limited to, feedback such as area of interest identified in a shared image content file based upon a user's actions during viewing of the image content file. Examples of involuntary responses comprise but are not limited to matters such as detectable involuntary physiological responses to a presented image, such as increases in blood pressure, galvanic skin response, voice stress, pupil dilation or the like. Sensors 38 of any known design can be incorporated into one or more of image sharing devices 20a-20n and can be adapted to sense such involuntary responses and to generate a feedback signal that is based upon the sensed involuntary responses or conditions that are indicative of such involuntary responses.
The determined feedback signal is then converted into digital feedback data that is logically associated in some manner with the image content file that provoked the actions giving rise to the feedback data and stored (step 158). In one embodiment this can be done by storing all feedback data as supplemental data in the image content file. The feedback data also can be stored as metadata in or in association with each of the image content files. The feedback data can include information from which particular responses can be determined and can optionally indicate the identity of the persons whose actions prompted the generation of the feedback data. Alternatively, the feedback data can be aggregated, summarized, or statistically analyzed or otherwise processed and provided in such an aggregated, summarized, statistically analyzed or otherwise processed form or in a form that is based upon such aggregations summarizations, analyses, or processed information. The feedback data can also be stored in any other logical manner in which data regarding an image content file can be securely stored.
Typically, the feedback data is based upon an emotional response and is affect laden. For example, in the embodiment of
After storage, such feedback data can be made available whenever the image content from the image content file is accessed or presented. For example, an image sharing device can have a controller is adapted to determine when feedback data is associated with an image content file and to cause an human detectable output signal to be generated that is based upon the associated feedback data. In certain embodiments, the feedback data can be presented in an audible form. For example, if the feedback provided was in the form of spoken words, the feedback signal can take the form of an audio signal or other signal that was recorded by the recipient of an image content file. This feedback signal can be converted into feedback data from which an audible signal can be reconstituted and presented using for example audio system 50. Optionally, the resulting audio data can also be associated with visual or other form of user detectable response which can be presented with the audible signal to provide a multi-media response package that enriches the communication.
In other embodiments, for example, discretion can be applied to determine whether to present the audio feedback data in audible from or to use the audible signal to determine other forms of response that may be more accessible, useful or appropriate for the recipient under the circumstances that a person accessing the image content file having the associated image data finds himself or herself in. In circumstances where an audible response may not be appropriate such as where, time, location or preferences dictate that the audible signal cannot be presented the audible feedback data can be used to select icons, animations, tactical responses or other forms of human perceptible feedback that can be generated by an image sharing device 20a-20n. In one example of this type, the audible signal can be used to select between a plurality of available visual-emotional icons, animations or video streams.
The feedback data can of course take other forms without limitation and in a further example can comprise any form of information that can be presented to others in visual form or that can be used as a basis for a visual form of communication, such as video clips or segments, still images, symbols, graphic representations, text alerts or other messages. In one example embodiment, feedback data can comprise an image that is captured of the observer of image content from an image content file. Such an image type feedback data can be presented as captured, or it can be modified or used as a basis for a graphical representation or text based symbol.
Feedback data can be shared with all users of an image content file or it can be shared with selected users of an image content file with information useful in making determinations about who to share such feedback data with being limited according to user preferences or the like which can be stored in the image sharing devices 20a-20n or elsewhere in image sharing system 10. For example, feedback data can be sent by image sharing system 10 to an originator of the image content file, to people who are identified as participating in the image content depicted in an image content file, or who are otherwise identified as being associated with an image content file. The feedback data can also be used for a variety of other purposes such as determining image value of an image content file or image content file retention.
Similarly, involuntary responses that give rise to particular types of feedback data can also be presented in a variety of ways such as by being converted into audio, text or tactile signals. For example, a physiological response such as a galvanic skin response to an image could be sensed and converted in to feedback data indicating that a skin response was detected, with such feedback data being presented as a voice or text message or icon or animation stating or suggesting “That gave me goose bumps!” or similarly blood pressure or hear rate monitoring information could give rise to feedback data that is presented in a text message such as “That made my heart race!”
It will be appreciated that such feedback can be provided with respect to individual images, in which case such feedback data can be logically associated with an individual image content file such as by way of supplemental data stored with the index data or such as by storing feedback data can be stored with the image content files. Additionally, or alternatively, feedback data can be sent to an owner of the image content file. Still further, it will be appreciated that certain groupings of image content files can be the subject of a common feedback and thus, in certain embodiments a user can be permitted to make a single feedback action that creates feedback data that is associated with all of the image content files in a grouping.
At the conclusion of the feedback steps 154-158 the process returns to step 106 of
It will be appreciated that, in generally, any of the image sharing devices 20a-20n in image sharing system 10 can enable communication with other devices outside of image sharing system 10. For example, image sharing device 20c of
It will be appreciated that such a system and method can also be used with non-image documents and other forms of data files. In the case of documents, it can also be desirable to encrypt the documents. Encryption may be even desirable in the case of sensitive documents such as tax forms. For example, scans of historical documents could be shared privately with members of the same family.
The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5550646 | Hassan et al. | Aug 1996 | A |
| 5572235 | Mical et al. | Nov 1996 | A |
| 5649185 | Antognini et al. | Jul 1997 | A |
| 5666215 | Fredlund et al. | Sep 1997 | A |
| 5760917 | Sheridan | Jun 1998 | A |
| 5802220 | Black et al. | Sep 1998 | A |
| 5832464 | Houvener et al. | Nov 1998 | A |
| 6004061 | Manico et al. | Dec 1999 | A |
| 6154772 | Dunn et al. | Nov 2000 | A |
| 6182133 | Horvita | Jan 2001 | B1 |
| 6301607 | Barraclough et al. | Oct 2001 | B2 |
| 6304277 | Hoekstra et al. | Oct 2001 | B1 |
| 6366907 | Fanning et al. | Apr 2002 | B1 |
| 6509910 | Agarwal et al. | Jan 2003 | B1 |
| 6535228 | Bandaru et al. | Mar 2003 | B1 |
| 6574742 | Jamroga et al. | Jun 2003 | B1 |
| 6629104 | Parulski et al. | Sep 2003 | B1 |
| 6662198 | Satyanarayanan et al. | Dec 2003 | B2 |
| 6678703 | Rothschild et al. | Jan 2004 | B2 |
| 6721952 | Guedalia et al. | Apr 2004 | B1 |
| 6757684 | Svendsen et al. | Jun 2004 | B2 |
| 6877016 | Hart et al. | Apr 2005 | B1 |
| 6957221 | Hart et al. | Oct 2005 | B1 |
| 7051052 | Shapiro et al. | May 2006 | B1 |
| 7051173 | Tsuchiya et al. | May 2006 | B2 |
| 7103619 | Rajpurkar et al. | Sep 2006 | B1 |
| 7158692 | Chalana et al. | Jan 2007 | B2 |
| 7200626 | Hoang et al. | Apr 2007 | B1 |
| 7263537 | Lin et al. | Aug 2007 | B1 |
| 7336775 | Tanaka et al. | Feb 2008 | B2 |
| 7392295 | Yuan et al. | Jun 2008 | B2 |
| 7411693 | Loukipoudis et al. | Aug 2008 | B2 |
| 7433903 | Shapiro et al. | Oct 2008 | B1 |
| 7555620 | Manley | Jun 2009 | B1 |
| 7561310 | Joyce | Jul 2009 | B2 |
| 7660413 | Partovi et al. | Feb 2010 | B2 |
| 7702821 | Feinberg et al. | Apr 2010 | B2 |
| 7703012 | Park et al. | Apr 2010 | B2 |
| 7756892 | Levy | Jul 2010 | B2 |
| 7774495 | Pabla et al. | Aug 2010 | B2 |
| 7796779 | Strong et al. | Sep 2010 | B1 |
| 7881192 | Sultan et al. | Feb 2011 | B2 |
| 20010013102 | Tsuchiya et al. | Aug 2001 | A1 |
| 20010051881 | Filler | Dec 2001 | A1 |
| 20020016718 | Rothschild et al. | Feb 2002 | A1 |
| 20020019751 | Rothschild et al. | Feb 2002 | A1 |
| 20020052885 | Levy | May 2002 | A1 |
| 20020087546 | Slater et al. | Jul 2002 | A1 |
| 20020112001 | Sutherland et al. | Aug 2002 | A1 |
| 20020188735 | Needham et al. | Dec 2002 | A1 |
| 20030009527 | McIntyre et al. | Jan 2003 | A1 |
| 20030046260 | Satyanarayanan et al. | Mar 2003 | A1 |
| 20030065922 | Fredlund et al. | Apr 2003 | A1 |
| 20030117651 | Matraszek et al. | Jun 2003 | A1 |
| 20030122839 | Matraszek et al. | Jul 2003 | A1 |
| 20030128389 | Matraszek et al. | Jul 2003 | A1 |
| 20030131002 | Gennetten et al. | Jul 2003 | A1 |
| 20030135793 | Craig et al. | Jul 2003 | A1 |
| 20030156304 | Fedorovskaya et al. | Aug 2003 | A1 |
| 20030165269 | Fedorovskaya et al. | Sep 2003 | A1 |
| 20030165270 | Endrikhovski et al. | Sep 2003 | A1 |
| 20030174872 | Chalana et al. | Sep 2003 | A1 |
| 20030214670 | Ohmura | Nov 2003 | A1 |
| 20040100567 | Miller et al. | May 2004 | A1 |
| 20040101178 | Fedorovskaya et al. | May 2004 | A1 |
| 20040101212 | Fedorovskaya et al. | May 2004 | A1 |
| 20040103111 | Miller et al. | May 2004 | A1 |
| 20040122918 | Fredlund et al. | Jun 2004 | A1 |
| 20040126038 | Aublant et al. | Jul 2004 | A1 |
| 20040162871 | Pabla et al. | Aug 2004 | A1 |
| 20040172451 | Biggs et al. | Sep 2004 | A1 |
| 20050066219 | Hoffman et al. | Mar 2005 | A1 |
| 20050069107 | Tanaka et al. | Mar 2005 | A1 |
| 20050129385 | Speasl et al. | Jun 2005 | A1 |
| 20050132288 | Kirn et al. | Jun 2005 | A1 |
| 20050134688 | Belz et al. | Jun 2005 | A1 |
| 20050135708 | Joyce | Jun 2005 | A1 |
| 20050141477 | Tomita et al. | Jun 2005 | A1 |
| 20050203771 | Achan | Sep 2005 | A1 |
| 20050286883 | Abe et al. | Dec 2005 | A1 |
| 20060080286 | Svendsen | Apr 2006 | A1 |
| 20060082809 | Loukipoudis et al. | Apr 2006 | A1 |
| 20060083442 | Loukipoudis et al. | Apr 2006 | A1 |
| 20060098668 | Dona | May 2006 | A1 |
| 20060159109 | Lamkin et al. | Jul 2006 | A1 |
| 20060161635 | Lamkin et al. | Jul 2006 | A1 |
| 20060230072 | Partovi et al. | Oct 2006 | A1 |
| 20070047950 | Asami et al. | Mar 2007 | A1 |
| 20070067373 | Higgins et al. | Mar 2007 | A1 |
| 20070097436 | Hirata | May 2007 | A1 |
| 20070279499 | Takeshita | Dec 2007 | A1 |
| 20070291303 | Tanaka et al. | Dec 2007 | A1 |
| 20080063384 | Tanaka et al. | Mar 2008 | A1 |
| 20080147821 | Dietrich et al. | Jun 2008 | A1 |
| 20080168559 | Touitou et al. | Jul 2008 | A1 |
| 20080177994 | Mayer | Jul 2008 | A1 |
| 20080307175 | Hart et al. | Dec 2008 | A1 |
| Number | Date | Country |
|---|---|---|
| 2004104759 | Dec 2004 | WO |
| 2005050413 | Jun 2005 | WO |
| 2006053830 | May 2006 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20090094247 A1 | Apr 2009 | US |
