Patent Grant
8761523
Reference is made to commonly-assigned, co-pending U.S. patent application Ser. No. 13/300,826 filed concurrently herewith, entitled “METHOD FOR MAKING EVEN-RELATED MEDIA COLLECTION” by Ronald S. Cok, et al., and co-pending U.S. patent application Ser. No. 13/300,889 filed concurrently herewith, entitled “USER METHOD FOR MAKING EVENT-RELATED MEDIA COLLECTION”, by Ronald S. Cok, et al, the disclosures of which are incorporated herein.
The present invention relates to the specification of recorded events and to compiling media collections related to the specified events.
Products that include media such as still images, video, audio and text are a popular keepsake or gift for many people. Such products typically include an image captured by a digital camera that is inserted into the product and is intended to enhance the product, the presentation of the image, or to provide storage for the image. Examples of such products include picture albums, photo-collages, posters, picture calendars, picture mugs, t-shirts and other textile products, picture ornaments, picture mouse pads, and picture post cards. Products such as picture albums, photo-collages, and picture calendars include multiple images. Products that include multiple images are designated herein as photographic products, image products, or photo-products.
Image-based products are frequently designed to represent and record a specific event in a person's life. Examples include weddings, graduations, parties, and vacations. In some situations, all of the images associated with an event are made by one individual who participates in the event or is responsible for recording the event. In other situations, multiple event participants record images associated with the event so that the situation is more complex. For example, different participating individuals can understand the event differently, can participate in different portions of the event at different times, can experience the event in different ways, or can record different parts of the event.
Making image-based products as event keepsakes or mementos, for example, as is commonly done with photo-albums, is often difficult, time-consuming, and tedious. When images from multiple event participants are included in the image-based product, the task becomes even more difficult. The number of images can be very large, collecting the images can be difficult, selecting representative images of high quality without selecting redundant images can be time-consuming, and determining which images are relevant to the event can be problematic.
Imaging tools for automating the specification of photographic products are known in the prior art. For example, tools for automating the layout and ordering of images in a photo-book are available from the Kodak Gallery as are methods for automatically organizing images in a collection into groups of images representative of an event. It is also known to divide groups of images representative of an event into smaller groups representative of sub-events within the context of a larger event. For example, images are segmented into event groups or sub-event groups based on the times at which the images in a collection were taken. U.S. Pat. No. 7,366,994 describes organizing digital objects according to a histogram timeline in which digital images are grouped by time of image capture. U.S. Patent Publication No. 2007/0008321 describes identifying images of special events based on time of image capture. U.S. Pat. No. 7,663,671 describes location-based image classification for images with map location metadata and is incorporated by reference herein its entirety.
Semantic analyses of digital images are also known in the art. For example, U.S. Pat. No. 7,035,467 describes a method for determining the general semantic theme of a group of images using a confidence measure derived from feature extraction. Scene-content similarity between digital images can also be used to indicate digital-image membership in a group of digital images representative of an event. For example, images having similar color histograms belong to the same event.
U.S. Patent Publication No. 2008/0304808 describes a method and system for automatically making an image product based on media assets stored in a database. A number of stored digital media files are analyzed to determine their semantic relationship to an event and are classified according to requirements and semantic rules for generating an image product. Rule sets are applied to assets for finding one or more assets that are included in a story product. The assets, which best meet the requirements and rules of the image product are included.
U.S. Pat. No. 7,730,036 describes event-based digital content record organization so that retrieval of such digital content in a manner meaningful and logical to users is achieved. In this regard, an event is defined by event boundaries, including a span of time, a geographic area, an acquirer of digital content, or a subject of digital content. This approach relies upon the post-capture analysis and sorting of collected images.
U.S. Pat. No. 7,085,818 describes providing information on proximate events based on current location and user availability. A determination is made of a current location of the wireless device and whether the current location is within a proximity to a target location. If the current location is within the proximity to the target location, information is transmitted. This information is used to schedule events for a user.
U.S. Pat. No. 7,233,933 describes cross-device monitoring, reasoning and visualization for providing status and forecasts of user's presence and availability. Predictive models are used to make forecasts of a user's presence and availability to facilitate collaboration and communications between entities such as parties to a communication. U.S. Pat. No. 7,539,489 discloses apparatus and methods facilitating a distributed approach to performance and functionality testing of location-sensitive wireless systems and equipment.
U.S. Patent Application Publication No. 2010/0111428 describes using image and location information to recognize an event depicted in an image from the image and location information associated with the image. The method includes acquiring the image and its associated location information, using the location information to acquire an aerial image, using the image and the acquired aerial image to identify the event, and storing the event in association with the image.
While these methods are useful for sorting images into event groups, temporally organizing the images, assessing emphasis, appeal, or image quality, or recognizing individuals in an image, there remains a need for improved methods of automating the specification and collection of images related to an event having a plurality of individual participants.
In accordance with the present invention, there is provided a method for making a media collection associated with an event having an event location, comprising:
receiving a specification of members in a group;
using a processor to receive one or more media elements from each of a plurality of media-capture devices, each media element having a capture location;
defining the event in response to receiving one or more media-capture-device signals having the event location from group members; and
associating media elements having the event location received at the same time or after the event definition with a stored media event collection corresponding to the event for subsequent use.
Various embodiments of the present invention have the advantage of forming media collections associated with an event without requiring analysis of the media elements in the media collection. Thus, the media collections associated with the event are more accurate and complete, and media element analysis, such as image processing, is rendered unnecessary.
These, and other, aspects of the present invention will be better appreciated and understood when considered in conjunction with the following description and the accompanying drawings. It should be understood, however, that the following description, while indicating embodiments of the present invention and numerous specific details thereof, is given by way of illustration and not of limitation. For example, the summary descriptions above are not meant to describe individual separate embodiments whose elements are not interchangeable. In fact, many of the elements described as related to a particular embodiment can be used together with, and interchanged with, elements of other described embodiments. Many changes and modifications can be made within the scope of the present invention without departing from the spirit thereof, and the invention includes all such modifications. The figures below are not intended to be drawn to any precise scale with respect to relative size, angular relationship, or relative position or to any combinational relationship with respect to interchangeability, substitution, or representation of an actual implementation.
The above and other features, and advantages of the present invention will become more apparent when taken in conjunction with the following description and drawings wherein identical reference numerals have been used, where possible, to designate identical features that are common to the figures, and wherein:
Various embodiments of the present invention are directed toward various methods for making a media collection associated with an event by defining events in response to media-capture device signals having location information received from individuals participating in the event, recording the event with media-capture devices, and associating recorded media elements with the event in stored media event collections for subsequent use.
As used herein, media are information elements that communicate information to users. Media can take a variety of human-understandable modalities such as images, audio, and text. A media element is information that includes one or more information components, for example, one or more of a digital still image, a digital video image sequence, audio information, or text information. A media element can include a plurality of components, for example any combination of a digital still image, a digital video image sequence, audio information, or text information.
In one embodiment, the media element is stored or communicated as a digital file or as one or more associated digital files. In another embodiment, components of the media element having location information describing the geographical location at which the components were captured or having time-of-capture information describing the time at which the components were captured are included as metadata in a common file with the components. Alternatively, such location or time-of capture information is stored in separate files associated with files in which other components of a corresponding media element are stored. In an embodiment, captured media are stored as media-element components in a digital storage system.
A media-capture device is a device, for example, an electronic device that captures media, for example communication media such as digital images, videos, audio, or text. The media-capture device is, for example, a digital camera or a cellular telephone that incorporates a digital camera. In an embodiment, the media-capture device is a smart phone that incorporates a digital camera and is capable of communicating digital information, such as digital images acquired with the incorporated digital camera, with a communication network, such as the internet or a cellular telephone network. Such devices are known in the telecommunications and imaging arts. The media-capture device can incorporate a clock for determining the time of capture of a media-element component, such as an image, and associating the capture time with the media-element component. Suitable electronic digital clocks are well known in the digital electronics industry. The media-capture device can incorporate ways of determining the capture location of a media-element component, such as an image, and associating the capture time with the media-element component. For example a GPS (global positioning system) device is incorporated into the media-capture device and used to determine the capture location of a media-element component. Alternatively, cellular telephone communication signals are used to determine the capture location of a media-element component. Determined capture locations or capture times are associated with the corresponding media-element components. Other ways of recording location can also be used, such as a record input by a user, other individual, or transmitted from other devices having location information (e.g. nearby computers communicating location information).
The media-capture-device signal includes a location signal, for example, obtained from a GPS device incorporated into the media-capture device. Such media-capture-device signals are communicated through a wireless or wired communication channel, for example, through cellular telephone communication channels or through the internet from hardware and software incorporated into the media-capture device using electronic device, processors, communication electronics, and software known in the art. The media-capture-device signals are communicated to a receiver, for example a computer server.
In one embodiment of the present invention, the media-capture-device signals include a media element including the capture location of the media element. The event is defined in response to receiving the media elements having the event location and the received media elements are associated with the stored media-event collection corresponding to the event for subsequent use. In this embodiment, the event definition can occur after the media elements are acquired. For example, a group of users can congregate at an event location, acquire images with their smart phones while at the event location, and then disperse. The images are later uploaded to the server, which then defines the event in response to the event location found with the acquired images, and associates the acquired images in the media collection. Alternatively, the images are transmitted to the server as the images are acquired. The server then receives the images, defines the event in response to the event location found with the acquired images while the event is in progress, and associates the acquired images in the media collection.
In an alternative embodiment, the media-capture-device signals are communicated separately from a media element. In this case, the media-capture device includes an identifier associated with its location and with media elements acquired by the media-capture device. When the media-capture-device signals indicate proximity of one or more identified media-capture devices to a pre-defined event location or a common location, an event is defined and media elements acquired by and identified with the media-capture device are associated into the media-event collection. When the media-capture device is no longer proximate to the event location, the media elements acquired by and identified with the media-capture device are no longer associated with the event and are not included in the media-event collection. In this embodiment, it is helpful if a capture time is included with the media element so that any media elements acquired and identified with the media-capture device while the media-capture device was proximate to the location are associated with the media event collection, even if the media element is communicated when the media-capture device is no longer at the event location. Media elements acquired at the location at a time different from the event time are not included. For example, a group of users with smart phones (media-capture devices) can congregate at an event location and transmit identified media-device capture signals indicating proximity to the event location to define an event. The users acquire images with their smart phones while at the event location and then disperse. The images are identified with the smart phones and uploaded to a server, either as the images are acquired or later. The server compares the capture time of the identified images to the location of the corresponding media-capture device at that time to determine whether the received images are part of the event. Those images that match the time and media-capture device are associated with the media-event collection. Those media recorded at the location but at a time different from the event time are excluded.
Referring to
In an optional step, the members can edit or delete captured media elements in step 255. A product incorporating one or more of the media elements is defined in step 260. The media product can also be edited by members so that a final media product that incorporates desired media elements in a desired way is specified and then distributed in step 265. The media product can include one or more of the media collection, a reference to the media collection, a product including at least a portion of the media collection, or a reference to a product including at least a portion of the media collection to one or more of the group members.
Members' proximity are detected with media-capture device signals in various ways according to various embodiments of the present invention. In one embodiment, the members capture media, such as images, that include capture location information and identifying media-capture device information. The media-capture device signal in this embodiment is a media element. When the capture locations from different media-capture devices indicated in different media elements match the event location, the event begins. Alternatively, the media-capture device signal can include a location signal separate from a media element, for example a communication of a location derived from a GPS device or extracted from cellular telephone signals in a media-capture device having cellular communications capability. Similarly, an event can be terminated in response to the geographic dispersal of the members, as indicated by the media-capture device signals indicating the location of their media-capture devices. The event termination can be detected by receiving media-capture-device signals from the one or more media-capture devices having locations different from the event location or different from a common location.
In another embodiment, proximity is determined by direct communication between media-capture devices, for example through Bluetooth point-to-point communications, direct optical communications such as infrared beams, or through local area networks. Once detected, proximity is communicated to remote device or to other media-capture devices.
The degree of proximity needed to establish an event can be related to the type and capabilities of media-capture devices. For example, an event can include participants who can see and record each other. If the participants' media-capture devices can record the participants in an area, the participants are sufficiently proximate to each other to define an event. If the participants' media-capture devices cannot record the participants at an area, the participants are not sufficiently proximate to each other to define an event. For example, media-capture devices including digital cameras having zoom lenses can enlarge the area considered to specify adequate participant proximity for an event in comparison to media-capture devices including digital cameras that do not have zoom lenses.
The media-capture devices of event participants can receive an event signal including a common-location indicator in response to such direct communication, for example from a remote system (such as a networked computer server from a service provider that receives media-capture device signals), or directly from a group member engaged in the direct communication. Such communication methods are known in the communications art. The media-capture device signals can include information indicating proximity by direct communication and are communicated to remote systems that then communicate an event signal to the directly communicating participants.
In an embodiment of the present invention, an event coordinator specifies an event location, a time, or a time span in step 200 and communicates a notification to an event service or members. When the media-capture-device signals indicate that media-capture devices are proximate to the event location, the event is defined and media elements acquired at the event location are associated with the media-event collection. Events end when the media-capture-device signals no longer include information corresponding to the event location. Thus, media elements acquired by the media-capture devices no longer have a capture location corresponding to the event location and are not included in the media-event collection.
In another embodiment of the present invention, an event location is not pre-defined. Identified media-capture devices are associated into a group, for example a family or group of friends. When the media-capture-device signals indicate that media-capture devices are proximate to each other at a common location, an event is defined and media elements acquired at the event location are associated with the media-event collection. In this example, events occur whenever the group congregates with their media-capture devices at the same location. When the group disperses, the event ends.
Referring to
The members eventually disperse in step 230, for example by traveling to separate and different locations, and the event ends in step 235. The captured media elements are communicated and received at the same time or after the event definition in step 240. The received media are associated and stored into a media-event collection in step 250 for subsequent use. The media elements are received, for example by a computer server connected to a communication network such as the internet and accessible through wired or wireless communication channels, such as local area networks, cellular communication networks, and point-to-point networks. Such communication channels can include: Ethernet, WiFi, or Bluetooth communication. Once the media elements are associated and stored in a media-event collection, they are used to define a product in step 260 and distributed in step 265.
Media products can be automatically defined and distributed (e.g. by a computer server of a service provider), or one or more group members can define and distribute the media products. Alternatively, another person, for example a professional graphic artist not part of the group can define and distribute a media product based on the media-event collection. Media products can be edited and refined by group members (e.g. in step 255).
According to various methods of the present invention, the event is defined in various ways in response to receiving one or more media-capture-device signals having the event location. As noted above, the event can be pre-specified and the event defined when media-capture signals (e.g. location signals or media elements having location capture information) from different members match the event location. Alternatively, the media-capture signals can indicate a common location that is not pre-determined. In further embodiments, the event is defined when a pre-determined number of people arrive at a pre-specified location or a common location. Alternatively, the event is defined when a pre-determined percentage of members in a group arrive at the event location or a common location. The group can be determined by the members themselves joining a group. Alternatively, the members are part of a group in view of whom they are or where they live. For example, a sporting event is defined when a number of people are at a sporting venue at the same time. The members of the group, in this example, are simply the people who have media-capture devices participating in an event service. Alternatively, a group is more exclusive, for example part of a family, and an event is defined when a number or percentage of the family congregate at a common location, for example, for a wedding.
An event can also be defined in response to both time and location. For example, an event is defined when members arrive at a location at a specified time, for example a pre-defined event time such as for a wedding or party or other event having a known, scheduled time. An end time or time-span allotment (amount of time) can also be specified, so that an event is terminated when participants disperse, the end time is reached, or the time elapses. Alternatively, an event is defined after a pre-specified delay time following the time when participants' locations coincide.
In a further embodiment of the present invention illustrated in
An event location can be specified in a variety of ways. A location can be latitude and longitude or a GPS location. Since physical people cannot be in the exact same location, a location is understood to include an area. The size of an area can simply reflect the precision of a location measurement (e.g. within ten meters) or can include a pre-determined distance from a precise location, for example within 10, 50, or 100 meters. Such a distance can be communicated to and received by participants or an event service and used to determine whether a media-capture location is at the event location or not. Such a determination can be made by comparing the media-capture location to the event location and determining whether the two locations are within the pre-determined distance of each other. Such measurements and calculations are known in the computing arts and can be computed by processors executing programs.
Alternatively, an event location is defined by the locations of the media-capture devices of the members. As members approach an event location or a common location, at some point they stop approaching a common location. The combined locations of the media-capture devices can define the event location. The event location is thus the area defined by the closest proximity of the media-capture devices as indicated by the media-capture device signals. Referring to
In various embodiments of the present invention, members of a group each have an identified media-capture device for capturing media with capture location, capture time information, and identification information. The group can be voluntarily defined by its members, for example by associating in social media networks. The group can interact through social media or media-sharing services provided by internet-connected service providers having computer servers that interact with the members' media-capture devices. The service provider can provide media-storage facilities, web-site services, application software for the media-capture devices, as well as software-enabled media services and media-event collection services using network-connected computer and storage servers.
Referring to
Referring to
Depending on the media elements received, the processor 34 can define an event and instantiate a corresponding media-event collection. Alternatively, an event coordinator, for example a member of the group, can define the event, location, or time and the media-event collection. The event coordinator can interact with the system 20 through a website controlled by the processor 34 and designed for the purpose of event specification, media-element collection, media-element analysis, and media-event collection storage. The servers and software for enabling such websites are within the scope of the computer and network arts.
In this embodiment, referring to
The system 20 can support multiple events at different locations for different groups. Hence, it is helpful if the media-capture devices are identified and associated with members who are, in turn, associated into identified groups. Each event can then be associated with the corresponding group, members, media-capture devices, and media-event locations.
In another embodiment of the present invention and as illustrated in
The event location is received by the mobile media-capture device in step 500 and the selection tool in step 505. The media-capture device (e.g. 80) sends media-capture device signals indicating the media-capture device location in step 507 that are received by the computer server in step 407. The beginning of the event is signaled in step 410 and media elements 5 are captured in step 510. The selection tool is operated so that, in this case, the capture location is compared to the event location in step 515. If media elements 5 are captured before the event begins, they are ignored. If a match is found after the event begins, the media element 5 is communicated in step 520 to the computer system 20 that receives the media element in step 415. The process is repeated until the capture location no longer matches and the event ends (step 525). The event end is communicated to the computer server in step 420.
In an alternative method of the present invention, the media-capture device (e.g. 80) is not informed of the event beginning and simply communicates media elements 5 having a capture location matching the event location, for example if a spontaneous common location is used to define the event. The computer system 20 then determines if the matched media elements 5 are associated with the media-event collection.
In another embodiment, the event only ends for the specific media-capture device (e.g. 80) that is no longer at the event location. The event can continue for other media-capture devices that continue the process until the event ends for the group and the media-collection is complete. In yet another embodiment, an event time at which the event was defined is communicated and the selection tool is operable to compare the capture time of a media element 5 to the communicated event time, and, if the capture time corresponds to the event time, communicate the media element 5.
Event participants can be members of a group, for example a general group such as cell-phone owners having an account with a service provider, or a self-selected group such as a self-selected on-line group in a social-media or media-sharing community. In an embodiment of the present invention illustrated in
In further embodiments of the present invention, media-capture device signals are received from each group member that sequentially visits the event location and terminates the event when some or all of the group members have left the event location.
In one embodiment of the present invention, an event coordinator provides event information, such as location, event type, or event time. In this case, as shown in
As noted above, group members' proximity can be detected in a variety of ways. As shown in
Referring to
The selection tool can select captured media element(s) 5 when a capture time of the media element 5 is at or after the specified time, a capture time of the media element 5 is within the time span, or a capture location of the media element 5 is within the distance from the event signal. In an embodiment, the selection is done by executing a software application on a processor in the media-capture device (e.g. 80).
Users can communicate an identifier (or a media-capture device identification) in step 551 (
Prior-art methods operate on a pre-existing collection of images to segment them into events. Inherent in this process is the acquisition of numerous images or other media elements that are not relevant to a specific event. Therefore, if an event-related product is desired, it is necessary to process and analyze the images in an image collection to determine events and which images are relevant to the event. In contrast, the present invention provides a method for acquiring only those images or other media elements in an image collection relevant to an event, thereby reducing the amount of communication and storage necessary for acquired images unrelated to the event and eliminating the image processing and analysis necessary for segmenting images into events.
According to the present invention, an image product, photographic product, or photo-product is a printed or electronic media product that includes multiple images incorporated into an image-related object, such as for example a photo-book, photo-album, a photo-card, a picture greeting card, a photo-collage, a picture mug, on-line albums, movies, photo slideshows, photo-blogs, or other image-bearing products. In various embodiments of the present invention, an image product is a media product that that can include printed images, for example images printed on photographic paper, cardboard, writing paper, textiles, ceramics, rubber such as foam rubber, or polymers. These printed images can be assembled or bound into image products. In an alternative embodiment, the media product can be an electronic image product suitable for display on an electronic display by a computing device and stored as a file, or multiple files, in an electronic storage system such as a computer-controlled disk drive or solid-state memory. Such image products can include, for example, photobooks, collages, or slide shows that include one or more images with or without ancillary images such as templates, backgrounds, clip art and the like. In various embodiments, an image product includes a single still image, multiple still images, or video images and can include other sensory modalities such as sound or text. A variety of these various media components are combined to create a media product that includes multiple media elements.
In an embodiment, the media products include images that are displayed by a computer on a display, for example as a single image or by sequentially displaying multiple pages in the product together with outputting any other related product information such as sound or text. Such display is interactively controlled by a user. Such display devices and media products are known in the art as are user interfaces for controlling the viewing of media products on a display. The media products are distributed and displayed on a display of a media-capture device.
Partially complete media products including captured media elements can be distributed to event participants during an event. In a further embodiment of the present invention, a media product derived from the media-event collection can be distributed in response to a subsequent event, for example a media product is produced in response to a group at a location and the media product distributed in response to the same group reconvening at the same location. Alternatively, the media product is distributed to a group member in response to the group member returning to the event location.
In one embodiment of the present invention, the various methods of the present invention are performed automatically using, for example, computer systems such as those described further below. Tools and circuits for receiving still images, video, audio, text, and photo-product choices, e.g. using communication circuits and networks, are known, as are tools and circuits for manually selecting digital images and specifying photo-products, e.g. by using software executing on a processor or interacting with an on-line computer server.
The capture, transmission, and storage of digital information such as images, videos, audio, and text are well known in the art. For example, as shown in
A variety of systems can be used to implement the various methods of the present invention. Referring to
The system for forming storage locations includes an electronic storage and retrieval system 16, a server processor 34 connected to one or more remote client computer(s) (e.g. mobile communication device 80) through a communication channel 18, the server processor 34 connected and having access to the electronic storage and retrieval system 16. The communication channel 18 can be a network and can interact with the processor 34 through a communication system 54.
The user 72 can photograph scenes and transmit the captured scenes through the communication channel 18 to the communication system 54 to be stored by the processor 34 on the disk drive 44 in the electronic storage and retrieval system 16 as a digital media element 5, such as a digital image.
The server processor 34 can include circuits to transmit and receive information to and from a remote client computer (e.g. mobile communication device 80), receive digital media element 5 from the remote client computer mobile communication device 80 through the communication network 18 and store the received digital media element 5 in the electronic storage and retrieval system 16. The server processor 34 also includes ways to receive references or receive photographs. Computer system components for storing, communicating, retrieving, and processing digital images are known in the art and discussed in greater detail with respect to
Referring in more detail to the mobile communication system 80, as shown in
Embodiments of the present invention can be implemented using a variety of computers and computer systems illustrated in
In another embodiment, a computer server operated by a service provider can provide web pages that are served over a network to a remote client computer such as a media-capture device. The web pages can permit a user of the remote client computer to provide digital images and photo-product choices. Applications provided by the web server to a remote client can enable capture, communication, and presentation of selected media elements, either as stand-alone software tools or provided through html, Java, or other known-internet interactive tools. A server computer can provide graphical user interface display elements and functions to a remote client computer connected to the server computer through a computer network such as the internet. The remote client computer can include a display having a graphic user interface (GUI) including a user-interactive GUI pointing device; and a plurality of media elements communicated to and stored on the server computer, communicated to the remote client computer, and displayed on the GUI.
Computers and computer systems are stored program machines that execute software programs to implement desired functions. According to a embodiment of the present invention, a software program executing on a computer with a display and graphic user interface (GUI) including a user-interactive GUI pointing device includes software for capturing, communicating, storing, and displaying a plurality of media elements having images on the GUI and for performing the steps of the various methods described above.
The data-processing system 110 includes one or more data-processing devices that implement the processes of the various embodiments of the present invention, including the example processes described herein. The phrases “data-processing device” or “data processor” are intended to include any data-processing device, such as a central processing unit (“CPU”), a desktop computer, a laptop computer, a mainframe computer, a personal digital assistant, a Blackberry™, tablet computer, a digital camera, a digital picture frame, cellular phone, a smart phone, or any other device for processing data, managing data, communicating data, or handling data, whether implemented with electrical, magnetic, optical, biological components, or otherwise.
The data-storage system 140 includes one or more processor-accessible memories configured to store information, including the information needed to execute the processes of the various embodiments of the present invention, including the example processes described herein. The data-storage system 140 can be a distributed processor-accessible memory system including multiple processor-accessible memories communicatively connected to the data-processing system 110 via a plurality of computers or devices. On the other hand, the data-storage system 140 need not be a distributed processor-accessible memory system and, consequently, can include one or more processor-accessible memories located within a single data processor or device.
The phrase “processor-accessible memory” is intended to include any processor-accessible data-storage device, whether volatile or nonvolatile, electronic, magnetic, optical, or otherwise, including but not limited to, registers, caches, floppy disks, hard disks, Compact Discs, DVDs, flash memories, ROMs, and RAMs.
The phrase “communicatively connected” is intended to include any type of connection, whether wired or wireless, between devices, data processors, or programs in which data is communicated. The phrase “communicatively connected” is intended to include a connection between devices or programs within a single data processor, a connection between devices or programs located in different data processors, and a connection between devices not located in data processors. In this regard, although the data-storage system 140 is shown separately from the data-processing system 110, one skilled in the art will appreciate that the data-storage system 140 can be stored completely or partially within the data-processing system 110. Further in this regard, although the peripheral system 120 and the user-interface system 130 are shown separately from the data-processing system 110, one skilled in the art will appreciate that one or both of such systems can be stored completely or partially within the data-processing system 110.
The peripheral system 120 can include one or more devices configured to provide digital content records such as media elements to the data-processing system 110. For example, the peripheral system 120 can include digital still cameras, digital video cameras, cellular phones, smart phones, audio recorders, or other information-recording devices. The data-processing system 110, upon receipt of digital content records from a device in the peripheral system 120, can store such digital content records in the data-storage system 140. Such records can include digital still images, digital video, audio recordings, and text stored as one or more components of one or more media elements 5.
The user-interface system 130 can include a mouse, a keyboard, a keypad, a touch screen, a voice-recognition system, another computer, or any device or combination of devices from which data is input to the data-processing system 110. In this regard, although the peripheral system 120 is shown separately from the user-interface system 130, the peripheral system 120 can be included as part of the user-interface system 130.
The user-interface system 130 also can include a display device, a processor-accessible memory, or any device or combination of devices to which data is output by the-data processing system 110. In this regard, if the user interface system 130 includes a processor-accessible memory, such memory can be part of the data-storage system 140 even though the user-interface system 130 and the data-storage system 140 are shown separately in
Referring to
The source of content data files 24 can include any form of electronic or other circuit or system that can supply digital data to processor 34 from which processor 34 can derive images for use in forming an image-enhanced item. In this regard, the content data files can comprise, for example and without limitation, still images, image sequences, video graphics, audio recording, text, and computer-generated images. Source of content data files 24 can optionally capture images to create content data for use in content data files by use of capture devices located at, or connected to, electronic system 20 or can obtain content data files that have been prepared by or using other devices. In the embodiment of
Sensors 38 are optional and can include light sensors, biometric sensors, magnetometers, orientation sensors, inertial sensors, and other sensors known in the art that can be used to detect conditions in the environment of system 20 and to convert this information into a form that can be used by processor 34 of system 20. Sensors 38 can also include one or more image sensors 39 that are adapted to capture images. Sensors 38 can also include biometric or other sensors for measuring involuntary physical and mental reactions such sensors 38 including, but not limited to, voice inflection, body movement, eye movement, pupil dilation, body temperature, and p4000 wave sensors. In addition, sensors 38 can measure magnetic fields to determine direction and orientation and inertial sensors to detect static and dynamic orientation.
Memory 40 can include conventional memory devices including solid-state, magnetic, optical or other data-storage devices. Memory 40 can be fixed within system 20 or it can be removable. In the embodiment of
In the embodiment shown in
Communication system 54 can comprise for example, one or more optical, radio frequency or other transducer circuits or other systems that convert image and other data into a form that can be conveyed to a remote device such as remote memory system 52 or remote display 56 using an optical signal, radio frequency signal or other form of signal. Communication system 54 can also be used to receive a digital image and other data from a host or server computer or network (not shown), a remote memory system 52 or a remote input 58. Communication system 54 provides processor 34 with information and instructions from signals received thereby. Typically, communication system 54 will be adapted to communicate with the remote memory system 52 by way of a communication network such as a conventional telecommunication or data transfer network such as the internet, a cellular, peer-to-peer or other form of mobile telecommunication network, a local communication network such as wired or wireless local area network or any other conventional wired or wireless data transfer system. In one useful embodiment, the system 20 can provide web access services to remotely connected computer systems (e.g. remote systems 35) that access the system 20 through a web browser. Alternatively, remote system 35 can provide web services to system 20 depending on the configurations of the systems.
User input system 26 provides a way for a user of system 20 to provide instructions to processor 34. This permits such a user to make a designation of content data files to be used in generating an image-enhanced output product and to select an output form for the output product. User input system 26 can also be used for a variety of other purposes including, but not limited to, permitting a user to arrange, organize and edit content data files to be incorporated into the image-enhanced output product, to provide information about the user or audience, to provide annotation data such as voice and text data, to identify characters in the content data files, and to perform such other interactions with system 20 as will be described later.
In this regard user input system 26 can comprise any form of transducer or other device capable of receiving an input from a user and converting this input into a form that can be used by processor 34. For example, user input system 26 can comprise a touch screen input, a touch pad input, a 4-way switch, a 6-way switch, an 8-way switch, a stylus system, a trackball system, a joystick system, a voice recognition system, a gesture recognition system a keyboard, a remote control or other such systems. In the embodiment shown in
Remote input 58 can take a variety of forms, including, but not limited to, the remote keyboard 58a, remote mouse 58b or remote control handheld device 58c illustrated in
As is illustrated in
Referring back to
In certain embodiments, the source of content data files 24, user input system 26 and output system 28 can share components.
Processor 34 operates system 20 based upon signals from user input system 26, sensors 38, memory 40 and communication system 54. Processor 34 can include, but is not limited to, a programmable digital computer, a programmable microprocessor, a programmable logic processor, a series of electronic circuits, a series of electronic circuits reduced to the form of an integrated circuit, or a series of discrete components. The system 20 of
The invention has been described in detail with particular reference to certain embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.
| Number | Name | Date | Kind |
|---|---|---|---|
| 7035467 | Nicponski | Apr 2006 | B2 |
| 7085818 | Brown et al. | Aug 2006 | B2 |
| 7233933 | Horvitz et al. | Jun 2007 | B2 |
| 7366994 | Loui | Apr 2008 | B2 |
| 7539489 | Alexander | May 2009 | B1 |
| 7663671 | Gallagher et al. | Feb 2010 | B2 |
| 7730036 | Blose et al. | Jun 2010 | B2 |
| 8447769 | Paris et al. | May 2013 | B1 |
| 8510383 | Hurley et al. | Aug 2013 | B2 |
| 8599801 | Baio et al. | Dec 2013 | B2 |
| 20070008321 | Gallagher et al. | Jan 2007 | A1 |
| 20070115373 | Gallagher et al. | May 2007 | A1 |
| 20080304808 | Newell et al. | Dec 2008 | A1 |
| 20100082624 | Martin et al. | Apr 2010 | A1 |
| 20100111428 | Yu et al. | May 2010 | A1 |
| 20130040660 | Fisher et al. | Feb 2013 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20130129232 A1 | May 2013 | US |
