Patent Application
20080297608
The patent pertains to a method for remote capture of digital images based on a cooperative network of digital devices in which at least one of the digital devices has image capture capabilities.
Networks of digital cameras and digital devices are setup to share information including images, and can be operated remotely when connected to a network. Typically, the digital cameras are setup as dedicated image capture devices that can only be operated by remote controllers that can control the image capture timing, pointing or zoom. Alternately, the digital devices are setup to allow images that have been captured to be shared with another digital device.
U.S. Pat. No. 6,400,903 entitled “Remote Camera Relay Controller Method and Apparatus” issued to Conoval discloses a method and apparatus to adapt a digital camera for unattended remote use of the digital camera. The digital camera is controlled remotely by a relay station that retransmits the image data. The digital camera is controlled for field of view, pan, tilt and windowing. However, this approach requires that the digital camera be connected to a network and setup specifically for dedicated remote operation through the relay station by another digital device.
U.S. Pat. No. 6,535,243 issued to Tullis discloses a method for allowing digital cameras access to a large amount of digital image data by using a bidirectional communication medium between the digital camera and a host computer. The method proposed by Tullis focuses on image storage and not image capture.
U.S. Pat. No. 7,154,535 issued to Yamasaki discloses a method for accessing images through a wired or wireless interface to image data resident on another digital camera. Following the method described by Yamasaki, an image is captured by a device and the image along with capture data is sent to another digital device for storage.
U.S. Pat. No. 7,139,018 issued to Grosvenor teaches the sharing of digital images amongst a group of people with image capture devices at the same event. The images are downloaded from the image capture devices to a shared storage location. The images are all labeled with a synchronizing code to enable image sharing of only the images from the event.
The prior art fails to describe a cooperative network of digital devices in which the operator can choose to participate within a group of digital devices that are connected to a common network. The image capture capabilities of the group are shared between those participating in the cooperative network thereby enabling images to be captured from desired locations and with different image capture capabilities from the operator's digital device. What is needed is a way for controlling and capturing a digital image through wired or wireless digital devices such as a cell phones, cell phones with embedded cameras, digital cameras, computers or personal digital assistants (PDAs). Accordingly, an opportunity exists to use available digital devices with image capture capabilities that are connected to a network to capture images cooperatively when requested by another digital device on the network.
In general terms, the present disclosure relates to a system and method for a cooperative capturing images, and more particularly to a system and method for acquiring images from multiple image capture devices.
The invention discloses the use of two or more digital devices that can communicate through a network wherein a request to capture an image of a specified location can be transmitted from a first digital device to the one or more other digital devices in the network. Digital devices with image capture capabilities located near the specified location and cooperating in the network can then capture an image of the specified location and transmit the image back to the requesting device for use or storage. The invention further discloses the use of a cooperative capture setting wherein the digital devices with image capture capabilities can be set by the user to respond to request, ignore requests, or limit requests by other digital devices on the network to capture images when requested.
Devices in the network that can be used in the method of the invention can include any type of digital device that can transmit information over a network and can use or store digital images including but not limited to: computers, cell phones, digital cameras, portable digital devices, digital televisions, digital picture frames, or the like. The network can be wireless, landline, cable, digital radio or other types of communication networks. In the spirit of the invention, the digital devices do not have to be setup specifically on the network for remote capture but instead can simply be the many digital devices which are normally present at any group event wherein a number of people are present.
One aspect of the present invention is a method for acquiring images from multiple image capture devices. More particularly, the method includes broadcasting a request to one or more image capture devices participating in a cooperative network for capturing an image at a predetermined location, capturing the image by the one or more image capture device, and storing the requested image in a storage device.
Another aspect of the present invention is a system for acquiring images from multiple image capture devices. More particularly, the system includes a cooperative network, a first device coupled to the cooperative network for broadcasting a request to one or more image capture devices participating in the cooperative network for capturing an image at a predetermined location, and a storage device coupled to the cooperative network for storing the captured image.
Yet another aspect of the present invention is a method for acquiring images from multiple image capture devices. More particularly, the method includes detecting one or more image capture devices in a cooperative network, controlling the operation of the detected one or more image capture devices in the cooperative network for capturing an image at a predetermined location, capturing the image by the one or more image capture device, and storing the requested image in a storage device.
The invention may be more completely understood by considering the detailed description of various embodiments of the invention which follows in connection with the accompanying drawings. Referring now to the drawings in which like reference numbers represent corresponding parts throughout:
Various embodiments of the present invention will be described in detail with reference to the drawings, wherein like reference numerals represent like parts and assemblies throughout the several views. Reference to various embodiments does not limit the scope of the invention, which is limited only by the scope of the claims attached hereto. Additionally, any examples set forth in this specification are not intended to be limiting and merely set forth some of the many possible embodiments for the claimed invention.
In one embodiment, the digital device 1 can also include a global positioning module 18 for determining the location of the digital device 1. However, in another embodiment, the digital device 1 does not include a global positioning module 18 for determining the location of the digital device 1. Multiple digital devices 1 can be connected together through a network connection 32 to create a cooperative network that enables communication between two or more digital devices 1 for various purposes.
In a first embodiment of the invention, a request to capture an image at a specified location is transmitted by a user from a first digital device 100 over the network 132. The request includes a specified location for the image to be captured and a range around the specified location wherein the image capture is desired. The request may also include a general or specific compass direction for pointing one or more other digital devices 110, 120, 130 and 140 and a range around the direction. The request to capture the image at the specified location is received by the one or more other digital devices 110, 120, 130 and 140 connected to the network 132. The digital devices 110, 120, 130 and 140 connected to the network 132 then compare the request to their cooperative capture setting. The cooperative capture setting are set by the operators of the digital devices 110, 120, 130 and 140 and are used to, but not limited to, determine whether image capture requests are to be allowed or ignored. Each digital device 110, 120, 130 and 140 with an image capture module 16 then compare its location to the specified location in the request sent from the first digital device 100. If the location of the digital device 110, 120, 130 and 140 with an image module 16 is within the specified range of the specified location and the device cooperative capture setting has been set to allow image captures as requested by other digital devices 1, then an image of the scene is captured and sent to the first digital device 100 over the network connection 132. This image may be captured manually by the user of the other digital device 110, 120, 130 or 140 or automatically with no user intervention as determined by the cooperative capture settings.
The advantage of the technique described, is that a user of digital device 100, for example, can capture images at remote locations using the image capture modules 16 of other digital devices 110, 120, 130 or 140, for example, via the network 132. The digital devices 110, 120, 130 or 140 can be located at a remote location with respect to digital device 100. In a group situation, such as at a sporting event, this can provide improved image capture capabilities for an operator by enabling other digital devices 110, 120, 130 or 140 with image capture modules 16 to be temporarily used. These temporarily used digital devices 110, 120, 130 or 140 provide more desirable images because they are located at locations closer to the action or have a better capture angle. When the network connection 32 (
For the case where the network connection 132 is a cellular network, a landline network or a radio network, then the difference in location between the requesting digital device 100 and the other digital devices 110, 120, 130 and 140 with an image capture module 16 can be many miles. For the case where the network connection 132 is a radio network, the distance can be unlimited.
Another advantage provided by the invention is that a digital device without an image capture module 16 can be used to transmit a request for an image capture of a specified location onto the network 132. In this way, the requested images can be captured by the other digital devices 110, 120, 130 or 140 having image modules 16 and transmitted to the digital device that does not have an image capture module 16.
A further advantage is that a request for an image capture can be made from a first digital device 100 to a second digital device 110, 120, 130 or 140 having an image capture module 16 with improved capabilities. For example, the second digital device 110, 120, 130 or 140 can include higher resolution or higher magnification capabilities for obtaining an image with improved image quality over what could be obtained with the first digital device 100.
In a further embodiment, the invention discloses that a network could be setup for assigning a monetary charge by the user of the second digital device 110, 120, 130 or 140 having image capture modules 16 to the user of the first digital device 100. The monetary charge can be for a temporary use of the image capture capabilities of the second digital device 110, 120, 130 or 140.
There are a number of options for determining the specific location of a location that is remote to the first digital device 100. In a first approach, global position coordinates of the specific location can be manually determined by the operator from a map or a database. In a second approach, the global position coordinates of the specific location can be determined based on measuring the global position coordinates of the first digital device 100 and then determining the distance and direction to the specific location. The determination can be made, for example, using measurements from a map or making a rough estimation. In this case, a compass would be required to determine the direction from the digital device 100 to the specified location. The global position coordinates of the specific location can then be calculated by adding the distance and direction to the specific location to the global position coordinates of the first digital device 100. In a third approach, the global position coordinates of the specific location can be measured directly with a rangefinder device such as is described in pending U.S. patent application Ser. No. 11/684,036 by Border (docket 93589) which is incorporated herein by reference.
In step 520, the first digital device 200 calculates the global position coordinates of the specific location where an image is to be captured based on the global position coordinates of the first digital device 200, the direction to the specific location where the image is to be captured, and the estimated or calculated distance from the first digital device 200 to the specific location where an image capture is desired. In step 530, the user of the first digital device 200 then broadcasts a request to capture the image over the cooperative network 232. The request for the image to be captured at the specific location includes the calculated global position coordinates for the specific location where an image capture is desired and other request information, such as a range around the location that includes the other end of the football field.
Referring back to
Also,
In step 656 the other digital devices 210, 220, 230, which have image capture modules 16, compare the request to their cooperative capture settings as set by their respective operators to determine whether requests will be allowed or ignored. If the cooperative capture settings are set such that image capture requests are not allowed, the request is ignored as shown in step 666. If the cooperative capture settings are set such that image capture request is allowed, the process continues to step 658. In step 658, the other digital devices 210, 220, 230 compare their locations as determined by their global positioning modules 18 to the specific location (and associated range) contained in the request from step 652. If the locations of the other digital devices 210, 220, 230 do not match the specific location (or are not within the range associated with the specific location of the request) contained in the request, the request is ignored as in step 666.
If the locations of the other digital devices 210, 220, 230 do match the specific location (or are within the range associated with the specific location of the request), the process then continues to step 660. The other digital devices 210, 220, 230 that match the criterion from steps 656 and 658 capture one or more images as requested. In step 662, the captured images are transmitted from the other digital device 210, 220, 230 to the first digital device 200 through the network 132. In step 664, the captured images are then used or stored by the first digital device 200.
In yet another embodiment, following step 654 wherein a request is received by the other digital devices 210, 220 and 230 from the first digital device 200 or other device, the locations of the other digital devices 210, 220 and 230 are transmitted back to the first digital device 200. The locations of the other digital devices 210, 220 and 230 can then be displayed on the first digital device 200 and the locations of the other digital devices 210, 220 and 230 can be shown relative to the specific location where an image capture is desired. The display of the locations of the other digital devices 210, 220 and 230 relative to the specific location where an image capture is desired can be shown graphical by displaying the global positioning coordinates. Alternatively, the locations of the other digital devices 210, 220 and 230 can be in the form of a map 700 illustrated in
In still a further embodiment, following step 654, the other digital devices 210, 220 and 230 transmit their locations and a description of their image capture capabilities such as: the number of mega pixels, the zoom range, the type of device such as hand-held, fixed mounted or controllably mounted, and whether a charge will be incurred for the image capture. The description of the image capture capabilities from the other digital devices 210, 220 and 230 can be shown along with the location in a graphical form. However, if the first digital device 200 is displaying a map 700 of the other digital devices 210, 220 and 230, a description of the other digital devices 210, 220 and 230 image capture capabilities can be shown when the icon B, C or D for the available digital device is selected on the map 700 as shown in
In another embodiment with respect to
For still image capture, a cooperative capture setting can be used in the second digital device 110 to allow video captures as requested or to ignore the requests. In a further embodiment, the cooperative capture setting can be set to limit the type of images to be captured. For example, the cooperative capture setting can be set to allow only requested still image captures, to allow requested still image captures and video captures, or to only allow requested video captures. In another embodiment, the cooperative capture setting can include limitations on the still image captures or the video image captures to be allowed. This limitation includes, but not limited to: resolution, time of day, pointing direction, location, image content, modified images which make the images more cartoon like, or some other effect to protect the privacy of the operator of the second digital device 110 and the other people in the image captured by the second digital device 110.
An image capture can include further specifications to the conditions surrounding the image capture such as: the time (including a time range) when the image capture should occur, and the image content based on desired aspects of the image (e.g., number of faces in the image, illumination brightness, colors present, speed of motion, object shapes).
The request for an image capture can even include a portion of an image. This portion of an image is used as an image content example to teach the second digital device to capture an image that contains the image content example. The image content example includes, but is not limited to, a face, an object such as a soccer ball, a number such as on a player's jersey, or other specific image content that is desired in the image to be captured. The portions of an image used as an image content example can be taken from a previously captured image or a previously stored image. This is accomplished by using a touch screen, a mouse, a pointer or other method of selecting portions of an image.
In yet another embodiment, video is immediately transmitted to the first digital device 100 in streaming video so that the video is viewable on the first digital device 100 in real time. A directional indicating system is used and includes a mechanism for communicating the desired change in the pointing direction of the first digital device 100 and a directional change indicator on the second digital device 110, or combinations thereof. In this embodiment, a directional indicating system is used so the user of the first digital device 100 can communicate a request to the user of the second digital device 110 to change the pointing direction of the second digital device 110. As a result, the user of the first digital device 100 can view a different field of view for capturing a video or still image. In operation, the mechanism for communicating the request for a change in pointing direction can include, but is not limited to, a button or a touch screen. The directional change indicator can include, but is not limited to, a series of lights for left, right, and up or down movements. Alternately, the directional change indicator can be shown on the display in the form of an arrow or other directional icon.
For a remotely operated camera that is connected to the network and can provide streaming video, the video is immediately transmitted to the first digital device 100 and is viewable on the first digital device 100 in real time. The user of the first digital device 100 can communicate a request for a change in pointing direction to the remotely operated camera. Provided that the remotely operated camera has movement controllers for changing the pointing direction of the remotely operated camera, the remotely operated camera can change its pointing direction in response to the communicated request.
In another alternate embodiment of the invention, the requested captured images can be transmitted over the network 132 to a remote database 240 for storage and access at a later time. Charges can be assessed to the user for storage and access to the remote database 240.
The following provides several examples of a cooperative capture of images. In a first example, a person with a digital device 100 having wireless connectivity at a sporting event requests an image capture from other digital devices 110, 120, 130 or 140 also at the sporting event. The other digital devices 110, 120, 130 or 140 are within a wireless range from the digital device 100 and it is hoped that some of the other digital devices 110, 120, 130 or 140 include digital cameras 24 (
In a second example, a person with a digital device 100 having wireless connectivity but no image capture module, such as a cellular phone 22, requests an image capture from a second digital device 110 at a group event such as a graduation. The second digital device 110 is a cellular phone with an embedded camera 30.
In a third example, a person with a cellular phone 22 requests a 10-minute video capture within the next twenty-four hours from a remote site where the person is planning a vacation. A cellular phone with an image capture module 30 that is located at the remote site captures the video and sends the video back over the cellular phone network.
In a fourth example, a person with a computer 28 connected by landline to the Internet, requests an image capture from Main Street so the person can check on traffic. An image is captured by a PDA 29 connected by WIFI to the Internet that is located at a street side café next to Main Street. The image is captured and transmitted back over the Internet.
In a fifth example, a person with a digital camera 24 having Bluetooth connectivity requests an image capture of himself or herself at an award ceremony where the person is receiving an award. The person hopes that someone else at the award ceremony will have a digital device with cooperative capture settings that will allow the request for image captures.
In a sixth example, a person with a cellular phone 22 requests a video capture from a location inside a store. The store has a digital camera 24 located inside a store that has cooperative capture settings that allow image capture requests. The digital camera 24 in the store is pointed at a scene that shows what type of merchandise the store offers.
In a seventh example, a store positions a digital camera 24 with short-range wireless connectivity and cooperative capture settings that allow image capture requests. Items on sale in the store are in the field of view of the digital camera 24. People wishing to view what is on sale can then request images to be captured from a specific location of the store and transmit those images to people having digital devices connected to the cooperative network as they walk past the store. Alternately, the request for images to be captured can be for multiple still captures or continuous video captures from digital devices located within a short range of the requester's digital device. Thus, the user would receive a series of different images as the user walks past a series of stores.
In an eighth example, a person positions a digital camera 24 with cellular telephone connectivity at a location having a good viewing angle of a major event, such as a concert, a sporting event or a war zone. The digital camera has the cooperative capture setting set to allow image capture requests of still and continuous streaming video. People wishing to view the major event can then request images to be captured from the specific location of the major event. The operator of the digital camera 24 can then assess charges for each image captured and bill the requesters accordingly over the cellular telephone network billing system.
In a ninth example, a person attending a concert or sporting event that has friends who could not make it to the concert can set the cooperative capture settings on a cellular phone with an embedded camera 30. Accordingly, this allows image capture requests of still images, videos or continuous video of the concert or sporting event over the network 132. In this way, the friends can request still images, videos or continuous video from the concert or sporting event over the network and the person attending the concert or sporting event can charge each of the friends a fee for the use of their cellular phone with an embedded camera 30.
In a final example, a person attending a soccer game requests multiple still images throughout the soccer game. The request specifies that an image should be captured whenever the soccer ball and the number of the person's favorite player are both in the image at a location that corresponds to the soccer goal. In this case, the person uses a previous image of the favorite player with a soccer ball. Selected portions of the previous image are included with the request as an image content examples which show the soccer ball and the favorite player's jersey number. By the end of the game, the person receives a number of images that contain the favorite player and the soccer ball in the region of the soccer goal.
The various embodiments described above are provided by way of illustration only and should not be construed to limit the invention. Those skilled in the art will readily recognize various modifications and changes that may be made to the present invention without following the example embodiments and applications illustrated and described herein, and without departing from the true spirit and scope of the present invention, which is set forth in the following claims.
