Patent Application
20240064398
Digitally-based and film-based cameras abound and are extremely flexible and convenient. One use for a camera is in the taking of self portraits. Typically, the user frames the shot and places the camera in a mode whereby when the shutter button is depressed; the camera waits a predetermined time so that the user may incorporate himself back into the shot before the camera actually takes the picture. This is cumbersome and leads to nontrivial problems. Sometimes the predetermined delay time is not long enough. Other times, it may be too long. For participates who are in place and ready to have their picture taken, especially children, waiting with a smile on their face for the picture to be snapped by the camera can seem endless even if it is just a few seconds long. Additionally, many who might like to be included into a shot find themselves not able to be because they have to take the picture and it is simply too much trouble to set up for a shutter-delayed photograph.
Voice recognition techniques are well known in the art and have been applied to cameras, see for example, U.S. Pat. Nos. 4,951,079, 6,021,278 and 6,101,338 which are herein incorporated by reference. It is currently possible to have fairly large vocabularies of uttered words recognized by electronic device. Speech recognition devices can be of a type whereby they are trained to recognize a specific person's vocalizations, so called speaker dependent recognition, or can be of a type which recognizes spoken words without regard to who speaks them, so called speaker independent recognition. Prior art voice operated cameras have several defects remedied or improved upon by various aspects of the present invention more fully disclosed below. One such problem is that in self portrait mode, the camera may snap the picture while the user is uttering the command. Another defect is that the microphone coupled to the voice recognition unit is usually mounted on the back of the camera. This placement is non-optimal when the user is in front of the camera as when taking a self portrait. Still another problem with prior art voice activated cameras is that they associate one vocalization or utterance to one camera operation. Thus, the user must remember which command word is to be spoken for which camera operation. This is overly constraining, unnatural, and significantly reduces the utility of adding voice recognition to the camera.
One prior art implementation of voice recognition allows for menu driven prompts to help guide the user through the task of remembering which command to speak for which camera function. This method however requires that the user be looking at the camera's dedicated LCD display for the menu. One aspect of the present invention provides for the menus to be displayed in the electronic view finder of the camera and be manipulated with both voice and gaze. Another aspect of the present invention incorporates touchpad technology which is typically used in laptop computers, such technology being well know in the art, as the camera input device for at least some functions.
A self-contained camera system, according to various aspects of the present invention, includes voice recognition wherein multiple different vocalizations can be recognized and wherein some such recognized vocalizations can be associated with the same camera command. Another aspect of the invention provides for multiple microphones disposed on or in the camera system body and be operable so that the user can be anywhere around the camera system and be heard by the camera system equally well. According to other aspects of the present invention, the camera system viewfinder includes gaze tracking ability and in exemplary preferred embodiments, gaze tracking is used alone or in combination with other aspects of the invention to, for example, manipulate menus, improve picture taking speed, or improve the auto focus capability of the camera. Other aspects of the present invention, such as the addition of touchpad technology and gesture recognition provide for a improved and more natural user interface to the camera system.
Thus, it is an object of the invention to provide an improved self-portrait mode for a camera system. It is further an object of the invention to provide an improved user interface for a camera system. It is yet a further object of the invention to make a camera system more user friendly with a more natural and intuitive user interface. It is still a further object of the invention to broaden the capabilities of the camera system. It is further an object of the invention to more easily allow a user to compose a shot to be taken by the camera system. It is still further an object of the invention to improve image quality of pictures taken by the camera system. It is yet another object of the invention to improve the speed of picture taking by the camera system.
One aspect of the present invention solves several of the problems of the prior art voice recognition cameras in that this aspect provides for more than one microphone to be the source to the recognition unit. With reference to
Automatic microphone selection is preferred and with reference to
In yet another novel embodiment of this aspect of the invention, the multiple microphones are preferably associated with multiple voice recognition units or, alternatively, with different voice recognition algorithms well know in the art. The outputs of these multiple voice recognition units or different voice recognition algorithms are then coupled to the camera controller (
To illustrate this embodiment using the example of the camera system having microphones on its frontside and backside given above, each of these microphones is coupled to a voice recognition unit. When an utterance is received, each voice recognition unit recognizes the utterance. The camera controller then selects which voice recognition unit's recognition to accept. This is preferably based on the energy received by each microphone using circuitry similar to
An embodiment using multiple algorithms preferably has one voice recognition algorithm associated with the frontside microphone and, a different voice recognition algorithm associated with the backside microphone. Preferably, the voice recognition algorithm associated with the frontside microphone is adapted to recognize vocalizations uttered from afar (owing to this microphone probably being used in self-portraits), while the voice recognition algorithm associated with the backside microphone is optimal for closely uttered vocalizations. Selection of which algorithm is to be used as the camera controller input is preferably as above. Alternatively, as above, the selection would be by static selection or both applied to the camera controller and a voting scheme used to resolve discrepancies. While the above example contemplates using different voice recognition algorithms, there is no reason this must be so. The same algorithms could also be used in which case this example functions the same as multiple voice recognition units.
It is further contemplated in another aspect of the invention that the voice recognition subsystem be used in conjunction with the photograph storing hardware and software. In a preferred use of this aspect of the invention, the user utters names to be assigned to the photographs during storage and, later, utter then again for recall of the stored image. Thus, according to this aspect of the present invention, a stored photograph can be recalled for display simply by uttering the associated name of the photograph. The name association is preferably by direct association, that is, the name stored with the picture. In a second preferred embodiment, the photograph storage media contains a secondary file managed by the camera system and which associates the given (i.e., uttered) name with the default file name assigned by the camera system's storage hardware and/or software to the photograph when the photograph is stored on the storage media. According to the second embodiment, when a photograph is to be vocally recalled for viewing, the camera system first recognizes the utterance (in this case, the name) which will be used to identify the picture to be recalled. The camera system then scans the association file for the name which was uttered and recognized. Next, the camera system determines the default name which was given to the photograph during storage and associated with the user-given name (which was uttered and recognized) in the association file. The camera system then recalls and displays the photograph by this associated default name.
In another preferred embodiment, the voice recognition subsystem of the improved camera system recognizes at least some vocalized letters of the alphabet and/or numbers so that the user may assign names to pictures simply by spelling the name by vocalizing letters and/or numbers. Another aspect of the invention provides that stored photographs be categorized on the storage media through use of voice-recognized utterances being used to reference and/or create categories labels and that, additionally, the recognizer subsystem preferably recognize key words for manipulating the stored pictures. For instance, according to this aspect of the invention, the inventive camera system would recognize the word “move” to mean that a picture is to be moved to or from a specific category. More specifically, “move, Christmas” would indicate that the currently referenced photograph is to be moved to the Christmas folder. An alternative example is “John move new year's” indicating that the picture named john (either directly named or by association, depending on embodiment) be moved to the folder named “New Year's”. It is further contemplated that the folder names may be used for picture delineation as well. For instance, the picture “John” in the Christmas folder is not the same as the picture “John” in the Birthday folder and the former may be referenced by “Christmas, John” while the latter is referenced by “Birthday, John”.
Another aspect of the present invention provides that the voice recognition camera system be capable of associating more than one vocal utterance or sound with a single command. The different utterances are contemplated to be different words, sounds or the same word under demonstrably different conditions. As an example, the voice recognition camera system of this aspect of the present invention allows the inventive camera system to understand, for example, any of “shoot”, “snap”, “cheese”, and a whistle to indicate to the camera system that a picture is to be taken. In another example, perhaps the phrase and word “watch the birdie” and “click” instruct the camera to take the picture. It is further envisioned that the user select command words from a predetermined list of the camera command words and that he then select which words correspond to which command. It is alternatively envisioned that the association of multiple recognizable words to camera commands may also be predetermined or preassigned. In another alternate embodiment, the inventive camera system allows the user to teach the camera system which words to recognize and also inform the camera system as to which recognized words to associate with which camera commands. There are obviously other embodiments for associating recognized vocalizations to camera commands and the foregoing embodiments are simply preferred examples.
In another embodiment of this aspect of the present invention, the user has his uttered commands recognized under demonstrably different conditions and recognized as being different utterances. For instance, according to this aspect of the invention, the voice operated camera system operates so that it understand commands vocalized close to the camera (as if the user is taking the picture in traditional fashion with the camera back to his face) and significantly farther away (as if the user is taking a self portrait picture and is part of the shot and thus has to vocalize loudly to the front of the camera.) For this illustration, in a preferred embodiment the user teaches the words to the camera under the different conditions anticipated. For example, the user would teach the camera system by speaking the word “snap” close to the camera and inform the camera that this is a picture taking command and would then stand far from the camera and say “snap”, thus teaching another utterance, and instruct the camera that this is also a picture taking command. These two different utterances of the same word under different conditions would be stored and recognized as different utterances. This aspect of the invention contemplates that the words vocalized and/or taught need not be the same word and, as illustrated above, different words would also be considered different utterances as well.
Since voice recognition is not always 100 percent accurate, another aspect of the present invention contemplates that the camera system or a remote device, or both, preferably provide an indication that a voice command was or was not understood. Thus, using the self portrait example above, if the user vocalizes the command to take a picture but the camera system does not properly recognize the vocalization as being something it understands, the camera system would beep, or light an LED, etc. to indicate it's misrecognition. Because of the relatively small number of anticipated camera commands and allowing for multiple vocalizations to command the same action, it is expected that the recognition rates will be quite high and fairly tolerant of extraneous noise without necessarily resorting to the use of a highly directional or closely coupled (to the user's mouth) microphone though the use of such devices is within the scope of the invention.
It is anticipated that the user of the inventive camera system may be too far away from the camera system for the camera system to recognize and understand the user's vocalizations. Thus, another aspect of the invention provides that the camera is equipped with a small laser sensor (
Another aspect of the present invention provides for there being a predetermined delay introduced between recognizing a voice command and the camera actually implementing the command. This aspect of the invention allows time, for example, for the user to close his mouth or for others in a self-portrait shot to settle down quickly before the picture is actually taken. In a first preferred embodiment of this aspect of the invention, the delay is implemented unconditionally for at least the picture taking command. In a second preferred embodiment of this aspect of the invention, the delay introduced is dependent upon from where the command came relative to the camera system. For instance, if the camera system recognized the command as coming from the frontside microphone, delay is used, but if the command comes from the backside microphone, then no delay is implemented. The simple energy detection circuitry of
Another aspect of the present invention provides that the camera LCD display (
According to another aspect of the present invention, it is envisioned that the current dedicated LCD display (
In another preferred embodiment, the remotely coupled display has buttons on it to control the camera system. In another embodiment, the remotely coupled display contains the microphone for receiving the voice commands of the user, digitizing the received voice, analyzing and recognizing the vocalization locally and sending a command to the camera system. In another preferred embodiment, the remotely coupled display containing the microphone simply digitizes the vocalization received by the microphone and transmits the digitized vocalization to the camera system for recognition of the vocalization by the camera system itself. In all embodiments of the wireless remote display, it is preferred that the display contain its own power source, separate from the power source of the camera. It is also contemplated that the display's separate power source may be coupled to the camera's power source when the display is ‘docked’ to the camera so that both may share power sources or so that the camera's power source may recharge the display's power source.
According to another aspect of the present invention, the electronic view finder (EVF) typically used on modern digital cameras includes a gaze tracking capability which is well known in the art, see for example U.S. Pat. No. 6,758,563 to Levola which is herein incorporated by reference. In this aspect of the present invention, menus typically used for user interface to the camera are electronically superimposed in the image in the EVF. The gaze tracker subsystem is operable for determining the area or approximate location of the viewfinder image at which the user is gazing. Thus, by the user looking at different areas of the EVF image, the gaze tracker subsystem informs the camera system so that a mouse-like pointer or cursor is moved by the camera system to the area of the EVF image indicated by the gaze tracking device to be the area the user is viewing. Preferably, the user then speaks a command to indicate his selection of the item pointed to by the pointer image. Alternatively, the user may indicate through other methods that this is his selection, such as staring at a position in the image for a minimum predetermined time or pressing a button, etc. As an example, the EVF displays icons for flash, shutter speed, camera mode, etc (alone or superimposed on the normal viewfinder image.) By gazing at an icon, a small compositely rendered arrow, cursor, etc., in the EVF image is caused by the gaze tracker subsystem to move to point to the icon at which the user is determined to be gazing by the gaze tracking subsystem, for instance, the camera mode icon as an example here. Preferably, the user then utters a command which is recognized by the camera system as indicating his desire to select that icon, for example, “yes” or “open”.
Alternatively, the icon is selected by the user gazing at the icon for some predetermined amount of time. When the icon is selected by whatever method, the EVF image shows a drop down menu of available camera modes, for example, portrait, landscape, fireworks, etc. The user, preferably, then utters the proper command word from the list or he may optionally gaze down the list at the mode he desires whereupon the gaze tracker subsystem directs that the pointer or cursor in the EVF image moves to the word and, preferably highlighting it, indicates that this is what the camera system thinks the user want to do. The user, preferably, then utters a command indicating his acceptance or rejection of that mode in this example, such as ‘yes’ or ‘no’. If the command uttered indicates acceptance, the camera system implements the command, if the command indicates rejection of the selected command, the camera system preferably moves the pointer to a neighboring command. To leave a menu, the user may utter ‘end’ to return to the menu above or ‘home’ to indicate the home menu. Preferably, the user can also manipulate the pointer position by uttering commands such as “up”, “down”, “left” and “right” to indicate relative cursor movement. In this way, the user interacts with the camera in the most natural of ways, through sight and sound cooperatively. While the above example used the preferred combination of gaze and voice recognition, it is contemplated that gaze tracking be combined with other input methods such as pushing buttons (like a mouse click) or touch input disclosed below, or gesture recognition disclosed below, etc. as examples.
Another application of this aspect of the invention uses gaze tracking to assist the auto focus (AF) capability of the prior art camera. AF generally has too modes, one mode uses the entire image, center weighted, to determine focus, another mode allows different areas of the image to have greater weight in determining focus. In the second mode, the user typically pre-selects the area of the framed image that he wishes to be over-weighted by the AF capability. This is cumbersome in that the user must predict where he wants the weighting to be ahead of time, thus, this embodiment of this aspect of the invention provides that the gaze tracker subsystem inform the AF capability of the camera system as to the location of the image that the user is gazing and that the AF capability use this information to weight this area of the image when determining focus. It is contemplated that the AF system may only provide for discrete areas of the image to be so weighted and in this case, preferably, the AF capability selects the discrete area of the image closest to that being gazed upon.
Another embodiment of this aspect of the invention uses the gaze tracker to enable the flash of the camera system. Flash is common used to “fill” dimly lit photographic scenes but sometimes this is not warranted. Other times, it is desired to have “fill” flash because the area of the scene desired is dark but the rest of the scene is quite bright (taking a picture in shade for example) and the camera does not automatically provide “fill” flash because the overall image is bright enough. Typically, the amount of “fill” flash the camera will give is determined by the camera measuring the brightness of the scene. The inventive camera system with gaze tracking is used to enhance the prior art method of determining the desire and amount of “fill” flash in that the inventive camera system gives more weight, in determining the scene brightness, to the area of the scene indicated by the gaze tracker as being gazed upon.
Another aspect of the present invention adds touchpad technology to the prior art camera system. Use of the word ‘touchpad’ throughout this disclosure should be construed to mean either the touchpad itself or the touchpad with any or all of a controller, software, associated touchpad electronics, etc. This touchpad technology is similar to the touchpad mouse pad used on laptop computers which is also well understood in the computer art. In a first preferred embodiment, the EVF (or LCD display) displays the menus as above and the user moves the cursor or mouse pointer around this image by use of his finger on the touchpad. This operation is virtually identical to that of the mouse in laptop computers and is well understood in the art. Preferably, the touch pad is mounted on the top of the camera at the location typically used for the shutter button (
Another application of this aspect of the invention uses the touchpad to inform the camera system to zoom the lens simply by the user stroking his finger from front to back (for example, to zoom) or back to front over the touchpad (for example, to wide angle). For this aspect of the present invention, a preferred embodiment has the touchpad on the barrel of the lens. This is a most natural way to control zoom since the movement of the finger is a gesture with the user ‘pulling’ the object to be photographed closer (front to back stroke means zooming) or ‘pushing’ the object to be photographed away (back to front stroke means wide angle). According to another aspect of the invention, the touchpad replaces the shutter button functionality and the preferable location for this embodiment is top mounted. Preferably, the touchpad is tapped once to focus the camera and/or lock the AF and tapped a second time to trip the shutter. Alternatively, the inventive camera system simply senses the person's touch of the touchpad, auto focuses the camera and/or locks the focus or provides continually focusing while the person's touch is sensed and wherein a tap of the touchpad then trips the shutter. Preferably, the camera system enforces a maximum amount of time that the AF may be locked so that action photographs will not be badly focused. Automatically locking the AF settings for a maximum predetermined time after AF activation or continuously focus upon AF activation is also applicable to the prior art AF button activation method described below. While a computer-like touchpad was used to illustrate the above preferred embodiments of this aspect of the invention, the touch sensitive input device could be comprised of other structure, for instance, the aforementioned touch-sensitive LCD display. Also, throughout this disclosure, the word ‘continuous’ (and its variants, e.g., continually, etc.) should be construed to mean discretely continuous in addition to its analogue-world definition.
In a second preferred embodiment of this aspect of the invention, the touchpad is placed on the back of the camera (
One of the most annoying properties of the modern digital camera is the shutter delay that occurs when a picture is taken. That is, the delay between the user depressing the shutter button and the camera actually taking the picture. This delay can be as much as one second on some modern digital cameras and is typically due to the camera focusing and then taking the picture after the shutter button is depressed. One solution to this implemented by prior art cameras is for the camera to sense when the shutter button is depressed half way, then focus and lock the AF settings of the camera while the shutter button remains half way depressed, so that when the user depresses the shutter button the rest of the way, the picture is taken almost instantaneously. This solution is more often than not misused or misunderstood by novice users or those who do not use their camera regularly and can also result in blurred action photographs. Thus, one aspect of the present invention provides that the viewfinder be coupled to a unit for detecting when the user's eye is viewing through the viewfinder. When viewfinder use is detected, the inventive camera system preferably enables the auto focus system to continually focus thus ensuring that the shot is focused when the camera system is commanded to take a picture. Preferably, the gaze tracker is used for this determination though this aspect of the invention may be implemented without gaze tracking.
In a preferred embodiment of this aspect of the invention without gaze tracking, the viewfinder is equipped with a small light emitting device and a light detection device both well known in the art. With reference to
Another aspect of the present invention is to employ a wink-detector as part of the viewfinder of the camera. Preferably, the gaze tracker is modified for this purpose. Alternatively, the previously disclosed viewfinder use detector may also be employed. All that is required is to additionally detect the abrupt change in reflected light from the eye that would be caused by the eyelid wink. The wink-detector is contemplated to be used for shutter trip and/or AF activation or lock among other things. It is contemplated that it be used in the aforementioned application wherein the menus of the camera are displayed on the EVF. In this case, the wink detector preferably acts as a user selection detector device in that the user may select an item pointed to by the gaze tracker pointer or that is otherwise highlighted by the gaze tracker simply by winking. It is contemplated that the detected wink would preferably function in the camera system similarly to a left mouse click on a computer system when dealing with menus and icons. In this way, the camera system with wink detector of this aspect of the present invention becomes a optical gesture-recognizing camera wherein the gesture is optically received and electronically recognized (gesture recognition is also contemplated to be used in the touchpad software as described above.)
In an enhancement of this aspect of the invention, the wink detector subsystem discriminates between a wink and a blink by preferably determining the amount of time taken by the wink or blink. If the amount of time taken for the gesture (blinking or winking) is below a certain threshold, the gesture is considered a wink and disregarded.
Once a user of a camera has taken pictures, typically he will wish to print or otherwise develop the pictures for viewing, framing, etc. Another aspect of the present invention provides for simpler photo offloading from the modern digital camera when a set of predetermined conditions, such as day, time, number of pictures to offload, etc., are met. The camera system preferably includes the ability for the user to indicate to the camera which pictures to offload so that the camera offloads only those pictures that are so indicated by the user. In a first preferred embodiment of this aspect of the invention, the camera system is internally equipped with wireless interface technology by a wireless interface to the camera controller for interfacing directly to a photo printer or other photo rendering device. Currently preferred is WIFI (i.e., IEEE 802.11 a/b/g/n) with alternatives being Bluetooth, or wireless USB all of which are known in the art. By connecting via WIFI, the inventive camera system can preferably access other devices on the LAN associated with the WIFI for the storing of pictures onto a computer, network drive, etc. In additional, preferably, devices on the network can access the camera system and the pictures within it directly and also access camera settings, upload new software or updates to the camera system, etc. Since one of the big complaints with wireless technology for small devices is the often-obtrusive antenna, it is greatly preferred for this aspect of the invention that the wireless hardware including antenna be completely contained within the body of the camera system.
In a second preferred embodiment of this aspect of the invention, the inventive camera system is equipped with software and hardware coupled to the camera controller allowing independent communication with a computer network for the primary purpose of communicating its pictures over the internet. Currently preferred is WIFI which is typically connected by LAN, routers, etc. to the internet and which usually allows WIFI-equipped devices to independently connect to the internet (
In an enhancement to the above-disclosed embodiments of this aspect of the invention, the inventive camera system is operable for being instructed to automatically initiate a connection to the internet, LAN, printer, etc. whenever the predetermined conditions are met and it is in range of the network connection, (e.g., WIFI, Bluetooth, wireless USB, wired LAN, etc). Once the transmittal of the pictures is complete, the inventive camera system preferably terminates the connection. Additionally, the inventive camera system is preferably operable so that the automatic connection is made only at certain times of the day or weekends, etc., so as to confine picture transmission to periods of low network usage or periods of cheaper network access, etc. Also, it is currently preferred that the user be queried to allow the automatic connection though this is obviously not required and the connection can be made completely autonomously. Thus, in the first embodiment above, the inventive camera system automatically sends its pictures to a printer or other device on the LAN for printing or for remotely storing the pictures in the inventive camera system, whenever the inventive camera system is in range of the LAN network connection and connection can be made. In the second embodiment above, the inventive camera system automatically connects to the internet preferably via WIFI, although cellular network, etc. connection is also contemplated, when it has a predetermined number of pictures and can so connect, and will send the pictures to virtually any internet destination without user intervention. For example, the inventive camera system can be instructed to automatically send the pictures to an email account, internet picture hosting site (
Many prior art digital cameras can now record images continuously at 30 frames per second (i.e., take movies) along with sound. Thus, a prior art camera having an internet connection capability as herein taught combined with well known and straightforward editing methods enables inventive on-camera movie composition. According to this aspect of the invention, the inventive camera records a series of images, (e.g., a movie) and then the user downloads an MP3 file (i.e., a sound file) from a network (e.g., internet) source to be associated with the movie taken so that when the movie is played, the MP3 file also plays. Alternatively, the MP3 content is embedded in the movie, either as is, or re-encoded. Additionally, the user may download other movie material or still images via the network connection for insertion in the camera-recorded movie or for the replacement of certain individual camera-taken “frames” in the movie.
Another aspect of the present invention provides that prior art features of the cell phone (
Cell phones being so light and without much inertia are hard to steady and the fact that the user must push a button on something so light makes it even harder to keep steady particularly given the small size of the shutter button on some cell phones. This aspect of the present invention would make picture taking on cell phones simpler and more fool proof.
Another aspect of the invention provides that the prior art voice recognition unit of the cell phone be adapted to recognize at least some email addresses when spoken. Another aspect of this inventive adaptation is to adapt the cell phone voice recognizer to identify the letters of the alphabet along with certain key words, for example, “space”, “underscore”, “question mark”, etc and numbers so that pictures may be named when stored by spelling, for example. This aspect of the invention is contemplated to serve the dual purpose of being usable for text messaging or chat text input on the cell phone in addition to picture labeling.
Additionally, other aspects of the present invention taught for the improved camera system are applicable to the improved cell phone herein disclosed particularly the aspect of the present invention associating multiple different utterances to a single command. The aspect of the invention allowing for automatic connection to a LAN or the internet is also contemplated for use with cell phone cameras. This aspect of the invention ameliorates the prior art storage space limitation which severely hampers the utility of the cell phone camera. Cellular service providers typically charge a fee for internet access or emailing and so an automatic feature to connect to the net or send email for the purposes of transmitting pictures can improve revenue generation for these companies.
The embodiments herein disclosed for the various aspects of the present invention are exemplary and are meant to illustrate the currently preferred embodiments of the various aspects of the invention. The disclosed embodiments are not meant to be exhaustive or to limit application of the various aspects of the invention to those embodiments so disclosed. There are other embodiments of the various aspects of the present invention that are within the scope of the invention. Additionally, not all aspects of the invention need to be practiced together, it is contemplated that subsets of the disclosed aspects of the present invention may be practiced in an embodiment and still be within the scope of the present invention. For instance, an embodiment combining a touch sensitive shutter button with a viewfinder use detector so that focusing is only accomplished when both the shutter button is touched and viewfinder use is detected. Another embodiment contemplated is to use the viewfinder use detector to automatically turn the EVF on and the LCD display off when viewfinder use is detected instead of the prior art method of pressing a button which typically toggles which of the two is on and which is off. Still another contemplated embodiment applies the touch gesture recognition typically used with the computer-like touchpad technology to a touch sensitive display, such as the touch sensitive LCD of the camera and other devices herein disclosed that utilize an LCD display. Combining various aspects of the invention herein disclosed, such as voice recognition, touch input, gaze tracking, etc for camera control provides much more natural and human interfacing to the camera system for the control of camera menus, camera features, camera options, camera settings, commanding picture taking, enabling flash, etc.
Another alternative embodiment for the disclosed aspects of the present invention is to use the disclosed touchpad with or without supporting input gesture recognition with cellular phones, other cellular devices, Apple Computer Inc.'s Ipod MP3 player, etc., with the computer-like touchpad replacing some or all of the buttons on devices. Touch input with or without touch-based gesture recognition would be an ideal replacement for Apple's Ipod click wheel interface. The touch pad would preferably be made round (alternatively, it would be rectangular with the housing of the device providing a round aperture to the touchpad device) and simply by skimming a finger over or touching the touchpad at the appropriate places on the touch pad, the Ipod would be commanded to perform the proper function such as raising or lowering the volume, fast forwarding, slowing down replay, changing the selection, etc. This type of round touchpad is also contemplated for use on cell phones to simulate the old-fashioned rotary dial action or placement of digits. The user touches the pad at the appropriate place around the circumference of the touch pad to select digits and enter them and then makes a dialing motion (stroking a thumb or finger around the circumference of the touchpad) to begin the call or touches the center of the pad to begin the call. Round pattern dialing is easily done with the thumb when the phone is being single-handedly held. With reference to
Returning to the Ipod example, because of the large memory currently available with the Ipod, it is also contemplated that a digital camera, similar to cell phone's camera be embedded in the Ipod and coupled to the Ipod controller and this inventive Ipod be operable for taking pictures and storing the pictures in the Ipod's memory. Another alternate embodiment for the disclosed aspects of the present invention is to use the viewfinder use detector, gaze tracker, and/or the disclosed internet connectability, herein described, in a video camera. As with the camera system disclosure, the viewfinder use detector can be used to enable or disable various aspects of the video camera system, such as turning the LCD display off when viewfinder use is detected. Gaze tracking is contemplated to be used to assist the video camera focusing or used to guide and select menu items. Internet connectability is contemplated be used to download sound or image files for editing or for uploading video recorded for editing or remote storage of the video images.
It is further contemplated that certain aspects of the presently disclosed invention have application beyond those disclosed herein. For instance, various voice recognition aspects of the present invention, such as use of a plurality of microphones or multiple different vocal utterances associated with the same command or delayed implementation of a command which corresponds to a recognized vocalization, are contemplated to have utility for many of the devices herein referenced and are anticipated to be incorporated therein. As an example, automatically connecting to the internet when a set of predetermined rules or conditions (such as time, date, status of equipment, etc) is met would be useful for the download/upload of information from/to the internet, like music, video, etc. for processing, storage, transmission to another party, etc. Those skilled in the art will undoubtedly see various combinations and alternative embodiments of the various aspects of the present invention herein taught but which will still be within the spirit and scope of the invention.
This application is a continuation of pending application Ser. No. 17/383,397, filed Jul. 22, 2021, which is a continuation of application Ser. No. 16/663,742 (now issued U.S. Pat. No. 11,153,472), filed Oct. 25, 2019, which is a continuation of application Ser. No. 14/614,515, filed Feb. 5, 2015 (abandoned), which claims the benefit of application Ser. No. 14/539,687 (now issued U.S. Pat. No. 9,485,403), filed Nov. 12, 2014, which claims the benefit of application Ser. No. 14/495,976 (now issued U.S. Pat. No. 8,917,982), filed Sep. 25, 2014, which claims the benefit of application Ser. No. 14/453,511 (now issued U.S. Pat. No. 8,923,692), filed Aug. 6, 2014, which claims the benefit of application Ser. No. 14/315,544 (now issued U.S. Pat. No. 8,897,634), filed Jun. 26, 2014, which claims the benefit of application Ser. No. 14/203,129 (now issued U.S. Pat. No. 8,818,182), filed Mar. 10, 2014, which claims the benefit of application Ser. No. 13/717,681 (now issued U.S. Pat. No. 8,831,418), filed Dec. 17, 2012, which claims the benefit of application Ser. No. 13/087,650 (now issued U.S. Pat. No. 8,467,672), filed Apr. 15, 2011, which claims the benefit of application Ser. No. 12/710,066 (now issued U.S. Pat. No. 7,933,508), filed Feb. 22, 2010, which claims the benefit of application Ser. No. 11/163,391 (now issued U.S. Pat. No. 7,697,827), filed Oct. 17, 2005, all of which are herein incorporated by reference. Reference is also made to related application Ser. No. 14/199,855 (now issued U.S. Pat. No. 8,824,879), filed Mar. 6, 2014, related application Ser. No. 14/950,338 (now issued U.S. Pat. No. 10,257,401), filed Nov. 24, 2015, related application Ser. No. 14/950,370 (now issued U.S. Pat. No. 10,063,761), filed Nov. 24, 2015, and related application Ser. No. 15/188,736 (now issued U.S. Pat. No. 9,936,116) filed Jun. 21, 2016.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11163391 | Oct 2005 | US |
| Child | 12710066 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17383397 | Jul 2021 | US |
| Child | 18384997 | US | |
| Parent | 16663742 | Oct 2019 | US |
| Child | 17383397 | US | |
| Parent | 14614515 | Feb 2015 | US |
| Child | 16663742 | US | |
| Parent | 14539687 | Nov 2014 | US |
| Child | 14614515 | US | |
| Parent | 14495976 | Sep 2014 | US |
| Child | 14539687 | US | |
| Parent | 14453511 | Aug 2014 | US |
| Child | 14495976 | US | |
| Parent | 14315544 | Jun 2014 | US |
| Child | 14453511 | US | |
| Parent | 14203129 | Mar 2014 | US |
| Child | 14315544 | US | |
| Parent | 13717681 | Dec 2012 | US |
| Child | 14203129 | US | |
| Parent | 13087650 | Apr 2011 | US |
| Child | 13717681 | US | |
| Parent | 12710066 | Feb 2010 | US |
| Child | 13087650 | US |
