Real-time automatic facial feature replacement

Abstract

A method for modifying selected regions of a target image based on selected regions of a source image. In one embodiment, facial features are detected in a video image from a webcam. One or more of those facial features are selected and superimposed on the target image. Resizing and alpha blending techniques are used to blend the source portions into the target images. For example, this can produce fun effects such as moving the eyes and lips of an image of Mona Lisa.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating the system and user layers of software in an embodiment of a system incorporating the feature replacement features of the present invention.

FIG. 2 is a block diagram of an embodiment of a system incorporating the feature replacement features of the present invention.

FIGS. 3A and 3B are diagrams of a hovering dialog box and drop down menu in one embodiment of the invention.

FIG. 4 is a diagram of an embodiment of a user interface screen for selecting the feature replacement.

FIG. 5 is a screen shot of an embodiment of an instant messenger application incorporating the facial feature replacement feature of the invention.

FIGS. 6A-6D are screen shots illustrating the modification of the eyes and mouth of Mona Lisa according to an embodiment of the invention.

FIG. 7 is a flowchart of an embodiment of the invention.

Claims

1. A method for modifying an image, comprising: receiving a source image of a person's face;detecting at least a first facial feature from said source image;extracting said first facial feature from said source image;applying said first facial feature to a portion of a target image to produce a modified target image; andproviding said modified target image to an application program.

2. The method of claim 1 further comprising: selecting a target image and at least said first facial feature by a user;detecting a target facial feature in said target image corresponding to said first facial feature;replacing said target facial feature with said first facial feature.

3. The method of claim 1 wherein said source image is a video image from a live video feed.

4. The method of claim 1 wherein said target image is a still image.

5. The method of claim 1 wherein said application program is an instant messaging program.

6. The method of claim 1 further comprising: displaying a graphical user interface indicating the availability of said target image upon detection of said source image.

7. The method of claim 1 further comprising: displaying a graphical user interface indicating the availability of said target image upon detection of said application program.

8. The method of claim 1 further comprising: resizing said facial feature to fit within said target image; andalpha blending said facial feature.

9. The method of claim 1 wherein said facial feature is an entire face.

10. The method of claim 1 wherein said facial feature is applied to other than the position of a corresponding facial feature in said target image.

11. An apparatus for modifying an image, comprising: a video input feed including an image of a person's face;a feature detection software module configured to detect a plurality of facial features from said video feed;a feature replacement software module configured to receive an indication of detected facial features from said feature detection software and enable selection of at least a first one of said facial features, selection of a target image to which to apply said first facial feature and application of said first facial feature to a target image to produce a modified video feed; anda modified video feed output directed to an application program.

12. The apparatus of claim 11 wherein said video input feed is a live video feed.

13. The apparatus of claim 11 wherein said feature replacement software module modifies less than 20 percent of said video input feed.

14. The apparatus of claim 11 further comprising a quick assistant for accessing said feature replacement software module.

15. The apparatus of claim 14 wherein said quick assistant is configured to hover near said application program using said video feed.

16. The apparatus of claim 11 further comprising: a resizing module for resizing said facial feature to fit within said target image; andan alpha blending module for alpha blending said facial feature.

17. An apparatus for modifying a video image, comprising: a live video input feed including an image of a person's face;a feature detection software module configured to detect a plurality of facial features from said video feed;a feature replacement software module configured to receive an indication of detected facial features from said feature detection software and enable selection of at least a first one of said facial features, selection of a modification for said first facial feature and application of said modification to a target image to produce a modified video feed;said feature replacement software module including resizing and alpha blending modules;wherein said feature replacement software module modifies less than 20 percent of said target image;a quick assistant for accessing said feature replacement software, said quick assistant being configured to hover near an application program using said video feed; anda modified video feed output directed to said application program.

18. An system for modifying an image, comprising: a video camera providing a video input feed including an image of a person's face; anda computer including a feature detection software module configured to detect a plurality of facial features from said video feed;a feature replacement software module configured to receive an indication of detected facial features from said feature detection software and enable selection of at least a first one of said facial features, selection of a target image to which to apply said first facial feature and application of said first facial feature to a target image to produce a modified video feed; anda modified video feed output directed to an application program.