Embodiments of the disclosure are defined by the claims below, not this summary. A high-level overview of various aspects of the disclosure are provided here for that reason, to provide an overview of the disclosure, and to introduce a selection of concepts that are further described in the Detailed Description section below. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in isolation to determine the scope of the claimed subject matter.
In brief and at a high level, this disclosure describes, among other things, systems and methods for augmenting a digital image using a template overlay kit. Exemplary embodiments of the template overlay kit include a template portfolio comprising a template page having a design template, wherein the design template is configured to receive a user marking on the surface of the template page. In embodiments, an overlay kit application for execution by a computing device, such as a personal computer or handheld device, interacts with the design template and user marking by capturing an image via a camera associated with the computing device. The overlay kit application may then generate a custom digital overlay that incorporates the user marking received by the design template. Additionally, the overlay kit application may apply the custom digital overlay to one or more facial features detected in a user-selectable image.
Illustrative embodiments of the disclosure are described in detail below with reference to the attached drawing figures, and wherein:
The subject matter of embodiments of the disclosure is described with specificity herein to meet statutory requirements. But the description itself is not intended to necessarily limit the scope of claims. Rather, the claimed subject matter might be embodied in other ways to include different steps or combinations of steps similar to the ones described in this document, in conjunction with other present or future technologies. Terms should not be interpreted as implying any particular order among or between various steps herein disclosed unless and except when the order of individual steps is explicitly described.
In brief and at a high level, this disclosure describes, among other things, systems and methods for augmenting an image using a template overlay kit. Exemplary embodiments of the kit include a template portfolio comprising a template page having a first design template, wherein the first design template is configured to receive a user marking on the surface of a template page. In embodiments, an overlay kit application for execution by a computing device, such as a personal computer or handheld device, interacts with the design template and the received user markings using a camera associated with the computing device. The overlay kit application receives a captured image of the design template and the user's marking. Upon receiving the captured image of the design template and the user's marking, the overlay kit application may render a custom digital overlay that incorporates the user's marking received by the design template. The overlay kit application may then apply the custom digital overlay to one or more facial features detected in a user-selectable image.
In one embodiment, a template portfolio comprises a first template page having a first design template configured to receive a user marking. The template portfolio may further comprise an overlay kit application that, when executed by a computing device, receives a captured image comprising the first design template and the user marking. The overlay kit application generates a custom digital overlay in a display of the computing device. In embodiments, the custom digital overlay may be generated from a digital overlay template that incorporates the user marking received by the first design template. The overlay kit application may augment one or more facial features detected in a user-selectable image with the custom digital overlay incorporating the user marking.
In a further embodiment, a method is provided for augmenting an digital image using an overlay kit application that is executed on a computing device. The method comprises receiving, at a computing device, an indication to capture an image of a first design template. The first design template is associated with a first template page of a template portfolio and the first template page is configured to receive a user marking within the first design template. The method may further comprise identifying, via the computing device, the user marking received within the first design template. In addition, the method comprises generating, via the processor, a custom digital overlay by incorporating the user marking into a digital overlay template and augmenting a user-selectable image displayed on a screen of the computing device with the custom digital overlay incorporating the user marking.
In yet another embodiment, a template overlay kit comprises a template portfolio comprising one or more template pages having a first design template configured to receive a user marking. The template overlay kit further comprises an overlay kit application that, when executed by a computing device, receives an indication to capture an image of the first design template and identifies, in the captured image of the first design template, the user marking received by the first design template. The overlay kit application may generate a custom digital overlay by incorporating the user marking into a digital overlay template. Additionally, the overlay kit application augments, in a graphical user interface of the computing device, a user-selectable image with the custom digital overlay. The user may interact with the application, for example, through a graphical user interface.
In brief and at a high level, this disclosure describes, among other things, referring initially to
Computing device 12 may include hand-held devices, consumer electronics, general-purpose computers, more specialty computing devices, touch-pad computing devices, touch-screen computing devices, and the like. Embodiments of the disclosure may be described in the general context of computer code or machine-useable instructions, including computer-useable or computer-executable instructions such as program modules, being executed by the computing device 12. The computing device 12 typically includes a variety of computer-readable media, which may be any available media that is accessible by the computing device 12, such as computer storage media that stores computer-executable instructions to be executed by the computing device 12. In one embodiment, computing device 12 is a touch-screen device having a camera, such as an iPod Touch®, iPad®, and/or an iPhone® device provided by Apple® Inc.
As shown in the exemplary embodiment included in
The memory 14 includes computer-storage media in the form of volatile and/or nonvolatile memory that may be removable, non-removable, or a combination thereof. The computing device 12 also includes one or more processors 16 that read data from various entities such as the memory 14 or the I/O components 22. The presentation component(s) 18 present data indications to a user or other device, such as a display device, speaker, printing component, vibrating component, and the like. The I/O ports 20 allow the computing device 12 to be logically coupled to other devices, while the I/O components 22 may include a microphone, joystick, game pad, satellite dish, scanner, printer, wireless device, and a controller, such as a stylus, a keyboard and a mouse, a natural user interface (NUI), and the like.
Turning next to
In embodiments, the overlay template portfolio 50 includes any number of pre-printed template pages, such as template pages 15 and 38 in
The surface of a template page and, thus, a design template, may be configured to receive user markings within the design template. For instance, a user may color in the pre-printed design templates 30 and 35 on template pages 15 and 38 using any number of the design markers 40. As such, the writing surface of template pages 15 and 38 may be any surface adapted to receive markings from the design marker 40. In one embodiment, the template pages 15 and 38 are paper surfaces for accepting markings from one or more of the design markers 40, which may include markers, pens, pencils, and/or any other design marker 40 configured to create a marking on a paper writing surface. In another embodiment, the template pages 15 and 38 are dry-erase surfaces for accepting dry-erasable markings from one or more of the design markers 40 configured to interact with a dry-erase surface, which includes dry-erase markers, dray-erase crayons, and/or any other design marker 40 configured to create a marking on a paper writing surface.
Accordingly, design marker 40 may be any type of marking device for marking on a surface, such as a washable marker, a permanent marker, a dry-erase marker, a crayon, a pencil, a colored pencil, a pen, and the like. Further, design marker 40 associated with template page 15 may be marking devices that are different from the design marker 40 associated with template page 38, such as design markers 40 including both a set of washable markers and a set of colored pencils.
As mentioned, the design template may be configured to receive the user marking on the surface of the template page associated with the design template. The design template may comprise a two-dimensional line drawing that provides an outline for coloring in by a user. Additionally, the design template may depict one or more overlay features. The term overlay feature generally refers to objects or features that may be used to augment a user-selectable image. In embodiments, the overlay feature augments facial features within the user-selectable image. As such, overlay features may comprise facial features, such as eyes, nose, mouth, and the like, or accessories, such as a hat, earrings, sunglasses, and the like. As shown in
In one embodiment, the design template may comprise a plurality of overlay features. As shown in
With reference to
In embodiments, the overlay template portfolio 50 may comprise a series of template pages to further facilitate unique combinations of overlay features through the interchanging the template pages. As shown in
Referring now to
In embodiments, the overlay kit application may receive an image of the design template that was captured by a camera associated with the computing device 310. The computing device 310 may capture and store the image based on receiving a user indication to capture the image of the design template. The overlay kit application may then receive or load the captured image captured by the camera, for instance, via the processor of the computing device 310.
Further, the overlay kit application may identify the design template in the captured image. For instance, in one embodiment, the overlay kit application identifies the design template through a machine-readable label, such as a barcode or other identifiable features, located on the template page. When the computing device receives a captured image of the unique combination of design templates, it can identify one or more machine-readable labels associated with each design template within the captured image. As shown in
Upon identifying the design template in the captured image, the overlay kit application may load the digital overlay template associated with the design template. The digital overlay template may be a digitally rendered model based on the two dimensional outline of the design template. As such, the digital overlay template may have similar visual features as that of the design template. It should be appreciated that the digital overlay template may be a two-dimensional or a three-dimensional digital model.
As shown in
Turning now to
As mentioned, the overlay kit application may incorporate the user's markings into the digital overlay template to produce a rendered digital overlay. In embodiments, the overlay kit application renders the digital reproduction of the user's markings with the digital design template to generate the custom digital overlay 410. As shown in
In some embodiments, the overlay kit application allows for one or more rendered digital overlay to be combined so as to generate a custom digital overlay. Generally, this allows a user to mix and match the rendered digital overlay to create a custom digital overlay. As such, the overlay kit application may cause for display one or more rendered digital overlay features. In some embodiments, the overlay kit application can receive input from a user indicating a unique combination of rendered digital overlay features (lizard lips, cat nose, crazy eyes, etc.). For example, the overlay kit application may render a scale nose digital overlay feature and cat nose digital overlay feature. The overlay kit application may then cause these rendered overlay features to be presented on a display and allow a user to select between them. The overlay kit application can receive an indication from the user through an input on the computing device (such as a touch on a touchscreen) and, based on the received indication, combine the selected overlay feature with other rendered digital overlay features. Accordingly, the overlay kit application allows a user to manipulate and generate custom digital overlays.
In another embodiment, the overlay kit application may enhance the custom digital overlay by supplementing the user's markings. For example, the overlay kit application may analyze the design template and identify portions that do not include user's markings. In other words, the overlay kit application identifies portions of the design template that were left uncolored or blank by the user (e.g., blank portion 415). The overlay kit application may then supplement the user's markings to create a consistent or cohesive custom digital overlay. As illustrated in
With continued reference to
The overlay kit application may receive the user-selectable image and analyze the image to identify the user's facial features contained therein. For instance, the overlay kit application may identify the eyes, nose, lips, and the like, of a user's portrait in the user-selectable image. As known in the art, the user's facial features may be identified and tracked using facial feature detection and/or tracking algorithms, as discussed below with reference to
Turning now to
In some embodiments, the overlay feature may be animated. With continued reference to
Turning now to
At step 620, the overlay kit application may analyze the captured image of the overlay design template. In addition to analyzing the captured image to identify the design template (as discussed above), the overlay kit application may identify the user marking received within the design template. This may be achieved, for instance, by an image recognition component within the overlay kit application. In one embodiment, the image recognition component can identify user markings (e.g., colors, shades, shapes, patterns) that were received by the design template on the template page.
At step 630, the overlay kit application may generate the custom digital overlay by incorporating the user marking into the digital overlay template. In embodiments, an overlay generator can determine a digital replica of the user marking and incorporate the digital replica into the digital design template. For example, the overlay generator may analyze the color profile of the user marking and create a digital replica that is consistent the user's marking color profile. The digital replica may then be applied to the digital design template. In this way, the overlay kit application may incorporate all of the user's markings (e.g., color, shading, shapes, and patterns) into the digital design template. Once the user's markings are incorporated into the digital design template, the overlay generator can generate a custom digital overlay. In embodiments, the overlay generator can then store the custom digital overlay in computer-storage media and render the custom digital overlay for display on the computing device screen 56.
At step 640, the overlay kit application may augment one or more facial features detected in the user-selectable image. In embodiments, the overlay kit application may receive the user-selectable image. The user-selectable image may be a photograph or a video stream that the user selects through interacting with the graphical user interface. The user-selectable image may be provided to the overlay kit application through components associated with the computing device. For instance, in one embodiment, the user-selectable image is a live video stream that is being captured through the camera associated with the computing device. The overlay kit application may then receive the live video stream from via the processor 16 of user computing device 10.
Further, the overlay kit application may analyze the user-selectable image to identify and track facial features. For instance, the overlay kit application may employ facial detection and tracking algorithms that are known in the art to detect facial features depicted in the user-selectable image. In one embodiment, the overlay kit application detects facial features by identifying landmark features using geometric-based facial recognition algorithms. In yet another embodiment, the overlay kit application detects facial features by identifying landmark features using photometric-based facial recognition algorithms. As such, the overlay kit application may identify the relative position, size, and/or shape of the identified facial features and augment the features by placing the overlay features of the custom digital overlay over and/or proximate to the identified facial feature. Any and all aspects, and any variation thereof, are contemplated as being within aspects herein.
Many different arrangements of the various components depicted, as well as components not shown, are possible without departing from the scope of the claims below. Embodiments of the technology have been described with the intent to be illustrative rather than restrictive. Alternative embodiments will become apparent to readers of this disclosure after and because of reading it. Alternative means of implementing the aforementioned can be completed without departing from the scope of the claims below. Certain features and subcombinations are of utility and may be employed without reference to other features and subcombinations and are contemplated within the scope of the claims.
This application is a non-provisional application that claims priority to U.S. Provisional Application No. 62/554,192, entitled “CUSTOM DIGITAL OVERLAY KIT FOR AUGMENTING A DIGITAL IMAGE,” filed on Sep. 5, 2017, which is incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
62554192 | Sep 2017 | US |