Patent Grant
12033296
The present disclosure relates generally to computer user interfaces, and more specifically to techniques for creating and editing avatars.
Avatars are used to represent the users of electronic devices. The avatars can represent the appearance of a user or can represent an idealized or completely fictional representation of the user. Avatars can then be associated with a user so that the appearance of the avatar to others triggers an association or link with the user. Avatars can be created and edited for such use, including use in multimedia communications.
Some techniques for creating and editing avatars using electronic devices, however, are generally cumbersome and inefficient. For example, some existing techniques use a complex and time-consuming user interface, which may include multiple key presses or keystrokes. Existing techniques require more time than necessary, wasting user time and device energy. This latter consideration is particularly important in battery-operated devices.
Accordingly, the present technique provides electronic devices with faster, more efficient methods and interfaces for creating and editing avatars. Such methods and interfaces optionally complement or replace other methods for creating avatars. Such methods and interfaces reduce the cognitive burden on a user and produce a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges.
A method is described. The method is performed at an electronic device having a display apparatus and one or more input devices. The method comprises: displaying, via the display apparatus, an avatar navigation user interface, the avatar navigation user interface including an avatar; while the avatar navigation user interface is displayed, detecting a gesture, via the one or more input devices directed to the avatar navigation user interface; and in response to detecting the gesture: in accordance with a determination that the gesture is in a first direction, displaying an avatar of a first type in the avatar navigation user interface; and in accordance with a determination that the gesture is in a second direction opposite the first direction, displaying an avatar of a second type different from the first type in the avatar navigation user interface.
A non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus and one or more input devices. The one or more programs including instructions for: displaying, via the display apparatus, an avatar navigation user interface, the avatar navigation user interface including an avatar; while the avatar navigation user interface is displayed, detecting a gesture, via the one or more input devices directed to the avatar navigation user interface; and in response to detecting the gesture: in accordance with a determination that the gesture is in a first direction, displaying an avatar of a first type in the avatar navigation user interface; and in accordance with a determination that the gesture is in a second direction opposite the first direction, displaying an avatar of a second type different from the first type in the avatar navigation user interface.
A transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus and one or more input devices. The one or more programs including instructions for: displaying, via the display apparatus, an avatar navigation user interface, the avatar navigation user interface including an avatar; while the avatar navigation user interface is displayed, detecting a gesture, via the one or more input devices directed to the avatar navigation user interface; and in response to detecting the gesture: in accordance with a determination that the gesture is in a first direction, displaying an avatar of a first type in the avatar navigation user interface; and in accordance with a determination that the gesture is in a second direction opposite the first direction, displaying an avatar of a second type different from the first type in the avatar navigation user interface.
An electronic device is described. The electronic device comprises: a display apparatus; one or more input devices; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the display apparatus, an avatar navigation user interface, the avatar navigation user interface including an avatar; while the avatar navigation user interface is displayed, detecting a gesture, via the one or more input devices directed to the avatar navigation user interface; and in response to detecting the gesture: in accordance with a determination that the gesture is in a first direction, displaying an avatar of a first type in the avatar navigation user interface; and in accordance with a determination that the gesture is in a second direction opposite the first direction, displaying an avatar of a second type different from the first type in the avatar navigation user interface.
An electronic device is described. The electronic device comprises: a display apparatus; one or more input devices; means for displaying, via the display apparatus, an avatar navigation user interface, the avatar navigation user interface including an avatar; means, while the avatar navigation user interface is displayed, for detecting a gesture, via the one or more input devices directed to the avatar navigation user interface; and means, responsive to detecting the gesture, for: in accordance with a determination that the gesture is in a first direction, displaying an avatar of a first type in the avatar navigation user interface; and in accordance with a determination that the gesture is in a second direction opposite the first direction, displaying an avatar of a second type different from the first type in the avatar navigation user interface.
A method is described. The method is performed at an electronic device having a display apparatus. The method comprises: displaying, via the display apparatus, an avatar editing user interface that includes concurrently displaying: an avatar having a plurality of avatar features; a first option selection region for a respective avatar feature including a first set of feature options corresponding to a set of candidate values for a first characteristic of the respective avatar feature; and a second option selection region for the respective avatar feature including a second set of feature options corresponding to a set of candidate values for a second characteristic of the respective avatar feature, wherein the second characteristic of the respective avatar feature is different from the first characteristic of the respective avatar feature; and in response to detecting a selection of one of the feature options in the first set of feature options, changing an appearance of at least one of the second set of feature options from a first appearance to a second appearance.
A non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus, the one or more programs including instructions for: displaying, via the display apparatus, an avatar editing user interface that includes concurrently displaying: an avatar having a plurality of avatar features; a first option selection region for a respective avatar feature including a first set of feature options corresponding to a set of candidate values for a first characteristic of the respective avatar feature; and a second option selection region for the respective avatar feature including a second set of feature options corresponding to a set of candidate values for a second characteristic of the respective avatar feature, wherein the second characteristic of the respective avatar feature is different from the first characteristic of the respective avatar feature; and in response to detecting a selection of one of the feature options in the first set of feature options, changing an appearance of at least one of the second set of feature options from a first appearance to a second appearance.
A transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus, the one or more programs including instructions for: displaying, via the display apparatus, an avatar editing user interface that includes concurrently displaying: an avatar having a plurality of avatar features; a first option selection region for a respective avatar feature including a first set of feature options corresponding to a set of candidate values for a first characteristic of the respective avatar feature; and a second option selection region for the respective avatar feature including a second set of feature options corresponding to a set of candidate values for a second characteristic of the respective avatar feature, wherein the second characteristic of the respective avatar feature is different from the first characteristic of the respective avatar feature; and in response to detecting a selection of one of the feature options in the first set of feature options, changing an appearance of at least one of the second set of feature options from a first appearance to a second appearance.
An electronic device is described. The electronic device comprises: a display apparatus; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the display apparatus, an avatar editing user interface that includes concurrently displaying: an avatar having a plurality of avatar features; a first option selection region for a respective avatar feature including a first set of feature options corresponding to a set of candidate values for a first characteristic of the respective avatar feature; and a second option selection region for the respective avatar feature including a second set of feature options corresponding to a set of candidate values for a second characteristic of the respective avatar feature, wherein the second characteristic of the respective avatar feature is different from the first characteristic of the respective avatar feature; and in response to detecting a selection of one of the feature options in the first set of feature options, changing an appearance of at least one of the second set of feature options from a first appearance to a second appearance.
An electronic device is described. The electronic device comprises: a display apparatus; means for displaying, via the display apparatus, an avatar editing user interface that includes concurrently displaying: an avatar having a plurality of avatar features; a first option selection region for a respective avatar feature including a first set of feature options corresponding to a set of candidate values for a first characteristic of the respective avatar feature; and a second option selection region for the respective avatar feature including a second set of feature options corresponding to a set of candidate values for a second characteristic of the respective avatar feature, wherein the second characteristic of the respective avatar feature is different from the first characteristic of the respective avatar feature; and means, responsive to detecting a selection of one of the feature options in the first set of feature options, for changing an appearance of at least one of the second set of feature options from a first appearance to a second appearance.
A method is described. The method is performed at an electronic device having a display apparatus. The method comprises: displaying, via the display apparatus: a user interface object including a respective feature having a first set of one or more colors; and a plurality of color options for the respective feature; detecting a selection of a color option of the plurality of color options that corresponds to a second color; in response to detecting the selection: changing the color of the respective feature to the color option; and displaying a first color adjustment control for the color option that corresponds to a second set of one or more colors; while the respective feature of the user interface object has the second set of one or more colors, detecting an input that corresponds to the first color adjustment control; and in response to detecting the input that corresponds to the first color adjustment control, modifying the color of the respective feature from the second set of one or more colors to a modified version of the second set of one or more colors based on the second color.
A non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus, the one or more programs including instructions for: displaying, via the display apparatus: a user interface object including a respective feature having a first set of one or more colors; and a plurality of color options for the respective feature; detecting a selection of a color option of the plurality of color options that corresponds to a second color; in response to detecting the selection: changing the color of the respective feature to the color option; and displaying a first color adjustment control for the color option that corresponds to a second set of one or more colors; while the respective feature of the user interface object has the second set of one or more colors, detecting an input that corresponds to the first color adjustment control; and in response to detecting the input that corresponds to the first color adjustment control, modifying the color of the respective feature from the second set of one or more colors to a modified version of the second set of one or more colors based on the second color.
A transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus, the one or more programs including instructions for: displaying, via the display apparatus: a user interface object including a respective feature having a first set of one or more colors; and a plurality of color options for the respective feature; detecting a selection of a color option of the plurality of color options that corresponds to a second color; in response to detecting the selection: changing the color of the respective feature to the color option; and displaying a first color adjustment control for the color option that corresponds to a second set of one or more colors; while the respective feature of the user interface object has the second set of one or more colors, detecting an input that corresponds to the first color adjustment control; and in response to detecting the input that corresponds to the first color adjustment control, modifying the color of the respective feature from the second set of one or more colors to a modified version of the second set of one or more colors based on the second color.
An electronic device is described. The electronic device comprises: a display apparatus; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the display apparatus: a user interface object including a respective feature having a first set of one or more colors; and a plurality of color options for the respective feature; detecting a selection of a color option of the plurality of color options that corresponds to a second color; in response to detecting the selection: changing the color of the respective feature to the color option; and displaying a first color adjustment control for the color option that corresponds to a second set of one or more colors; while the respective feature of the user interface object has the second set of one or more colors, detecting an input that corresponds to the first color adjustment control; and in response to detecting the input that corresponds to the first color adjustment control, modifying the color of the respective feature from the second set of one or more colors to a modified version of the second set of one or more colors based on the second color.
An electronic device is described. The electronic device comprises: a display apparatus; and means for displaying, via the display apparatus: a user interface object including a respective feature having a first set of one or more colors; and a plurality of color options for the respective feature; means for detecting a selection of a color option of the plurality of color options that corresponds to a second color; in response to detecting the selection: means for changing the color of the respective feature to the color option; and means for displaying a first color adjustment control for the color option that corresponds to a second set of one or more colors; means for while the respective feature of the user interface object has the second set of one or more colors, detecting an input that corresponds to the first color adjustment control; and means for in response to detecting the input that corresponds to the first color adjustment control, modifying the color of the respective feature from the second set of one or more colors to a modified version of the second set of one or more colors based on the second color.
A method is described. The method is performed at an electronic device having a display apparatus. The method comprises: displaying, via the display apparatus, an avatar editing user interface that includes displaying: an avatar having a plurality of avatar features including a first avatar feature having a first set of one or more colors and a second avatar feature having a set of one or more colors based on the first set of one or more colors and different from the first set of one or more colors; and a plurality of color options corresponding to the first avatar feature; detecting selection of a respective color option of the plurality of color options; and in response to detecting selection of the respective color option of the plurality of color options of the first avatar feature, in accordance with a determination that the respective color option corresponds to a second set of one or more colors, updating an appearance of the avatar, including: changing the first avatar feature to the second set of one or more colors; and changing the second avatar feature to a set of one or more colors based on the second set of one or more colors and different from the second set of one or more colors.
A non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus, the one or more programs including instructions for: displaying, via the display apparatus, an avatar editing user interface that includes displaying: an avatar having a plurality of avatar features including a first avatar feature having a first set of one or more colors and a second avatar feature having a set of one or more colors based on the first set of one or more colors and different from the first set of one or more colors; and a plurality of color options corresponding to the first avatar feature; detecting selection of a respective color option of the plurality of color options; and in response to detecting selection of the respective color option of the plurality of color options of the first avatar feature, in accordance with a determination that the respective color option corresponds to a second set of one or more colors, updating an appearance of the avatar, including: changing the first avatar feature to the second set of one or more colors; and changing the second avatar feature to a set of one or more colors based on the second set of one or more colors and different from the second set of one or more colors.
A transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus, the one or more programs including instructions for: displaying, via the display apparatus, an avatar editing user interface that includes displaying: an avatar having a plurality of avatar features including a first avatar feature having a first set of one or more colors and a second avatar feature having a set of one or more colors based on the first set of one or more colors and different from the first set of one or more colors; and a plurality of color options corresponding to the first avatar feature; detecting selection of a respective color option of the plurality of color options; and in response to detecting selection of the respective color option of the plurality of color options of the first avatar feature, in accordance with a determination that the respective color option corresponds to a second set of one or more colors, updating an appearance of the avatar, including: changing the first avatar feature to the second set of one or more colors; and changing the second avatar feature to a set of one or more colors based on the second set of one or more colors and different from the second set of one or more colors.
An electronic device is described. The electronic device comprises: a display apparatus; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the display apparatus, an avatar editing user interface that includes displaying: an avatar having a plurality of avatar features including a first avatar feature having a first set of one or more colors and a second avatar feature having a set of one or more colors based on the first set of one or more colors and different from the first set of one or more colors; and a plurality of color options corresponding to the first avatar feature; detecting selection of a respective color option of the plurality of color options; and in response to detecting selection of the respective color option of the plurality of color options of the first avatar feature, in accordance with a determination that the respective color option corresponds to a second set of one or more colors, updating an appearance of the avatar, including: changing the first avatar feature to the second set of one or more colors; and changing the second avatar feature to a set of one or more colors based on the second set of one or more colors and different from the second set of one or more colors.
An electronic device is described. The electronic device comprises: a display apparatus; and means for displaying, via the display apparatus, an avatar editing user interface that includes displaying: an avatar having a plurality of avatar features including a first avatar feature having a first set of one or more colors and a second avatar feature having a set of one or more colors based on the first set of one or more colors and different from the first set of one or more colors; and a plurality of color options corresponding to the first avatar feature; means for detecting selection of a respective color option of the plurality of color options; and means for in response to detecting selection of the respective color option of the plurality of color options of the first avatar feature, in accordance with a determination that the respective color option corresponds to a second set of one or more colors, updating an appearance of the avatar, including: means for changing the first avatar feature to the second set of one or more colors; and means for changing the second avatar feature to a set of one or more colors based on the second set of one or more colors and different from the second set of one or more colors.
A method is described. The method is performed at an electronic device having a display apparatus. The method comprises: displaying, via the display apparatus, an avatar editing user interface that includes displaying: an avatar having a plurality of avatar features including avatar hair having a selected avatar hairstyle; and a plurality of avatar accessory options; detecting selection of a respective accessory option; and in response to detecting the selection of the respective accessory option of the plurality of avatar accessory options, changing an appearance of the avatar to include a representation of the respective accessory option, including, in accordance with a determination that the respective accessory option is a first accessory option: displaying the representation of the first accessory option positioned on the avatar; and modifying a geometry of a first portion of the avatar hair based on the position of the representation of the first accessory option on the avatar, while maintaining the selected avatar hairstyle.
A non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus, the one or more programs including instructions for: an avatar having a plurality of avatar features including avatar hair having a selected avatar hairstyle; and a plurality of avatar accessory options; detecting selection of a respective accessory option; and in response to detecting the selection of the respective accessory option of the plurality of avatar accessory options, changing an appearance of the avatar to include a representation of the respective accessory option, including, in accordance with a determination that the respective accessory option is a first accessory option: displaying the representation of the first accessory option positioned on the avatar; and modifying a geometry of a first portion of the avatar hair based on the position of the representation of the first accessory option on the avatar, while maintaining the selected avatar hairstyle.
A transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus, the one or more programs including instructions for: an avatar having a plurality of avatar features including avatar hair having a selected avatar hairstyle; and a plurality of avatar accessory options; detecting selection of a respective accessory option; and in response to detecting the selection of the respective accessory option of the plurality of avatar accessory options, changing an appearance of the avatar to include a representation of the respective accessory option, including, in accordance with a determination that the respective accessory option is a first accessory option: displaying the representation of the first accessory option positioned on the avatar; and modifying a geometry of a first portion of the avatar hair based on the position of the representation of the first accessory option on the avatar, while maintaining the selected avatar hairstyle.
An electronic device is described. The electronic device comprises: a display apparatus; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: an avatar having a plurality of avatar features including avatar hair having a selected avatar hairstyle; and a plurality of avatar accessory options; detecting selection of a respective accessory option; and in response to detecting the selection of the respective accessory option of the plurality of avatar accessory options, changing an appearance of the avatar to include a representation of the respective accessory option, including, in accordance with a determination that the respective accessory option is a first accessory option: displaying the representation of the first accessory option positioned on the avatar; and modifying a geometry of a first portion of the avatar hair based on the position of the representation of the first accessory option on the avatar, while maintaining the selected avatar hairstyle.
An electronic device is described. The electronic device comprises: a display apparatus; and means for displaying, via the display apparatus, an avatar editing user interface that includes displaying: an avatar having a plurality of avatar features including avatar hair having a selected avatar hairstyle; and a plurality of avatar accessory options; means for detecting selection of a respective accessory option; and means for in response to detecting the selection of the respective accessory option of the plurality of avatar accessory options, changing an appearance of the avatar to include a representation of the respective accessory option, including, in accordance with a determination that the respective accessory option is a first accessory option: means for displaying the representation of the first accessory option positioned on the avatar; and means for modifying a geometry of a first portion of the avatar hair based on the position of the representation of the first accessory option on the avatar, while maintaining the selected avatar hairstyle.
A method is described. The method is performed at an electronic device having one or more cameras and a display apparatus. The method comprises: displaying, via the display apparatus, a virtual avatar, having a plurality of avatar features, that changes appearance in response to detected changes in pose of a face in a field of view of the one or more cameras; while the face is detected in the field of view of the one or more cameras, the face including a plurality of detected facial features including a first facial feature other than a tongue of the user, detecting movement of the first facial feature; and in response to detecting movement of the first facial feature: in accordance with a determination that the tongue of the user meets respective criteria wherein the respective criteria include a requirement that the tongue of the user is visible in order for the respective criteria to be met, displaying an avatar tongue and modifying a position of the avatar tongue based on the movement of the first facial feature; and in accordance with a determination that the tongue of the user does not meet the respective criteria, forgoing displaying the avatar tongue.
A non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus and one or more cameras, the one or more programs including instructions for: displaying, via the display apparatus, a virtual avatar, having a plurality of avatar features, that changes appearance in response to detected changes in pose of a face in a field of view of the one or more cameras; while the face is detected in the field of view of the one or more cameras, the face including a plurality of detected facial features including a first facial feature other than a tongue of the user, detecting movement of the first facial feature; and in response to detecting movement of the first facial feature: in accordance with a determination that the tongue of the user meets respective criteria wherein the respective criteria include a requirement that the tongue of the user is visible in order for the respective criteria to be met, displaying an avatar tongue and modifying a position of the avatar tongue based on the movement of the first facial feature; and in accordance with a determination that the tongue of the user does not meet the respective criteria, forgoing displaying the avatar tongue.
A transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of an electronic device with a display apparatus and one or more cameras, the one or more programs including instructions for: displaying, via the display apparatus, a virtual avatar, having a plurality of avatar features, that changes appearance in response to detected changes in pose of a face in a field of view of the one or more cameras; while the face is detected in the field of view of the one or more cameras, the face including a plurality of detected facial features including a first facial feature other than a tongue of the user, detecting movement of the first facial feature; and in response to detecting movement of the first facial feature: in accordance with a determination that the tongue of the user meets respective criteria wherein the respective criteria include a requirement that the tongue of the user is visible in order for the respective criteria to be met, displaying an avatar tongue and modifying a position of the avatar tongue based on the movement of the first facial feature; and in accordance with a determination that the tongue of the user does not meet the respective criteria, forgoing displaying the avatar tongue.
An electronic device is described. The electronic device comprises: a display apparatus; one or more cameras; one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: displaying, via the display apparatus, a virtual avatar, having a plurality of avatar features, that changes appearance in response to detected changes in pose of a face in a field of view of the one or more cameras; while the face is detected in the field of view of the one or more cameras, the face including a plurality of detected facial features including a first facial feature other than a tongue of the user, detecting movement of the first facial feature; and in response to detecting movement of the first facial feature: in accordance with a determination that the tongue of the user meets respective criteria wherein the respective criteria include a requirement that the tongue of the user is visible in order for the respective criteria to be met, displaying an avatar tongue and modifying a position of the avatar tongue based on the movement of the first facial feature; and in accordance with a determination that the tongue of the user does not meet the respective criteria, forgoing displaying the avatar tongue.
An electronic device is described. The electronic device comprises: a display apparatus; one or more cameras; and means for displaying, via the display apparatus, a virtual avatar, having a plurality of avatar features, that changes appearance in response to detected changes in pose of a face in a field of view of the one or more cameras; means for while the face is detected in the field of view of the one or more cameras, the face including a plurality of detected facial features including a first facial feature other than a tongue of the user, detecting movement of the first facial feature; and means for in response to detecting movement of the first facial feature: means for in accordance with a determination that the tongue of the user meets respective criteria wherein the respective criteria include a requirement that the tongue of the user is visible in order for the respective criteria to be met, displaying an avatar tongue and modifying a position of the avatar tongue based on the movement of the first facial feature; and means for in accordance with a determination that the tongue of the user does not meet the respective criteria, forgoing displaying the avatar tongue.
Executable instructions for performing these functions are, optionally, included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are, optionally, included in a transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.
Thus, devices are provided with faster, more efficient methods and interfaces for creating and editing avatars, thereby increasing the effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may complement or replace other methods for creating and editing avatars.
For a better understanding of the various described embodiments, reference should be made to the Description of Embodiments below, in conjunction with the following drawings in which like reference numerals refer to corresponding parts throughout the figures.
The following description sets forth exemplary methods, parameters, and the like. It should be recognized, however, that such description is not intended as a limitation on the scope of the present disclosure but is instead provided as a description of exemplary embodiments.
There is a need for electronic devices that provide efficient methods and interfaces for creating and editing avatars. For example, while programs already exist for creating and editing avatars, these programs are inefficient and difficult to use compared to the techniques below, which allow a user to create and edit avatars to be as realistic or unrealistic as desired. Such techniques can reduce the cognitive burden on a user who creates and edits an avatar, thereby enhancing productivity. Further, such techniques can reduce processor and battery power otherwise wasted on redundant user inputs.
Below,
Although the following description uses terms “first,” “second,” etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch could be termed a second touch, and, similarly, a second touch could be termed a first touch, without departing from the scope of the various described embodiments. The first touch and the second touch are both touches, but they are not the same touch.
The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The term “if” is, optionally, construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” is, optionally, construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.
Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communications device, such as a mobile telephone, that also contains other functions, such as PDA and/or music player functions. Exemplary embodiments of portable multifunction devices include, without limitation, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and/or touchpads), are, optionally, used. It should also be understood that, in some embodiments, the device is not a portable communications device, but is a desktop computer with a touch-sensitive surface (e.g., a touch screen display and/or a touchpad).
In the discussion that follows, an electronic device that includes a display and a touch-sensitive surface is described. It should be understood, however, that the electronic device optionally includes one or more other physical user-interface devices, such as a physical keyboard, a mouse, and/or a joystick.
The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk authoring application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an e-mail application, an instant messaging application, a workout support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and/or a digital video player application.
The various applications that are executed on the device optionally use at least one common physical user-interface device, such as the touch-sensitive surface. One or more functions of the touch-sensitive surface as well as corresponding information displayed on the device are, optionally, adjusted and/or varied from one application to the next and/or within a respective application. In this way, a common physical architecture (such as the touch-sensitive surface) of the device optionally supports the variety of applications with user interfaces that are intuitive and transparent to the user.
Attention is now directed toward embodiments of portable devices with touch-sensitive displays.
As used in the specification and claims, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a substitute (proxy) for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four distinct values and more typically includes hundreds of distinct values (e.g., at least 256). Intensity of a contact is, optionally, determined (or measured) using various approaches and various sensors or combinations of sensors. For example, one or more force sensors underneath or adjacent to the touch-sensitive surface are, optionally, used to measure force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., a weighted average) to determine an estimated force of a contact. Similarly, a pressure-sensitive tip of a stylus is, optionally, used to determine a pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and/or changes thereto, the capacitance of the touch-sensitive surface proximate to the contact and/or changes thereto, and/or the resistance of the touch-sensitive surface proximate to the contact and/or changes thereto are, optionally, used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the substitute measurements for contact force or pressure are used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurements). In some implementations, the substitute measurements for contact force or pressure are converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of a contact as an attribute of a user input allows for user access to additional device functionality that may otherwise not be accessible by the user on a reduced-size device with limited real estate for displaying affordances (e.g., on a touch-sensitive display) and/or receiving user input (e.g., via a touch-sensitive display, a touch-sensitive surface, or a physical/mechanical control such as a knob or a button).
As used in the specification and claims, the term “tactile output” refers to physical displacement of a device relative to a previous position of the device, physical displacement of a component (e.g., a touch-sensitive surface) of a device relative to another component (e.g., housing) of the device, or displacement of the component relative to a center of mass of the device that will be detected by a user with the user's sense of touch. For example, in situations where the device or the component of the device is in contact with a surface of a user that is sensitive to touch (e.g., a finger, palm, or other part of a user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in physical characteristics of the device or the component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is, optionally, interpreted by the user as a “down click” or “up click” of a physical actuator button. In some cases, a user will feel a tactile sensation such as an “down click” or “up click” even when there is no movement of a physical actuator button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movements. As another example, movement of the touch-sensitive surface is, optionally, interpreted or sensed by the user as “roughness” of the touch-sensitive surface, even when there is no change in smoothness of the touch-sensitive surface. While such interpretations of touch by a user will be subject to the individualized sensory perceptions of the user, there are many sensory perceptions of touch that are common to a large majority of users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., an “up click,” a “down click,” “roughness”), unless otherwise stated, the generated tactile output corresponds to physical displacement of the device or a component thereof that will generate the described sensory perception for a typical (or average) user.
It should be appreciated that device 100 is only one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. The various components shown in
Memory 102 optionally includes high-speed random access memory and optionally also includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.
Peripherals interface 118 can be used to couple input and output peripherals of the device to CPU 120 and memory 102. The one or more processors 120 run or execute various software programs and/or sets of instructions stored in memory 102 to perform various functions for device 100 and to process data. In some embodiments, peripherals interface 118, CPU 120, and memory controller 122 are, optionally, implemented on a single chip, such as chip 104. In some other embodiments, they are, optionally, implemented on separate chips.
RF (radio frequency) circuitry 108 receives and sends RF signals, also called electromagnetic signals. RF circuitry 108 converts electrical signals to/from electromagnetic signals and communicates with communications networks and other communications devices via the electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and so forth. RF circuitry 108 optionally communicates with networks, such as the Internet, also referred to as the World Wide Web (WWW), an intranet and/or a wireless network, such as a cellular telephone network, a wireless local area network (LAN) and/or a metropolitan area network (MAN), and other devices by wireless communication. The RF circuitry 108 optionally includes well-known circuitry for detecting near field communication (NFC) fields, such as by a short-range communication radio. The wireless communication optionally uses any of a plurality of communications standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), long term evolution (LTE), near field communication (NFC), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and/or IEEE 802.11ac), voice over Internet Protocol (VoIP), Wi-MAX, a protocol for e-mail (e.g., Internet message access protocol (IMAP) and/or post office protocol (POP)), instant messaging (e.g., extensible messaging and presence protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and/or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between a user and device 100. Audio circuitry 110 receives audio data from peripherals interface 118, converts the audio data to an electrical signal, and transmits the electrical signal to speaker 111. Speaker 111 converts the electrical signal to human-audible sound waves. Audio circuitry 110 also receives electrical signals converted by microphone 113 from sound waves. Audio circuitry 110 converts the electrical signal to audio data and transmits the audio data to peripherals interface 118 for processing. Audio data is, optionally, retrieved from and/or transmitted to memory 102 and/or RF circuitry 108 by peripherals interface 118. In some embodiments, audio circuitry 110 also includes a headset jack (e.g., 212,
I/O subsystem 106 couples input/output peripherals on device 100, such as touch screen 112 and other input control devices 116, to peripherals interface 118. I/O subsystem 106 optionally includes display controller 156, optical sensor controller 158, depth camera controller 169, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive/send electrical signals from/to other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and so forth. In some alternate embodiments, input controller(s) 160 are, optionally, coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more buttons (e.g., 208,
A quick press of the push button optionally disengages a lock of touch screen 112 or optionally begins a process that uses gestures on the touch screen to unlock the device, as described in U.S. patent application Ser. No. 11/322,549, “Unlocking a Device by Performing Gestures on an Unlock Image,” filed Dec. 23, 2005, U.S. Pat. No. 7,657,849, which is hereby incorporated by reference in its entirety. A longer press of the push button (e.g., 206) optionally turns power to device 100 on or off. The functionality of one or more of the buttons are, optionally, user-customizable. Touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.
Touch-sensitive display 112 provides an input interface and an output interface between the device and a user. Display controller 156 receives and/or sends electrical signals from/to touch screen 112. Touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively termed “graphics”). In some embodiments, some or all of the visual output optionally corresponds to user-interface objects.
Touch screen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from the user based on haptic and/or tactile contact. Touch screen 112 and display controller 156 (along with any associated modules and/or sets of instructions in memory 102) detect contact (and any movement or breaking of the contact) on touch screen 112 and convert the detected contact into interaction with user-interface objects (e.g., one or more soft keys, icons, web pages, or images) that are displayed on touch screen 112. In an exemplary embodiment, a point of contact between touch screen 112 and the user corresponds to a finger of the user.
Touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. Touch screen 112 and display controller 156 optionally detect contact and any movement or breaking thereof using any of a plurality of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with touch screen 112. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, California.
A touch-sensitive display in some embodiments of touch screen 112 is, optionally, analogous to the multi-touch sensitive touchpads described in the following U.S. Pat. No. 6,323,846 (Westerman et al.), U.S. Pat. No. 6,570,557 (Westerman et al.), and/or U.S. Pat. No. 6,677,932 (Westerman), and/or U.S. Patent Publication 2002/0015024A1, each of which is hereby incorporated by reference in its entirety. However, touch screen 112 displays visual output from device 100, whereas touch-sensitive touchpads do not provide visual output.
A touch-sensitive display in some embodiments of touch screen 112 is described in the following applications: (1) U.S. patent application Ser. No. 11/381,313, “Multipoint Touch Surface Controller,” filed May 2, 2006; (2) U.S. patent application Ser. No. 10/840,862, “Multipoint Touchscreen,” filed May 6, 2004; (3) U.S. patent application Ser. No. 10/903,964, “Gestures For Touch Sensitive Input Devices,” filed Jul. 30, 2004; (4) U.S. patent application Ser. No. 11/048,264, “Gestures For Touch Sensitive Input Devices,” filed Jan. 31, 2005; (5) U.S. patent application Ser. No. 11/038,590, “Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices,” filed Jan. 18, 2005; (6) U.S. patent application Ser. No. 11/228,758, “Virtual Input Device Placement On A Touch Screen User Interface,” filed Sep. 16, 2005; (7) U.S. patent application Ser. No. 11/228,700, “Operation Of A Computer With A Touch Screen Interface,” filed Sep. 16, 2005; (8) U.S. patent application Ser. No. 11/228,737, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard,” filed Sep. 16, 2005; and (9) U.S. patent application Ser. No. 11/367,749, “Multi-Functional Hand-Held Device,” filed Mar. 3, 2006. All of these applications are incorporated by reference herein in their entirety.
Touch screen 112 optionally has a video resolution in excess of 100 dpi. In some embodiments, the touch screen has a video resolution of approximately 160 dpi. The user optionally makes contact with touch screen 112 using any suitable object or appendage, such as a stylus, a finger, and so forth. In some embodiments, the user interface is designed to work primarily with finger-based contacts and gestures, which can be less precise than stylus-based input due to the larger area of contact of a finger on the touch screen. In some embodiments, the device translates the rough finger-based input into a precise pointer/cursor position or command for performing the actions desired by the user.
In some embodiments, in addition to the touch screen, device 100 optionally includes a touchpad for activating or deactivating particular functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output. The touchpad is, optionally, a touch-sensitive surface that is separate from touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.
Device 100 also includes power system 162 for powering the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)) and any other components associated with the generation, management and distribution of power in portable devices.
Device 100 optionally also includes one or more optical sensors 164.
Device 100 optionally also includes one or more depth camera sensors 175.
In some embodiments, a depth map (e.g., depth map image) contains information (e.g., values) that relates to the distance of objects in a scene from a viewpoint (e.g., a camera, an optical sensor, a depth camera sensor). In one embodiment of a depth map, each depth pixel defines the position in the viewpoint's Z-axis where its corresponding two-dimensional pixel is located. In some embodiments, a depth map is composed of pixels wherein each pixel is defined by a value (e.g., 0-255). For example, the “0” value represents pixels that are located at the most distant place in a “three dimensional” scene and the “255” value represents pixels that are located closest to a viewpoint (e.g., a camera, an optical sensor, a depth camera sensor) in the “three dimensional” scene. In other embodiments, a depth map represents the distance between an object in a scene and the plane of the viewpoint. In some embodiments, the depth map includes information about the relative depth of various features of an object of interest in view of the depth camera (e.g., the relative depth of eyes, nose, mouth, ears of a user's face). In some embodiments, the depth map includes information that enables the device to determine contours of the object of interest in a z direction.
Device 100 optionally also includes one or more contact intensity sensors 165.
Device 100 optionally also includes one or more proximity sensors 166.
Device 100 optionally also includes one or more tactile output generators 167.
Device 100 optionally also includes one or more accelerometers 168.
In some embodiments, the software components stored in memory 102 include operating system 126, communication module (or set of instructions) 128, contact/motion module (or set of instructions) 130, graphics module (or set of instructions) 132, text input module (or set of instructions) 134, Global Positioning System (GPS) module (or set of instructions) 135, and applications (or sets of instructions) 136. Furthermore, in some embodiments, memory 102 (
Operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and/or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.
Communication module 128 facilitates communication with other devices over one or more external ports 124 and also includes various software components for handling data received by RF circuitry 108 and/or external port 124. External port 124 (e.g., Universal Serial Bus (USB), FIREWIRE, etc.) is adapted for coupling directly to other devices or indirectly over a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, or similar to and/or compatible with, the 30-pin connector used on iPod® (trademark of Apple Inc.) devices.
Contact/motion module 130 optionally detects contact with touch screen 112 (in conjunction with display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). Contact/motion module 130 includes various software components for performing various operations related to detection of contact, such as determining if contact has occurred (e.g., detecting a finger-down event), determining an intensity of the contact (e.g., the force or pressure of the contact or a substitute for the force or pressure of the contact), determining if there is movement of the contact and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger-dragging events), and determining if the contact has ceased (e.g., detecting a finger-up event or a break in contact). Contact/motion module 130 receives contact data from the touch-sensitive surface. Determining movement of the point of contact, which is represented by a series of contact data, optionally includes determining speed (magnitude), velocity (magnitude and direction), and/or an acceleration (a change in magnitude and/or direction) of the point of contact. These operations are, optionally, applied to single contacts (e.g., one finger contacts) or to multiple simultaneous contacts (e.g., “multitouch”/multiple finger contacts). In some embodiments, contact/motion module 130 and display controller 156 detect contact on a touchpad.
In some embodiments, contact/motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., to determine whether a user has “clicked” on an icon). In some embodiments, at least a subset of the intensity thresholds are determined in accordance with software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of particular physical actuators and can be adjusted without changing the physical hardware of device 100). For example, a mouse “click” threshold of a trackpad or touch screen display can be set to any of a large range of predefined threshold values without changing the trackpad or touch screen display hardware. Additionally, in some implementations, a user of the device is provided with software settings for adjusting one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and/or by adjusting a plurality of intensity thresholds at once with a system-level click “intensity” parameter).
Contact/motion module 130 optionally detects a gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and/or intensities of detected contacts). Thus, a gesture is, optionally, detected by detecting a particular contact pattern. For example, detecting a finger tap gesture includes detecting a finger-down event followed by detecting a finger-up (liftoff) event at the same position (or substantially the same position) as the finger-down event (e.g., at the position of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger-down event followed by detecting one or more finger-dragging events, and subsequently followed by detecting a finger-up (liftoff) event.
Graphics module 132 includes various known software components for rendering and displaying graphics on touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual property) of graphics that are displayed. As used herein, the term “graphics” includes any object that can be displayed to a user, including, without limitation, text, web pages, icons (such as user-interface objects including soft keys), digital images, videos, animations, and the like.
In some embodiments, graphics module 132 stores data representing graphics to be used. Each graphic is, optionally, assigned a corresponding code. Graphics module 132 receives, from applications etc., one or more codes specifying graphics to be displayed along with, if necessary, coordinate data and other graphic property data, and then generates screen image data to output to display controller 156.
Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator(s) 167 to produce tactile outputs at one or more locations on device 100 in response to user interactions with device 100.
Text input module 134, which is, optionally, a component of graphics module 132, provides soft keyboards for entering text in various applications (e.g., contacts 137, e-mail client module 140, IM 141, browser 147, and any other application that needs text input).
GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to telephone module 138 for use in location-based dialing; to camera module 143 as picture/video metadata; and to applications that provide location-based services such as weather widgets, local yellow page widgets, and map/navigation widgets).
Applications 136 optionally include the following modules (or sets of instructions), or a subset or superset thereof:
Examples of other applications 136 that are, optionally, stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.
In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, contacts module 137 are, optionally, used to manage an address book or contact list (e.g., stored in application internal state 192 of contacts module 137 in memory 102 or memory 370), including: adding name(s) to the address book; deleting name(s) from the address book; associating telephone number(s), e-mail address(es), physical address(es) or other information with a name; associating an image with a name; categorizing and sorting names; providing telephone numbers or e-mail addresses to initiate and/or facilitate communications by telephone 138, video conference module 139, e-mail 140, or IM 141; and so forth.
In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, telephone module 138 are optionally, used to enter a sequence of characters corresponding to a telephone number, access one or more telephone numbers in contacts module 137, modify a telephone number that has been entered, dial a respective telephone number, conduct a conversation, and disconnect or hang up when the conversation is completed. As noted above, the wireless communication optionally uses any of a plurality of communications standards, protocols, and technologies.
In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact/motion module 130, graphics module 132, text input module 134, contacts module 137, and telephone module 138, video conference module 139 includes executable instructions to initiate, conduct, and terminate a video conference between a user and one or more other participants in accordance with user instructions.
In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, e-mail client module 140 includes executable instructions to create, send, receive, and manage e-mail in response to user instructions. In conjunction with image management module 144, e-mail client module 140 makes it very easy to create and send e-mails with still or video images taken with camera module 143.
In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, the instant messaging module 141 includes executable instructions to enter a sequence of characters corresponding to an instant message, to modify previously entered characters, to transmit a respective instant message (for example, using a Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for telephony-based instant messages or using XMPP, SIMPLE, or IMPS for Internet-based instant messages), to receive instant messages, and to view received instant messages. In some embodiments, transmitted and/or received instant messages optionally include graphics, photos, audio files, video files and/or other attachments as are supported in an MMS and/or an Enhanced Messaging Service (EMS). As used herein, “instant messaging” refers to both telephony-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).
In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, workout support module 142 includes executable instructions to create workouts (e.g., with time, distance, and/or calorie burning goals); communicate with workout sensors (sports devices); receive workout sensor data; calibrate sensors used to monitor a workout; select and play music for a workout; and display, store, and transmit workout data.
In conjunction with touch screen 112, display controller 156, optical sensor(s) 164, optical sensor controller 158, contact/motion module 130, graphics module 132, and image management module 144, camera module 143 includes executable instructions to capture still images or video (including a video stream) and store them into memory 102, modify characteristics of a still image or video, or delete a still image or video from memory 102.
In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions to arrange, modify (e.g., edit), or otherwise manipulate, label, delete, present (e.g., in a digital slide show or album), and store still and/or video images.
In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions to browse the Internet in accordance with user instructions, including searching, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.
In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, e-mail client module 140, and browser module 147, calendar module 148 includes executable instructions to create, display, modify, and store calendars and data associated with calendars (e.g., calendar entries, to-do lists, etc.) in accordance with user instructions.
In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, and browser module 147, widget modules 149 are mini-applications that are, optionally, downloaded and used by a user (e.g., weather widget 149-1, stocks widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or created by the user (e.g., user-created widget 149-6). In some embodiments, a widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, a widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! Widgets).
In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, and browser module 147, the widget creator module 150 are, optionally, used by a user to create widgets (e.g., turning a user-specified portion of a web page into a widget).
In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, search module 151 includes executable instructions to search for text, music, sound, image, video, and/or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.
In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow the user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and executable instructions to display, present, or otherwise play back videos (e.g., on touch screen 112 or on an external, connected display via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).
In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, and text input module 134, notes module 153 includes executable instructions to create and manage notes, to-do lists, and the like in accordance with user instructions.
In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact/motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 are, optionally, used to receive, display, modify, and store maps and data associated with maps (e.g., driving directions, data on stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.
In conjunction with touch screen 112, display controller 156, contact/motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, e-mail client module 140, and browser module 147, online video module 155 includes instructions that allow the user to access, browse, receive (e.g., by streaming and/or download), play back (e.g., on the touch screen or on an external, connected display via external port 124), send an e-mail with a link to a particular online video, and otherwise manage online videos in one or more file formats, such as H.264. In some embodiments, instant messaging module 141, rather than e-mail client module 140, is used to send a link to a particular online video. Additional description of the online video application can be found in U.S. Provisional Patent Application No. 60/936,562, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed Jun. 20, 2007, and U.S. patent application Ser. No. 11/968,067, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed Dec. 31, 2007, the contents of which are hereby incorporated by reference in their entirety.
Each of the above-identified modules and applications corresponds to a set of executable instructions for performing one or more functions described above and the methods described in this application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and thus various subsets of these modules are, optionally, combined or otherwise rearranged in various embodiments. For example, video player module is, optionally, combined with music player module into a single module (e.g., video and music player module 152,
In some embodiments, device 100 is a device where operation of a predefined set of functions on the device is performed exclusively through a touch screen and/or a touchpad. By using a touch screen and/or a touchpad as the primary input control device for operation of device 100, the number of physical input control devices (such as push buttons, dials, and the like) on device 100 is, optionally, reduced.
The predefined set of functions that are performed exclusively through a touch screen and/or a touchpad optionally include navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates device 100 to a main, home, or root menu from any user interface that is displayed on device 100. In such embodiments, a “menu button” is implemented using a touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touchpad.
Event sorter 170 receives event information and determines the application 136-1 and application view 191 of application 136-1 to which to deliver the event information. Event sorter 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates the current application view(s) displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device/global internal state 157 is used by event sorter 170 to determine which application(s) is (are) currently active, and application internal state 192 is used by event sorter 170 to determine application views 191 to which to deliver event information.
In some embodiments, application internal state 192 includes additional information, such as one or more of: resume information to be used when application 136-1 resumes execution, user interface state information that indicates information being displayed or that is ready for display by application 136-1, a state queue for enabling the user to go back to a prior state or view of application 136-1, and a redo/undo queue of previous actions taken by the user.
Event monitor 171 receives event information from peripherals interface 118. Event information includes information about a sub-event (e.g., a user touch on touch-sensitive display 112, as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I/O subsystem 106 or a sensor, such as proximity sensor 166, accelerometer(s) 168, and/or microphone 113 (through audio circuitry 110). Information that peripherals interface 118 receives from I/O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.
In some embodiments, event monitor 171 sends requests to the peripherals interface 118 at predetermined intervals. In response, peripherals interface 118 transmits event information. In other embodiments, peripherals interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and/or for more than a predetermined duration).
In some embodiments, event sorter 170 also includes a hit view determination module 172 and/or an active event recognizer determination module 173.
Hit view determination module 172 provides software procedures for determining where a sub-event has taken place within one or more views when touch-sensitive display 112 displays more than one view. Views are made up of controls and other elements that a user can see on the display.
Another aspect of the user interface associated with an application is a set of views, sometimes herein called application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of a respective application) in which a touch is detected optionally correspond to programmatic levels within a programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is, optionally, called the hit view, and the set of events that are recognized as proper inputs are, optionally, determined based, at least in part, on the hit view of the initial touch that begins a touch-based gesture.
Hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies a hit view as the lowest view in the hierarchy which should handle the sub-event. In most circumstances, the hit view is the lowest level view in which an initiating sub-event occurs (e.g., the first sub-event in the sequence of sub-events that form an event or potential event). Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.
Active event recognizer determination module 173 determines which view or views within a view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of a sub-event are actively involved views, and therefore determines that all actively involved views should receive a particular sequence of sub-events. In other embodiments, even if touch sub-events were entirely confined to the area associated with one particular view, views higher in the hierarchy would still remain as actively involved views.
Event dispatcher module 174 dispatches the event information to an event recognizer (e.g., event recognizer 180). In embodiments including active event recognizer determination module 173, event dispatcher module 174 delivers the event information to an event recognizer determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores in an event queue the event information, which is retrieved by a respective event receiver 182.
In some embodiments, operating system 126 includes event sorter 170. Alternatively, application 136-1 includes event sorter 170. In yet other embodiments, event sorter 170 is a stand-alone module, or a part of another module stored in memory 102, such as contact/motion module 130.
In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events that occur within a respective view of the application's user interface. Each application view 191 of the application 136-1 includes one or more event recognizers 180. Typically, a respective application view 191 includes a plurality of event recognizers 180. In other embodiments, one or more of event recognizers 180 are part of a separate module, such as a user interface kit or a higher level object from which application 136-1 inherits methods and other properties. In some embodiments, a respective event handler 190 includes one or more of: data updater 176, object updater 177, GUI updater 178, and/or event data 179 received from event sorter 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update the application internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Also, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in a respective application view 191.
A respective event recognizer 180 receives event information (e.g., event data 179) from event sorter 170 and identifies an event from the event information. Event recognizer 180 includes event receiver 182 and event comparator 184. In some embodiments, event recognizer 180 also includes at least a subset of: metadata 183, and event delivery instructions 188 (which optionally include sub-event delivery instructions).
Event receiver 182 receives event information from event sorter 170. The event information includes information about a sub-event, for example, a touch or a touch movement. Depending on the sub-event, the event information also includes additional information, such as location of the sub-event. When the sub-event concerns motion of a touch, the event information optionally also includes speed and direction of the sub-event. In some embodiments, events include rotation of the device from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation (also called device attitude) of the device.
Event comparator 184 compares the event information to predefined event or sub-event definitions and, based on the comparison, determines an event or sub-event, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definitions 186. Event definitions 186 contain definitions of events (e.g., predefined sequences of sub-events), for example, event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in an event (187) include, for example, touch begin, touch end, touch movement, touch cancellation, and multiple touching. In one example, the definition for event 1 (187-1) is a double tap on a displayed object. The double tap, for example, comprises a first touch (touch begin) on the displayed object for a predetermined phase, a first liftoff (touch end) for a predetermined phase, a second touch (touch begin) on the displayed object for a predetermined phase, and a second liftoff (touch end) for a predetermined phase. In another example, the definition for event 2 (187-2) is a dragging on a displayed object. The dragging, for example, comprises a touch (or contact) on the displayed object for a predetermined phase, a movement of the touch across touch-sensitive display 112, and liftoff of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.
In some embodiments, event definition 187 includes a definition of an event for a respective user-interface object. In some embodiments, event comparator 184 performs a hit test to determine which user-interface object is associated with a sub-event. For example, in an application view in which three user-interface objects are displayed on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user-interface objects is associated with the touch (sub-event). If each displayed object is associated with a respective event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with the sub-event and the object triggering the hit test.
In some embodiments, the definition for a respective event (187) also includes delayed actions that delay delivery of the event information until after it has been determined whether the sequence of sub-events does or does not correspond to the event recognizer's event type.
When a respective event recognizer 180 determines that the series of sub-events do not match any of the events in event definitions 186, the respective event recognizer 180 enters an event impossible, event failed, or event ended state, after which it disregards subsequent sub-events of the touch-based gesture. In this situation, other event recognizers, if any, that remain active for the hit view continue to track and process sub-events of an ongoing touch-based gesture.
In some embodiments, a respective event recognizer 180 includes metadata 183 with configurable properties, flags, and/or lists that indicate how the event delivery system should perform sub-event delivery to actively involved event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and/or lists that indicate how event recognizers interact, or are enabled to interact, with one another. In some embodiments, metadata 183 includes configurable properties, flags, and/or lists that indicate whether sub-events are delivered to varying levels in the view or programmatic hierarchy.
In some embodiments, a respective event recognizer 180 activates event handler 190 associated with an event when one or more particular sub-events of an event are recognized. In some embodiments, a respective event recognizer 180 delivers event information associated with the event to event handler 190. Activating an event handler 190 is distinct from sending (and deferred sending) sub-events to a respective hit view. In some embodiments, event recognizer 180 throws a flag associated with the recognized event, and event handler 190 associated with the flag catches the flag and performs a predefined process.
In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver event information to event handlers associated with the series of sub-events or to actively involved views. Event handlers associated with the series of sub-events or with actively involved views receive the event information and perform a predetermined process.
In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates the telephone number used in contacts module 137, or stores a video file used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates a new user-interface object or updates the position of a user-interface object. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends it to graphics module 132 for display on a touch-sensitive display.
In some embodiments, event handler(s) 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of a respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
It shall be understood that the foregoing discussion regarding event handling of user touches on touch-sensitive displays also applies to other forms of user inputs to operate multifunction devices 100 with input devices, not all of which are initiated on touch screens. For example, mouse movement and mouse button presses, optionally coordinated with single or multiple keyboard presses or holds; contact movements such as taps, drags, scrolls, etc. on touchpads; pen stylus inputs; movement of the device; oral instructions; detected eye movements; biometric inputs; and/or any combination thereof are optionally utilized as inputs corresponding to sub-events which define an event to be recognized.
Device 100 optionally also include one or more physical buttons, such as “home” or menu button 204. As described previously, menu button 204 is, optionally, used to navigate to any application 136 in a set of applications that are, optionally, executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touch screen 112.
In some embodiments, device 100 includes touch screen 112, menu button 204, push button 206 for powering the device on/off and locking the device, volume adjustment button(s) 208, subscriber identity module (SIM) card slot 210, headset jack 212, and docking/charging external port 124. Push button 206 is, optionally, used to turn the power on/off on the device by depressing the button and holding the button in the depressed state for a predefined time interval; to lock the device by depressing the button and releasing the button before the predefined time interval has elapsed; and/or to unlock the device or initiate an unlock process. In an alternative embodiment, device 100 also accepts verbal input for activation or deactivation of some functions through microphone 113. Device 100 also, optionally, includes one or more contact intensity sensors 165 for detecting intensity of contacts on touch screen 112 and/or one or more tactile output generators 167 for generating tactile outputs for a user of device 100.
Each of the above-identified elements in
Attention is now directed towards embodiments of user interfaces that are, optionally, implemented on, for example, portable multifunction device 100.
It should be noted that the icon labels illustrated in
Although some of the examples that follow will be given with reference to inputs on touch screen display 112 (where the touch-sensitive surface and the display are combined), in some embodiments, the device detects inputs on a touch-sensitive surface that is separate from the display, as shown in
Additionally, while the following examples are given primarily with reference to finger inputs (e.g., finger contacts, finger tap gestures, finger swipe gestures), it should be understood that, in some embodiments, one or more of the finger inputs are replaced with input from another input device (e.g., a mouse-based input or stylus input). For example, a swipe gesture is, optionally, replaced with a mouse click (e.g., instead of a contact) followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is, optionally, replaced with a mouse click while the cursor is located over the location of the tap gesture (e.g., instead of detection of the contact followed by ceasing to detect the contact). Similarly, when multiple user inputs are simultaneously detected, it should be understood that multiple computer mice are, optionally, used simultaneously, or a mouse and finger contacts are, optionally, used simultaneously.
Exemplary techniques for detecting and processing touch intensity are found, for example, in related applications: International Patent Application Serial No. PCT/US2013/040061, titled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” filed May 8, 2013, published as WIPO Publication No. WO/2013/169849, and International Patent Application Serial No. PCT/US2013/069483, titled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” filed Nov. 11, 2013, published as WIPO Publication No. WO/2014/105276, each of which is hereby incorporated by reference in their entirety.
In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, can permit attachment of device 500 with, for example, hats, eyewear, earrings, necklaces, shirts, jackets, bracelets, watch straps, chains, trousers, belts, shoes, purses, backpacks, and so forth. These attachment mechanisms permit device 500 to be worn by a user.
Input mechanism 508 is, optionally, a microphone, in some examples. Personal electronic device 500 optionally includes various sensors, such as GPS sensor 532, accelerometer 534, directional sensor 540 (e.g., compass), gyroscope 536, motion sensor 538, and/or a combination thereof, all of which can be operatively connected to I/O section 514.
Memory 518 of personal electronic device 500 can include one or more non-transitory computer-readable storage mediums, for storing computer-executable instructions, which, when executed by one or more computer processors 516, for example, can cause the computer processors to perform the techniques described below, including processes 700, 900, 1000, 1100, 1200, and 1400 (
As used here, the term “affordance” refers to a user-interactive graphical user interface object that is, optionally, displayed on the display screen of devices 100, 300, and/or 500 (
As used herein, the term “focus selector” refers to an input element that indicates a current part of a user interface with which a user is interacting. In some implementations that include a cursor or other location marker, the cursor acts as a “focus selector” so that when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 in
As used in the specification and claims, the term “characteristic intensity” of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is, optionally, based on a predefined number of intensity samples, or a set of intensity samples collected during a predetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) relative to a predefined event (e.g., after detecting the contact, prior to detecting liftoff of the contact, before or after detecting a start of movement of the contact, prior to detecting an end of the contact, before or after detecting an increase in intensity of the contact, and/or before or after detecting a decrease in intensity of the contact). A characteristic intensity of a contact is, optionally, based on one or more of: a maximum value of the intensities of the contact, a mean value of the intensities of the contact, an average value of the intensities of the contact, a top 10 percentile value of the intensities of the contact, a value at the half maximum of the intensities of the contact, a value at the 90 percent maximum of the intensities of the contact, or the like. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is an average of the intensity of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an operation has been performed by a user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, a contact with a characteristic intensity that does not exceed the first threshold results in a first operation, a contact with a characteristic intensity that exceeds the first intensity threshold and does not exceed the second intensity threshold results in a second operation, and a contact with a characteristic intensity that exceeds the second threshold results in a third operation. In some embodiments, a comparison between the characteristic intensity and one or more thresholds is used to determine whether or not to perform one or more operations (e.g., whether to perform a respective operation or forgo performing the respective operation), rather than being used to determine whether to perform a first operation or a second operation.
In some embodiments, a portion of a gesture is identified for purposes of determining a characteristic intensity. For example, a touch-sensitive surface optionally receives a continuous swipe contact transitioning from a start location and reaching an end location, at which point the intensity of the contact increases. In this example, the characteristic intensity of the contact at the end location is, optionally, based on only a portion of the continuous swipe contact, and not the entire swipe contact (e.g., only the portion of the swipe contact at the end location). In some embodiments, a smoothing algorithm is, optionally, applied to the intensities of the swipe contact prior to determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of: an unweighted sliding-average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and/or an exponential smoothing algorithm. In some circumstances, these smoothing algorithms eliminate narrow spikes or dips in the intensities of the swipe contact for purposes of determining a characteristic intensity.
The intensity of a contact on the touch-sensitive surface is, optionally, characterized relative to one or more intensity thresholds, such as a contact-detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and/or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform operations typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform operations that are different from operations typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, when a contact is detected with a characteristic intensity below the light press intensity threshold (e.g., and above a nominal contact-detection intensity threshold below which the contact is no longer detected), the device will move a focus selector in accordance with movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally, unless otherwise stated, these intensity thresholds are consistent between different sets of user interface figures.
An increase of characteristic intensity of the contact from an intensity below the light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a “light press” input. An increase of characteristic intensity of the contact from an intensity below the deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a “deep press” input. An increase of characteristic intensity of the contact from an intensity below the contact-detection intensity threshold to an intensity between the contact-detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting the contact on the touch-surface. A decrease of characteristic intensity of the contact from an intensity above the contact-detection intensity threshold to an intensity below the contact-detection intensity threshold is sometimes referred to as detecting liftoff of the contact from the touch-surface. In some embodiments, the contact-detection intensity threshold is zero. In some embodiments, the contact-detection intensity threshold is greater than zero.
In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a respective press input or in response to detecting the respective press input performed with a respective contact (or a plurality of contacts), where the respective press input is detected based at least in part on detecting an increase in intensity of the contact (or plurality of contacts) above a press-input intensity threshold. In some embodiments, the respective operation is performed in response to detecting the increase in intensity of the respective contact above the press-input intensity threshold (e.g., a “down stroke” of the respective press input). In some embodiments, the press input includes an increase in intensity of the respective contact above the press-input intensity threshold and a subsequent decrease in intensity of the contact below the press-input intensity threshold, and the respective operation is performed in response to detecting the subsequent decrease in intensity of the respective contact below the press-input threshold (e.g., an “up stroke” of the respective press input).
In some embodiments, the device employs intensity hysteresis to avoid accidental inputs sometimes termed “jitter,” where the device defines or selects a hysteresis intensity threshold with a predefined relationship to the press-input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press-input intensity threshold or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press-input intensity threshold). Thus, in some embodiments, the press input includes an increase in intensity of the respective contact above the press-input intensity threshold and a subsequent decrease in intensity of the contact below the hysteresis intensity threshold that corresponds to the press-input intensity threshold, and the respective operation is performed in response to detecting the subsequent decrease in intensity of the respective contact below the hysteresis intensity threshold (e.g., an “up stroke” of the respective press input). Similarly, in some embodiments, the press input is detected only when the device detects an increase in intensity of the contact from an intensity at or below the hysteresis intensity threshold to an intensity at or above the press-input intensity threshold and, optionally, a subsequent decrease in intensity of the contact to an intensity at or below the hysteresis intensity, and the respective operation is performed in response to detecting the press input (e.g., the increase in intensity of the contact or the decrease in intensity of the contact, depending on the circumstances).
For ease of explanation, the descriptions of operations performed in response to a press input associated with a press-input intensity threshold or in response to a gesture including the press input are, optionally, triggered in response to detecting either: an increase in intensity of a contact above the press-input intensity threshold, an increase in intensity of a contact from an intensity below the hysteresis intensity threshold to an intensity above the press-input intensity threshold, a decrease in intensity of the contact below the press-input intensity threshold, and/or a decrease in intensity of the contact below the hysteresis intensity threshold corresponding to the press-input intensity threshold. Additionally, in examples where an operation is described as being performed in response to detecting a decrease in intensity of a contact below the press-input intensity threshold, the operation is, optionally, performed in response to detecting a decrease in intensity of the contact below a hysteresis intensity threshold corresponding to, and lower than, the press-input intensity threshold.
Attention is now directed towards embodiments of user interfaces (“UP”) and associated processes that are implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.
In some examples, electronic device 600 includes a depth camera, such as an infrared camera, a thermographic camera, or a combination thereof. In some examples, the device further includes a light-emitting device (e.g., light projector), such an IR flood light, a structured light projector, or a combination thereof. The light-emitting device is, optionally, used to illuminate the subject during capture of the image by a visible light camera and a depth camera (e.g., an IR camera) and the information from the depth camera and the visible light camera are used to determine a depth map of different portions of subject captured by the visible light camera. In some embodiments, a depth map (e.g., depth map image) contains information (e.g., values) that relates to the distance of objects in a scene from a viewpoint (e.g., a camera). In one embodiment of a depth map, each depth pixel defines the position in the viewpoint's Z-axis where its corresponding two-dimensional pixel is located. In some examples, a depth map is composed of pixels wherein each pixel is defined by a value (e.g., 0-255). For example, the “0” value represents pixels that are located at the most distant place in a “three dimensional” scene and the “255” value represents pixels that are located closest to a viewpoint (e.g., camera) in the “three dimensional” scene. In other examples, a depth map represents the distance between an object in a scene and the plane of the viewpoint.) In some embodiments, the depth map includes information about the relative depth of various features of an object of interest in view of the depth camera (e.g., the relative depth of eyes, nose, mouth, ears of a user's face). In some embodiments, the depth map includes information that enables the device to determine contours of the object of interest in a z direction. In some embodiments, the lighting effects described herein are displayed using disparity information from two cameras (e.g., two visual light cameras) for rear facing images and using depth information from a depth camera combined with image data from a visual light camera for front facing images (e.g., selfie images). In some embodiments, the same user interface is used when the two visual light cameras are used to determine the depth information and when the depth camera is used to determine the depth information, providing the user with a consistent experience, even when using dramatically different technologies to determine the information that is used when generating the lighting effects. In some embodiments, while displaying the camera user interface with one of the lighting effects applied, the device detects selection of a camera switching affordance and switches from the front facing cameras (e.g., a depth camera and a visible light camera) to the rear facing cameras (e.g., two visible light cameras that are spaced apart from each other) (or vice versa) while maintaining display of the user interface controls for applying the lighting effect and replacing display of the field of view of the front facing cameras to the field of view of the rear facing cameras (or vice versa).
In
In
In
In
In
In some embodiments, a virtual avatar is a representation of the user that can be graphically depicted (e.g., a graphical representation of the user). In some embodiments, the virtual avatar is non-photorealistic (e.g., is cartoonish). In some embodiments, the virtual avatar includes an avatar face having one or more avatar features (e.g., avatar facial features). In some embodiments, the avatar features correspond (e.g., are mapped) to one or more physical features of a user's face such that detected movement of the user's physical features (e.g., as determined based on a camera such as a depth sensing camera) affects the avatar feature (e.g., affects the feature's graphical representation).
In some examples, a user is able to manipulate characteristics or features of a virtual avatar using a camera sensor (e.g., camera module 143, optical sensor 164) and, optionally, a depth sensor (e.g., depth camera sensor 175). As a user's physical features (such as facial features) and position (such as head position, head rotation, or head tilt) changes, the electronic device detects the changes and modifies the displayed image of the virtual avatar to reflect the changes in the user's physical features and position. In some embodiments, the changes to the user's physical features and position are indicative of various expressions, emotions, context, tone, or other non-verbal communication. In some embodiments, the electronic device modifies the displayed image of the virtual avatar to represent these expressions, emotions, context, tone, or other non-verbal communication.
In some embodiments, customizable avatars are virtual avatars that can be selected and customized by a user, for example, to achieve a desired appearance (e.g., to look like the user). The customizable avatars generally have an appearance of a human character, rather than a non-human character such as an anthropomorphic construct of an animal or other nonhuman object. Additionally, features of the avatar can be created or changed, if desired, using an avatar editing user interface (e.g., such as the avatar editing user interface discussed below with respect to
In some embodiments, non-customizable avatars are virtual avatars that can be selected by a user, but generally are not fundamentally configurable, though their appearance can be altered via face tracking, as described in more detail below. Instead, non-customizable avatars are preconfigured and generally do not have feature components that can be modified by a user. In some embodiments, the non-customizable avatars have an appearance of a non-human character, such as an anthropomorphic construct of an animal or other nonhuman object. Non-customizable avatars cannot be created by a user or modified to achieve a significant change in the physical appearance, physical construct, or modeled behavior of non-customizable avatars.
In
In
Expanded avatar selection interface 634 includes avatar display region 636 and avatar option region 638. Avatar option region 638 includes a set of selectable avatar options 640. A selected avatar option is indicated by border 642, which, in
Avatar display region 636 also includes capture affordance 644, which can be selected to capture an image of avatar 645 to send to a participant in the message conversation (see messaging user interface 603). In some embodiments, the captured image is a still image or a video recording, depending on the type of gesture detected on capture affordance 644. For example, if device 600 detects a tap gesture on capture affordance 644, device 600 captures a still image of avatar 645 at the time the tap gesture occurs. If device 600 detects a tap-and-hold gesture on capture affordance 644, device 600 captures a video recording of avatar 645 during a period of time for which the tap-and-hold gesture persists. In some embodiments, the video recording stops when the finger lifts off of the affordance. In some embodiments, the video recording continues until a subsequent input (e.g., a tap input) is detected at a location corresponding to the affordance. In some embodiments, the captured image (e.g., still image or video recording) of avatar 645 is then inserted into message-compose field 608 to be subsequently sent to a participant in the message conversation. In some embodiments, the captured image of avatar 645 is sent directly to the participant in the message conversation without inserting the captured image in message-compose field 608.
In some embodiments, device 600 tracks movement and positioning (e.g., rotational movement and/or translational movement) of a user's face positioned in a field-of-view of a camera (e.g., camera 602) and, in response, updates an appearance of avatar 645 based on the detected changes in the user's face (often referred to herein as a “face tracking” function). For example, as shown in
In the expanded avatar selection interface illustrated in
In some embodiments, avatar creation prompt 646 appears after a slight delay and displays an animation of various example customizable avatars appearing and, for example, changing facial expressions. For example, in
In some embodiments, device 600 displays new customizable avatars, such as those created after selecting avatar creation icon 648, appearing in avatar option region 638 at an end of the set of avatar options 640, but not between any two non-customizable avatars. For example, all newly created customizable avatars can be displayed at the back end of the set of avatars (e.g., after unicorn avatar option 640b, but not between unicorn avatar option 640b and chicken avatar option 640c) or at the front end of the set of avatars (e.g., next to avatar creation icon 648 or between avatar creation icon 648 and monkey avatar option 640a). Thus, all customizable avatars are displayed grouped together and separate (e.g., segregated or set apart) from non-customizable avatars. This separation of customizable and non-customizable avatars is maintained in the various user interfaces described with respect to
In
In
After a user has customized an avatar in avatar editing user interface 652, the user can select done affordance 652 to save the avatar as a new customized avatar (shown as customizable woman avatar 670 in
In
In
Device 600 groups displayed customized and non-customized avatars by type and arranges the groupings in series such that scrolling in one direction provides access to avatars of one type (e.g., non-customized avatars), and scrolling in the opposite direction, provides access to avatars of a different type (e.g., customizable avatars).
Device 600 displays customizable woman avatar 670 in the center of condensed avatar selection region 668 and at a border region between customizable and non-customizable avatars (e.g., having customizable avatars on one side of woman avatar 670 and non-customizable avatars on the other side of woman avatar 670—see also
As shown in
In
In
As woman avatar 670 is scrolled from the center position in
In
After the monkey appears in the center of the screen in
In some embodiments, as a user scrolls through the listing of avatars 675, as each avatar stops in the center position of the condensed avatar selection interface 668, device 600 modifies the avatar to assume the pose (e.g., position and facial expression) of face 673. Thus, a user can hold a particular facial expression, and device 600 will modify the center avatar to match the facial expression. As the user holds the facial expression and swipes to a different avatar, device 600 displays an animation of the currently selected avatar transitioning from the held facial expression of the user's face to a static, default pose, while the next avatar is scrolled to the center position. Device 600 then displays the next avatar transitioning from its static pose to the user's held facial expression. In some embodiments, device 600 does not begin to modify an avatar positioned in the center of condensed avatar selection interface 668 (either in response to a detected face or as an animated transition from a tracked face to a static pose), until after the avatar pauses in the centered position. Thus, as a user quickly scrolls through the listing of avatars 675 (e.g., scrolling the avatars without stopping on an avatar), device 600 does not animate or modify the avatars, based on a detected face, as they are scrolling.
Because monkey avatar 671 is a non-customizable avatar selected in
In
In
In
In
In
In
In
In
In
In
Avatar editing user interface 694 is similar to the avatar editing user interface described below with reference to
In
In
In
For example, in
When device 600 detects right horizontal gesture 699b (e.g., a swipe or touch-and-drag gesture in a rightward direction on display 601), device 600 displays the embodiment illustrated in
In some embodiments, device 600 can display a scenario in which the originally selected avatar (at the center position of condensed avatar selection interface 668) is a non-customizable avatar and, in response to detecting a horizontal gesture, display condensed avatar selection interface 668 scrolling such that the non-customizable avatar is moved entirely off-screen, and showing only one or more customizable avatars in condensed avatar selection region 668.
When device 600 detects vertical gesture 699c (e.g., a vertical swipe or a vertical touch-and-drag gesture on display 601) in an upward direction, device 600 expands condensed avatar selection interface 668 to show expanded avatar selection interface 634 in
In
In
In
In some embodiments, device 600 changes the avatar displayed in avatar display region 636 in response to a selection of a different avatar option. For example, in
As described below, method 700 provides an intuitive way for navigating among avatars in an application. The method reduces the cognitive burden on a user for managing avatars, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to navigate among avatars in an application faster and more efficiently conserves power and increases the time between battery charges.
The electronic device displays (702), via the display apparatus, an avatar navigation user interface (e.g., 668). The avatar navigation user interface includes an avatar (e.g., 670).
While the avatar navigation user interface (e.g., 668) is displayed, the electronic device detects (704) a gesture (e.g., 699a, 699b), via the one or more input devices (e.g., a swipe gesture on a touch screen display at a location that corresponds to the avatar navigation user interface), directed to the avatar navigation user interface (e.g., 668).
In response (706) to detecting the gesture (e.g., 699a, 699b), in accordance with a determination (708) that the gesture is in a first direction (e.g., a horizontal swipe gesture in a rightward direction), the electronic device displays (710) an avatar of a first type (e.g., 670, 688, avatars modeled to represent humans, rather than non-human characters, or avatars that are configurable or can be created from an avatar prototype or template) in the avatar navigation user interface (e.g., 668). Displaying an avatar of the first type provides visual feedback to the user confirming that the input has been received and that the device is now in a state where the avatar of the first type can be selected. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In response (706) to detecting the gesture (e.g., 699a), in accordance with a determination (714) that the gesture (e.g., 699a) is in a second direction opposite the first direction (e.g., a horizontal swipe gesture in a leftward direction), the electronic device displays (716) an avatar of a second type (e.g., 645) different from the first type (e.g., 670, 688) in the avatar navigation user interface (e.g., avatars modeled to represent non-human characters, or avatars that are selectable, but not configurable). Displaying an avatar of the second type provides visual feedback to the user confirming that the input has been received and that the device is now in a state where the avatar of the second type can be selected. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, further in accordance with the determination (708) that the gesture is in the first direction, the electronic device foregoes (712) displaying the avatar of the second type (e.g., 645) in the avatar navigation user interface (e.g., 668). Further in accordance with the determination (714) that the gesture is in the second direction opposite the first direction, the electronic device foregoes (718) displaying the avatar of the first type (e.g., 670, 688) in the avatar navigation user interface (e.g., 668). By not displaying avatars of particular types, the electronic device provides visual feedback to the user confirming that the input has been received and that the device is not in a state where the avatar of that particular type can be selected. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, after displaying the avatar of the first type (e.g., 670), the electronic device detects a second gesture (e.g., 699b) in the first direction. In response to detecting the second gesture, the electronic device displays a second avatar of the first type (e.g., 688).
In accordance with some embodiments, after displaying the avatar of the second type (e.g., 645), the electronic device detects a third gesture in the second direction. In response to detecting the third gesture, the electronic device displays a second avatar of the second type (e.g., 678).
In accordance with some embodiments, the avatar of the first type (e.g., avatar 670) has an appearance of a human character (e.g., an avatar modeled to represent a human, rather than a non-human character.). In some embodiments, such avatars include customizable (e.g., selectable or configurable) avatar features (e.g., head, hair, eyes, and lips as seen in
In accordance with some embodiments, the avatar of the second type (e.g., avatar 645; avatars corresponding to avatar options shown in
In accordance with some embodiments, the avatar of the first type (e.g., 670) includes a plurality of avatar features (e.g., 851, 828) that are configurable (e.g., creatable, selectable, customizable) by a user. In some embodiments, such an avatar can be created by a user or can be preconfigured with multiple features that can be configured by the user. In some embodiments, configuration of the avatar features results in a significant change in the physical appearance or physical construction of the virtual avatar.
In accordance with some embodiments, the avatar of the second type (e.g., 645) does not include user configurable (e.g., creatable, selectable, customizable) avatar features. In some embodiments, such an avatar is preconfigured and does not have features that can be configured by a user. In some instances, such an avatar may be slightly altered (e.g., changing a color of the avatar or changing a size of the avatar), but such changes do not significantly alter the physical appearance or physical construction of the virtual avatar.
In accordance with some embodiments, the avatar navigation user interface includes a subregion (e.g., 686) having a plurality of avatars. The plurality of avatars includes a first set of avatars of the first type (e.g., 670a, 688a, 670a) and a second set of avatars of the second type (e.g., 640a). The first set of avatars of the first type are separated (e.g., set apart) from the second set of avatars of the second type. In some embodiments, the avatars of the first type are separated from the avatars from the second type so that when the avatar navigation user interface is displayed, and the electronic device detects a user gesture (e.g., a swipe gesture), the device displays or selects, in the avatar navigation user interface, an avatar of the first type when the gesture is in a first direction, or displays an avatar of the second type when the gesture is in a second direction opposite the first direction. In some embodiments, this allows the user to immediately select an avatar of a first or second type, without having to scroll thorough multiple avatars of the same type to get to an avatar of a different type. Providing visual separation of the avatars of the various types provides feedback to the user indicating that multiple types of avatars are displayed (and available to be customized) and informs the user as to the types of characteristics of the avatars that can be customized. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the avatar (e.g., 670) is a selected one of the plurality of avatars displayed at a location (e.g., a border region (e.g., 675)) between one or more of the first set of avatars of the first type and one or more of the second set of avatars of the second type (e.g., the avatar initially displayed in the avatar navigation user interface is positioned between a group of avatars of the first type and a group of avatars of the second type).
In accordance with some embodiments, the first set of avatars of the first type includes the selected one of the plurality of avatars. In accordance with a determination that the gesture is in the first direction, the electronic device replaces the selected one of the plurality of avatars with a different avatar of the first type (e.g., the selected avatar (e.g., 670) is replaced with a different one of the avatars of the first type (e.g., 688) from the first set of avatars of the first type). In accordance with a determination that the gesture is in the second direction, the electronic device replaces the selected one of the plurality of avatars with an avatar of the second type (e.g., the selected avatar (e.g., 670) is replaced with one of the avatars of the second type (e.g., 645) from the second set of avatars of the second type).
In accordance with some embodiments, the second set of avatars of the second type includes the selected one of the plurality of avatars. In accordance with a determination that the gesture is in the first direction, the electronic device replaces the selected one of the plurality of avatars with an avatar of the first type (e.g., the selected avatar (e.g., 645) is replaced with one of the avatars of the first type (e.g., 670) from the first set of avatars of the first type). In accordance with a determination that the gesture is in the second direction, the electronic device replaces the selected one of the plurality of avatars with a different avatar of the second type (e.g., the selected avatar (e.g., 645) is replaced with a different one (e.g., 678) of the avatars of the second type from the second set of avatars of the second type).
Displaying avatars of particular types provides visual feedback to the user confirming that input has been received and that the device is now in a state where the avatar of the particular type can be selected. By replacing avatars, the electronic device provides visual feedback that the device is in a state in which the replaced avatar can no longer be selected by the user. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the avatar navigation user interface includes a first affordance (e.g., 682) (e.g., a selectable, displayed avatar or an “edit” affordance (that is not an avatar)). While the avatar navigation user interface is displayed, the electronic device detects, via the one or more input devices, a gesture directed to the first affordance (e.g., a touch gesture on a touch screen display at a location that corresponds to the “edit” affordance or the displayed avatar or a swipe gesture in a third direction that is different from the first direction such as a swipe up gesture). In response to detecting the gesture directed to the first affordance, the electronic device displays an avatar library user interface (e.g., 686). The avatar library user interface includes a second affordance (e.g., 648) (e.g., “new avatar” or “plus” affordance) and one or more avatars of the first type.
In accordance with some embodiments, while the avatar library user interface is displayed, the electronic device detects, via the one or more input devices, a gesture directed to the second affordance (e.g., 648) (e.g., a touch gesture on a touch screen display at a location that corresponds to the “new avatar” affordance). In response to detecting the gesture directed to the second affordance, the electronic device displays an avatar editing user interface (e.g., 652). The avatar editing user interface is a user interface for generating (e.g., editing a new avatar to be added to the avatar library user interface) a new avatar of the first type. In some embodiments, the electronic device displays the avatar editing user interface and receives user input to create a new avatar of the first type. Once the new avatar of the first type is created, the device displays the new avatar of the first type in the avatar library user interface. For example, the new avatar of the first type is added to the end of the displayed avatars of the first type in the avatar library.
In accordance with some embodiments, the electronic device generates the new avatar of the first type and displays the new avatar in the avatar library user interface (e.g., 686). The new avatar is displayed at a position following a last one of the one or more avatars of the first type (e.g., at a last location in an order of the one or more avatars of the first type).
In accordance with some embodiments, the avatar navigation user interface further includes an affordance (e.g., a “delete” affordance) (e.g., 692c) associated with a function for removing (e.g., deleting or hiding) the avatar from the displayed avatar navigation user interface. The electronic device detects, via the one or more input devices, a gesture directed to the affordance associated with the function (e.g., a touch gesture on a touch screen display at a location that corresponds to the “delete” affordance). In response to detecting the gesture directed to the affordance associated with the function, the electronic device removes (e.g., deleting or hiding) the avatar from the displayed avatar navigation user interface.
In accordance with some embodiments, the avatar navigation user interface is displayed in a messaging user interface (e.g., 603) (e.g., an interface for sending messages between participants of a conversation hosted by a communication platform). In some embodiments, an avatar can be accessed from the avatar navigation user interface displayed as a portion of the messaging user interface, such that an avatar selected from the avatar navigation user interface is displayed in the messaging user interface for sending to a participant in a conversation.
Displaying the avatar navigation user interface in a messaging user interface enables the user to navigate among avatars without leaving the messaging user interface, thus avoiding the need to provide user input to switch between applications of the electronic device. Reducing the number of required user inputs enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, in accordance with a determination that the avatar navigation user interface does not include an avatar of the first type, the electronic device displays an avatar initiation user interface (e.g., 626) (e.g., the avatar splash screen) having an affordance (e.g., 632) (e.g., a “continue” affordance) associated with generating a new avatar of the first type. While the avatar initiation user interface is displayed, the electronic device detects a gesture (e.g., 630) (e.g., a touch gesture on a touch screen display at a location that corresponds to the “continue” affordance) directed to the affordance associated with generating a new avatar of the first type. In response to detecting the gesture directed to the affordance associated with generating a new avatar of the first type, the electronic device displays an avatar editing user interface (e.g., 652, 801). The avatar editing user interface is a user interface for generating (e.g., editing a new avatar to be added to the avatar library user interface) a new avatar of the first type.
In accordance with some embodiments, in accordance with a determination that the avatar navigation user interface includes an avatar of the first type, the electronic device displays the avatar of the first type and an affordance (e.g., 682) (e.g., “edit” affordance) associated with managing one or more features of the displayed avatar of the first type (e.g., 670). In some embodiments, when one or more avatars of the first type have been created, the avatar navigation user interface displays one of the avatars of the first type and an affordance (e.g., an “edit” affordance). In some embodiments, in response to detecting a selection of the affordance, the electronic device displays the avatar library user interface (e.g., 686), which includes a representation of the avatar of the first type (e.g., 670) and other avatars of the first type (e.g., 688). In some embodiments, the electronic device displays the avatar library user interface in response to detecting selection of the displayed avatar of the first type. In some embodiments, in response to detecting a selection of the affordance or the displayed avatar of the first type, the electronic device displays the avatar editing user interface (e.g., 652, 801), which provides a user interface for editing the avatar of the first type.
In accordance with some embodiments, displaying the avatar of the first type includes displaying the avatar of the first type transitioning from a non-interactive state (e.g., 670 in
In accordance with some embodiments, the electronic device displays, via the display apparatus, an avatar library user interface (e.g., 686) including one or more saved (e.g., previously created) avatars of the first type (e.g., 688, 670). The electronic device detects selection of (e.g., detecting a gesture directed to) one of the saved avatars of the first type (e.g., a touch gesture on a touch screen display at a location that corresponds to the saved avatar of the first type). In response to detecting selection of (e.g., detecting a gesture directed to) the one of the saved avatars of the first type, the electronic device displays a menu (e.g., 692) having one or more menu affordances (e.g., an “edit” affordance 692a, a “duplicate” affordance 692b, or a “delete” affordance 692c) associated with one of an edit function, a duplicate function, and a delete function for the one of the saved avatars of the first type.
In accordance with some embodiments, the electronic device detects selection of (e.g., detecting a gesture directed to) a first affordance (e.g., 692b) associated with the duplicate function (e.g., a touch gesture on a touch screen display at a location that corresponds to the “duplicate” affordance). In response to detecting selection of the first affordance, the electronic device generates a duplicate version (e.g., 695) of the one of the saved avatars and displaying the duplicate version in an avatar editing user interface (e.g., 694) (e.g., after selecting the “duplicate” affordance, the selected avatar is duplicated and then the duplicate version of the avatar is shown in an avatar editing user interface having avatar features that match those of the selected one of the saved avatars). In some embodiments, the duplicated avatar can be edited in the avatar editing user interface (e.g., 652, 694, 801) and then saved in the library (e.g., 686) after editing. In some embodiments, after the duplicate avatar is saved, it is displayed in the avatar library at a location adjacent the selected one of the saved avatars (e.g., immediately adjacent the duplicated avatar, or at a next location in an order, wherein the next location in the order immediately proceeds the location of the duplicated avatar in the order) in the avatar library user interface.
In accordance with some embodiments, the electronic device detects selection of (e.g., detecting a gesture directed to) a second affordance (e.g., 692a) associated with the edit function (e.g., a touch gesture on a touch screen display at a location that corresponds to the “edit” affordance). In response to detecting the gesture directed to the second affordance, the electronic device displays an avatar editing user interface (e.g., 652, 694, 801) including the one of the saved avatars (e.g., the avatar that was selected when the edit function was selected).
In accordance with some embodiments, the electronic device detects selection of (e.g., detecting a gesture directed to) a third affordance (e.g., 692c) associated with the delete function (e.g., a touch gesture on a touch screen display at a location that corresponds to the “delete” affordance). In response to detecting selection of (e.g., detecting a gesture directed to) the third affordance, the electronic device removes the displayed one of the saved avatars from the avatar library user interface.
In accordance with some embodiments, the electronic device (e.g., 600) displays a respective avatar of the first or second type (e.g., 670, 671) including displaying, via the display apparatus (e.g., 601), the respective avatar moving in a direction across the avatar navigation user interface (e.g., 671 moving across interface 668 in
In some embodiments, in accordance with a determination that the respective avatar (e.g., 671) reaches a second position (e.g., 671 in
Note that details of the processes described above with respect to method 700 (e.g.,
In
The device displays avatar 805 to represent a current state of the avatar based on modifications to the avatar features that have been made when editing the avatar in the avatar editing user interface. In the embodiment illustrated in
In some embodiments, prior to detecting a selection or modification of any of the avatar features, device 600 displays avatar 805 oscillating between two or more colors (e.g., yellow and white), which can indicate to a user that device 600 is prepared to receive input to modify avatar 805. In some embodiments, prior to detecting a selection or modification of any of the avatar features, device 600 displays avatar 805 without tracking the user's face (e.g., avatar 805 is displayed, but not modified in response to changes in a user's face). In some embodiments, after detecting an input on avatar editing user interface 801 (e.g., a selection of a color option, scrolling the displayed feature options, a gesture on the avatar, a gesture on an affordance (e.g., a “begin face tracking” affordance) etc.), device 600 stops oscillating the display of avatar 805 and/or begins tracking the user's face (e.g., modifying avatar 805 in response to detected changes in the user's face).
Avatar characteristics region 804 includes a displayed listing of avatar feature characteristics that correspond to the currently selected avatar feature (e.g., avatar head). Each avatar feature characteristic includes a set of selectable feature options that can be selected to modify the corresponding characteristic of the selected avatar feature. More specifically, each of the selectable feature options in the set of selectable feature options corresponds to a value for modifying the corresponding characteristic of the selected avatar feature. The changed characteristic is then reflected in displayed changes to avatar 805 and other avatar feature options that include a displayed representation of the characteristic.
Device 600 displays avatar feature options to represent available options for modifying a characteristic of a currently selected avatar feature. The displayed avatar feature options can be dynamically updated based on other selected avatar feature options. The other selected avatar feature options include different avatar feature options corresponding to the same currently selected avatar feature as well as selected avatar feature options corresponding to a different avatar feature (e.g., an avatar feature that is not currently selected, such as a previously modified avatar feature). For example, changes to characteristics of an avatar head feature (e.g., selecting a skin tone) can be shown in the avatar feature options corresponding to the avatar head feature (e.g., face shape feature options), and, optionally, in avatar feature options corresponding to other avatar features such as, for example, hair or eyes. In this example, in response to detecting selection of a skin tone, the device updates the currently displayed avatar feature options (e.g., face shape options) to show the selected skin tone. Additionally, when a different avatar feature is selected (e.g., eyes), the avatar feature options displayed for the eyes also include the selected skin tone.
As shown in
In some embodiments, a selected feature option is indicated by a displayed border around the selected feature option. For example, border 818 displayed around face shape option 814a indicates face shape option 814a is the currently selected avatar face shape. Accordingly, avatar 805 is displayed having the same face shape (e.g., rounded chin) as selected face shape option 814a. Conversely, no color options 812 are selected, so avatar 805 and face shape options 814 are displayed with no skin tone (e.g., a default or preselected skin tone).
In some embodiments, each of the displayed avatar feature characteristics are visually distinguished from other, adjacent avatar feature characteristics. In some embodiments, the avatar feature characteristics are visually distinguished by a respective header of an avatar feature characteristic. For example, in
In
In
In some embodiments, the selected skin tone affects a color or color property (e.g., base color, hue, luminance, shading, saturation, midtone, highlight, warmth, undertone, etc.) for other avatar features (e.g., hair, lips, etc.). For example, avatar hair or facial hair (e.g., eyebrows or a beard) may have an undertone that is determined based on a selected skin tone. For example, darker skin tones produce hair having a darker undertone (e.g., a brown or black undertone), whereas lighter skin tones produce a lighter hair undertone (e.g., a blonde or red undertone). These undertones can affect a color applied to a particular avatar feature, as discussed in greater detail below. Similarly, an avatar lip color can have an undertone that is based on the selected skin tone. For example, the avatar lip color can have a color that is based on the selected skin tone and, optionally, a different color such as red or pink. In some embodiments, the different color is combined with the skin tone color by an amount determined based on the settings of adjustment of color slider 822. For example, adjusting slider 822 in one direction increases the different color value comprising the avatar lip color (e.g., the amount of red or pink in the avatar lip color), and adjusting slider 822 in a different direction decreases the different color value comprising the avatar lip color.
As shown in
In
In some embodiments, after a feature option is selected, device 600 displays an animation to guide the user to select the next avatar feature in avatar feature region 807. For example, in
In
In some embodiments, respective avatar feature affordances 809 can be selected by a tap gesture on the respective avatar feature affordance 809 or by a swipe gesture on avatar feature region 807 (or, optionally, a swipe gesture on any location of avatar display region 803 other than on avatar 805). In such embodiments, the swipe gesture can scroll avatar feature region 807 horizontally to position a desired avatar feature affordance 809 directly beneath avatar 805. In response to detecting lift-off of the touch, device 600 selects the avatar feature affordance (including highlighting the affordance) that is positioned directly beneath avatar 805 after scrolling has finished.
As shown in
Device 600 updates avatar characteristics region 804 by ceasing to display the avatar feature characteristics corresponding to the avatar face feature (e.g., skin tone characteristic 808 and face shape characteristic 810) and displaying new avatar feature characteristics and feature options corresponding to the newly selected avatar feature. In some embodiments, such as that shown in
For example,
As discussed above, some of the feature options for a selected avatar feature are displayed in a sliding cascading effect as discussed above with respect to the appearance of hair color options, whereas other feature options for the selected avatar feature are displayed in an iteratively populating cascading effect as discussed with respect to hair texture options 834 and hairstyle options 836. Either of these cascading effects can be used for displaying population of feature options in accordance with any of the embodiments discussed herein.
In
As shown in
In some embodiments, feature options include a zoomed-in (e.g., magnified) view of the respective avatar feature corresponding to the feature option. Such feature options are generally those for which a close-up view of the avatar feature is beneficial for illustrating sufficient detail to distinguish the different avatar feature options. For example, in
As shown in
Additionally, in the embodiments discussed herein, feature options that illustrate avatar features affected by a selection of a different feature option are updated to reflect the selection of the different feature option. For example, in
In some embodiments, when a feature option is selected for a particular avatar feature characteristic, the feature options shown for that characteristic do not change in response to the selection, whereas feature options for other avatar feature characteristics do change. For example, in
The transition of pixie hairstyle option 836b and bob hairstyle option 836c is shown in
Bob hairstyle option 836c is transitioned after pixie hairstyle option 836b is finished transitioning (e.g., after displaying enlarged pixie hairstyle option 836b′ returning to its original size in
In
In
Device 600 also displays hair color slider 856 for adjusting a gradient of selected hair color option 832a. Hair color slider 856 includes selector affordance 858 (also referred to herein as a thumb) having an initial (e.g., default) location within a gradient region 857 (also referred to herein as a track) that extends between a high gradient value 857a and a low gradient value 857b of selected color 832a. Selector affordance 858 can be moved within region 857 (e.g., in accordance with a magnitude and direction of an input on the slider) to adjust the gradient of selected color 832a based on the position of selector affordance 858 within the gradient region 857. Adjusting the gradient of selected hair color option 832a causes the device to modify any avatar features having the selected color 832a (including feature options showing such avatar features as well as the color of the selected hair color option (e.g., 832a changes in
In some embodiments, the gradient can represent various characteristics of the selected hair color such as, for example, shading, saturation, undertone, midtones, highlights, warmth, luminance, or hue. In some embodiments, the gradient can represent an undertone of the avatar hair that is different from the selected color and, optionally, based on a selected skin tone of the avatar. The gradient of the undertone can be adjusted by moving selector affordance 858 within the gradient region 857, which ultimately modifies the appearance of the selected hair color and avatar hair 851. In some embodiments, the undertone of the hair corresponds to a natural hair color that is determined based on a selected skin tone (skin color). For example, for darker skin tones, the hair has a darker undertone (e.g., a brown or black undertone), whereas lighter skin tones produce a lighter hair undertone (e.g., a blonde or red undertone). Adjusting the undertone gives the hair an appearance of having not only a particular color applied, but also an intensity of that color, based on the gradient of the undertone. For example, for avatar hair having a non-natural selected hair color (e.g., purple), adjusting an undertone to a low gradient value 857b, provides little or no natural hair color (e.g., brown) undertone. This emphasizes the purple hair color, giving the appearance that the avatar has heavily applied a purple hair dye. Conversely, adjusting the undertone to a high gradient value 857a emphasizes the natural undertone of the hair (or other avatar feature, such as avatar eyebrows or lips), giving the appearance that the avatar has lightly applied purple hair dye. By adjusting the position of selector affordance 858 along the slider, a user can adjust the gradient of the undertone that device 600 applies to selected color 832a.
In some embodiments, selector affordance 858 includes a color representing a currently selected gradient of selected color 832a. In its initial location, selector affordance 858 has a same color as selected color 832a when selected color 832a is initially displayed. In other words, selected color 832a has an initial (e.g., default or preselected) color the first time it is selected (e.g., see
For example, in
In
In
In
In
In
In
In
For example,
Conversely, device 600 expands avatar display region 803 from a condensed (or intermediate) state in response to detecting movement of input 864 in a downward direction, as shown in
By condensing avatar display region 803, device 600 displays a larger avatar characteristics region 804 to show additional avatar feature characteristics and/or feature options. The sizes of the avatar feature characteristics and feature options do not change when avatar characteristics region 804 expands or contracts. Accordingly, device 600 displays more avatar feature characteristics and/or feature options as avatar characteristics region 804 expands, and displays fewer avatar feature characteristics and/or feature options as avatar characteristics region 804 contracts.
In some embodiments, as device 600 displays scrolling of avatar feature characteristics (e.g., 808, 810, 838, 840, 842) and their respective feature options (e.g., 812, 814, 832, 834, 836) device 600 maintains display of a respective header for an avatar feature characteristic positioned at the top of avatar characteristics region 804, when a portion of that avatar feature characteristic is scrolled partially off the top edge (e.g., below line 806) of avatar characteristics region 804. For example, as shown in
In
In
In some embodiments, avatar display region 803 and avatar 805 transition from the condensed state directly to the fully expanded state in response to detecting a selection of a feature option. For example, in
In
In
In
As shown in
In
In
As shown in
In
In
In
Device 600 also displays lip color slider 892, which can be controlled in a manner similar to other color sliders discussed herein. Lip color slider 892 includes selector affordance 893 that can be positioned along the lip color slider to adjust a gradient of selected lip color 884a from a high gradient value at 892a to a low gradient value at 892b. In some embodiments, the gradient can represent various characteristics of the selected lip color such as, for example, shading, saturation, undertone, midtones, highlights, warmth, or hue. In some embodiments, the gradient can represent an undertone of the avatar lips that is different from the selected color and, optionally, based on a selected skin tone of the avatar. The gradient of the undertone can be adjusted by moving selector affordance 893 along the lip color slider 892, which ultimately modifies the appearance of the selected lip color and avatar lips 828. For example, the undertone of the selected color can be a red color, or some other color corresponding to a natural skin tone (e.g., brown), whereas the selected lip color (e.g., selected lip color 884a) can be any color (including any non-natural color). Adjusting the undertone gives the avatar's lips an appearance of having not only a particular color applied to the lips, but also an intensity of that color, based on the gradient of the undertone. For example, for avatar lips having a non-natural selected lip color (e.g., green), adjusting an undertone to a low gradient value 892b, provides little or no natural lip color (e.g., red) undertone. This emphasizes the green lip color, giving the appearance that the avatar has heavily applied green lipstick, or lips of an unnatural color. Conversely, adjusting the undertone to a high gradient value 892a emphasizes the undertone of the lips, giving the appearance that the avatar has lightly applied green lipstick. By adjusting the position of selector affordance 893 along the slider, a user can adjust the gradient of the undertone that device 600 applies to selected color 884a.
In
As shown in
In some embodiments, feature options can be scrolled horizontally to display additional feature options. For example, in
In some embodiments, device 600 displays feature options to represent a potential appearance of the avatar (e.g., avatar 805) if the respective feature option is selected. In some embodiments, however, device 600 displays feature options that do not completely represent a potential appearance of the avatar if the respective feature option is selected. For example, device 600 can display feature options having a representation of an avatar feature with a portion of the respective avatar feature omitted. Omitting a portion of the respective avatar feature from the feature option shows other avatar features in the feature option that would otherwise be obstructed by the omitted portion if it were displayed, but does not fully represent a potential appearance of the avatar if the feature option is selected. For example, in
Device 600 also displays hat characteristic 8106 having hat options 8108. The displayed hat options 8108 represent potential changes to avatar 805 if a respective hat option is selected. In addition to modifying avatar 805 to include the selected hat, such potential changes include a reshaping of avatar hair 851 and a lighting affect such as casting a shadow on the face of avatar 805. In
Hat option 8108c also illustrates a potential change to avatar 805 that would display a lighting effect on avatar 805. For example, cowboy hat option 8108c includes a large hat (e.g., a cowboy hat) that casts a shadow 8120 on the avatar's forehead, below the brim of the cowboy hat. By displaying hat option 8108c with a cowboy hat, reshaped hairline, and shadow 8120, device 600 indicates that selection of hat option 8108c would result in a modification to avatar 805 that includes displaying the cowboy hat on avatar 805, reshaping the hairline of avatar hair 851, and casting a shadow on the forehead of avatar 805 (e.g., see
In some embodiments, device 600 detects a user's face positioned in a field of view of a camera (e.g., camera 602), and modifies (e.g., continuously) an appearance of avatar 805 based on detected changes in the user's face (e.g., changes in pose of the user's face, changes in the relative position of facial features, etc.). For example, in
In
In some embodiments, device 600 modifies selected avatar features, such as those represented in avatar 805, based on a physics model applied to the respective selected avatar features. For example, in
In some embodiments, device 600 modifies a displayed orientation and/or magnification of avatar 805 in response to detected input on avatar display region 803 or more specifically, in some embodiments, on avatar 805. For example, in
In some embodiments, device 600 displays selected avatar features moving, in response to the detected input on avatar display region 803 (or avatar 805), based on an applied physics model. For example, in
In
In
In
In
For example, as shown in
In response to detecting input 8138, device 600 also expands glasses characteristic 8110 to display color options for both the frame 8140-1 and lenses 8140-2 (e.g., see
In
In
Lenses color slider 899 is similar to other sliders discussed herein and can be used to adjust a color (or other aspects) of glasses lenses 8140-2 in accordance with the various slider embodiments discussed herein. In the embodiment illustrated in
In some embodiments, both frame color slider 897 and lenses color slider 899 adjust their respective avatar features in a same manner. For example, frame color slider 897 modifies color option 894-1 from a cooler tone to a warmer tone when selector affordance 897-1 moves to the left, and lenses color slider 899 modifies color option 896-1 from a cooler tone to a warmer tone when selector affordance 899-1 moves to the left. As another example, frame color slider 897 modifies color option 894-1 by increasing a first color value (e.g., red) when selector affordance 897-1 moves to the left and increasing a second color value (e.g., green) when selector affordance 897-1 moves to the right, and lenses color slider 899 modifies color option 896-1 by increasing the first color value when selector affordance 899-1 moves to the left and increasing the second color value when selector affordance 899-1 moves to the right.
In
In
In
Avatar 805 is also displayed moving in response to a detected pose of a user's face (e.g., detected in camera 602). As a user moves their head, device 600 modifies avatar 805 in real time to mirror the user's movements. As the avatar 805 moves, earrings 8125 and avatar hair 851 sway in response to movement of the avatar head. In some embodiments, as device 600 modifies avatar 805 to mirror the real-time movements of the user, device 600 also modifies the lighting effects on avatar 805, including moving displayed locations of reflections 8150 and shadows 8142 based on a relative position of a modeled light source and avatar 805 (and selected avatar features such as avatar glasses 8140).
For example, in
In some embodiments, device 600 modifies the physical movement of avatar features (e.g., such as avatar hair 851) based on the features applied to the avatar. For example, as shown in
In some embodiments, if the user's face is not detected in the field of view of the camera (e.g., 602) for a threshold amount of time, device 600 stops modifying the avatar and displays a prompt indicating that face tracking is stopped and instructing the user to resume face tracking. For example,
In some embodiments, device 600 modifies some avatar features in response to changing other avatar features. For example,
For example, in
In addition, device 600 updates the displayed feature options based on the changed hair. For example, hat options 8108 shown in
In some embodiments, when different avatar options are selected, the new selected avatar option is modified based on avatar features already present on the avatar. For example, in
In
In
In
Device 600 also detects input 8152 (e.g., touch gesture) on done affordance 8154. In response, device 600 closes the avatar editing user interface and displays avatar 805 in avatar selection region 8156 of an application (e.g., a messaging application such as that discussed above with respect to
As described below, method 900 provides an intuitive way for displaying an avatar editing user interface. The method reduces the cognitive burden on a user for managing avatars, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to modify characteristics of an avatar using an avatar editing user interface faster and more efficiently conserves power and increases the time between battery charges.
The electronic device displays (902), via the display apparatus, an avatar editing user interface (e.g., 801) that includes concurrently displaying: an avatar (904) (e.g., 805) having a plurality of avatar features (e.g., avatar hair, facial features (avatar lips, eyes, nose, etc.), accessories (e.g., earrings, sunglasses, hats)), a first option selection region (904) (e.g., 808) for a respective avatar feature, and a second option selection region (906) (e.g., 810) for the respective avatar feature.
The first option selection region (e.g., 808) for a respective avatar feature (e.g., a visually distinguished region that includes options selectable for modifying an avatar feature) includes (904) a first set of feature options (e.g., displayed representations of available modifications of a corresponding avatar feature) corresponding to a set of candidate values for a first characteristic (e.g., face shape, lip size, hair color, etc.) of the respective (e.g., currently selected) avatar feature. In some examples, the option selection regions (e.g., 808, 810) are configured to scroll vertically. In some examples, the feature options include graphical depictions of different feature options that may be selected to customize aspects of a particular avatar feature. In some examples, the feature options (e.g., 809) are configured to scroll horizontally. In some examples, the option selection regions (e.g., 808, 810) are configured to scroll along an axis that is different from the axis along which the feature options (e.g., 809) are configured to scroll, such as axes that are perpendicular to each other.
The second option selection region (e.g., 810) for the respective avatar feature includes (906) a second set of feature options corresponding to a set of candidate values for a second characteristic of the respective (e.g., currently selected) avatar feature. The second characteristic of the respective avatar feature is different from the first characteristic of the respective avatar feature.
In response (910) to detecting a selection (e.g., 850) of one of the feature options (e.g., 834b) in the first set of feature options (e.g., a user selection of a “wavy hair” feature option from the “hair texture” characteristic of a “hair” avatar feature), the electronic device changes (912) an appearance of at least one of the second set of feature options (e.g., 810) from a first appearance (e.g., 836b) to a second appearance (e.g., 836b′) (e.g., of the second set of feature options). In some examples, a displayed feature option showing an avatar hairstyle transitions from a first appearance of the avatar's hair (e.g., a state in which the avatar's hair has a straight texture) to the second appearance in which the avatar's hair has a wavy texture.
Changing an appearance of at least one of the second set of feature options from a first appearance to a second appearance in response to detecting a selection of one of the feature options in the first set of feature options provides the user with feedback about the current state of the avatar and the available avatar feature options and provides visual feedback to the user confirming the selection of the one of the feature options in the first set of feature options. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, changing an appearance of at least one of the second set of feature options (e.g., 836) from the first appearance (e.g., 836b) to the second appearance (e.g., 836b′) includes changing (914) an appearance at least two of the second set of feature options (e.g., from an appearance that corresponds to the first option from the first set of feature options to an appearance that corresponds to the second option from the second set of feature options).
In accordance with some embodiments, in response (910) to detecting the selection of the one of the feature options in the first set of feature options, foregoing (918) changing the appearance of the first set of feature options from the first appearance (e.g., 834) to the second appearance (e.g., 836b′). Foregoing changing the appearance of the first set of feature options from the first appearance (e.g., 834) to the second appearance (e.g., 836b′) in response to detecting the selection of the one of the feature options in the first set of feature options provides the user with visual feedback indicating that the first set of feature options are not affected or updated in response to detecting the selection of the one of the first set of feature options. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the second appearance of the at least one of the second set of feature options (e.g., 836b) is based on the selected one of the feature options (e.g., 834b) in the first set of feature options (e.g., the device determines a first characteristic value corresponding to the selected one of the feature options in the first set of feature options and updates the at least one of the second set of feature options based on the first characteristic value).
In accordance with some embodiments, displaying at least one of the second set of feature options (e.g., 836b) changing from the first appearance to the second appearance includes a determination that the at least one of the second set of feature options includes at least a portion of an avatar feature corresponding to the selected one of the first set of feature options (e.g., when a hair texture option is selected, a plurality of hairstyle options change to show the selected hair texture if those hairstyle options include a representation of hair (e.g., as shown in
In accordance with some embodiments, in response to detecting the selection of the one of the feature options (e.g., 834b) in the first set of feature options, in accordance with a determination that a second one (e.g., 836a) of the second set of feature options does not include at least a second portion of an avatar feature corresponding to the selected one of the first set of feature options, the electronic device maintains the appearance of the second one of the second set of feature options. (e.g., when a hair color option is selected, a plurality of hairstyle options change if those hairstyle options include a representation of hair, but a “bald” hairstyle option does not change in appearance because the “bald” hairstyle does not include a representation of hair, as shown in
Maintaining the appearance of the second one of the second set of feature options in accordance with a determination that the second one of the second set of feature options does not include at least the second portion of the avatar feature corresponding to the selected one of the first set of feature options provides the user with visual feedback indicating that the second one of the second set of feature options is not affected or updated in response to detecting selection of the one of the first set of feature options. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, changing the appearance of the at least one of the second set of feature options (e.g., 836b) from the first appearance to the second appearance includes displaying an animation of the at least one of the second set of feature options changing from the first appearance to the second appearance (e.g., as shown in
Displaying an animation of the at least one of the second set of feature options changing from the first appearance to the second appearance provides the user with feedback about the current state of the at least one of the second set of feature options and provides visual feedback to the user confirming the selection of one of the feature options in the first set of feature options. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the selected one of the feature options in the first set of feature options is a selected hair color (e.g., 832a, red) in a first set of hair color options (e.g., 832) and the at least one of the second set of feature options includes one or more of a hair length option (e.g., long, medium, short), a hair type option (e.g., 834, curly, straight, wavy, etc.), and a hairstyle option (e.g., 836). In accordance with some embodiments, changing the appearance of at least one of the second set of feature options from the first appearance to the second appearance includes changing one or more of the hair length option, the hair type option, and the hairstyle option from a first hair color to the selected hair color (e.g., as shown in
In accordance with some embodiments, the selected one of the feature options (e.g., 834b) in the first set of feature options (e.g., 834) is a selected hair type (e.g., curly, straight, wavy) in a first set of hair type options, and the at least one of the second set of feature options includes one or more of a hair length option (e.g., long, medium, short, etc.) and a hairstyle option (e.g., 836b). In accordance with some embodiments, changing the appearance of at least one of the second set of feature options from the first appearance to the second appearance includes changing one or more of the hair length option and the hairstyle option from a first hair type to the selected hair type. Changing one or more of the hair length option and the hairstyle option from a first hair type to the selected hair type provides the user with feedback about the current state of the avatar and the hair length option and the hairstyle option and provides visual feedback to the user confirming the selection of the hair type option. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the second set of feature options includes a plurality of feature options arranged in an order in which a first feature option (e.g., 836a) is before a second feature option (e.g., 836b) in the order and the second feature option is before a third feature option (e.g., 836c) in the order. In accordance with some embodiments, changing the appearance of at least one of the second set of feature options from a first appearance to a second appearance includes: displaying a first animated transition of the first feature option of the second set of feature options from the first appearance to the second appearance; after displaying at least a portion of the first animated transition of the first feature option to the second appearance, starting a second animated transition of the second feature option of the second set of feature options from the first appearance to the second appearance; and after displaying at least a portion of the second animated transition of the second feature option to the second appearance, starting a third animated transition of the third feature option of the second set of feature options from the first appearance to the second appearance. In some embodiments, the first animated transition overlaps with the second animated transition and the second animated transition overlaps with the third animated transition. In some embodiments, the first feature option is adjacent to the second feature option which is adjacent to both the first feature option and the third feature option.
Displaying the first animated transition, then starting a second animated transition after displaying at least a portion of the first animated transition, then starting the third animated transition after displaying at least a portion of the second animated transition provides the user with feedback about the current state of the changed appearance of the first, second, and third feature options in the second set of feature options and provides visual feedback to the user indicating an order in which the first, second, and third feature options are transitioned. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, changing the appearance of at least one of the second set of feature options from the first appearance to the second appearance comprises: enlarging a size of a first one of the second set of feature options (e.g., 836b′) and then reducing (e.g., to its original size) the size of the first one of the second set of feature options (e.g., 836b); and enlarging a size of a second one of the second set of feature options (e.g., 836c′) and then reducing (e.g., to its original size) the size of the second one of the second set of feature options (e.g., 836c). In some embodiments, the second one of the feature options is enlarged before the first one of the feature options is reduced to its original size (e.g., the changing of the first and second feature options overlaps). Enlarging the sizes of the first and second ones of the second set of feature options provides the user with feedback about the current state of the changed appearance of the first and second ones of the second set of feature options and provides visual feedback to the user indicating the first and second ones of the second set of feature options are changing. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
Reducing the sizes of the first and second ones of the second set of feature options provides the user with feedback about the current state of the changed appearance of the first and second ones of the second set of feature options and provides visual feedback to the user indicating when the change is complete. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the electronic device detects a change in a face in a field of view of one or more cameras (e.g., 602) of the electronic device. The electronic device changes an appearance of the avatar (e.g., 805) based on the detected change in the face (e.g. in addition to changing the appearance of the second set of feature options) (e.g., as shown in
In accordance with some embodiments, after the electronic device (e.g., 600) detects the change in the face (e.g., 673), the electronic device determines that the face has not been detected in the field of view of the one or more cameras (e.g., 602) for a predetermined amount of time (e.g., ten seconds). In response to determining that the face has not been detected in the field of view of the one or more cameras for the predetermined amount of time, the electronic device ceases changing the appearance of the avatar (e.g., 805) based on the detected change in the face (e.g., transitioning the avatar to a non-interactive (static) state in which the avatar does not change in response to detecting changes in the face even if the face returns to the field of view of the one or more cameras after tracking has stopped). After ceasing changing the appearance of the avatar, the electronic device detects an input (e.g., 8166) (e.g., an input directed to the user interface such as a gesture on the user interface (e.g., a tap gesture on a “tap to resume tracking face” affordance), detection of device lift, etc.). When the user's face has not been detected in the field of view, the electronic device does not update the appearance of the avatar based on the detected change. Since the detected changes are not visible to the user, battery power and processing resources of the electronic device are preserved by not the changes. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In response to detecting the input (e.g., 8166), the electronic device (e.g., 600) resumes changing the appearance of the avatar (e.g., 805) based on the detected change in the face (e.g., 673) (e.g., transitioning the avatar to an interactive state (e.g., 805 in
In accordance with some embodiments, in response to determining that the face (e.g., 673) has not been detected in the field of view of the one or more cameras (e.g., 602) for the predetermined amount of time, the electronic device (e.g., 600) displays an indication (e.g., 8164) (e.g., a message) that the face is not being detected in the field of view of the one or more cameras. In some embodiments, the indication is a message that informs the user of an action that can be taken to resume face tracking (e.g., “show your face,” “tap to resume,” etc.). In some embodiments, the indication is an animation indicating that the avatar (e.g., 805) is no longer being changed in response to detected changes in the user's face (e.g., an animation of the avatar transitioning to a static state). When the face is not detected in the field of view, the user is notified by a displayed indication that the face is not detected. This provides feedback to the user so that the user may take action to resume face tracking and informs the user of an action that can be taken to resume the face tracking (otherwise, the user may not be aware that the device has stopped face tracking or understand how to resume the tracking). Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently. Stopping face tracking when the user is not detected also saves power and reduces wear and tear on the device (including the face tracking sensors). The notification informs the user how to resume tracking that was stopped to save power and reduce wear and tear on the device (including the face tracking sensors).
In some embodiments, the input is detecting (e.g., via an accelerometer and/or gyroscope of the electronic device) the device (e.g., 600) being raised (e.g., a user is picking up the device and, optionally, the user's face (e.g., 673) is detected in the field of view of the one or more cameras (e.g., 602)). In some embodiments, the input is a gesture (e.g., 8166) (e.g., a tap or swipe gesture) directed to the avatar editing user interface (e.g., 801). In some embodiments the gesture is an input anywhere on the user interface, including, for example, selection of an option, navigation to a new section of the user interface, selection of an affordance (e.g., a “begin tracking facial movements” affordance).
In accordance with some embodiments, the electronic device changes an appearance of the avatar based on an input (e.g., a gesture on the avatar to rotate or adjust a magnification of the avatar, or a detected change in a face in a field of view of a camera) (e.g., as shown in 8BG to 8BI). Changing the appearance of the avatar based on the input includes moving one or more of the plurality of avatar features (e.g., 8125) in accordance with one or more physics models (e.g., a model of inertia, a model of gravity, a force transfer model, a friction model). In some embodiments, the physics model specifies a magnitude and direction of movement of an avatar feature based on a magnitude and direction of the input (e.g., a gesture on the avatar to rotate or adjust a magnification of the avatar, or movement of the face or a portion of the face) and one or more predefined properties of the virtual avatar feature such as a simulated mass, simulated elasticity, simulated coefficient of friction or other simulated physical property.
Moving one or more of the avatar features based on a physics model for the virtual avatar enables the user to create a realistic and interactive virtual avatar that can communicate a wider range of non-verbal information. This enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to communicate an intended message using more realistic movements of the virtual avatar) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the electronic device detects a gesture (e.g., a pinch/de-pinch gesture, a swipe gesture) on the avatar (e.g., 805). In response to detecting the gesture on the avatar: in accordance with a determination that the gesture corresponds to a gesture of a first type (e.g., a pinch/de-pinch gesture), the electronic device adjusts a zoom level of the avatar based on the gesture (e.g., zoom-in on the displayed avatar if the gesture is a de-pinch gesture, and zoom-out from the displayed avatar if the gesture is a pinch gesture); and in accordance with a determination that the gesture corresponds to a gesture of a second type (e.g., a swipe gesture), the electronic device adjusts an orientation of the avatar based on the gesture (e.g., rotate the avatar in a direction corresponding to a direction of the swipe gesture) (e.g., as shown in
Adjusting the zoom level of the avatar based on the gesture provides the user with options for controlling modifications to the display of the avatar without requiring displayed user interface control (e.g., touch control) elements. Providing additional control options without cluttering the user interface with additional controls enhances the operability of the device making the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
Adjusting the orientation of the avatar based on the gesture provides the user with options for controlling modifications to the display of the avatar without requiring displayed user interface control (e.g., touch control) elements. Providing additional control options without cluttering the user interface with additional controls enhances the operability of the device making the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, a respective feature option (e.g., a feature option of the first or second sets of feature options) includes a representation of the respective (e.g., currently selected) avatar feature. The representation of the respective avatar feature is displayed having an enlarged view (e.g., zoomed-in) in comparison to the respective avatar feature of the displayed avatar. In some embodiments, the feature option corresponds to the avatar nose and includes a zoomed-in view of the avatar's nose and surrounding facial region, when compared to the avatar nose and surrounding facial region of the displayed avatar. In some embodiments, the second set of feature options includes one or more enlarged views of avatar features.
In accordance with some embodiments, a second respective feature option (e.g., 8116) includes a representation of the respective avatar feature and excludes (e.g., does not display) at least a portion of a different avatar feature (e.g., an avatar feature that, when displayed, obscures at least a portion of the respective avatar feature being modified using the respective feature options) (e.g., as shown in
In accordance with some embodiments, displaying the avatar editing user interface further includes displaying an avatar feature subregion (e.g., a scrollable, textual listing of avatar feature options) (e.g., 807) including a plurality of affordances (e.g., 809) corresponding to avatar features (e.g., face, hair, eyes, accessories, etc.). The plurality of affordances include a first selected affordance (e.g., 809a, 809b, 809c, 809d) corresponding to the respective (e.g., a currently selected) avatar feature (e.g., the “hair” affordance 809b is highlighted to show the hair avatar feature is currently selected).
In accordance with some embodiments, in response to detecting the selection of the one of the feature options (e.g., 814b) in the first set of feature options (e.g., 814), the electronic device displays an animation of a visual effect (e.g., highlighting hair affordance 809b in
In accordance with some embodiments, in response to detecting selection of a second affordance (e.g., an “accessories” affordance 809D), the second affordance corresponding to a second avatar feature (e.g., avatar accessories), the electronic device: updates the first option selection region to display an updated first set of feature options (e.g., displayed earrings options) corresponding to a set of candidate values (e.g., different earring options such as hoop earrings, stud earrings, or no earrings) for a first characteristic (e.g., an earring characteristic) of the second avatar feature, and updates the second option selection region to display an updated second set of feature options (e.g., displayed hat options) corresponding to a set of candidate values (e.g., no hat, cowboy hat, headband, etc.) for a second characteristic (e.g., a hat characteristic) of the second avatar feature (e.g., as shown in
Updating the first and second option selection regions in response to detecting selection of the second affordance corresponding to the second avatar feature provides the user with feedback confirming selection of the second avatar feature and provides visual feedback to the user indicating the avatar feature options available for the second avatar feature. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the avatar feature subregion (e.g., 807) is displayed in a first region (e.g., 803) of the avatar editing user interface. The first option selection region (e.g., 808) and the second option selection region (e.g., 810) are displayed in a second region (e.g., 804) of the avatar editing user interface, the second region displayed positioned below the first region.
In accordance with some embodiments, the first set of feature options includes a plurality of color affordances corresponding to colors, the plurality of color affordances including a first selected color affordance corresponding to a color of the respective (e.g., currently selected) avatar feature (e.g., as shown in
In accordance with some embodiments, in response to detecting a selection of one of the plurality of color affordances (e.g., 832), the electronic device displays a color picker user interface (e.g., 888, 892, 856, 822) (e.g., a user interface displaying colors that can be selected to modify the color of the selected color affordance) having a selected color corresponding to the selected color affordance and a plurality of other color options that are not included in the plurality of color affordances. In some embodiments, the color picker UI is displayed having a selected color that corresponds to the selected color affordance. The user can then adjust the color picker UI to refine the selected color or choose an entirely different color altogether. In some embodiments, displaying the color picker user interface includes replacing at least one of the first option selection region or the second option selection region with the color picker user interface. In some embodiments, the color picker UI replaces the first and second option selection regions with an animation showing the color picker UI sliding onto the screen (and over the first and second option selection regions) from a particular direction (e.g., bottom of screen, left side of screen, right side of screen, etc.). In some embodiments, the color picker UI is a pop-up screen that is displayed over the first and second option selection regions.
In some embodiments, in accordance with a determination that the plurality of color affordances (e.g., 812) correspond to colors for an avatar skin tone feature, the plurality of color affordances includes an expanded set of color affordances (e.g., shown in
In accordance with some embodiments, the plurality of color affordances correspond to colors for an avatar feature of a first type (e.g., 828) (e.g., an avatar feature other than an avatar skin tone feature). In some embodiments, the electronic device (e.g., 600) displays a first portion (e.g., 882) of the plurality of color affordances. In some embodiments, the electronic device detects a gesture (e.g., a swipe gesture) on the plurality of color affordances (e.g., a swipe gesture on the color affordances). In response to detecting the gesture, the electronic device ceases to display the first portion of color affordances and displays a second portion of color affordances (e.g., scrolling the plurality of color affordances to reveal additional color affordances). In some embodiments, the second portion of color affordances including an affordance (e.g., 886) corresponding to an expanded set (e.g., 888) of color affordances different from the first portion of color affordances and the second portion of color affordances. Displaying an animation of the avatar transitioning from an interactive state to a non-interactive state provides visual feedback of the avatar's non-interactive appearance. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, at least one of the first characteristic or the second characteristic corresponds to a feature shape (e.g., face shape, nose shape, ear shape, etc.) of the respective avatar feature (e.g., avatar face).
In accordance with some embodiments, the respective avatar feature is an avatar face (e.g.,
In accordance with some embodiments, the respective avatar feature is avatar hair (e.g.,
In accordance with some embodiments, the respective avatar feature is avatar eyes. The first characteristic and the second characteristic are selected from a group consisting of: eye shape, eye color, eyelashes, and eyebrow shape.
In accordance with some embodiments, the respective avatar feature is accessories (e.g.,
In accordance with some embodiments, in response to detecting a vertical gesture (e.g., a vertical swipe gesture on the touch screen display at a location corresponding to the avatar editing user interface) on the avatar editing user interface, the electronic device scrolls the avatar editing user interface in a vertical direction corresponding to the vertical gesture. Scrolling the avatar editing user interface includes scrolling the first option selection region and second option selection region in the direction of the vertical gesture while maintaining a vertical position of a region including the displayed avatar (e.g., as shown in
In accordance with some embodiments, in response to detecting a gesture (e.g., 830) (e.g., a horizontal swipe gesture on the touch screen display at a location corresponding to the avatar, or a touch gesture on an affordance corresponding to one of the avatar features) on an avatar feature subregion (e.g., 807) of the avatar editing user interface, the electronic device: displays the avatar feature subregion changing from a first appearance in which a first avatar feature (e.g., 809a) is selected to a second appearance in which a second avatar feature (e.g., 809b) is selected; ceases to display the first and second option selection regions (e.g., 808, 810); displays a third option selection region (e.g., 838) having a plurality of feature options (e.g., 832) arranged in an order in which a first feature option is before a second feature option in the order and the second feature option is before a third feature option in the order; displays a fourth option selection region (e.g., 840) having a plurality of feature options (e.g., 834) arranged in an order in which a first feature option is before a second feature option in the order and the second feature option is before a third feature option in the order. Displaying the third option selection region includes displaying a first animation that includes displaying the plurality of feature options of the third option selection region in order. Displaying the fourth option selection region includes: after displaying at least a portion of the first animation, starting a second animation that includes displaying the plurality of feature options of the fourth option selection region in order.
In accordance with some embodiments, the avatar is a first size (e.g., an enlarged size) or a second size (e.g., a reduced size). The electronic device detects a gesture (e.g., a tap gesture on a feature option or a vertical swipe gesture) on the avatar editing user interface (e.g., at a location corresponding to the first option selection region or the second option selection region), In accordance with a determination that the gesture corresponds to a selection (e.g., 869) of a feature option (e.g., 836f) in the first or second set of feature options, and the avatar is the second size (e.g.,
In accordance with some embodiments, in accordance with a determination that the gesture is the scroll gesture and the avatar is the first size, the electronic device foregoes displaying the avatar transitioning to the second size if the scroll gesture corresponds to the second scroll direction. In some embodiments, the avatar (e.g., 805) is condensed only when the scroll gesture is in a downward scrolling direction.
In accordance with some embodiments, prior to detecting the selection (e.g., 820) of the one of the feature options (e.g., 812), the avatar (e.g., 805) is displayed with a skin color that changes over time through a plurality of different color values (e.g., the avatar is displayed oscillating back and forth between two or more colors over time). In some embodiments, prior to detecting the selection of the one of the feature options, the avatar is displayed in a non-interactive state (e.g., 805 in
Note that details of the processes described above with respect to method 900 (e.g.,
As described below, method 1000 provides an intuitive way for displaying visual effects in an avatar editing application. The method reduces the cognitive burden on a user for applying visual effects to an image viewed in an avatar editing application, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to display visual effects in an image faster and more efficiently conserves power and increases the time between battery charges.
In some embodiments, the electronic device (e.g., 600) displays (1002), via the display apparatus (e.g., 601): a user interface object (e.g., a virtual avatar 805) including a respective feature (e.g., 851, 8140) having a first set of one or more colors (e.g., a default set of one or more colors, including, in some embodiments, highlights, midtones, and/or shadows) and a plurality of color options (e.g., 832, 894) (e.g., a plurality of affordances, each corresponding to a color) for the respective feature (e.g., a first avatar feature; e.g., avatar skin tone, avatar eye color, avatar hair color, etc.). In some embodiments, the respective feature is an avatar skin tone. In some embodiments, the respective feature is an avatar eye color (e.g., 829). In some embodiments, the respective feature is an avatar hair color. Displaying an avatar with a respective feature that the user can change with color options provides visual feedback to the user confirming that the respective feature of the avatar is in a state where the color may be changed. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In some embodiments, the electronic device (e.g., 600) detects (1004) a selection (e.g., 895, 852) of a color option (e.g., 894-1, 832a) of the plurality of color options (e.g., 894, 832) that corresponds to a second color. In response to detecting the selection (1006): the electronic device changes (1008) the color of the respective feature (e.g., frames 8140-1, avatar hair 851) to the color option (e.g., changing an appearance of an avatar feature option that displays the respective avatar feature; e.g., changing an appearance of a virtual avatar (e.g., 805) having the respective avatar feature), and displays (1010) a first color adjustment control (e.g., 857, 897) (e.g., a slider user interface) for the color option that corresponds to a second set of one or more colors (e.g., a set of color changes resulting from changes to slider 856, 897). Displaying an avatar with a first color adjustment control provides visual feedback to the user confirming that the respective feature of the avatar has changed colors and is selected for further color modification. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently. Haptic feedback confirms that the changes have been received. Providing haptic feedback informs the user that input was received and that the change has been made.
In some embodiments, the first color adjustment control for the color option that corresponds to the second set of one or more colors includes a slider (e.g., 897) having a track (e.g., 897-2) and a thumb (e.g., 897-1) that moves in the track. In some embodiments, the input (e.g., 860) causes movement of the thumb in the track. In some embodiments, in response to detecting the input and in accordance with the thumb being moved to a predetermined position (e.g., 860′) (e.g., a midpoint of the track; a position that corresponds to a default value for the second color), the device generates a haptic feedback. In some embodiments, movement of the thumb to positions other than the predetermined position does not generate a haptic feedback that includes a tactile output.
While the respective feature (e.g., 851) of the user interface object (e.g., 805) has the second set of one or more colors (e.g., 832a), the electronic device detects (1012) an input (e.g., 860) (e.g., drag gesture or tap gesture) that corresponds to the first color adjustment control. In response to detecting the input that corresponds to the first color adjustment control, the electronic device modifies (1014) the color of the respective feature from the second set of one or more colors to a modified version of the second set of one or more colors (e.g., a modified color of the respective avatar feature) based on the second color. In some embodiments, the slider user interface modifies a property (e.g., a hue, saturation, value/lightness) of the base selected color option. In some embodiments, the displayed color of the selected color option is also modified in response to the input on the slider user interface. In some embodiments, the plurality of color options includes a color palette as described with respect to method 900 and
In accordance with some embodiments, in response to detecting the input (e.g., 860) that corresponds to the first color adjustment control (e.g., 857), the electronic device (e.g. 600) modifies the color of the color option (e.g., 832a) from the second color to the modified version of the second set of one or more colors. In some embodiments, modifying the color of the respective feature (e.g., 851, 8140) from the second set of one or more colors to the modified version of the second set of one or more colors includes modifying a plurality of values (e.g., highlight, midtone, shadows) for the second set of one or more colors. In some embodiments, modifying the color of the respective feature from the second set of one or more colors to the modified version of the second set of one or more colors is further based on a magnitude and direction of the input (e.g., 860) that corresponds to the first color adjustment control (e.g., the red value of the color increases more the farther the input moves to the right and the green value of the color increases more the farther the input moves to the left).
In accordance with some embodiments, the electronic device (e.g. 600) displays (1016) a second plurality of color options (e.g., 896) for a second feature (e.g., 8140-2) (e.g., a portion of the respective (first) avatar feature or a second avatar feature different from the respective avatar feature). Displaying an avatar with a second plurality of color options for a second feature provides visual feedback to the user when the user changes the color of the second feature using the second plurality of color options. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In some embodiments, the electronic device (e.g., 600) detects (1018) a selection (e.g., 898) of a second color option (e.g., 896-1) of the second plurality of color options. In some embodiments, in response (1020) to detecting the selection of the second color option, the electronic device changes (1022) a color of the second feature to the second color option and displays (1024) a second color adjustment control (e.g., 899) for the second color option that corresponds to a third set of one or more colors. Displaying the second color adjustment control provides visual feedback to the user that the color of the second feature may be changed with a different set of colors. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the respective feature and the second feature each correspond to portions of an avatar glasses feature (e.g., 8140), the plurality of color options (e.g., 884) correspond to colors for a frame (e.g., 8140-1) of the avatar glasses, and the second plurality of color options (e.g., 896) correspond to colors for lenses (e.g., 8140-2) of the avatar glasses. In some embodiments, the electronic device (e.g., 600) detects an input that corresponds to the second color adjustment control. In response to detecting the input that corresponds to the second color adjustment control, the electronic device modifies an opacity of the lenses of the avatar glasses (e.g., modifying the opacity of the lenses within a range from a maximum value that is completely reflective to a minimum value that is mostly transparent with little reflection). The appearance of the avatar glasses provides feedback to the user indicating the types of characteristics of the avatar that can be customized. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In some embodiments, in response to detecting the selection of the second color option (e.g., 832b), device (e.g., 600) ceases displaying (e.g., in response to detecting the selection of the second color option) the first color adjustment control (e.g., 857) for the color option (e.g., 832a) that corresponds to the second set of one or more colors (e.g., hiding the first color slider). In accordance with some embodiments, after ceasing to display (e.g., in response to detecting the selection of the second color option) the first color adjustment control (e.g., 857) for the color option (e.g., 832a) that corresponds to the second set of one or more colors, the electronic device (e.g. 600) detects a subsequent selection (e.g., 871) of the color option (e.g., 832a) of the plurality of color options that corresponds to the second color. In response to detecting the subsequent selection, the electronic device resumes display of the first color adjustment control for the color option (e.g., see
In accordance with some embodiments, after ceasing to display the first color adjustment control (e.g., 857) that corresponds to the second set of one or more colors, the electronic device maintains display of the color option (e.g., 832a) of the plurality of color options having the modified version of the second set of one or more colors (e.g., as shown in
In some embodiments, modifying the color of the respective feature from the second set of one or more colors to a modified version of the second set of one or more colors based on the second color includes one or more of the following steps. In accordance with a determination that the input (e.g., 860) that corresponds to the first color adjustment control (e.g., 822) includes movement in a second direction, the device (e.g., 600) increases a red value of the second set of one or more colors. In accordance with a determination that the input that corresponds to the first color adjustment control includes movement in a third direction, increase a green value of the second set of one or more colors.
In some embodiments, while the respective feature of the user interface object has the third set of one or more colors, the electronic device (e.g. 600) detects an input (e.g., drag gesture or tap gesture) that corresponds to the second color adjustment control (e.g., 899). In response to detecting the input that corresponds to the second color adjustment control, the electronic device modifies the color of the respective feature from the third set of one or more colors to a modified version of the third set of one or more colors (e.g., a modified color of the respective avatar feature) based on the second color. In some embodiments, this includes one or more of the following steps. In accordance with a determination that the second input that corresponds to the second color adjustment control includes movement in the second direction, increase a red value of the third set of one or more colors. In accordance with a determination that the second input that corresponds to the second color adjustment control includes movement in the third direction, increase a green value of the third set of one or more colors. Modifications of the set of colors are tied to the movement of the user input. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, in response to a determination that the input that corresponds to the first color adjustment control (e.g., 897) includes a first direction, the electronic device (e.g. 600) modifies the second set of one or more colors in a first manner (e.g., adjusting a color gradient of the second set of one or more colors in a first direction (e.g., from cooler tones to warmer tones) based on movement of the input on the first color slider in the first direction). In some embodiments, in response to a determination that a second input that corresponds to the second color adjustment control (e.g., 899) includes the first direction, modifying the third set of one or more colors in the first manner (e.g., adjusting a gradient of the third set of one or more colors based on movement of the input on the second color slider in the first direction (e.g., the same first direction as a movement of the first color slider), in the same manner as the gradient of the second set of one or more colors were adjusted (e.g., also from cooler tones to warmer tones)). Modifications of the set of colors are tied to the movement of the user input. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
Note that details of the processes described above with respect to method 1000 (e.g.,
As described below, method 1100 provides an intuitive way for displaying an avatar editing user interface. The method reduces the cognitive burden on a user for managing avatars, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to modify characteristics of an avatar using an avatar editing user interface faster and more efficiently conserves power and increases the time between battery charges.
The electronic device (e.g. 600) displays (1102), via the display apparatus (e.g. 601), an avatar editing user interface (e.g., 801) that includes displaying (1104): an avatar (e.g., 805) having a plurality of avatar features (e.g., avatar hair, facial features (avatar lips, eyes, nose, etc.), accessories (e.g., earrings, sunglasses, hats)) including a first avatar feature (e.g., skin tone) having a first set of one or more colors and a second avatar feature (e.g., 827, 829) (e.g., facial hair, eyebrows, lips) having a set of one or more colors based on the first set of one or more colors and different from the first set of one or more colors. Displaying the avatar editing user interface also includes displaying (1106) a plurality of color options (e.g., 812) (e.g., a plurality of affordances, each corresponding to a color) corresponding to the first avatar feature. The electronic device detects (1108) selection (e.g., 820) of a respective color option (e.g., 812a) of the plurality of color options. The appearance of the avatar provides feedback to the user indicating the types of characteristics of the avatar that can be customized. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In some embodiments, in response to detecting selection of the respective color option (e.g., 812a) of the plurality of color options of the first avatar feature (e.g., skin tone), in accordance with a determination that the respective color option corresponds to a second set of one or more colors, the electronic device (e.g. 600) updates (1110) an appearance of the avatar (e.g., 805). In some embodiments, updating the appearance of the avatar includes one or more of the following steps. One step includes changing (1112) the first avatar feature (e.g., face of avatar 805) to the second set of one or more colors. Another step includes changing (1114) the second avatar feature (e.g., 827) to a set of one or more colors based on the second set of one or more colors and different from the second set of one or more colors (e.g., the selected color of the first avatar feature provides a color characteristic (e.g., undertone, hue, shading, saturation, midtone, highlight, warmth, etc.) for the modified color of the second avatar feature). The selection of a respective color option for a first avatar feature and changing the first avatar feature in accordance with the selection provides feedback to the user of the modified first avatar feature. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, in response to detecting selection (e.g., 820) of the respective color option (e.g., 812a) of the plurality of color options of the first avatar feature, in accordance with a determination that the respective color option corresponds to a third set of one or more colors, the electronic device (e.g. 600) changes (1118) the first avatar feature and the second avatar feature (e.g., 827) in a different manner (e.g., changing the first and second avatar features based on the selected color option corresponding to the third set of one or more colors rather than the second set of one or more colors; e.g., when the selected color option corresponds to the third set of one or more colors, adjusting a highlight of the first and second avatar features based on the selected color option) than when the respective color option corresponds to the second set of one or more colors (e.g., when the selected color option corresponds to the second set of one or more colors, adjusting a midtone of the first and second avatar features). In some embodiments, the relationship between the selected color option and the first and second avatar features is different for the third set of colors than it is for the second set of one or more colors. For example, the selected color option corresponding to the second set of one or more colors is used to adjust highlights for the first and/or second avatar features, whereas the selected color option corresponding to the third set of one or more colors is used to adjust midtones for the first and/or second avatar features. The selection of a respective color option for a first avatar feature and changing the first avatar feature in accordance with the selection provides feedback to the user of the modified first avatar feature. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the electronic device (e.g. 600) displays, via the display apparatus (e.g. 601), a second plurality of color options (e.g., 832) corresponding to a third avatar feature (e.g., 851) (e.g., hair color). Device detects selection (e.g., 852) of a first color option (e.g., 832a) of the second plurality of color options. In response to detecting selection of the first color option of the second plurality of color options of the third avatar feature, and in accordance with a determination that the first color option corresponds to a fourth set of one or more colors, the electronic device updates the appearance of the avatar (e.g., 805). Updating the avatar includes changing the third avatar feature (e.g., 851) to the fourth set of one or more colors and changing the second avatar feature (e.g., eyebrow color 827) to a set of one or more colors based on the fourth set of one or more colors and different from the fourth set of one or more colors. In some embodiments, the avatar's facial hair color (e.g., eyebrow color) is affected by both the hair color and the skin tone. The appearance of the avatar provides feedback to the user indicating the types of characteristics of the avatar that can be customized. The selection of a first color option for a third avatar feature and changing the third avatar feature in accordance with the selection provides feedback to the user of the modified first avatar feature. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the electronic device (e.g. 600) detects selection (e.g., 861) of a second color option (e.g., 832b) of the second plurality of color options (e.g., 832). In response to detecting selection of the second color option of the second plurality of color options of the third avatar feature and in accordance with a determination that the first color option corresponds to a fifth set of one or more colors, the electronic device changes the third avatar feature (e.g., skin tone) and the second avatar feature (e.g., 827) in a different manner (e.g., changing the third and second avatar features based on the second color option corresponding to the fifth set of one or more colors rather than the fourth set of one or more colors) than when the first color option is selected. In some embodiments, the relationship between the selected color option (e.g., the second color option) and the third and second avatar features is different for the fifth set of colors than it is for the fourth set of one or more colors. For example, the selected color option corresponding to the fourth set of one or more colors is used to adjust highlights for the third and/or second avatar features, whereas the selected color option corresponding to the fifth set of one or more colors is used to adjust midtones for the third and/or second avatar features. In some embodiments, the first avatar feature corresponds to avatar hair color. In some embodiments, the second avatar feature corresponds to avatar eyebrows. In some embodiments, the third avatar feature corresponds to avatar skin tone. The selection of a second color option for a second avatar feature and changing the second avatar feature in accordance with the selection provides feedback to the user of the modified second avatar feature. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the third avatar feature (e.g., avatar skin tone) and the second avatar feature (e.g., 827) (e.g., avatar eyebrows) are changed in a first manner that includes adjusting a first color property (e.g., a color hue) based on the second set of one or more colors corresponding to the first avatar feature (e.g., avatar hair color). In some embodiments, the third avatar feature and the second avatar feature are changed in a second manner that includes adjusting a second color property (e.g., a color luminance) that is different from the first color property based on the fourth set of one or more colors corresponding to the third avatar feature (e.g., the avatar eyebrows are darker than the avatar skin tone). A third avatar feature and a second avatar feature are adjusted in accordance with a first color property corresponding to a first avatar feature. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, in response to detecting selection (e.g., 820) of the respective color option (e.g., 812a) of the plurality of color options (e.g., 812), the electronic device (e.g., 600) displays (1116) a color adjustment control (e.g., 822) (e.g., a slider user interface) for the respective color option that corresponds to the second set of one or more colors. In some embodiments, the color adjustment control is a color adjustment control as described with respect to method 1000 and
In accordance with some embodiments, the second avatar feature corresponds to avatar lips (e.g., 828) having an avatar lip color that corresponds to the set of one or more colors based on the second set of one or more colors and different from the second set of one or more colors. In some embodiments, the device detects an input (e.g., drag gesture or tap gesture) that corresponds to the color adjustment control (e.g., 892, 893). In response to detecting the input, the electronic device (e.g. 600) modifies the avatar lip color of a first portion (e.g., outer portion (e.g. 828a)) of the avatar lips and maintains the avatar lip color of a second portion (e.g., inner portion (e.g., 828b)) of the avatar lips. The appearance of the second avatar feature provides feedback to the user indicating the types of characteristics of the avatar that can be customized. The selection of a color option for an avatar feature from the color adjustment control provides feedback to the user of the modified first avatar feature. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the first avatar feature corresponds to avatar skin. In some embodiments, the second avatar feature corresponds to avatar lips (e.g., 828). In some embodiments, the set of one or more colors based on the second set of one or more colors includes the second set of one or more colors and a red value (e.g., the avatar lips are based on the skin tone and a shade of red (e.g., a natural shade such as pink, or a shade representing a lipstick tint)). The appearance of the avatar skin tone provides feedback to the user indicating the skin tone of the avatar can be customized. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
Note that details of the processes described above with respect to method 1100 (e.g.,
As described below, method 1200 provides an intuitive way for displaying an avatar editing user interface. The method reduces the cognitive burden on a user for managing avatars, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to modify characteristics of an avatar using an avatar editing user interface faster and more efficiently conserves power and increases the time between battery charges.
The electronic device (e.g. 600) displays (1202), via the display apparatus (e.g. 601), an avatar editing user interface (e.g., 801) that includes displaying (1204): an avatar (e.g., 805) having a plurality of avatar features including avatar hair (e.g., 851) having a selected avatar hairstyle (e.g., 836b) (e.g., a particular styling of the avatar hair that was selected (e.g., by a user) for the avatar). The avatar editing user interface also includes (1206) a plurality of avatar accessory options (e.g., 8112) (e.g., affordances corresponding to various avatar accessories (e.g., glasses, hats, earrings, scarves, etc.)). The appearance of the avatar hair and avatar accessory options provides feedback to the user indicating the hairstyle and avatar accessories can be customized. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
The electronic device (e.g. 600) detects (1208) selection of a respective accessory option (e.g., 8112b). In response to detecting the selection of the respective accessory option of the plurality of avatar accessory options (e.g., 8112), the electronic device changes (1210) an appearance of the avatar (e.g., 805) to include a representation of the respective accessory option (e.g., 8140), including, in accordance with a determination that the respective accessory option is a first accessory option (e.g., 8112b) (e.g., a glasses accessory option): displaying (1212) the representation of the first accessory option (e.g., 8140) positioned on the avatar (e.g., displaying the selected glasses on the avatar's face with the temple positioned along the side of the avatar's head and the earpiece positioned behind the avatar's ear). The electronic device modifies (1214) a geometry of a first portion (e.g., 8145) of the avatar hair based on the position of the representation of the first accessory option on the avatar, while maintaining the selected avatar hairstyle (e.g., a portion of the avatar hair located adjacent the glasses is displayed pushed aside to accommodate the presence of the glasses on the avatar's face, including the positioning of the temple and the earpiece behind the avatar's ear, while the remaining portions of the avatar hair remain unchanged to represent the selected avatar hairstyle). The appearance of the avatar accessory option provides feedback to the user indicating the accessories of the avatar can be customized. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, an appearance of the representation of the respective accessory option (e.g., 8108d) is based on one or more characteristics (e.g., hair type, hairstyle, hair length, etc.) of the avatar hair (e.g., 851). In some embodiments, the size of an accessory option (e.g., a hat (e.g., 8170)) is determined based on the avatar hair. For example, if the avatar hair has a small hairstyle (e.g., 851-1) (e.g., 836c) (a buzz or bald hairstyle), a hat has a small hatline circumference (e.g., hatline 8118 in
In accordance with some embodiments, in accordance with a determination that the respective accessory option is a second accessory option (e.g., an accessory option different than the first accessory option; e.g., a hat, 8170): the electronic device (e.g. 600) displays the representation of the second accessory option (e.g., 8170) positioned on the avatar (e.g., displaying the selected hat on the avatar's head with a hatline (e.g., 8118) of the hat positioned on the avatar's head based on the type of hat selected). The electronic device modifies a geometry of a second portion of the avatar hair (e.g., hair at 8118, 8118-1, or 8118-2) different from the modified geometry of the first portion (e.g., 8145) of the avatar hair based on the position of the representation of the second accessory option on the avatar, while maintaining the selected avatar hairstyle (e.g., the avatar hair is modified at the hatline of the hat such that the avatar hair is compressed at the hatline, causing the hair positioned below and/or above the hatline (depending on the selected hat and hairstyle) to flared out in response to the compression of the hair at the hatline). The appearance of the avatar displayed with the accessory option provides feedback to the user indicating the customization of the avatar with the selected accessories. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, after displaying the representation (e.g., 8140) of the first accessory option position on the avatar, the electronic device (e.g. 600) detects (1216) selection (e.g., 8159) of a second respective accessory option (e.g., 8108d) (e.g., an avatar hat). In response to detecting the selection of the second respective accessory option of the plurality of avatar accessory options, the electronic device changes (1218) the appearance of the avatar (e.g., 805) to include a representation (e.g., 8160) of the second respective accessory option and the representation of the respective accessory option (e.g., the avatar is updated to include both an avatar hat and avatar glasses while maintaining the selected avatar hairstyle). The appearance of the avatar with the selected accessories provides feedback to the user indicating the accessories of the avatar can be customized. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the electronic device (e.g. 600) displays, via the display apparatus (e.g. 601), a plurality of avatar hairstyle options (e.g., 836) (e.g., including a hairstyle option corresponding to the selected avatar hairstyle). The electronic device detects selection (e.g., 872) of a second hairstyle option (e.g., 836c in
In accordance with a determination that the respective accessory option (e.g., 8108d) is a second type of accessory option (e.g., 8108) (e.g., a hat displayed on the avatar adjacent at least a portion of the avatar hair), the electronic device (e.g. 600) displays the avatar hair (e.g., 851) having the second hairstyle option (e.g., 836c) modified in a second manner (e.g., puffing out at 8118-1 or 8118-2) based on the representation of the respective accessory option (e.g., the geometry of a second portion of the avatar hair is modified based on a position of the hat, while still maintaining the second avatar hairstyle). The appearance of the avatar displayed with the accessory option provides feedback to the user indicating the customization of the avatar with the selected accessories. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, in accordance with a determination that the respective accessory option is a third type (e.g., an accessory option that does not affect the displayed avatar hairstyle; e.g., a nose ring), the electronic device (e.g. 600) displays the avatar hair (e.g., 851) having the second hairstyle option (e.g., 836c) without modification (e.g., without modification based on the respective accessory option). The appearance of the avatar displayed with the hairstyle and accessory option provides feedback to the user indicating the customization of the avatar with the selected hairstyle. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, in response to detecting a selection of a third hairstyle option (e.g., 851-2 in
In accordance with some embodiments, the respective accessory option is an avatar hat (e.g., 8160) and changing the appearance of the representation of the respective accessory option includes changing a size of the representation of the avatar hat based on a size (e.g., simulated hair volume) of the third hairstyle option (e.g., 851-2) (e.g., selecting a larger hairstyle increases the size of the hat to accommodate the larger hairstyle; e.g., selecting a smaller hairstyle decreases the size of the hat to accommodate the smaller hairstyle). In some embodiments, changing the appearance of the representation of the respective accessory option further includes changing a size of a hatline (e.g., a portion of the hat that fits onto the head to affix the hat to the head) of the representation of the avatar hat based on the size of the third hairstyle option (e.g., a circumference of the hatline changes (increases or decreases) based on the size of the hairstyle option). In some embodiments, the hatline remains at a same location relative to the head such that the hatline continues to intersect the head at the same location, but has a different circumference). The appearance of the avatar displayed with a hat option provides feedback to the user indicating the customization of the avatar with the selected hat. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the first accessory option is an avatar hat (e.g., 8160) and displaying the representation of the first accessory option positioned on the avatar (e.g., 805) includes displaying the avatar hat positioned over a portion of the avatar hair (e.g., 851) (e.g., the avatar hat is displayed overlaid on a top portion of the avatar head and adjacent hair). In some embodiments, modifying the geometry of the portion of the avatar hair includes displaying the avatar hair having a compressed appearance at a location (e.g., 8118-1 or 8118-2) adjacent a hatline (e.g., a portion of the hat that fits onto the head to affix the hat to the head) of the avatar hat and expanding as the avatar hair extends from the location adjacent the hatline of the avatar hat (e.g., the avatar hair is modified at the hatline of the hat such that the avatar hair is compressed at the hatline, causing the hair positioned below and/or above the hatline (depending on the selected hat and hairstyle) to flared out in response to the compression of the hair at the hatline). The appearance of the avatar displayed with a hat option provides feedback to the user indicating the customization of the avatar with the selected hat. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, in response to detecting a selection (e.g., 8168) of a second avatar hat option (e.g., 8108e) of the plurality of avatar accessory options (e.g., 8108), the electronic device (e.g. 600) replaces the representation of the avatar hat (e.g., 8160) with a representation of the second avatar hat (e.g., 8170), while maintaining the hatline (e.g., 8118) and the geometry of the portion of the avatar hair having the compressed appearance at the location adjacent the hatline and expanding as the avatar hair extends from the location adjacent the hatline (e.g., different avatar hats have the same hatline; e.g., selecting a different avatar hat replaces the currently selected avatar hat with the different avatar hat while maintaining hatline and the shape of the avatar hair relative to the hatline). The appearance of the avatar displayed with a hat option provides feedback to the user indicating the customization of the avatar with the selected hat. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the avatar hair (e.g., 851) moves in accordance with a simulated physical reaction of the avatar hair to avatar movement based on a physics model (e.g., shown in
In accordance with some embodiments, the first accessory option is avatar glasses (e.g., 8140) and modifying the geometry of the portion of the avatar hair (e.g., 851) includes displaying the portion (e.g., 8145) of the avatar hair positioned so as to avoid obstructing at least a portion of the avatar glasses (e.g., the hair on the side of the avatar head, above the avatar ears, is moved behind or to the side or otherwise positioned behind the temples of the glasses). In some embodiments, the first accessory option is avatar glasses and displaying the representation of the first accessory option positioned on the avatar includes: displaying a representation of a reflection (e.g., 8150) on a lens portion (e.g., 8140-2) of the avatar glasses (e.g., the representation of the reflection is overlaid on the representation of the glasses) (e.g., the position of the reflection on the glasses is determined based on a relative position of the displayed glasses and a simulated light source that is, optionally, determined based on a detected light source in a field of view of a camera) and displaying a representation of a shadow cast by the representation of the avatar glasses that is displayed on at least a portion of the avatar (e.g., the representation of the shadow cast by the glasses is overlaid on the representation of the avatar with an opacity less than 100%) (e.g., a portion of the avatar that is determined based on a relative position of the displayed avatar and a simulated light source that is, optionally, determined based on a detected light source in a field of view of a camera). The appearance of the avatar displayed with a glasses option provides feedback to the user indicating the customization of the avatar with the selected hat. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, displaying the representation of the first accessory option positioned on the avatar includes: displaying a representation of one or more shadows (e.g., 8142, 8147, 8172) cast (e.g., cast on the avatar) by the first accessory option (e.g., an avatar hat (e.g., 8170) or avatar glasses (e.g., 8140)) or the avatar hair (e.g., 851) (e.g., the representation of the shadow cast by the hair, glasses, and/or hat is overlaid on the representation of the avatar with an opacity less than 100%) (e.g., a portion of the avatar that is determined based on a relative position of the displayed avatar and a simulated light source that is, optionally, determined based on a detected light source in a field of view of a camera). The appearance of the avatar displayed with shadow provides feedback to the user indicating a more realistic representation of the avatar. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the first accessory option is an avatar earring (e.g., 8125). The avatar earrings move in accordance with a physics model (e.g., a model of inertia, a model of gravity, a force transfer model, a friction model) (In some embodiments, the avatar moves based on detected changes in a face within the field of view of one or more cameras of the electronic device). The appearance of the avatar displayed with earrings provides feedback to the user indicating the customization of the avatar with the selected earrings. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
Note that details of the processes described above with respect to method 1200 (e.g.,
In
As shown in
In
In
In some embodiments, device 600 displays the avatar's tongue sticking out of the avatar's mouth in response to detecting the user's tongue extending from the user's mouth. For example, in
In some embodiments, device 600 displays the transition from no tongue extended (e.g., see tongue 1322-3 in
In some embodiments, device 600 displays movement of an avatar tongue based on detected movement of features of the user's face other than the user's tongue (e.g., tilting or rotation of the user's head, or movement of jaw 1325-2 up/down and/or side-to-side). For example,
In some embodiments, device 600 modifies movement of an avatar tongue based on a physics model (e.g., a modeled gravity, inertia, etc.) applied to the avatar. As the avatar's tongue extends farther from the avatar's mouth, the tongue's response to the physics model is exacerbated based on the amount of tongue extended from the avatar's mouth. For example, in
In some embodiments, device 600 does not modify the avatar to display particular facial expressions (or reduces the movement of avatar features (e.g., lips, mouth, etc.) that form the particular facial expressions) when the avatar's tongue is extended. This is to avoid modifying the avatar in a way that interferes with (e.g., impinges or collides with) the displayed avatar tongue. For example, device 600 can forego modifying the avatar's lips to form a lip pucker, closing the avatar mouth, extending the bottom lip (e.g., a pouting pose), or extending the lips and moving the mouth to a closed position (e.g., funneling the mouth).
In
When robot avatar 1323 is positioned in the center of condensed avatar selection interface 1315, device 600 begins modifying the robot avatar based on the detected face 1325. As shown in
As shown in
For example, in
In
In some embodiments, device 600 displays an avatar tongue having a visual effect that is determined based on the specific avatar. For example, a robot avatar tongue has a hinged connection, a unicorn avatar has a glittery tongue, and an alien avatar has an iridescent effect. In some embodiments, the visual effect changes based on a displayed position of the avatar tongue. For example,
In some embodiments, device 600 displays an avatar tongue having different shapes depending on the position of the avatar's mouth (which is determined based on a detected position of the user's mouth). For example, when user mouth 1325-1 is opened, device 600 displays the avatar tongue having a flat shape as shown by monkey tongue 1322-3 in
As described below, method 1400 provides an intuitive way for modifying an avatar in an avatar navigation user interface. The method reduces the cognitive burden on a user for modifying avatars, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to modify characteristics of an avatar using an avatar navigation user interface faster and more efficiently conserves power and increases the time between battery charges.
The electronic device (e.g. 600) displays (1402), via the display apparatus (e.g. 601), a virtual avatar (e.g., 1322, 1323, 1324), having a plurality of avatar features (e.g., 1322-1, 1322-2, 1322-3) (e.g., a facial feature (e.g., eyes, mouth, part of mouth) or macro feature (e.g., head, neck)), that changes appearance in response to detected changes in pose (e.g., orientation, translation) (e.g., a change in a facial expression) of a face (e.g., 1325) in a field of view of the one or more cameras (e.g. 602). While the face is detected in the field of view of the one or more cameras, the face including a plurality of detected facial features including a first facial feature (e.g., 1325-2) other than a tongue of the user (e.g., a jaw), the electronic device detects (1404) movement of the first facial feature. Displaying the appearance of the avatar provides feedback to the user indicating the customization of particular features of the avatar. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In response to detecting (1406) movement of the first facial feature (e.g., 1325-2), the device (e.g., 600) performs one or more of the following steps. In accordance (1408) with a determination that the tongue of the user (e.g., 1325-3) meets respective criteria (e.g., tongue-display criteria) wherein the respective criteria include a requirement that the tongue of the user is visible (e.g., as shown in
The electronic device (e.g. 600) modifies (1408) a position of the avatar tongue (e.g., 1322-3) based on (e.g., a direction and magnitude of) the movement of the first facial feature (e.g., 1325-2) (e.g., a position of the avatar tongue is determined based on the detected position (e.g., within a range from fully opened to fully closed) of the user's jaw). In some embodiments, in response to detecting movement of the first facial feature, an avatar feature (e.g., 1322-2) (e.g., an avatar feature other than the avatar tongue) that corresponds to the first facial feature is also modified/moved based on the detected movement of the first facial feature.). In accordance with a determination that the tongue of the user does not meet the respective criteria, the electronic device forgoes (1414) display of the avatar tongue.
In accordance with some embodiments, the avatar tongue (e.g., 1323-3) includes a first portion (e.g., 1323-3a) and a second portion (e.g., 1323-3b) and the second portion is connected to the first portion by a connector (e.g., 1323-4) (e.g., a hinge) that is more flexible than the first portion or the second portion (e.g., the avatar tongue has two or more segments that are joined at one or more hinges). In some embodiments, the avatar tongue is formed of hinged segments when the virtual avatar is a robot avatar (e.g., 1323). In some embodiments, the first portion and the second portion are rigid. In some embodiments, the first portion dangles freely when the avatar tongue is extended and moves in accordance with movement of the user's head (e.g., as shown in
In accordance with some embodiments, the avatar tongue (e.g., 1323-3) has a visual effect (e.g., 1324-4) (e.g., glitter, iridescence) that changes in response to modifying a position of the avatar tongue. In some embodiments, the virtual avatar is a unicorn and the avatar tongue includes a glittery effect that sparkles as the avatar tongue moves. In some embodiments, the virtual avatar is an alien (e.g., 1324) and the avatar tongue includes an iridescent effect that changes as the avatar tongue moves. The display of the visual effect of the avatar tongue movement provides feedback to the user indicating the movement of the avatar tongue in accordance with the movement of the user. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In some embodiments, modifying the position of the avatar tongue (e.g., 1322-3) based on the movement of the first facial feature (e.g., 1325-2) includes one or more of the following steps. In accordance with a determination that the first facial feature moves in a first direction (e.g., the user's jaw moves to the left and/or up), the electronic device (e.g., 600) modifies (1410) the position of the avatar tongue in the first direction (e.g., moving the avatar tongue to the left and/or up). In accordance with a determination that the first facial feature moves in a second direction different from the first direction (e.g., the user's jaw moves to the right and/or down), the electronic device modifies (1412) the position of the avatar tongue in the second direction (e.g., moving the avatar tongue to the right and/or down). The display of the avatar tongue provides feedback to the user indicating the movement of the avatar tongue in accordance with the movement of a first facial feature. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, modifying the position of the avatar tongue (e.g., 1322-3) based on the movement of the first facial feature (e.g., 1325-2) includes one or more of the following steps. In accordance with a determination that the first facial feature moves by a first magnitude (e.g., the user's jaw moves 30 degrees to the right from a front-facing position), modifying the position of the avatar tongue by an amount proportional to the first magnitude (e.g., the avatar tongue moves 30 degrees to the right from a front-facing position). In accordance with a determination that the first facial feature moves by a second magnitude different from the first magnitude (e.g., the user's jaw moves 45 degrees to the right from a front-facing position), the electronic device (e.g. 600) modifies the position of the avatar tongue by an amount proportional to the second magnitude (e.g., the avatar tongue moves 45 degrees to the right from a front-facing position). The display of the avatar tongue provides feedback to the user indicating the movement of the avatar tongue in accordance with the movement of a first facial feature. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the avatar tongue (e.g., 1322-3) moves in accordance with a physics model (e.g., a model of inertia, a model of gravity, a force transfer model, a friction model). In some embodiments, a degree of movement (e.g., a degree of movement in accordance with the physics model based on movement of the head and/or a facial feature) of the avatar tongue increases (e.g., or decreases) based on an increasing (e.g., or decreasing) amount of the tongue extended from a mouth of the virtual avatar (e.g., 1322). The physical model allows the avatar tongue to be displayed realistically in accordance with the movement of the subject. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, while the avatar tongue (e.g., 1324-3) is displayed, the electronic device (e.g. 600) detects (1416) that the tongue (e.g., 1325-3) of the user no longer meets the respective criteria (e.g., tongue-display criteria). In response to detecting that the tongue of the user no longer meets the respective criteria, the electronic device ceases (1418) to display the avatar tongue (e.g.,
In accordance with some embodiments, the electronic device (e.g. 600) detects movement of a second facial feature (e.g., a user's mouth; 1325-1) to a first position (e.g.,
In accordance with some embodiments, the second facial feature is a mouth (e.g., 1325-1) of the user, the first position of the second facial feature corresponds to a position in which the mouth of the user is closed (e.g., with the jaw opened) and the first avatar feature is an avatar mouth. In some embodiments, a movement of the avatar's mouth is dampened, in comparison to movement of a mouth of a face detected in the field of view of one or more cameras (e.g. 602) of the device, so as to avoid the mouth fully closing and thereby colliding with or impinging on the extended avatar tongue. The display of the avatar tongue provides feedback to the user indicating the movement of the avatar tongue in accordance the user closing his mouth. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the device) which, additionally, reduces power usage and improves battery life of the device by enabling the user to use the device more quickly and efficiently.
In accordance with some embodiments, the second facial feature is a bottom lip of the user, the first position of the second facial feature corresponds to a position in which the bottom lip of the user is extended (e.g., the user's bottom lip is sticking out in a pouting pose), and the first avatar feature is a bottom lip of the avatar. In some embodiments, a movement of the avatar's bottom lip is dampened, in comparison to movement of a bottom lip of a face detected in the field of view of one or more cameras (e.g. 602) of the device, so as to avoid the bottom lip fully colliding with or impinging on the extended avatar tongue.
In accordance with some embodiments, the second facial feature is an upper lip and bottom lip of the user, the first position of the second facial feature corresponds to a position in which the upper lip and bottom lip of the user are puckered, and the first avatar feature is an upper lip and bottom lip of the avatar. In some embodiments, a movement of the avatar's upper lip and bottom lip is dampened, in comparison to movement of a upper lip and bottom lip of a face detected in the field of view of one or more cameras (e.g. 602) of the device, so as to avoid the lips colliding with or impinging on the extended avatar tongue.
In accordance with some embodiments, the second facial feature is a mouth (e.g., 1325-1) of the user, the first position of the second facial feature corresponds to a position in which the mouth of the user is closing (e.g., an intermediate position of the mouth moving from an open position to a closed position with the user's lips puckered), and the first avatar feature is an avatar mouth. In some embodiments, a movement of the avatar's mouth is dampened, in comparison to movement of a mouth of a face detected in the field of view of one or more cameras (e.g. 602) of the device, so as to avoid the mouth closing and thereby colliding with or impinging on the extended avatar tongue.
In accordance with some embodiments, displaying the avatar tongue (e.g., 1322-3) includes one or more of the following steps. Detecting a position of a third facial feature (e.g., 1325-1) (e.g., a user's mouth). In accordance with a determination that the third facial feature has a first position (e.g., a substantially closed position), the electronic device (e.g. 600) displays the avatar tongue having a first shape (e.g., shown in
Note that details of the processes described above with respect to method 1400 (e.g.,
The foregoing description, for purpose of explanation, has been described with reference to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the techniques and their practical applications. Others skilled in the art are thereby enabled to best utilize the techniques and various embodiments with various modifications as are suited to the particular use contemplated.
Although the disclosure and examples have been fully described with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of the disclosure and examples as defined by the claims.
As described above, one aspect of the present technology is the gathering and use of data available from various sources for sharing with other users. The present disclosure contemplates that in some instances, this gathered data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data can include demographic data, location-based data, telephone numbers, email addresses, twitter IDs, home addresses, data or records relating to a user's health or level of fitness (e.g., vital signs measurements, medication information, exercise information), date of birth, or any other identifying or personal information.
The present disclosure recognizes that the use of such personal information data, in the present technology, can be used to the benefit of users. For example, the personal information data can be used to better represent a user in a conversation. Further, other uses for personal information data that benefit the user are also contemplated by the present disclosure. For instance, health and fitness data may be used to provide insights into a user's general wellness, or may be used as positive feedback to individuals using technology to pursue wellness goals.
The present disclosure contemplates that the entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information data will comply with well-established privacy policies and/or privacy practices. In particular, such entities should implement and consistently use privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining personal information data private and secure. Such policies should be easily accessible by users, and should be updated as the collection and/or use of data changes. Personal information from users should be collected for legitimate and reasonable uses of the entity and not shared or sold outside of those legitimate uses. Further, such collection/sharing should occur after receiving the informed consent of the users. Additionally, such entities should consider taking any needed steps for safeguarding and securing access to such personal information data and ensuring that others with access to the personal information data adhere to their privacy policies and procedures. Further, such entities can subject themselves to evaluation by third parties to certify their adherence to widely accepted privacy policies and practices. In addition, policies and practices should be adapted for the particular types of personal information data being collected and/or accessed and adapted to applicable laws and standards, including jurisdiction-specific considerations. For instance, in the US, collection of or access to certain health data may be governed by federal and/or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); whereas health data in other countries may be subject to other regulations and policies and should be handled accordingly. Hence different privacy practices should be maintained for different personal data types in each country.
Despite the foregoing, the present disclosure also contemplates embodiments in which users selectively block the use of, or access to, personal information data. That is, the present disclosure contemplates that hardware and/or software elements can be provided to prevent or block access to such personal information data. For example, in the case of sending an avatar, the present technology can be configured to allow users to select to “opt in” or “opt out” of participation in the collection of personal information data during registration for services or anytime thereafter. In addition to providing “opt in” and “opt out” options, the present disclosure contemplates providing notifications relating to the access or use of personal information. For instance, a user may be notified upon downloading an app that their personal information data will be accessed and then reminded again just before personal information data is accessed by the app.
Moreover, it is the intent of the present disclosure that personal information data should be managed and handled in a way to minimize risks of unintentional or unauthorized access or use. Risk can be minimized by limiting the collection of data and deleting data once it is no longer needed. In addition, and when applicable, including in certain health related applications, data de-identification can be used to protect a user's privacy. De-identification may be facilitated, when appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of data stored (e.g., collecting location data a city level rather than at an address level), controlling how data is stored (e.g., aggregating data across users), and/or other methods.
Therefore, although the present disclosure broadly covers use of personal information data to implement one or more various disclosed embodiments, the present disclosure also contemplates that the various embodiments can also be implemented without the need for accessing such personal information data. That is, the various embodiments of the present technology are not rendered inoperable due to the lack of all or a portion of such personal information data.
This application is a continuation of U.S. application Ser. No. 17/370,505, filed Jul. 8, 2021, and entitled “Avatar Creation User Interface,” which is a continuation of U.S. application Ser. No. 17/091,460, filed Nov. 6, 2020, now U.S. Pat. No. 11,380,077, and entitled “Avatar Creation User Interface,” which is a continuation of U.S. application Ser. No. 16/519,850, filed Jul. 23, 2019, now U.S. Pat. No. 10,861,248, and entitled “Avatar Creation User Interface,” which is a continuation of U.S. application Ser. No. 16/142,288, filed Sep. 26, 2018, now U.S. Pat. No. 10,410,434, and entitled “Avatar Creation User Interface,” which claims the benefit of U.S. Provisional Application No. 62/668,200, filed May 7, 2018, and entitled “Avatar Creation User Interface,” and the benefit of U.S. Provisional Application No. 62/679,950, filed Jun. 3, 2018, and entitled “Avatar Creation User Interface,” the contents of which are hereby incorporated by reference in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 3633354 | Stemmler | Jan 1972 | A |
| 4847819 | Hong | Jul 1989 | A |
| 4945521 | Klaus | Jul 1990 | A |
| 5383165 | Vaucher | Jan 1995 | A |
| 5559947 | Wugofski | Sep 1996 | A |
| 5995119 | Cosatto et al. | Nov 1999 | A |
| 6084598 | Chekerylla | Jul 2000 | A |
| 6088040 | Oda et al. | Jul 2000 | A |
| 6173402 | Chapman | Jan 2001 | B1 |
| 6323846 | Westerman et al. | Nov 2001 | B1 |
| 6545682 | Ventrella et al. | Apr 2003 | B1 |
| 6570557 | Westerman et al. | May 2003 | B1 |
| 6621524 | Iijima et al. | Sep 2003 | B1 |
| 6919892 | Cheiky et al. | Jul 2005 | B1 |
| 7027054 | Cheiky et al. | Apr 2006 | B1 |
| 7046838 | Sakagawa et al. | May 2006 | B1 |
| 7180524 | Axelrod | Feb 2007 | B1 |
| 7227976 | Jung et al. | Jun 2007 | B1 |
| 7657849 | Chaudhri et al. | Feb 2010 | B2 |
| 7716057 | Horvitz | May 2010 | B2 |
| 7751285 | Cain et al. | Jul 2010 | B1 |
| 7908554 | Blattner | Mar 2011 | B1 |
| 8130219 | Fleury et al. | Mar 2012 | B2 |
| 8131848 | Denise | Mar 2012 | B1 |
| 8156060 | Borzestowski et al. | Apr 2012 | B2 |
| 8169438 | Baraff et al. | May 2012 | B1 |
| 8234218 | Robinson et al. | Jul 2012 | B2 |
| 8254647 | Nechyba et al. | Aug 2012 | B1 |
| 8280979 | Kunz et al. | Oct 2012 | B2 |
| 8295546 | Craig et al. | Oct 2012 | B2 |
| 8390628 | Harding et al. | Mar 2013 | B2 |
| 8423089 | Song et al. | Apr 2013 | B2 |
| 8488040 | Chen et al. | Jul 2013 | B2 |
| 8601379 | Marks et al. | Dec 2013 | B2 |
| 8867849 | Kirkham et al. | Oct 2014 | B1 |
| 8896652 | Ralston | Nov 2014 | B2 |
| 8949618 | Lee et al. | Feb 2015 | B1 |
| 8988490 | Fujii | Mar 2015 | B2 |
| 9094576 | Karakotsios | Jul 2015 | B1 |
| 9104908 | Rogers et al. | Aug 2015 | B1 |
| 9153031 | El-Saban et al. | Oct 2015 | B2 |
| 9170645 | Park et al. | Oct 2015 | B2 |
| 9207837 | Paretti et al. | Dec 2015 | B2 |
| 9230241 | Singh et al. | Jan 2016 | B1 |
| 9230355 | Ahuja et al. | Jan 2016 | B1 |
| 9245177 | Perez | Jan 2016 | B2 |
| 9246961 | Walkin et al. | Jan 2016 | B2 |
| 9264660 | Petterson et al. | Feb 2016 | B1 |
| 9269196 | Fan et al. | Feb 2016 | B1 |
| 9298257 | Hwang et al. | Mar 2016 | B2 |
| 9298263 | Geisner et al. | Mar 2016 | B2 |
| 9349414 | Furment et al. | May 2016 | B1 |
| 9411506 | Marra et al. | Aug 2016 | B1 |
| 9448708 | Bennett et al. | Sep 2016 | B1 |
| 9451210 | Smus | Sep 2016 | B1 |
| 9542070 | Xu et al. | Jan 2017 | B2 |
| 9576400 | Van Os et al. | Feb 2017 | B2 |
| 9602559 | Barros et al. | Mar 2017 | B1 |
| 9625987 | Lapenna et al. | Apr 2017 | B1 |
| 9628416 | Henderson | Apr 2017 | B2 |
| 9639974 | Smith et al. | May 2017 | B2 |
| 9686497 | Terry | Jun 2017 | B1 |
| 9747716 | Mallet et al. | Aug 2017 | B1 |
| 9760976 | Kameyama | Sep 2017 | B2 |
| 9786084 | Bhat et al. | Oct 2017 | B1 |
| 9913246 | Carey et al. | Mar 2018 | B1 |
| 9948589 | Gonnen et al. | Apr 2018 | B2 |
| 9949697 | Iscoe et al. | Apr 2018 | B2 |
| 10062133 | Mishra et al. | Aug 2018 | B1 |
| 10095385 | Walkin et al. | Oct 2018 | B2 |
| 10139218 | Matsushita | Nov 2018 | B2 |
| 10155168 | Blackstock et al. | Dec 2018 | B2 |
| 10169897 | Geiger et al. | Jan 2019 | B1 |
| 10171985 | Czajka et al. | Jan 2019 | B1 |
| 10237276 | Gupta | Mar 2019 | B2 |
| 10262327 | Hardebeck et al. | Apr 2019 | B1 |
| 10270983 | Van Os et al. | Apr 2019 | B1 |
| 10289265 | Kulkarni | May 2019 | B2 |
| 10325416 | Scapel et al. | Jun 2019 | B1 |
| 10325417 | Scapel | Jun 2019 | B1 |
| 10375313 | Van Os et al. | Aug 2019 | B1 |
| 10376153 | Tzvieli et al. | Aug 2019 | B2 |
| 10379719 | Scapel et al. | Aug 2019 | B2 |
| 10397391 | Czajka et al. | Aug 2019 | B1 |
| 10410434 | Scapel et al. | Sep 2019 | B1 |
| 10496244 | Reynolds et al. | Dec 2019 | B2 |
| 10505726 | Andon et al. | Dec 2019 | B1 |
| 10521091 | Anzures et al. | Dec 2019 | B2 |
| 10521948 | Rickwald et al. | Dec 2019 | B2 |
| 10580221 | Scapel et al. | Mar 2020 | B2 |
| 10607065 | Milman et al. | Mar 2020 | B2 |
| 10607419 | Van Os et al. | Mar 2020 | B2 |
| 10620590 | Guzman et al. | Apr 2020 | B1 |
| 10628985 | Mishra et al. | Apr 2020 | B2 |
| 10657695 | Chand et al. | May 2020 | B2 |
| 10659405 | Chang et al. | May 2020 | B1 |
| 10698575 | Walkin et al. | Jun 2020 | B2 |
| 10708545 | Rivard et al. | Jul 2020 | B2 |
| 10789753 | Miller et al. | Sep 2020 | B2 |
| 10796480 | Chen et al. | Oct 2020 | B2 |
| 10798035 | Lewis et al. | Oct 2020 | B2 |
| 10810409 | Bacivarov et al. | Oct 2020 | B2 |
| 10817981 | Belkin | Oct 2020 | B1 |
| 10845968 | Scapel et al. | Nov 2020 | B2 |
| 10855910 | Tano et al. | Dec 2020 | B2 |
| 10902661 | Mourkogiannis et al. | Jan 2021 | B1 |
| 10931813 | Kim et al. | Feb 2021 | B1 |
| 10984569 | Bondich et al. | Apr 2021 | B2 |
| 11055889 | Lee et al. | Jul 2021 | B2 |
| 11061372 | Chen et al. | Jul 2021 | B1 |
| 11107261 | Scapel et al. | Aug 2021 | B2 |
| 11217036 | Albuz et al. | Jan 2022 | B1 |
| 11467713 | Buzyn et al. | Oct 2022 | B2 |
| 20010019330 | Bickmore et al. | Sep 2001 | A1 |
| 20010033675 | Maurer et al. | Oct 2001 | A1 |
| 20010047365 | Yonaitis | Nov 2001 | A1 |
| 20010050689 | Park | Dec 2001 | A1 |
| 20020015024 | Westerman et al. | Feb 2002 | A1 |
| 20020054157 | Hayashi et al. | May 2002 | A1 |
| 20020061130 | Kirk et al. | May 2002 | A1 |
| 20020072993 | Sandus et al. | Jun 2002 | A1 |
| 20020109668 | Rosenberg et al. | Aug 2002 | A1 |
| 20020135581 | Russell et al. | Sep 2002 | A1 |
| 20030135769 | Loughran | Jul 2003 | A1 |
| 20030140309 | Saito et al. | Jul 2003 | A1 |
| 20030154446 | Constant et al. | Aug 2003 | A1 |
| 20030206170 | Bickmore et al. | Nov 2003 | A1 |
| 20040075699 | Franchi et al. | Apr 2004 | A1 |
| 20040179039 | Blattner et al. | Sep 2004 | A1 |
| 20040203342 | Sibecas et al. | Oct 2004 | A1 |
| 20040225966 | Besharat et al. | Nov 2004 | A1 |
| 20050027716 | Apfel | Feb 2005 | A1 |
| 20050122543 | Walker | Jun 2005 | A1 |
| 20050124389 | Yang | Jun 2005 | A1 |
| 20050137015 | Rogers et al. | Jun 2005 | A1 |
| 20050190059 | Wehrenberg | Sep 2005 | A1 |
| 20050190653 | Chen | Sep 2005 | A1 |
| 20050193343 | Kawabe et al. | Sep 2005 | A1 |
| 20050202748 | Porter | Sep 2005 | A1 |
| 20050231513 | Lebarton et al. | Oct 2005 | A1 |
| 20050231625 | Parulski et al. | Oct 2005 | A1 |
| 20050248574 | Ashtekar et al. | Nov 2005 | A1 |
| 20050248582 | Scheepers et al. | Nov 2005 | A1 |
| 20050257042 | Sierra et al. | Nov 2005 | A1 |
| 20050261031 | Seo et al. | Nov 2005 | A1 |
| 20060017692 | Wehrenberg et al. | Jan 2006 | A1 |
| 20060020904 | Aaltonen et al. | Jan 2006 | A1 |
| 20060143569 | Kinsella et al. | Jun 2006 | A1 |
| 20060166708 | Kim et al. | Jul 2006 | A1 |
| 20060188144 | Sasaki et al. | Aug 2006 | A1 |
| 20060294465 | Ronen et al. | Dec 2006 | A1 |
| 20070024614 | Tam et al. | Feb 2007 | A1 |
| 20070025723 | Baudisch et al. | Feb 2007 | A1 |
| 20070052851 | Ochs et al. | Mar 2007 | A1 |
| 20070081081 | Cheng | Apr 2007 | A1 |
| 20070113181 | Blattner et al. | May 2007 | A1 |
| 20070168357 | Mo | Jul 2007 | A1 |
| 20070171091 | Nisenboim et al. | Jul 2007 | A1 |
| 20070192718 | Voorhees et al. | Aug 2007 | A1 |
| 20070226653 | Moore et al. | Sep 2007 | A1 |
| 20070260984 | Marks et al. | Nov 2007 | A1 |
| 20080052242 | Merritt et al. | Feb 2008 | A1 |
| 20080095470 | Chao et al. | Apr 2008 | A1 |
| 20080098031 | Ducharme | Apr 2008 | A1 |
| 20080133580 | Wanless et al. | Jun 2008 | A1 |
| 20080201438 | Mandre et al. | Aug 2008 | A1 |
| 20080242423 | Kerr et al. | Oct 2008 | A1 |
| 20080267459 | Nakada et al. | Oct 2008 | A1 |
| 20080298571 | Kurtz et al. | Dec 2008 | A1 |
| 20080300572 | Rankers et al. | Dec 2008 | A1 |
| 20080309677 | Fleury et al. | Dec 2008 | A1 |
| 20080316227 | Fleury et al. | Dec 2008 | A1 |
| 20090027337 | Hildreth | Jan 2009 | A1 |
| 20090031240 | Hildreth | Jan 2009 | A1 |
| 20090044113 | Jones et al. | Feb 2009 | A1 |
| 20090055484 | Vuong et al. | Feb 2009 | A1 |
| 20090066817 | Sakamaki | Mar 2009 | A1 |
| 20090077497 | Cho et al. | Mar 2009 | A1 |
| 20090083847 | Fadell et al. | Mar 2009 | A1 |
| 20090132371 | Strietzel et al. | May 2009 | A1 |
| 20090144173 | Mo et al. | Jun 2009 | A1 |
| 20090144639 | Nims et al. | Jun 2009 | A1 |
| 20090168756 | Kurapati et al. | Jul 2009 | A1 |
| 20090175509 | Gonion et al. | Jul 2009 | A1 |
| 20090195545 | Debevec et al. | Aug 2009 | A1 |
| 20090202114 | Morin et al. | Aug 2009 | A1 |
| 20090216691 | Borzestowski et al. | Aug 2009 | A1 |
| 20090251484 | Zhao et al. | Oct 2009 | A1 |
| 20090254859 | Arrasvuori et al. | Oct 2009 | A1 |
| 20090254862 | Viginisson et al. | Oct 2009 | A1 |
| 20090297022 | Pettigrew et al. | Dec 2009 | A1 |
| 20090300513 | Nims et al. | Dec 2009 | A1 |
| 20090307629 | Horiuchi et al. | Dec 2009 | A1 |
| 20090312049 | Isomursu | Dec 2009 | A1 |
| 20090325701 | Andres Del Valle | Dec 2009 | A1 |
| 20100007665 | Smith et al. | Jan 2010 | A1 |
| 20100009747 | Reville et al. | Jan 2010 | A1 |
| 20100026640 | Kim et al. | Feb 2010 | A1 |
| 20100097375 | Tadaishi et al. | Apr 2010 | A1 |
| 20100123915 | Kashimoto | May 2010 | A1 |
| 20100124363 | Ek et al. | May 2010 | A1 |
| 20100124941 | Cho | May 2010 | A1 |
| 20100149573 | Pat et al. | Jun 2010 | A1 |
| 20100153847 | Fama | Jun 2010 | A1 |
| 20100164684 | Sasa et al. | Jul 2010 | A1 |
| 20100169376 | Chu | Jul 2010 | A1 |
| 20100188426 | Ohmori et al. | Jul 2010 | A1 |
| 20100199200 | Fujioka | Aug 2010 | A1 |
| 20100203968 | Gill et al. | Aug 2010 | A1 |
| 20100207721 | Nakajima et al. | Aug 2010 | A1 |
| 20100211899 | Fujioka | Aug 2010 | A1 |
| 20100211900 | Fujioka | Aug 2010 | A1 |
| 20100218089 | Chao et al. | Aug 2010 | A1 |
| 20100257469 | Kim et al. | Oct 2010 | A1 |
| 20100277470 | Margolis | Nov 2010 | A1 |
| 20100317410 | Song et al. | Dec 2010 | A1 |
| 20100322111 | Li | Dec 2010 | A1 |
| 20110007174 | Bacivarov et al. | Jan 2011 | A1 |
| 20110025707 | Fujioka | Feb 2011 | A1 |
| 20110064388 | Brown et al. | Mar 2011 | A1 |
| 20110067098 | Ruggiero et al. | Mar 2011 | A1 |
| 20110072394 | Victor et al. | Mar 2011 | A1 |
| 20110074807 | Inada et al. | Mar 2011 | A1 |
| 20110080356 | Kang et al. | Apr 2011 | A1 |
| 20110119610 | Hackborn et al. | May 2011 | A1 |
| 20110221755 | Geisner et al. | Sep 2011 | A1 |
| 20110239115 | Williams et al. | Sep 2011 | A1 |
| 20110248992 | van Os et al. | Oct 2011 | A1 |
| 20110249073 | Cranfill et al. | Oct 2011 | A1 |
| 20110249078 | Abuan et al. | Oct 2011 | A1 |
| 20110252344 | Van Os | Oct 2011 | A1 |
| 20110256848 | Bok et al. | Oct 2011 | A1 |
| 20110296324 | Goossens et al. | Dec 2011 | A1 |
| 20110298808 | Rovik | Dec 2011 | A1 |
| 20110304629 | Winchester | Dec 2011 | A1 |
| 20110304632 | Evertt et al. | Dec 2011 | A1 |
| 20120011453 | Shimono et al. | Jan 2012 | A1 |
| 20120017180 | Flik et al. | Jan 2012 | A1 |
| 20120069028 | Bouguerra | Mar 2012 | A1 |
| 20120075328 | Goossens | Mar 2012 | A1 |
| 20120079377 | Goossens | Mar 2012 | A1 |
| 20120079378 | Goossens | Mar 2012 | A1 |
| 20120081282 | Chin | Apr 2012 | A1 |
| 20120113762 | Frost | May 2012 | A1 |
| 20120139830 | Hwang et al. | Jun 2012 | A1 |
| 20120158515 | K | Jun 2012 | A1 |
| 20120206452 | Geisner et al. | Aug 2012 | A1 |
| 20120210263 | Perry et al. | Aug 2012 | A1 |
| 20120218125 | Demirdjian et al. | Aug 2012 | A1 |
| 20120223952 | Kanemaru et al. | Sep 2012 | A1 |
| 20120233120 | Nijim et al. | Sep 2012 | A1 |
| 20120235790 | Zhao et al. | Sep 2012 | A1 |
| 20120256967 | Baldwin et al. | Oct 2012 | A1 |
| 20120289290 | Chae et al. | Nov 2012 | A1 |
| 20120293686 | Karn et al. | Nov 2012 | A1 |
| 20120299945 | Aarabi | Nov 2012 | A1 |
| 20120309520 | Evertt et al. | Dec 2012 | A1 |
| 20120314047 | Kasahara et al. | Dec 2012 | A1 |
| 20120327183 | Fujii | Dec 2012 | A1 |
| 20130015946 | Lau et al. | Jan 2013 | A1 |
| 20130038759 | Jo et al. | Feb 2013 | A1 |
| 20130067453 | Luan | Mar 2013 | A1 |
| 20130101164 | Leclerc et al. | Apr 2013 | A1 |
| 20130135315 | Bares et al. | May 2013 | A1 |
| 20130136341 | Yamamoto | May 2013 | A1 |
| 20130141513 | Setton et al. | Jun 2013 | A1 |
| 20130147933 | Kulas et al. | Jun 2013 | A1 |
| 20130148867 | Wang | Jun 2013 | A1 |
| 20130157646 | Ferren et al. | Jun 2013 | A1 |
| 20130159900 | Pendharkar | Jun 2013 | A1 |
| 20130176208 | Tanaka et al. | Jul 2013 | A1 |
| 20130194378 | Brown | Aug 2013 | A1 |
| 20130198210 | Lee et al. | Aug 2013 | A1 |
| 20130201104 | Ptucha et al. | Aug 2013 | A1 |
| 20130234964 | Kim et al. | Sep 2013 | A1 |
| 20130235045 | Corazza et al. | Sep 2013 | A1 |
| 20130258040 | Kaytaz et al. | Oct 2013 | A1 |
| 20130286161 | Lv et al. | Oct 2013 | A1 |
| 20130290905 | Luvogt et al. | Oct 2013 | A1 |
| 20130293686 | Blow et al. | Nov 2013 | A1 |
| 20130305189 | Kim | Nov 2013 | A1 |
| 20130318347 | Moffat | Nov 2013 | A1 |
| 20130322218 | Burkhardt et al. | Dec 2013 | A1 |
| 20130342672 | Gray et al. | Dec 2013 | A1 |
| 20130342730 | Lee et al. | Dec 2013 | A1 |
| 20140013422 | Janus et al. | Jan 2014 | A1 |
| 20140040066 | Fujioka | Feb 2014 | A1 |
| 20140043329 | Wang et al. | Feb 2014 | A1 |
| 20140047389 | Aarabi | Feb 2014 | A1 |
| 20140047560 | Meyer et al. | Feb 2014 | A1 |
| 20140055554 | Du et al. | Feb 2014 | A1 |
| 20140062853 | Chaudhri et al. | Mar 2014 | A1 |
| 20140078144 | Berriman et al. | Mar 2014 | A1 |
| 20140085293 | Konoplev et al. | Mar 2014 | A1 |
| 20140085460 | Park et al. | Mar 2014 | A1 |
| 20140085487 | Park et al. | Mar 2014 | A1 |
| 20140092130 | Anderson et al. | Apr 2014 | A1 |
| 20140111420 | Ahn et al. | Apr 2014 | A1 |
| 20140115451 | Sheldon-Dante | Apr 2014 | A1 |
| 20140115488 | Hackborn | Apr 2014 | A1 |
| 20140137013 | Matas | May 2014 | A1 |
| 20140143693 | Goossens et al. | May 2014 | A1 |
| 20140157153 | Yuen et al. | Jun 2014 | A1 |
| 20140165000 | Fleizach et al. | Jun 2014 | A1 |
| 20140198121 | Tong et al. | Jul 2014 | A1 |
| 20140213318 | Leem et al. | Jul 2014 | A1 |
| 20140218371 | Du et al. | Aug 2014 | A1 |
| 20140220855 | Heilbron et al. | Aug 2014 | A1 |
| 20140254434 | Jain et al. | Sep 2014 | A1 |
| 20140267311 | Evertt et al. | Sep 2014 | A1 |
| 20140267618 | Esteban et al. | Sep 2014 | A1 |
| 20140279062 | Hackman et al. | Sep 2014 | A1 |
| 20140283128 | Shepherd et al. | Sep 2014 | A1 |
| 20140292641 | Cho et al. | Oct 2014 | A1 |
| 20140300635 | Suzuki | Oct 2014 | A1 |
| 20140313307 | Oh et al. | Oct 2014 | A1 |
| 20140333671 | Phang et al. | Nov 2014 | A1 |
| 20140336808 | Taylor et al. | Nov 2014 | A1 |
| 20140351720 | Yin | Nov 2014 | A1 |
| 20140354401 | Soni et al. | Dec 2014 | A1 |
| 20140354538 | Lee et al. | Dec 2014 | A1 |
| 20140361974 | Li et al. | Dec 2014 | A1 |
| 20140362091 | Bouaziz et al. | Dec 2014 | A1 |
| 20140366159 | Cohen | Dec 2014 | A1 |
| 20140368601 | Decharms | Dec 2014 | A1 |
| 20150011204 | Seo et al. | Jan 2015 | A1 |
| 20150033192 | Bohannon et al. | Jan 2015 | A1 |
| 20150033364 | Wong | Jan 2015 | A1 |
| 20150035825 | Zhou et al. | Feb 2015 | A1 |
| 20150036883 | Deri et al. | Feb 2015 | A1 |
| 20150037545 | Sun | Feb 2015 | A1 |
| 20150042571 | Lombardi et al. | Feb 2015 | A1 |
| 20150043046 | Iwamoto | Feb 2015 | A1 |
| 20150049014 | Saito | Feb 2015 | A1 |
| 20150058754 | Rauh | Feb 2015 | A1 |
| 20150062052 | Bernstein et al. | Mar 2015 | A1 |
| 20150070378 | Kriese et al. | Mar 2015 | A1 |
| 20150077502 | Jordan et al. | Mar 2015 | A1 |
| 20150078621 | Choi et al. | Mar 2015 | A1 |
| 20150082193 | Wallace et al. | Mar 2015 | A1 |
| 20150082446 | Flowers et al. | Mar 2015 | A1 |
| 20150084950 | Li et al. | Mar 2015 | A1 |
| 20150091896 | Tarquini et al. | Apr 2015 | A1 |
| 20150121251 | Siddhartha et al. | Apr 2015 | A1 |
| 20150130716 | Sridharan et al. | May 2015 | A1 |
| 20150149899 | Bernstein et al. | May 2015 | A1 |
| 20150149927 | Walkin et al. | May 2015 | A1 |
| 20150172238 | Ahmed et al. | Jun 2015 | A1 |
| 20150172584 | Park et al. | Jun 2015 | A1 |
| 20150195277 | Faaborg et al. | Jul 2015 | A1 |
| 20150208244 | Nakao | Jul 2015 | A1 |
| 20150213307 | Beeler et al. | Jul 2015 | A1 |
| 20150213604 | Li et al. | Jul 2015 | A1 |
| 20150248235 | Offenberg et al. | Sep 2015 | A1 |
| 20150253740 | Nishijima et al. | Sep 2015 | A1 |
| 20150254886 | Li | Sep 2015 | A1 |
| 20150261292 | Conzola et al. | Sep 2015 | A1 |
| 20150261387 | Petersen et al. | Sep 2015 | A1 |
| 20150281145 | Ji | Oct 2015 | A1 |
| 20150302624 | Burke | Oct 2015 | A1 |
| 20150310259 | Lau et al. | Oct 2015 | A1 |
| 20150312182 | Langholz | Oct 2015 | A1 |
| 20150312184 | Langholz et al. | Oct 2015 | A1 |
| 20150312185 | Langholz et al. | Oct 2015 | A1 |
| 20150317945 | Andress et al. | Nov 2015 | A1 |
| 20150325029 | Li et al. | Nov 2015 | A1 |
| 20150334075 | Wang et al. | Nov 2015 | A1 |
| 20150334292 | Tartz et al. | Nov 2015 | A1 |
| 20150346912 | Yang et al. | Dec 2015 | A1 |
| 20150350125 | Henderson | Dec 2015 | A1 |
| 20150350141 | Yang et al. | Dec 2015 | A1 |
| 20150370529 | Zambetti et al. | Dec 2015 | A1 |
| 20150379252 | Tang et al. | Dec 2015 | A1 |
| 20160005206 | Li et al. | Jan 2016 | A1 |
| 20160005211 | Sarkis et al. | Jan 2016 | A1 |
| 20160006987 | Li et al. | Jan 2016 | A1 |
| 20160030844 | Nair et al. | Feb 2016 | A1 |
| 20160034133 | Wilson et al. | Feb 2016 | A1 |
| 20160037331 | Vernon et al. | Feb 2016 | A1 |
| 20160042548 | Du et al. | Feb 2016 | A1 |
| 20160050169 | Ben Atar et al. | Feb 2016 | A1 |
| 20160055370 | Garcia | Feb 2016 | A1 |
| 20160057087 | Gomba | Feb 2016 | A1 |
| 20160063828 | Verweij et al. | Mar 2016 | A1 |
| 20160086387 | Os et al. | Mar 2016 | A1 |
| 20160092035 | Crocker et al. | Mar 2016 | A1 |
| 20160092043 | Missig et al. | Mar 2016 | A1 |
| 20160094705 | Vendrow | Mar 2016 | A1 |
| 20160103427 | Westra et al. | Apr 2016 | A1 |
| 20160104034 | Wilder et al. | Apr 2016 | A1 |
| 20160105388 | Bin Mahfooz et al. | Apr 2016 | A1 |
| 20160110922 | Haring | Apr 2016 | A1 |
| 20160127641 | Gove | May 2016 | A1 |
| 20160132200 | Walkin et al. | May 2016 | A1 |
| 20160134635 | Thelin et al. | May 2016 | A1 |
| 20160134840 | Mcculloch | May 2016 | A1 |
| 20160150215 | Chen et al. | May 2016 | A1 |
| 20160163084 | Corazza et al. | Jun 2016 | A1 |
| 20160182661 | Brezina et al. | Jun 2016 | A1 |
| 20160187995 | Rosewall | Jun 2016 | A1 |
| 20160191958 | Nauseef et al. | Jun 2016 | A1 |
| 20160192324 | Zhang et al. | Jun 2016 | A1 |
| 20160217601 | Tsuda et al. | Jul 2016 | A1 |
| 20160226926 | Singh et al. | Aug 2016 | A1 |
| 20160227115 | Bin Mahfooz et al. | Aug 2016 | A1 |
| 20160227121 | Matsushita | Aug 2016 | A1 |
| 20160231878 | Tsuda et al. | Aug 2016 | A1 |
| 20160247308 | Jiao et al. | Aug 2016 | A1 |
| 20160247309 | Li et al. | Aug 2016 | A1 |
| 20160259413 | Anzures et al. | Sep 2016 | A1 |
| 20160259497 | Foss et al. | Sep 2016 | A1 |
| 20160259498 | Foss et al. | Sep 2016 | A1 |
| 20160259499 | Kocienda et al. | Sep 2016 | A1 |
| 20160259518 | King et al. | Sep 2016 | A1 |
| 20160259519 | Foss et al. | Sep 2016 | A1 |
| 20160259527 | Kocienda et al. | Sep 2016 | A1 |
| 20160259528 | Foss et al. | Sep 2016 | A1 |
| 20160267067 | Mays et al. | Sep 2016 | A1 |
| 20160267699 | Borke et al. | Sep 2016 | A1 |
| 20160275724 | Adeyoola et al. | Sep 2016 | A1 |
| 20160284123 | Hare et al. | Sep 2016 | A1 |
| 20160291822 | Ahuja et al. | Oct 2016 | A1 |
| 20160292901 | Li et al. | Oct 2016 | A1 |
| 20160292903 | Li et al. | Oct 2016 | A1 |
| 20160300379 | Du et al. | Oct 2016 | A1 |
| 20160307028 | Fedorov | Oct 2016 | A1 |
| 20160327911 | Eim et al. | Nov 2016 | A1 |
| 20160328874 | Tong et al. | Nov 2016 | A1 |
| 20160328875 | Fang et al. | Nov 2016 | A1 |
| 20160328876 | Tong et al. | Nov 2016 | A1 |
| 20160328886 | Tong et al. | Nov 2016 | A1 |
| 20160332025 | Repka | Nov 2016 | A1 |
| 20160350957 | Woods et al. | Dec 2016 | A1 |
| 20160357282 | Block et al. | Dec 2016 | A1 |
| 20160364600 | Shah et al. | Dec 2016 | A1 |
| 20160370974 | Stenneth | Dec 2016 | A1 |
| 20160378304 | Bahgat et al. | Dec 2016 | A1 |
| 20170003659 | Nakanishi | Jan 2017 | A1 |
| 20170018289 | Morgenstern | Jan 2017 | A1 |
| 20170032554 | O'Donovan et al. | Feb 2017 | A1 |
| 20170046045 | Tung et al. | Feb 2017 | A1 |
| 20170046065 | Zeng et al. | Feb 2017 | A1 |
| 20170046426 | Pearce et al. | Feb 2017 | A1 |
| 20170046507 | Archer et al. | Feb 2017 | A1 |
| 20170061635 | Petrovich et al. | Mar 2017 | A1 |
| 20170069124 | Tong et al. | Mar 2017 | A1 |
| 20170080346 | Abbas | Mar 2017 | A1 |
| 20170082983 | Katzer et al. | Mar 2017 | A1 |
| 20170083086 | Mazur et al. | Mar 2017 | A1 |
| 20170083524 | Huang et al. | Mar 2017 | A1 |
| 20170083586 | Huang et al. | Mar 2017 | A1 |
| 20170098122 | El Kaliouby et al. | Apr 2017 | A1 |
| 20170102916 | Noble et al. | Apr 2017 | A1 |
| 20170111616 | Li et al. | Apr 2017 | A1 |
| 20170113140 | Blackstock et al. | Apr 2017 | A1 |
| 20170132828 | Zelenin et al. | May 2017 | A1 |
| 20170140214 | Matas et al. | May 2017 | A1 |
| 20170147802 | Li | May 2017 | A1 |
| 20170160819 | Yi et al. | Jun 2017 | A1 |
| 20170163588 | Devasthali et al. | Jun 2017 | A1 |
| 20170164888 | Matsuda et al. | Jun 2017 | A1 |
| 20170178287 | Anderson | Jun 2017 | A1 |
| 20170193684 | Du et al. | Jul 2017 | A1 |
| 20170206095 | Gibbs et al. | Jul 2017 | A1 |
| 20170220212 | Yang et al. | Aug 2017 | A1 |
| 20170236298 | Vetter | Aug 2017 | A1 |
| 20170255169 | Lee et al. | Sep 2017 | A1 |
| 20170256086 | Park et al. | Sep 2017 | A1 |
| 20170269715 | Kim et al. | Sep 2017 | A1 |
| 20170269792 | Xu et al. | Sep 2017 | A1 |
| 20170285764 | Kim et al. | Oct 2017 | A1 |
| 20170285916 | Xu et al. | Oct 2017 | A1 |
| 20170286423 | Shorman et al. | Oct 2017 | A1 |
| 20170286913 | Liu et al. | Oct 2017 | A1 |
| 20170322711 | Robinson et al. | Nov 2017 | A1 |
| 20170323266 | Seo | Nov 2017 | A1 |
| 20170336926 | Chaudhri et al. | Nov 2017 | A1 |
| 20170336928 | Chaudhri et al. | Nov 2017 | A1 |
| 20170337554 | Mokhasi et al. | Nov 2017 | A1 |
| 20170346772 | Albouyeh et al. | Nov 2017 | A1 |
| 20170352091 | Chen et al. | Dec 2017 | A1 |
| 20170358117 | Goossens et al. | Dec 2017 | A1 |
| 20180004404 | Delfino et al. | Jan 2018 | A1 |
| 20180024726 | Hviding | Jan 2018 | A1 |
| 20180025219 | Baldwin et al. | Jan 2018 | A1 |
| 20180034867 | Zahn et al. | Feb 2018 | A1 |
| 20180047200 | O'Hara et al. | Feb 2018 | A1 |
| 20180059903 | Lim et al. | Mar 2018 | A1 |
| 20180063603 | Tang et al. | Mar 2018 | A1 |
| 20180067633 | Wilson et al. | Mar 2018 | A1 |
| 20180074693 | Jones et al. | Mar 2018 | A1 |
| 20180081515 | Block et al. | Mar 2018 | A1 |
| 20180088787 | Bereza et al. | Mar 2018 | A1 |
| 20180091732 | Wilson et al. | Mar 2018 | A1 |
| 20180095649 | Valdivia et al. | Apr 2018 | A1 |
| 20180114543 | Novikoff | Apr 2018 | A1 |
| 20180115503 | Baldwin et al. | Apr 2018 | A1 |
| 20180121060 | Jeong et al. | May 2018 | A1 |
| 20180130094 | Tung et al. | May 2018 | A1 |
| 20180131878 | Charlton et al. | May 2018 | A1 |
| 20180157901 | Arbatman et al. | Jun 2018 | A1 |
| 20180165862 | Sawaki | Jun 2018 | A1 |
| 20180181201 | Grant et al. | Jun 2018 | A1 |
| 20180189549 | Inomata | Jul 2018 | A1 |
| 20180191944 | Carbonell et al. | Jul 2018 | A1 |
| 20180197343 | Hare et al. | Jul 2018 | A1 |
| 20180225263 | Zhong et al. | Aug 2018 | A1 |
| 20180246639 | Han et al. | Aug 2018 | A1 |
| 20180268589 | Grant | Sep 2018 | A1 |
| 20180316775 | Kwon et al. | Nov 2018 | A1 |
| 20180321826 | Bereza et al. | Nov 2018 | A1 |
| 20180324353 | Kim et al. | Nov 2018 | A1 |
| 20180329587 | Ko et al. | Nov 2018 | A1 |
| 20180335927 | Anzures et al. | Nov 2018 | A1 |
| 20180335929 | Scapel et al. | Nov 2018 | A1 |
| 20180335930 | Scapel et al. | Nov 2018 | A1 |
| 20180336715 | Rickwald et al. | Nov 2018 | A1 |
| 20180349795 | Boyle et al. | Dec 2018 | A1 |
| 20190050045 | Jha et al. | Feb 2019 | A1 |
| 20190058827 | Park et al. | Feb 2019 | A1 |
| 20190072909 | Misaki et al. | Mar 2019 | A1 |
| 20190087082 | Chaudhri et al. | Mar 2019 | A1 |
| 20190088018 | Shenton et al. | Mar 2019 | A1 |
| 20190139207 | Jeong et al. | May 2019 | A1 |
| 20190158735 | Wilson et al. | May 2019 | A1 |
| 20190160378 | Fajt et al. | May 2019 | A1 |
| 20190171338 | Voss et al. | Jun 2019 | A1 |
| 20190171869 | Fortune et al. | Jun 2019 | A1 |
| 20190180088 | Norimatsu | Jun 2019 | A1 |
| 20190235748 | Seol et al. | Aug 2019 | A1 |
| 20190266775 | Lee et al. | Aug 2019 | A1 |
| 20190266807 | Lee et al. | Aug 2019 | A1 |
| 20190276051 | Marti et al. | Sep 2019 | A1 |
| 20190279410 | Orvalho et al. | Sep 2019 | A1 |
| 20190295056 | Wright | Sep 2019 | A1 |
| 20190339847 | Scapel et al. | Nov 2019 | A1 |
| 20190342507 | Dye et al. | Nov 2019 | A1 |
| 20190347868 | Scapel et al. | Nov 2019 | A1 |
| 20190370492 | Falchuk et al. | Dec 2019 | A1 |
| 20190371033 | Scapel et al. | Dec 2019 | A1 |
| 20200034025 | Brady et al. | Jan 2020 | A1 |
| 20200045245 | Van Os et al. | Feb 2020 | A1 |
| 20200068095 | Nabetani | Feb 2020 | A1 |
| 20200074711 | Barlier et al. | Mar 2020 | A1 |
| 20200089302 | Kim et al. | Mar 2020 | A1 |
| 20200142484 | Maalouf et al. | May 2020 | A1 |
| 20200226848 | Van Os et al. | Jul 2020 | A1 |
| 20200234481 | Scapel et al. | Jul 2020 | A1 |
| 20200234508 | Shaburov et al. | Jul 2020 | A1 |
| 20200264738 | Lee et al. | Aug 2020 | A1 |
| 20200265234 | Lee et al. | Aug 2020 | A1 |
| 20200285851 | Lin et al. | Sep 2020 | A1 |
| 20200302669 | Barlier et al. | Sep 2020 | A1 |
| 20200306640 | Kolen et al. | Oct 2020 | A1 |
| 20200358725 | Scapel et al. | Nov 2020 | A1 |
| 20200358726 | Dryer et al. | Nov 2020 | A1 |
| 20200380768 | Harris et al. | Dec 2020 | A1 |
| 20200380781 | Barlier et al. | Dec 2020 | A1 |
| 20200402304 | Hwang et al. | Dec 2020 | A1 |
| 20200409533 | Blackstock et al. | Dec 2020 | A1 |
| 20200410763 | Hare et al. | Dec 2020 | A1 |
| 20200412975 | Al Majid et al. | Dec 2020 | A1 |
| 20210005003 | Chong et al. | Jan 2021 | A1 |
| 20210027514 | Kwon et al. | Jan 2021 | A1 |
| 20210056769 | Scapel et al. | Feb 2021 | A1 |
| 20210058351 | Viklund et al. | Feb 2021 | A1 |
| 20210065448 | Goodrich et al. | Mar 2021 | A1 |
| 20210065454 | Goodrich et al. | Mar 2021 | A1 |
| 20210096703 | Anzures et al. | Apr 2021 | A1 |
| 20210099568 | Depue et al. | Apr 2021 | A1 |
| 20210099761 | Zhang | Apr 2021 | A1 |
| 20210152505 | Baldwin et al. | May 2021 | A1 |
| 20210168108 | Antmen et al. | Jun 2021 | A1 |
| 20210264656 | Barlier et al. | Aug 2021 | A1 |
| 20210287343 | Kaida | Sep 2021 | A1 |
| 20210311609 | Dandoko | Oct 2021 | A1 |
| 20210335055 | Scapel et al. | Oct 2021 | A1 |
| 20210349426 | Chen et al. | Nov 2021 | A1 |
| 20210349427 | Chen et al. | Nov 2021 | A1 |
| 20210349611 | Chen et al. | Nov 2021 | A1 |
| 20210349612 | Triverio | Nov 2021 | A1 |
| 20210375042 | Chen et al. | Dec 2021 | A1 |
| 20210390753 | Scapel et al. | Dec 2021 | A1 |
| 20220070385 | Van Os et al. | Mar 2022 | A1 |
| 20220122309 | Kim et al. | Apr 2022 | A1 |
| 20220206675 | Hawkes | Jun 2022 | A1 |
| 20220229546 | Lee et al. | Jul 2022 | A1 |
| 20220244838 | Bereza et al. | Aug 2022 | A1 |
| 20220301041 | Lee et al. | Sep 2022 | A1 |
| 20220319075 | Hu et al. | Oct 2022 | A1 |
| 20220374137 | Triverio et al. | Nov 2022 | A1 |
| 20220392132 | Sepulveda et al. | Dec 2022 | A1 |
| 20230004270 | Chen et al. | Jan 2023 | A1 |
| 20230043249 | Van Os et al. | Feb 2023 | A1 |
| 20230090342 | Barlier et al. | Mar 2023 | A1 |
| 20230171484 | Dedonato et al. | Jun 2023 | A1 |
| 20230283884 | Van Os et al. | Sep 2023 | A1 |
| 20230305688 | Triverio et al. | Sep 2023 | A1 |
| 20230350564 | Chen et al. | Nov 2023 | A1 |
| 20230364936 | Antonakis | Nov 2023 | A1 |
| 20230379573 | Wilson et al. | Nov 2023 | A1 |
| 20240029334 | Sepulveda et al. | Jan 2024 | A1 |
| 20240036717 | Triverio | Feb 2024 | A1 |
| 20240077937 | Rickwald et al. | Mar 2024 | A1 |
| Number | Date | Country |
|---|---|---|
| 2015101639 | Dec 2015 | AU |
| 2017100683 | Jan 2018 | AU |
| 2015297035 | Jun 2018 | AU |
| 2356232 | Mar 2002 | CA |
| 1083229 | Mar 1994 | CN |
| 2602404 | Feb 2004 | CN |
| 1581901 | Feb 2005 | CN |
| 101055646 | Oct 2007 | CN |
| 101329707 | Dec 2008 | CN |
| 101472158 | Jul 2009 | CN |
| 101692681 | Apr 2010 | CN |
| 101742053 | Jun 2010 | CN |
| 101930284 | Dec 2010 | CN |
| 102035990 | Apr 2011 | CN |
| 102075727 | May 2011 | CN |
| 102142149 | Aug 2011 | CN |
| 102271241 | Dec 2011 | CN |
| 102298797 | Dec 2011 | CN |
| 102394919 | Mar 2012 | CN |
| 102479388 | May 2012 | CN |
| 202217134 | May 2012 | CN |
| 102622085 | Aug 2012 | CN |
| 102750070 | Oct 2012 | CN |
| 102841683 | Dec 2012 | CN |
| 102854979 | Jan 2013 | CN |
| 102984195 | Mar 2013 | CN |
| 102999934 | Mar 2013 | CN |
| 103116902 | May 2013 | CN |
| 103209642 | Jul 2013 | CN |
| 103294171 | Sep 2013 | CN |
| 103346957 | Oct 2013 | CN |
| 103516894 | Jan 2014 | CN |
| 103703438 | Apr 2014 | CN |
| 103886632 | Jun 2014 | CN |
| 103927190 | Jul 2014 | CN |
| 103947190 | Jul 2014 | CN |
| 104011738 | Aug 2014 | CN |
| 104115503 | Oct 2014 | CN |
| 104170358 | Nov 2014 | CN |
| 104182741 | Dec 2014 | CN |
| 104246793 | Dec 2014 | CN |
| 104270597 | Jan 2015 | CN |
| 104376160 | Feb 2015 | CN |
| 104732396 | Jun 2015 | CN |
| 104753762 | Jul 2015 | CN |
| 104753766 | Jul 2015 | CN |
| 104836879 | Aug 2015 | CN |
| 104898402 | Sep 2015 | CN |
| 104935497 | Sep 2015 | CN |
| 104952063 | Sep 2015 | CN |
| 105051651 | Nov 2015 | CN |
| 105099861 | Nov 2015 | CN |
| 105100462 | Nov 2015 | CN |
| 105139438 | Dec 2015 | CN |
| 105190700 | Dec 2015 | CN |
| 105374055 | Mar 2016 | CN |
| 105391843 | Mar 2016 | CN |
| 105391937 | Mar 2016 | CN |
| 105611215 | May 2016 | CN |
| 105611275 | May 2016 | CN |
| 105653031 | Jun 2016 | CN |
| 105844101 | Aug 2016 | CN |
| 106101358 | Nov 2016 | CN |
| 106303690 | Jan 2017 | CN |
| 106575444 | Apr 2017 | CN |
| 106909064 | Jun 2017 | CN |
| 107171934 | Sep 2017 | CN |
| 107533356 | Jan 2018 | CN |
| 107561904 | Jan 2018 | CN |
| 107613085 | Jan 2018 | CN |
| 107924113 | Apr 2018 | CN |
| 201670652 | Dec 2017 | DK |
| 0579093 | Jan 1994 | EP |
| 1215867 | Jun 2002 | EP |
| 1429291 | Jun 2004 | EP |
| 1592212 | Nov 2005 | EP |
| 1599862 | Nov 2005 | EP |
| 1736931 | Dec 2006 | EP |
| 2028611 | Feb 2009 | EP |
| 2416563 | Feb 2012 | EP |
| 2713298 | Apr 2014 | EP |
| 2741175 | Jun 2014 | EP |
| 2762997 | Aug 2014 | EP |
| 2960822 | Dec 2015 | EP |
| 2990887 | Mar 2016 | EP |
| 3026636 | Jun 2016 | EP |
| 3047884 | Jul 2016 | EP |
| 3051525 | Aug 2016 | EP |
| 3101958 | Dec 2016 | EP |
| 3118761 | Jan 2017 | EP |
| 3190563 | Jul 2017 | EP |
| 3211587 | Aug 2017 | EP |
| 3308563 | Apr 2018 | EP |
| 2556665 | Aug 2018 | EP |
| 3396618 | Oct 2018 | EP |
| 3401770 | Nov 2018 | EP |
| 53-31170 | Mar 1978 | JP |
| 56-621 | Jan 1981 | JP |
| 3007616 | Feb 1995 | JP |
| 9-9072 | Jan 1997 | JP |
| 10-506472 | Jun 1998 | JP |
| 10-293860 | Nov 1998 | JP |
| 11-109066 | Apr 1999 | JP |
| 11-312159 | Nov 1999 | JP |
| 2000-76460 | Mar 2000 | JP |
| 2000-162349 | Jun 2000 | JP |
| 2000-283720 | Oct 2000 | JP |
| 2001-92783 | Apr 2001 | JP |
| 2001-144884 | May 2001 | JP |
| 2001-273064 | Oct 2001 | JP |
| 2001-313886 | Nov 2001 | JP |
| 2002-222412 | Aug 2002 | JP |
| 2002-251238 | Sep 2002 | JP |
| 2003-9404 | Jan 2003 | JP |
| 2003-150550 | May 2003 | JP |
| 2003-219217 | Jul 2003 | JP |
| 2003-233616 | Aug 2003 | JP |
| 2004-28918 | Jan 2004 | JP |
| 2004-184396 | Jul 2004 | JP |
| 2004-194069 | Jul 2004 | JP |
| 2004-287558 | Oct 2004 | JP |
| 2005-115480 | Apr 2005 | JP |
| 2005-202651 | Jul 2005 | JP |
| 2005-521890 | Jul 2005 | JP |
| 2005-293280 | Oct 2005 | JP |
| 2006-65683 | Mar 2006 | JP |
| 2006-102327 | Apr 2006 | JP |
| 2006-520053 | Aug 2006 | JP |
| 2006-259930 | Sep 2006 | JP |
| 2007-52770 | Mar 2007 | JP |
| 2007-528240 | Oct 2007 | JP |
| 2007-329632 | Dec 2007 | JP |
| 2008-15800 | Jan 2008 | JP |
| 2009-135770 | Jun 2009 | JP |
| 2009-211166 | Sep 2009 | JP |
| 2009-217612 | Sep 2009 | JP |
| 2010-28404 | Feb 2010 | JP |
| 2010-224837 | Oct 2010 | JP |
| 2010-541046 | Dec 2010 | JP |
| 2011-40865 | Feb 2011 | JP |
| 2011-70623 | Apr 2011 | JP |
| 2011-515726 | May 2011 | JP |
| 2011-517810 | Jun 2011 | JP |
| 2011-192228 | Sep 2011 | JP |
| 2011-525648 | Sep 2011 | JP |
| 2011-199523 | Oct 2011 | JP |
| 2011-209887 | Oct 2011 | JP |
| 2011-217146 | Oct 2011 | JP |
| 2012-18569 | Jan 2012 | JP |
| 2012-38292 | Feb 2012 | JP |
| 2012-168802 | Sep 2012 | JP |
| 2012-208719 | Oct 2012 | JP |
| 2013-3671 | Jan 2013 | JP |
| 2013-9073 | Jan 2013 | JP |
| 2013-88906 | May 2013 | JP |
| 2013-92989 | May 2013 | JP |
| 2013-97760 | May 2013 | JP |
| 2013-97814 | May 2013 | JP |
| 2013-101528 | May 2013 | JP |
| 2013-114498 | Jun 2013 | JP |
| 2013-140540 | Jul 2013 | JP |
| 2013-178723 | Sep 2013 | JP |
| 2013-232230 | Nov 2013 | JP |
| 2014-110009 | Jun 2014 | JP |
| 2014-206817 | Oct 2014 | JP |
| 2014-222439 | Nov 2014 | JP |
| 2015-36925 | Feb 2015 | JP |
| 2015-504619 | Feb 2015 | JP |
| 2015-56142 | Mar 2015 | JP |
| 2015-207051 | Nov 2015 | JP |
| 2016-136324 | Jul 2016 | JP |
| 2016-162000 | Sep 2016 | JP |
| 2016-534435 | Nov 2016 | JP |
| 2017-54195 | Mar 2017 | JP |
| 2017-521804 | Aug 2017 | JP |
| 2017-527917 | Sep 2017 | JP |
| 2017-531225 | Oct 2017 | JP |
| 6240301 | Nov 2017 | JP |
| 6266736 | Jan 2018 | JP |
| 2018-514020 | May 2018 | JP |
| 2018-514838 | Jun 2018 | JP |
| 2018-106365 | Jul 2018 | JP |
| 2018-116067 | Jul 2018 | JP |
| 2018-151966 | Sep 2018 | JP |
| 2019-145108 | Aug 2019 | JP |
| 10-2004-0046272 | Jun 2004 | KR |
| 10-2004-0107489 | Dec 2004 | KR |
| 10-2005-0086630 | Aug 2005 | KR |
| 10-2008-0050336 | Jun 2008 | KR |
| 10-2010-0086052 | Jul 2010 | KR |
| 10-2011-0028581 | Mar 2011 | KR |
| 10-2011-0089429 | Aug 2011 | KR |
| 10-2012-0006610 | Jan 2012 | KR |
| 10-2012-0113252 | Oct 2012 | KR |
| 10-2012-0127842 | Nov 2012 | KR |
| 10-2012-0130627 | Dec 2012 | KR |
| 10-2012-0132134 | Dec 2012 | KR |
| 10-2014-0033088 | Mar 2014 | KR |
| 10-2014-0039737 | Apr 2014 | KR |
| 10-2014-0049340 | Apr 2014 | KR |
| 10-2015-0008996 | Jan 2015 | KR |
| 10-2015-0024899 | Mar 2015 | KR |
| 10-2015-0067197 | Jun 2015 | KR |
| 10-1540544 | Jul 2015 | KR |
| 10-1587115 | Jan 2016 | KR |
| 10-2016-0014623 | Feb 2016 | KR |
| 10-2016-0016910 | Feb 2016 | KR |
| 10-2016-0026337 | Mar 2016 | KR |
| 10-2016-0047891 | May 2016 | KR |
| 10-2016-0063058 | Jun 2016 | KR |
| 10-2016-0146942 | Dec 2016 | KR |
| 10-2017-0012384 | Feb 2017 | KR |
| 10-2017-0023063 | Mar 2017 | KR |
| 10-2017-0081391 | Jul 2017 | KR |
| 10-2017-0112267 | Oct 2017 | KR |
| 10-2017-0112406 | Oct 2017 | KR |
| 10-2017-0117306 | Oct 2017 | KR |
| 10-2018-0017227 | Feb 2018 | KR |
| 10-1866407 | Jun 2018 | KR |
| 10-1875907 | Jul 2018 | KR |
| 10-2019-0033082 | Mar 2019 | KR |
| 10-2019-0114034 | Oct 2019 | KR |
| 10-2020-0101206 | Aug 2020 | KR |
| 10-2020-0132995 | Nov 2020 | KR |
| 10-2338576 | Dec 2021 | KR |
| 199840795 | Sep 1998 | WO |
| 2003085460 | Oct 2003 | WO |
| 2004079530 | Sep 2004 | WO |
| 2007120981 | Oct 2007 | WO |
| 2009073607 | Jun 2009 | WO |
| 2009114239 | Sep 2009 | WO |
| 2009133710 | Nov 2009 | WO |
| 2010059306 | May 2010 | WO |
| 2011084860 | Jul 2011 | WO |
| 2011127309 | Oct 2011 | WO |
| 2012068193 | May 2012 | WO |
| 2012170354 | Dec 2012 | WO |
| 2013082325 | Jun 2013 | WO |
| 2013097139 | Jul 2013 | WO |
| 2013097264 | Jul 2013 | WO |
| 2013120851 | Aug 2013 | WO |
| 2013152453 | Oct 2013 | WO |
| 2013152454 | Oct 2013 | WO |
| 2013152455 | Oct 2013 | WO |
| 2013169849 | Nov 2013 | WO |
| 2013189058 | Dec 2013 | WO |
| 2014012456 | Jan 2014 | WO |
| 2014053063 | Apr 2014 | WO |
| 2014094199 | Jun 2014 | WO |
| 2014105276 | Jul 2014 | WO |
| 2014193465 | Dec 2014 | WO |
| 2014200734 | Dec 2014 | WO |
| 2015034960 | Mar 2015 | WO |
| 2015065928 | May 2015 | WO |
| 2015069153 | May 2015 | WO |
| 2015084891 | Jun 2015 | WO |
| 2015119605 | Aug 2015 | WO |
| 2015144209 | Oct 2015 | WO |
| 2015167590 | Nov 2015 | WO |
| 2015183756 | Dec 2015 | WO |
| 2015187458 | Dec 2015 | WO |
| 2015195216 | Dec 2015 | WO |
| 2015196448 | Dec 2015 | WO |
| 2016022203 | Feb 2016 | WO |
| 2016022204 | Feb 2016 | WO |
| 2016022205 | Feb 2016 | WO |
| 2016026402 | Feb 2016 | WO |
| 2016036218 | Mar 2016 | WO |
| 2016042926 | Mar 2016 | WO |
| 2016045005 | Mar 2016 | WO |
| 2016049439 | Mar 2016 | WO |
| 2016057062 | Apr 2016 | WO |
| 2016064435 | Apr 2016 | WO |
| 2016101124 | Jun 2016 | WO |
| 2016101131 | Jun 2016 | WO |
| 2016101132 | Jun 2016 | WO |
| 2016144385 | Sep 2016 | WO |
| 2016144975 | Sep 2016 | WO |
| 2016145129 | Sep 2016 | WO |
| 2016161556 | Oct 2016 | WO |
| 2017012302 | Jan 2017 | WO |
| 2017015949 | Feb 2017 | WO |
| 2017030646 | Feb 2017 | WO |
| 2017043314 | Mar 2017 | WO |
| 2017077751 | May 2017 | WO |
| 2017153771 | Sep 2017 | WO |
| 2017201326 | Nov 2017 | WO |
| 2017218193 | Dec 2017 | WO |
| 2018006053 | Jan 2018 | WO |
| 2018049430 | Mar 2018 | WO |
| 2018057272 | Mar 2018 | WO |
| 2018151758 | Aug 2018 | WO |
| 2018212801 | Nov 2018 | WO |
| 2018212802 | Nov 2018 | WO |
| 2019216997 | Nov 2019 | WO |
| 2019216999 | Nov 2019 | WO |
| 2020226785 | Nov 2020 | WO |
| 2021050190 | Mar 2021 | WO |
| Entry |
|---|
| Final Office Action received for U.S. Appl. No. 17/031,765, mailed on Sep. 1, 2023, 37 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/093,408, mailed on Aug. 30, 2023, 59 pages. |
| Office Action received for European Patent Application No. 21728746.5, mailed on Aug. 21, 2023, 4 pages. |
| Rozario, Hamlin, “How to Edit Photos on iPhone & iPad”, Online Available at: https://osxdaily.com/2020/01/23/how-to-edit-photos-on-iphone-ipad/, Jan. 23, 2020, 10 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,765, mailed on Oct. 31, 2023, 5 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2023233200, mailed on Oct. 17, 2023, 3 pages. |
| Office Action received for Chinese Patent Application No. 202310124087.2, mailed on Sep. 9, 2023, 24 pages (13 pages of English Translation and 11 pages of Official Copy). |
| Advisory Action received for U.S. Appl. No. 17/031,765, mailed on Nov. 13, 2023, 5 pages. |
| Decision on Appeal received for Korean Patent Application No. 10-2022-7004578, mailed on Oct. 31, 2023, 26 pages (5 pages of English Translation and 21 pages of Official Copy). |
| Decision to Grant received for Japanese Patent Application No. 2023-146062, mailed on Nov. 13, 2023, 2 pages (1 page of English Translation and 1 page of Official Copy). |
| Notice of Allowance received for Korean Patent Application No. 10-2022-7029729, mailed on Nov. 9, 2023, 8 pages (2 pages of English Translation and 6 pages of Official Copy). |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/093,408, mailed on Sep. 13, 2023, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/093,408, mailed on Sep. 20, 2023, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2023200039, mailed on Aug. 31, 2023, 3 pages. |
| “[B612] Addition of facial recognition bear/cat stamps and AR background function having moving sparkles or hearts”, Available Online at: <URL, htpps://apptopi.jp/2017/0l/22/b612>, Jan. 22, 2017, 11 pages. |
| A Day in the Life of Mike, “#SnapChat Vs #Msqrd”, Available Online at: <https://www.youtube.com/watch?v=vS_1mrWXmC8>, See especially 4:22-6:05, Mar. 9, 2016, 4 pages. |
| Advisory Action received for U.S. Appl. No. 13/082,035, mailed on Jun. 19, 2015, 5 pages. |
| Advisory Action received for U.S. Appl. No. 13/082,035, mailed on Oct. 23, 2013, 3 pages. |
| Advisory Action received for U.S. Appl. No. 16/259,771, mailed on Feb. 26, 2020, 3 pages. |
| Advisory Action received for U.S. Appl. No. 16/259,771, mailed on Jul. 14, 2020, 6 pages. |
| Advisory Action received for U.S. Appl. No. 16/583,706, mailed on Mar. 21, 2022, 3 pages. |
| Advisory Action received for U.S. Appl. No. 17/031,765, mailed on Dec. 12, 2022, 7 pages. |
| AKG Technical, “Mojipop app//Mozipop gif maker app//How to use mojipop app; AKG Technical”, Available online at: https://www.youtube.com/watch?v=_ 9pdQ3CpWA4, Feb. 4, 2019, 4 pages. |
| Ali et al., “Facial Expression Recognition Using Human to Animated-Character Expression Translation”, Oct. 12, 2019, 8 pages. |
| Androidslide, “Camera Zoom FX”, Available at: <https://www.youtube.com/watch?v=AHmPn8y74wY>, Nov. 5, 2011, 3 pages. |
| Appes Stela, “Gif Me! Camera [Android] Video review by Stelapps”, Available Online at: <https://www.youtube.com/watch?v=uae0xUucOyY>, Jul. 17, 2014, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 13/082,035, mailed on Apr. 4, 2013, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 13/082,035, mailed on Aug. 1, 2016, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 13/082,035, mailed on Jan. 29, 2015, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 13/082,035, mailed on Oct. 30, 2013, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 14/866,560, mailed on Jan. 30, 2019, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 14/866,560, mailed on Jul. 26, 2018, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 14/866,560, mailed on May 14, 2019, 4 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 14/866,560, mailed on Oct. 21, 2019, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 15/714,887, mailed on Aug. 19, 2020, 4 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 15/714,887, mailed on Mar. 17, 2020, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 15/940,017, mailed on Dec. 26, 2019, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 15/940,017, mailed on Jun. 30, 2020, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/259,771, mailed on Apr. 18, 2022, 2 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/259,771, mailed on May 5, 2020, 10 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/519,850, mailed on Jun. 26, 2020, 4 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/582,500, mailed on Aug. 25, 2020, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/582,500, mailed on Dec. 27, 2021, 8 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/582,500, mailed on Feb. 1, 2021, 6 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/582,500, mailed on Jul. 1, 2022, 6 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/582,500, mailed on Oct. 28, 2022, 6 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/583,706, mailed on Aug. 9, 2021, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/583,706, mailed on Feb. 27, 2020, 6 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/583,706, mailed on Nov. 18, 2020, 7 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/599,433, mailed on Apr. 20, 2021, 7 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/663,062, mailed on Dec. 18, 2020, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/833,436, mailed on Jan. 27, 2022, 2 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/833,436, mailed on Jul. 1, 2021, 2 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,654, mailed on Feb. 1, 2021, 2 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,671, mailed on Aug. 2, 2021, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,671, mailed on Dec. 9, 2022, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,671, mailed on Jun. 13, 2022, 7 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,671, mailed on Nov. 8, 2021, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,765, mailed on Dec. 15, 2021, 4 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,765, mailed on May 23, 2022, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,765, mailed on Nov. 16, 2022, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,765, mailed on Sep. 22, 2021, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/093,408, mailed on Jan. 5, 2023, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/093,408, mailed on Jul. 1, 2022, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/093,408, mailed on Mar. 1, 2022, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/220,752, mailed on Jul. 22, 2022, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/370,505, mailed on Oct. 17, 2022, 4 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/373,163, mailed on Apr. 11, 2022, 2 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/746,179, mailed on Nov. 28, 2022, 4 pages. |
| AppLivGames, “Super Mario Run Stickers for iMessage: Free Delivery Started!”, Available online at: <https://games.app-liv.jp/archives/178627>, Sep. 13, 2016, 3 pages. |
| AT&T Customer Care, “How to Access & Manage Contacts on Your Samsung Galaxy S9 l S9+ l AT&T Wireless”, Online Available at: https://www.youtube.com/watch?v=nb4Zf9Xi5ZQ, Mar. 9, 2018, 8 pages. |
| BeYourAvatar, “Faceshift studio tutorial part 4.8: tracking—fbx export”, Available online at : https://www.youtube.com/watch?v=_yqmc9yzKLM, Nov. 19, 2012, 3 pages. |
| Bomen XYZ, “Cara membuat stiker di android, WhatsApp, Fb Messenger dll || Work 100%”, Available online at: https://www.youtube.com/watch?v=cafBfzD1Bbo, Feb. 21, 2019, 3 pages. |
| Brief Communication Regarding Oral Proceedings received for European Patent Application No. 19172407.9, mailed on Nov. 9, 2020, 1 page. |
| Brief Communication Regarding Oral Proceedings received for European Patent Application No. 19172407.9, mailed on Nov. 20, 2020, 2 pages. |
| Brief Communication Regarding Oral Proceedings received for European Patent Application No. 19181242.9, mailed on Oct. 5, 2022, 4 pages. |
| Canchichi, “Mii Creation”, Online available at: https://www.youtube.com/watch?v=bYm7IEYu42k, Jan. 16, 2007, 4 pages. |
| Carretero et al., “Preserving Avatar Genuineness in Different Display Media”, Mobile Networks and Applications, Kluwer Academic Publishers, BO, vol. 13, No. 6, Jul. 15, 2008, pp. 627-634. |
| Certificate of Examination received for Australian Patent Application No. 2019100420, mailed on Jul. 3, 2019, 2 pages. |
| Certificate of Examination received for Australian Patent Application No. 2019100497, mailed on Jul. 29, 2019, 2 pages. |
| Certificate of Examination received for Australian Patent Application No. 2019100794, mailed on Dec. 19, 2019, 2 pages. |
| Certificate of Examination received for Australian Patent Application No. 2019101019, mailed on Nov. 12, 2019, 2 pages. |
| Certificate of Examination received for Australian Patent Application No. 2019101667, mailed on Mar. 20, 2020, 2 pages. |
| Certificate of Examination received for Australian Patent Application No. 2020100189, mailed on May 12, 2020, 2 pages. |
| Certificate of Examination received for Australian Patent Application No. 2020100675, mailed on Jun. 30, 2020, 2 pages. |
| Certificate of Examination received for Australian Patent Application No. 2020101043, mailed on Dec. 22, 2020, 2 pages. |
| Certificate of Examination received for Australian Patent Application No. 2020101715, mailed on Oct. 6, 2020, 2 pages. |
| Chicaview, “What is New! Make Funny GIFs Clips—Gif Me Phone App)”, Available online at : <https://www.youtube.com/watch?v=0LPGSFFP-V0>, See especially 1:15-2:25, Sep. 20, 2016, 3 pages. |
| Contents Pocket, “Line Stamp Information”, Available online at: <https://web.archive.org/web/20150404080541/http://contents-pocket.net/linestamp.html>, Apr. 2015, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 15/713,490, mailed on May 1, 2019, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 15/940,017, mailed on Aug. 27, 2020, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 15/940,017, mailed on Oct. 21, 2020, 3 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 15/981,754, mailed on Oct. 15, 2019, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 15/981,754, mailed on Oct. 24, 2019, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/142,288, mailed on Jul. 30, 2019, 5 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/143,097, mailed on Nov. 8, 2019, 3 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/519,850, mailed on Nov. 2, 2020, 5 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/519,850, mailed on Sep. 8, 2020, 5 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/582,570, mailed on Mar. 31, 2020, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/599,433, mailed on Aug. 13, 2021, 5 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/599,433, mailed on Oct. 14, 2021, 3 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/663,062, mailed on Apr. 14, 2021, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/663,062, mailed on Jul. 21, 2021, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/676,087, mailed on Aug. 3, 2020, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/676,087, mailed on Aug. 19, 2020, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/676,087, mailed on Jul. 8, 2020, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/896,457, mailed on Apr. 6, 2021, 3 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/896,457, mailed on Feb. 24, 2021, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 16/896,457, mailed on Jan. 28, 2021, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/091,460, mailed on Feb. 16, 2022, 6 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/091,460, mailed on Feb. 25, 2022, 6 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/220,752, mailed on Oct. 14, 2022, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/370,505, mailed on Apr. 4, 2023, 5 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/370,505, mailed on Apr. 28, 2023, 5 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/370,505, mailed on Mar. 8, 2023, 5 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/373,163, mailed on Jul. 15, 2022, 5 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/373,163, mailed on Jun. 27, 2022, 5 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/525,664, mailed on Nov. 3, 2022, 2 pages. |
| Decision on Appeal received for Korean Patent Application No. 10-2019-7033799, mailed on Jul. 19, 2022, 23 pages. |
| Decision on Appeal received for Korean Patent Application No. 10-2021-7002582, mailed on May 13, 2022, 29 pages. |
| Decision on Appeal received for U.S. Appl. No. 15/714,887, mailed on Feb. 18, 2022, 14 pages. |
| Decision on Appeal received for U.S. Appl. No. 16/259,771, mailed on Aug. 19, 2021, 12 pages. |
| Decision to Grant received for Danish Patent Application No. PA201770418, mailed on Oct. 25, 2019, 3 pages. |
| Decision to Grant received for Danish Patent Application No. PA201770419, mailed on Oct. 25, 2018, 2 pages. |
| Decision to Grant received for Danish Patent Application No. PA201770720, mailed on Aug. 8, 2019, 2 pages. |
| Decision to Grant received for Danish Patent Application No. PA201770721, mailed on Jun. 17, 2019, 2 pages. |
| Decision to Grant received for Danish Patent Application No. PA201870372, mailed on Jun. 17, 2020, 2 pages. |
| Decision to Grant received for Danish Patent Application No. PA201870375, mailed on Jul. 24, 2019, 2 pages. |
| Decision to Grant received for Danish Patent Application No. PA201870377, mailed on May 14, 2019, 2 pages. |
| Decision to Grant received for Danish Patent Application No. PA201870381, mailed on Oct. 14, 2019, 2 pages. |
| Decision to Grant received for European Patent Application No. 17853654.6, mailed on Apr. 15, 2021, 2 pages. |
| Decision to Grant received for European Patent Application No. 18704335.1, mailed on Sep. 24, 2020, 2 pages. |
| Decision to Grant received for European Patent Application No. 19172407.9, mailed on Jun. 17, 2021, 2 pages. |
| Decision to Grant received for European Patent Application No. 19181242.9, mailed on Mar. 23, 2023, 3 pages. |
| Decision to Grant received for European Patent Application No. 20168021.2, mailed on Feb. 3, 2022, 2 pages. |
| Decision to Grant received for Japanese Patent Application No. 2018-182607, mailed on Apr. 13, 2022, 3 pages. |
| Decision to Grant received for Japanese Patent Application No. 2019-563408, mailed on Aug. 25, 2021, 3 pages. |
| Decision to Grant received for Japanese Patent Application No. 2020-193703, mailed on Aug. 10, 2021, 3 pages. |
| Decision to Refuse received for European Patent Application No. 19204230.7, mailed on Feb. 4, 2022, 15 pages. |
| Decision to Refuse received for European Patent Application No. 19724959.2, mailed on Jun. 22, 2021, 13 pages. |
| Decision to Refuse received for Japanese Patent Application No. 2020-159824, mailed on Sep. 30, 2022, 6 pages. |
| EnterBrain, “No. 5 Create your own Avatar Mii Studio”, vol. 26, No. 11, p. 138, Feb. 24, 2011, 4 pages. |
| European Search Report received for European Patent Application No. 19172407.9, mailed on Oct. 9, 2019, 4 pages. |
| European Search Report received for European Patent Application No. 19181242.9, mailed on Nov. 27, 2019, 4 pages. |
| European Search Report received for European Patent Application No. 19186042.8, mailed on Sep. 12, 2019, 4 pages. |
| European Search Report received for European Patent Application No. 19211833.9, mailed on Jul. 1, 2020, 4 pages. |
| European Search Report received for European Patent Application No. 20168021.2, mailed on Jul. 8, 2020, 4 pages. |
| Examiner's Answer to Appeal Brief received for U.S. Appl. No. 15/714,887, mailed on Aug. 27, 2021, 23 pages. |
| Examiner's Answer to Appeal Brief received for U.S. Appl. No. 16/259,771, mailed on Oct. 23, 2020, 15 pages. |
| Examiner's Pre-Review Report received for Japanese Patent Application No. 2019-215503, mailed on Aug. 20, 2021, 15 pages. |
| Examiner's Pre-Review Report received for Japanese Patent Application No. 2019-563560, mailed on Dec. 27, 2021, 4 pages. |
| Extended European Search Report received for European Patent Application No. 17853654.6, mailed on Jul. 8, 2019, 9 pages. |
| Extended European Search Report received for European Patent Application No. 17853657.9, mailed on May 28, 2020, 9 pages. |
| Extended European Search Report received for European Patent Application No. 19204230.7, mailed on Feb. 21, 2020, 7 pages. |
| Extended European Search Report received for European Patent Application No. 19212057.4, mailed on Feb. 27, 2020, 8 pages. |
| Extended European Search Report received for European Patent Application No. 20191533.7, mailed on Nov. 13, 2020, 8 pages. |
| Extended European Search Report received for European Patent Application No. 21166287.9, mailed on Nov. 5, 2021, 10 pages. |
| Extended European Search Report received for European Patent Application No. 22154034.7, mailed on May 11, 2022, 14 pages. |
| FaceRig, “FaceRig Mobile Selfie Tip”, Available online at: https://www.youtube.com/watch?v=x3DZHnXWZ3U, Oct. 18, 2016, 3 pages. |
| FaceRig, “FaceRig Mobile Tip: How to record with and without the camera feed”, Available Online at : https://www.youtube.com/watch?v=lwk9FIWGvVM, Nov. 8, 2016, 3 pages. |
| Fedko Daria, “AR Hair Styles”, Online Available at <https://www.youtube.com/watch?v=FrS6tHRbFE0>, Jan. 24, 2017, 2 pages. |
| Final Office Action received for U.S. Appl. No. 13/082,035, mailed on Apr. 16, 2015, 24 pages. |
| Final Office Action received for U.S. Appl. No. 13/082,035, mailed on Aug. 15, 2013, 24 pages. |
| Final Office Action received for U.S. Appl. No. 14/866,560, mailed on Oct. 9, 2018, 22 pages. |
| Final Office Action received for U.S. Appl. No. 15/714,887, mailed on Nov. 13, 2020, 60 pages. |
| Final Office Action received for U.S. Appl. No. 15/714,887, mailed on Nov. 15, 2019, 55 pages. |
| Final Office Action received for U.S. Appl. No. 15/870,195, mailed on Dec. 13, 2018, 27 pages. |
| Final Office Action received for U.S. Appl. No. 15/940,017, mailed on Apr. 15, 2020, 19 pages. |
| Final Office Action received for U.S. Appl. No. 15/940,017, mailed on Dec. 20, 2018, 17 pages. |
| Final Office Action received for U.S. Appl. No. 15/940,232, mailed on Jan. 10, 2019, 27 pages. |
| Final Office Action received for U.S. Appl. No. 16/116,221, mailed on Mar. 22, 2019, 35 pages. |
| Final Office Action received for U.S. Appl. No. 16/259,771, mailed on Aug. 12, 2022, 25 pages. |
| Final Office Action received for U.S. Appl. No. 16/259,771, mailed on Nov. 18, 2019, 13 pages. |
| Final Office Action received for U.S. Appl. No. 16/582,500, mailed on Apr. 29, 2022, 23 pages. |
| Final Office Action received for U.S. Appl. No. 16/582,500, mailed on Nov. 30, 2020, 20 pages. |
| Final Office Action received for U.S. Appl. No. 16/583,706, mailed on Jun. 11, 2020, 31 pages. |
| Final Office Action received for U.S. Appl. No. 16/583,706, mailed on Nov. 18, 2021, 39 pages. |
| Final Office Action received for U.S. Appl. No. 16/833,436, mailed on Sep. 21, 2021, 29 pages. |
| Final Office Action received for U.S. Appl. No. 17/031,671, mailed on Nov. 15, 2022, 27 pages. |
| Final Office Action received for U.S. Appl. No. 17/031,671, mailed on Sep. 7, 2021, 27 pages. |
| Final Office Action received for U.S. Appl. No. 17/031,765, mailed on Oct. 29, 2021, 34 pages. |
| Final Office Action received for U.S. Appl. No. 17/031,765, mailed on Sep. 12, 2022, 37 pages. |
| Final Office Action received for U.S. Appl. No. 17/093,408, mailed on May 18, 2022, 41 pages. |
| FlatLineVertigo, “Black Desert Online :: Intro to Hair Customization”, Online Available at: <https://www.youtube.com/watch?v=9MCbfd_eMEg>, Sep. 9, 2015, 3 pages. |
| Flyme Global, “Flyme 6—Setup Contact Avatar”, Available online at: https://www.youtube.com/watch?v=HvmyZdovhEk, May 15, 2017, 3 pages. |
| Gao et al., “Automatic Unpaired Shape Deformation Transfer”, ACM Transactions on Graphics, Online available at: https://doi.org/10.1145/3272127.3275028, 2018, 11 pages. |
| Gardener Ricardo, “How to Create and Use AR Emoji Galaxy S10, S10 Plus”, Available online at: https://www.youtube.com/watch?v=wNjgUQzFYto, May 9, 2019, 3 pages. |
| Gavin Brady, “How to Remove Old User Account Pictures in Windows 10”, Available online at: https://www.howtogeek.com/369601/how-to-remove-old-user-account-pictures-in-windows-10/, Oct. 16, 2018, 5 pages. |
| Giphy Inc. Communication, “Giphy Cam. The GIF Camera”, Available at: <https://web.archive.org/web/20170309234909/https://play.google.com/store/apps/details?id=com.giphy.camera>, Mar. 9, 2017, pp. 1-3. |
| Here are Warez Files:Eve Online Character Creator, Online Available at: <http://theherearewarezfiles.blogspot.com/2014/03/eve-online-character-creator-download.html>, Mar. 3, 2014, 7 pages. |
| Holotech Studios Entertainment, “FaceRig”, Available at: <https://web.archive.org/web/20161120090627/https://play.google.com/store/apps/details?id=com.holotech.facerig&hl=da>, Nov. 9, 2016, 3 pages. |
| How to Use MSQRD, Available Online at: <https://web.archive.org/web/20160505072814/https:/www.wikihow.com/Use-MSQRD>, May 5, 2016, 3 pages. |
| Ilovex, “Stripe Generator, a tool that makes it easy to create striped materials”, Online available at : https://www.ilovex.co.jp/blog/system/webconsulting/stripe-generator.html, May 2, 2012, 3 pages. |
| Intention to Grant received for Danish Patent Application No. PA201770418, mailed on Aug. 22, 2019, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA201770418, mailed on Nov. 16, 2018, 3 pages. |
| Intention to Grant received for Danish Patent Application No. PA201770419, mailed on Mar. 28, 2018, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA201770720, mailed on Apr. 4, 2019, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA201770720, mailed on Jun. 21, 2019, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA201770721, mailed on Apr. 4, 2019, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA201870372, mailed on Feb. 13, 2020, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA201870375, mailed on Jun. 3, 2019, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA201870375, mailed on Mar. 26, 2019, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA201870377, mailed on Mar. 26, 2019, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA201870381, mailed on Jul. 18, 2019, 2 pages. |
| Intention to Grant received for Danish Patent Application No. PA202070623, mailed on Jul. 20, 2022, 2 pages. |
| Intention to Grant received for European Patent Application No. 17853654.6, mailed on Nov. 23, 2020, 8 pages. |
| Intention to grant received for European Patent Application No. 18704335.1, mailed on Apr. 17, 2020, 6 pages. |
| Intention to Grant received for European Patent Application No. 19172407.9, mailed on Feb. 11, 2021, 9 pages. |
| Intention to Grant received for European Patent Application No. 19181242.9, mailed on Nov. 17, 2022, 9 pages. |
| Intention to Grant received for European Patent Application No. 19181242.9, mailed on Oct. 28, 2021, 16 pages. |
| Intention to Grant received for European Patent Application No. 20168021.2, mailed on Apr. 15, 2021, 8 pages. |
| Intention to Grant received for European Patent Application No. 20168021.2, mailed on Sep. 20, 2021, 8 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2018/014658, mailed on Nov. 28, 2019, 14 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2018/014892, mailed on Nov. 28, 2019, 8 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2011/031616, mailed on Oct. 18, 2012, 6 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2017/049760, mailed on Apr. 4, 2019, 9 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2017/049795, mailed on Apr. 4, 2019, 16 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2018/033044, mailed on Nov. 28, 2019, 8 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2019/023793, mailed on Nov. 19, 2020, 12 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2019/024067, mailed on Nov. 19, 2020, 12 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2020/014176, mailed on Jul. 29, 2021, 9 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2020/025913, mailed on Nov. 18, 2021, 11 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2021/031096, mailed on Nov. 24, 2022, 11 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2021/031212, mailed on Nov. 24, 2022, 16 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US17/49760, mailed on Jan. 19, 2018, 12 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2011/031616, mailed on Aug. 30, 2011, 8 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2017/049795, mailed on Dec. 27, 2017, 26 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2018/014658, mailed on Jun. 6, 2018, 20 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2018/014892, mailed on Mar. 7, 2018, 10 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2018/033044, mailed on Sep. 11, 2018, 13 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2019/023793, mailed on Aug. 27, 2019, 17 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2019/024067, mailed on Oct. 9, 2019, 18 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2020/014176, mailed on Mar. 26, 2020, 12 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2020/025913, mailed on Sep. 15, 2020, 19 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2021/031096, mailed on Oct. 13, 2021, 16 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2021/031212, mailed on Sep. 21, 2021, 21 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/029811, mailed on Nov. 7, 2022, 15 pages. |
| Invitation to Pay Addition Fees received for PCT Patent Application No. PCT/US2018/014658, mailed on Apr. 11, 2018, 14 pages. |
| Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2022/029811, mailed on Sep. 14, 2022, 9 pages. |
| Invitation to Pay Additional fees received for PCT Patent Application No. PCT/US17/49760, mailed on Nov. 21, 2017, 2 pages. |
| Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2017/049795, mailed on Nov. 3, 2017, 3 pages. |
| Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2019/023793, mailed on Jul. 5, 2019, 11 pages. |
| Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2019/024067, mailed on Jul. 16, 2019, 13 pages. |
| Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2020/025913, mailed on Jul. 24, 2020, 11 pages. |
| Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2021/031096, mailed on Aug. 19, 2021, 8 pages. |
| Invitation to Pay Additional Fees received for PCT Patent Application No. PCT/US2021/031212, mailed on Jul. 28, 2021, 19 pages. |
| Invitation to Pay Search Fees received for European Patent Application No. 19724959.2, mailed on Feb. 25, 2020, 3 pages. |
| Invitation to Pay Search Fees received for European Patent Application No. 20722020.3, mailed on Feb. 16, 2021, 3 pages. |
| ITJungles, “Samsung Galaxy S8: How to Assign a Photo to a Contact”, Available online at: <https://www.youtube.com/watch?v=2ZdwxijxDzE>, Feb. 13, 2018, 3 pages. |
| ITJungles, “Samsung Galaxy S9: How to Add Stickers to Text Messages”, Available online at: https://www.youtube.com/watch?v=ojGC_UMQds0, Jan. 22, 2019, 3 pages. |
| Jabbari Ibrahim, “How to set up Google Gboard's ‘Mini’ stickers”, Available online at: https://www.youtube.com/watch?v=z_sWkctRr8Q, Aug. 30, 2018, 3 pages. |
| Koti Kotresh, “Colour with Asian Paints.A Mobail App by Android Application—2018”, Available Online at <https://www.youtube.com/watch?v=M6EIO7ErYd0&feature=youtu.be&t=81>, May 6, 2018, 2 pages. |
| Kozak Tadeusz, “When You're Video Chatting on Snapchat, How Do You Use Face Filters?”, Quora, Online Available at: https://www.quora.com/When-youre-video-chatting-on-Snapchat-how-do-you-use-face-filters, Apr. 29, 2018, 1 page. |
| Kyoko Makino, “How to Make a Lookalike Face Icon for Your Friend”, ASCII, Japan Weekly, ASCII Media Works Inc., vol. 24, pp. 90-93, Jul. 17, 2014, 7 pages. |
| Lang Brian, “How to Audio & Video Chat with Multiple Users at the Same Time in Groups”, Snapchat 101, Online Available at: <https://smartphones.gadgethacks.com/how-to/snapchat-101-audio-video-chat-with-multiple-users-same-time-groups-0184113/>, Apr. 17, 2018, 4 pages. |
| Latest Technology, “How to Create Personalized Emojis on Gboard Using Your Selfies II Personal Emojis”, Available online at: https://www.youtube.com/watch?v=udyom84oqqA, Nov. 1, 2018, 3 pages. |
| Lein et al., “Patternizer”, Available online at: https://patternizer.com/, Apr. 2016, 5 pages. |
| Mega Ninja, “Face rig review”, Available online at : https://www.youtube.com/watch?v=8YqeeiEVKRg, Feb. 6, 2017, 3 pages. |
| Minutes of the Oral Proceedings received for European Patent Application No. 19181242.9, mailed on Dec. 15, 2020, 6 pages. |
| Minutes of the Oral Proceedings received for European Patent Application No. 19204230.7, mailed on Feb. 2, 2022, 9 pages. |
| Minutes of the Oral Proceedings received for European Patent Application No. 19724959.2, mailed on Jun. 14, 2021, 6 pages. |
| Mitsuru Takeuchi, “Face Shape Selection for Automatic Avatar Generation”, 13th Annual Conference Proceedings of Virtual Reality Society of Japan tournament Papers [DVD-ROM], The Virtual Reality Society of Japan, Sep. 24, 2008, 7 pages. |
| Modestneko, “How to Use Facerig”, Available Online at: https://www.youtube.com/watch?v=e25_nuRNIOM, Mar. 31, 2019, 4 pages. |
| Nathan B Tech, “New Samsung S10 AR Emojis In Depth”, Available online at: https://www.youtube.com/watch?v=xXeNSuNoEHc, Mar. 17, 2019, 4 pages. |
| NCCU DCT, “Faceshift”, Available online at : https://www.youtube.com/watch?v=4Ph0_SP8tpA, Dec. 1, 2014, 3 pages. |
| NeuroTechnology, “Sentimask SDK”, Available at: https://www.neurotechnology.com/sentimask.html, Apr. 22, 2018, 5 pages. |
| NinEverything, “Making a Mii on Switch—all of the options”, Online available at: https://www.youtube.com/watch?v=kUDPmbBK7ys, Feb. 23, 2017, 3 pages. |
| Noh et al., “Expression Cloning”, Proceedings of the 28th annual conference on Computer Graphics and Interactive Techniques, ACM SIGGRAPH, Los Angeles, CA, USA, Aug. 12-17, 2001, 12 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/082,035, mailed on Apr. 21, 2016, 25 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/082,035, mailed on Dec. 19, 2012, 19 pages. |
| Non-Final Office Action received for U.S. Appl. No. 13/082,035, mailed on Sep. 11, 2014, 23 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/866,560, mailed on Apr. 19, 2018, 10 pages. |
| Non-Final Office Action received for U.S. Appl. No. 14/866,560, mailed on Apr. 30, 2019, 23 pages. |
| Non-Final Office Action received for U.S. Appl. No. 15/714,887, mailed on May 27, 2020, 48 pages. |
| Non-Final Office Action received for U.S. Appl. No. 15/714,887, mailed on May 30, 2019, 47 pages. |
| Non-Final Office Action received for U.S. Appl. No. 15/870,195, mailed on May 2, 2018, 22 pages. |
| Non-Final Office Action received for U.S. Appl. No. 15/940,017, mailed on Jun. 18, 2018, 15 pages. |
| Non-Final Office Action received for U.S. Appl. No. 15/940,017, mailed on Sep. 30, 2019, 16 pages. |
| Non-Final Office Action received for U.S. Appl. No. 15/940,232, mailed on Jun. 18, 2018, 23 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/035,419, mailed on Jan. 30, 2019, 24 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/116,221, mailed on Nov. 13, 2018, 27 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/142,288, mailed on Nov. 20, 2018, 15 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/142,305, mailed on Nov. 23, 2018, 32 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/142,328, mailed on Nov. 8, 2018, 18 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/143,097, mailed on Feb. 28, 2019, 17 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/259,771, mailed on Jan. 25, 2022, 20 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/259,771, mailed on May 8, 2019, 11 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/519,850, mailed on Mar. 23, 2020, 8 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/582,500, mailed on Jun. 2, 2020, 15 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/582,500, mailed on Sep. 17, 2021, 18 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/582,500, mailed on Sep. 23, 2022, 23 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/583,706, mailed on Jan. 10, 2020, 27 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/583,706, mailed on Mar. 4, 2021, 34 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/599,433, mailed on Jan. 28, 2021, 16 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/663,062, mailed on Oct. 28, 2020, 14 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/676,087, mailed on Apr. 9, 2020, 55 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/833,436, mailed on Mar. 29, 2021, 27 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/031,654, mailed on Nov. 19, 2020, 12 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/031,671, mailed on Apr. 1, 2022, 32 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/031,671, mailed on Apr. 30, 2021, 27 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/031,765, mailed on Jun. 28, 2021, 32 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/031,765, mailed on Mar. 29, 2022, 33 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/091,460, mailed on Sep. 10, 2021, 10 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/093,408, mailed on Dec. 8, 2021, 37 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/093,408, mailed on Sep. 14, 2022, 46 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/220,752, mailed on Apr. 15, 2022, 21 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/370,505, mailed on Jul. 6, 2022, 14 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/373,163, mailed on Jan. 27, 2022, 14 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/461,014, mailed on Dec. 7, 2022, 22 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/746,179, mailed on Oct. 25, 2022, 18 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2017330208, mailed on Nov. 28, 2019, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2017330212, mailed on Apr. 28, 2020, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2018269375, mailed on Dec. 3, 2020, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2018270420, mailed on Jul. 21, 2021, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2019265357, mailed on Dec. 24, 2020, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2019266049, mailed on Nov. 24, 2020, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2020201721, mailed on Jul. 6, 2021, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2020213402, mailed on Sep. 21, 2020, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2020239749, mailed on May 27, 2022, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2020269590, mailed on Nov. 8, 2022, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2020294208, mailed on Mar. 2, 2022, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2021201295, mailed on May 10, 2022, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2021201681, mailed on Feb. 3, 2022, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2021202254, mailed on Nov. 16, 2022, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2021250944, mailed on Nov. 14, 2022, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2021254574, mailed on Dec. 14, 2022, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2022215297, mailed on Sep. 26, 2022, 3 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2022220279, mailed on Sep. 27, 2022, 3 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201880022585.3, mailed on Oct. 28, 2020, 6 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201910278273.5, mailed on Nov. 19, 2020, 2 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201910315328.5, mailed on Aug. 24, 2022, 4 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201910379481.4, mailed on Nov. 9, 2020, 6 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201910563974.3, mailed on Jun. 2, 2021, 2 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201910692958.4, mailed on Jul. 21, 2020, 2 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201910692978.1, mailed on Feb. 4, 2021, 6 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201911202668.3, mailed on Feb. 4, 2021, 5 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201911219517.9, mailed on Jul. 4, 2022, 6 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201911219525.3, mailed on Sep. 29, 2020, 2 pages. |
| Notice of Allowance received for Chinese Patent Application No. 202010776600.2, mailed on Apr. 1, 2021, 8 pages. |
| Notice of Allowance received for Chinese Patent Application No. 202110820692.4, mailed on Nov. 16, 2022, 2 pages. |
| Notice of Allowance received for Danish Patent Application No. PA202070623, mailed on Sep. 20, 2022, 2 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2018-184254, mailed on Jun. 15, 2020, 5 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2019-215503, mailed on Aug. 26, 2022, 3 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2019-511767, mailed on Mar. 30, 2020, 4 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2019-511975, mailed on Dec. 14, 2020, 4 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2020-120086, mailed on Nov. 15, 2021, 5 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2020-159825, mailed on Mar. 25, 2022, 5 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2021-001028, mailed on Sep. 9, 2022, 4 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2021-092483, mailed on Sep. 30, 2022, 4 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2021-153573, mailed on Feb. 17, 2023, 4 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2021-566102, mailed on Oct. 28, 2022, 5 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2019-7005136, mailed on Feb. 19, 2021, 5 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2019-7005369, mailed on Oct. 26, 2020, 4 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2019-7033634, mailed on Aug. 20, 2021, 4 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2020-0123852, mailed on Nov. 28, 2022, 7 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2020-0123887, mailed on Nov. 28, 2022, 7 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2020-7031855, mailed on Mar. 22, 2021, 5 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2020-7032147, mailed on May 12, 2021, 5 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2021-7015473, mailed on Feb. 24, 2022, 5 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2021-7019525, mailed on Jul. 13, 2021, 5 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2021-7023617, mailed on Dec. 21, 2021, 6 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2021-7038284, mailed on Feb. 25, 2022, 5 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2022-7002829, mailed on Feb. 12, 2022, 6 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2022-7016421, mailed on May 25, 2022, 6 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2022-7017766, mailed on Jun. 14, 2022, 6 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2022-7017767, mailed on Jun. 14, 2022, 6 pages. |
| Notice of Allowance received for U.S. Appl. No. 13/082,035, mailed on Oct. 5, 2016, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 14/866,560, mailed on Nov. 15, 2019, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 15/713,490, mailed on Mar. 20, 2019, 15 pages. |
| Notice of Allowance received for U.S. Appl. No. 15/870,195, mailed on Sep. 23, 2019, 13 pages. |
| Notice of Allowance received for U.S. Appl. No. 15/940,017, mailed on Aug. 6, 2020, 10 pages. |
| Notice of Allowance received for U.S. Appl. No. 15/940,232, mailed on Jun. 4, 2019, 12 pages. |
| Notice of Allowance received for U.S. Appl. No. 15/981,754, mailed on Jul. 17, 2019, 15 pages. |
| Notice of Allowance received for U.S. Appl. No. 15/981,754, mailed on Sep. 18, 2019, 14 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/035,419, mailed on May 24, 2019, 14 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/110,514, mailed on Apr. 29, 2019, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/110,514, mailed on Mar. 13, 2019, 11 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/116,221, mailed on Nov. 22, 2019, 13 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/116,221, mailed on Sep. 20, 2019, 13 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/142,288, mailed on Jun. 24, 2019, 10 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/142,288, mailed on Mar. 27, 2019, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/142,288, mailed on May 1, 2019, 4 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/142,305, mailed on Apr. 3, 2019, 5 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/142,305, mailed on May 1, 2019, 2 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/142,328, mailed on Apr. 5, 2019, 7 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/143,097, mailed on Aug. 29, 2019, 23 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/143,201, mailed on Feb. 8, 2019, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/143,201, mailed on Nov. 28, 2018, 14 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/519,850, mailed on Aug. 26, 2020, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/582,570, mailed on Mar. 6, 2020, 28 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/599,433, mailed on May 14, 2021, 11 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/599,433, mailed on Oct. 4, 2021, 13 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/663,062, mailed on Jul. 13, 2021, 7 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/663,062, mailed on Mar. 24, 2021, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/676,087, mailed on Jun. 19, 2020, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/676,087, mailed on Oct. 21, 2020, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/833,436, mailed on Jul. 7, 2022, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/833,436, mailed on Sep. 8, 2022, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 16/896,457, mailed on Jan. 8, 2021, 22 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/031,654, mailed on Feb. 10, 2021, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/031,654, mailed on May 27, 2021, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/091,460, mailed on Apr. 28, 2022, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/091,460, mailed on Feb. 4, 2022, 10 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/091,460, mailed on May 23, 2022, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/220,752, mailed on Sep. 7, 2022, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/370,505, mailed on Feb. 2, 2023, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/373,163, mailed on Jul. 27, 2022, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/373,163, mailed on May 11, 2022, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/525,664, mailed on Oct. 27, 2022, 11 pages. |
| Office Action received for Australian Patent Application No. 2017330208, mailed on Jul. 25, 2019, 5 pages. |
| Office Action received for Australian Patent Application No. 2017330212, mailed on Feb. 21, 2020, 2 pages. |
| Office Action received for Australian Patent Application No. 2018269375, mailed on Jun. 19, 2020, 4 pages. |
| Office Action received for Australian Patent Application No. 2018269375, mailed on Sep. 7, 2020, 3 pages. |
| Office Action received for Australian Patent Application No. 2018270420, mailed on Apr. 19, 2021, 4 pages. |
| Office Action received for Australian Patent Application No. 2018270420, mailed on Jan. 7, 2021, 5 pages. |
| Office Action received for Australian Patent Application No. 2018270420, mailed on Jul. 21, 2020, 5 pages. |
| Office Action received for Australian Patent Application No. 2019100794, mailed on Oct. 3, 2019, 4 pages. |
| Office Action received for Australian Patent Application No. 2020100189, mailed on Apr. 1, 2020, 3 pages. |
| Office Action received for Australian Patent Application No. 2020101043, mailed on Aug. 14, 2020, 5 pages. |
| Office Action received for Australian Patent Application No. 2020101043, mailed on Oct. 30, 2020, 4 pages. |
| Office Action received for Australian Patent Application No. 2020201721, mailed on Feb. 26, 2021, 7 pages. |
| Office Action received for Australian Patent Application No. 2020239749, mailed on Jan. 21, 2022, 4 pages. |
| Office Action received for Australian Patent Application No. 2020239749, mailed on Jul. 16, 2021, 5 pages. |
| Office Action received for Australian Patent Application No. 2020269590, mailed on Sep. 16, 2022, 2 pages. |
| Office Action received for Australian Patent Application No. 2020294208, mailed on Dec. 17, 2021, 2 pages. |
| Office Action received for Australian Patent Application No. 2021201295, mailed on Jan. 14, 2022, 3 pages. |
| Office Action received for Australian Patent Application No. 2021201681, mailed on Nov. 11, 2021, 4 pages. |
| Office Action received for Australian Patent Application No. 2021202254, mailed on Jun. 20, 2022, 2 pages. |
| Office Action received for Australian Patent Application No. 2021250944, mailed on Sep. 16, 2022, 3 pages. |
| Office Action received for Australian Patent Application No. 2021254574, mailed on Oct. 15, 2022, 3 pages. |
| Office Action received for Chinese Patent Application No. 201780053143.0, mailed on Dec. 16, 2021, 19 pages. |
| Office Action received for Chinese Patent Application No. 201780053143.0, mailed on Dec. 24, 2020, 21 pages. |
| Office Action received for Chinese Patent Application No. 201780053143.0, mailed on Mar. 30, 2022, 12 pages. |
| Office Action received for Chinese Patent Application No. 201780053143.0, mailed on May 22, 2020, 21 pages. |
| Office Action received for Chinese Patent Application No. 201780053143.0, mailed on Sep. 3, 2021, 24 pages. |
| Office Action received for Chinese Patent Application No. 201780058426.4, mailed on Dec. 2, 2022, 11 pages. |
| Office Action received for Chinese Patent Application No. 201880000798.6, mailed on Aug. 5, 2020, 18 pages. |
| Office Action received for Chinese Patent Application No. 201880000798.6, mailed on Dec. 30, 2021, 10 pages. |
| Office Action received for Chinese Patent Application No. 201880000798.6, mailed on Jul. 2, 2021, 15 pages. |
| Office Action received for Chinese Patent Application No. 201880022585.3, mailed on May 22, 2020, 11 pages. |
| Office Action received for Chinese Patent Application No. 201910278273.5, mailed on Jan. 3, 2020, 17 pages. |
| Office Action received for Chinese Patent Application No. 201910278273.5, mailed on Jun. 9, 2020, 8 pages. |
| Office Action received for Chinese Patent Application No. 201910315328.5, mailed on Nov. 30, 2021, 21 pages. |
| Office Action received for Chinese Patent Application No. 201910379481.4, mailed on Mar. 2, 2020, 18 pages. |
| Office Action received for Chinese Patent Application No. 201910563974.3, mailed on Feb. 7, 2021, 7 pages. |
| Office Action received for Chinese Patent Application No. 201910563974.3, mailed on May 8, 2020, 18 pages. |
| Office Action received for Chinese Patent Application No. 201910691865.X, mailed on Aug. 4, 2021, 10 pages. |
| Office Action received for Chinese Patent Application No. 201910691865.X, mailed on Feb. 4, 2021, 16 pages. |
| Office Action received for Chinese Patent Application No. 201910691865.X, mailed on Jul. 8, 2020, 17 pages. |
| Office Action received for Chinese Patent Application No. 201910691872.X, mailed on Jun. 3, 2020, 10 pages. |
| Office Action received for Chinese Patent Application No. 201910691872.X, mailed on Jun. 23, 2021, 10 pages. |
| Office Action received for Chinese Patent Application No. 201910691872.X, mailed on Mar. 24, 2021, 19 pages. |
| Office Action received for Chinese Patent Application No. 201910691872.X, mailed on Nov. 10, 2021, 16 pages. |
| Office Action received for Chinese Patent Application No. 201910692958.4, mailed on Mar. 19, 2020, 20 pages. |
| Office Action received for Chinese Patent Application No. 201910692978.1, mailed on Apr. 3, 2020, 19 pages. |
| Office Action received for Chinese Patent Application No. 201910692978.1, mailed on Nov. 4, 2020, 4 pages. |
| Office Action received for Chinese Patent Application No. 201911199054.4, mailed on Jan. 20, 2021, 19 pages. |
| Office Action received for Chinese Patent Application No. 201911199054.4, mailed on Jul. 3, 2020, 15 pages. |
| Office Action received for Chinese Patent Application No. 201911199054.4, mailed on Jun. 10, 2021, 13 pages. |
| Office Action received for Chinese Patent Application No. 201911202668.3, mailed on Aug. 4, 2020, 13 pages. |
| Office Action received for Chinese Patent Application No. 201911219517.9, mailed on Jan. 19, 2022, 11 pages. |
| Office Action received for Chinese Patent Application No. 201911219517.9, mailed on Mar. 2, 2021, 20 pages. |
| Office Action received for Chinese Patent Application No. 201911219525.3, mailed on Jul. 10, 2020, 7 pages. |
| Office Action received for Chinese Patent Application No. 202010330318.1, mailed on Jul. 13, 2021, 12 pages. |
| Office Action received for Chinese Patent Application No. 202010330318.1, mailed on Mar. 31, 2021, 13 pages. |
| Office Action received for Chinese Patent Application No. 202010330318.1, mailed on Nov. 19, 2020, 18 pages. |
| Office Action received for Chinese Patent Application No. 202110820692.4, mailed on Mar. 15, 2022, 18 pages. |
| Office Action received for Danish Patent Application No. PA201770393, mailed on Dec. 12, 2018, 7 pages. |
| Office Action received for Danish Patent Application No. PA201770393, mailed on Jan. 31, 2020, 6 pages. |
| Office Action received for Danish Patent Application No. PA201770393, mailed on Jul. 11, 2019, 2 pages. |
| Office Action received for Danish Patent Application No. PA201770393, mailed on Mar. 19, 2018, 8 pages. |
| Office Action received for Danish Patent Application No. PA201770418, mailed on May 8, 2018, 3 pages. |
| Office Action received for Danish Patent Application No. PA201770419, mailed on Jan. 10, 2018, 4 pages. |
| Office Action received for Danish Patent Application No. PA201770720, mailed on Apr. 26, 2018, 3 pages. |
| Office Action received for Danish Patent Application No. PA201770720, mailed on Nov. 16, 2018, 3 pages. |
| Office Action received for Danish Patent Application No. PA201770720, mailed on Oct. 18, 2017, 8 pages. |
| Office Action received for Danish Patent Application No. PA201770721, mailed on Apr. 26, 2018, 3 pages. |
| Office Action received for Danish Patent Application No. PA201770721, mailed on Nov. 16, 2018, 3 Pages. |
| Office Action received for Danish Patent Application No. PA201770721, mailed on Oct. 19, 2017, 8 pages. |
| Office Action received for Danish Patent Application No. PA201870366, mailed on Aug. 22, 2019, 3 pages. |
| Office Action received for Danish Patent Application No. PA201870366, mailed on Dec. 12, 2018, 3 pages. |
| Office Action received for Danish Patent Application No. PA201870367, mailed on Dec. 20, 2018, 5 pages. |
| Office Action received for Danish Patent Application No. PA201870368, mailed on Dec. 20, 2018, 5 pages. |
| Office Action received for Danish Patent Application No. PA201870368, mailed on Oct. 1, 2019, 6 pages. |
| Office Action received for Danish Patent Application No. PA201870372, mailed on Aug. 20, 2019, 2 pages. |
| Office Action received for Danish Patent Application No. PA201870372, mailed on Jan. 31, 2019, 4 pages. |
| Office Action received for Danish Patent Application No. PA201870374, mailed on Feb. 6, 2019, 5 pages. |
| Office Action received for Danish Patent Application No. PA201870374, mailed on Jun. 17, 2019, 5 pages. |
| Office Action received for Danish Patent Application No. PA201870375, mailed on Jan. 31, 2019, 4 pages. |
| Office Action received for Danish Patent Application No. PA201870377, mailed on Jan. 31, 2019, 4 pages. |
| Office Action received for Danish Patent Application No. PA201970530, mailed on Mar. 4, 2020, 4 pages. |
| Office Action received for Danish Patent Application No. PA201970530, mailed on Mar. 25, 2021, 4 pages. |
| Office Action received for Danish Patent Application No. PA201970531, mailed on Aug. 13, 2021, 3 pages. |
| Office Action received for Danish Patent Application No. PA201970531, mailed on Feb. 17, 2020, 3 pages. |
| Office Action received for Danish Patent Application No. PA202070623, mailed on Aug. 24, 2021, 3 pages. |
| Office Action received for Danish Patent Application No. PA202070623, mailed on May 23, 2022, 3 pages. |
| Office Action received for Danish Patent Application No. PA202070624, mailed on Feb. 4, 2022, 4 pages. |
| Office Action received for Danish Patent Application No. PA202070624, mailed on Jun. 16, 2021, 5 pages. |
| Office Action received for Danish Patent Application No. PA202070625, mailed on Feb. 8, 2022, 2 pages. |
| Office Action received for Danish Patent Application No. PA202070625, mailed on Jun. 16, 2021, 3 pages. |
| Office Action received for Danish Patent Application No. PA202070625, mailed on Sep. 23, 2022, 4 pages. |
| Office Action received for European Patent Application No. 17853654.6, mailed on Mar. 23, 2020, 4 pages. |
| Office Action received for European Patent Application No. 17853657.9, mailed on Apr. 1, 2021, 6 pages. |
| Office Action received for European Patent Application No. 18703184.4, mailed on Dec. 14, 2021, 4 pages. |
| Office Action received for European Patent Application No. 18703184.4, mailed on Jul. 2, 2021, 6 pages. |
| Office Action received for European Patent Application No. 18703184.4, mailed on Jul. 13, 2022, 4 pages. |
| Office Action received for European Patent Application No. 18703184.4, mailed on May 6, 2020, 7 pages. |
| Office Action received for European Patent Application No. 18703184.4, mailed on Nov. 23, 2020, 8 pages. |
| Office Action received for European Patent Application No. 18703184.4, mailed on Oct. 29, 2019, 6 pages. |
| Office Action received for European Patent Application No. 18704335.1, mailed on Sep. 23, 2019, 7 pages. |
| Office Action received for European Patent Application No. 18732519.6, mailed on Apr. 24, 2020, 6 pages. |
| Office Action received for European Patent Application No. 18732519.6, mailed on Oct. 6, 2020, 5 pages. |
| Office Action received for European Patent Application No. 19172407.9, mailed on Oct. 18, 2019, 7 pages. |
| Office Action received for European Patent Application No. 19181242.9, mailed on Dec. 6, 2019, 9 pages. |
| Office Action received for European Patent Application No. 19186042.8, mailed on Dec. 2, 2021, 5 pages. |
| Office Action received for European Patent Application No. 19186042.8, mailed on May 12, 2020, 5 pages. |
| Office Action received for European Patent Application No. 19186042.8, mailed on Sep. 24, 2019, 6 pages. |
| Office Action received for European Patent Application No. 19204230.7, mailed on Sep. 28, 2020, 6 pages. |
| Office Action received for European Patent Application No. 19211833.9, mailed on Jan. 29, 2021, 5 pages. |
| Office Action received for European Patent Application No. 19211833.9, mailed on Jul. 13, 2020, 7 pages. |
| Office Action received for European Patent Application No. 19212057.4, mailed on Mar. 9, 2021, 6 pages. |
| Office Action received for European Patent Application No. 19724959.2, mailed on Apr. 23, 2020, 10 pages. |
| Office Action received for European Patent Application No. 20168021.2, mailed on Jul. 22, 2020, 8 pages. |
| Office Action received for European Patent Application No. 20191533.7, mailed on May 12, 2022, 5 pages. |
| Office Action received for European Patent Application No. 20722020.3, mailed on May 12, 2021, 9 pages. |
| Office Action received for Indian Patent Application No. 201814036470, mailed on Feb. 26, 2021, 7 pages. |
| Office Action received for Indian Patent Application No. 201814036472, mailed on Jul. 8, 2021, 8 pages. |
| Office Action received for Indian Patent Application No. 201917046737, mailed on Aug. 9, 2021, 8 pages. |
| Office Action received for Indian Patent Application No. 202015008747, mailed on Mar. 15, 2023, 10 pages. |
| Office Action received for Indian Patent Application No. 202215026505, mailed on Feb. 8, 2023, 9 pages. |
| Office Action received for Japanese Patent Application No. 2018-182607, mailed on Apr. 6, 2020, 6 pages. |
| Office Action received for Japanese Patent Application No. 2018-182607, mailed on Jul. 20, 2020, 5 pages. |
| Office Action received for Japanese Patent Application No. 2018-182607, mailed on Sep. 8, 2021, 7 pages. |
| Office Action received for Japanese Patent Application No. 2018-184254, mailed on Mar. 2, 2020, 8 pages. |
| Office Action received for Japanese Patent Application No. 2019-215503, mailed on Feb. 5, 2021, 12 pages. |
| Office Action received for Japanese Patent Application No. 2019-215503, mailed on Jul. 3, 2020, 12 pages. |
| Office Action received for Japanese Patent Application No. 2019-511975, mailed on Apr. 10, 2020, 6 pages. |
| Office Action received for Japanese Patent Application No. 2019-563408, mailed on Nov. 2, 2020, 4 pages. |
| Office Action received for Japanese Patent Application No. 2019-563560, mailed on Jul. 4, 2022, 34 pages. |
| Office Action received for Japanese Patent Application No. 2019-563560, mailed on Jun. 14, 2021, 6 pages. |
| Office Action received for Japanese Patent Application No. 2019-563560, mailed on Nov. 30, 2020, 7 pages. |
| Office Action received for Japanese Patent Application No. 2020-120086, mailed on May 21, 2021, 6 pages. |
| Office Action received for Japanese Patent Application No. 2020-120086, mailed on Nov. 20, 2020, 6 pages. |
| Office Action received for Japanese Patent Application No. 2020-159823, mailed on Aug. 15, 2022, 6 pages. |
| Office Action received for Japanese Patent Application No. 2020-159823, mailed on Dec. 23, 2021, 8 pages. |
| Office Action received for Japanese Patent Application No. 2020-159824, mailed on Dec. 17, 2021, 13 pages. |
| Office Action received for Japanese Patent Application No. 2020-159825, mailed on Dec. 10, 2021, 4 pages. |
| Office Action received for Japanese Patent Application No. 2020-193703, mailed on Apr. 19, 2021, 4 pages. |
| Office Action received for Japanese Patent Application No. 2021-001028, mailed on Jan. 31, 2022, 10 pages. |
| Office Action received for Japanese Patent Application No. 2021-092483, mailed on Apr. 1, 2022, 8 pages. |
| Office Action received for Japanese Patent Application No. 2021-153573, mailed on Oct. 17, 2022, 4 pages. |
| Office Action received for Japanese Patent Application No. 2021-166686, mailed on Oct. 3, 2022, 3 pages. |
| Office Action received for Japanese Patent Application No. 2021-173713, mailed on Nov. 16, 2022, 9 pages. |
| Office Action received for Korean Patent Application No. 10-2019-7005136, mailed on Jan. 28, 2020, 5 pages. |
| Office Action received for Korean Patent Application No. 10-2019-7005369, mailed on Mar. 13, 2020, 12 pages. |
| Office Action received for Korean Patent Application No. 10-2019-7033634, mailed on Sep. 28, 2020, 15 pages. |
| Office Action received for Korean Patent Application No. 10-2019-7033799, mailed on Apr. 27, 2021, 9 pages. |
| Office Action received for Korean Patent Application No. 10-2019-7033799, mailed on Nov. 23, 2021, 6 pages. |
| Office Action received for Korean Patent Application No. 10-2020-0123852, mailed on Jun. 9, 2022, 10 pages. |
| Office Action received for Korean Patent Application No. 10-2020-0123857, mailed on Dec. 16, 2022, 8 pages. |
| Office Action received for Korean Patent Application No. 10-2020-0123857, mailed on Jun. 9, 2022, 12 pages. |
| Office Action received for Korean Patent Application No. 10-2020-0123887, mailed on Jun. 9, 2022, 5 pages. |
| Office Action received for Korean Patent Application No. 10-2020-7031855, mailed on Nov. 24, 2020, 6 pages. |
| Office Action received for Korean Patent Application No. 10-2020-7032147, mailed on Feb. 16, 2021, 6 pages. |
| Office Action received for Korean Patent Application No. 10-2021-7002582, mailed on Apr. 16, 2021, 13 pages. |
| Office Action received for Korean Patent Application No. 10-2021-7002582, mailed on Oct. 29, 2021, 6 pages. |
| Office Action received for Korean Patent Application No. 10-2021-7015473, mailed on Aug. 25, 2021, 5 pages. |
| Office Action received for Korean Patent Application No. 10-2022-7003364, mailed on Apr. 22, 2022, 14 pages. |
| Office Action received for Korean Patent Application No. 10-2022-7003364, mailed on Dec. 26, 2022, 8 pages. |
| Office Action received for Korean Patent Application No. 10-2022-7004578, mailed on Mar. 22, 2022, 11 pages. |
| Office Action received for Korean Patent Application No. 10-2022-7009437, mailed on Nov. 30, 2022, 6 pages. |
| Office Action received for Korean Patent Application No. 10-2022-7029803, mailed on Sep. 3, 2022, 5 pages. |
| Office Action received for Taiwanese Patent Application No. 100111887, mailed on Oct. 7, 2013, 23 pages. |
| Opuni Kojo, “FaceShift Studio Demo”, Available online at : https://www.youtube.com/watch?v=72ty7PYKwGU, Oct. 1, 2012, 3 pages. |
| Pavlakos et al., “Expressive Body Capture: 3D Hands, Face, and Body from a Single Image”, In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 2019, online available at https://arxiv.org/abs/1904.05866, 2019, pp. 10975-10985. |
| PC World, “How to make AR Emojis on the Samsung Galaxy S9”, You Tube, Available Online: https://www.youtube.com/watch?v=8wQICfulkz0, Feb. 25, 2018, 2 pages. |
| Pre-Appeal Review Report received for Japanese Patent Application No. 2018-182607, mailed on Jan. 21, 2021, 4 pages. |
| Pumarola et al., “GANimation: Anatomically-aware Facial Animation from a Single Image”, Proceedings of the European Conference on Computer Vision ECCV), Jul. 24, 2018, 16 pages. |
| Pyun et al., “An Example-Based Approach for Facial Expression Cloning”, SIGGRAPH Symposium on Computer Animation, The Eurographics Association 2003), 2003, 10 pages. |
| Reallusion, “CrazyTalk 8 Tutorial—Customizing Eyes and Teeth”, Online available at: https://www.youtube.com/watch?v=A9LgNB1PoMY, Dec. 23, 2015, 21 pages. |
| Record of Oral Hearing received for U.S. Appl. No. 15/714,887, mailed on Feb. 15, 2022, 16 pages. |
| Record of Oral Hearing received for U.S. Appl. No. 16/259,771, mailed on Aug. 4, 2021, 15 pages. |
| Result of Consultation received for European Patent Application No. 19172407.9, mailed on Nov. 5, 2020, 17 pages. |
| Result of Consultation received for European Patent Application No. 19204230.7, mailed on Nov. 16, 2020, 3 pages. |
| Result of Consultation received for European Patent Application No. 19204230.7, mailed on Sep. 24, 2020, 5 pages. |
| Result of Consultation received for European Patent Application No. 19211833.9, mailed on Jul. 15, 2021, 3 pages. |
| Result of Consultation received for European Patent Application No. 19724959.2, mailed on Sep. 4, 2020, 3 pages. |
| Result of Consultation received for European Patent Application No. 19181242.9, mailed on Dec. 1, 2020, 12 pages. |
| Rosa et al., “Stripe Generator—a Free Tool for the Web Design Community”, Available online at: http://www.stripegenerator.com/, Mar. 28, 2019, 10 pages. |
| Sambrook Jade, “Video Selfie Filters with MSQRD for Facebook Live”, Available Online at: <https://www.youtube.com/watch?v=JZrWK2NEFeg>, See especially 2:44-3:03, Jul. 2, 2016, 3 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201770393, mailed on Jun. 21, 2017, 9 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201770418, mailed on Jun. 23, 2017, 8 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201770419, mailed on Jun. 19, 2017, 6 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201870366, mailed on Aug. 27, 2018, 9 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201870367, mailed on Aug. 27, 2018, 9 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201870368, mailed on Sep. 6, 2018, 7 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201870372, mailed on Sep. 14, 2018, 8 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201870372, mailed on Sep. 17, 2018, 10 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201870374, mailed on Aug. 27, 2018, 9 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201870375, mailed on Aug. 23, 2018, 8 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201870377, mailed on Sep. 4, 2018, 8 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201970530, mailed on Oct. 11, 2019, 8 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA201970531, mailed on Oct. 11, 2019, 9 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA202070623, mailed on Dec. 21, 2020, 9 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA202070624, mailed on Dec. 10, 2020, 10 pages. |
| Search Report and Opinion received for Danish Patent Application No. PA202070625, mailed on Dec. 17, 2020, 9 pages. |
| Search Report received for Danish Patent Application No. PA201870381, mailed on Sep. 13, 2018, 7 pages. |
| Singh Lovepreet, “Samsung Galaxy Watch: How to Change Watch Face—Tips and Tricks”, Online available at: <https://www.youtube.com/watch?pp=desktop&v=IN7gPxTZ1qU>, Dec. 4, 2018, 80 pages. |
| SlashGear, “Samsung AR Emoji demo on the Galaxy S9”, Available Online at <https://www.youtube.com/watch?v=GQwNKzY4C9Y>, Feb. 25, 2018, 3 pages. |
| Space-O Digicom Private Limited, “Tongue Piercing Booth—The Barbell Tongue Rings & Oral Piercings App”, May 30, 2017, 5 pages. |
| SpellBurst, “The Sims 3: Create a Sim With Me | #2—Dark Fairy + Full CC List!”, Available online at: <https://www.youtube.com/watch?v=Dy_5g9B-wkA>, Oct. 9, 2017, 2 pages. |
| StateofTech, “iPhone 6 Tips—How to Access the Camera from the Lock Screen”, Screen captures with generated transcript from YouTube video clip, Online Available at: <https://www.youtube.com/watch?v=frB151RYB7U>, Jul. 2, 2015, 23 pages. |
| Summons to Attend Oral Proceedings received for European Patent Application No. 19172407.9, mailed on Jun. 24, 2020, 14 pages. |
| Summons to Attend Oral Proceedings received for European Patent Application No. 19181242.9, mailed on Jun. 16, 2020, 12 pages. |
| Summons to Attend Oral Proceedings received for European Patent Application No. 19181242.9, mailed on May 19, 2022, 7 pages. |
| Summons to Attend Oral Proceedings received for European Patent Application No. 19204230.7, mailed on May 25, 2021, 10 pages. |
| Summons to Attend Oral Proceedings received for European Patent Application No. 19724959.2, mailed on Feb. 1, 2021, 9 pages. |
| Summons to Attend Oral Proceedings received for European Patent Application No. 19724959.2, mailed on Mar. 31, 2021, 3 pages. |
| Supplemental Notice of Allowance received for U.S. Appl. No. 15/713,490, mailed on May 30, 2019, 2 pages. |
| Supplemental Notice of Allowance received for U.S. Appl. No. 15/870,195, mailed on Nov. 14, 2019, 9 pages. |
| Supplemental Notice of Allowance received for U.S. Appl. No. 16/143,201, mailed on Dec. 13, 2018, 2 pages. |
| Supplemental Notice of Allowance received for U.S. Appl. No. 16/143,201, mailed on Dec. 19, 2018, 2 pages. |
| Supplemental Notice of Allowance received for U.S. Appl. No. 16/143,201, mailed on Jan. 10, 2019, 2 pages. |
| Supplemental Notice of Allowance received for U.S. Appl. No. 16/833,436, mailed on Jul. 14, 2022, 2 pages. |
| SwitchForce, “Nintendo Switch Mii Creation+ NEW Mii Options and Poses”, Online Available at: https://www.youtube.com/watch?v=n4ZFuaf2k4M, Feb. 23, 2017, 8 pages. |
| Tech With Brett, “How to Create Your AR Emoji on the Galaxy S9 and S9+”, Available online at: <https://www.youtube.com/watch?v=HHMdcBpC8MQ>, Mar. 16, 2018, 5 pages. |
| TheUnlockr, “Galaxy Watch Complete Walkthrough: The Best Watch They've Made So Far”, Available online at: https://www.youtube.com/watch?v=xiEClfe1SN4, Sep. 11, 2018, 27 pages. |
| Ting, “Giphy Cam iOS) | Ting Download”, Available online at : https://www.youtube.com/watch?v=mykfBpyD3gg, Oct. 2, 2015, 3 pages. |
| Tsuchihashi et al., “Generation of Caricatures by Automatic Selection of Templates for Shapes and Placement of Facial Parts”, Technical Report of the Institute of Image Information and Television Engineers, Japan, The Institute of Image Information and Television Engineers, vol. 33, No. 11, pp. 77-80., Feb. 8, 2009, 7 pages. |
| Twins Tornado, “New Tutorial: Add Facial Expressions to your Game Characters!”, Available online at : https://www.youtube.com/watch?v=wKSjByNyaKA, Mar. 14, 2014, 4 pages. |
| VidsTube, “Bitmoji Clockface on Fitbit Versa Sense/Versa 3/Versa 2”, Available online at: <https://www.youtube.com/watch?v=4V_xDnSLeHE>, Retrieved on Dec. 3, 2020, Jun. 30, 2019, 1 page. |
| Woolsey Amanda, “How To Customize The Clock on the Apple Watch”, Available online at: <https://www.youtube.com/watch?v=t-3Bckdd9B4>, Retrieved on Dec. 11, 2020, Apr. 25, 2015, 1 page. |
| Yom Mama, “SnapChat Tutorial For Beginners!”, Available Online at: <https://www.youtube.com/watch?v=zUmj039NNOU>, See especially 6:55-7:22, Jun. 6, 2016, 3 pages. |
| Zhang et al., “Facial Expression Retargeting from Human to Avatar Made Easy”, IEEE Transactions On Visualization And Computer Graphics, Aug. 2020, 14 pages. |
| Zhao et al., “An Event-related Potential Comparison of Facial Expression Processing between Cartoon and Real Faces”, Online available at: https://www.biorxiv.org/content/10.1101/333898v2, Jun. 18, 2018, 31 pages. |
| Zollhöfer et al., “State of the Art on Monocular 3D Face Reconstruction, Tracking, and Applications”, In Computer graphics forum May 2018 vol. 37, No. 2), online available at https://studios.disneyresearch.com/wp-content/uploads/2019/03/State-of-the-Art-on-Monocular-3D-Face-Reconstruction-Tracking-and-Applications-1.pdf., 2018, 28 pages. |
| Zy News, “Generate Cartoon Face within Three Seconds, You are the New-generation Expression Emperor”, Online available at: <http://inews.ifeng.com/48551936/news.shtml>, Apr. 22, 2016, 3 pages. |
| Examiner's Answer to Appeal Brief received for U.S. Appl. No. 17/031,671, mailed on Dec. 8, 2023, 16 pages. |
| Intention to Grant received for European Patent Application No. 18732519.6, mailed on Dec. 15, 2023, 10 pages. |
| Non-Final Office Action received for U.S. Appl. No. 18/197,242, mailed on Dec. 7, 2023, 24 pages. |
| Advisory Action received for U.S. Appl. No. 17/093,408, mailed on Jun. 5, 2023, 4 pages. |
| Alldieck et al., “Learning to Reconstruct People in Clothing from a Single RGB Camera”, Rxiv.Org, Cornell University Library, 201 Olin Library Cornell University Ithaca, Ny 14853, 2019, 12 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/582,500, mailed on Apr. 14, 2023, 4 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/582,500, mailed on May 4, 2023, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,671, mailed on May 23, 2023, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,765, mailed on Apr. 17, 2023, 4 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/031,765, mailed on May 3, 2023, 6 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/093,408, mailed on May 10, 2023, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/093,408, mailed on May 25, 2023, 2 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/461,014, mailed on Feb. 21, 2023, 3 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/941,962, mailed on May 30, 2023, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/525,664, mailed on Apr. 11, 2023, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/525,664, mailed on Feb. 23, 2023, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/525,664, mailed on May 17, 2023, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/941,962, mailed on Apr. 14, 2023, 6 pages. |
| Decision to Grant received for Japanese Patent Application No. 2021-166686, mailed on Apr. 20, 2023, 2 pages (1 page of English Translation and 1 page of Official Copy). |
| Droid Life, “20+ Galaxy S9, S9+ Tips and Tricks”, Available Online at: https://www.youtube.com/watch?v=sso0mYTfV6w, Mar. 22, 2018, pp. 1-33. |
| Examiner's Answer to Appeal Brief received for U.S. Appl. No. 16/259,771, mailed on May 26, 2023, 23 pages. |
| Final Office Action received for U.S. Appl. No. 16/582,500, mailed on Feb. 3, 2023, 24 pages. |
| Final Office Action received for U.S. Appl. No. 16/583,706, mailed on Feb. 17, 2023, 38 pages. |
| Final Office Action received for U.S. Appl. No. 17/093,408, mailed on Mar. 2, 2023, 51 pages. |
| Final Office Action received for U.S. Appl. No. 17/461,014, mailed on Apr. 6, 2023, 24 pages. |
| Gauging Gadgets, “How to Customize Watch Faces—Garmin Venu Tutorial”, Online Available at: https://www.youtube.com/watch?v=dxajKKulaP0, Jan. 7, 2020, 14 pages. |
| IGN, “Create a Sim”, The Sims 4 Wiki Guide, Available Online at: https://www.ign.conn/wikis/the-sinns-4/Create_a_Sinn, Jun. 27, 2018, 17 pages. |
| Intention to Grant received for European Patent Application No. 21166287.9, mailed on Feb. 23, 2023, 9 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2022/050799, mailed on Apr. 3, 2023, 18 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/031,671, mailed on Mar. 17, 2023, 34 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/031,765, mailed on Mar. 28, 2023, 31 pages. |
| Non-Final Office Action received for U.S. Appl. No. 17/725,311, mailed on May 10, 2023, 54 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2022200965, mailed on May 11, 2023, 3 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2020-0123852, mailed on Mar. 9, 2023, 7 pages (2 pages of English Translation and 5 pages of Official Copy). |
| Notice of Allowance received for Korean Patent Application No. 10-2020-0123857, mailed on Feb. 21, 2023, 6 pages (1 page of English Translation and 5 pages of Official Copy). |
| Notice of Allowance received for Korean Patent Application No. 10-2022-7029803, mailed on Mar. 23, 2023, 8 pages (2 pages of English Translation and 6 pages of Official Copy). |
| Notice of Allowance received for U.S. Appl. No. 17/525,664, mailed on Apr. 26, 2023, 10 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/525,664, mailed on Feb. 14, 2023, 10 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/736,925, mailed on Apr. 24, 2023, 10 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/746,179, mailed on Mar. 6, 2023, 8 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/941,962, mailed on Mar. 10, 2023, 11 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/941,962, mailed on May 3, 2023, 10 pages. |
| Office Action received for Australian Patent Application No. 2022200965, mailed on Feb. 14, 2023, 4 pages. |
| Office Action received for Australian Patent Application No. 2022203285, mailed on Apr. 20, 2023, 4 pages. |
| Office Action received for Australian Patent Application No. 2022203285, mailed on Jan. 18, 2023, 3 pages. |
| Office Action received for Chinese Patent Application No. 201780053143.0, mailed on Nov. 30, 2022, 13 pages (6 pages of English Translation and 7 pages of Official Copy). |
| Office Action received for European Patent Application No. 20704768.9, mailed on Mar. 24, 2023, 8 pages. |
| Office Action received for European Patent Application No. 22154034.7, mailed on May 26, 2023, 10 pages. |
| Office Action received for Indian Patent Application No. 202015008746, mailed on Mar. 6, 2023, 7 pages. |
| Office Action received for Indian Patent Application No. 202215026045, mailed on Mar. 31, 2023, 8 pages. |
| Office Action received for Japanese Patent Application No. 2019-563560, mailed on Jan. 20, 2023, 56 pages (25 pages of English Translation and 31 pages of Official Copy). |
| Office Action received for Japanese Patent Application No. 2021-168243, mailed on Feb. 6, 2023, 8 pages (4 pages of English Translation and 4 pages of Official Copy). |
| Office Action received for Korean Patent Application No. 10-2022-7004578, mailed on Jan. 27, 2023, 8 pages (4 pages of English Translation and 4 pages of Official Copy). |
| Office Action received for Korean Patent Application No. 10-2022-7004578, mailed on May 11, 2023, 8 pages (4 pages of English Translation and 4 pages of Official Copy). |
| Pre-Appeal Review Report received for Japanese Patent Application No. 2020-159823, mailed on Jan. 12, 2023, 4 pages (2 pages of English Translation and 2 pages of Official Copy). |
| Summons to Attend Oral Proceedings received for European Patent Application No. 17853657.9, mailed on May 2, 2023, 8 pages. |
| Summons to Attend Oral Proceedings received for European Patent Application No. 19212057.4, mailed on Apr. 19, 2023, 9 pages. |
| Supplemental Notice of Allowance received for U.S. Appl. No. 17/746,179, mailed on Apr. 3, 2023, 2 pages. |
| Takahashi et al., “Neural network modeling of altered facial expression recognition in autism spectrum disorders based on predictive processing framework”, Scientific reports, Online available at:—https://www.nature.com/articles/s41598-021-94067-x, Jul. 26, 2021, 14 pages. |
| Communication for Board of Appeal received for European Patent Application No. 19724959.2, mailed on Sep. 27, 2023, 14 pages. |
| Non-Final Office Action received for U.S. Appl. No. 18/071,434, mailed on Sep. 22, 2023, 27 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2023200867, mailed on Sep. 13, 2023, 3 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2021-7036424, mailed on Sep. 11, 2023, 7 pages (2 pages of English Translation and 5 pages of Official Copy). |
| Office Action received for Australian Patent Application No. 2023201250, mailed on Sep. 11, 2023, 3 pages. |
| Intention to Grant received for European Patent Application No. 20722020.3, mailed on Nov. 22, 2023, 10 pages. |
| International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US2022/029811, mailed on Nov. 30, 2023, 10 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2023201250, mailed on Nov. 21, 2023, 3 pages. |
| Office Action received for Indian Patent Application No. 202118051150, mailed on Nov. 24, 2023, 5 pages. |
| Office Action received for Japanese Patent Application No. 2022-170806, mailed on Nov. 17, 2023, 14 pages (7 pages of English Translation and 7 pages of Official Copy). |
| Pre-Appeal Review Report received for Japanese Patent Application No. 2021-173713, mailed on Nov. 10, 2023, 4 pages (2 pages of English Translation and 2 pages of Official Copy). |
| Supplemental Notice of Allowance received for U.S. Appl. No. 17/971,456, mailed on Dec. 4, 2023, 2 pages. |
| Applicant Initiated Interview Summary received for U.S. Appl. No. 17/725,311, mailed on Jun. 30, 2023, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/582,500, mailed on Aug. 1, 2023, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/941,962, mailed on Aug. 3, 2023, 2 pages. |
| Decision to Grant received for Japanese Patent Application No. 2023-083816, mailed on Aug. 9, 2023, 2 pages (1 page of English Translation and 1 page of Official Copy). |
| Decision to Refuse received for Japanese Patent Application No. 2021-168243, mailed on Aug. 14, 2023, 7 pages (3 pages of English Translation and 4 pages of Official Copy). |
| Examiner's Answer to Appeal Brief received for U.S. Appl. No. 16/583,706, mailed on Aug. 1, 2023, 29 pages. |
| Extended European Search Report received for European Patent Application No. 23168077.8, mailed on Jul. 11, 2023, 12 pages. |
| Intention to Grant received for European Patent Application No. 20722020.3, mailed on Jun. 7, 2023, 10 pages. |
| Notice of Acceptance received for Australian Patent Application No. 2022203285, mailed on Jun. 16, 2023, 3 pages. |
| Notice of Allowance received for Chinese Patent Application No. 201780058426.4, mailed on Jun. 30, 2023, 2 pages (1 page of English Translation and 1 page of Official Copy). |
| Notice of Allowance received for Japanese Patent Application No. 2020-159823, mailed on Jul. 24, 2023, 23 pages (1 page of English Translation and 22 pages of Official Copy). |
| Notice of Allowance received for Korean Patent Application No. 10-2022-7003364, mailed on Jul. 28, 2023, 7 pages (2 pages of English Translation and 5 pages of Official Copy). |
| Notice of Allowance received for Korean Patent Application No. 10-2022-7009437, mailed on Jun. 22, 2023, 7 pages (2 pages of English Translation and 5 pages of Official Copy). |
| Notice of Allowance received for Korean Patent Application No. 10-2023-7021441, mailed on Jul. 6, 2023, 8 pages (2 pages of English Translation and 6 pages of Official Copy). |
| Notice of Allowance received for U.S. Appl. No. 17/736,925, mailed on Aug. 3, 2023, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/941,962, mailed on Jul. 3, 2023, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/971,456, mailed on Jun. 26, 2023, 9 pages. |
| Office Action received for Australian Patent Application No. 2023200039, mailed on Jul. 4, 2023, 2 pages. |
| Office Action received for Australian Patent Application No. 2023200867, mailed on Jul. 21, 2023, 3 pages. |
| Office Action received for Japanese Patent Application No. 2021-173713, mailed on Jun. 15, 2023, 4 pages (2 pages of English Translation and 2 pages of Official Copy). |
| Office Action received for Korean Patent Application No. 10-2023-0064928, mailed on Jun. 9, 2023, 6 pages (2 pages of English Translation and 4 pages of Official Copy). |
| Summons to Oral Proceedings received for European Patent Application No. 19724959.2, mailed on Jul. 14, 2023, 6 pages. |
| IGN,“Create a Sim”, The Sims 4 Wiki Guide, Available Online at: https://www.ign.com/wikis/the-sims-4/Create_a_Sim, Jun. 27, 2018, 17 pages. |
| Final Office Action received for U.S. Appl. No. 17/725,311, mailed on Oct. 13, 2023, 66 pages. |
| Non-Final Office Action received for U.S. Appl. No. 16/582,500, mailed on Oct. 13, 2023, 25 pages. |
| Notice of Allowance received for Korean Patent Application No. 10-2023-0064928, mailed on Sep. 22, 2023, 7 pages (2 pages of English Translation and 5 pages of Official Copy). |
| Office Action received for European Patent Application No. 19186042.8, mailed on Oct. 10, 2023, 6 pages. |
| Supplemental Notice of Allowance received for U.S. Appl. No. 17/971,456, mailed on Oct. 16, 2023, 5 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 16/582,500, mailed on Feb. 20, 2024, 3 pages. |
| Decision to Refuse received for European Patent Application No. 17853657.9, mailed on Feb. 2, 2024, 17 pages. |
| Decision to Refuse received for European Patent Application No. 19212057.4, mailed on Feb. 5, 2024, 18 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/725,311, mailed on Feb. 14, 2024, 8 pages. |
| Notice of Hearing received for Indian Patent Application No. 201814036470, mailed on Feb. 7, 2024, 4 pages. |
| Record of Oral Hearing received for U.S. Appl. No. 16/259,771, mailed on Feb. 4, 2024, 15 pages. |
| Summons to Attend Oral Proceedings received for European Patent Application No. 20191533.7, mailed on Feb. 13, 2024, 7 pages. |
| Decision on Appeal received for U.S. Appl. No. 16/259,771, mailed on Feb. 8, 2024, 18 pages. |
| Examiner's Answer to Appeal Brief received for U.S. Appl. No. 17/461,014, mailed on Jan. 29, 2024, 13 pages. |
| Extended European Search Report received for European Patent Application No. 23198442.8, mailed on Dec. 12, 2023, 5 pages. |
| Minutes of the Oral Proceedings received for European Patent Application No. 19212057.4, mailed on Jan. 31, 2024, 6 pages. |
| Notice of Allowance received for Chinese Patent Application No. 202310124087.2, mailed on Jan. 25, 2024, 4 pages (1 page of English Translation and 3 pages of Official Copy). |
| Notice of Allowance received for U.S. Appl. No. 18/071,434, mailed on Jan. 31, 2024, 10 pages. |
| Office Action received for Australian Patent Application No. 2023200797, mailed on Jan. 23, 2024, 5 pages. |
| Office Action received for Australian Patent Application No. 2023282284, mailed on Jan. 19, 2024, 6 pages. |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 17/725,311, mailed on Jan. 16, 2024, 6 pages. |
| Office Action received for European Patent Application No. 21728746.5, mailed on Jan. 11, 2024, 4 pages. |
| Office Action received for Japanese Patent Application No. 2022-163568, mailed on Dec. 22. 2023, 8 pages (4 pages of English Translation and 4 pages of Official Copy). |
| Applicant-Initiated Interview Summary received for U.S. Appl. No. 18/197,242. mailed on Feb. 22, 2024, 2 pages. |
| Communication for Board of Appeal received for European Patent Application No. 19204230.7, mailed on Feb. 16, 2024, 1 page. |
| Notice of Allowance received for U.S. Appl. No. 18/197,242, mailed on Mar. 6, 2024, 11 pages. |
| Office Action received for Chinese Patent Application No. 201880004632.1, mailed on Jan. 31, 2024, 7 pages (3 pages of English Translation and 4 pages of Official Copy). |
| Office Action received for European Patent Application No. 22154034.7, mailed on Feb. 19, 2024, 8 pages. |
| Office Action received for Korean Patent Application No. 10-2023-7032383, mailed on Feb. 5, 2024, 16 pages (7 pages of English Translation and 9 pages of Official Copy). |
| Summons to Oral Proceedings received for European Patent Application No. 19204230.7, mailed on Feb. 19, 2024, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 18/197,242, mailed on Mar. 18, 2024, 2 pages. |
| International Search Report and Written Opinion received for PCT Patent Application No. PCT/US2023/031979, mailed on Mar. 12, 2024, 16 pages. |
| Invitation to Pay Additional Fees and Partial International Search Report received for PCT Patent Application No. PCT/US2023/031979, mailed on Jan. 19, 2024, 9 pages. |
| Notice of Allowance received for Japanese Patent Application No. 2022-186563, mailed on Mar. 1, 2024, 4 pages (1 page of English Translation and 3 pages of Official Copy). |
| Notice of Allowance received for U.S. Appl. No. 18/220,715, mailed on Mar. 7, 2024, 11 pages. |
| Office Action received for Japanese Patent Application No. 2021-168243, mailed on Mar. 8, 2024, 4 pages (2 pages of English Translation and 2 pages of Official Copy). |
| Office Action received for Korean Patent Application No. 10-2024-7004853, mailed on Mar. 4, 2024, 6 pages (2 pages of English Translation and 4 pages of Official Copy). |
| Record of Oral Hearing received for U.S. Appl. No. 16/583,706, mailed on Mar. 5, 2024, 13 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 17/725,311, mailed on Mar. 28, 2024, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 18/071,434, mailed on Mar. 21, 2024, 2 pages. |
| Corrected Notice of Allowance received for U.S. Appl. No. 18/197,242, mailed on Mar. 27, 2024, 2 pages. |
| Decision to Grant received for European Patent Application No. 18732519.6, mailed on Mar. 28, 2024, 4 pages. |
| Decision to Grant received for European Patent Application No. 20722020.3, mailed on Mar. 21, 2024, 4 pages. |
| Intention to Grant received for European Patent Application No. 23198442.8, mailed on Mar. 18, 2024, 9 pages. |
| Notice of Allowance received for U.S. Appl. No. 17/031,765, mailed on Apr. 2, 2024, 34 pages. |
| Office Action received for Japanese Patent Application No. 2022-194369, mailed on Mar. 15, 2024, 11 pages (5 pages of English Translation and 6 pages of Official Copy). |
| Office Action received for Korean Patent Application No. 10-2023-7025821, mailed on Mar. 12, 2024, 11 pages (5 pages of English Translation and 6 pages of Official Copy). |
| Office Action received for Korean Patent Application No. 10-2023-7039673, mailed on Feb. 20, 2024, 11 pages (2 pages of English Translation and 9 pages of Official Copy). |
| Office Action received for European Patent Application No. 23168077.8, mailed on Apr. 25, 2024, 7 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20230343053 A1 | Oct 2023 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62679950 | Jun 2018 | US | |
| 62668200 | May 2018 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17370505 | Jul 2021 | US |
| Child | 18138634 | US | |
| Parent | 17091460 | Nov 2020 | US |
| Child | 17370505 | US | |
| Parent | 16519850 | Jul 2019 | US |
| Child | 17091460 | US | |
| Parent | 16142288 | Sep 2018 | US |
| Child | 16519850 | US |
