The present invention relates generally to three-dimensional (3D) computer animation and visual effects software, and in particular, to a method, apparatus, system, framework, and article of manufacture for a tutorial system for onboarding new users.
Three-dimensional (3D) computer animation and visual effects applications (3D application) can be complex and can have a steep learning curve. Studies have shown that with such 3D applications, there is a noteworthy percentage of users (e.g., prospects and/or existing customers) that churn (i.e., move to a competitor, have low use of the software, just evaluating, etc.). The cost of the 3D application, ease of use, and ease of learning are the biggest contributors of churn. Further, a majority of the users expect to learn how to use such 3D applications on their own compared to those that expect to learn by participating in formal training. In addition, users desire a minimal amount of time to learn how to use such 3D applications. In view of the above, it is desirable to have an on-boarding/first experience process that enables users to learn how to use such 3D applications (e.g., as a first experience with either the application or a feature of the application) while investing a minimum amount of time and effort. Prior art systems fail to provide such capabilities.
One or more embodiments of the invention overcome the problems of the prior art by providing a state machine to build interactive tutorials for a 3D animation and visual effects application. The interactive tutorial provides a gamified mechanism for walking a user through the performance of a (3D animation, modeling, or visual effect) operation in the 3D application. Further, a 3D polygon avatar character immersed within the 3D application interacts with the user input to walk the user through the operation. The state machine controls the interactive tutorial and consists of daisy chained stage nodes that represent the steps of the tutorial and invoke scripts (or other computer code) that provide instructions to the user and control how the tutorial progresses. In addition, the state machine is exposed to the user such that it can be edited/modified to customize the tutorial. Further, by exposing the state machine capability, a user can create a new state machine to create a new tutorial.
Referring now to the drawings in which like reference numbers represent corresponding parts throughout:
In the following description, reference is made to the accompanying drawings which form a part hereof, and which is shown, by way of illustration, several embodiments of the present invention. It is understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.
Embodiments of the invention provide a user experience that consists of a gamified learning experience via interactive learning tutorials. The learning experience is embedded into the application itself and led via an interactive character that is gender neutral, inviting, welcoming, and not intimidating. When starting the 3D application, the application prompts the user to determine whether the user is a new user or an experienced one. If new, the user is taken to a Getting Started page where an interactive tutorial is hosted. If experienced, the user may be brought to a different page and/or further queried to determine if the user would like to initialize the interactive learning tutorial (i.e., to enable the user to create their own in-app interactive experiences).
Once the interactive tutorial commences, an interactive tutorial screen is displayed where the user is introduced to a virtual instructor (e.g., a 3D polygon avatar character) that is immersed within the 3D application.
Text instructions for the tutorial may be displayed in two different areas—overlay bubble 208 and overlay dialog 210. The overlay bubble 208 is a word bubble-style overlay that includes text that describes how the user can perform a current step (i.e., of the multiple steps of the operation). In
The overlay dialog 210 is a dialog style overlay with an image or text that illustrates how and what input mechanisms the user can utilize to perform a current step. In
Via the interactive tutorial, the user walks through the steps of an operation in the application itself in an interactive fully immersive manner while actually using the application (i.e., in contrast to a static video playback and/or walkthrough of static screen shots where the user is not actually performing an operation that the application was designed for (e.g., a 3D animation operation, modeling operation, visual effect operation, etc.). Thus, embodiments of the invention provide a system where the application itself teaches users how to use the application interactively in a gamified way while recognizing user inputs and successful passing of the steps required to move onto the next step.
In one or more embodiments of the invention, the interactive tutorial is controlled using a node-based state machine.
Stage nodes 302A, 302E and 302F have been expanded to display the attributes that have been configured for that stage node. The “On Activate Script” attribute 306 has a connection to a script node (e.g., script nodes 308A, 308F, and 308H). Each stage node 302 is connected via an “On Activate Script” attribute 306 to a script node (e.g., either an activation or deactivation script node). Script nodes 308 are where the bulk of each stage happens. The script node 308 may consist of a script/code written in a computer coding language (e.g., PYTHON, C++, BASIC, etc.). Essentially, the script node 308 automates operations/steps of the 3D application.
The “On Deactivate Script” attribute 310 is utilized to connect a script node (e.g., script nodes 308B, 308G, and 308I) to clean up after a stage once it's finished. In this regard, it is good practice to try and keep stage logic self-contained so that it's easy to move the stage 302 around or insert/delete a stage 302 as needed. In
The “Time Slider Bookmark” attribute 312 may be used for setting up animations at the beginning of a stage, but also for changing the state of a scene between one stage to another. In
The progression of stages based on the daisy chained stage nodes 302 may be defined using the node based state machine. Depending on the goal of a stage, the way it progresses to the next stage may differ. In this regard, stage nodes 302 may be chained together to execute multiple scripts in sequence according to a set of rules. These are useful for creating interactive experiences such as the tutorials of embodiments of the invention.
In addition, various source code/scripts may be used to display the 2D text or images on the user interface such as that illustrated in
At step 602, an interactive tutorial for performing an operation in the 3D application is initialized. The operation consists of a series of two or more steps and is a 3D animation, modeling, or visual effect operation.
At step 604, an instruction for performing a first step of the two or more steps is displayed in the 3D application. The instruction consists of text. In one or more embodiments, the instruction is an overlay bubble that is a word bubble-style overlay that includes the text. Further, the text in the overlay bubble describes how the user can perform a current step of the two or more steps. Alternatively, or in addition, the instruction may be an overlay dialog that is a dialog box style overlay. Such an overlay dialog is an image or text that illustrates how and what input mechanisms the user can utilize to perform a current step of the two or more steps. Further, the overlay dialog may include a progress status indicator reflecting how far the user has progressed in completing the two or more steps in the operation.
At step 606, input from a user is received into the 3D application.
At step 608, a determination is made regarding whether the input successfully completes/comprises the first step. The determination can be made based on an exact completion of the step or a range. For example, if the step consists of moving to a certain view or camera frustrum within a model, once the user has reached within a certain threshold range of that view/location, the step may be successfully completed. Alternatively, the user may be required to move to an exact view or camera frustrum. The range may also determine if a certain percentage of the step has been completed (e.g., if 6% of the particular steps have been completed).
If the input does not successfully comprise the first step, the system may wait for additional user input to further complete the step. Alternatively, if the input successfully comprises the first step, steps 604-608 are repeated for additional steps of the operation (i.e., until the operation has been completed).
Steps 602-608 may also include displaying a 3D polygon avatar character immersed within the 3D application. Such a 3D polygon avatar character interacts with the user input to walk the user through the operation.
Further to the above, the interactive tutorial initialized in step 602 (i.e., and the performance of steps 604-608) may be controlled using a node-based state machine. Such a node-based state machine consists of multiple stage nodes that are daisy chained together via on one or more connections. The connections reflect dependencies between the multiple stage nodes that are connected via the daisy chaining. Each of the multiple stage nodes corresponds to one of the two or more steps. In addition, a second stage node of the multiple stage nodes is dependent upon a completion of a first stage node that the second stage node is connected to such that the second stage node begins when the first stage node ends. A set of instructions are defined (e.g., via a computer coding language) for the second stage node and the set of instructions determine how the 3D application behaves upon activation of the second stage node.
Within the node-based state machine, an additional set of instructions also be defined for the second stage node. The additional set of instructions determines how the 3D application behaves upon deactivation of the second stage node.
Further to the above, the node-based state machine may be exposed to the user via a graph in a graphical user interface. Each of the multiple stage nodes is illustrated in the graph as a node, and the one or more connections between the multiple stage nodes are illustrated as lines. The graph can be edited (via user input into the graph) (e.g., by editing/moving one or more of the multiple stage nodes or one or more connections) such that the editing/moving affects the sequence of the interactive tutorial.
In addition, as part of the interactive tutorial (and via the node-based state machine), a pre-defined animation (e.g., a timeslider bookmark) may be triggered based on an initiation of the first step. Such an animation is intended to show/demonstrate to the user how a step is performed and/or the potential operations of the 3D application.
In one embodiment, the computer 702 operates by the hardware processor 704A performing instructions defined by the computer program 710 (e.g., a computer-aided design [CAD] application) under control of an operating system 708. The computer program 710 and/or the operating system 708 may be stored in the memory 706 and may interface with the user and/or other devices to accept input and commands and, based on such input and commands and the instructions defined by the computer program 710 and operating system 708, to provide output and results.
Output/results may be presented on the display 722 or provided to another device for presentation or further processing or action. In one embodiment, the display 722 comprises a liquid crystal display (LCD) having a plurality of separately addressable liquid crystals. Alternatively, the display 722 may comprise a light emitting diode (LED) display having clusters of red, green and blue diodes driven together to form full-color pixels. Each liquid crystal or pixel of the display 722 changes to an opaque or translucent state to form a part of the image on the display in response to the data or information generated by the processor 704 from the application of the instructions of the computer program 710 and/or operating system 708 to the input and commands. The image may be provided through a graphical user interface (GUI) module 718. Although the GUI module 718 is depicted as a separate module, the instructions performing the GUI functions can be resident or distributed in the operating system 708, the computer program 710, or implemented with special purpose memory and processors.
In one or more embodiments, the display 722 is integrated with/into the computer 702 and comprises a multi-touch device having a touch sensing surface (e.g., track pad or touch screen) with the ability to recognize the presence of two or more points of contact with the surface. Examples of multi-touch devices include mobile devices (e.g., IPHONE, NEXUS S, DROID devices, etc.), tablet computers (e.g., IPAD, HP TOUCHPAD, SURFACE Devices, etc.), portable/handheld game/music/video player/console devices (e.g., IPOD TOUCH, MP3 players, NINTENDO SWITCH, PLAYSTATION PORTABLE, etc.), touch tables, and walls (e.g., where an image is projected through acrylic and/or glass, and the image is then backlit with LEDs).
Some or all of the operations/procedures performed by the computer 702 according to the computer program 710 instructions may be implemented in a special purpose processor 704B. In this embodiment, some or all of the computer program 710 instructions may be implemented via firmware instructions stored in a read only memory (ROM), a programmable read only memory (PROM) or flash memory within the special purpose processor 704B or in memory 706. The special purpose processor 704B may also be hardwired through circuit design to perform some or all of the operations/procedures to implement the present invention. Further, the special purpose processor 704B may be a hybrid processor, which includes dedicated circuitry for performing a subset of functions, and other circuits for performing more general functions such as responding to computer program 710 instructions. In one embodiment, the special purpose processor 704B is an application specific integrated circuit (ASIC).
The computer 702 may also implement a compiler 712 that allows an application or computer program 710 written in a programming language such as C, C++, Assembly, SQL, PYTHON, PROLOG, MATLAB, RUBY, RAILS, HASKELL, or other language to be translated into processor 704 readable code. Alternatively, the compiler 712 may be an interpreter that executes instructions/source code directly, translates source code into an intermediate representation that is executed, or that executes stored precompiled code. Such source code may be written in a variety of programming languages such as JAVA, JAVASCRIPT, PERL, BASIC, etc. After completion, the application or computer program 710 accesses and manipulates data accepted from I/O devices and stored in the memory 706 of the computer 702 using the relationships and logic that were generated using the compiler 712.
The computer 702 also optionally comprises an external communication device such as a modem, satellite link, Ethernet card, or other device for accepting input from, and providing output to, other computers 702.
In one embodiment, instructions implementing the operating system 708, the computer program 710, and the compiler 712 are tangibly embodied in a non-transitory computer-readable medium, e.g., data storage device 720, which could include one or more fixed or removable data storage devices, such as a zip drive, floppy disc drive 724, hard drive, CD-ROM drive, tape drive, etc. Further, the operating system 708 and the computer program 710 are comprised of computer program 710 instructions which, when accessed, read and executed by the computer 702, cause the computer 702 to perform the steps necessary to implement and/or use the present invention or to load the program of instructions into a memory 706, thus creating a special purpose data structure causing the computer 702 to operate as a specially programmed computer executing the method steps described herein. Computer program 710 and/or operating instructions may also be tangibly embodied in memory 706 and/or data communications devices 730, thereby making a computer program product or article of manufacture according to the invention. As such, the terms “article of manufacture,” “program storage device,” and “computer program product,” as used herein, are intended to encompass a computer program accessible from any computer readable device or media.
Of course, those skilled in the art will recognize that any combination of the above components, or any number of different components, peripherals, and other devices, may be used with the computer 702.
A network 804 such as the Internet connects clients 802 to server computers 806. Network 804 may utilize ethernet, coaxial cable, wireless communications, radio frequency (RF), etc. to connect and provide the communication between clients 802 and servers 806. Further, in a cloud-based computing system, resources (e.g., storage, processors, applications, memory, infrastructure, etc.) in clients 802 and server computers 806 may be shared by clients 802, server computers 806, and users across one or more networks. Resources may be shared by multiple users and can be dynamically reallocated per demand. In this regard, cloud computing may be referred to as a model for enabling access to a shared pool of configurable computing resources.
Clients 802 may execute a client application or web browser and communicate with server computers 806 executing web servers 810. Such a web browser is typically a program such as MICROSOFT INTERNET EXPLORER/EDGE, MOZILLA FIREFOX, OPERA, APPLE SAFARI, GOOGLE CHROME, etc. Further, the software executing on clients 802 may be downloaded from server computer 806 to client computers 802 and installed as a plug-in or ACTIVEX control of a web browser. Accordingly, clients 802 may utilize ACTIVEX components/component object model (COM) or distributed COM (DCOM) components to provide a user interface on a display of client 802. The web server 810 is typically a program such as MICROSOFT'S INTERNET INFORMATION SERVER.
Web server 810 may host an Active Server Page (ASP) or Internet Server Application Programming Interface (ISAPI) application 812, which may be executing scripts. The scripts invoke objects that execute business logic (referred to as business objects). The business objects then manipulate data in database 816 through a database management system (DBMS) 814. Alternatively, database 816 may be part of, or connected directly to, client 802 instead of communicating/obtaining the information from database 816 across network 804. When a developer encapsulates the business functionality into objects, the system may be referred to as a component object model (COM) system. Accordingly, the scripts executing on web server 810 (and/or application 812) invoke COM objects that implement the business logic. Further, server 806 may utilize MICROSOFT'S TRANSACTION SERVER (MTS) to access required data stored in database 816 via an interface such as ADO (Active Data Objects), OLE DB (Object Linking and Embedding DataBase), or ODBC (Open DataBase Connectivity).
Generally, these components 800-816 all comprise logic and/or data that is embodied in/or retrievable from device, medium, signal, or carrier, e.g., a data storage device, a data communications device, a remote computer or device coupled to the computer via a network or via another data communications device, etc. Moreover, this logic and/or data, when read, executed, and/or interpreted, results in the steps necessary to implement and/or use the present invention being performed.
Although the terms “user computer”, “client computer”, and/or “server computer” are referred to herein, it is understood that such computers 802 and 806 may be interchangeable and may further include thin client devices with limited or full processing capabilities, portable devices such as cell phones, notebook computers, pocket computers, multi-touch devices, and/or any other devices with suitable processing, communication, and input/output capability.
Of course, those skilled in the art will recognize that any combination of the above components, or any number of different components, peripherals, and other devices, may be used with computers 802 and 806. Embodiments of the invention are implemented as a software/CAD application on a client 802 or server computer 806. Further, as described above, the client 802 or server computer 806 may comprise a thin client device or a portable device that has a multi-touch-based display.
This concludes the description of the preferred embodiment of the invention. The following describes some alternative embodiments for accomplishing the present invention. For example, any type of computer, such as a mainframe, minicomputer, or personal computer, or computer configuration, such as a timesharing mainframe, local area network, or standalone personal computer, could be used with the present invention.
The foregoing description of the preferred embodiment of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto.
This application claims the benefit under 35 U.S.C. Section 119(e) of the following co-pending and commonly-assigned U.S. provisional patent application(s), which is/are incorporated by reference herein: Provisional Application Ser. No. 63/188,218, filed on May 13, 2021, with inventor(s) Matthew Chan, Trevor Adams, Kourosh Dehghani, and Simon Ouellet, entitled “Application Onboarding Tutorial System,” attorneys' docket number 30566.0601USP1.
Number | Date | Country | |
---|---|---|---|
63188218 | May 2021 | US |