Patent Application
20230410191
The present disclosure relates to computing technology, in particular user interfaces that facilitate improved interactions with electronic financial systems.
Online financial systems are prevalent. But traditional user interfaces for interacting with online financial systems can be lacking and have not changed dramatically since their introduction. As most interactions with financial systems are performed electronically, new methods of interaction are needed that enable users to leverage new financial services features.
In an example, a method includes displaying a user interface having avatar user interface objects at different locations within the user interface. Each avatar user interface object represents one of a financial services available within a financial system. The method further includes, while displaying the user interface, detecting a selection of an avatar user interface object of the avatar user interface objects. The method further includes, in response to the detection, displaying, within the user interface, an area representing an autonomous agent that is configured to enable interactions with the one of the financial services. The method further includes generating, via the autonomous agent, text corresponding to the financial service associated with the selected avatar user interface object. The method further includes presenting the text in the area as appearing from the autonomous agent. The method further includes receiving, via the user interface, a response corresponding to selection of one of the financial services. The method further includes causing, based on receiving the response, a server to perform a transaction within the selected financial service. The method further includes presenting, in the area, results of the transaction.
In another example, causing the server to perform the response further includes providing the response to a classification model, and determining, via the classification model, the transaction.
In another example, the method further includes outputting, with the text and in the area, an additional user interface objects. Each of the additional user interface objects relating the selected one of the financial services. The method further includes receiving, via the user interface, a selection of one of the additional user interface objects. The method further includes causing, based on the selection, a server to perform an additional transaction within the selected financial service. The method further includes presenting, on the user interface, results of the additional transaction.
In an example, the method includes displaying, on the user interface, additional user interface objects, each object associated with an additional user interface. Each of the additional user interfaces enables a user device to access data and transact with one or more of the financial services. The method further includes while displaying the user interface, detecting a selection of an additional user interface object by the user device. The method further includes, in response to receiving the selection, displaying the additional user interface that corresponds to the selected object.
In another example, the additional user interfaces include one or more of a first additional user interface having a first window depicting the financial services and a second window depicting transactions corresponding to at least one of the financial services; and a second additional user interface having a avatar user interface objects at different locations within the second additional user interface. Each avatar user interface object represents one of the financial services.
In another example, the method includes displaying the user interface in a display of a virtual reality headset. The response is received from a microphone associated with the virtual reality headset.
In another example, the user interface is displayed in a virtual reality headset. The response is obtained from a virtual reality device.
While the above examples are discussed as computer-implemented methods, it will be appreciated that the above functionality can be implemented in a system such as a computer system and/or as computer-executable instructions stored on a non-transitory computer-readable medium.
Embodiments of the present invention relate to improved user interfaces for interactions with electronic financial systems. For instance, certain embodiments involve gamified user interfaces, autonomous agent-based interfaces, or virtual reality-based user interfaces. These interfaces provide for flexibility and customization in the methods in which computing devices enable interaction with electronic financial systems.
In a simplified example introduced for discussion purposes, a user computing device connects to a financial services server. The financial services server can be part of a network of servers that collectively provide financial services such as online banking, insurance, home financing, auto financing, and so forth. The financial services server authenticates the user device using one or more techniques such as a login and password, two-factor authentication, and/or biometric authentication. After successful authentication, the user computing device presents, in the web browser or via a virtual reality device, an improved autonomous agent (“chatbot”) for the execution of financial functions. The user selects a financial service via the autonomous agent, which assists the user with completing a financial transaction. Continuing the example, the user may continue to interact with the autonomous agent, which can assist with transactions, opening new accounts, questions about existing accounts, and so forth.
The user interfaces disclosed herein can facilitate the representation of financial functions. Examples of user interfaces include traditional user interfaces, for example, with lists of accounts and transactions; gamified user interfaces in which different functions or services are represented as avatars or icons; user interfaces that allow drag-and-drop functionality; agent based interfaces in which a user may select financial services and/or transact with the financial services by way of messaging in English or another language with an autonomous (e.g., computer-generated) agent or a remotely located agent; virtual reality-based user interfaces in which a user navigates financial services and transactions from within one or more virtual rooms; or any combination thereof.
Additionally, disclosed techniques allow a user to adjust their preferences with respect to user interfaces one or more times during a financial services session. For instance, a user may start an online session with a more traditional user interface and then decide that they wish to ask specific questions and switch to an interactive session with an autonomous agent. Similarly, the user may switch back to the traditional interface, or to another interface such as a gamified interface, and so on. Accordingly, technical advantages of the disclosed solutions include the ability to dynamically update not only the content of the user interface on a computing device but also the style and format of the user interface, based on interactions received from a user computing device.
Turning now to the Figures,
As can be seen in browser 130, computing device 110 is displaying an autonomous-agent based interface in which messages and user interface objects generated by an autonomous agent can be presented and in which a user may respond. Examples of functionality that is possible with an autonomous agent includes answering user questions about existing or new accounts, opening new accounts, and learning about new services. A dialogue may be user-initiated, e.g., by the selection of a chat button. In other cases, a dialogue may be initiated by the financial system, for instance if computing device 110 detects that a user is having trouble navigating a website.
Developing textual or object-based responses and understanding natural language inputs provided by a user can involve machine learning and/or classification models. For instance, computing device 110 obtains text entered by the user interacting with browser 130 (or via a VR interface of some kind). Computing device 110 sends the text to financial server 160, where the text is processed to understand whether the user is making a request, asking a question, or desires some other action. In some cases, financial server 160 operates a machine-learning model or classification model that is trained with previous interactions with that user or other users, and the model determines the user's intent. In response, financial server 160 provides the result via network 150 to computing device 110. The conversation between user and autonomous agent can continue.
In turn, computing device 110 connects via network 150 to financial server 160 to obtain financial records from records 165 or initiate electronic financial transactions. Records 165 can include financial statements, records, transactions, and/or other financial information. Computing device 110 and financial server 160 include one or more processors, memories, storage devices, and/or network connections. An example of computing device 110 includes computer system 1400 depicted in
Non-limiting examples of user interfaces include classic financial service interfaces such as those with side-by-side service and transaction views, gamified user interfaces, and autonomous-agent based user interfaces. In some examples, these user interfaces are used to access financial services via financial server 160 by using browser 130 on display 120. Traditional interactive methods such as a mouse, keyboard, voice-based systems, and other similar techniques can be used.
The user interfaces described herein can be accessed and interacted via one or more VR devices. Examples of VR devices include VR headsets, handsets, joysticks, gloves having electronic sensors therein, and so forth. For instance, a user wearing one or more VR devices can navigate a user interface, check transactions in a bank account, open a new account, explore new products, and so forth. Examples of suitable VR devices include the VR headset as depicted with respect to
In some cases, when a user first accesses a financial system via computing device 110, the user is presented with user interface 200. In some cases, one or more authentication devices can be used such as biometric devices (e.g., fingerprint scanners), two-factor authentication devices, and so forth. For example, during the login process but before accessing any financial information, computing device 110 can require additional authentication. In other cases, one or more accessibility functions are provided to access computing device 110, such as external accessibility devices, screen readers, text-to-speech systems, and so forth.
In some examples, a user may enter the financial system as a guest by selecting guest login object 202. This enables the user to try out the financial system. In this case, artificially-created data is presented such as artificial transactions. No actual transactions take place in this example. In other examples, a user may not yet either have a login to the financial system (for instance if they have a banking account but have not yet created a login), or may not have an account at all and may need to open an account. The account creation object 203 is available for such a case.
Navigation objects 205 serve as indicators that the user may navigate the interface using their keyboard (specifically with the up, down, left, and right buttons). In some cases, a user may click on navigation objects 205 to navigate the interface. Chat window 206 is available for interactions with either a human or autonomous agent. For instance, if a user has a problem logging in, they can send a message in chat window 206. In other cases, a new user may have questions about products and services.
Background 210 is depicted behind sign in prompt 201, a guest login object 202, and account creation object 203. Background 210 can be a shaded, generic, or anonymized view of the other user interfaces described herein. Interactions between the user and the objects in background 210 are not possible. Rather, background 210 is there as a preview of the types of user interfaces available after login. In this manner, background 210 serves as a store front of available user interfaces. Upon successful login, the user may be presented with another user interface. Examples include, but are not limited to, e.g.,
In some respects, user interface 300 can be considered a more classic or traditional view in an online financial or banking system. For instance, the three panes from left to right, specifically options pane 301, transactions pane 302, and details pane 304 show information in a more traditional format. By contrast, some of the alternative user interfaces depicted herein allow for presentation of similar material, specifically accounts, transactions, services, and so forth, differently. Moreover, as explained further herein, a user may switch between different user interfaces as they wish. For instance, one user may prefer a first view and another user a second view. Or in some cases, certain information may be more easily accessed in with a certain user interface in some contexts. In yet other cases, virtual reality or other interactive techniques may be used.
In an example, an autonomous agent determines a message to provide to the user that includes information regarding a financial service. The system outputs the message in agent area 610. The message can be displayed in text form, in button form, or in another form. As depicted, agent area 610 includes objects such as “Recent Transactions” and “Bill Pay.”
In response the user may select one of the objects and results of the transaction in agent area 610 or user area 612.
For instance, as depicted, user interface 900 includes financial services stations 901, 902, 903, 904, 905, and 906, each having a virtual desk or table. Optionally, the avatars can be visualized as sitting or standing at the tables. Optionally, the avatars can be visualized as sitting or standing at the tables.
Each of stations 901-906 can correspond to a financial service product or function and can have an associated avatar representing a virtual financial services person who can help and/or avatars of customers who are waiting for assistance. User interface 900 can be viewed as a type of dashboard that depicts available services. Different services or vendors, representing loans, insurance, and so forth are represented by virtual vendors.
When a user wishes to transact with at a specific station, they can click an area around the vendor to virtually approach the avatar. When viewed with a VR device, the user may navigate this interface by moving and/or turning. In turn the sensors of the VR device recognize the users movements and adjust user interface 900 accordingly.
Other user interface elements are not shown but are possible. For instance, one or more highlighted (shiny, moving, etc.) interface objects can be depicted. These objects can represent offers such as a deal on an auto loan rate, or an offer on a savings account. In other cases, one or more virtual catalog objects can be depicted in a virtual newsstand. These catalog objects can be interacted with and open into another window, whereby the user may view the contents of the catalog. In yet other embodiments, the user may switch to an autonomous agent view.
Queue 907 is a virtual queue in which a number of people, represented by avatars, are depicted as waiting for their turn. In some cases, the avatars can be animated, for instance, interacting with each other or speaking with each other. In some cases, the interactions can relate to experiences with the products and services represented by stations 901-906.
Navigation objects 912 serve as indicators that the user may navigate using their keyboard (specifically with the up, down, left, and right buttons). Chat window 913 is available for interactions with either a human or autonomous agent. If financial documents are to be reviewed and signed, then user interface 900 can cause a window that is overlayed on the user interface or a pop-up window to be depicted that enables viewing of documents in Portable Document Format (PDF) or other format. Electronic signatures can be obtained via user interface 900.
If a station 901-906 is selected for further information, then one or more menus can appear. For instance, details 911 show balances associated with the product associated with station 904. One such example is depicted with respect to
The recommended products in area 1120 can be adjusted based on the user's personal data and/or financial information. For instance, a screen might ask “have checking but would you like insurance also?”
For example, virtual reality headset devices allow users to experience more complex and realistic environments by displaying two or three-dimensional content, or simulated three-dimensional content that relates to financial services, including videos, animations, and so forth. VR device 1200 is also capable of displaying three-dimensional movies, video games, scenes, or simulations that allow users to interact with the virtual reality environment.
As mentioned, the VR device 1200 provides a virtual reality environment to a user. For instance, the VR device 1200 displays a movie, panoramic scene, photographs or images, content browser (e.g., a photo or media content album), and/or a two or three-dimensional environment to the user via the display screen. In at least some instances, the VR device 1200 allows the user to interact with the virtual reality environment by way of one or more input devices. For example, the user can change the view within the environment or move within the environment by moving his or her head or physically moving from one location to another (i.e., changing the position of the user's head laterally or vertically). This movement can cause the VR device 1200 to change the view within the interface. Similarly, when a user moves backward, forward, or sideways, VR device 1200 is adjusted to show the user having moved to a different location within the virtual room.
The VR device 1200 also includes a support element 1204 to hold the VR device 1200 in place as the user views the virtual reality environment provided by way of the display screen. Specifically, the support element 1204 can hold the VR device 1200 in place so that the perspective of displayed content provided to the user is consistent. In one example, the support element 1204 is a flexible strap. Alternatively, the support element 1204 can be an adjustable support element 1204 that allows the user to adjust the fit of the VR device 1200 for comfort and stability.
It should be appreciated that while method 1300 is set forth below as including various operations, other sequences of operations may also be performed. For example, the steps outlined below may be performed in a different order. Moreover, the individual steps illustrated by method 1300 may include multiple sub-operations that may be performed in various sequences as appropriate to the individual operation. Furthermore, additional operations may be added or removed depending on the particular applications. One of the ordinary skill in the art would recognize many variations, modifications, and alternatives.
At block 1302, method 1300 involves displaying a user interface having avatar user interface objects at different locations within the user interface. Each avatar user interface object represents a financial service available within a financial system. In an example, computing device 110 displays, via display 120, browser 130 having an avatar user interface. Examples of avatar-based user interfaces include
At block 1304, method 1300 involves, while displaying the user interface, detecting a selection of an avatar user interface object of the avatar user interface objects. Examples of avatar user interface objects include 901-905. Continuing the example, the user selects an avatar user interface object (e.g. financial services station 903), which represents a car loan.
At block 1306, method 1300 involves, in response to the detection, displaying, within the user interface, an area representing an autonomous agent that is configured to enable interactions with to interact with the one of the financial services. In response to the selection of financial services station 903 (an avatar user interface object), computing device 110 displays user interface 600 of
At block 1308, method 1300 involves generating, via the autonomous agent, text corresponding to the financial service associated with the selected avatar user interface object. Continuing the example, computing device 110 displays information about the car loan in are 1110 and area 1130.
At block 1310, method 1300 involves presenting the text in the area as appearing from the autonomous agent. Continuing the example, computing device 110 displays text in the agent area 610. In some cases, computing device 110 can output additional user interface objects that represent one or more financial services.
At block 1312, method 1300 involves receiving, via the user interface, a response corresponding to selection of one of the financial services. Continuing the example, computing device 110 receives a selection in user area 612.
At block 1314, method 1300 involves causing, based on receiving the response, a server to perform a transaction within the selected financial service. Causing the server to perform the transaction can in some cases involve providing the response to a classification model, and determining the transaction from the classification model.
At block 1316, method 1300 involves presenting, in the area, results of the transaction. In some cases, the user interface can further refresh, causing an interface such as interface 800 to be displayed, which shows the results of the transaction “Please pay $1,000.”
Continuing the example, in some cases, the user may switch interfaces between different styles. For example, computing device 110 can display additional user interface objects that are each associated with an additional user interface. The additional user interfaces enables a user device to access data and transact with one or more of the financial services. In response to receiving a selection of an object, computing device 110 displays the additional user interface that corresponds to the selected object.
The computer system 1400 includes at least a processor 1402, a memory 1404, a storage device 1406, input/output peripherals (I/O) 1408, communication peripherals 1410, and an interface bus 1412. The interface bus 1412 is configured to communicate, transmit, and transfer data, controls, and commands among the various components of the computer system 1400. The memory 1404 and the storage device 1406 include non-transitory computer-readable storage media, such as RAM, ROM, electrically erasable programmable read-only memory (EEPROM), hard drives, CD-ROMs, optical storage devices, magnetic storage devices, electronic non-volatile computer storage, for example Flash® memory, and other tangible storage media. Any of such computer readable storage media can be configured to store instructions or program codes embodying aspects of the disclosure. The memory 1404 and the storage device 1406 also include computer readable signal media. A computer readable signal medium includes a propagated data signal with computer readable program code embodied therein. Such a propagated signal takes any of a variety of forms including, but not limited to, electromagnetic, optical, or any combination thereof. A computer readable signal medium includes any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use in connection with the computer system 1400.
Further, the memory 1404 includes an operating system, programs, and applications. The processor 1402 is configured to execute the stored instructions and includes, for example, a logical processing unit, a microprocessor, a digital signal processor, and other processors. The memory 1404 and/or the processor 1402 can be virtualized and can be hosted within another computer system of, for example, a cloud network or a data center. The I/O peripherals 1408 include user interfaces, such as a keyboard, screen (e.g., a touch screen), microphone, speaker, other input/output devices, and computing components, such as graphical processing units, serial ports, parallel ports, universal serial buses, and other input/output peripherals. The I/O peripherals 1408 are connected to the processor 1402 through any of the ports coupled to the interface bus 1412. The communication peripherals 1410 are configured to facilitate communication between the computer system 1400 and other computing devices over a communications network and include, for example, a network interface controller, modem, wireless and wired interface cards, antenna, and other communication peripherals.
In the following, further examples are described to facilitate the understanding of the invention.
In an example, a method includes displaying an initial user interface including a user interface objects. Each object is associated with a respective main user interface. Each of the main user interfaces enables a user to access data and transact with one or more financial services available within a financial system. The main user interfaces include a first main user interface having a first window depicting the financial services and a second window depicting transactions corresponding to at least one of the financial services. The main user interfaces include a second main user interface having a avatar user interface objects at different locations within the second main user interface. Each avatar user interface object represents one of the financial services. The main user interfaces include a third user main interface having the first window depicting one of the financial services and a third window depicting interactions with an autonomous agent. The autonomous agent is configured to enable the user to interact with the one of the financial services. The method further includes, while displaying the initial user interface, detecting a selection of an object by the user. The method further includes, in response to receiving the selection, performing operations. The operations include displaying the main user interface that corresponds to the selected object. The operations further include receiving, via the main user interface, a request to transact with one of the financial services. The operations further include presenting, on the main user interface, results of a transaction associated with the financial service.
In an embodiment, the main user interface includes the user interface objects. The method further includes while displaying the main user interface, detecting an additional selection of an additional object by the user. The additional object is different from the object. The method further includes, in response to receiving the additional object, displaying an additional main user interface that corresponds to the additional object.
In an embodiment, displaying the initial user interface includes presenting the initial user interface in a virtual reality device, displaying the main user interface includes presenting the main user interface in the virtual reality device, and receiving the selection of the object includes receiving a selection via the virtual reality device.
In an embodiment, the main user interface is the second main user interface and the avatar user interface objects represent banking functions within a bank the different locations represent different locations within the bank.
In an embodiment, the main user interface is the third main user interface. The method further includes determining a first message including information regarding the selected one of the financial services. The method further includes outputting, in a first area of the main user interface, the first message and a additional user interface objects, each of the additional user interface objects relating the selected one of the financial services. The method further includes receiving, via the main user interface, a selection of one of the additional user interface objects. The method further includes presenting, on the main user interface, results of an additional transaction associated with the selected one of the financial services.
In an embodiment, receiving the selection of the object includes receiving a selection via a keyboard or a mouse.
In an embodiment, the initial user interface and the main user interface are displayed in a web browser.
In an example, a method involves displaying, in a first area of an interface displayed on a virtual reality device, interface objects at different locations within the first area. Each interface object represents one of a set financial services available within a financial system. The method further involves displaying a second area on the interface and on the virtual reality device. The method further involves, while displaying the interface, detecting, from the virtual reality device, a selection followed by a movement of an interface object of the interface objects. The method further involves moving, on the interface displayed on the virtual reality device, the interface object according to the movement. The method further involves detecting, via the virtual reality device, a placement of the interface object in the second area. The method further involves, in response to detecting the placement: initiating an application for the financial service corresponding to the interface object; and displaying, in the second area on the virtual reality device, a result of the application.
In another example, the method involves, in response to detecting the placement, displaying an additional user interface object on the virtual reality device.
In another example, the selection includes a pinch gesture and the placement includes a relaxing of the pinch gesture.
In another example, the selection includes a first tap at a first location and the placement includes a second tap at a second location.
In another example, the moving includes a drag gesture of a finger.
In another example, initiating the application includes transmitting, to a financial server device, information associated with a user associated with the virtual reality device, and the method further involves obtaining the result. The result is determined by the financial server device based on the information.
In another example, the method involves displaying, in the interface, interface objects, each object associated with a respective main interface. Each of the main interfaces enables a user to access data and transact with one or more of the financial services. The main interfaces include a first main interface having a first window depicting the financial services and a second window depicting transactions corresponding to at least one of the financial services. The main interfaces further include a second main interface having an avatar interface objects at different locations within the second main interface. Each avatar interface object represents one of the financial services. The method further involves, while displaying the interface on the virtual reality device, detecting a selection of an interface object from the virtual reality device. The method further involves, in response to receiving the selection, updating the interface with the main interface that corresponds to the selected object.
While the above examples are discussed as computer-implemented methods, it will be appreciated that the above functionality can be implemented in a system such as a computer system and/or as computer-executable instructions stored on a non-transitory computer-readable medium.
Although the subject matter has been described in language specific to structural features or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims. And, although the subject matter has been described with reference to financial account systems and financial account data, various aspects disclosed herein can be applicable to other types of account systems and other types of data.
