The present application finds particular application in healthcare and wellness systems, particularly involving assisting the elderly or infirm in configuring a remote health monitoring system. However, it will be appreciated that the described technique may also find application in other remote access systems, other system setup and/or system configuration scenarios, etc.
Complex networking devices that are to be installed at a consumer's home often require complicated configuration, which may differ between users, service providers, countries, etc. This in turn further exacerbates difficulties that may be experienced by users. Other problems arise when a user has little experience and/or aptitude for configuring a network, let alone setting network security parameters during configuration of the network. Moreover, users of advanced age often have other limitations that can hamper system installation, such as degraded eyesight and/or lack of experience with newer technologies. For example, it can be difficult for a user with poor eyesight or compromised cognitive abilities to correctly enter an encrypted security key with multiple alphanumeric characters, varied upper- and lower-case characters, etc. Often, repeated mistakes in security key entry can result in user frustration and disregarding of the protocol, which in turn leaves the network connection insecure and vulnerable. Additionally, usage of technical systems with remote controls, complex menu structures, and various applications like video-streaming, e-mail, questionnaires and graphs is challenging for users, especially elderly people. Alternatively, such a user may be forced to pay a premium for a professional to make a house call to install the system or occupy a service provider help line for an extended duration in an attempt to identify the problem, both of which add to overall system cost. The present application provides new and improved user identification and network configuration systems and methods, which overcome the above-referenced problems and others.
Traditional helplines permit a user to speak with to a customer service employee telephonically. However, it is often difficult for users to clearly describe the problem, and even more challenging for a helpline employee to explain a solution to a user. For instance, an elderly person with little technical experience may not be able to locate the power cable on a device when several cables extend from the device. Moreover, users often do not recall actions they have taken and/or settings they have changed to configure a device.
In accordance with one aspect, a system for providing verbal and graphical instruction from a remote healthcare monitoring service helpdesk, includes a home-end device (HED) with a VoIP component that provides a VoIP communication link with a centralized server, and a memory that stores screenshots historical information associated with user actions during installation or operation of the HED. The system further includes a GUI that presents graphical images to the user, and a speaker through which audio information is output to the user.
In accordance with another aspect, a method of troubleshooting installation and normal operation of a remote healthcare system includes storing screenshots that describe HED installation actions that a user has completed, optionally stripping privacy-sensitive information from the screenshot information and storing the screenshots at a server, and receiving a request for a user helpdesk session. The method further includes initiating the helpdesk session and providing a connection between the HED and the server, which enables bi-directional communication between the user and a helpdesk employee, and providing real-time video of a helpdesk employee to the HED for display to the user on the a GUI coupled to the HED. The method still further includes receiving, at the server, the stored screenshots for review by the helpdesk employee, and providing graphical instructions to the HED and displaying them on the GUI.
One advantage is that users are provided with both graphical and verbal instructions to reduce issue resolution time.
An additional advantage is the support of technical features to provide easy and direct access to the helpdesk service.
Another advantage resides in storing user actions in persistent memory to permit a helpdesk employee to review user actions for problem analysis.
Another advantage resides in providing automatic helpdesk session resumption after a system reboot.
Still further advantages of the subject innovation will be appreciated by those of ordinary skill in the art upon reading and understand the following detailed description.
The innovation may take form in various components and arrangements of components, and in various steps and arrangements of steps. The drawings are only for purposes of illustrating various aspects and are not to be construed as limiting the invention.
According to an example, the user 16 transmits a helpdesk support request from the HED to the server over the Internet connection. The helpdesk employee responds to the user's request via a VoIP connection that permits the user and the helpdesk employee to communicate as if speaking telephonically. That is, the user can hear the helpdesk employee through the speaker in the GUI, and can talk to the helpdesk employee using the microphone in the HED. Thus, VoIP audio can be transmitted bi-directionally between the parties. Additionally, the server can transmit photo and/or real-time video of the helpdesk employee to the HED for presentation on the GUI to the user, which provides a more robust interface for the user during the helpdesk session. The HED stores and transmits screenshots (e.g., a bitmap dump of a screen or a description of elements visible at the screen, similar to a vector image, etc.) associated with user actions to the server for viewing by the helpdesk employee. Additionally, user privacy-sensitive information (e.g., name, ID number(s), etc.) may be masked or removed from the pictures stored at the HED, stored at the server, or stored in both places, prior to being presented to the helpdesk. Moreover, screenshots associated with completed user actions can be stored at the server to ensure that privacy-sensitive information is not accessible to non-privileged persons.
For instance, the user can attempt to use the HED, and upon encountering a problem, the user initiates the helpdesk session. The helpdesk employee can receive historical information, such as a series of screenshots representing actions the user has already performed. For instance, if the user has plugged the HED into a power outlet and inserted an instructional DVD or the like, then actions performed in response to the instructional DVD can be recorded in persistent memory in the HED and an indication of such can be provided to the helpdesk employee at the inception of the helpdesk session. In this manner, the helpdesk employee can be apprised of the user's progress in order to better understand the issue or problem that prompted the user to initiate a helpdesk session.
To further this example, the helpdesk employee transmits graphical hints or instructions to the user via the server and HED, and the instructions are presented the user on the GUI. For instance, if the helpdesk employee recognizes that the user needs to reboot the HED (e.g., by disconnecting and reconnecting the power cable), the helpdesk employee can transmit an image of the power cable and its point of attachment to the HED. This graphical instruction can save substantial amounts of time that may otherwise be required to explain verbally, to a technologically unsavvy user, how to disconnect the power cable from the HED.
Additionally, the HED 12 transmits updated screenshots to the server 18 for the helpdesk employee 20 to review. Screenshot update information relates to actions that the user has performed recently, which may not have been included in the screen shot history provided to the helpdesk employee at the inception of the helpdesk session. In this manner, the helpdesk employee receives updates indicative of user actions taken, and is able to provide more refined instruction to resolve the user's issue. Alternatively, the screenshots are stored at the server side.
According to another feature, a microphone 14 is included in remote control 26, which allows the user to enter information to the HED for transmission to the server and eventually the helpdesk employee. For instance, the user can enter information using buttons on the remote control, which can be manipulated to select icons on the GUI, to enter digits and the like, etc. The remote can transmit information entered using the buttons over an IR channel between the remote and the HED. Additionally, the user can speak into the microphone with or without knowing that the microphone is present. For instance, the user may think he or she is talking to the GUI, but the microphone in the remote control picks up the sound of the user's voice, and such voice information is transmitted using Bluetooth, Zigbee, or the like, to the HED. In addition to the microphone, the remote control can include a button that, when depressed, triggers the HED to initiate a helpdesk session.
The HED 12 provides VoIP functionality to permit a voice connection with the service provider. The user speaks into the microphone 14 and the speaker is used as loudspeaker for the helpdesk employee's voice. The HED stores the history of screens shots passed through by the patient. These screen shots provided to the helpdesk employee at the moment a request for support is made. The HED can switch to helpdesk-mode upon initiation of a helpdesk session by the user. In this mode, any change to the screen (e.g., as the user navigates through one or more screens) is also sent to the helpdesk employee. The helpdesk mode and helpdesk session data is stored in resident memory in the HED, so that if the session is interrupted (e.g., due to power failure, user action etc.), the support session (with the same employee) can be continued when the HED reboots. A visual presentation (e.g., a photo or streaming video) of the helpdesk employee becomes visible on the GUI to make the support more personal. The helpdesk employee can send photos to the GUI screen to support his/her instructions with graphics. For example, when the user has to remove and reinsert the power cable, a photo of the power cable can be shown. Additionally, the server records all helpdesk calls for each patient, or user. Analysis of this information provides the service provider with a specific user profile for each patient. Based on this information, the service provider may decide to give the patient additional courses of special care, additional instruction courses, withdraw the system from the user's residence, adjust the user's care regimen, etc.
The system further includes a helpdesk button 56 that the user depresses to initiate a helpdesk session. Upon initiation of the session, the HED 12 goes into helpdesk mode and initiates a VoIP session with the server 18 using a VoIP component 46. The user can then communicate using the VoIP connection as though on the telephone with a helpdesk employee at the server 18 (e.g., a bi-directional audio link is thus provided). The server includes any and all hardware and/or software to maintain the VoIP connection, as well as to provide the user with an image or video of the helpdesk employee and/or graphical instructions to resolve the user's issue, as will be appreciated by those of skill. The HED additionally includes a processor 48 that executes instructions related to performing the various actions and/or protocols described herein, and a memory 50 that stores information related to one or more routines, protocols, etc., for providing a broadband connection with the server, for creating and maintaining the VoIP communication link, communicating wirelessly with the remote control 26, etc. Additionally, the memory includes a buffer 52 that stores screenshots related to user actions during system installation (or at other times during other actions). When the user initiates a helpdesk session, a screenshot history is transmitted to the server for review by a helpdesk employee to bring the helpdesk employee up to speed with regard to the issue or problem that prompted the user to initiate the helpdesk session. Additionally, the buffer stores updates to the screenshot history, which show actions taken by the user during the helpdesk session in response to instructions provided by the helpdesk employee. In this manner, the helpdesk employee can see what the user is seeing to better guide the user through the installation and/or operation process, while providing real-time verbal instruction over the VoIP connection. It will be appreciated that buffer 52 may be a ring buffer (e.g., a circular buffer) or other suitable buffer for performing the described actions, and stores a number of previously viewed screens, N, where N is an integer.
It will be appreciated that the memory 50 is a persistent memory that additionally stores the helpdesk session so that the system can resume the helpdesk session in the event that a system reboot becomes necessary to resolve the user's issue. Additionally or alternatively, the session information can be stored at the server, to be retrieved with a unique device recognition identification. In this manner, the user can be instructed to reboot the system at an appropriate time (e.g., by removing and reapplying power or the like), and upon reboot the user and helpdesk employee session is restored (e.g., with VoIP and visual communication) so that the user can receive further instruction, the helpdesk employee can verify issue resolution, etc. According to other embodiments, the server 18 records helpdesk issues for each user or patient, and the helpdesk issue history can be used to make healthcare service decisions for the patient. For instance, if the patient is so infirm or technologically unsavvy that he or she initiates a helpdesk session with high frequency relative to other users (e.g., more than a predetermined number of sessions within a predefined time period, etc.), then a determination may be made that the user is not benefiting from the remote healthcare system and appropriate action may be taken, such as providing in-person healthcare or the like. According to other examples, if a user initiates a helpdesk session repeatedly for the same or similar issues, a determination may be made to send the user pre-recorded instruction in response to initiation of a current helpdesk session based on a prediction that the current issue will be similar to the most common issue in the stored history. In this manner, helpdesk employee resources are conserved.
According to another example, a patient may be working with a remote healthcare service, viewing screens on the GUI 22 associated with the HED 12, when the patient experiences a problem. The patient then depresses the helpdesk button 56 on the remote 26, causing the HED to switch to helpdesk mode and establish a connection with an available helpdesk employee at the service provider. A photo of the helpdesk employee appears on the GUI, and the patient is able hear the helpdesk employee's voice through a speaker associated with the GUI. The speaker may be integral or external to the GUI, and/or may be integral or external to the HED. According to a related embodiment, real-time video of the helpdesk employee can be transmitted from the server 18 to the HED 12 for display to the patient via the GUI. The HED passes recent screen shots (e.g., passed through or viewed by the patient before running into problems) to the helpdesk employee. The helpdesk employee can ask the patient, via the VoIP connection, what the problem is, the patient can respond, and the microphone 14 picks up the patient's voice (e.g., without having to move the remote control to the patient's mouth). The helpdesk employee listens to the question of the patient and determines a solution as a function of the history of screen shots and system data provided to the server by the HED. The helpdesk employee then explains the solution to the patient and sends graphical instructions to the HED for display on the GUI. The patient attempts to execute the solution, and patient actions are monitored by the helpdesk employee because the HED sends all interaction to the helpdesk. When the problem is resolved, the helpdesk employee sends a command that instructs the HED to exit helpdesk mode, and the session is finished. During the helpdesk session, screenshot data describing actions executed by the patient is stored in persistent memory to facilitate rebooting the HED, if necessary to resolve the problem. In this manner, once the patient has executed the instructions provided by the helpdesk employee (e.g., verbally and/or graphically) the patient can reboot the HED to effect the changes, and then automatically be reconnected to the helpdesk employee, who then verifies that the solution resolved the patient's problem and ends the helpdesk session. According to other embodiments, the helpdesk takes over the HED and shows a usage scenario to the user, including a visual display of the virtual key pressed by the “helpdesk” to execute the scenario.
In addition to the VoIP connection, at 68, the server can provide a photo or real-time video of the helpdesk employee to the HED over an Internet connection or the like, for presentation to the user on a GUI, which personalizes the helpdesk session. The helpdesk employee additionally provides graphical instructions to the user via the Internet connection, at 70, and is able to explain the instructions verbally over the VoIP connection, if necessary. The HED forwards information, via the broadband connection, to the server for viewing by the helpdesk employee in the form of screenshots that the user has viewed or navigated through during operation, at 72. The HED can maintain a catalogue or history of screenshots visited by the user prior to calling the helpdesk to provide the helpdesk employee with information that facilitates discerning the user's problem, as well as screenshots visited during the helpdesk session so that the helpdesk employee can monitor the user's progress in resolving the problem that prompted the helpdesk session. At 74, a determination is made regarding whether the user's issue has been resolved.
If the issue is not resolved, then the method can revert to either 66, where the helpdesk employee receives further information from the user regarding the problem (e.g., verbal information over the VoIP connection and/or status and session information over the broadband connection), or to 68, where the helpdesk employee provides further information to the user to continue working to a solution to the user's issue. If the determination at 74 indicates that the user's issue has been resolved, the helpdesk employee can ask the user whether there are any other issues requiring attention, politely terminate the helpdesk session, or both. In this manner, a centralized helpdesk employee can send and receive both graphical and verbal information to and from a patient that is technologically unsavvy and might otherwise occupy an inordinate amount of helpdesk time over telephone or the like. In another embodiment, the user can initiate a helpdesk request by leaving a voice mail or text massage and transmitting the screenshots. The helpdesk employee can telephone, email, and/or send a send a series of instructional video screens to the user when a solution has been determined.
At 84, a server at the service provider receives a request for help from the user, such as may be transmitted by the user upon depression of a helpdesk button on the remote control or the like. Upon depression of the button, the remote control sends a wireless (e.g., Bluetooth, IR, Zigbee, RF, etc.) signal to the HED, which in turn sends a helpdesk session request to the server via an Internet/Ethernet connection to initiate the helpdesk session with VoIP, at 86. At 88, the server begins recording the helpdesk session to maintain a record thereof, including screenshot histories, graphical instructions, etc. At 90, the helpdesk employee and/or the server provide a photo and/or real-time video of the helpdesk employee to the user to personalize the helpdesk session. Additionally, the helpdesk employee provides graphical instruction and/or verbal instruction to the user to attempt to resolve the user's issue. At 92, the helpdesk employee receives the stored history of screenshots from the HED, and the helpdesk employee assesses the user's progress based thereon. At 94, the helpdesk session is stored in persistent memory in the HED to facilitate automatically resuming the helpdesk session if necessary. For instance, screenshots that the user completes or navigates through during the helpdesk session are stored in the HED and/or at the server. Storage of the screenshots may be separate from or part of the screenshot history that is maintained in the HED and/or the server.
At 96, a determination is made regarding whether the HED requires a reboot, such as by cessation of power to the HED. For example, at some point during the helpdesk session, it may become necessary to reboot the HED to effectuate changes implemented by the user during the helpdesk session. In such a case, the helpdesk employee instructs the user to turn the HED off and then back on, or to disconnect the power cable from the HED or the wall socket to remove power, and then to reconnect the power cable. Such instructions can be given to the user verbally over the VoIP connection and/or graphically, for instance as a screenshot that depicts the power cable, its location, its connection to the HED, etc., to permit the user to easily identify the power cable, unplug it, and plug it back in at a designated time. In this manner, the user interrupts power to the HED to cause a reboot. Thus, if the determination at 96 indicates that the HED should be rebooted, then at 98, the HED reboots upon restoration of power, discovers the stored helpdesk session at 94, and the helpdesk session is restored to a current state immediately prior to cessation of power. Storage of the helpdesk session information can occur at the HED, at the server, or both, and information stored at 94 is utilized at 98 to resume the helpdesk session, which then continues at 100.
If the determination at 96 indicates that no reboot is necessary, then at 100, the helpdesk session continues as normal. At 102, a determination is made regarding whether the user's issue has been resolved. If the issue has not been resolved, then the method reverts to 100, where the helpdesk session continues as normal. If the issue has been resolved, then at 104, the helpdesk session and the VoIP link between the server and the HED are ended. In this manner, a helpdesk session is initiated, maintained, and automatically resumed after an HED reboot, to permit a remote user and a centralized helpdesk employee to communicate both verbally (e.g., using the VoIP connection) and visually (e.g., using an Internet or Ethernet connection to provide screenshots, graphical instructions, etc.).
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB2008/050546 | 2/14/2008 | WO | 00 | 9/2/2009 |
Number | Date | Country | |
---|---|---|---|
60893743 | Mar 2007 | US |