The majority of toys and educational devices have static content, meaning that whatever content was loaded onto the device at manufacture time is the same content that will remain on the device for the lifetime of the device. Other toys and devices that allow their content to be upgraded typically require expansion packs, cables, or cartridges that must be physically attached to the device in order to transfer information.
The majority of toys and educational devices claiming to be “interactive” also provide a superficial level of interaction with their users, typically recycling the same content over and over again and requiring physical button presses to interact with the device.
The present invention is therefore directed to the problem of developing an interactive toy or learning device that can easily be updated while providing a sophisticated level of interaction.
The present invention solves these and other problems by providing a new way of on-the-fly content updating for toys and educational devices that can be pulled from a central web server. This allows parents to completely customize how the toy/educational device behaves depending on the age, needs and preferences of their child.
Moreover, the present invention proposes a combination of several ways on interacting with the device, including but not limited to: button presses, smart accessories, smart cards, speech command recognition, and device-to-device communication. Offering this combination of input methods serves to make the play experience between the child and the toy/educational device much more engaging.
According to one aspect of the present invention, an exemplary embodiment of an interactive entertainment apparatus includes an exterior shell and a non-transitory computer readable media that can be loaded into an end user's computer. The exterior shell has a humanoid or animal shape with one or more extremities. Any animal, toy or human shape may suffice. The shell houses an internal computer and one or more tactile control buttons. The internal computer includes a central processing unit, memory coupled to the central processing unit and a rechargeable battery to power the internal computer. The internal computer also includes a wireless connectivity adapter coupled to the central processing unit to provide wireless connectivity to other wireless devices when brought in a predetermined proximity of the shell. The internal computer also includes an RFID tag reader to read an RFID tag when brought in vicinity of the shell and a wireless network adapter. The internal computer includes an internal database to store information regarding multiple smart cards and smart accessories. The internal computer executes a predetermined application associated with an identified RFID tag to change a behavior of the shell upon detection and identification of a new RFID tag. The internal computer determines when a given RFID tag entered proximity of the shell and when the given RFID tag left proximity of the shell to determine how long the RFID tag remained in proximity of the shell. Each of the smart accessories has associated with it a unique smart accessory RFID tag. Each of the smart cards has associated with it a unique smart card RFID tag. The internal database stores smart card applications in association with the smart cards, one smart card application for each smart card. The internal database also stores smart accessory applications in association with the smart accessories, one smart accessory application for each smart accessory. Each smart accessory application controls a behavior of the shell in response to the shell being brought in proximity to an associated smart accessory. Each smart card application controls a behavior of the shell in response to the shell being brought in proximity to an associated smart card. The tactile control buttons are coupled to the internal computer, and can be activated by pressing. The user may select one or more applications to execute on the internal computer by pressing one of the tactile control buttons and cycling through the applications each time the tactile control buttons is pressed, and then holding the tactile control button for a predetermined time to select the desired applications. The non-transitory computer readable media has stored thereon an end user application, which when executing enables an end user computer to perform a synchronization process with the internal computer and to obtain configuration updates and new applications from a central web server. The internal computer communicates with an end user computer via the wireless connectivity adapter to obtain configuration updates and new applications during a synchronization process with the end user computer.
In the above exemplary embodiment, the internal computer may include an audio speaker to output audio signals from the central processing unit.
In the above exemplary embodiment, the internal computer may also include an audio microphone to pick up audio signals and provide these audio signals to the central processing unit.
In the above exemplary embodiment, the internal computer may also include speech recognition capability to respond to voice commands issued by a user. The internal computer executes a predetermined application based on a recognized voice command.
According to another aspect of the present invention, an exemplary embodiment of an updatable, interactive entertainment apparatus includes an exterior shell having a humanoid or animal shape. The shape includes one or more extremities. The shell has a data/power cord to couple to a portable computing device, such as a smart phone, smart device, portable computer, laptop computer or the like. The apparatus also includes a tactile control button to couple to the portable computing device via the data/power cord. The tactile control button is activated by pressing on the button. The user may select an application to execute on the portable computing device by pressing the tactile control button and cycling through several applications each time the tactile control button is pressed, and then holding the tactile control button for a predetermined time to select the desired application. The apparatus also includes a non-transitory computer readable media having stored thereon an application for execution on the portable computing device. The application enables the portable computing device to provide wireless connectivity to other wireless devices when brought in a predetermined proximity of the shell. The application also enables the smart phone to include a RFID tag reader to read an RFID tag when brought in vicinity of the shell. The application also enables the portable computing device to execute a predetermined application associated with an identified RFID tag to change a behavior of the shell upon detection and identification of a new RFID tag. The application also enables the portable computing device to determine when a given RFID tag entered proximity of the shell and when the given RFID tag left proximity of the shell to determine how long the RFID tag remained in proximity of the shell. The application also enables the portable computing device to determine how long a given RFID tag has remained in proximity of the shell for use in controlling the behavior of the shell. The application also enables the portable computing device to store an internal database of information regarding several smart cards and several smart accessories. Each smart accessory has associated with it a unique smart accessory RFID tag. Each smart card has associated with it a unique smart card RFID tag. The internal database stores smart card applications in association with smart cards, one smart card application for each smart card. The internal database stores smart accessory applications in association with smart accessories, one smart accessory application for each smart accessory. Each smart accessory application controls behavior of the shell in response to the shell being brought in proximity to an associated smart accessory. Each smart card application controls behavior of the shell in response to the shell being brought in proximity to an associated smart card. The application also enables an end user computer to perform a synchronization process with the portable computing device and to obtain configuration updates and new applications from a central web server. The application also enables the portable computing device to communicate with a central web server.
In the above exemplary embodiment, the application may also enable the portable computing device to recognize one or more voice commands issued by a user. The application enables the portable computing device to execute a predetermined application based on a recognized voice command to cause the shell to behave in a way responsive to the voice command.
According to yet another aspect of the present invention, an exemplary embodiment of a non-transitory computer readable media has stored thereon an application for execution on a portable computer to control an entertainment device. When executing the application causes the portable computer to provide wireless connectivity to other wireless devices when brought in a predetermined proximity of the entertainment device. The application also causes the portable computer to provide an RFID tag reader to read an RFID tag when brought in vicinity of the shell. The application also causes the portable computer to execute a predetermined application associated with an identified RFID tag to change a behavior of the shell upon detection and identification of a new RFID tag. The application also causes the portable computer to determine when a given RFID tag entered proximity of the shell and when the given RFID tag left proximity of the shell to determine how long the RFID tag remained in proximity of the shell. The application also enables the portable computer to determine how long a given RFID tag has remained in proximity of the shell for use in controlling behavior of the shell.
The application causes the portable computer to store an internal database of information regarding smart cards and smart accessories. Each smart accessory has associated with it a unique smart accessory RFID tag. Each smart card has associated with it a unique smart card RFID tag. The internal database stores smart card applications in association with smart cards, one smart card application for each smart card. The internal database stores smart accessory applications in association with smart accessories, one smart accessory application for each smart accessory. Each smart accessory application controls behavior of the shell in response to the shell being brought in proximity to an associated smart accessory. Each smart card application controls behavior of the shell in response to the shell being brought in proximity to an associated smart card.
In the above exemplary embodiment, the application may enable the portable computer to obtain configuration updates and new applications for the entertainment device from a central web server.
In the above exemplary embodiment, the application may enable the portable computer to communicate with a central web server to obtain configuration information, updates or new applications for the entertainment device.
According to another aspect of the present invention, an exemplary embodiment of a method for enabling a learning device or toy to interact with an end user includes: disposing an internal computer inside an exterior shell of the learning device or toy; providing wireless connectivity to other wireless devices when brought in a predetermined proximity of the learning device or toy; reading a radio frequency identification tag when brought in a vicinity of the learning device or toy; and executing a predetermined application associated with an identified radio frequency identification tag to change behavior of the learning device or toy upon detection and identification of a new radio frequency identification tag.
In the above exemplary embodiment, the method may include determining how long a radio frequency identification tag remained in proximity of the learning device or toy, and controlling behavior of the learning device or toy based on a length of time the given radio frequency identification tag remained in proximity of the learning device or toy.
In the above exemplary embodiment, the method may include storing inside the learning device or toy an internal database of information regarding smart cards, associating with each smart card a unique smart card radio frequency identification tag, storing in the internal database smart card applications in association with smart cards, one smart card application for each smart card, and controlling behavior of the learning device or toy with each smart card application when the learning device or toy is brought in proximity of an associated smart card.
In the above exemplary embodiment, the method may include storing inside the learning device or toy an internal database of information regarding smart accessories, associating with each smart accessory a unique smart accessory radio frequency identification tag, storing in the internal database smart accessory applications in association with smart accessories, one smart accessory application for each smart accessory, and controlling behavior of the learning device or toy with each smart accessory application when the learning device or toy is brought in proximity of an associated smart accessory.
In the above exemplary embodiment, the method may include providing tactile control buttons coupled to the internal computer, enabling a user to select applications to execute on the internal computer by pressing the tactile control buttons and cycling through the applications each time the tactile control button is pressed, and then holding the tactile control button for a predetermined time to select the desired application.
In the above exemplary embodiment, the method may include synchronizing the internal computer in the learning device or toy with an end user computer to obtain configuration updates and new applications from a central web server via the end user computer.
In the above exemplary embodiment, the method may include receiving audio signals and providing the received audio signals to the internal computer.
In the above exemplary embodiment, the method may include responding to one or more voice commands issued by a user by executing a predetermined application on the internal computer based on a recognized one of a plurality of voice commands.
Disclosed herein is an interactive electronic toy/learning device system capable of wireless updates, configuration through a website, environment interaction through smart accessories/cards, response based on speech recognition commands, and wireless device-to-device communication, charging and configuration.
The present invention includes an electronic device and associated system of information exchange for use in an educational or recreational toy. The electronic device (“the Device”) consists of a miniature custom computer 12 (“the internal computer”) (see
The Device is also capable of receiving wireless information updates (“updates” and “applications”) through a Bluetooth connection with the end user's computer (see
The end user's computer is able to automatically download device updates and configuration information from the central web server via a background software application running on the end user's computer. These updates and configuration information are then transferred to the Device during a synchronization event with the end user's computer (see
The present invention includes a second embodiment (the Device Type 2) which is capable of leveraging the end user's smartphone to partially replace the functionality performed by the internal computer in the Device (see
The purpose of the interactive toy or learning device system described below is to provide a lifelike toy or educational device to a child that offers a robust and interactive educational play experience. The Device will be able to play games, tell stories, and educate a child through auditory communication, sounds and lighted responses, such as LED responses. Depending on the age, ability, and preferences of the child, parents will be able to load different applications and content onto the Device that are appropriate for their child. For example, if a parent wishes to teach their child Spanish, the parent would be able to load a Spanish language application on the Device, or if the parent wanted the device to sing nursery rhymes, the parent could load the device with nursery rhymes, all downloaded from a central web server and transferred onto the Device. The applications and application logic that runs on the device may also be pulled from an external party's central web server. In the Device Type 2 embodiment, the application logic transferred onto the end user's smartphone or smart device could come from the Apple App Store (if using an Apple iOS device) or an Android market (if using an Android device).
The different updates and applications loaded onto the toy are able to interact with children through a number of different inputs. One way of interacting with the Device is via two “control buttons” placed inside the extremities of the Device (e.g., one button is disposed inside a hand, and one button is disposed inside a foot or another hand, see
As used herein, behavior can include outputting prerecorded voice messages, moving a limb or other body part, modifying the facial expression, and is only limited to the imagination of the creator. The behavior of the device comprises the set of interactions between the device and the end user. These interactions include the projection of audio from the device speaker (e.g., speech, sound effects and/or music), illumination of the LED lights from the device, and vibration (when using a smart device equipped with a vibration motor). For example, if a certain smart accessory is presented to the device (e.g., an Apple), the device may project an audio response of “Yummy”, play a sound effect of someone eating an apple, flash an LED light, and activate the vibration capability of the smartphone or handheld computer residing in the device (if applicable).
The Device is also able to accept and recognize speech commands from the end user, allowing the end user to change the Device's behavior when the end user issues certain “keyword” commands (see
Turning to
Inside the body 11 of the Device 10 is a miniature computer 12 that may contain the following components: (a) CPU; (b) memory; (c) rechargeable battery that is able to charge via wireless induction, as well as a direct electrical connectivity; (d) Bluetooth connectivity adapter; (e) RFID tag reader; (f) audio speaker; (g) audio microphone; (h) LED lights; (i) control button 1 input; (j) control button 2 input; (k) a port for recharging the internal battery; and (l) a WiFi Internet adapter. Wires 13, 14 connect the two inputs for the control buttons with the actual tactile control buttons 15, 16 residing in two of the device's extremities 18, 19. Control buttons 15, 16 are typically placed within different extremities of the shell 11.
Turning to
Device 10 interacts with a Bluetooth dongle 17 (which is not necessarily part of the Device) that plugs into the end user's computer 22 (see
The internal computer 12 runs an operating system, such as the open source Android mobile operating system. Additionally, internal computer 12 may utilize a speech recognition platform as the main operating software, such as the open source PocketSphinx speech recognition platform. A diagram outlining how each of these components within the Device may be connected can be seen in
The Device 10 may be designed to greet the end user and await a command from the end user when the Device 10 is first powered on via a button press to determine what application logic the end user wishes to run. For example, if the end user wishes to play a nursery rhyme application, the end user may press and hold one of the control buttons on the device to launch the application logic corresponding to the nursery rhyme.
When using the Device Type 2 embodiment, the application selection may be determined by the specific smartphone or smart device's operating system. For example, if using an Apple iOS device, the application logic may be launched by clicking on one of the App icons from the home screen of the device.
Turning to
Alternatively, if the end user wants to interact with the Device via a smart accessory, the Device may respond once that accessory is brought into proximity of its RFID reader.
Turning to
In step 43, the Device reads the RFID tag present in a smart accessory or smart card. Next, in step 44, the Device checks to see if the RFID tag exists in its internal database. If the RFID exists in the internal database of the Device, the process moves to step 45, and if not, the process moves to step 46.
When the Device 10 reads an RFID tag ID, if an entry in the internal database exists for that ID, the Device is able to resolve the ID to the accessory type 42 in which case in step 45 the Device reacts appropriately for the smart accessory 41 or smart card type 42, depending on the application or application update currently installed and running on the Device 10.
For RFID tag IDs that do not exist within the internal device database, in step 46 the Device sends a query to the end user's computer, which queries the central web server, which resolves the RFID tag ID to an accessory type, and claims the accessory type for the Device if not already owned.
This query may be accomplished during the next synchronization with the end user's Computer. During this synchronization session, the Device passes the unknown RFID tag ID to the end user's computer 22, which queries the central web server 21 to resolve the RFID tag ID to smart accessory/card type. If a smart accessory/card exists for the RFID tag ID in the central web server 21, the end user's computer 22 passes this information back to the Device 10, and the Device 10 updates its internal database. If the smart accessory/card is not currently claimed by another Device, the Device 10 that first queries the central web server 21 with the unclaimed RFID tag ID lays claim to that smart accessory/card.
The application logic of the Device can be updated via a synchronization operation with the end user's computer. Turning to
The central web server 21 stores applications, updates, configuration information, and statistics for each and every device, such as the Device 10. The central web server 21 sends/receives this information to/from an end user's computer 22 through an Internet connection 23. If the Device Type 2 has an on-board internet connection, the Device Type 2 will send/receive this information directly to/from the central web server 21 without requiring the end user's computer 22 as an intermediary (see
Turning to
Returning to
The Device 10 is capable of communicating back and forth with an end user's computer 22 through Bluetooth technology 24, and through this communication able to receive the updates and configuration information passed from the central web server 21 to the end user's computer 22. Through this Bluetooth communication 24, the Device 10 is also able to send statistics back to the end user's computer 22, which passes them back to the central web server 21.
When the Device 10 is brought within proximity of the Bluetooth dongle 17, the Device 10 and the end user's computer 22 are capable of establishing a Bluetooth connection 24. The applications/updates and configuration information chosen for the Device 10 via the online store can be then automatically downloaded by a background software application running on the end user's computer 22. These applications/updates and configuration information can then be transferred to the Device 10 over a Bluetooth connection 24 and installed on the Device 10.
Turning to
The end user's smart phone or smart device may include: (a) CPU; (b) memory; (c) a rechargeable battery; (d) a Bluetooth connectivity adapter; (f) an audio speaker; (g) an audio microphone; (h) a visual screen; (i) a data/power port; and (j) a WiFi or wireless data connection.
Shell 102 contains an internal pouch that's capable of containing the data/power cord and the end user's smartphone.
In one embodiment, the Device may be capable of running a number of Applications/Updates that provide different functionality. Using the online store outlined in
Turning to
The end user is able to connect to the online store 51 hosted by the central web server 21 to purchase and download updates for the Device 10. The end user is also able to configure the Device 10 from this online store 51. Updates and configuration information are automatically downloaded by the end user's computer 22 and pushed to the Device 10 via the background software application running on the end user's computer 22.
As evident in
In one embodiment, the system 10 may also contain a Bluetooth adapter dongle 17 as shown in
In one embodiment, the end user's computer 22 is also part of the system. The end user's computer 22 may communicate with the central web server 21 and/or the Device 10 during a synchronization process. The end user is also able to access the online store 51 (hosted on the central web server 21) through their internet connection 23 and a web browser (not shown).
A synchronization operation may also be initialized by the Device 10 when brought within the transmission range of the Bluetooth dongle 17, which is attached to the end user's computer 22 in one embodiment. When the synchronization initiates, the Device 10 may send application statistics over the Bluetooth connection 24 to the end user's computer 22, and a background service software application running on the end user's computer 22 is capable of uploading these statistics to the central web server database (not shown) available via server 21. The background service application running on the end user's computer 22 is also capable of downloading the desired applications/updates that were selected for download from the online store 51 residing on the central web server 21. After the background service on the end user's computer downloads the desired applications/updates/configuration information, the desired applications/updates/configuration information are able to be pushed over the wireless Bluetooth connection 24 onto the Device 10, as shown in
In one embodiment, the central web server 21 may have responsibilities that include: hosting the online store 51, transferring information back and forth from the end user's computer 22 or transferring information back and forth from the Device Type 2 as shown in
The online store 51 may be a website where the end user, or someone acting on the behalf of the end user, is able to choose applications/updates for their individual Device 10 and choose configuration options for their Device 10. End users may create an account to manage their device and log in to the online store 51 to begin choosing applications and configuration options for their Device 10. The user may then save their updates, which may be recorded in a database residing within the central web server 21.
The central web server is also responsible for handling the transfer of applications/updates and configuration information explained in previous sections and outlined in
The central web server 21 may also contain a database (not shown) with the exhaustive mapping between smart accessory/card type and the individual RFID tag contained within the smart accessory/card. Within this database, each individual smart accessory/card can be linked to an individual Device, thereby “claiming” the smart accessory/card for that particular Device 10. During a synchronization operation, these mappings between RFID tag ID and smart accessory/card type may be transferred onto the Device 10 for use by an application or update running on the Device 10.
In one embodiment, the educational and entertaining experience provided by the Device may be enhanced through its ability to interact with smart accessories and smart cards. Contained within the internal computer of the device may be an RFID reader chip capable of reading unique RFID tags within proximity of several inches.
Turning to
As part of the learning device system, a suite of smart accessories and smart cards (wherein each may contain a unique RFID tag) may be available for interaction with the device as shown in
Referring to
The application or application logic (app) that is running on the device governs the current behavior of the device at that time and how it interacts with smart accessories and smart cards. For example, in a game that requires the end user to ‘feed’ the device a ‘juice bottle’ smart accessory, the application may keep track of the number of times that the end user presents this accessory to the device, the time interval between accessory presentations, and the duration of each presentation to the device. In the previous example, the device may issue different responses if the ‘juice bottle’ accessory is given too frequently (e.g. “you're feeding me too much, I'm not thirsty”), not frequently enough (e.g. “I'm thirsty, can I have some juice?”), or not a long enough duration each time (e.g. “You pulled the juice bottle away from me too quickly”).
The Device includes the capability to detect for how long a smart accessory/card has been in range. For example, the RFID reader passes along real-time information about when a tag enters the range of the RFID reader (i.e., the read proximity) and leaves read proximity, allowing the Device to determine the length of time that the RFID tag in question remained within proximity of the Device. This enables more robust interactivity with the learning device or toy.
Smart accessories 31 may consist of an exterior “shell” that resembles a physical object (e.g., Baseball glove, Skateboard, etc.). The “shell” of the object may either be plush fabric, plastic, or wood. Contained within the shell of the object may be a miniature RFID tag capable of being read by the RFID reader inside the device. Depending on the appearance of the smart accessory, its effect on the logic of the device may be different which is achieved by the current application or application update currently installed and running on the Device. For example, a “Santa Claus” hat smart accessory may be programmed to run application logic that sings Christmas carols to the end user.
Referring to
Turning to
Each smart card 32 contains a unique RFID tag inside that is able to be read by the RFID reader contained within the device. Since the RFID tag in this smart card 32 is different than the RFID tag in the smart accessory 31 pictured above, the Device will act differently when it recognizes this smart card.
In one embodiment, the Device maintains an internal database that keeps track of the resolution between RFID tag IDs and smart accessory/card types. For example, a smart accessory that resembles a baseball glove might contain an RFID Tag with ID of “123ABC”. The Device's internal database may be capable of tracking the association between RFID Tag “123ABC” and smart accessory type “baseball glove”. For RFID tag IDs that do not currently reside in the internal device database, the Device may be capable of issuing a query to the central web server to resolve this RFID tag ID to smart accessory/card type mapping. During the next synchronization, the Device may pass the unknown RFID tag IDs to the end user's computer, which queries the central web server to see if a mapping exists between the unknown RFID Tag ID and the smart accessory/card type (the central web server maintains the exhaustive list of these mappings). If a mapping exists on the central web server, the end user's computer may pass this information back to the Device, which updates its internal database with the new RFID tag ID to smart accessory/card type.
If the smart accessory is not currently claimed by an existing Device, the first Device to issue a query to the central web server for an unclaimed RFID tag ID may lay claim to that particular RFID tag ID (and associated smart accessory/card). Smart accessory claims may be used by some device applications to ensure that only one device is capable of using a smart accessory/card simultaneously.
Turning to
The end user will be prompted by the Device when it is listening for speech commands. Depending on the speech command issued by the end user, the Device may behave differently or give a different audio reply to the device user.
In step 61, the Device 10 indicates to the end user that it's listening for speech commands. This indication may be in the form of a tone or voice message. In step 62, the end user issues a speech command to the Device 10. In step 63, the Device resolves which voice command (A or B) was issued. While only two are shown, many more are possible. If command A is issued, in step 64 the Device reacts appropriately for Command A, depending on the application or application update running on the Device 10. If Command B is resolved, the Device 10 reacts appropriately for Command B, depending on the application or application update running on the Device 10.
Turning to
When a specific button combination is pressed on each device, Device A 71 and Device B 72 establish a connection and pass information back and forth. In method 70, the process begins with step 73 in which a specific button combination on both devices 71, 72 is pressed.
In step 74, a search for in-range like-devices over a Bluetooth connection is initiated. In step 75, Device A 71 finds Device B 72 over a Bluetooth connection. In step 76, Device A 71 and Device B 72 exchange information over a Bluetooth connection.
The present invention also includes a non-transitory computer readable media having stored thereon an end user application, which when executing enables an end user computer to perform a synchronization process with the internal computer and to obtain configuration updates and new applications from a central web server. This application enables the end user computer to perform all of the functions described above. This non-transitory computer readable media may include a DVD or compact disk that can be loaded into a traditional computer. Also, the computer readable media may include a file that can be downloaded from the internet or other network.
Additionally, for the Device Type 2, a computer program or application may be downloaded to the portable computer or smart phone, which then enables the smart phone to act as the Device, thereby enabling the toy to leverage the power and capability of one's smart phone or portable computer.
This application claims priority to U.S. Provisional Patent Application No. 61/531,673 filed Sep. 7, 2011 by the same inventors and bearing the title “Interactive Electronic Toy/Learning Device System Capable of Wireless Updates, Configuration through a Website, Environment Interaction through Smart Accessories/Cards, Speech Recognition, and Wireless Device-To-Device Communication.” U.S. Provisional Patent Application No. 61/531,673 is hereby incorporated by reference as if repeated herein in its entirety, including the drawings.
Number | Date | Country | |
---|---|---|---|
61531673 | Sep 2011 | US |