Patent Application
20120225604
A portion of the disclosure of this patent document contains material which is subject to copyright or mask work protection. The copyright or mask work owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright or mask work rights whatsoever.
The toy industry loses a huge amount of profit and customers to game consoles whose users are becoming younger every year, as they switch from normal toys to these interesting and entertaining electronic game devices. The interactivity of game consoles and the fact that a user can control them are the main reasons for their popularity. It seems interactivity is the key for successful marketing and product placement. When electronic toys first appeared on the market, they were equipped with buttons and some blinky lamps or LEDs, as well as some funny sound effects. Prospective buyers could buy and test these toys in a shop before buying them. The toy industry realized that users became bored with toys after a while and required ones with new effects. This changed when game consoles were introduced, they created virtual worlds where players could express their fantasies and control game situations in so many different ways that the fun and entertainment factor increased way above that of conventional toys. As this multibillion market grew, the toy industry had to find ways to bring its products up to date in a way that matched and even exceeded game consoles. This invention will empower this process in an affordable way because toys are much cheaper to produce than game consoles and come in much greater quantities for lower profit. This invention also takes care of the economic aspect by using existing components with the well-known bill of material (BOM) and total cost of ownership (TCO).
A broadcast station can mix signal sequences into a running program, which causes reactions in toys or game devices on the receiver's side by invoking functions in toys or games (
A. Game consoles show interactive scenarios on TV or computer screens (PC games). A user has devices or means to manipulate the action for getting points or entering the next possible level. Such control devices (game pads) can have buttons and joysticks, accelerometers, or light sources that can be tracked from the game consoles' equipment. Platforms on the ground (digital weight scales and balance boards) give the user hands-free action as well as camera-monitored input devices that track the movements of users and players' bodies and limbs.
B. The toy market possesses toys, LCD, and board games with integrated electronics means for interactive feedback. Buttons or touch sensors check if a user is activating them to start some pre-programmed functions. Mechatronics is also available to move a toy's parts, heads, limbs, wheels, or whatever. Cars or other vehicles can be controlled remotely via radio frequency devices. All the described technologies can use the Internet for downloading and upgrading functions or playing online games in real time. This invention produces new ways for real-time interaction with broadcasted media content of any kind.
The microcontrollers that the toy industry uses often contain the means to produce sound, voice in- or output. This invention will show that it is possible to use such controllers additionally as input devices for gestures and/or signal sequences coming over a media at the same time with no large efforts in bill of material or controller performance.
A gesture recognition circuit replaces the need to use buttons, joysticks, or game pads. 3D gestures can be enabled by using several sensors, from capacitive (alternating e-fields) over light or sound (ultrasonic) or radar. The distance of a user's hand or finger from an electrode can be measured and transferred into signals for the microcontroller to analyze and react to. The controller starts functions related to the XYZ position of a user's finger or a pattern that the user is creating while playing with the toy/game. Functions can be started to move electromechanical components such as motors, servos, magnets, or other objects. So, it seems that the toy reacts to the users' input gestures. The XYZ coordinates or recognized gesture patterns can also be transferred into a network as control commands for online games or as reaction signs for broadcasting contents which a player watches while playing with the toy/game.
Signal sequences from the broadcast media (TV, radio, Internet, or others) can be received from the toy, and the controller inside starts related functions or activities as a kind of feedback. The user has now the order to react, either by giving gestures or gesture patterns or through voice commands or other comments into the toy. Means and sensors in the toy can receive these signals and return them into the network or invoke functions in the toy/game. The application part of the invention will demonstrate several examples.
A program or program sequence in the toy/game's microcontroller has the means to receive gestures or other signals from the user (player). These input signals can be converted into function codes or output signals. The function codes can call functions in the toy/game or outside by using communication technology for data transmission and reception. Signals can be calculated with formulas or compared in look-up tables that contain the reaction or function for every possible play/signal pattern. Signal sequences or patterns can be trained and stored in the toys/games' microcontrollers' memory. To identify the player or the toy, an ID code will be provided. The toys/games' microcontroller sends the ID code plus signal sequences or function codes to an Internet portal or to other electronic devices which can handle this information. The portal switches the ID/information sequence to a database and launches, the so-called Virtual Personal Assistant (VPA) software. This software reads or interprets commands from the database related to the ID code or sequences coming from the toy/game's microcontroller or from other electronic devices. It compares stored and received data and launches reaction activities for feedback to the user or the broadcasting station or to other sources.
A broadcasting station or a provider of digital or analog information can use the same portal (Personal Assistant Portal, PAP) to send sequences back to the user's toys in different ways. One way is to broadcast this information over broadcasting stations such as TV, radio, or other wired or wireless providers. The sequence can be any kind of electronic data, from audio to pictures or movie sequences to pure digital information or others. An activated toy on the receiving side (e.g. in front of a TV screen) receives such sequences and reacts immediately, so the player can play with this toy in relation to the content she/he is watching or listening.
The portal also creates a logbook for storing points for customer relationship management (CRM) purposes or other data that needs to be logged or stored in journals. Users can either register via telephone or via an Internet Web page (register page). The activities a Virtual Personal Assistant (VPA) should fulfill when triggered by external commands can be entered in an instruction page or as scripted with its own language (similar to mnemonics).
The functions of the Personal Assistant Portal (PAP) and the Virtual Personal Assistant (VPA) can also be used for sales support in a shop to promote a toy, game, or other games to a potential customer if he/she wants to touch them or act with them in a way that triggers the output activities from the VPA.
The state-of-the-art now presents TV screens with a built-in interactive Internet means (with apps) so the use of the TV in relation with the Personal Assistant Portal works as an additional service function for viewers, users, players, or other people who can access such a TV screen.
Action figures or pawns for board games or the smallest toys are often too small to fit batteries inside them to power an internal circuit. If they have batteries inside, replacing them can be difficult. Most of these batteries are toxic, so it is not good for them to be in toys. The invention uses means and technologies to avoid the use of batteries whenever possible. Instead, they are replaced by energy harvesters (
Users can absorb or bridge energy from the electric field that the detector senses. This invention allows for the use of all electrodes very narrowly together while other technologies, such as the capacitive touch screen, often have the electrodes in the corners. The pulse generator P and the detector D consist of only a few components, which is an important economic factor (low bill of material, BOM). A software in the microcontroller (described later in the software section of the invention) calculates the XYZ position of a user/player's hand and uses this for internal functions to move actors such as motors, servos, magnets or other electro mechanical components, as well as light (LED) or sound or voice output related to the user's actions.
Additionally, this signal can be transferred into a Personal Assistant Portal (PAP) (
The controller M (of the toy) has the means for voice or sound or melody recognition, especially if the sound comes in pre-stored sequences. As the signals come in, the controller compares the received sequence with the stored ones to identify if they match in a frame of tolerance and accuracy, which can vary. If a match is detected, functions can be invoked with internal or external effects. Listing 1 shows how the gestures sensed and transferred (mixed with User/Toy ID).
The microcontroller M of the toy creates an electric field, which spreads over the user's skin if she/he is near enough. If the user touches action figures, small toys, or pawns of a board game, these items will be influenced by the electric field. As this is an electrical signal, it can be rectified and charge a capacitor until a certain amount is reached. Then the electronics in the small items can be invoked and sends back signals or can start actions. The maximum voltage is created from the harvester if the user touches the device. So, it is possible to distinguish between approach and touch.
VPA is a software set of functions resident in the input server of the invention's underlying system. Every time a trigger signal reaches the input server, a VPA is launched. This means that every user gets his/her own Virtual Personal Assistant (VPA), which “lives only for the current job” that needs to be done. An inherent artificial intelligence system (IAI) reduces the need for scripting and interpreting statements or comments. Tab. 1 shows a possible command list. A journal logs the activities automatically for reference, payment sharing or other purposes, among CRM, statistics, etc.
Interfacing with Game Consoles
The invention allows a simple interface with game consoles by using toys/games, board games, action figures, or other devices as input devices (game control, game pad, or others).
It is possible to equip the player/user with the invention's underlying devices that can inform him/her about the state of play or the game situation. It is preferable that such devices are worn like wristbands, headbands, caps, or other kinds of clothes, but they can also be stationary places near the play scene. In the same way that toys/games react to broadcasted signals, the player can get information on orders, points, signals, vibrations, or electromechanical support. Also a player/user can send back body signals or vital signs (EMG, ECG, EEG, movements, sounds, etc.) into the network or the Toy or Game.
S2F sequences can be broadcast over the normal communication media by using the possibilities that the media allows_audio signals, voice commands, color changing footage, or analog or digitals signals, even in combinations. A tele-interactive toy has the means to receive S2F sequences and the ability to check if they match with previous, stored ones and, if so, to launch determined functions to inform or entertain the user or viewers. This means it is necessary that the toy/game is within reach of media such as a TV screen, radio, or computer, which is connected to the Internet or other networks. The technology of the information clouds will enable S2F signals to be received everywhere in the near future. Such sequences can also address specific toys or games or groups of them by containing identifying signals. Special sequences can lock or unlock receiving devices (toys/games) or change functions.
The invention also allows integration into so-called set-up boxes, which provide content delivered via cable or satellite. Such boxes are often equipped with back channels, which can be used from the invention as well. Telephone or Internet or network connections can also be used.
The content can be added with a list of functions started either at a specific time while the content is being broadcasted or when some determined pictures or film sequences occur. In this case a user's reaction will only be accepted during a time interval or specific picture sequence where the user has to act and play with his/her toys/games doing the right thing at the right time to get points or other benefits. In the short term, the right answer must come at the right time or for the right picture.
Preparing such content, a person can watch the film/audio/content/sequence in parts or frames with the invention-related software, and enter positions in time or picture numbers together with the sequence for function commands S2F in a list that will later run and work in synchronization with the broadcasted content. A VPA can also be triggered to interpret such a list.
This application claims priority to U.S. Provisional Application No. 61/353,463 filed on Jun. 10, 2010, the entire contents of which are incorporated herein by references.
| Number | Date | Country | |
|---|---|---|---|
| 61353463 | Jun 2010 | US |
