There are many and varied types of products that benefit from the use of a colour display screen, multimedia capabilities such as video and audio, or sensor inputs such as accelerometers.
However, due to manufacturing constrains and expense, particularly when considering entertainment products such as toys and games, it is often not possible to utilize such technologies.
Further, many people own and use portable handheld devices with colour display screens and multimedia capabilities but use them for a relatively limited set of uses and, although it is possible to adapt such devices within software (by installing additional applications and so forth), there are limited possibilities to adapt such devices physically.
Existing solutions that relate to the problems outlined above are:
Apparatus and system that enables a handheld multimedia device (e.g. an mp3 player, such as the Apple™ iPod™ Touch, or a mobile telephone, such as the Apple™ iPhone™, or any other device that includes one or more multimedia technologies such as a display screen, touch input, video, audio and networking capabilities) to be adapted, both in software and physically, so as to be used for a new or enhanced purpose.
The intention is to augment an existing handheld device by using a software application combined with an additional physical element, so as to enable the device to be used for a new purpose—the additional physical element containing, attaching to or otherwise integrating with the handheld device and having an intrinsic relationship to features of the device (e.g. cut-outs that enable only certain areas of the screen to be visible) so as to appear to transform the device into a new product. The additional physical element may be constructed from various materials, such as papers, cards, plastics, rubbers, fabrics and so on, and may have various physical designs and graphics applied.
For example, a software application and a stuffed-fabric cover could be provided to adapt a handheld device into an animated soft-toy—the application being installed on the handheld device and the device being inserted into the stuffed-fabric cover. Such an example embodiment would combine the handheld device, application and cover in an integrated way so as to appear to transform the device into a new product, and therefore the cover may relate to and integrate with various features of the handheld device (e.g. a cover in the form of an animal's face may have cut-outs to enable areas of the screen of the device to be visible so as to display content that relates to the cover, such as a pair of animated eyes).
The apparatus incorporates, but is not limited to, three main elements—a handheld multimedia device, such as an mp3 player, mobile telephone, PDA or similar device; a software application (which is installed on the device); and a physical element that contains, attaches to or otherwise integrates with the handheld device. All three elements combine to augment the handheld device, adapting it for a new purpose, whereby the device appears to be transformed into a new product.
In the preferred embodiment, the handheld device is incorporated into the additional physical element in such a way that the physical element and features of the device (such as the display) become intrinsically related and therefore the content output from the software application (e.g. in the form of video and audio) interplays with the physical element so as to appear to transform the device into a new product. For example, the handheld device may be inserted into a stuffed-fabric cover in the shape of an animal's face in such a way that the display of the device aligns with cut-out areas on the cover, so that animated eyes (generated from the software application) are visible through the cut-out areas and therefore the animal face appears to have “real” animated eyes (see the soft-toy example embodiment in
In most embodiments, the apparatus may utilize various technologies that may be available on the handheld device (such as a video display output, touch display input, audio, networking, GPS, accelerometer sensors, tilt/orientation sensors, microphone) so as to enhance the purpose for which the device is being adapted. For example, it may utilize the touch display input of the device to respond to user interaction (such as an eye blinking when a user touches the eye with his finger, as in the case of a soft-toy similar to the example embodiment shown in
In some embodiments, the additional physical element will integrate with the device in a more ‘active’ way, whereby a technological relationship between the device and the physical element is created, rather than the physical element merely containing or attaching to the device, so as to enhance the overall functionality or interactivity. For example, the physical element may contain a cable and dock type connector to enable it to be connected to the device and for the device to be charged via the physical element; or the physical element may contain a dock type connector and a speaker so as to amplify the sound from the device; or the physical element may contain a dock type connector and sensors (e.g. switches, potentiometers, capacitive sensors, microphones, IR receivers, LDRs, FSRs and so on) so that interaction with the physical element results in communication from the physical element to the device via the dock connector causing the software application to respond in some way; or the physical element may contain a dock type connector and actuators (e.g. motors, solenoids, servos, wheels and so on) so that the software application can control the actuators via the dock connector (e.g. in an example embodiment where the physical element is in the form of a robot with wheels which drives around and is controlled from the software application); or the physical element may contain areas of material that when touching the touch display of the device cause the device to register a touch input, and therefore when a user presses certain corresponding areas of the physical element the material thus comes into contact with the touch display causing a touch input to registered and the software application to respond in some way.
In some embodiments the software application may output content that is up-to-date or enhanced, either by prompting the installation of new version of the application from time to time (or an alternative but related additional application); or by loading or streaming content from a remote source using the networking capabilities of the handheld device.
The present invention may be applied to many alternative configurations, and used in many varied applications, some examples include:
A scenario of use is described below, representing one such embodiment of the invention in more detail: The example embodiment is described with reference to the figures.
User 101 has a handheld multimedia device 102 (containing a software application 105); and a physical element 106.
Device 102 includes a video display 103, touch input 104, and a software application 105 (which has been installed on the device and is intended to be used in combination with the physical element 106).
Physical element 106 is a stuffed fabric cover in the form of an animal's face which includes an internal space 107, into which the handheld device 102 is to be inserted and thus supported, and two cut-out areas 108, which align with the display screen of the device (when the device is inserted into the physical element) and enable two areas of the device display to be visible.
When running on the device, software application 105 displays a pair of animated eyes on the screen of the device, which become visible through the cut-out areas in the physical element when the device is inserted into the physical element. Application 105 also responds to touch input so that when the device display is touched within the area of the screen displaying the eyes, the eyes will be animated so as to appear to blink in response to the touch.
User 201 has launched the software application (105 in
In a further enhancement of this embodiment, the software application (105 in
In a further enhancement of this embodiment, the software application on the multimedia handheld device 202 receives or loads new content via a network connection. This new content may be loaded into the software application free of charge to the user, or the user may purchase this new content via the software application. Examples of new content that could be loaded into the software application are: new audio content (e.g. the latest episode of an audio story that the soft-toy will narrate to the user); new graphical content (e.g. the user may be able to customise the appearance of the soft-toy by updating the colour of the eyes); new game content (e.g. different games each week could be loaded into the software application so that the user would be able to interact with the soft-toy in different ways).
In a further enhancement of this embodiment, the software application on the multimedia handheld device 202 utilizes the camera of the device (e.g. a front facing or rear facing video camera typically used for taking photos or recording video or videotelephony) to recognize three-dimensional objects (e.g. identifiable colours or forms) or two-dimensional graphics (e.g. identifiable machine readable printed codes such as 2D barcodes or other recognizable printed patterns), the lens of the camera being unobstructed by means of an appropriately positioned cut-out in the physical element 206. The soft-toy would thus be able to indentify objects and print material in its environment and would react by means of audio/visual output. For example, stickers with illustrated pictures and 2D barcodes printed on them could be placed around a room so that when the soft-toy is carried around the room the soft-toy could “see” and recognize each sticker (i.e. the software application would read the 2D barcodes via the camera on the device) and thus play back different sounds associated with each sticker, such as the voice of the toy describing the illustrated picture on a sticker or telling the user additional information about the picture.
In a further enhancement of this embodiment, the software application on the multimedia handheld device 202 utilizes the microphone of the device to either record audio or to analyze audio input so as to allow the user to interact with the soft-toy using sound. For example, the soft-toy could appear to mimic the user by repeating what the user says by recording the users voice and then playing it back with distortion or audio filtering so that that it appears to be the voice of the toy. Further, the software application could analyze audio input from the microphone so as to identify particular frequencies and/or sounds that it has been programmed to respond to and thus react by means of audio/visual output. For example, the soft-toy could “listen” (i.e. the software application analyzes sound input via the microphone on the device) for certain notes to be played on a toy piano and respond by singing a lyric whilst also animating its eye in time to the music.
User 301 inserts his finger through the cut-out 308 in physical element 306 and touches the display of handheld device 302. The device registers a touch input and in response the software application animates the eye so as to make the eye appear to blink. Thus the soft-toy becomes interactive, blinking when it is touched or “poked” in the eye.
Further enhancements of this embodiment may be to utilize the date/time features of the device to make the soft-toy 410 appears to sleep at appropriate times (e.g. close the animated eyes on screen when it becomes evening); to utilize the accelerometer sensors in the device so that when the soft-toy 411 is shaken or tilted the eyes appear dizzy or dazed (e.g. the animated eyes may spin or become “crossed”); or the physical element may include an external cable and a dock type connector within the internal space (107 in
So, in use, a user receives a software application and a physical element (a soft-toy in the form of an animal face). He installs and runs the software application on his handheld multimedia device and inserts the device into the physical element. The software application displays a pair of animated eyes, which are visible through two cut-outs in the physical element. The soft-toy thus appears to “come to life”, having a pair of animated eyes. If the user inserts his finger through one of the cut-outs and touches the display screen, the “eye” blinks, thus the soft-toy also becomes interactive.
The soft-toy embodiment of the invention referred to in
According to one aspect of the invention, there is provided an apparatus comprising a hand-held device and a container, the container including a window or cut-out, the hand-held device including a screen, the hand-held device being removable from the container, the hand-held device arranged in the container such that some or all of the screen is exposed through the window, the hand-held device running a software application that provides screen content which relates to the design or function of the container.
The apparatus may be one in which the container is a toy.
The apparatus may be one in which the container is a soft toy.
The apparatus may be one in which the software application makes the toy or soft toy appear animated.
The apparatus may be one in which the software application generates audio output from the hand-held device.
The apparatus may be one in which only some of the screen is exposed through the window or cut-out.
The apparatus may be one in which less than half of the screen is exposed through the window or cut-out.
The apparatus may be one in which software applications can be purchased from an application store.
The apparatus may be one in which video or audio content can be purchased from a vendor using the hand-held device.
The apparatus may be one in which the camera of the hand-held device is used to recognize three-dimensional objects or two-dimensional printed patterns, such as 2D barcodes.
The apparatus may be one in which the microphone of the hand-held device is used to record audio (e.g. the user's voice) or to analyze audio input (e.g. to detect tones).
This application is based on and claims priority to U.S. Provisional Application No. 61/394,940, filed Oct. 20, 2010, the entire contents of which are hereby fully incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
61394940 | Oct 2010 | US |