Patent Application
20230245587
The present invention relates in general to books and stories and in specific to integrating special effects to stories that immerses participants into the story environment specifically for children under the age of 10 years old.
Children learn to talk as they participate in the usual, everyday communication. In order to comprehend and communicate effectively, development of strong verbal skills is vital, right from the birth of children. Research has proven the role of audio-visual books in this regard. The ease of using audio-visual books contributes to its success in developing verbal skills in children.
Audio-Visual books provide good interpretive reading skills to children. Inability to read big, long texts could potentially affect their interest in reading and learning. Audio-Visual books help children to understand complex language. Through pictures and music, children are able to grasp information better. Audio-visual books attract children towards stories, texts and content and boost their interest in understanding language, thus fostering their verbal skills.
Audio visual books further develop active listening and critical thinking skills. Effective verbal or spoken communication depends on the ability to listen to what others speak. Active listening is an important skill and should be introduced in children right from a young age, in order to interact with others, expressing thoughts, sharing information and proper understanding of context.
Audio-Visual books are very engaging and spark the imagination of children. These books help children understand what others are trying to say, build a context and communicate better themselves. Children love listening to these stories and thus develop the ability to listen critically and carefully. Visual images stick in the long-term memory of children. They are able to pay more attention and understand better through images rather than textual form. Visuals transmit the message faster to children and help them comprehend information so that they can put their thoughts into words clearly.
Listening to Audio-Visual books helps children to share how they think with others effectively and improve their vocabulary, reading and speaking skills. They are more interesting and associate how words sound with how they appear on a page and help children to correlate the meaning of words, which increases their understanding.
Audio-Visual books are easily accessible, portable and can be listened to over-and- over again. When children show reluctance towards hard book covers, audio-visual books act as the perfect tool to attract children through their stories, pictures and music, providing a pleasurable reading and learning experience.
In recent years interactive books and mixed reality toys are finding an extended market owing to the proliferation of smartphones in the market. Apps have been developed that play the background music with sound effects relevant to some key words written in the story. The app will play the sound effects while reading the book and recognizes the readers sound. The available apps have the feature of playing relevant sounds. Music and/or audible effects in combination with silent reading is further described. Such systems, however, are dependent on use of electronic books and algorithms that synchronize a user's reading speed to the sound effects. Improvements in systems and methods for integrating special effects to stories are desirable.
The present invention is a system and method to add audio and visual effects to the story books. The system “Live the Story” is an App that works with electronic devices including but not limited to kindle, computers, smart phones and tablets and provides interactive sound effects, illustrations and recordings while the users are reading a book. In the description the term “app” or “application” or “mobile app” may refer to, for example, an executable binary that is installed and runs on a computing device.
The story book may refer to a children's book, a board book, a chapter book, a novel, a magazine, a comic book, and the like.
The software application of the system has options to add background images, characters, gif animations, sound effects, visual effects and control the way they are going to be presented. The books will be uploaded on online server of the system and then will be downloaded by the end users.
The system immerses participants, the readers of the book and the listeners, while viewing or listening to the reader and allow participants specifically young children to bring a subject to life and explore the subject more interactively. The pictures come alive in the form of videos or 3D figures displayed on top of the picture, creating an illusion of images becoming alive by augmenting videos and 3D objects on top of the image/ picture, when viewed through the electronic devices. In the invention, the participants become part of the story.
In one embodiment the participant's own image can become part of the story (video or 3D) along with the other story characters while displaying the AR content. In another embodiment the participants can create an avatar and become part of the story.
Interactive sound effects, visual effects and animations integrated with the books, bring the story to life by adding music, sounds and even character voices. The system of the present invention has a voice recognition technology which helps the sound effects become a seamless part of users narration.
Therefore, it is an objective of the present invention to make reading books to be more joyful by adding audio and visual attractions and create a new generation of book lovers and to provide valuable screen time.
It is another object of the present invention to prevent children to spend more time on using electronic devices such as mobile and tablet devices to play games and to enrich the time they spend on tablets by directing them to enjoy reading books.
It is another object of the present invention to strengthening the relation between parents and their children by involving the parents to read books with their children and encouraging the children to read books and enjoy their time by using the present interactive app.
Embodiments herein will hereinafter be described in conjunction with the appended drawings provided to illustrate and not to limit the scope of the claims, wherein like designations denote like elements, and in which:
The present invention relates to a system to adding special effects to story books, such as a traditional paper book, e-book or any other sources, and an associated method for playing the special effects. The special effects is in response to a user reading a story to enhance the enjoyment of the reading experience specifically for younger children. The special effects can be customized to the particular story and can be synchronized to initiate the special effect in response to the text source being read. The system of the present invention uses the latest Machine Learning techniques, voice recognition and AR to create special effects.
The system is programmed to begin processing and outputting a special effect related to the word being read by the reader. The system will perform while reading a book, special effects, such as, audio sounds, music, lighting or other environmental effects when specific words or phrases of the text source are read. For example, a system may be configured to detect a particular pre-determined word or phrase of a text source, process, and output a special effect related to one or more portions of the book.
The application is an Android App that is downloadable from the Google Play Store and can be installed on any electronic device such as mobile device, a desktop or a laptop configured to receive an audible input from a user and output a plurality of special effects associated with the story based on algorithm of the system. The audible input from a user comprises a voice of a user reading one or more portions of a story is pre-recorded and electronically outputted.
The system determines whether the audible input matches one or more pre-determined triggers via a voice recognition algorithm; and in response to determining that the audible input matches the pre-determined trigger, command the system to output a plurality of special effects associated with the story book; wherein the special effect comprises an audio or a visual content.
Referring to
The system application of the present invention 100 is comprised of 3 major parts:
a. Book editor software (Desktop) 110
b. Web based Control Panel 120
c. Android App (LIVE THE STORY) 130
The Book editor software 110 is programmed to create and edit the books (stories) that will be used on the Android App 130. The book editor software 110 provides features comprising:
Add/Edit text layers (font and size) 111;
Add/Edit Background layers(Images);
Add/Edit character layers (Static/Dynamic Images), animations and motions layer (gif images) 112, and
Add visual and sound effects on the images and characters 113.
The book Editor 110 creates multimedia books. The user of the system 100 will be able to add/edit texts, Add Images, import Visual documents (GIF format) and sound effects (Audio format) on selected parts of the book either text or images. The system 100 can utilize a voice recognition feature to detect specific words when read by the reader and run the relevant assigned animations (GIF or sound files).
The system 100 may add background images, characters, texts, gif animations and control the way they are going to be played. The books will be uploaded on online server of the system and then will be downloaded by the users.
The web based Control Panel 120 is designed to create categories that will be available on the app, and to upload the books so that they are accessible and downloadable for the app user on their android device. The features of the control panel 120 of the system are to: Add/Edit book categories 121, Upload/Edit or delete book's details 122 and import books to create book list 123.
Android App 130 is downloadable from the Google Play Store and can be installed on any android device. After the App 130 is executed, the first initial step is to download the books from the online store into the android device and then the Books (stories) can be played at any time. The user will have the option to select an avatar 131 for the characters of the book. The App 130 has features to download and update the book's (stories) categories 132, select Avatars (using the camera or a saved avatar created by avatar maker apps) 133, create avatars or use a picture of participants' face in the story.
The user then selects a book 134 to read. The system 100 runs and shares the user's story which is read by the reader 135 with the created or selected avatar in combination with visual and sound effects 136.
A particular special effect is played to the feature phrase being read. The system 100 may be programmed to command one or more of the special effect output modules to play the special effect upon detection of one or more trigger phrases. The system includes a special effect track that may be multi-layered comprising one or more special effects that may play separate or simultaneously during reading of the book. Each special effect layer may include one or more special effects including but not limited to an auditory effect, a visual effect, an environmental effect, other special effects, and combinations thereof.
The special effect track may be incorporated into various file formats for playing by corresponding special effect software. The system 100 enables the users to provide additional special effect tracks, add, or modify existing special effect tracks to the system. A user or reader of a book may then download or obtain the updated special effect track for a selected book. For example, in response to detection of a single trigger phrase, one or more special effects of special effect layer 1 may be pre-programmed to play for a pre-determined period of time, one or more special effects of special effect layer 2 may be pre-programmed to begin playback after a pre-determined time of the playback of one or more effects of special effect layer 1, and one or more audible effects of special effect layer 3 may be pre-programmed to begin playback after a pre-determined time after the playback of one or more special effects of layers 1 and/or 2.
Auditory effects can include background music, human voices, animal sounds, atmospheric noise, sound effects and the like.
Visual effects can include any special effect that is designed to be viewable by a user. For example, visual effects can include animation, video, avatars, or other forms of motion, light sources and the like.
According to
The system Incorporates AR technologies to create a unique interactive experience and bring the stories to life. Multiple users can use multiple devices and enter the story environment to view the same story unfold through different perspectives depending on their physical location. Users can, for example, face the tablet/phone device to an empty table, and then perceive the 3D world on the table.
Experiencing the story with more users will always be more fun, and throughout the whole story, users can have their friends also experience the story on their devices even if they are apart from each other. Through remote technologies, the AR experiences will be in sync including video and audio calls in the background so they can talk to each other as well.
To further enhance the experience of an interactive story, the AR component can be complemented with actual physical toys/markers. It can be a board with many pieces to signify the different characters or objects of the story. Through AR, these pieces turn into their 3D characters or objects. Their position is also tracked and thus the story can be played by a ‘physical touch’. Multiple kids can look around the table with their phones/tablets and run around it and look at the story, while the parent is moving the pieces and the story along. This creates a lively experience that involves both the parents and the kids, making it the perfect bonding experience to be a part of the story, together.
The input unit 103, voice recognition module 106, and the other related circuitry, may be configured to work together to receive and detect audible from the reader. For example, the voice recognition module 106 may be configured to receive audible sounds from a reader and analyze the received audible sounds to detect trigger phrases. Based upon the detected trigger phrases, an appropriate response such as an audible or visual effect may be initiated.
The system 100 may include a communication network 200 which operatively couples to the electronic device 101, the server 102, and the database 109. The electronic device 101 may include but not limited to one or more personal computers, laptop computers, display devices, video gaming systems, gaming consoles, mobile devices, smartphones or tablet computers.
The audio output module 107 may include a speaker, a sound controller , and various related circuitry (not shown), which may work with the sound controller to activate the speaker and to play audio effects stored in the database 109 or in the memory 105 in a manner known to one of ordinary skill in the art. The processor may be used by the audio output module and/or related circuitry to play the audio effects stored in the memory and/or the database .
The voice recognition module 106 may include a controller , and other related circuitry (not shown). The input unit 103, voice recognition controller, and the other related circuitry, may be configured to work together to receive and detect audible messages from the reader and detect trigger phrases and based upon the detected trigger phrase initiate an appropriate response (e.g., special effect). For each detected trigger phrase, a corresponding special effect may be stored in the memory 105 or the database 109. The voice recognition module 106 may employ at least one voice recognition algorithm.
The application of the system is configured to work with android devices including but not limited to kindle, computers, smart phones and tablets and provides interactive sound effects, illustrations and recordings while the users are reading a book to their children. Interactive sound effects, visual effects and animations integrated with the books, bring the story to life by adding music, sounds and even character voices. The app's voice recognition technology helps the sound effects become a seamless part of users narration.
In the description the term “app” or “application” or “mobile app” may refer to, for example, an executable program that is installed and runs on a computing device to perform one or more functions. It should be noted that one or more of the above components (e.g., the processor 104, the voice recognition module 106) may be operated in conjunction with the app as a part of the system 100.
At block 304 the participant selects a text source from the system, the voice recognition module may be activated 306 to receive audible input from the reader 305, via the microphone of the input unit of the electronic device. the user may identify a text source she wishes to read aloud. Identification of the text source may be performed by the user entering a title of a text source, browsing for a text source title, or audibly speaking the name of a text source title.
At block 309 the participant is asked to select a desired avatar. The participant's real face can also be selected and saved in the application data base 310. At block 307, the application continuously picks up on audible messages, checks the audible input that matches to one or more pre-determined trigger phrases. Such a check may include comparing the spoken word(s) to word searchable files having an associated audio effect or soundtrack. The system load sound tracks and files for selected text source and plays the special effect associated with the one or more trigger phrases 308. The selected avatars are used 311 and activated in the system 312.
The foregoing is considered as illustrative only of the principles of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation shown and described, and accordingly, all suitable modifications and equivalents may be resorted to, falling within the scope of the invention.
With respect to the above description, it is to be realized that the optimum relationships for the parts of the invention in regard to size, shape, form, materials, function and manner of operation, assembly and use are deemed readily apparent and obvious to those skilled in the art, and all equivalent relationships to those illustrated in the drawings and described in the specification are intended to be encompassed by the present invention.
This application claims priority to the U.S. provisional patent application No. 63/305,958 filed on Feb. 2, 2022, entitled “SYSTEM AND METHOD FOR INTEGRATING SPECIAL EFFECTS TO A STORY”, the application being hereby incorporated by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 63305958 | Feb 2022 | US |
