Patent Application
20180102142
The present invention relates generally to generation of interactive video files having interaction with external entities.
The present invention provides a method for real-time generation of action while playing of at least one interactive video. The method comprising the steps of: generating an interactive video having event data parameters indicating of association of pre-defined triggering events with object properties changes through video; identifying triggering events while playing the interactive video based on defined event parameters of video object properties changes; sending interactive instruction based on triggering events while playing the video; applying predefined action at external computer based entity which is not part of the player, based on received instructions; wherein the generating sending and applying, are performed by at least one processor.
According to some embodiments of the invention, each interactive event is identified by a unique event type.
According to some embodiments of the invention the event data are associated with time log, optionally timing relative to scene, translating to absolute time within the video.
According to some embodiments of the invention the event data are associated with condition logic in relation to property change.
According to some embodiments of the invention the event data are associated with context, content or behavior by analyzing of content, context or behavior within video,
According to some embodiments of the invention the video generation includes generating an interactive rule layer file including the event data parameters.
According to some embodiments of the invention the video generation includes embedding in event data parameters within encapsulated video file format.
According to some embodiments of the invention event data parameters may relate to the user's profile, the environment and the context of video.
According to some embodiments of the invention the event parameters data includes all the information required in order to invoke the selected external interactive action including at least one of required communication protocol, Address and Data, Execution scripts, Application names or Process names
The present invention provides a system for real-time generation of action while playing of at least one interactive video. The system comprises: Video Builder module enabling to generate an interactive video having event data parameters indicating of association of pre-defined triggering events with object properties changes through video; Video Decoder Player module for identifying triggering events while playing the interactive video based on defined event parameters of video object properties changes and sending interactive instruction based on triggering events while playing the video; and Remote external interactive Entity for applying predefined action at external computer based entity which is not part of the player, based on received instructions.
According to some embodiments of the invention each interactive event is identified by a unique event type. According to some embodiments of the invention the event data are associated with time log, optionally timing relative to scene, translating to absolute time within the video.
According to some embodiments of the invention the event data are associated with condition logic in relation to property change.
According to some embodiments of the invention the event data are associated with context, content or behavior by analyzing of content, context or behavior within video.
Before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of the components set forth in the following description or illustrated in the drawings. The invention is applicable to other embodiments or of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting.
The invention described henceforth relates to a method and a system for creating and playing interactive video sequences. The interactive properties of the video sequence are manifested as rules, which are comprised of triggering conditions and subsequent actions that would be taken when the conditions are met. Following is a table of definitions of the terms used throughout this application,
The invention relates to two types of interaction rules:
According to one embodiment of the invention, the interaction rules (internal and external) are embedded within an encapsulated, encoded file, in conjunction with the video sequence to be played.
According to another embodiment of the invention, the interaction rules (internal and external) are manifested as “Interactive rule layer” files. These files are created independently and separately from the actual video sequence, and may be exported and applied to multiple video sequences.
The Video Builder UI is a designer's interface for creating Interactive videos. The Video Builder UI:
The Video Builder module aggregates all the information included in the interactive video. It incorporates this information in an “Encapsulated video file”
The Video Encoder module:
The designated Video Decoder/Player module:
“Remote External Interactive Entities” are any type of entities, either physical (e.g., Electrical appliance, computer, communication device) or virtual (e.g. a software application, process or service running on any local or remote computing machine) that would be affected by External interactive rule actions. For example—a ventilator may be activated whenever there is a sequence of a storm in the video.
The Video Budder UI is a designer's interface for creating Interactive videos. One of the Video Builder UI's tasks is to facilitate the creation of external and internal interaction rules, through the internal and external interaction rule preparation modules. In this depicted embodiment of the invention, the Video Builder UI is utilized to define the content of independent, External and Internal, Interaction rules' Layer files.
The Video Builder module generates the External and Internal, Interaction rules' Layer files according to the configurations set in the Video Builder UI module. These Layer files may be either imported to the Video Builder as references, or exported, to be independently applied on any video sequence.
The Video Decoder/Player module is designed to play interactive video sequences, applying Internal and External interactive rules that were extracted from interaction rule layer files. In the depicted embodiment, the Video Decoder/Player module:
Select the type and features of an internal interactive action from a predefined set of possible actions.
Select whether the Internal interaction rule is to be applied statically or dynamically. If the rule is to be applied dynamically, configure parameters for diversifying the interactive action throughout (optionally between) video playbacks. These parameters may relate to the user's profile, the environment and the context of playback (e.g.: Show pink object for girls, blue for boys).
Set up all the information required in order to invoke the selected Internal interactive action, e.g.: Changes in media object parameters (e.g. color, lighting), Selection and ordering of Media units (e.g. change the video sequence according to user input), Incorporation of additional media objects into existing media units (e.g. add a scene to the video sequence).
Optionally—export Internal interaction rules as independent layers. Such layers of rules may be imported for use in other projects.
The Internal interaction rule preparation module applies Static, Internal Interaction rules to appropriate media objects. This sets global rules that would affect the video sequences' video or audio in the same way on every presentation of the video file (e.g. the alien spaceship sequence is always accompanied by the Beatle's “Yellow submarine” audio).
The internal interaction rule preparation module also applies Dynamic, Internal Interaction rules to appropriate media objects. This sets rules that would affect video sequences' video or audio differently according to predefined conditions, on every presentation of the video file (e.g. Set the alien spaceship's color to pink or blue, according to the viewer's gender).
The External interaction rule preparation module applies Static, External Interaction rules to appropriate media objects. This sets global rules that would affect Remote external interactive entities in the same way on every presentation of the video file (e.g.: When an email is mentioned on the video, send an email to a predefined address).
The External interaction rule preparation module also applies Dynamic, External Interaction rules to appropriate media objects. This sets rules that would affect Remote external interactive entities differently for each presentation of the video file, according to predefined conditions (e.g. Whenever there is a sunrise sequence in the video, invoke a different application according to the day of the week).
The Internal interaction rule preparation module and External interaction rule preparation module optionally create interaction rules' Layer files that could be exported and applied in multiple projects.
The Video material preparation module links all the information relevant for rendering the video sequence frame by frame. This includes:
The Audio material preparation module links all the information relevant for producing audio that is synchronized to the video sequence. This includes:
The media unit configuration parameters are applied to determine rules for video selection and ordering. These parameters are categorized by:
Media objects are attributed a dedicated set of parameters. These include:
Static and Dynamic properties of Internal, interactive rule conditions and rule actions, that will affect the video sequence.
Static and Dynamic properties of External, interactive rule conditions and rule actions. These rules will affect remote, external interactive entities
The Encoder obtains an Encapsulated Video file from the Video builder module. This file incorporates media objects and media units as well as optional External and Internal interaction rules.
The Encoder may optionally present the interactive video on-the-fly in a video stream. In this case, the Encoder will:
The Encoder processes the Encapsulated Video file, compresses each video object optimally according to its type, and produces an encapsulated, encoded, interactive (external and internal) video file. This file may be read by the dedicated Decoder/Player module, as elaborated below.
The Decoder un-compresses and Extracts the different types of data aggregated in the encapsulated, encoded video file:
The Decoder identifies triggering events in the extracted video data, based on rules that are embedded within that same file. These rules apply to events and conditions such as video object properties, timing, content, context, and behavior of objects.
The Decoder optionally receives input from the user viewing the video stream. This input may be applied as triggers for interactive actions (send email when pressing the ‘Enter’ key) or for diversifying the action (e.g. providing the viewer's gender will invoke different actions).
The Decoder applies actions to the video sequence, as were defined according to the internal interactive rules, embedded in the encoded, encapsulated video file format. These actions will be applied in conjunction with the identification of triggering events, as elaborated above.
Take into account all conditions and actions as elaborated above, to perform frame-by-frame rendering of the presented video sequence and the adjoined audio stream.
The Decoder applies actions on the remote external interactive entity, as were defined according to the external interactive rules, embedded in the encoded, encapsulated video file format. These actions will be applied in conjunction with the identification of triggering events, as elaborated above.
The Decoder optionally exports the encapsulated video and audio data to an industry standard video file format, e.g.: MPEG4.
The Decoder receives a video file to play. This file may be either an industry standard format (e.g. MPEG4) or an encapsulated, encoded interactive video file, prepared by the video encoder module. It also imports an interactive rules' layer file. This layer file is generated by the video builder module, and exported for use by the decoder/player module.
The Decoder Extracts interaction rules from the interactive rules' video file. These rules may be based on defined events and conditions in the video file, e.g. timing, content, context, and behavior of objects.
The Decoder identifies triggering events in the video file that match the extracted interaction rules.
The Decoder optionally receives input from the user viewing the video stream. This input may be applied as triggers for internal interactive actions (e.g. providing the viewer's gender will invoke different appearances of the video sequence).
Take into account all conditions and actions as elaborated above, to perform frame-by-frame rendering of the presented video sequence and the adjoined audio stream.
The Decoder applies actions on the remote external interactive entity, as were defined according to the external interactive rules, embedded in the interactive rules' layer file. These actions will be applied in conjunction with the identification of triggering events, as elaborated above.
The system of the present invention may include, according to certain embodiments of the invention, machine readable memory containing or otherwise storing a program of instructions which, when executed by the machine, implements some or all of the apparatus, methods, features and functionalities of the invention shown and described herein. Alternatively, or in addition, the apparatus of the present invention may include, according to certain embodiments of the invention, a program as above which may be written in any conventional programming language, and optionally a machine for executing the program such as but not limited to a general purpose computer which may optionally be configured or activated in accordance with the teachings of the present invention. Any of the teachings incorporated herein may wherever suitable operate on signals representative of physical objects or substances.
Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification discussions, utilizing terms such as, “processing”, “computing”, “estimating”, “selecting”, “ranking”, “grading”, “calculating”, “determining”, “generating”, “reassessing”, “classifying”, “generating”, “producing”, “stereo-matching”, “registering”, “detecting”, “associating”, “superimposing”, “obtaining” or the like, refer to the action and/or processes of a computer or computing system, or processor or similar electronic computing device, that manipulate and/or transform data represented as physical, such as electronic, quantities within the computing system's registers and/or memories, into other data similarly represented as physical quantities within the computing system's memories, registers or other such information storage, transmission or display devices. The term “computer” should be broadly construed to cover any kind of electronic device with data processing capabilities, including, by way of non-limiting example, personal computers, servers, computing system, communication devices, processors (e.g. digital signal processor (DSP), microcontrollers, field programmable gate array (FPGA), application specific integrated circuit (ASIC), etc.) and other electronic computing devices.
The present invention may be described, merely for clarity, in terms of terminology specific to particular programming languages, operating systems, browsers, system versions, individual products, and the like. It will be appreciated that this terminology is intended to convey general principles of operation clearly and briefly, by way of example, and is not intended to limit the scope of the invention to any particular programming language, operating system, browser, system version, or individual product.
It is appreciated that software components of the present invention including programs and data may, if desired, be implemented in ROM (read only memory) form including CD-ROMs, EPROMs and EEPROMs, or may be stored in any other suitable typically non-transitory computer-readable medium such as but not limited to disks of various kinds, cards of various kinds and RAMs. Components described herein as software may, alternatively, be implemented wholly or partly in hardware, if desired, using conventional techniques. Conversely, components described herein as hardware may, alternatively, be implemented wholly or partly in software, if desired, using conventional techniques.
Included in the scope of the present invention, inter alia, are electromagnetic signals carrying computer-readable instructions for performing any or all of the steps of any of the methods shown and described herein, in any suitable order; machine-readable instructions for performing any or all of the steps of any of the methods shown and described herein, in any suitable order; program storage devices readable by machine, tangibly embodying a program of instructions executable by the machine to perform any or all of the steps of any of the methods shown and described herein, in any suitable order; a computer program product comprising a computer useable medium having computer readable program code, such as executable code, having embodied therein, and/or including computer readable program code for performing, any or all of the steps of any of the methods shown and described herein, in any suitable order; any technical effects brought about by any or all of the steps of any of the methods shown and described herein, when performed in any suitable order; any suitable apparatus or device or combination of such, programmed to perform, alone or in combination, any or all of the steps of any of the methods shown and described herein, in any suitable order; electronic devices each including a processor and a cooperating input device and/or output device and operative to perform in software any steps shown and described herein; information storage devices or physical records, such as disks or hard drives, causing a computer or other device to be configured so as to carry out any or all of the steps of any of the methods shown and described herein, in any suitable order; a program pre-stored e.g. in memory or on an information network such as the Internet, before or after being downloaded, which embodies any or all of the steps of any of the methods shown and described herein, in any suitable order, and the method of uploading or downloading such, and a system including server/s and/or client/s for using such; and hardware which performs any or all of the steps of any of the methods shown and described herein, in any suitable order, either alone or in conjunction with software. Any computer-readable or machine-readable media described herein is intended to include non-transitory computer- or machine-readable media.
Any computations or other forms of analysis described herein may be performed by a suitable computerized method. Any step described herein may be computer-implemented. The invention shown and described herein may include (a) using a computerized method to identify a solution to any of the problems or for any of the objectives described herein, the solution optionally include at least one of a decision, an action, a product, a service or any other information described herein that impacts, in a positive manner, a problem or objectives described herein; and (b) outputting the solution.
The scope of the present invention is not limited to structures and functions specifically described herein and is also intended to include devices which have the capacity to yield a structure, or perform a function, described herein, such that even though users of the device may not use the capacity, they are, if they so desire, able to modify the device to obtain the structure or function.
Features of the present invention which are described in the context of separate embodiments may also be provided in combination in a single embodiment.
For example, a system embodiment is intended to include a corresponding process embodiment. Also, each system embodiment is intended to include a server-centered “view” or client centered “view”, or “view” from any other node of the system, of the entire functionality of the system, computer-readable medium, apparatus, including only those functionalities performed at that server or client or node.
