1. Field
Media with interconnected relationships may benefit from visualizing and ranking techniques and systems. More specifically, interconnected media associated with nodes may benefit from being viewable based on certain user information.
2. Description of the Related Art
Interconnected media can be represented in various forms. Examples of interconnected media can be media with storylines that have been divided into video, text, graphic, or audio episodes. Each episode can be represented as a node in a graph or pictorial representations in a cover flow form. The storylines and the characters can be viewed on a semantic graph with the character connections from episode to episode represented as connections in a semantic graph with nodes displayed sequentially.
The media can be considered contextually connected when the interconnections are interconnections, such as temporal relationships. For example, media that is connected by a storyline in real or fictional time can be considered contextually connected.
The difficulty of browsing interconnected media on a semantic graph is that as the number of graph nodes increases and as the connectivity of the graph nodes increases, the visual complexity of the graph will also increase. Such information density can be appreciated by some, however, it may be overwhelming to others. Even one that may appreciate a high information density presentation may need to focus on a particular section of a graph while continuing to visualize the overall relationship to the entire graph. A simple culling of nodes could remove nodes that are critical to maintaining the contextual relationship, such as an episode that deals with a traumatic injury to a character.
It may also be worthwhile to take into account what is currently relevant to a user, since the interests of users may shift depending on what related movies, games, theme park attractions, cartoons, television shows, characters, stars, or other entertainment is currently trending.
According to certain embodiments of the present invention, a method can include organizing media stored on a plurality of nodes, the media being contextually connected. The method can also include generating one or more images of the nodes based on at least one parameter related to a user. The method can further include providing the one or more images of the nodes to at least one display. The one or more images of the nodes to be displayed can illustrate connections between the displayed nodes. The one or more images of the nodes can be generated based on datasets selected by the user, a desired level of detail selected by the user, or a prioritized set of nodes that are most relevant to the user.
In certain embodiments of the present invention, an apparatus can include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code can be configured to, with the at least one processor, cause the apparatus at least to generate one or more images of the nodes based on at least one parameter related to a user. The at least one memory and the computer program code can also be configured to, with the at least one processor, cause the apparatus at least to provide the one or more images of the nodes to at least one display. The one or more images of the nodes to be displayed may illustrate connections between the displayed nodes. The one or more images of the nodes can be generated based on datasets selected by the user, a desired level of detail selected by the user, or a prioritized set of nodes that are most relevant to the user.
A non-transitory computer-readable medium can, in certain embodiments of the present invention, be encoded with instructions that, when executed in hardware, perform a process. The process can include organizing media stored on a plurality of nodes, and the media may be contextually connected. The process can also include generating one or more images of the nodes based on at least one parameter related to a user. The process can further include providing the one or more images of the nodes to at least one display. The one or more images of the nodes to be displayed can illustrate connections between the displayed nodes. The one or more images of the nodes can be generated based on datasets selected by the user, a desired level of detail selected by the user, or a prioritized set of nodes that are most relevant to the user.
An apparatus can, according to certain embodiments of the present invention, include means for organizing media stored on a plurality of nodes, and the media may be contextually connected. The apparatus can also include means for generating one or more images of the nodes based on at least one parameter related to a user. The apparatus can further include means for providing the one or more images of the nodes to at least one display. The one or more images of the nodes to be displayed can illustrate connections between the displayed nodes. The one or more images of the nodes can be generated based on datasets selected by the user, a desired level of detail selected by the user, or a prioritized set of nodes that are most relevant to the user.
For proper understanding of the invention, reference should be made to the accompanying drawings, wherein:
Contextually connected media can be visualized and organized into semantic graphs, at varying levels of complexity such that the contextual relations of the media are visually highlighted at a plurality of, if not all, levels of detail. The visualization can be dynamically customized for each user. The system can dynamically generate visualizations that are customized to the user-selected datasets, the desired level of complexity, and/or to the profile of the user based on the user's similarity to other users.
This system can alter the visualization of the semantic graph dynamically and reduce or add connected media, represented as nodes and their connections, to the visualization depending on the desired level of complexity and a prioritized set of nodes that are most relevant for each user. A novice user can have a custom simplified view that primarily displays key nodes and/or nodes that are popular to novice users. Expert or more experienced users can have a custom complex view of the graph that displays greater complexity as well as nodes that may be key branching points with many other node connections. The system can select nodes to display at each level of complexity such that the displayed nodes are representative of the context of the media, the importance of the node relative to other displayed nodes, the relevancy of the node to the user, the importance of the node within a community of visualization users, and/or the importance of the node based on metrics representing popularity from other data sources. The system can also dynamically weigh the nodes of a semantic graph such that the nodes can be visualized at various levels of detail. The visible nodes can be the most relevant nodes for the connected media. The system can also select nodes for visualization based on a dynamic weighting system, which may assign a weight to a node based on the context, importance, and/or popularity of the node.
As mentioned above, media content can be visualized and organized into semantic graphs, which may be customized for each user at various levels of detail. A system for providing such display of information can include of a system of servers and of devices or computers that may visualize the media content contained in the graph nodes. The media content can be audio, video, and/or text and can represent events, episodes, scenes, shots, digital representations of print media, locations, persons, personas, actors, characters, back-story, “making-of,” alternate storylines, and/or digital representations of physical objects, and the like. The system of servers can store the semantic graph, store the user database, calculate a dynamic node visualization weight for each user, calculate the appropriate node set for the user based on the weight and level of detail, store viewing metrics for the user, store metrics from other users, serve a social forum for each node, and/or serve the content of the nodes to the visualization users that form a community. The system of servers can also collect metrics to create profiles of a user's visualization(s), which can include metrics from a user's node viewing and metrics from a user's node related to the user's social activity, to rank nodes for viewing.
Devices and computers can be used by users of visualization software or of a visualization website to visualize the media that is organized into a semantic graph. Users can login to the system of servers through software on the devices and computers or through a web page. Devices and computers can communicate with the system of servers through a defined set of web-services. The software or the web page, viewed on the devices or computers, can animate the visualization of the graph to gradually reveal details of the graph as the user explores the connected media. The system of servers can stream the shape of the graph in two- or three-dimensions as well as a customized node set for each user and the associated media content. Users can explore the interconnections of media based on metadata relationships by adding or subtracting additional media characteristics such as categories, themes, imagery, characters, storyline, artists, and/or directors. Users can explore the interconnections of media and media characteristics at various levels of detail by exploring node sets that may be customized by the system of servers for each user.
Users of the visualization software or website may be able to participate in a community that comments, ranks, and socializes with other users around the media content in each node. Users can also earn status and achievements for participation in the community as an incentive to further participate in the community. Achievement and status can be used to unlock locked media or to gain special privileges within the community, such as the ability to edit metadata or the ability to mediate, moderate, and/or administer forums.
The system of servers can profile each user as they browse the visualization, stream media, and/or participate in the community to match user behavior with appropriate sets of nodes for visualization. The system of servers can also combine the metrics of the media collected from the individual user, community, and outside sources with the importance of a node in maintaining the media context to present a targeted subset of nodes to each user.
The visualization users 155, 160, 165 can be grouped into a community 150 within this browsing experience by attaching a system of logins, rating, commenting, questions, feedback, and/or profiles, etc. to the nodes and associated media. Metrics of browsing graph visualization behavior can be collected from the community via a metrics collection unit 120 and can be combined with metrics of viewing associated media from other sources, such as television or web, and combined in a database. The metrics obtained by the metrics collection unit 120 can be sent to the system of servers 101 via the Internet 125. From the Internet 125, the metrics obtained can be sent to a metrics database 115 via the graph visualization server system 110.
Media components 206, 211, 216, 221 can be attached to graph nodes 205, 210, 215, 220 along with associated metadata 208 and social features 209 for each media component 206, 211, 216, 221 such as ratings, comments, and forums. Nodes 205, 210, 215, 220 can also contain a dynamically calculated visualization weight 225, 235, 240, 245 that may determine which nodes may be visible to a user at their desired level of detail. Nodes for display can be selected based on the calculated visualization weight 225, 235, 240, 245, the current level of visualization detail selected by the user, and what other media organizing characteristics were selected by the user. The nodes 205, 210, 215, 220 can also include semantic information 250, 255, 260, 265 that can identify the specific connections between the nodes, such as, for example, which nodes may be connected to each other. The semantic information 250, 255, 260, 265 can also include tag data and identifying information associated with each node 205, 210, 215, 220 based on the content contained within them.
Users can select other media organizing characteristics to add or subtract media segments that may be displayed. In
The weight of a node can be unique for each user. The visualization weight of a node (Wt) can be calculated based on the importance of the node in maintaining the relationships of connected media and the importance of the node to the user and the user community. The importance of the node to other connected media can be captured by the shape of the graph (S), the number of connected nodes (N), and a manual or algorithmically-assigned level of contextual importance to the node (I). The importance of the node to visualization users and the community can be captured by the relevancy of a node to a user (U), a visualization community importance to the node (C), and a metrics-based importance to the node, which may include metrics from sources outside the visualization community (M).
Each weight can be multiplied by a multiplier a-f
Wt=a(S)+b(N)+c(I)+d(U)+e(C)+f(M)
The importance of a node to the shape of a graph (S) can be pre-calculated based on existing vertex decimation schemes. The contextual importance of a node (I) can be manually assigned or calculated by an existing algorithm depending on the media content of the node. For example, summarization algorithms have been developed for summarizing text-based media while other algorithms have been developed for summarizing video based on closed captions or image recognition. The summarization algorithms can rank different segments of the media to create a hierarchy for summarization. This ranking could be used to calculate the importance of the node (I). The user 305 importance of a node (U) can be calculated dynamically and can be based on profiling the user's browsing pattern of nodes and matching this browsing pattern to other users within the visualization community.
A user can be categorized into groups based on the preference of the user for certain media-organizing characteristics, preferences for specific media, preferences for levels of detail of the media, and/or preferences of associated nodes of the media compared to other users. Based on this categorization a user's likely preference for a particular node can be calculated based on the browsing pattern of other similar users. The community based importance to a node (C) can be collected from user ratings of media that may be associated to a node, the number of ratings for the node, the number of active comments for the node, and/or the general social activity of the node. Metrics based weighting (M) can be based on the popularity of media within a broader community and may include the sales of particular media, the popularity of associated media in other formats, the popularity of associated merchandise, the popularity of physical collectibles associated with the media, the popularity of digital collectibles associated with the media, and/or analytics collected from other systems such as television, radio, broadcast media, theaters, games, computer and device applications, web, and/or advertising networks.
Vertices that may be useful in maintaining the overall shape of the graph may always be streamed, but vertices that are not as important may be streamed as needed for the correct level of detail. The vertex decimation function can preserve the overall shape of the graph at various levels of detail without the associated nodes and media, so that users can see a consistent shape to the graph whether they are zoomed into a magnified section or whether they are looking at a much larger section. The system of servers 101 can separately store and stream the semantic nodes with their associated media to a visualization user 305 in a streamable tree structure 415 that may be dynamically generated such that the depth of the node in the tree may reflect a dynamically calculated visualization weight.
The system of servers, at 530, can generate one or more images of the nodes based on at least one parameter related to the user. At 535, the system of servers can calculate a visualization weight for each node of the plurality of nodes. The visualization weight can be calculated, at 536, based on context, at 537, based on importance, or at 538, based on the popularity 538 of each node. At 540, the system of servers can attach a social forum or social network to each node of the plurality of nodes. The social forum and social network can allow the user not only to rate and comment on the stored media, but also to ask or answer questions, friend users, send messages to users, have discussions with users, follow the activity of users, form groups, and/or send announcements to groups of users.
At 545, the system of servers, can provide an interface configured to, at 550, allow the user to rank, comment and socialize with other users around the media of each node. Alternatively, at 545, the system of servers can provide an interface configured to, at 555, allow the user to control the number of viewable nodes. It should be noted that the alternatives discussed above can be applied individually or in combination with each other according to certain embodiments of the present invention.
The system of servers, at 560, can provide one or more images of the nodes to at least one display. The one or more images of the nodes to be displayed can illustrate connections between the displayed nodes. The one or more images of the nodes can also be generated based on datasets selected by the user, a desired level of detail selected by the user, and/or a prioritized set of nodes that are most relevant to the user.
The system of servers, at 565, can display the media through a web-based interface. In certain embodiments of the present invention, the media displayed through the web-based interface can be viewed on a stationary or a portable electronic device. For instance, the media can be displayed through a web-based interface viewed on a computer, a mobile phone, a tablet computer, a device that can connect to a television or monitor, a portable gaming device, secondary devices, projection devices, or other web-enabled device. Such devices can also be used for digital signage and retail displays. However, in other embodiments of the present invention, other stationary or portable electronic devices may be used.
The methods described above can be implemented in hardware alone or by software running on hardware. For example, a computer program product can be encoded with instructions for performing the above-described methods. Likewise, a computer readable medium, such as a non-transitory computer readable medium, can be encoded with instructions that, when executed in hardware, perform the above-described methods.
The methods described above can be implemented by an apparatus 600, according to certain embodiments of the present invention and illustrated in
The apparatus 600 can also include at least one memory 610. The memory 610 may include computer program instructions or computer code. The memory 610 can be one or more memories of any type suitable to the local application environment, and can be implemented using any suitable volatile or nonvolatile data storage technology such as semiconductor-based memory device, a magnetic memory device and system, an optical memory device and system, fixed memory, and removable memory. For example, memory 610 may include any combination of random access memory (RAM), read only memory (ROM), static storage such as magnetic or optical disk, hard disk drive (HDD), or any other type of non-transitory machine or computer readable media. The instructions stored in memory 610 can include program instructions or computer program code that, when executed by processor 605, enable the apparatus 600 to perform tasks as described herein.
The apparatus 600 can also include a user interface 615. The user interface 615 of
While the apparatus 600 shown in
Nodes 710 can be arranged along lines 715. Lines 715 can show relationships between media content and how the nodes are connected relative to each other. Examples of arrangements include, but are not limited to: arrangement according to character intersections across media over real time as shown by the lines, spacing, and grouping of nodes; arrangements according to character intersections over narrative time within media as shown by lines, spacing, and grouping of nodes 715; arrangements according to other metadata, or client or user-generated criteria, such as “villains,” “heroes,” “gender,” “age,” etc.; arrangements according to user-generated criteria, such as “favorites,” “order watched,” “my friends' favorites,” and so on.
Nodes 710 can also be surrounded with small avatars 725. Avatars 725 may represent users gathering around popular content, which is aggregated and cached over a window of time such as, for example, twenty-four hours.
Other navigation options can also be available to the user. For example, in the “ride” view of the node graph 830, after a user taps or touches node 825 along the interconnected pathway 820, the node 825 may be expanded to allow the user to view the contents contained within the node 825. The contents of the node 825 may include various forms of media, such as, for example, video 905 and/or various forms of media as previously described herein, or the like. If the media content within the node 825 contains video 905, upon expansion of node 825, video 905 may automatically play. The video 905 may also be expanded to full screen by tapping/touching button 910. In other embodiments of the present invention, the node 825 may automatically cycle through any additional media contained therein.
Monitoring of the user profile may also be available. For example, the user can monitor profile status via status bar 935. Status information may include, for example, the number of points the user needs to reach the next level, the user's rank, and the like.
The user profile may also include various other information relevant to the user. For example, the profile may include a pins portion 945 that can correspond to the journeys or pathways 820, characters, and/or various forms of media content as previously described herein that the user is interested in, would like to follow, and/or would like to share. The profile may also include a favorites portion 950 that can correspond to nodes that the user has “liked.” The profile may also include a packs portion 955 that can correspond to types of media content liked by the user or that may be most relevant to the user. The profile may also include follower information 960 of other users that may be following the user, other users that the user is following 965, and journeys or pathways 970 that may include various node networks that the user has explored and/or the user has created, which can be optionally shared to a community.
The user may also shift from one interconnected pathway 820 to another in a left or right direction. The user may also be able to view key content 980 contained within a particular interconnected pathway 820 and select a pathway 820 to follow by touching or tapping on the desired pathway 820.
The described features, advantages, and characteristics of the invention can be combined in any suitable manner in one or more embodiments. One skilled in the relevant art will recognize that the invention can be practiced without one or more of the specific features or advantages of a particular embodiment. In other instances, additional features and advantages can be recognized in certain embodiments that may not be present in all embodiments of the invention.
One having ordinary skill in the art will readily understand that the invention as discussed above may be practiced with steps in a different order, and/or with hardware elements in configurations which are different than those which are disclosed. Therefore, although the invention has been described based upon these preferred embodiments, it would be apparent to those of skill in the art that certain modifications, variations, and alternative constructions would be apparent, while remaining within the spirit and scope of the invention. In order to determine the metes and bounds of the invention, therefore, reference should be made to the appended claims
This application is related to and claims the benefit and priority of U.S. Provisional Patent Application No. 61/810,904, filed on Apr. 11, 2013, which is hereby incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
61810904 | Apr 2013 | US |