Patent Application
20190132272
Electronic messaging and related social media applications (apps) have enjoyed almost exponential growth in recent decades due to widespread availability of mobile communication devices and public access computer networks such as the Internet. Messaging in conjunction with user supplied media, due to the almost synonymous integration of cameras with most mobile devices, have further fueled the growth of social media apps and websites. As a result, many network outlets exist for electronic communication including user captured visual images.
A mobile messaging device and application augments user generated messaging content with prequalified graphic content based on situational parameters and vendor subscribed criteria. An initiating device, responsive to a user, captures user supplied content such as video or still images. A selected prequalifier is indicative of augmented content based on a mood, theme, novelty or emotive inclination of the sender. The prequalifier may be an arbitrary, fanciful or themed selection based on an accompanying theme to the user supplied content. Vendor initiated filters denote a match with augmented content to accompany the user selected content based on the prequalifier and the filter. Integration logic on the sender device integrates augmented content of the most relevant vendor with the user supplied content, and the integrated content is transported to the recipient device for rendering thereon.
Configurations herein are based, in part, on the observation that mobile devices facilitate interpersonal messaging by allowing capture and transmission of user generated content in a portable network conversant device. A conventional cellphone, smartphone, tablet or other personal telecommunications device (mobile device) combines image capture and network transmission capability in a portable package that permits spontaneous sharing of user generated content such as pictures (i.e. “selfies” and video). Unfortunately, conventional approaches to inter-device messaging suffer from the shortcoming that fanciful or arbitrary augmentations are difficult to inject into the pictorial image content. Accompanying text may be appended, but the rendered content remains separated. While browser renderings are commonly overlaid or tiled with third party and commercial content, user generated content is typically transmitted in an unaugmented manner. At most, conventional approaches may provide graphical apps to manually modify or “dress up” pictorial captures, which may import a content item, allow edits, and export the content for subsequent inclusion—a time consuming and tedious process.
Accordingly, configurations herein substantially overcome the above-described shortcomings of conventional messaging approaches by providing selections of prequalifiers that denote a genre, topic or type of augmented content for integration with user supplied content. The prequalifier includes integration logic for applying the augmented content to the images in the user supplied content, and is based on a filter that applies different augmented content based on a context of the communication, such as location, time and user demographics. The prequalifiers denote a particular emotive content or enhancement that the sender wishes to convey. For example, a hungry user might select a prequalifier of a pizza slice. The augmented content might include a selfie of the user (sender) with an image of a slice of pizza positioned as if the user were eating it. Vendor supplied content might include a contact number and/or link for a nearby restaurant based on the geolocation of the user matching the filter of the restaurant. The same prequalifier in another location might result in vendor content of a pizza delivery contact of that location.
In further detail, the method of rendering content on a mobile device as disclosed herein includes receiving user content resulting from user gathered media on a mobile device of the user, such that the user content includes visual images, and receiving a selection of a prequalifier indicative of augmented content, in which the prequalifier is stored in a library and the augmented content is adapted for combining with the user supplied content. The mobile device filters the available augmented content based on a profile including demographics, geo-location and characteristics of the mobile device, and augments the user content with the filtered, augmented content by graphical modification to a stored visual image depicting the user content. A server and public access network such as the Internet are invoked to transmit the augmented user content to a mobile device of an intended recipient for rendering, in which the renderable, augmented user content is denoted by the selected prequalifier in an incoming message or email list.
In deployment, configurations herein may take the form of a mobile device for sharing video images, including a video capture element adapted to perform electronic recording of user generated content of visual images, and a database of prequalifiers, such that each prequalifier has a graphical icon and is indicative of augmented content configured for applicability to the recorded visual images. The device further includes a rendering screen for viewing the recorded content and selecting a prequalifier from the database, and a touch based input device for receiving the selection of the prequalifier and recorded content for augmentation. A interface to a network is employed for transmitting the augmented user content to a recipient mobile device adapted for rendering the transmitted content. Prequalifier integration logic configured on the device or an intermediate server is configured for receiving a selection of the prequalifier indicative of augmented content, filtering the augmented content and applying it to the user content.
Still other configurations include a system for capture, modification, transport and rendering of visual messages between mobile devices, defined by a plurality of mobile devices, and a server in communication with the mobile device of a sender, in which the sender mobile device is adapted to visually capture user content. A communication network couples to the server, the mobile device of the sender and a mobile device of a recipient, and a database of prequalifiers denotes each prequalifier by a graphical icon image. Each prequalifier in the database is associated with augmented content adapted to modify a visual image, a vendor subscribing to the prequalifier, and a filter indicative of applicability of the augmented content.
The foregoing and other objects, features and advantages of the invention will be apparent from the following description of particular embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention.
Configurations depicted below present example embodiments of the disclosed approach in the form of a mobile device having an application (app) for implementing the prequalifier selection and resulting augmented content, as now described with reference to
It should be emphasized that features of the claimed approach include the ability to “push” user content at the request of the sender, in conjunction with the emotive impression conveyed by the augmented content selected by the sender. A variety of prequalifiers are available at the sender device, for example a pizza slice may denote “I'm hungry.” A sports symbol, such as a baseball or football, may indicate enthusiasm about an upcoming game. Both the prequalifier and the user supplied content are based on a selection received at the sending device, in contrast to conventional approaches which remove sender control over modification to the sent image. The various prequalifiers available via the library are also available for promotional content to be added in conjunction with the emotive content. For example, a banner ad of a local establishment may accompany the pizza slice augmented image. An offer for tickets may accompany a sports based prequalifier, or the user content may place the image of the user with a background as if seated in the sports venue, in addition to an offer or banner for tickets. The actual manner of incorporating the augmented content and applying it to the user content, and further for adding in the promotional content, is determined by the filters associated with the various prequalifiers and prequalifier integration logic. The integration logic interprets and applies the filters based on external factors such as device preferences, location and browsing history, demographics, etc.
In contrast to conventional approaches, the augmented content is identified by graphical prequalifiers that denote the augmented content, such as a pizza slice, baseball or football. Conventional graphic depictions are colloquially known as “emojis,” but appear as a static replacement of a text character and carry no further significance or action. Further, these prequalifiers are offered to commercial vendors to tap into users whom the prequalifier appeals to. Conventional apps merely parse text entries of queries and messages for terms deemed to present a vendor opportunity. This so-called “adword” approach attaches only to text entries, and has no graphic appeal or content component.
For example, conventional approaches to capturing user content attach merely to the camera app, irrespective of any context. In other words, vendor brands basically just pay to be “inside” the camera when a user invokes, or clicks, on their camera. There is no context. Vendor brands are merely paying to be there when someone opens the camera. In contrast, in configurations herein, the prequalifier icon represents either an emotion that brands buy into or a prequalifying image (generic pizza slice) that the vendor selects to trigger their content for presentation to an end user. It is a “hot” lead because the user has already assented to some appealing aspect of the vendor, not a “cold” lead from merely flashing a banner upon app invocation.
Even absent any promotional content, the value of the graphic prequalifier is apparent in that users are emotionally persuaded by the prequalifier iconic image as the reason for initiating the communication. Further, the prequalifier image is the identifying designator in the receiver's message stream, in lieu of a conventional dot or application icon to denote incoming items. This gives the sender the ability to “hide” what is inside of the communication but still express the idea of what made them take that photo and share it.—in other words, the prequalifier image denotes the “meeting of the minds” between sender and receiver.
Recipient users may be located by any suitable identifier, such as email or social media labels. They need not have the corresponding app installed. Upon receipt of augmented user content, the recipient device 100-2 determines if the recipient device is operable to launch an app responsive to the augmented user content, and if not, launches a browser app responsive to the token (URL). The URL indicative of the content is invoked to render augmented user content.
In configurations herein, in contrast to conventional approaches, the sender device 100-1 is directed by the user 110 to supplement user generated media content with augmented content based on a prequalifier selected by the user 110. The augmented content is based on a genre, type or brand indicated by the prequalifier, and optionally with vendor supplied content associated with the prequalifier. In contrast to conventional approaches, the user generated content is graphically (visually) integrated with the augmented content at the sender device 100-1, rather than appended or gathered during transmission, outside the control of the user 110, discussed in further detail below.
A visual display 102 on the sender device 100-1 displays an array of available prequalifiers 120. The prequalifiers 120 define various genres, types and brands, and may be generic or sponsored by vendors. Generally, the prequalifiers are selected to convey emotive or fanciful additions to the user generated content, such as a photo or video. The prequalifiers 120 reside in a local library 140 on the device 100-1, and are cached or downloaded from a server 150. The server 150 also originates app placement on the devices 100-N for supporting a GUI (graphical user interface) and app 154 driving the messaging interface. The server 150 maintains a repository 152 for storing the full library table 162 of prequalifiers and associated information, discussed further below. Individual devices 100 are periodically updated from the repository 152.
In operation, the originating device 100-1 is invoked for capturing user generated content, such as a still or a short video. A selected prequalifier 120-1 and corresponding user generated content are sent to the recipient device 100-2 as a URL (uniform resource locator) referencing a location in the server repository 152. Upon receipt, the recipient device 100-2 receives an input directing rendering of the URL 145, and the renderable content 146 including the augmented content integrated with the user generated content is sent to the device 100-2. The resulting augmented user content 180 is viewable on the display 170′ by the app 154′.
Upon receiving the augmented user content 180, the content may persist for only a predetermined amount of time. The received augmented user content 180 may be time sensitive based on users setting an expiration timer before they send it to friend/recipient. The distinction here is that unlike conventional apps, if a click is on the content is not received in time, the content is purged. For example, if a user sets the timer to 20 seconds and the recipient does not open your phone and look at it within the 20 seconds, it may be gone.
In
The network repository 152 may further define a database including a mapping from each prequalifier to promotional content. The repository 152, in the example configuration, stores the library of prequalifiers 120 as a table 162. The table includes entries 300-1 . . . 300-N (300 generally), each having a prequalifier 310, a vendor 312, a filter 314 and content 316 in respective columns. The prequalifier column 310 indicates the rendered prequalifier 120 selectable on the device 100-1, and may have more than one entry if multiple vendors subscribe to it. The vendor column 312 indicates the subscribing vendor. If no vendor has subscribed, the prequalifier 310 is indicative of only emotive content. The filter column 314 identifies the filter associated with the prequalifier for the vendor, and includes attributes such as geolocation, timing and demographics. Vendors may decide to focus their promotional content to particular regions, at particular times, or for certain demographics, such as age or gender, depending on the customer base of the vendor. For example, pizza content may be applied only during afternoon or evening hours, or concert tickets that are directed only to teens and young adults. The content column 316 indicates the augmented content to apply, and includes either the vendor promotional content or simply emotive content if no vendor has subscribed. The content 316 may be stored by reference to graphical features, rather than as a table; storage depictions are logically shown.
The prequalification integration logic 190 determines, based on the entries 300 for a particular prequalifier 120, which content to apply based on the filters. For example, a baseball prequalifier, corresponding to filter 314-2 from entry 300-2, may result in augmented user content 180-1 of user image with a cap and jersey having insignia 181 for “Yankees” ® or “Red Sox”® depending on whether the mobile device 100-1 is in New York or Boston. Similarly, a pizza slice prequalifier 120, corresponding to filters 314-3 and 314-4 may result in either a user image with a pizza slice imposed as if the picture subject were eating it (content 180-2), or with a banner from a local pizza establishment, shown as augmented user content 180-3.
Implementation of the filters for determining the augmented content may be done in any suitable manner. Depending on the number of prequalifiers, the filters may be stored or cached on a local database (library 140) on the mobile device, in which the local database is periodically refreshed. Multiple filters may exist for each prequalifier, depending on the vendor distribution, as the filter indicative of the promotional content corresponding to the filter.
Upon application launch, the mobile device 100-1 receives user content 165 resulting from user gathered media on the mobile device 100-1 of the user such that the user content includes visual images (stills or video), as shown at step 402. The user also selects a prequalifier 120 indicative of augmented content, as shown at step 403, such that the prequalifier is stored in a library 140 and the augmented content is adapted for combining with the user supplied content. The mobile device 100-1 receives the selection and now has both a prequalifier and user content.
Prequalifier integration logic 190 filters the augmented content based on a profile including demographics, geo-location and characteristics of the mobile device, as depicted at step 404. In particular configurations, filtering the augmented content further includes mapping fee for services providers with the selected prequalifier, as shown at step 405. The prequalifier integration logic 190 identifies which augmented content to apply based on the filters. This includes a check for determining, based on the selected prequalifier, if a mapping exists from the prequalifier to the promotional content of a promotional vendor, as depicted at step 406.
If, at step 406, there is at least one entry for promotional content, that is, at least one vendor has subscribed to the prequalifier, then the prequalifier integration logic 190 determines which filter applies, as shown at step 407. After determining if the mapping to promotional content exists, for each prequalifier entry, the prequalifier integration logic 190 determines, based on the corresponding filter, whether to apply the mapped promotional content by comparison of attributes of the filter to a location and browsing history stored on the mobile device 100 containing the user supplied content 165, as shown at step 408. This includes mapping the selected prequalifier to a set of entries in the local DB, in which the mapped entry indicative of the augmented content, a vendor, and a filter for selectively applying the augmented content, as disclosed at step 409. In other words, whichever filter 314 has attributes that most closely aligns with the device denote the augmented contact to integrate. As indicated above, the augmented content generally includes promotional content based on a fee for services arrangement with the promotional vendor subscribing or contracting for the prequalifier 120, as depicted at step 410. At step 411, the prequalifier integration logic 190 includes selection logic that determines, from among the mapped set of entries 300, which of the filters is a match with the selected prequalifier based on the selection logic.
The selected augmented content 316 is then integrated, based on the prequalifier integration logic 190, the content from the mapped entry 300 with the user supplied content to generate integrated content for transport and rendering on the recipient device 100-2, as disclosed at step 412. Otherwise, if the check at step 406 indicates that no promotional content is associated with the prequalifier, then the user content 165 is integrated with the augmented content 167, as depicted at step 413. In either case, the prequalifier integration logic 190 overlays the augmented content on the user supplied content to generate augmented user content 180 with an emotive component corresponding to the prequalifier 120.
The augmented user content may be transported and rendered via the recipient mobile device 100-2 by any suitable manner. In a particular configuration, the server 150 stores the augmented user content 146 in the network repository 152 accessible to the mobile device 100-1 and a device 100-2 of the intended recipient, as shown at step 414. The initiating (sending) mobile device 100-1 sends the augmented user content 146 to the server 150. The server 150 generates a token, such as a URL (Uniform Resource Locator) defining the location of the augmented user content on the repository 152, as shown at step 415. The network 130 is used for transmitting the generated token (URL) and an icon depicting the selected prequalifier to the recipient device 100-2, as depicted at step 416. In response to receiving a selection to open the icon, the recipient mobile device 100-2 maps the token (URL) to the network repository 152 for retrieving the augmented user content, as shown at step 417. The mobile device 100-2 retrieves the augmented user content 145 based on the mapped token for rendering on the recipient device. The augmented user content 145 visually depicts the user content with the augmented content graphically applied in a meaningful format applicable to both the emotive value and commercial value intended to be conveyed by the augmented content. The resulting augmented user content 180 is then rendered on the recipient device 100-2.
Those skilled in the art should readily appreciate that the programs and methods defined herein are deliverable to a user processing and rendering device in many forms, including but not limited to a) information permanently stored on non-writeable storage media such as ROM devices, b) information alterably stored on writeable non-transitory storage media such as floppy disks, magnetic tapes, CDs, RAM devices, and other magnetic and optical media, or c) information conveyed to a computer through communication media, as in an electronic network such as the Internet or telephone modem lines. The operations and methods may be implemented in a software executable object or as a set of encoded instructions for execution by a processor responsive to the instructions. Alternatively, the operations and methods disclosed herein may be embodied in whole or in part using hardware components, such as Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), state machines, controllers or other hardware components or devices, or a combination of hardware, software, and firmware components.
While the system and methods defined herein have been particularly shown and described with references to embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.
