MEDIA SHARING AND COMMUNICATION SYSTEM

Abstract

A system for recognizing and purchasing items, including smart glasses having a user system integrated therein and having a user interface for displaying items for purchase on the smart glasses, the user system including software that recognizes and tags items available to purchase that a user views through the smart glasses, wherein the user can select an item for purchase with a one-click purchase function, the user system storing user payment and address information on non-transitory computer readable media. A method of shopping with smart glasses, by a user viewing an item with smart glasses, the smart glasses identifying the item for purchase, the user selecting the item for purchase, and the user purchasing the item with a one-click purchase function.

Description

BACKGROUND OF THE INVENTION

1. Technical Field

The present invention relates to generally to media sharing and communication systems and methods of providing the same.

2. Background Art

Individuals having common bonds, both men and women, congregate together to watch events such as sports, theater, or otherwise. In one particular aspect, it is common for individuals to watch television programming including movies, sports, politics, or otherwise. This may occur in a public setting, such as bars, or in a private setting, such as one's home. During these programming events, individuals engage in discussions, exchange of ideas or beliefs, cheering or even badgering one another.

With the expansion in relationships between individuals, it is not always possible for individuals to participate in viewing events or programming together. This is particularly the case after individuals separate over time, such as after military service, college, or otherwise. However, recently it has become more common for individuals to maintain long distance relationships with one another. To this extent, various internet service providers have offered networking and communication systems between individuals. They provide the ability to send public and private messages to others in their networking group. They also provide the ability to share profiles and preferences with one another so as to exchange information. Examples of such networking systems include FACEBOOK®, LINKEDIN®, TWITTER®, or otherwise.

However, while these and other networking means have provided some means for individuals to maintain contact, they do not effectively replace the ability for individuals to interact with one another, particularly when it comes to events and more particularly with television programming.

In view of the foregoing, there is a need for systems and methods to allow individuals to continue to enjoy events and programming together, without having to be at the same location. This allows for expanded networking in different aspects than before.

SUMMARY OF THE INVENTION

The present invention provides for a system for recognizing and purchasing items, including smart glasses having a user system integrated therein and having a user interface for displaying items for purchase on the smart glasses, the user system including software that recognizes and tags items available to purchase that a user views through the smart glasses, wherein the user can select an item for purchase with a one-click purchase function, the user system storing user payment and address information on non-transitory computer readable media.

The present invention provides for a method of shopping with smart glasses, by a user viewing an item with smart glasses, the smart glasses identifying the item for purchase, the user selecting the item for purchase, and the user purchasing the item with a one-click purchase function.

DESCRIPTION OF THE DRAWINGS

Other advantages of the present invention are readily appreciated as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings wherein:

FIG. 1 illustrate a schematic view of a media sharing and communication system according to the teachings of the present invention;

FIG. 2 illustrates a schematic view of another media sharing and communication system according to the teachings of the present invention;

FIG. 3 illustrates a schematic view of another media sharing and communication system according to the teachings of the present invention;

FIG. 4 illustrates a schematic view of another media sharing and communication system according to the teachings of the present invention;

FIG. 5 illustrates a screen-shot of an exemplary user interface according to the teachings of the present invention;

FIG. 6 is a diagram of the system architecture; and

FIGS. 7A-71 show screenshots of product recognition within the store section, FIG. 7A shows an outfit, FIG. 7B shows recognition of pieces of an outfit,

FIG. 7C shows a coat, FIG. 7D shows a bag, FIG. 7E shows a shoe, FIG. 7F shows a shoe, FIG. 7G shows products found in the image of FIG. 7H, and FIG. 7I shows suggested products.

DETAILED DESCRIPTION OF THE INVENTION

The present invention generally provides systems and methods for sharing and exchanging media between individuals with a media sharing and communication system 10, shown in the Figures. The exchange of media can be based on known interests of others.

“Individual” as defined herein, refers to an individual user of media, and not a media content provider or company.

“Media” as used herein, refers preferably to a short portion of media, or a clip i.e. less than a whole video, movie, television show, song, commercial, etc. However, full portions of media can also be shared. Also, screenshots of media can be shared. The portion of media can be any length of time, such as 5 seconds, 10 seconds, 25 seconds, 1 minute, 2 minutes, 5 minutes, or other lengths. Some media are already divided into blocks defining particular scenes, such as in 10 second blocks or other lengths. The preset blocks of media can also be shared, and do not necessarily need to be recorded to be shared. The media can be live broadcasts or prerecorded content.

The media can also be an online game, and users can record portions of the game they are playing, allowing other users to see highlights, records, achievements, or in general plays they have made. The online game can be played on systems such as Xbox, PlayStation, Nintendo DS, or other web-based games through the Internet.

Advancements through the features of the present invention provide a TUBEMAIL™, TUBESHARE™, YOUSHARE™, communication system that allows individual users, who share the same cable or satellite provider, the ability to record and share portions or full episodes of sporting events, movies, shows, or otherwise along with messages regarding the media.

Referring to FIG. 1, an exemplary embodiment of a media sharing and communication system 10 is shown. The system 10 includes a media content provider 12 configured to provide media content to a plurality of user systems 14 over one or more networks 16. The system 10 includes a transmitter 18 configured to transmit media, particularly media programming, to the user systems 14 over the one or more networks 16. The system 10 further includes a receiver 20 configured to receive media, or media information including identification information, from the user systems 14, over the one or more networks 16. The plurality of user systems 14 are configured to receive media, such as television programming, from the media content provider 12. In one exemplary embodiment, the user systems 14 include a user transmitter/receiver 22, in communication with the media content provider, a display screen 24 for viewing media content received by the user transmitter/receiver, and in one particular exemplary embodiment a digital recording device 26 for recording digital information received by the transmitter/receiver 18. In one particular configuration, the user transmitter/receiver 22 is further configured for transmitting data stored by the digital recording device 26.

In one exemplary mode of operation, digital media is transmitted or streamed by the media content provider 12 to the plurality of user systems 14. The media transmitted by the media content provider 12 may comprise any media transmitted by a network including programming shows, movies, sporting events, or otherwise. The transmitted media is received by the user systems 14 through the one or more networks 16. The media received by the user transmitter/receiver 22 is further transmitted to the display screen 24 for viewing. During viewing, once the individual user of the user system 14 determines they wish to share media content, the digital recording device 26 is activated to record the desired media or record information pertaining to the desired media. The media can also be stored and saved on non-transitory computer readable medium on the digital recording device 26 for sharing at a later time by the user or for the user's own personal reasons such as rewatching media or posting to their profile or social media to promote dialogues about certain scenes or products. The digital recording device 26 can also copy the media for storage for a limited time instead of recording. The individual user of the user system 14 generates a message (which can be a text message, a voice commentary message, information related to the location of the media, or combinations thereof) and the recorded media or record information pertaining to the desired media along with the message is then transmitted to another user system 14 (i.e. a second user system 14), via the network 16, through the user transmitter/receiver 22. It should be understood that text messages can include emojis. Messages can also include image files, such as memes, gifs, stickers, or other files. Dissemination of media from one user system 14 to another user system 14 may be based upon selection by an individual user of the first user system 14, based upon user profile set up by an individual user of the first or second user system 14, or otherwise. In other words, the media can be selectively distributed to individual users based on their preferences, including an indication of desired media content. Once the recorded media or media information is received by the second user system 14, the second individual user selectively reviews the message and views the media. In case the first individual user does not send a message along with the portion of media, the second individual user can initiate dialogue with the first individual user and send a message to the first individual user. For example, if the first individual user sends a clip from a TV show without a message, and the second individual user is confused as to why they received the clip, they can send a message to the first individual user to ask them why the clip was sent. The first individual user can send messages either to a second individual user alone, or to a group of individual users that the first individual user can select to share the message with. When sent to a group, this functions as a group chat.

In greater detail, with reference to FIGS. 1-4, the media content provider 12 is configured for disseminating media to a plurality of user systems 14. In one exemplary embodiment, the media content provider 12 comprises a cable television provider, satellite television provider, online movie or other media provider, a media provider through applications on a smartphone or tablet, or otherwise. The media content provider 12 provides assortment of media including audio/visual media, identification information or otherwise. The media provides one or more, or plurality of programming for the user systems 14. Examples of programming available through the media, without limitation, includes movies, network programming, sporting events, concerts, online games, or otherwise. The media disseminated to the user systems 14 may be streamed through or stored on local hard drive of the media content provider 12 or be accessible through a cloud.

The transmitter 18 of the media content provider 12 is configured to disseminate media to a plurality of user systems 14 over one or more networks 16. In one configuration, the network comprises a hardwired network, such as a cable network extending from the media content provider 12 to the user systems 14. In another configuration, the network comprises or includes a wireless network configured for broadcasting signals through radio waves or otherwise. In the latter configuration the media content provider 12 includes a satellite dish or other means for broadcasting media. It is contemplated that the media disseminated from the media content provider 12 may be streamed through the media content provider or stored on one or more digital recording device. Any user transmitter 18 or receiver 20 can include wireless communication links for receiving media and media content providers 12 can disseminate media through wireless communication links.

The receiver 20 of the media content provider is configured to receive information from the user systems 14. In one configuration, the receiver 20 records data transmitted by the user systems including media, program information, both or otherwise. Accordingly, in view of the many potential user systems 14, it is contemplated that the receiver 20 includes many data storage devices. In another configuration, the receiver 20 is further configured for transmitting the received or recorded media to another user system 14, according to a request by the originating user system 14.

In one particular exemplary embodiment, referring to FIG. 2, the receiver 20 is configured with suitable software for reviewing media transmitted by a user system. In this configuration, it is possible for the receiver 20 to review the identification information of the media transmitted by a first user system 28 and confirm that a designated second user system 30 is authorized to receive the media. In this configuration, the receiver 20 confirms that the media transmitted by the first user system 28 is viewable by the second user system 30 through the viewing package held by the second user system. For example, should the first user system 28 transmit media from a first channel the receiver 20 confirms that the second user system 30 is authorized to view media on the first channel. Should the programming subscribed by the second user system 30 include the first channel then the second user system is authorized to receive and view the media along with any communication attached therewith. Should the programming purchased by the second user system 30 not include the first channel then the second user system is notified that media could not be received due to programming configuration subscribed by the second user. Also, the first user system 28 is notified that the second user system 30 is not authorized to receive the media due to programming subscription of the second user system. The authorization of the second user system 30 can also be automatic or not needed if all users are subscribed to a particular streaming service or channel that automatically allows them access to content therein.

Referring again to FIG. 1, the user system 14, e.g. first user system 28, second user system 30 or otherwise, include the user transmitter/receiver 22, which is configured to receive media from the media content provider 12 and in one particular exemplary embodiment transmit media and/or communication to the media content provider 12 and another user system 14. In one exemplary embodiment, the user transmitter/receiver 22 is similar or includes a cable box, satellite receiver or similar devise commonly used to receive broadcasted digital programming. It should be appreciated that the transmitter/receiver 22 may comprise a single unit or several units. The user transmitter/receiver 22 can also be a suitable mechanism for receiving data within a smartphone or tablet.

The user system 14 further include display screen 24 configured to display media received by the user transmitter/receiver 22. The display screen comprises any suitable display screen including standard definition televisions, high definition televisions, monitors or otherwise. The display screen 24 is in communication with the transmitter/receiver 22 through suitable connecting cables or otherwise. The user systems 14 further includes digital recording device 26 configured to record media received by the user transmitter/receiver 22. Examples of suitable digital recording devices 26 includes DVRs or otherwise. The digital recording device 26 is in communication with the transmitter/receiver 22 through suitable connecting cables or otherwise.

Referring to FIGS. 1 and 5, the user systems 14 further include suitable software for generation of a user interface 32 that is useable with a remote keypad, mouse and/or other user interface devices (smart phones, tablets, or other portable devices). A smart phone or tablet can also be used as a remote control (to allow for easier messaging and use of emojis and general use of the user interface 32) in combination with a television or larger computer screen. In one exemplary embodiment, the suitable software for generating the user interface 32 is stored on a memory device of the user transmitter/receiver 22. In the configuration shown in FIG. 5, the user interface 32 provides means for composing messages (whether text, video, or voice) and attaching media segments, e.g. audio, video and/or identification information, to the composed message. A quick share button can be included in the user interface 32 that provides instant recording of media with options of length of time of 5 seconds, 10 seconds, 15 seconds, 30 seconds, 1 minute, 5 minutes, as well as any other desired length of time. The completed communication is then sendable to other user systems 14. An instant messaging exchange can be located across the bottom of the user interface 32. In the configuration shown, the user interface 32 includes a ‘FRIENDS’ section indicating users of other user systems 14. The user interface 32 further includes ‘NEW’, ‘REPLY’ and ‘FORWARD’ icons for creating, responding and forwarding communications, which may include media. The user interface 32 further includes ‘INBOX’ section listing communication received from other user systems 14 including ‘FROM’, communication or media ‘SUBJECT’, date ‘RECIEVED’, and file ‘SIZE’ In one exemplary embodiment, the user interface 32 includes ‘Banner Add Space’ for displaying relevant marketing or advertising to the user of the user system, which may be based upon a user profile (including age, gender, location, interests such as favorite television shows, actresses or actors, sport teams, soap operas, musician, band, celebrity commercials or otherwise), transmitted or received media and/or communication, or otherwise.

The user interface 32 can also include a store section wherein users can shop for products directly from their user system 14. The store section can be easily accessible through a shop button or icon on the user interface 32. The store section can include products that are directly advertised to the user as above, or products that may be of interest to the user based on their user profile (i.e. targeted to the user based on things that they like or are following their profile). The store section can include links to products on outside websites, such that when the user clicks on the item, they are directed to an outside website to complete the purchase. The store section can also receive meta data (or other data tagged with information) from media that the user is watching that generates links to products shown in the media so that the user can purchase the products. The media can automatically push this data to the user system 14. Items can be tagged with a software program similar to facial recognition software used by FACEBOOK®. Any item within the media can be recognized with the software program and identified as an item available for purchase (such as clothing, jewelry, furniture, décor, makeup and beauty items, toys, and other household items) and that item can be located on a website or store for purchase and the price of the item can be identified. The software program can analyze images within the media for pixel values and gradients to compare to images of items available for sale in order to correctly identify the items. It should be understood that items for purchase can be identified and purchased from both live broadcasts and prerecorded content.

For example, if the user is watching “The View,” and they like the reading glasses that a co-host is wearing, a link can be generated for those glasses that the user can click on and buy the glasses. The user can pause the media that they are viewing (whether by operating a remote control, mouse, or touchscreen), and options of items for purchase can be presented on the screen either automatically (and include an indication that the item is for sale, such as a graphic display or icon with the name of the item and its price and/or source) or when the user clicks on or moves a mouse over a certain item. Every item can be displayed for sale in the scene to the user or a single item that the user selects from the display. Users can also gift products to other users in the system or other individuals outside of the system. For example, users can gift a streaming package or digital gift cards to other users. Gift cards can be added to the other user's user profile for purchasing media content or other products that they desire. Users can also gift products (such as those advertised based on the other user's profile, or listed on a “Gift Me” section of the user's profile that is viewable to other users in which the user has liked or selected a particular item that they are interested in having purchased for them) and have them shipped to another user.

Users can also list their own products for sale in the store section to other users, as well as advertise their products to other users and upload their own advertisements or commercials. Users can store their payment (credit card/debit card/banking) information in their profile, along with their address to make transactions within the user system 14 easy and quick. If the user does not complete a transaction on an outside website, users can add items to a shopping cart within the user system 14 and check out with their payment information to have their items delivered. In general, when the user pauses the media, options can pop up on the user interface 32 for recording, sharing, purchasing, or gifting. This allows the user to easily select an option and proceed with what they want to do. The user can click on the item they want to purchase and it can be added to a shopping cart, the payment information can be attached to the user's account and they can purchase the item seamlessly without exiting the viewing platform and then the transaction can be closed. This essentially provides a one-click function for shopping. A one-click function icon can appear on the screen of the user interface 32 after an item or items are selected for purchase, which the user can toggle to seamlessly proceed with the purchase of the item.

In one example with the store section, a user is watching TV and sees a tie that George Clooney is wearing, the user can pause the screen, the option to record, share, or purchase pops up on the screen, the user can select purchase for any item that is tagged for purchase such as the tie, the item goes into their shopping cart, and having payment information attached to the user account allows the user to purchase or gift the tie that they want without exiting the viewing platform. In another example, a child is watching a DISNEY® movie and their parent hears them ask for a Princess Jasmine costume seen in the movie. The parent can pause the screen, select the costume, and purchase it without changing the channel or having to search on another market/platform.

Therefore, the present invention also provides for a shopping interface for purchasing items on media, including the user system 14 having the user interface 32 displaying items for purchase, such that when the media is paused, items for purchase pop up and are displayed on the user interface allowing said user to select an item to purchase, the user system 14 storing user payment and address information on non-transitory computer readable media. The items displayed for purchase can also include food and the details of the food ordering module described below can be included in this system.

The present invention also provides for a method of shopping on media, including the steps of a user playing media on the user interface 32 of the user system 14, the user pausing the media, displaying items for purchase, the user selecting an item, and the user purchasing the item with stored user payment and address information on non-transitory computer readable media of the user system 14. The items displayed for purchase can also include food and the details of the food ordering module described below can be included in this system.

The user interface 32 can further include a search mechanism that allows individual users to search for media or particular scenes in media as well as products. Media can be searched by users by keywords (such as any identifying information in a particular scene or moment, landmarks, actor name, director name, type of media such as commercial, sports event, movie, or tv program, genre of media (drama, comedy, news, documentary, etc.), or combinations thereof located in the file name, file description, or meta data. If a media file itself has identifying information within scenes, that can be searched. Clips or portions of media can be saved by users (such as individuals, actors, or directors) in their account and can be searchable. For example, a user can search for “Scene in Forest Gump, when Forest runs through water at the National Mall in DC.” Any clips/portions returned by the search results can then be selected and shared with other users or edited further (to select a particular scene or moment) and then shared. Actors can also narrate scenes and explain to viewers what was going on in their mind during that scene and provide the scenes as clips for users to share. Media can be searched to find items for users to make purchases (such as clothing, shoes, jewelry, electronics, or home items) that appear in media. For example, a user can search for Ann Hathaway because they like the dress she had on in the movie “The Intern” at a certain scene. The search results can provide a link to purchase or a link to purchase within the store section as above. The search mechanism allows users to find content without having to leave the platform of the user system 14.

The user interface 32 can include a video recording mechanism, wherein users can record a video of themselves and share the video with other users through the user system 14. For example, users can record themselves reenacting scenes from movies, shows, commercials, video games, etc. The video recording mechanism can use sounds from any media (background music or other sounds) to bring reenactments to life. Users can also speak along with their favorite scenes or actors for performing complete in sync voice overs. Users can also create challenges with other users to create reenactments, which promotes social use of the media sharing and communication system 10. Users can also just create a video of themselves and speak about the media that they have viewed and/or shared with other users.

The user interface 32 can include an online betting module that allows users to bet on sports events (such as NBA, NFL, NHL, MLB, NASCAR), or on online games that users play against each other. The online betting module can include an age verification mechanism according to requirements of cities, states, and/or countries. Bets can be placed before or during an event. The online betting module can be easily accessible through a button or icon on the user interface 32. It should be understood that any of the modules herein can utilize the one-click function as described for purchasing goods/services/placing bets. Therefore, with the betting module, the user can watch a game or sporting match and they can place a bet instantaneously with the one-click function. The user can also see analytical information or betting lines shown on a broadcast and they can choose to instantaneously place a bet with the one-click function. The online betting module can work in conjunction with existing betting interfaces such as FanDuel, BetMGM, and others to receive information (such as analytical information) and/or place bets. Any betting algorithm in the user system 14 can be screen based so the user can bet whether watching an event in real time or from a recording. The betting module can include a internal time limit mechanism that knows or receives information about a time limit for placing a bet so that the user cannot place a bet after an event. However, the user can make a bet on a recording before that time limit.

The user interface 32 can further include an online food ordering module that allows users to order food advertised in commercials or online ads (such as a pizza store, a fast food company, a convenience store), as well as the type of food shown in a media program such as a tv show or movie. For example, a tv show may feature the cast eating at a high end restaurant, and different high end restaurants can be displayed on the user interface as offering online ordering and optionally delivery to the user. A cooking show can feature a particular type of cuisine (such as Chinese, Mexican, Japanese, Indian, Italian, Vietnamese, French, Fusion, Southern, Middle Eastern, Korean, Spanish, Eastern European, etc.), and the user interface can display restaurants of that type of cuisine that offer online ordering and delivery. A user can click on the restaurant and order food for either pick up or delivery. The user interface 32 can interact with existing food ordering/delivery platforms such as Seamless, Grubhub, Uber Eats, Postmates, Yelp, Caviar, DoorDash, and others. The online food ordering module can also be easily accessible through a button or icon on the user interface 32. A user can also gift food and delivery to another user, and addresses of other users (contacts) can be stored in the user system 14 to easily send these items to another user. As with the store section, the online food ordering module can use a software program to identify and tag food items for purchase. Any food item within the media can be recognized with the software program and identified as an item available for purchase and that item can be located at a restaurant or delivery platform for purchase. The software program can analyze images within the media for pixel values and gradients to compare to images of food items available for sale in order to correctly identify the food items.

In one exemplary embodiment the user system 14 includes suitable software and user interface 32 for generating a user profile and attract other users or followers from social networks such as FACEBOOK®, TWITTER®, or otherwise, based upon the type of programming the user views. The user profile includes information of an individual user of the user system 14 to provide an indication of personal preference. For example, information that can be inputted into the user interface includes types of media, e.g. audio, video or identification information that a user enjoys. Other user preferences includes programming likes and dislikes including sports, movies, programming, celebrities, commercials, games, or otherwise. Other user preferences are possible. Users can also like or love any media, and this can be visible on their user profile and/or visible to other users or friends.

In greater detail, in one exemplary embodiment, the user profile provides the ability to indicate special interests. In one particular configuration, the user profile is used to generate suggested viewing. The user profile provides the ability of a user to indicate particular interests which may include a particular actor, athlete, programming type or otherwise. Based upon the user profile, the media sharing and communication system 10 generates a listing of program based upon the user programming, which may include similar interest such as indicated actors, athletes, programming type or otherwise. Traditional methods require the user to search for something and then they begin to see advertisements directed towards their search. The present invention reverses this process.

For example, should the user profile indicate a favorite baseball player and the particular baseball player is participating in an interview on one programming channel, such as a finance channel, the system 10 would indicate to the user that a player indicated in their user profile is on a particular channel providing the ability of the user to watch or record the particular programming. This concept can also be applied to actors, movie types, sports, other players, automobile manufactures or otherwise.

The user profile as visible in user interface 32 can further include tabs for trending news, sports, products, or clips of media. The user can add particular news sources, sports teams, or products they are interested in, and/or these can be generated based on information in the user profile. Users can also receive news updates based on their interests and preferences (such as finance, sports, local, etc.).

User profiles can also be tailored to a particular age group, such as for kids, with tailored advertising and suggested media suitable for a particular age group.

The communication system 10 provides socialization between users. The individual user of the user system 14 can send and receive a friend request, which must be approved by the recipient (i.e. second user system 14), in order to be added to the friend list and receive media. The communication system 10 is further conFigured to suggest friends or other users that have similar interest so that media can be sent to individuals, of a user profile friend list, that has similar interests. The communication system 10 further provides the ability to set up a notification that will notify a user when other users are online or offline. The individual user can also have an open profile option that allows anyone to follow them or send media, promoting community and meeting new people. A user can search for friends by name, username, gamer tag, telephone, address, or email that have been used in setting up a user profile.

In one particular exemplary embodiment, the user system 14 is integrated in hardware and/or software components of a cellular phone, i.e. smartphone, tablet, or smart device (such as a smart watch or smart glasses, examples include APPLE VISION PRO®, XIAOMI SMART GLASSES®, MICROSOFT HOLOLENS®, GOLDEN-1 INFINITY®) and is accessible to the user in the form of an application stored on non-transitory computer readable media or stored in a cloud. For example, the transmitter/receiver 22 comprises a transmitter/receiver 22 used in cellular phones for cellular communication. The display screen 24 comprises a screen and user interface of the cellular phone or smart device. Further, the cellular phone or smart device includes a digital recording device comprising a memory module for recording media, generating user interfaces, generating messages, combinations thereof or otherwise.

In one particular mode of operation, referring again to FIGS. 1-5, during viewing of media being disseminated from the media content provider 12, should the viewer find a particular media content of interest, the user records and initiates the user interface 32 to select other users to which to share the media content with. Optionally, the user includes a message with the recorded media, such as “check this out”, “did you see that play”, “best part of the movie”, or otherwise. The recorded media and message is sent to another user system 14, through the media content provider 12 and more specifically receiver 20. Should the recipient be authorized to receive the media and have sufficient memory, the message and media is transferred to the second user system 14. A user can also send a message to a second user about recommended programming that the second user may like.

Any commands within the user system 14 can be actuated (received and executed) through the voice of the individual users. For example, the individual user can use a voice command to rewind media, fast forward media, record media, add a message to the recorded media, and send the media and/or message to another user, as well as make purchases in the store section, use the online food ordering module (ordering or searching for food), use the betting module (placing and confirming bets), and gift items. Any of the commands can be actuated for a set amount of time determined by the user (such as by seconds (5 seconds, 10 seconds, 25 seconds) or minutes (1 minute, 5 minutes, 10 minutes)) at the time the voice command is given. For example, the individual user can command “Rewind by 10 seconds and record for 25 seconds. Send to Joe.” The individual user can command “purchase the red hat and send to Sheryl”. Voice commands can be used with the user system 14 (especially with smart glasses) in such instances as the user hearing a song on the radio and requesting to purchase the song, or related content, such as a movie, item, or concert tickets. Voice commands can be used to purchase anything that the user sees in media that they are viewing through the user system 14, especially with smart glasses.

In particular, when the message is a voice commentary, this allows the users (whether sending or receiving) to narrate clips or portions of media and to have open dialogue about particular clips of interest. This can allow the user the opportunity to act as a news anchor or sports commentator. Voice commentary allows the user to express with great detail what that media portion means to them along with why they decided to send it to a particular user. This can enhance the television viewing experience with friends and family when users are in two different households, and gives the user an opportunity to explain to the other user why they feel they should or should not like a show, actor, sports team, etc. With the voice commentary, the user can also talk over a desired portion of media, much like a sports commentator or news anchor, and narrate the portion of media.

The present invention creates excitement for the user when a user turns on their user system 14 and is notified that they have messages in their INBOX from friends and family as in FIG. 5. The present invention helps reduce channel surfing, because when a user turns on their user system 14, they have suggested media to review from their INBOX, as well as suggestions for media to view based on their likes and interests from their user profile, such as an actress they like is on a talk show at a certain time, a particular category of media (action, architecture, sports, animals, drama), or their favorite sports team is playing on a particular channel. Also, the user system 14 can allow for individual users to see what their friends are watching, and they can be notified either in their INBOX or on their display screen 24. This can promote group watching where the individual user can start watching a program along with their friend or group of friends.

Users can further send messages to other users without a media file attached with it. For example, a user can send another user a reminder that a program they like was on earlier, or simply send messages not related to media files such as greetings to another user. Users can also message each other while watching a live program, and this provides users the ability to watch a program together while being in different locations. Messages can pop up on their display screen 24 of their user system 14 or go directly to their INBOX while watching a live program.

The user system 14 includes architecture as generally shown in FIG. 6. Users at 100 use their smartphone, tablet, other mobile devices, etc. including the user system 14 integrated therein (such as with the application) and access a presentation layer 102. The presentation layer 102 is responsible for data handling and graphic management which ensures that the communications that pass through it are in the appropriate form for the recipient application. Flutter is one example of a scripting language that can be used, it is an open-source user interface software development kit created by Google. The presentation layer 102 is in electronic communication with services consumers 104. The services consumers 104 is in electronic communication with services (Python flask) 106. The services (Python flask) 106 is in electronic communication with a business layer 108, which includes workflows and components and entities. In the business layer 108, Node can be used for a backend and for REST API's which works as a handshaking mechanism between the business layer 108 and the presentation layer 102. The business layer 108 is in electronic communication with a data access layer 110, which includes data access logic and service agents. The data access layer 110 is in electronic communication with services provider 112 and data sources 114. Meta data 116 is in electronic communication with framework services 118. The framework services 118 can include operational management, authentication and security, and pre-built add-ins.

The present invention also provides for a method of sharing portions of media and watching a live program, by a first individual user recording a portion of media and recording a message (such as video, text, voice, or combinations thereof), transmitting the portion of media and message to a second individual user if the second individual user is authorized to view the portion of media, the second individual user viewing the portion of media and message, the first individual user recording a message during a live program and transmitting the message to the second individual user, and the second individual user recording a message during the live program and transmitting the message to the first individual user. This method can be performed by using the media sharing and communications system 10 described above. More particularly, the recording step is further defined as the first individual user recording a portion of media with a recording mechanism 26 in a first user system 14, the transmitting step is further defined as transmitting the portion of media and message with a first user transmitter/receiver 22 to a second user transmitter/receiver 22, and the viewing step is further defined as a second individual user viewing the portion of media and message with a second user system 14. Any notifications described above can be sent to the first individual user or second individual user, such as notifying the first individual user if the second individual user is not authorized to view the portion of media. The users can create user profiles and the user systems 14 can generate suggested programming based on the user profile. The method can further include notifying the first (or second) individual user of messages in an inbox and suggestions of programming when the first (or second) user system 14 is turned on. The users can also shop in the store section of the user system 14 or list products for sale. The users can place an online bet with the online betting module, and any bets can be placed with the one-click function. The users can order food with the online food ordering module. The first individual user can also record a video of themselves and share the video with the second individual user as described above. While watching the live programming, any users can also live stream a video of themselves to share with other users in the group watching the media on their user interfaces 32. The streaming videos can appear to the side of the media being watched or be minimized when desired.

The present invention also provides for method of sharing media by a first individual user searching for media of program information, programming shows, movies, concerts, sporting events, online games, or commercials by keywords and selecting a portion of media returned in search results, the first individual user recording a message of video, text, voice, emojis, images, or combinations thereof, transmitting the portion of media and message to a second individual user if the second individual user is authorized to view the portion of media, and the second individual user viewing the portion of media and message. The searching step is performed with the searching mechanism as described above. The first individual user can also record a video of themselves and share the video with the second individual user as described above.

The present invention also generally provides for a method of sharing portions of media, by a first individual user recording a portion of media and recording a message chosen from the group consisting of video, text, voice, and combinations thereof, transmitting the portion of media and message to a second individual user if the second individual user is authorized to view the portion of media, the second individual user viewing the portion of media and message, the first individual user recording a message and transmitting the message to the second individual user, and the second individual user recording a message and transmitting the message to the first individual user, wherein any of the steps are performed by a voice command. The first individual user can also record a video of themselves and share the video with the second individual user as described above.

When the smart device is smart glasses, the user system 14 allows the user to look at an item through the smart glasses, the item can be recognized by the user system 14 as an item to purchase, and the user can purchase that item seamlessly with the one-click purchase function. The item can be any item shown in media as described above or any item that the user encounters, such as items in a store window, items in an advertisement, food (shown in media or in a restaurant), an item on another person (such as clothing, shoes, or accessories), an item in nature (such as trees, flowers, or other plants), or any other location. The items can be merchandise related to a movie, television show, sporting event, or concert that the user is watching, and this allows companies/performers to generate revenue from those watching events. The item can also be a bet as described above with the betting module and the user system can receive analytical information about the bet. The user system 14 can be in electronic communication with a camera operatively integrated in the smart glasses such that the user system 14 can identify items to purchase with product recognition as described above. An option to purchase can pop up on the smart glasses and the user can be prompted to continue with the purchase. The user system 14 can present different pricing options for the item if it is available at different stores or websites. Any selection or interaction with items identified can be through touchpad or buttons, use of a smartphone as a remote control, speech recognition, gesture recognition, eye tracking, or a brain-computer interface as per the smart glasses' capabilities.

The user system 14 can include artificial intelligence (AI) embedded within the system extends its functionality beyond mere item recognition, possessing the capability to proffer supplementary items based on discerned user preferences. Through recurrent learning and adaptive processes, this AI mechanism adeptly aligns with the user's idiosyncratic inclinations. As the user directs their visual focus through the smart glasses towards an item of interest, the user system 14, empowered by its AI capabilities, not only identifies the subject but also offers a curated selection of related items. These recommendations encompass items that correspond with the user's tastes, enriching the shopping experience. Furthermore, the AI's learning potential is transformative. Over time, it attains an intimate understanding of the user's preferences, factoring in historical purchasing behavior, item interactions, and real-time contextual inputs. Consequently, the system becomes increasingly astute, delivering progressively pertinent suggestions as the user navigates their surroundings. In this dynamic shopping environment, possibilities are extensive. Whether the user is situated in diverse settings, such as live events, urban locales, or natural landscapes, the AI within the user system 14 can seamlessly adapt and furnish suggestions for prospective acquisitions. This degree of personalization streamlines the shopping process and transforms it into an engaging and gratifying experience, establishing a profound connection between the user and their smart glasses, thereby rendering each visual interaction a potential shopping opportunity.

The AI can be utilized for the purpose of seamlessly aligning individuals with products that suit their preferences and style. The AI proactively identifies products that align seamlessly with the user's unique criteria. Whether it is a preference for a specific style, a requirement for a particular fit, or any other personalized criterion, the system adeptly discerns and presents options.

Users are endowed with the capability to select products through a gaze or a pointing gesture, thereby expediting the shopping experience. This selection process offers a dual pathway, affording users the choice to access pricing information initially or proceed directly to adding the selected item to the cart. Additionally, users may exercise the option to immediately check out or opt for the product to be placed in the cart for later consideration. Such a system caters to the individual's preferred manner of interaction and ensures a more intuitive, personalized, and efficient approach to product discovery and acquisition.

The invention is further described in detail by reference to the following experimental examples. These examples are provided for the purpose of illustration only, and are not intended to be limiting unless otherwise specified. Thus, the invention should in no way be construed as being limited to the following examples, but rather, should be construed to encompass any and all variations which become evident as a result of the teaching provided herein.

Example 1

The following method was used to extract merchandise, clothing, etc. for product recognition from media content so that it can be searched in the open marketplace on any website. In one particular example, the product can be found in the Amazon marketplace to provide quick checkout and tracking. Example segmentation is shown in FIGS. 7A-71.

FIG. 7A shows an outfit found in media, FIG. 7B shows recognition of pieces of an outfit, FIG. 7C shows a coat, FIG. 7D shows a bag, FIG. 7E shows a shoe, and FIG. 7F shows a shoe. FIG. 7G shows products found and recognized in the media image of FIG. 7H, and FIG. 7I shows suggested products based on the image of FIG. 7H.

For example, the user system 14 allows the user to download the media (from any source such as, but not limited to, YOUTUBE®), frames of a time period of one second can be extracted using cv2library (such that a 10 second video extracts 10 frames), and the extracted frames are passed to a Mask ROCNNN model to identify products/clothes in the frames and it identifies and marks the portion of the detected items. The detected items are cropped using cv2 crop tool and based on the dimensions the data is saved on the server. The cropped items are taken and sent to a web automation tool (such as selenium webdriver), which automatically uses the cropped images and searches with Amazon StyleSnap to find related results and/or searches with Google and selects the images that have the same product tag to redirect the user to the relatable source. If Chromedriver is used as a browser and the match is found, it can be uploaded onto an S3 server and at the same time a database is updated. The user system 14 then deletes the folder created on the server because all the data is in the database itself.

Throughout this application, various publications, including United States patents, are referenced by author and year and patents by number. Full citations for the publications are listed below. The disclosures of these publications and patents in their entireties are hereby incorporated by reference into this application in order to more fully describe the state of the art to which this invention pertains.

The invention has been described in an illustrative manner, and it is to be understood that the terminology which has been used is intended to be in the nature of words of description rather than of limitation.

Obviously, many modifications and variations of the present invention are possible in light of the above teachings. It is, therefore, to be understood that within the scope of the appended claims, the invention can be practiced otherwise than as specifically described.

Claims

1. A system for recognizing and purchasing items, comprising: smart glasses including a user system integrated therein and having a user interface for displaying items for purchase on said smart glasses, said user system including software that recognizes and tags items available to purchase that a user views through said smart glasses, wherein said user can select an item for purchase with a one-click purchase function, said user system storing user payment and address information on non-transitory computer readable media.

2. The system of claim 1, wherein said item is chosen from the group consisting of an item shown in media, an item in a store window, an item in an advertisement, food, an item on a person, and an item in nature.

3. The system of claim 1, wherein said item is merchandise related to an event chosen from the group consisting of a movie, television show, sporting event, and concert.

4. The system of claim 1, wherein said user system is in electronic communication with a camera operatively integrated in said smart glasses.

5. The system of claim 1, wherein said user system presents different pricing options for said item to said user.

6. The system of claim 1, wherein said user system includes artificial intelligence (AI) that suggests related items to said item that said user has selected.

7. The system of claim 6, wherein said AI learns preferences of said user.

8. The system of claim 1, wherein the item is gifted to an individual.

9. The system of claim 1, wherein said software is further defined as software that recognizes and tags items available to purchase by analyzing images for pixel values and gradients to compare to images of items available for sale in order to correctly identify the items.

10. The system of claim 1, wherein said user system is accessible by using an application stored on non-transitory computer readable media.

11. The system of claim 1, wherein the item for purchase is a bet, and wherein said user interface receives analytical information about said bet.

12. A method of shopping with smart glasses, including the steps of: a user viewing an item with smart glasses;the smart glasses identifying the item for purchase;the user selecting the item for purchase; andthe user purchasing the item with a one-click purchase function.

13. The method of claim 12, wherein the smart glasses includes a user system integrated therein having a user interface for displaying items for purchase on the smart glasses, the user system including software that recognizes and tags items available to purchase that a user views through said smart glasses.

14. The method of claim 12, further including, after said selecting step, the step of artificial intelligence (AI) of the user system suggests additional related items to purchase.

15. The method of claim 12, further including the step of the user purchasing the selected item and the additional related items.

16. The method of claim 12, further including the step of the AI learning preferences of the user.

17. The method of claim 12, wherein the item is chosen from the group consisting of an item shown in media, an item in a store window, an item in an advertisement, food, an item on a person, and an item in nature.

18. The method of claim 12, wherein the item is merchandise related to an event chosen from the group consisting of a movie, television show, sporting event, and concert.

19. The method of claim 13, wherein the software is further defined as software that recognizes and tags items available to purchase by analyzing images for pixel values and gradients to compare to images of items available for sale in order to correctly identify the items.

20. The method of claim 12, wherein the user system is accessible by using an application stored on non-transitory computer readable media.

21. The method of claim 12, wherein the user system is in electronic communication with a camera operatively integrated in the smart glasses.

22. The method of claim 12, wherein said identifying step further includes the step of the user system presenting different pricing options for the item to the user.

23. The method of claim 12, wherein the user system stores user payment and address information on non-transitory computer readable media to provide the one-click function.

24. The method of claim 12, further including the step of a user receiving analytical information about a bet and placing a bet with the one-click purchase function.