Intelligent Keyboard

Abstract

An intelligent keyboard for mobile devices and other computer devices. This intelligent keyboard provides the user with suggestions of relevant words or phrases that can be used to start or continue a conversation on text message, email and/or various web applications. The intelligent keyboard provides conversation suggestions that are appropriate for given application contexts, categories, and conversation types. The intelligent keyboard uses user generated content from application users, usage history, profile data, dialogue data, platform generated content from the system managers/owners, content collected from various websites/integrations and natural language content generated by artificial intelligence. Content is ranked by preference, contextual suitability, and performance. Content is further tagged for application context. User behavior, user data and artificial intelligence models continuously update the system so that the relevance and performance of keyboard content is optimized.

Description

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to an intelligent keyboard that provides suggested phrases to start conversations on computing devices. Electronic communication via texting, iMessage, email, Slack, Microsoft Teams, dating applications and many other applications has become extremely common place in today’s virtual world. While word suggestions, auto-complete and auto-correction are well known in today’s mobile devices such as Apple’s iPhone, Google’s Android devices and various laptop/desktop computer application, today’s devices do not suggest entire phrases to start conversations based on the category of conversation and intent of the user. The present invention relates to intelligent keyboards for installation on mobile operating systems like Apple iOS and Google Android, or on desktop/laptop operating systems like Apple MacOS, Microsoft Windows, Linux and Unix.

SUMMARY OF THE INVENTION

The present invention is an intelligent keyboard for mobile devices. This intelligent keyboard provides the user with suggestions of relevant words or phrases that can be used to start or continue a conversation on text message, email and/or various web applications. The intelligent keyboard provides conversation suggestions that are appropriate for given application contexts, categories and conversation types. The intelligent keyboard uses user generated content from application users, usage history, profile data, dialogue data, platform generated content from the system managers/owners, content collected from various websites/integrations and natural language content generated by artificial intelligence. Content is ranked by preference, contextual suitability and performance. Content is further tagged for application context. User behavior, user data and artificial intelligence models continuously update the system so that the relevance and performance of keyboard content is optimized.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of the intelligent keyboard system.

FIG. 2 is a block diagram of the human generated content module.

FIG. 3 is a block diagram of the Artificial Intelligence Models module.

FIG. 4 is a block diagram of the integrations module.

FIG. 5 is a block diagram of the web content module.

FIG. 6 is a block diagram of the API/app servers module.

FIG. 6 is a block diagram of the matching algorithm.

FIG. 7 is a block diagram of the iOS App.

FIG. 8 is a screenshot of the intelligent keyboard.

FIG. 9 is a block diagram of the web app.

FIG. 10 is a block diagram application of the module database.

FIG. 11 is a block diagram of the artificial intelligence database.

FIG. 12 shows screenshots of the iOS app configuration screens.

FIG. 13 shows screenshots of the various states of the intelligent keyboard.

FIG. 14 shows screenshots of suggested phrases provided by the intelligent keyboard.

FIG. 15 shows a flow chart of the pro mode of the intelligent keyboard.

FIG. 16 shows a flow chart of the AI mode of the intelligent keyboard.

FIG. 17 shows a view of the complete intelligent keyboard system.

FIG. 18 shows a block diagram of the generative text module.

FIG. 19 shows a block diagram of the persona based generation module.

FIG. 20 shows examples of input generation.

FIG. 21 shows an example of screenshot OCR.

FIG. 22 shows a profile screenshot analyzed by the system.

FIG. 23 shows a block diagram of advanced neural network.

FIG. 24 shows optional inputs of advanced neural network.

FIG. 25 shows a screenshot of suggestion tagging.

FIG. 26 shows a block diagram of rephrase function.

FIG. 27 shows a screenshot of the intelligent keyboard rephrase function.

FIG. 28 shows a block diagram of seed module.

FIG. 29 shows example metadata and resulting seeds.

FIG. 30 shows screenshots of the insights functions.

FIG. 31 shows the double dial interface.

FIG. 32 shows the generative image function.

DESCRIPTION OF THE PREFERRED EMBODIMENT

The following detailed description refers to the preferred embodiment of the disclosed invention as shown in the attached figures and in the below description. This detailed description is not meant to limit the scope of the invention in any way but is intended to disclose the preferred embodiment/best mode of the invention at the time of filing this application.

FIG. 1 shows a block diagram of the complete intelligent keyboard system 1. The major components of the system include Human Generated Content 2. This block selects, ranks and stores content created by humans for the system, both platform owners and users. Integrations 4 functions to capture content from other applications and websites utilized by the user on their particular mobile device. Artificial Intelligence Models 3 provides logic and connectivity to models that have been trained using machine learning. Artificial intelligence models are defined as any function that has been trained by one or more machine learning algorithms using data. These models can be trained by third parties, by the patent holders or some combination thereof. Artificial intelligence database 100 is the stored, structured data used to create, manage, train, deploy and maintain artificial intelligence models 3. Web content 5 identifies and collects relevant information from third party websites that is utilized within the platform. The platform is connected to the internet 6. API/App Servers 7 provides application servers that control the platform and various functions as well as application programming interfaces (API) to various third party functionality. Mobile app 8 is the mobile application that is installed on the user device, in the preferred embodiment, an iOS app. However, the present invention may be used on any mobile device such as those running operating systems from Apple (iOS), Google (Android) or Microsoft, or on any other type of computing device such as those running Microsoft Windows, Apple MacOS, Linux, or any other platform well known in the art. This application controls keyboard extension 11 which is the actual intelligent keyboard on the user’s device. Web application 9 allows the platform owner to make configuration changes to the system. Lastly, database 10 stores all the keyboard content, user profiles and configurations for the platform. The intelligent keyboard disclosed in this application suggests and sends messages suggested to the user. In the preferred embodiment, messages are in the form of a complete phrase, but for purposes of this application a message is defined as any combination of one or more characters that may or may not form a word or phrase.

FIG. 2 shows a detailed block diagram of Human Generated Content 2. In platform generated content block 12, platform owner and/or operator generates and stores specific keyboard content written for the platform. This includes specific phrases that are appropriate for specific contexts such as dating applications, texting, email, slack and social media. An example of this content might include editorially driven and tested conversation starters for dating applications. Such content is developed to match a variety of situations, user content (from the context of the conversation, i.e. dating, email, text, Slack and social media) and user tones.

Phrases on the platform are also organized by Category. Categories include Favorites, Advice, Openers, Banter, Connect/Disconnect and others. Under each Category, there are several conversation types, known as Intents. These Intents include, but are not limited to, curious, ridiculous, flirty, dog, nature, challenge, basic, date at home and today. These are examples of Categories and Intents included in the preferred embodiment, but any number of additional categories or types are anticipated in the invention. Under each Category, several complete phrases are provided to start or continue specific conversations.

The keyboard is designed to be an intent-based communication assistant. The purpose of the keyboard is to assist a user who has an idea of what they want to say, i.e. an intent, but not the specific words to make the statement. In this situation, the user can tap an intent and be presented with a list of content to choose from, and messages to send. The user can then choose the content they prefer and send the message populated with the chosen content.

The message lifecycle, i.e. the cognitive steps for sending a message, is generally the same for each message. The user’s cognitive steps for each message are: (1) determine intent for the message, (2) develop specific words that express the intent, (3) type those letters/words, (4) edit and (5) send the message. The intelligent keyboard simplifies steps 2 through 5 of the process. Using the intelligent keyboard, the user can start with an intent and skip directly to sending an appropriate message

User generated content 13 includes content generated by users on the platform. The platform collects and tags content generated by all the users on the platform and utilizes ranking algorithm 14 to determine the top performing phrases across the platform. Phrase performance on the platform is determined by a number of factors, including category views, interaction frequency for each category, phrase views, phrase sends, peak usage times (by day of week and time of day), user voting on content by an up or down vote and many other factors. Top performing phrases are published across the platform so that any user can access the phrase from the keyboard as a conversation suggestion.

For purposes of this application, message data means any amount of data, no matter how large or small, that forms all or part of a message. Message data stored in human generated content 2 is stored in structured databases well known in the art. These structured databases allow easy search, location and access to message data utilized on the platform. Part or all of these databases may be stored on remote servers or on the user’s local device, depending on the configuration of the software and other factors such as frequency of access by user, and speed of data access required.

FIG. 3 shows a block diagram of Artificial Intelligence Models functionality: AI configuration 15, content tagging 16, Artificial Intelligence Database Content 101 from the Artificial Intelligence Database 100 and Artificial Intelligence Models API 17. AI configuration 15 sets the general configuration options sending content and receiving predictions from Artificial Intelligence Models. These configurations include but are not limited to: human-generated context, meta parameters for AI generated content, user profiles, processing content (both human- and Al-generated), and applying meta tags relating to the subject, tone and structure of the content. The platform owners may update these configurations from time to time to optimize the performance of the artificial intelligence algorithm(s) in the Artificial Intelligence Models 17.

The type of artificial intelligence used in this system is utilized for language tasks in natural language processing, such as classification, part-of-speech tagging and text generation. Specifically, when a set of words or a phrase is sent to the AI API, one or more Artificial Intelligence Models will return the most appropriate set of words or phrases in response to what is sent relative to the configurations set in AI configuration 15. In this way, the AI can generate sentences that, in context, mimic a normal human conversation. This AI generated content is constantly tagged, categorized and saved. The present system uses this natural language capability to generate conversation content and responses that are presented in the intelligent keyboard. The system further uses AI in content tagging 16 to tag keyboard phrases with various keywords that allow the system to present the most effective phrases for a given context on a user keyboard.

Artificial Intelligence Models API 17 provides an API connection for the platform to communicate with Artificial Intelligence Models 3. Artificial Intelligence Models API 17 receives specific configurations and content. They return generated text, classifications, tags and other content. For example, if “How are you?” is sent to the Artificial Intelligence Models API, it might respond “I am doing well, thank you.” The Artificial Intelligence Models use content to optimize such natural language responses so that they seem as close to human conversation as possible. The intelligent keyboard uses such natural language AI responses to generate phrases for the keyboard.

Generally an application programming interface (API) is queried by sending data structured in a specific format to the API. Upon receipt of such an appropriately formed API request, an API will process the request and return data as an output. Content received by the Artificial Intelligence Models API can include configuration data that is needed by Artificial Intelligence Models 3 to generate a response, including dialogue history, profile data, and other data used by the Artificial Intelligence Models 3 to generate predictions. Predictions can take the form of: 1) classifications, 2) text responses such as single words, phrases, sentences or paragraphs, or 3) vectors, tensors and other mathematical objects.

Message data stored in artificial intelligence models 3 is stored in structured databases well known in the art. These structured databases allow easy search, location and access to message data utilized on the platform. Part or all of these databases may be stored on remote servers or on the user’s local device, depending on the configuration of the software and other factors such as frequency of access by user, and speed of data access required.

FIG. 4 shows a detailed view of integrations 4. Integrations 4 assists the system in learning the user’s language style by analyzing the user’s actual use of language on their mobile device. In the preferred embodiment, the mobile device is an Apple iOS device (iPhone or iPad) but the disclosed system and method could be used on any type of mobile device, particularly those running Google’s Android mobile operating system. The system collects the user’s content from applications and integrations on their mobile phone. The system takes such content, particularly conversation style and content, and processes it to assist the system in mimicking the user’s natural language style.

Content scraping 18 includes the code and logic to collect and process content from the user’s mobile device. Content scraping 18 is designed to take collected content from various different applications and integrations, then structure and tag the content in a consistent manner so it can be utilized across the intelligent keyboard application. The logic in content scraping 18 is developed with the specific applications/integrations disclosed in this preferred embodiment but could be extended to include nearly any application or integration that is added to the intelligent keyboard product in the future.

Email integration 19 allows the system to collect conversation from the user’s email application to determine their language style. Such email applications include the native iOS mail application as well as other third-party email applications such as Gmail. Email is an excellent location to collect data about a user’s conversational style and content, so it is a primary data source for the intelligent keyboard application. While email tends to be longer form conversation, iMessage or SMS tends to show a user’s conversational style for shorter form conversation. For this purpose, iMessage/SMS integration 20 collects conversational data from the user’s Apple iMessage and/or text message accounts. This conversational data is vitally important for the intelligent keyboard application because it reveals the user’s style and content for shorter form content.

Calendar 21, maps 22, search 23 and contacts 24 collect data from the calendar app, map app, search engines and contacts applications respectively. These apps provide useful structural data to enhance the system’s understanding of the user’s conversational style and content, but also location data, search history and frequent contacts. In the preferred embodiment, the intelligent keyboard is able to use the enhanced context provided by calendar 21, maps 22, search 23 and contacts 24 to add events to a user’s preferred calendar application without leaving the intelligent keyboard.

Third-party apps 25 allows the system to collect data from specific third-party apps such as Yelp, Foursquare, Opentable, Calendly, Instagram, or Facebook to provide hyper specific content, recommendations, opportunities or offers relevant to the user. While the preferred embodiment of the disclosed invention includes integrations with these third-party apps, many other could be included and are consistent with the invention disclosed here.

Message data stored in integrations 4 is stored in structured databases well known in the art. These structured databases allow easy search, location and access to message data utilized on the platform. Part or all of these databases may be stored on remote servers or on the user’s local device, depending on the configuration of the software and other factors such as frequency of access by user, and speed of data access required.

FIG. 5 shows a detailed block diagram of web content 5. Similarly to integrations 4, the purpose of web content 5 is to collect conversational information from major websites using publicly available APIs. While integrations 4 is focused on the specific user’s conversational style and content, web content 5 focuses more broadly on general conversational content and style utilized by the general public on key websites. Similarly to integrations 4, this content is collected (scraped) from public websites, then consistently tagged and categorized so that it can be utilized in the intelligent keyboard application.

Content scraping 26 is a code block designed to capture, process and tag content collected via public API from key websites. The key function is to capture unstructured content data, then process it into a structured dataset that can be utilized to populate the intelligent keyboard with useful content for given user contexts. In the preferred embodiment, this functionality is optimized for sites like Reddit 27, Twitter 28 and Instagram 29, but also includes other web content 30 and third-party apps 31. Many websites with or without public APIs are envisioned by the present invention. Reddit, Twitter and Instagram all support public APIs that allow the system to make structured data requests of those platforms so that conversational and other data can be captured and processed for the intelligent keyboard product. Web content 5 is connected to the internet 6. As described in relation to other message data, web content 5 is stored in databases well known in the art.

FIG. 6 is a detailed block diagram of API/App Servers 7. This code functions to control the servers both for the mobile and web applications as well as provide API support for the various API requests made by the platform to public websites. iOS App/Keyboard server 32 provides server support for all the user iOS applications and extended keyboards. These server functions include sending and receiving data, storing new information in the database and perhaps most importantly distributing server process/computing across many servers on the internet. These servers also provide caching functionality so that the latest data set is stored at a variety of server locations across the internet and various geographies. This provides fast and reliable access for all users. Web app server 34 and database server 33 provide such server functionality for the web app and the database respectively. The system API server provides a cached version of API accessed content so that public APIs are not accessed too frequently. In many cases, these public APIs are not robust enough to be accessed on the order of magnitude necessary to support a mobile application.

FIG. 7 presents a block diagram of iOS app 8. The iOS app 8 user can build a specific user profile for their intelligent keyboard application in user profile 36. This includes typical information such as name, email address, phone number, photo, gender, sex, age, hobbies, interests, and education, including preferred conversational voice, tone, slang or other differentiators unique to their personal vocabular. In addition to typical identifying information in the user profile, content created by the user with particular conversational words, responses and phrases can be stored as “favorites” or “bookmarks” in their user profile. In addition to the user profile assembled by the user, the system monitors the type of information the user engages with, the user’s conversational tone and content and their specific responses in particular contexts. In this application, the term context means the computer application or software where the intelligent keyboard is deployed and the user is attempting to send a message or display content, such as email, texting/iMessage, calendar, dating applications, messaging apps such as Slack or another location where a user is using the intelligent keyboard to insert messages. As the user continues to use the intelligent keyboard, the system builds this user profile based on user behavior to improve the function and content prediction capability of the system. The system further attempts to match users to other similar users based on the similarity of their user profile. When user A has a high match rating with another similar user B, the system may serve content preferred by user A to user B and vice versa.

Activity tracking 37 monitors the activity of the user to build a stronger profile of the user. This information is used to build, improve and optimize the user profile described above. Activity tracking 37 specifically tracks the type of content engaged with by the user and in what contexts. Activity tracking 37 tracks the following interactions: which Categories and Intents are most and least used by a user, when users are most or least active during the day and week, how often a user accesses the intelligent keyboard during a period of time, engagement patterns over time including peaks and troughs throughout the year, and various internal improvements, such as the effect on user engagement of releasing new features or device notifications. This allows the system to more accurately predict the conversational phrases preferred by the user, but also to display additional equivalent and previously unused/under used, opening and response options. Thus activity tracking 37 can be utilized to build the behavior criteria utilized by the platform to suggest content. Configuration block 38 allows the user to control key features of the intelligent keyboard including keyboard activation, notifications and keyboard content including favorites, openers, banter, connect, disconnects and key questions. The intelligent keyboard configuration options are discussed in more detail in FIG. 12.

FIG. 8 shows a screenshot of keyboard extension 11. Text input window 39 is the standard text input window from Apple iOS operating system for inputting text in a message or other text input fields. While the preferred embodiment is shown in reference to iOS, text input window 39 could be any text input window from any operating system, mobile or otherwise. Categories 40 shows the main categories of intelligent text available in the platform. In this view, the categories shown are: favorites, openers, banter and connect, but the preferred embodiment anticipates many other categories that are consistent with the invention disclosed including others like disconnect and “the 36 Q’s.” These categories organize the intelligent keyboard content into high level categories that assist the user in identifying content appropriate for the conversation type in which they are engaging.

Keyboard toggle 41 allows the user to toggle between keyboard types in iOS, including the intelligent keyboard, standard keyboard and other enabled keyboards. Intelligent keyboard content 42 is a listing of the suggested content for a specific category 40. The user will tap one of these content bubbles 45 to populate the text input window 39 with words and phrases. Help button 43 provides conversational guidance from the intelligent keyboard. Back button 44 inputs the most recently viewed content into the text input window 39 in reverse chronological order.

FIG. 9 shows a block diagram of web app 9. Web app 9 is an administrative dashboard available only to the platform owners (not users) that allows editing and releasing content and setting configurations. Platform configuration 46 contains the key configurations for Artificial Intelligence Models and platform content, engagement limits, feature enabling or disabling, and notifications. Content release 47 allows the editing of existing content and creation of new content by platform owners. The block further allows a controlled “push” of new content to all the servers for delivery to platform users. Lastly database update 48 controls the orderly update of the key databases as shown in FIG. 10 based on new content, new configurations, new integrations or any new functionality that requires the update of the databases and/or database configurations.

FIG. 10 shows detail of application database 10. Live keyboard content 49 contains Al generated content, user generated content and platform generated content. Live keyboard content 49 has been ranked by the system by popularity and tagged appropriately to be fetched and served to users in particular keyboard contexts and categories. The database is available globally via the internet so that access to mobile users is fast regardless of their physical location. The contents of the live keyboard content 49 database are managed by web app 9 and by the other functions of the system. Application database 10 also stores web/scraped content 51 that’s gathered from web content 5 and integrations 4. Lastly application database 10 stores all generated Al content 52. This is content generated by Artificial Intelligence Models.

FIG. 11 shows the details of the artificial intelligence database 100. Information stored in artificial intelligence database 100 is used to create, manage, train, deploy and maintain artificial intelligence models 3. User dialogue history 102 stores user conversations from the user of the specific instance of the intelligent keyboard. Curated datasets 103 are conversations that have been created by users or come from third-party sources, both of which have been edited by a human reviewer, usually for the purpose of processing them into training datasets 104. These curated data sets 103 are examples, selected by a human reviewer, that suit particular intents or conversation types. Training datasets 104 are curated example datasets that have been prepared for usage in training/fine-tuning artificial intelligence models 3 using machine learning. These training datasets 104 may be subsets or supersets of curated datasets 103 and are assembled both by human reviewers and modified, updated or refined by the artificial intelligence models 3. Profile data 105 is information about the user or user of the intelligent keyboard as well as data collected about the people to whom users are speaking. Profile data 105 may be incorporated into training datasets 104 to train and/or fine-tune artificial intelligence models 3 using machine learning. Profile data 105 may contain data from local user profile 36 and application database 10 such as, user profile 50 or profiles of people that users have spoken, including information acquired from third-party data providers. AI Web/Scraped Content 106 in the Artificial Intelligence Database 106 is any information relevant to building, evaluating or training/fine-tuning artificial intelligence models 3 obtained from the internet, including content collected in web content model 6 as described related to FIG. 5, specifically derived from Reddit, Instagram, Twitter as well as other third party apps. Each model in artificial intelligence models 3 has information about its architecture, parameters, performance, deployment, usage history, training/fine-tuning history, version and other details stored in model metadata 107. Miscellaneous data for the maintenance, deployment, use, training/fine-tuning of artificial intelligence models 3 is contained in other AI data 108.

FIG. 12 shows screenshots of the various configuration screens of iOS app 8. Settings screen 53 allows the user to activate the intelligent keyboard, turn on/off notifications, get help and watch tutorials. Keyboard screen 54 allows the user to access categorized content such as favorites, openers, banter, connect, disconnect, “the 36 q’s” and other categorized content. Favorites screen 55 allows the user to manage and edit their favorite content for the intelligent keyboard.

FIG. 13 shows various screenshots of the actual live intelligent keyboard. Initial screen 55 shows the intelligent keyboard as it is generating keyboard content appropriate for the context, i.e. the application, text, email, etc. Category screen 56 shows the screen where the user has selected the opener category. Type screen 57 shows the “curious” Intent is ready to make a request for AI generated content from the API. Type screen 58 shows “banter” conversation type selected. Populate screen 59 shows the selected content populating the message window. Lastly favorites screen 60 shows the user’s favorite keyboard content.

The intelligent keyboard has two modes: 1) Pro mode and 2) AI mode. In Pro mode, the keyboard content is written for the platform owners by experts in platform generated content 12 and stored in application database 10. In AI mode, all keyboard content is generated by artificial intelligence models 3. FIG. 13 outlines the user flow for Pro mode and FIG. 14 shows the user flow for AI mode.

FIG. 14 shows screenshots of the intelligent keyboard application providing phrase suggestions based on various opening words. In step 79, the intelligent keyboard is in its opening state. The word “NATURE” is selected in step 80. At this point the intelligent keyboard begins generating text in the text box. Step 81 shows the fully generated text for “NATURE” plus the ability to select additional words for a new phrase. Step 82 shows the intelligent keyboard generating a phrase starting with the word “DOG.” In this view, the phrase beginning to be generated in the text box is visible. Step 83 shows the fully generated suggested phrase for “DOG” plus other word selection options.

In FIG. 15, the user is selecting Pro mode for the intelligent keyboard. The user enables intelligent keyboard in iOS or another mobile operating system in step 61. When the user is inputting text in the keyboard of their mobile device, say in a text message, email or application, they have the option of switching to the intelligent keyboard in step 62. At this step, any text already typed in the text content box on the mobile device continues to be displayed in the text content box so that it can be added to the intelligent keyboard if the user so chooses.

Once the intelligent keyboard is activated, the user chooses the keyboard mode: Pro mode or AI mode. In step 63, the user selects Pro mode. In step 71, the user could select Al mode, which is shown in detail in FIG. 14. The user selects the category of content in 64. The categories are described earlier in this document but include Favorites, Advice, Openers, Banter, Connect/Disconnect and others. The keyboard displays the content for the selected category in step 65. The content loaded is determined, in part, by content metadata related to the context (i.e. text, email, app, etc.) checked in step 69, described in more detail below. After the category is selected, the keyboard displays the selected content for that category in step 65. In the next step 66, the user has the option of tapping an intent to display further related content, which is then displayed by intent. Intents include curious, ridiculous, flirty, dog, nature, challenge, basic, date at home and today. The user has the option to tap a chosen piece of content and add it in the text box in step 67. Content is sent in step 68.

While the user is selecting content in the above steps, the intelligent keyboard is monitoring the user’s context, i.e. the location the keyboard is used, such as iMessage/SMS/text, email, dating apps, and others. The intelligent keyboard is also monitoring the keyboard content tapped, selected or sent by the user (user interaction). This information is passed to the system to optimize the content presented to the present user as well as other users of the intelligent keyboard. This first occurs at step 62 when the intelligent keyboard is enabled. At this step, all known configurations for the intelligent keyboard are loaded. These configurations are stored on the local user application 8, the servers 7 and application database 10. These configurations are updated in real time based on utilization of the intelligent keyboard by the present user and all users of the platform across the internet. Further, as a user interacts with content category step 65, intent step 66, text box step 67 and send step 68, the platform tracks this interaction and sends to ranking algorithm 14 and activity tracking 37. As this data is tracked, it is passed to database 10, web app 9 and to the system’s proprietary algorithm 74. The activity data is processed and used to further optimize the content displayed to users in specific contexts, categories and intents. The system also monitors if any of the stored metadata is changed/updated/affected in step 69. These updates to metadata are generally due to user activity such as storing a favorite or interacting with content. These changes are routed through the system elements such as the user’s local application storage 8, server 7, database 10, proprietary algorithm 74 and web application 9.

FIG. 16 shows the user selecting AI mode for the intelligent keyboard. Many of the steps are the same or overlap as with the Pro mode option and are described in detail in the discussion of FIG. 13. The user chooses AI mode in step 72. AI mode means that the artificial intelligence feature choses all the content presented to the user in the intelligent keyboard. A full discussion of artificial intelligence 3 is presented in relation to FIGS. 3 and 11 and accompanying discussion. As in Pro mode the user chooses the category in step 75. Content for the category is displayed in step 76. The user may select content at this step or select an intent in step 77. Text is copied in the text box in 78 and is sent by the user in step 69. As with Pro mode, the system monitors user behavior at each step of the process, including intent, category and tone, specifically monitoring user interactions and favorites of content. Additionally, at each stage of the process where new content is displayed for the user (category 75 and intent 77), the system sends information to artificial intelligence models 3 which generate AI content. These Al fetches are done based on system settings and data stored at server 7, database 10, artificial intelligence database 100, user application 8, web application 9 and proprietary algorithm 74.

FIG. 17 shows a system implementation of the intelligent keyboard system 1 as described in the present disclosure. User device 200 could be any suitable computer system with a keyboard capable of running the software associated with intelligent keyboard 1, but for purposes of this disclosure a mobile phone such as an iPhone running Apple’s iOS operating system or Android devices running Google’s Android operating system are discussed. System hardware for such a mobile device includes microprocessor 201. Microprocessor 201 can any low power mobile optimized microprocessor known in the art, such as those manufactured by Apple, ARM, Intel and AMD. While those are suitable examples, any microprocessor capable of processing digital instructions could be utilized. System memory and storage 202 encompasses both non-volatile memory (that doesn’t require a power to maintain memory) such as Flash memory that stores the operating system and applications as well as memory that’s accessed by the microprocessor during execution of system operations. These memories are well known in the art. Network/wireless communication module 203 connects the device to the internet, either through any wired connection to the internet or any suitable wireless connection such as WiFi or 3G/4G/5G wireless connections through mobile carriers. This module provides connection to network 209 which, in this embodiment, is the internet. GPS/location module 204 provides location data generally using the global positioning system to pinpoint the user’s location. Display/touchscreen controller 205 sends signals to the mobile device LCD or OLED (or other suitable technology) screen to render images and text on the screen. This controller further reads signals sent from the touchscreen relating to user interaction with the touchscreen. These controllers are well known in the art and any suitable one could be used, such as those in use in Apple iPhones or Google Android mobile devices. IO/battery/audio 206 controller interfaces with the mobile device battery, provides power management, input/output control for USB, Firewire, Bluetooth or other connected devices and the audio processor encodes and decodes digital audio signals so that they can be played back using analog speakers.

System software typically includes operating system 207, which in this case is generally Apple’s iOS mobile operating system or Google’s Android operating system. Any suitable operating system could be used, including Microsoft Window’s, Apple MacOS, LINUX, Unix or any other operating system known in the art. Intelligent keyboard application 208 is the local version of the software running on a user’s device. This version of the software displays the intelligent keyboard and stores the user’s preferences as discussed previously in relation to FIG. 7.

The intelligent keyboard system 1 shows the remove servers related to the functions of the intelligent keyboard. These individual modules and databases have been discussed in depth in above, but this representation shows the remote nature of the server based software modules and databases. The software modules and databases can be executed on any suitable server connected to the internet, but in the preferred embodiment, servers hosted on Amazon Web Services are utilized. The intelligent keyboard application 208 communicates through network 209 to servers that host intelligent keyboard system 1. These servers further communicate through network 209 with the various internet services discussed prior including Reddit 27, Twitter 28, Instagram 29, other suitable web content 30 and 3^rd party apps 31.

Third party user devices 211 also connect through network 209. These are other user devices that receive communications from the user of the intelligent keyboard application. While the figure indicates that third party user devices 211 are mobile phones, such devices could also be desktop or mobile computers receiving communication.

Lastly, web store/application store 210 is connected to network 209 and thus to user device 200. In the preferred embodiment, web store/application store 210 is an online store for downloadable applications or other downloadable content such as the Apple App Store or Google Play Store. While this aspect of the intention is described in relation to these existing web store/application store 210, any suitable type of online marketplace could be utilized. Here, the user could download the intelligent keyboard application 208 or paid extensions to the intelligent keyboard application 208. It is anticipated that libraries of keyboard content in particular voices could be sold in app for purchase and download through these web store/application stores 210.

FIG. 18 shows a block diagram of generative text module 300. This module takes various inputs to the intelligent keyboard and generates suggested text based on those inputs. Generative text module 300 includes data inputs from a screenshot 311 or user specification 345. Each of these data inputs may be utilized individually to generate suggested text or may be used in combination to generate suggested text. These data inputs do not require upstream data input from any of the other data inputs to function. In the improved preferred embodiment disclosed, the intelligent keyboard application utilizes data from both of these data sources, however each may be used individually in other embodiments of the invention consistent with this disclosure and associated claims.

A screenshot in this context is any image captured of the screen of a computing device, including any mobile device, smartphone, tablet computer, laptop/notebook computer and/or desktop computer. Many devices include built-in functionality to capture such an image, i.e. a screenshot. Further, many software applications exist to capture screenshots of a computing device screen. A screenshot may include many different types of data including without limitation, name, user name, profile name, emojis, date/time stamps, conversation text, images, message status, and many others. This is not an exhaustive list and any data point that may be captured in a screenshot could potentially be utilized as an input for the intelligent keyboard.

Screenshot 311 is an input screenshot from a computing device. This screenshot is passed to OCR segmentation 312. OCR segmentation 312 draws boxes around messages and other segments of text, and then recognizes the text in each such box. Segmentation classifier 313 includes an advanced neural network (discussed in FIGS. 19 and 20) and classifies each segment of text according to its purpose in the conversation. Each segment of text may have multiple classifications. For example, a segment of text may be classified as a message and it may also be classified as sent by a certain user in the conversation. If a screenshot contains images that one user sent to another user, the advanced screenshot parser identifies those images as messages and describes their content. For example, if the screenshot depicts a user named John sending a cat meme to another user, the advanced screenshot parser draws identifies the meme as a message sent by John and provides a brief description of the meme, i.e “meme of a cat says ‘oh there’s a dead mouse on your pillow? How’d that get there?’”.

User specification 345 relates to specific instructions provided by the user about the type or tone of response to be generated. App classifier 346 identifies the application utilized for the textual communication. Examples include iMessage, Facebook Messenger, Tinder, other dating apps, whatsapp, snapchat, SMS/text messaging or any other communication platform utilized on a computing device including any smartphone or tablet.

Compilation and contextualization 306 module generates input for generative AI model 307. The disclosed preferred embodiment, compilation and contextualization module uses persona-based generation which is described in detail in relation to FIG. 19.

The Compilation component is reconstruction of a conversation from a list of segments of text and information about who sent them and when. The Contextualization component describes adding instructions, prompts, and other information to tune the instructions/input to generative Al model 307 for the context of the conversation. An example of contextualization is the sentence “This conversation is taking place on a smartphone in the messaging app iMessage between Jessica and Amy” where “iMessage”, “Jessica” and “Amy” are contextual information that has been identified and added from various processes. Specifically, app classifier 346 has identified “iMessage” as the application. The name “Jessica” has been identified in a screenshot by OCR segmentation 312 and classified as a name by segmentation classifier 313. Lastly, “Amy” is identified as the name of the user in the application database as collected at signed up.

The information used to compile and contextualize an input includes one or more of the following: 1) text from a conversation, irrespective of where that text originates, such as from a screenshot analyzed by the system or directly from an application, 2) user specified inputs as to the desired suggestions such as requesting that suggestions are “witty” and/or “professional”, 3) metadata about where the conversation is taking place such the application as identified by app classifier 346, 4) profile information about any of the conversants, such as their name, age, location, demographic information, hobbies, interests, or any other relevant data points as specified in the system and well known in the art, and 5) past conversations including one or more of the conversants. This information is compiled into a list of instructions and data that are passed to generative Al model 307.

Many generative text models are probabilistic models, meaning that they predict the probability of words or phrases, or parts of words or phrases rather than the words or phrases themselves. It is then necessary to choose which words or phrases by sampling from the probability distribution. Sampling parameter algorithm 347 adjusts sampling parameters dynamically for each set of text suggestions. In the preferred embodiment, sampling parameter algorithm 347 adjusts a sampling parameter called temperature. Temperature is a term well known in the art related to adjusting the randomness of the sampling. Increased randomness of the sampling as the effect of choosing a greater variety of words, thus increasing the creativity of the produced text. The algorithm categorizes the conversation based on the length of the conversation, measured in words. There can be two or more categorizations, for example short, medium and long. Each category corresponds to a non-overlapping range of words, e.g. short is for conversations less than 40 words, medium for 40-60 words, and long for conversations with more than 60 words. A sampling method is then specified for each categorization to generate the suggestions. The optimal configuration for the sampling parameter algorithm 347 operates in the following manner with two categorizations: For long conversations (those with 64 words or more): one of the suggestions is generated with a low temperature (=> 1.0) and two of the suggestions are generated with a medium temperature (1.1). For short conversations (those with 64 words or less): one of the suggestions is generated with a low temperature (=> 1.0) and two of the suggestions are generated with high temperatures (1.3 or greater).

Suggested text 308 is generated by feeding the output of compilation and contextualization 306 to generative AI model 307 using the sampling parameters selected by the sampling parameter algorithm 347. Generative AI model 307 is typically a large language model that is based on a transformer neural network. Example generative AI models 307 are: 1) open source models that are finely-tuned on conversational data such as gpt-j, 2) commercially available models such as OpenAI’s models, including GPT-3.5 text-davinci-003, gpt-3.5-turbo and gpt-4, 3) commercially available models that have been fine-tuned on our conversational data such OpenAI’s text-davinci-003 that has been fine-tuned on application conversational data. In the preferred embodiment, generative AI model 307 includes each of the three models listed above where simultaneous requests are sent to each to generate candidate responses.

Suggestions filter 331 filters suggested words or phrases before displaying them to a user. The suggested words or phrases may be filtered on: (1) how closely they match conversation metadata, (2) whether the words or phrases contain violent, graphic, or inappropriate content, (3) the rating of the words or phrases provided by an artificial intelligence system according to the match between the words or phrases and the conversation metadata, or a rating based on the quality, appropriateness, popularity or other characteristic of the words or phrases. When suggestions are filtered on any of the listed criteria, or other criteria as determined by the system, those filtered suggested words/phrases are fed back to compilation and contextualization module 306. This feedback loop ensures that the generative AI model is provided information that enables training of the model for improved suggested words and phrases. Suggested text 308 may be presented directly to the user or tagged with further information.

Tagged suggested text is suggested words or phrases that are tagged with information about the suggested text. One or more of these tags may be displayed as plain text adjacent to the suggestion. For example, a suggestion that reads “You’re doing great!” may have a tag of “Encouraging” and “Positive” next to the phrase in a manner which enables the user to easily characterize each word or phrase. The intent of this design is to enable a user of an intelligent keyboard to quickly identify which words or phrases are likely to fit their needs without having to read the full text of the suggestions. Any tag representing any information related to a suggested word or phrase may be included in the present system.

FIG. 19 shows the data inputs and functional components of persona-based generation method used in the compilation and contextualization 306 module of the present invention. Persona based generation module utilizes the following data inputs: conversation metadata data 324, conversational analysis 325, characteristics requested 326, user information 327, conversation history 328, past conversations 329 and prompts/instructions 330. These inputs are: (1) conversation metadata 324 which includes the app where the conversation takes place and the nature of the relationship between the two conversants, such as friends, business associates, romantic acquaintances, etc., and are the most important for optimal operational textual history of conversation, (2) conversational analysis 325 meaning the tone of the conversation and optimal tone of any suggestions are the most important for optimal operation, (3) characteristics requested 326 specifically characteristics of the suggestions requested by the user, such as making the conversation witty, flirty, funny, professional, etc., (4) user information 327 which includes the demographic information of the users (e.g. “millennial” or “GenZ”) and is the most important information for optimal operation, (5) conversation history 328 which is prior conversations which can be gathered through: (a) automatic retrieval from the smartphone, (b) sent by the user, or (c) parsed from a screenshot of the conversation, (6) past conversations 329 defined as a history of one or more communications sent by the people in the conversation, and (6) prompts and instructions 330 to the artificial intelligence system to generate suggested words or phrases, where details of the instructions are modified based on any of the other inputs, or according to instructions from one or more of the respondents (e.g. “Make it sound like genZ”).

Input compiler 331 takes the requested data inputs and complies them into a format appropriate for passing to the AI model such that the model will output the optimal suggestions.

Configuration data 324 may include conversation metadata which comprises conversant information, conversation type, conversation information, conversation history and screenshot information. Conversation metadata is any information about a conversation on a smartphone or other computing device that is not the text of the conversation or a screenshot of the conversation. This conversation metadata is utilized to assist in generating suggested words or phrases. Conversant information includes information about the people who are communicating with each other, including their name(s), location(s), a description of their relationship, demographic profiles, their communication history, an analysis of their previous communication, and relevant facts about one or more of the person(s) in the conversation. Conversation type includes information about the desired suggested words or phrases generated by an intelligent keyboard, including the tone, intent, relevant factual information or other details that characterize the desired suggested words or phrases. Conversation information includes information about the conversation contained in the smartphone, tablet or other computing device, including the application in which the conversation took place (if applicable), send and receipt times for individual messages in a conversation, send and receipt status for messages in a conversation, including user behavior before, during, or after the conversation. Conversation history data includes past conversations that one or more of the people in the conversation have had, either with each other or with other people. Lastly, screenshot information includes data related to the screenshots sent by user as part of the conversation. Specific information includes whether the screenshot is cropped, what app the screenshot depicts, and the theme of the app depicted in the screenshot (e.g. “dark mode”, “light mode” or “custom”).

In many mobile applications, a user may create a profile including information such as name/screenname, contact information, employment details, birthdate/age, photographs/avatars, hobbies/interests, places they visit, opening questions and other personal information. The intelligent keyboard of the present invention will analyze a screenshot taken by the user of a potential conversation partner’s profile page and make suggestions on how the user can begin a conversation with that person.

FIG. 20 shows example input generation for persona based generation module 305. The first column, labeled “Elements” shows input data related to conversation metadata, application, conversational analysis, application, conversational tone, characteristics requested by user, demographic profile, relationship and conversation history. Column two - titled “Compiled Input” - shows the input data in compiled form, in this case conversational history and instructions to the AI model for what type of suggested words or phrases are desired. The final/third column shows suggested words or phrases as output by the AI model based on the input persona data and compiled instructions.

FIG. 21 is a table showing how conversation data is mapped from a screenshot. Under the column screenshot, an example screenshot is included with various components highlighted. The output is shown in the second column. Objects include time, images, name, emoji, status, message content, etc. Each of these objects are then classified by the system as such.

Profile information can be also gathered from a screenshot using the OCR segmentation module 312 and segment classifier 313. uses the same technology and process as advanced screenshot parsing 302 to collect profile information from a user profile screenshot. In this case, the screenshot 311 is an input screenshot of a user profile from a computing device. This screenshot is passed to OCR segmentation 312. OCR segmentation 312 draws boxes around relevant profile information and then recognizes the text in each such box. Segmentation classifier 313 includes an advanced neural network and classifies each segment of text according to its purpose in the profile. Relevant profile data that may be collected includes: name, age, hobbies, education, workplace, location/residence, interests, hobbies, profile description, tags, pets, distances and last online. Additional data points may be available in other profiles not included in this list.

Profile data may also be collected by means other than screenshot, including direct collection from a user profile, API or other method of gathering profile data. This profile data may include any of the data points listed above or any other information included in a user profile to be utilized in the intelligent keyboard system.

FIG. 22 shows a profile screenshot as analyzed by the system. The first column shows a screenshot provided by a user. In this example, the screenshot is provided from the Tinder dating platform. The second column shows the profile data collected by the screenshot parser that is then used as instructions to the Artificial Intelligence System. The third column shows suggested responses as provided by the AI model. These responses are tailored to the information shown on the user profile captured in the provided screenshot from column one.

FIG. 23 shows a base version of block diagram of advanced neural network utilized in segment classifier 313. Advanced neural network classifies a segment of text from a screenshot using the following: (1) a cropped area of the screenshot around the text, (2) the text itself, as recognized by OCR, (3) the coordinates of a box wherein the text is located, (4) the height and width of the whole screenshot, The minimum and maximum for the coordinates of the box around the text are calculated in the standard way to most Python-based imaging libraries in the art, notably the bottom-most coordinate is the maximum y value and the top-most coordinate is the minimum y value.

FIG. 24 shows optional parameters used in advanced neural network of segment classifier 313.. These optional parameters are: (1) information about the screenshot such as the app it was taken in, (2) the platform, (3) the “theme” (light mode, dark mode, or a custom background), and (4) the whole screenshot/whether the screenshot as a whole has been cropped.

FIG. 25 shows details of the screenshot suggestion tagging function of the present intelligent keyboard disclosed. Suggested phrases 345 are shown with tags 346 displayed below the suggested text. This is so the user may evaluate the tone or other characteristics of the suggested phrases 345.

FIG. 26 shows a block diagram of the rephrase 332 function of the present intelligent keyboard. Rephrase 332 enables a user to ask the system to rephrase suggested words or phrases, i.e. provide new suggested words or phrases. These words or phrases can be: (1) content that the user has selected, (2) content that the user has entered into an input field in the keyboard or a mobile application, (3) suggested words or phrases generated by an intelligent keyboard app and suggested to the user. If the user does not like any of these suggestions, an intelligent keyboard has an option to try again and displays different rephrased words or text.

Further, the intelligent keyboard may utilize conversation metadata when rephrasing words or phrases. A user may request tone, subject matter, or other details desired for the rephrased words or phrases. For example, a user can select text in their text box and choose “Witty” from a dropdown menu; the intelligent keyboard rephrases the selected text in a witty way.

Rephrase module 332 is comprised of conversation metadata 324, text 334 (text to be rephrased) and requested characteristics 335. Conversation metadata is as previously described and includes any information about a conversation on a smartphone or other computing device that is not the text of the conversation or a screenshot of the conversation, including conversant information, conversation type, conversation information, conversation history and screenshot information. Conversant information includes information about the people who are communicating with each other, including their name(s), location(s), a description of their relationship, demographic profiles, their communication history, an analysis of their previous communication, and relevant facts about one or more of the person(s) in the conversation. Text 334 is the text to be rephrased as provided by the user. Required characteristics 335 are the parameters specified for tone, content or other required characteristics as provided by the user. This information is provided compilation and contextualization 306 for passing to generative AI model 307 to create new rephrased text suggestions.

FIG. 27 shows a screenshot of the rephrase function of the intelligent keyboard application. Rephrase button 347 invokes the rephrase function as described in relation to FIG. 31. Tone button 348 passes instructions to the intelligent keyboard related to the tone requested for the rephrase of suggested words and/or phrases.

Seeds refer to compressed information that is provided to a large language model in order to improve the quality of outputs or to increase the speed at which outputs are provided. The intelligent keyboard application may compress conversation metadata into one or more seeds. The intelligent keyboard application then may use these seeds when generating suggested or rephrased words or phrases by providing these seeds to an artificial intelligence system.

FIG. 28 shows a block diagram of the seed module 336 of the present intelligent keyboard application. Seed module 336 is comprised of compressed data 337 which is created by a large language model using a prompt to compress the message. The following prompt is given to the large language model, with “{model name}” replaced with the model’s actual name (e.g. “GPT-4”) and “{text to compress}” replaced with the text to compress (e.g. “Profile Information: Jessica, Age: 23, Location: Ithaca, New York, Hobbies: Ice Skating \n\nConversation History: \n\nJohn: Hey, how are you?\n\nJessica: Great! How’s life?”):

“Your task is to compress the following text such that {model name} can reconstruct it as close as possible to the original. It does not need to be human readable. Use language mixing, abbreviations, symbols (unicode and emojis) to aggressively compress it, while still keeping ALL the information to fully reconstruct it.\n\n ##Text to compress:\n\n {text to compress}”.

Conversation history 338 includes conversation history from the user and also the user with the specific other party to the communication. Prompts and instructions 339 are comprised of: 1) a task description, which describes the task and the people in it, 2) task instructions, which provides explicit instructions on what to generate (e.g. “Write a response...”), 3) response guidance that provides information on what is a good or bad response, including (a) characterization of what a suggestion should be (e.g. “the response should be thoughtful”, (b) specific requirements that a suggestion should have (e.g. “include an emoji”), (c) optional requirements that a suggestion may have (e.g. “feel free to use slang and emojis”), and (d) things that should be omitted from a response (e.g. “Do not use a formal tone.”, “Do not use exclamation points.”), and (4) ‘start response’ prompt. For models such as gpt-4 and davinci-text, it is best to phrase the task description (1) in the second person (use “you”). The following are optimal for prompts and instructions for a dating context. Each element is modified by “Further Specifications”. The “Further Specifications” are the optimal list, but it is not exhaustive and can be extended:

Element	Base Text	Further Specification
Task Description	“You are full of {characterization}. The following is a conversation in which you need to respond to the other conversant using {characterization}.”	{characterization} is replaced with one of the following:
• empathy
• wit
• curiosity
• flirtation
• skepticism
• anger
• sarcasm
Task Instructions	“Write a {characterization} message that {objective}.”	{characterization} is replaced with one of the following:
• empathic
• witty
• curious
• flirty
• skeptical
• angry
• sarcastic
{objective} is replaced with one of the following:
• “agrees with the conversant’s point of view”
• “asks the conversant out on a date”
• “Is a sweet opening line about your conversant”
• “agrees with your
		conversant while expressing understanding”
• “neither agrees nor disagrees agrees with the conversant’s point of view”
• “contains a question in response to your conversant”
• “diffuses the situation in a kind way”
• “disagree with the conversant’s opinion”
Response Guidance	“You cannot use exclamation marks or “!” in the response.”	{name} is the name of the conversant that the user is talking to.
“Your response must use the same writing style and punctuation as you did in the conversation.”
“Keep the response short and succinct.”
“You cannot use “You:” or “Keys” or “conversant” in the response.”
“The person’s name is {name}. You can include that name in the response.”
Start Response	“Your response:”

FIG. 29 shows example conversation metadata and resulting seeds. Column one “Conversation Metadata” shows the input metadata, including the application, tone and past conversation. Column two “Compressed Information” shows the actual compressed seed produced by seed module 336. Lastly, the third column “Example Usage” shows how a seed could be used to instruct the system to rephrase specific text with a specific style and tone.

FIG. 30 shows screenshots of the key insights function of the present intelligent keyboard. The intelligent keyboard provides analysis of a conversation to a user so they can understand important aspects of the conversation, such as tone, mood and subject matter. Insights enable a user to write better messages or to evaluate suggested and rephrased words and phrases. Key insights detail page 340 shows information about conversations 349. Information provided includes conversation health, response urgency and narrative about each conversation. Key insights summary page 341 shows a conversational rating, analysis of messages sent and of messages sent by tone. The key insights metrics discussed above are those utilized in the preferred embodiment, but any data point could be reported by the system.

FIG. 31 shows double dial interface 342 for interacting with the intelligent keyboard and split button interface 343. Split button interface 343 enables a user to intuitively interact and choose options for obtaining suggestions.

FIG. 32 shows a generative image function for the intelligent keyboard that enables a user to request images to be sent as messages in the conversation. The user of the intelligent keyboard can do this by sending text describing the image that is to be generated and providing other information about the desired image, such as the style, content and size. The intelligent keyboard uses this information along with conversational metadata to display one or more images that the user may insert as a message into the conversation. If the user does not like any of these images, an intelligent keyboard has an option to try again and displays different images.

Although the present invention has been described in relation to the above disclosed preferred embodiment, many modifications in design, implementation, systems and execution are possible while still maintaining the novel features and advantages of the invention. The preferred embodiment is not meant to limit the scope of the patent in any way, and it should be given the broadest possible interpretation consistent with the language of the disclosure on the whole.

Claims

1. An intelligent keyboard for generating suggested messages through a computing device comprising: a user specification module, where a user of the intelligent keyboard may input suggested text requirements for generated suggested text, and a compilation and contextualization module, where the compilation and contextualization module compiles the suggested text requirements and a set of text generation data inputs to form an instruction for text to be generated by a generative Al model wherein the generative Al model accepts the instruction and outputs a set of suggested text and the intelligent keyboard presents the set of suggested text to the user.

2. The intelligent keyboard of claim 1 further comprising a screenshot analysis module, where the screenshot analysis module detects and classifies text contained within the screenshot to generate a set of screenshot text and where the compilation and contextualization further compiles the screenshot text with the suggested text requirements and the set of text generation data inputs to form an instruction for text to be generated by the generative Al model.

3. The intelligent keyboard of claim 2 where the screenshot analysis module further comprises an OCR segmentation module, where the OCR segmentation module outputs detected text from the screenshot, and a segment classifier module that classifies the detected text by purpose of the detected text.

4. The intelligent keyboard of claim 3 where the segment classifier module further comprises an advanced neural network to classify the detected text.

5. The intelligent keyboard of claim 1 where one or more of the set of text generation data inputs are chosen from the set of conversation metadata, conversational analysis, characteristics requested, user information, conversation history, past conversations, prompts and instructions.

6. The intelligent keyboard of claim 1 where a sampling parameter algorithm adjusts an input sampling parameter for the generative Al model to adjust the set of suggested text.

7. The intelligent keyboard of claim 1 where the set of suggested text is filtered by a filtering criteria before being presented to the user.

8. The intelligent keyboard of claim 7 where one or more of the filtering criteria are selected from the set of conversation metadata, violent content, graphic content, inappropriate content, and quality.

9. The intelligent keyboard of claim 1 where the set of suggested text is tagged by a set of tagging criteria.

10. The intelligent keyboard of claim 1 where the intelligent keyboard generates a set of rephrased suggested text based on one or more criteria selected from the set of conversation metadata, the set of suggested text and a set of requested characteristics.

11. The intelligent keyboard of claim 1 where the instruction for text to be generated is compressed into shorter seed instruction.

12. The intelligent keyboard of claim 1 where the generative Al model is selected from the set comprising gpt-j, OpenAl GPT-3.5 text-davinci-003, OpenAl gpt-3.5-turbo, DialoGPT, BERT, ROBERTA, T5, OPT, Switch, LLamA, h2oGPT, and OpenAl gpt-4.

13. The intelligent keyboard of claim 1 further comprising: a suggested message window where the set of suggested text is displayed, where the user may select text to be sent from the set of suggested text, and a message insertion location to insert the text to be sent.

14. A system for an intelligent keyboard for generating suggested messages comprising: a computing device comprising a microprocessor, a memory, a display controller, a means for communication with a network, an operating system and an intelligent keyboard application, the intelligent keyboard application for use by a user to generating suggested messages to be sent by the computer system, the intelligent keyboard application comprising: a user specification module, where a user of the intelligent keyboard may input suggested text requirements for generated suggested text,a compilation and contextualization module, where the compilation and contextualization module compiles the suggested text requirements and a set of text generation data inputs to form an instruction for text to be generated by a generative Al model wherein the generative Al model accepts the instruction and outputs a set of suggested text and the intelligent keyboard presents the set of suggested text to the user, andwherein the network is configured for transmitting data between computer systems.

15. The intelligent keyboard of claim 14 further comprising a screenshot analysis module, where the screenshot analysis module detects and classifies text contained within the screenshot to generate a set of screenshot text and where the compilation and contextualization further compiles the screenshot text with the suggested text requirements and the set of text generation data inputs to form an instruction for text to be generated by the generative Al model.

16. The intelligent keyboard of claim 15 where the screenshot analysis module further comprises an OCR segmentation module, where the OCR segmentation module outputs detected text from the screenshot, and a segment classifier module that classifies the detected text by purpose of the detected text.

17. The intelligent keyboard of claim 16 where the segment classifier module further comprises an advanced neural network to classify the detected text.

18. The intelligent keyboard of claim 14 where one or more of the set of text generation data inputs are chosen from the set of conversation metadata, conversational analysis, characteristics requested, user information, conversation history, past conversations, prompts and instructions.

19. The intelligent keyboard of claim 14 where a sampling parameter algorithm adjusts an input sampling parameter for the generative Al model to adjust the set of suggested text.

20. The intelligent keyboard of claim 14 where the set of suggested text is filtered by a filtering criteria before being presented to the user.

21. The intelligent keyboard of claim 20 where one or more of the filtering criteria are selected from the set of conversation metadata, violent content, graphic content, inappropriate content, or quality.

22. The intelligent keyboard of claim 14 where the set of suggested text is tagged by a set of tagging criteria.

23. The intelligent keyboard of claim 14 where the intelligent keyboard generates a set of rephrased suggested text based on conversation metadata, the set of suggested text and a set of requested characteristics.

24. The intelligent keyboard of claim 14 where the instruction for text to be generated is compressed into shorter seed instruction.

25. The intelligent keyboard of claim 14 where the generative Al model is selected from the set comprising gpt-j, OpenAl GPT-3.5 text-davinci-003, OpenAl gpt-3.5-turbo, DialoGPT, BERT, ROBERTA, T5, OPT, Switch, LLamA, h2oGPT, and OpenAl gpt-4.

26. The intelligent keyboard of claim 14 further comprising: a suggested message window where the set of suggested text is displayed, wherein the user may select text to be sent from the set of suggested text, and a message insertion location to insert the text to be sent.

27. A method of generating suggested messages for sending by a user using an intelligent keyboard application through a computing system comprising: inputting by the user suggested text requirements for generated suggested text via a user specification module, andforming an instruction for text to be generated by a generative Al model by a compilation and contextualization module, where the compilation and contextualization module compiles the suggested text requirements and a set of text generation data inputs to form the instruction,sending the instruction to the generative Al model where the generative Al model outputs a set of suggested text and presents the set of suggested text to the userof the intelligent keyboard.

28. The intelligent keyboard of claim 27 the method further comprising detecting and classifying text contained within a screenshot with a screenshot analysis module to generate a set of screenshot text and where the compilation and contextualization further compiles the screenshot text with the suggested text requirements and the set of text generation data inputs to form an instruction for text to be generated by the generative Al model.

29. The intelligent keyboard of claim 28 where the screenshot analysis module further comprises an OCR segmentation module, where the OCR segmentation module outputs detected text from the screenshot, and a segment classifier module that classifies the detected text by purpose of the detected text.

30. The intelligent keyboard of claim 29 where the segment classifier module further comprises an advanced neural network to classify the detected text.

31. The intelligent keyboard of claim 27 where one or more of the set of text generation data inputs are chosen from the set of conversation metadata, conversational analysis, characteristics requested, user information, conversation history, past conversations, prompts and instructions.

32. The intelligent keyboard of claim 27 where a sampling parameter algorithm adjusts an input sampling parameter for the generative Al model to adjust the set of suggested text.

33. The intelligent keyboard of claim 27 where the set of suggested text is filtered by a filtering criteria before being presented to the user.

34. The intelligent keyboard of claim 33 where one or more of the filtering criteria are selected from the set of conversation metadata, violent content, graphic content, inappropriate content, or quality.

35. The intelligent keyboard of claim 27 where the set of suggested text is tagged by a set of tagging criteria.

36. The intelligent keyboard of claim 27 where the intelligent keyboard generates a set of rephrased suggested text based on conversation metadata, the set of suggested text and a set of requested characteristics.

37. The intelligent keyboard of claim 27 where the instruction for text to be generated is compressed into shorter seed instruction.

38. The intelligent keyboard of claim 27 where the generative Al model is selected from the set comprising gpt-j, OpenAl GPT-3.5 text-davinci-003, OpenAl gpt-3.5-turbo, DialoGPT, BERT, ROBERTA, T5, OPT, Switch, LLamA, h2oGPT, and OpenAl gpt-4.

39. The intelligent keyboard of claim 27 further comprising: a suggested message window where the set of suggested text is displayed, wherein the user may select text to be sent from the set of suggested text, and a message insertion location to insert the text to be sent.

40. An intelligent keyboard for sending suggested messages through a computing device comprising: An intelligent keyboard application for use on a computer system and display on a computer screen, the intelligent keyboard for use by a user to generate a message to be sent by the computer system, the intelligent keyboard comprising a message insertion location to insert the message generated by the intelligent keyboard,an intent selection window, wherein the user may select an objective and tone for the message to be sent, anda suggested message window where a set of one or more suggested messages are displayed, wherein the user may select and send one of the set of suggested messages via the computer system;wherein the set of one or more suggested messages is selected by a selection criteria by the computer system from one or more message data databases comprising: an integrations database, the integrations database comprising text message data collected from the user, andan artificial intelligence content database, the artificial intelligence content database comprising message data generated by artificial intelligence models utilizing machine learning to generate human natural language responses.

41. The intelligent keyboard of claim 40 where the integrations database further comprises message data collected from one or more applications linked to the intelligent keyboard application by the user where the one or more applications are chosen from the set of email, maps, text messages, iMessage, search history, calendar and contacts.