Patent Application
20080141247
This invention relates to using a computer for personal and group information management and communication.
The vast majority of today's busy families with computers, personal digital assistants (PDAs), and cell phones (all modern computing devices classified generally as computers), still use wall calendars, sticky notes, and kitchen message boards to coordinate their everyday activities. The complexity of family schedules and household information, ease of use, ease of access, and portability have remained powerful barriers to adoption of electronic solutions.
Numerous solutions have been attempted to induce families to adopt computing devices for the task, with limited success. In the Oct. 15, 2003 edition of the Wall Street Journal well-known technology columnist Walt Mossberg wrote: “Today, busy families need more than simple wall calendars to keep their lives organized. With both parents often working and children's lives packed with activities, the problem of meshing everyone's schedules has become acute. Some families have resorted to wring schedules on white boards, assigning different colored markers to each person. Others paper their refrigerators with various print-outs and calendars for scout troop meetings, music lessons and game schedules. But these paper reminders are hard to sync with work calendars that are often kept on computers.”
“For years, technology companies have made sporadic attempts at products that coordinate family schedules electronically. But the solutions generally required too much work and involved too much complexity to be worth the benefits they offered.”
Walt Mossberg wrote this as part of a review of a hardware product called the Home Organizer from a company called Simpliciti, which he also rejected as a solution.
Zanthus [1,2], a reputable market research firm employed by the Internet Home Alliance, a consortium of companies such as IBM, Microsoft, HP, and Proctor & Gamble, offers a review of the state-of-the-art in family calendaring and concludes that the lack of good universal family calendaring solution has hurt the adoption of digital technologies in the home.
The key problem with existing solutions, is the so-called “entry problem”. The wall calendar and day planner win out over computer-based solutions primarily because of the cost, in time and effort, associated with making entries in or consulting a computer-based calendar, whether it is a desktop computer or a hand-held one. The average user takes between 15 and 45 seconds to successfully make an entry on a computer-based calendar, with an average of about 15 “touchpoints” in the form on which the entry is made (see
Some companies have tried to solve this problem differently. Xerox [3] has invented a solution to automatically scan various documents such as those found on the web or those that schools send home with students for calendaring information to construct a database of calendaring information that could then be automatically fed into computer-based calendars. Problems with this approach include the non-uniform availability of electronically-available calendaring information, the human cost to verify the accuracy of the automatically-collected information and apply corrections, and so on.
A great many user considerations went into the building of our invention:
In general in one aspect, the invention features a computer-based method for use in group calendaring. According to the method, the computer allows the input of calendaring information in a shorthand such that it is possible to notate an event pertaining to one or more individuals, whether it is a one-time event or an event that recurs in one of several different ways, in the shortest possible amount of time, and with the least amount of effort.
In general in another aspect, the invention features a computer-based method for creating a list of related or unrelated group calendar entries in a shorthand such that it is possible to create a complex set of schedules involving one or more events and one or more people in the shortest possible amount of time and with the least amount of effort.
In general in another aspect, the invention features a computer-based method for sharing and importing one or more calendar entries with the least amount of effort such that individuals in a community can seamlessly share such information amongst themselves in a highly localized manner heretofore unavailable.
In general in another aspect the invention features a computer-based method of interacting with the user that allows for quicker entry, quicker access to, and quicker modification of frequently used information.
In general in another aspect, the invention features a computer-based method of interacting with the user that allows one fixed part of the application to be used to input a variety of information such that, instead of selecting various menus, forms, or applications, the user always uses that part of the application to perform various functions, such as making a calendar entry, creating a task, sending an email or cell phone text message, keeping a journal and so on. The user can always visit a certain part of the application and perform the required task using one input field and the same shorthand notation used elsewhere in the application.
In general in another aspect the invention features a computer-based method of bringing lifestyle information such as news, weather, shopping, etc., automatically to the user based on their profile, without compromising the user's privacy.
In general in another aspect, the invention features a computer-based method of controlling the notification of event additions and reminders such that a group member can choose to receive notification or not on a variety of devices and channels, such as email, cell phones, and instant messengers.
Implementations of the invention may include one or more of the following features:
Among the advantages of the invention are one or more of the following. A user can enter or review group scheduling information with the same ease-of-use and flexibility that wall calendars and day planners offer. Each member of the group can view his or her information separately or together with those of other members. Each member can enter information on his or her own behalf or on someone else's behalf with the same ease of use and speed, without requiring a separate login process. In general, the invention makes managing group communication, whether in a family situation or in a small workgroup situation, a lot easier than other available computer-based solutions, and comparable in user experience to wall calendars.
In the computer network diagram of
Computer system 130 is running two software components, labeled as Mediabee Desktop Client (MDC) and Mediabee Desktop Server (MDS), which components are also shown in
In the application block diagram of
All the components shown in
Mediabee Desktop Client is a browser-based application, written primarily in HTML and Javascript and “wrapped” in a native shell application (for example, a Windows EXE file) to provide better control and security. Other kinds of Mediabee clients are possible. For example, the Mediabee Web Client is a pure web client in the sense that it only uses web-native HTML and Javascript. Mediabee Desktop Server is written in Python. The database used is an object-oriented database. Zope Object Database, or ZODB, is the one we used.
Usage scenarios for the Mediabee application in a network as shown in
One key innovation the Mediabee Desktop Client brings is a shorthand notation that takes fewer seconds and keystrokes to make entries. For example, “Soccer, 4-5 p, Mark” is a shorthand notation that Mark has a soccer appointment from 4 pm to 5 pm. This kind of shorthand notation is a basic building block to build a user-friendly multiplatform calendaring system such as the Mediabee application. The net effect of this notation is to dramatically reduce the amount of time it takes to make calendar entries whether you're trying to do it on your computer or through the limited keypad on your cell phone. A consequence of our implementation is that tools such as SMS and instant messaging can be used to update and share calendar-centric information freely between members of a trusted group, such as families and small businesses. Contrast this approach with that shown in
In
Exhibit 820 in
Exhibit 840 in
Exhibit 860 in
Exhibit 870 in
Through careful consideration of all the factors influencing the utility, or lack thereof of computing devices for calendaring, and solving the related problems, the invention makes possible a number of benefits to consumers and companies that service them. They are outlined below:
1) Method for Simplifying the Creation and Management of Calendar Entries on Computers, PDAs, Cell Phones, and Other Devices that Requires Minimal Interaction. Method for Using Email, SMS, and Instant Messaging Tools to Simplify Household Information Management.
Calendaring software has been around for many years. The number and types of personal and group productivity applications are virtually limitless. Yet none have tackled one of the most basic problems with this class of software: that of adoption by the average user. A number of factors contribute to lack of adoption, but one of the most basic is that of how long it takes to make, edit, and delete entries on the calendar. Yahoo Calendar is currently one of the most popular calendar interfaces—a screen shot is shown in
The calendar interfaces of Microsoft Outlook, MSN Calendar, and AOL Calendar are not too dissimilar. This is actually a daunting interface for most people, especially home users whose jobs don't depend on a mastery of this kind of interface. A personal digital assistant (PDA) device, like a Palm Pilot HandSpring Treo, or a Pocket PC phone/PDA combo device, has only a slightly less intimidating method of calendar entry. Between the stylus usage to select from dropdowns and writing on the “Graffiti” or other handwriting recognition device, making a calendar entry on these devices is considered a chore in itself by a majority of users [U. of Maryland Calendaring Study 2002].
The Mediabee approach to interaction with the calendar is vastly simplified. It is basically a shorthand notation that takes fewer seconds and keystrokes. For example, “Soccer, 4-5 p, Mark” is a shorthand notation that Mark has a soccer appointment from 4 P.M to 5 P.M. This kind of shorthand notation is a basic building block to building a user-friendly multiplatform calendaring system such as the Mediabee HIM. The net effect of this notation is to dramatically reduce the amount of time it takes to make calendar entries whether you're trying to do it on your computer or through the limited keypad on your cell phone.
Another consequence of this method, which avoids the traditional calendaring user interface in favor of a short text string, is that tools such as short message services (SMS) and instant messaging can be used to update and share calendar-centric information freely between members of a trusted group, such as families and small businesses. In cases such as SMS, depending on the device used and the availability of keys in the input device, for example, there may be some variations in syntax, but the spirit of making entries without the need for a great deal of interaction will be preserved.
2) Method for Using Lists to Organize Home and Business Information into Calendar Entries, Reminders, and Messages.
The List Planner user interface (
The Memo Pad (
3) Method for Creating and Monitoring Carryover Tasks and Progress Metering
Software such as Microsoft Outlook provides for the ability to create to-do lists. A to-do list item on such software typically has a task name, a due date, and priority as its properties. Tasks that are not checked off as having been completed by their due dates are marked in some manner—perhaps they appear in red or bold, for example. Such software typically makes no distinction between tasks that can be carried over and tasks that make no sense to carry over. If a task is a repetitive one that must be performed every day, for example, feeding the dog, it doesn't make sense to carry it over.
Contrast the conventional approach with the approach used in our Daily Planner user interface (
Our system allows for the metering of this progress on a real-time basis over daily, weekly, and monthly periods. This unique feature allows for incenting household members of small office workers to meet daily and weekly goals in addition to providing reminders and visual feedback on a daily basis. The combined tracking of all members of a household or business using the system will indicate the overall level of discipline, chaos, or stress in the household or business. A color-based visual indication or an incentive system can be combined with this tracking to improve discipline and reduce chaos and stress. This group rating could be combined with a device such as Ambient Devices' Orb product, centrally placed in a home or office setting, to indicate the level of stress in the home or office which would be directly related to the amount of regular activities or chores that have been ignored.
The same system also allows for certain tasks to be “carried over”. If your property taxes are due on June 15th, for example, and you intended to pay it on June 1st, you'd set up a reminder for yourself and choose the carryover option, specifying a deadline of June 15. From June 1 to June 15, as long as the item is not checked off for being completed, the system will provide visual and other feedback indicating that the task is imminently due and is in danger of being overdue. After June 15, the unchecked task will remain, but the system will stop complaining about it as the deadline is already past.
Over a period of time, if the system is used regularly, it can gradually change habits of people, making them more organized and less stressed. The key to making this work for people is to make it easy enough for people to adopt and maintain. The Activity Planner, a part of our invention, provides for an orderly way in which people can plan their regular at-home activities and regular out-of-home activities.
4) Method for Using the System to Deliver Highly Relevant Information such as Traffic and Weather Updates, Flight Information, and so on in a Timely Manner Automatically
The Mediabee application setup and profile modules gather some key facts about the household or business situation under which it will be used. These modules are customizable to different environments—i.e., although the process is the same, the nature and types of questions asked may vary depending on the environment in which the application will be used. No matter what the environment, the goals of these modules are as follows:
Between the information established through the setup process and the application setting and the information entered by the users into the calendar, a great deal is known about the home environment. This information can then be used to proactively bring information as needed into the application and various other implements used by family members. For example, just before Mary leaves for work, 7 to 8 am, traffic information for the routes relating to Mary's commute (including the detour to Nancy's daycare center) can be brought to the traffic, weather, and news panel of the application. The same information can be fed into a PDA or cell phone belonging to Mary or fed into the OnStar system in Mary's car.
Another example of this method is when Mark is on a trip, we bring information about things relating to his trip into the information panel of the application: Mark is in Cleveland today; Mark's flight to Chicago has been delayed by an hour; and so on.
5) Method for Scripting the Calendar to Drive the Scheduling of Content Display and Other System Operations
In the previous method, logic is embedded into the application to automatically schedule content for display. This method refers to user-programmability of that feature.
The List Planner has what, when, who, and options fields. List Planner entries are tightly integrated into the calendar and display scheduler, which provides for scheduling display items in various panels of our applications. Each viewport has a display list associated with it. For example, in the main window of our application, the upper right corner contains the clock panel. Just above the clock panel is a news and weather panel.
If you are an administrator of the system (its main user), you have the ability to modify the display lists of these panels. Through List Planner, you can select the System/Display/NewsWeatherPanel and add your own entries to the display list or modify the modifiable entries in that list. (Certain entries are maintained by the system and cannot be modified.) So, for example, just as you would specify “Floss, Daily; 8 p, All” in the List Planner, you could add “Traffic:commute, Daily; 8 a, Mark”. The only difference here is that the what typically would be a predefined keyword. The system provides a number of predefined keywords, but the users can add their own keywords through a scripting mechanism using a language such as Javascript.
What is unique about this is the simplicity with which this can be done, and the universal nature and applicability of our simplified shorthand for events.
6) Method for Annotating Digital Photographs Automatically Based on Information from the Calendar
The Mediabee application is a comprehensive but easy to use calendaring system Mediabee's focus is to drive adoption of the calendaring system so that many other benefits can be realized easily. One such benefit is the possibility of automatically annotating digital photographs.
Digital photographs are stored in the EXIF file format, which allows for, among other things, textual annotation of photographs. Some information, like when the photograph was taken, what the lighting conditions were, etc., is recorded by the digital camera that took the photograph Other information, like who's in the picture, is typically recorded by the photographer or other user using some external tool. Busy people often do not have time to carry out this step. Our software, if rigorously used by the family, contains a wealth of information about what was happening to whom at what times. For example, if Nancy has ballet practice at 6 P.M. on Monday, and some photographs were taken at that time, there is a very good chance that the photographs were those of Nancy in ballet practice.
One way in which this information could be used, for example, is as follows. The Photos section of Mediabee application provides an Auto-Annotate command, which, when invoked, would provide a table of photos with each photograph potentially corresponding to one or more calendar entries that occurred during or near the same time frame as when the photograph was recorded. This would allow the user to run this command and, perhaps in one quick sweep, accept all the auto-annotation as captions for the photos.
7) Method for using the System to Monitor Remote Events such as Children's Homework, Elders' Health & Medication, and Other Work-Life Balance Requirements
The capabilities of the Daily Planner user interface make it ideally suited for basic delivery of elder care services. Consider the following scenario. Your older parent wants to live alone despite your protestations; you're uncomfortable because you're living at a distance. He needs to take his medication three times a day and it could get serious if he misses his medication. You set up the Mediabee application on an inexpensive PC (or on a consumer device licensed to run Mediabee application) in his home similar to system 110 in
Consider another scenario, as follows. You're in the office and your kids come back home from school. Your son is supposed to work on his science project and your daughter needs to practice her piano lessons. They both complete their work and check off the items on their schedules. In between meetings, you do a quick check and see that they're done with their homework. Your mind is at ease during that next meeting, and you didn't have to call to remind them.
8) Method for Improving Communication of Essential Messages Provided by Employees and Benefits Service Providers
The Photo Player (
The Mediabee application, if used by employees, would provide a great long-term messaging platform. The application in its current form, for example, includes a playlist of health-related websites such as http://www.kidshealth.org and http://ahealthyme.com. The application has a screen saver mode, in which, after a certain period of inactivity, the main application panel starts the web player. Employers and benefits providers could tailor the playlist to their communications needs, effectively improving long-term communications with employees, leading to happier, healthier, and presumably wealthier employees.
9) Method for Eliminating the Need for Paper Mail by Enabling the Delivery and Promotion of Electronic Catalogs, Coupons, and Other Messages using the System Without Compromising the Privacy of Users
Postal mail and newspaper delivery account for the lion's share of promotional materials coming into homes today, although email spam is very quickly overtaking paper based promotions in volume. A large amount of press materials testify to the fact that current email systems were simply not designed to balance the needs of marketers to get relevant promotional materials to willing prospects versus the ability of the consumer to choose when and what such information they want to process. The Mediabee application system is created from the ground up to allow for this balance.
A feature of our system is the ability of the user to make selections of the following nature:
Another feature is for these offers to automatically present reminders at selectable intervals.
10) Method for Managing the Display of Multiuser Calendaring and Repetitive Information to Present Information Within Certain Spatial Constraints.
Even the largest available displays and screen resolutions have spatial constraints when it comes to displaying calendar entries for a group of users that must be viewable from a nominal distance of 3-10 feet. Although we could design the display such that it is scrollable like any regular web page, that model would detract from our usability requirements, which closely model the wall calendar metaphor. One optimal model for operation of our application is that it will have the information that a user might require reachable through a minimal interaction, preferably no mouse or key clicks required. Our PC and Web clients use certain techniques that are uniquely optimized to display such information.
The following description applies to the monthly view of our calendaring application. Similar algorithms could be used to optimize the display for daily, weekly, and yearly views. If there are many entries on each date to show, we optimize the display to show more of the current information and less of information that's past or in the future. So let's say that there are 6 entries on each date. For the current week, show all the entries if possible. If there are more than X entries on any one day of the current week, show only X (say 10) entries with a . . . to indicate there are more. For previous and next weeks, show only Y (say 4) entries each with a . . . to indicate there are more. Show only up to Z (say 13) characters per entry to ensure that an entry doesn't exceed 1 row. This logic should also account for the “common user, display vs individual user display—i.e., when displaying entries for one person alone, there are bound to be fewer entries. X, Y, and Z are parameters of this parameter-driven system.
11) Method to Integrate Building Security and Automation Services into the System
Many homes today have services provided by security services companies such as ADT®. High-end systems have a great degree of sophistication in how the security system integrates with home automation and control systems that might be installed on premises. The vast majority of security installations are rather primitive in their knowledge of the premise residents' whereabouts.
Mediabee, through its simplicity of use, is able to capture a lot of information about the premise owners' habits and schedules. For example, the system is usually cognizant of when no one is expected to be in the premises or when adults may not be present in the household. Coupled with certain sensory systems, such as the recognition of a “bluetooth”—or global positioning satellite signal (GPS)—enabled cell phone on premises, Mediabee is able to provide a lot of information to a security system that can enable the security system to be “smart” about what kinds of actions to take upon a suspected security breach, even if the security system is not armed.
For example, a household might have a security system, but the owner may not have enabled it as she went to a soccer game with her child. During that time, the opening of a window is detected Mediabee knows that according to information that was entered into it, no one is supposed to be at home. So it alerts one or more of the adult occupants through an email and/or cell phone message (such as SMS) that something might be amiss. If the message recipient(s) do not respond within a predefined interval, Mediabee HIM might even alert the security company, depending on how the owner set up their preferences. The advantage of the Mediabee-enabled security system versus one that is not Mediabee-enabled is that there is an additional level of intelligence that can be applied by the system before deciding the course of action for notification. A traditional calendaring tool would be ineffective in this situation because it is highly unlikely to have the relevant information.
12) Method for Using the System to Script Various Security and Automation Tasks
Mediabee exposes its underlying objects using a simplified object model that can be programmed using a scripting language such as Javascript to adapt their premise security and automation system to the purposes of the user. A very simple example could be as follows: “If (Weather.Tate<45) HVAC.Heating.On.”
Manufacturers of various security and automation systems do provide some level of software programmability for their systems. However, there is no standard or system out there that accounts for household information management and calendaring objects comprehensively like the Mediabee system. How many members live in the household, how many are expected to be present in the premises at any given time, etc., are vital pieces of information for home automation and security functions; yet there is no system that supplies this information. This is a key advantage of the Mediabee system. By focusing on ease of use, driving adoption, and encouraging users to enter all pertinent scheduling information for household members into it, Mediabee creates good data inputs for the remaining systems.
The scripting feature exposes this data through simplified non-programmatic interfaces as well as programmatic ones in a manner that is well understood in the industry.
13) Method for Distributing Self-Organizing Content that is Purchased Through Micropayments.
Ringtones for cell phones are distributed on a micropayment basis by cell phone providers. Even though free tools exist for creating and uploading ringtones to cell phones have existed for years, what wireless carriers found is that users are willing to pay a premium for convenience and packaging of information. That is why the ringtones industry is a $1.5 B industry today and expected to be a $15 B/year industry in a few years.
The packaging of application and content around the Mediabee system, coupled with the Photo Player (
