Patent Grant
10579724
Spreadsheet application programs typically store data in cells as character strings, numbers, or errors. Although data in spreadsheets may be displayed as, for example, currency, a date, a time, a percentage, a location, etc., existing spreadsheet applications treat such data as a display formatted version of strings or numbers, without understanding the type of data nor do spreadsheet applications have the ability to perform intelligent calculations on such data. In other words, present spreadsheet applications perceive and understand such data simply as numerical or string values without understanding what type of data it is. In an example, present spreadsheet applications may allow addition of the value “2 kg” and the value “2 years” because the spreadsheet application merely recognizes the numerical value “2” without regard to the reference unit. Accordingly, spreadsheet applications may allow the addition of 2 kg to 2 years, resulting in, for example 4 (kg or years) without error. In another example, present spreadsheet applications may treat values such as “5 kg” and “6 kg” as string values, thereby preventing the sum of such values. In another example, the value and associated unit are separated into individual cells. For example, the number “2” may be stored in a cell and the associated unit may be stored in an adjacent cell. Accordingly, the numerical values are allowed to be added, despite the erroneous result. This configuration further requires the user to rely on their own organization within the spreadsheet to remember the association between the cells. Accordingly, calculation errors may occur and may be exacerbated when propagated through a spreadsheet or series of workbooks containing vast amounts of data due to the lack of understanding and recognition of the type of data entered by the spreadsheet application.
It is with respect to these and other general considerations that aspects of the present disclosure have been made. Additionally, although relatively specific problems are discussed, it should be understood that the aspects should not be limited to solving only the specific problems identified in the background.
The present disclosure is directed to systems and methods for implementing rich data types in a spreadsheet application. Generally, a value being of a rich data type is as a type of value that has context and established relationships with other types of data. In particular, a rich data type is a data value having associated context, which may be units (e.g., inches, miles, meters, kilograms, seconds, joules, hertz, Fahrenheit, etc.) or other information about the data's type (e.g., city, stock, NCAA football team, car, restaurant, school, etc.). Additionally, a value being of a rich data type further includes established relationships with other types of data.
In a first aspect, this disclosure describes a computer-implemented method for creating an object associated with a cell of a spreadsheet, comprising: receiving a data value in a cell of a spreadsheet; creating the object including a value field and at least one of a unit field and a type field, wherein the value field comprises the data value; identifying at least one of a data type and a data unit associated with the data value. The computer-implemented method further includes adding at least one of: the identified data type in the type field; the identified data unit in the unit field; and associating the object with the cell of the spreadsheet.
In a second aspect, a system is disclosed. The system comprises at least one processing unit; an at least one memory storing computer executable instructions that, when executed by the at least one processing unit, cause the system to perform a method, the method comprising: identifying a first data value in a cell of a spreadsheet, wherein a first object associated with the cell comprises: the first data value in a first value field; and a first data type in a first type field; identifying a second data value in a related cell of a spreadsheet, wherein a second object associated with the related cell comprises: the second data value in a second value field; and a second data type in a second type field; determining that the first data type is different than the second data type; and providing a notification that the first data value is inconsistent with the second data value.
In third aspect, another system is disclosed. The system comprises at least one processing unit; an at least one memory storing computer executable instructions that, when executed by the at least one processing unit, cause the system to perform a method, the method comprising: identifying a first data value in a cell of a spreadsheet, wherein a first object associated with the cell comprises: the first data value in a first value field; and a first data unit in a first unit field; identifying a second data value in a related cell of a spreadsheet, wherein a second object associated with the related cell comprises: the second data value in a second value field; and a second data unit in a second unit field; determining that the first data unit is different than the second data unit; and providing a notification that the first data value is inconsistent with the second data value.
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
Various embodiments will be described in detail with reference to the drawings, wherein like reference numerals represent like parts and assemblies throughout the several views. Reference to various embodiments does not limit the scope of the claims attached hereto. Additionally, any examples set forth in this specification are not intended to be limiting and merely set forth some of the many possible embodiments for the appended claims.
The present disclosure is directed to systems and methods for implementing rich data types in a spreadsheet application. Generally, a value being of a rich data type is a type of data that has context and established relationships with other types of data. Accordingly, a rich data type is a data value having associated context, which may be units (e.g., inches, miles, meters, kilograms, seconds, joules, hertz, Fahrenheit, etc.) or other information about the data's type (e.g., city, stock, NCAA football team, car, restaurant, school, etc.). Additionally, a value being of a rich data type further includes established relationships with other types of data. In an example, established relationships may provide the spreadsheet application with further information regarding how that value fits in context with other values, so as to correctly convert a value to another value and identify whether it is even possible to convert a value to another value. Still further, such relationship information may provide the spreadsheet application with knowledge about surrounding values, enabling the spreadsheet application to suggest units as the user types a value into the spreadsheet. Additionally, such information about established relationships provides the spreadsheet application with the ability to provide features such as, for example, look up of related data (e.g., if a value is a city, the spreadsheet application can provide the population of that city; if the value is a football team, the spreadsheet application can provide the name and position of each player; if the value is an ingredient, the spreadsheet application can provide the name of recipes including that ingredient, etc.). Accordingly, the disclosed spreadsheet application recognizes data values and semantic information about the data's type. The spreadsheet application uses such contextual and relationship information to prevent errors, contextually present user interface experiences to make operations easier, surface related data, common operations, etc.
Accordingly, novel aspects provide a rich data type that is user-extensible and a spreadsheet that is type aware. Furthermore, the disclosed spreadsheet application will enable users to define relationships between new or custom data types and also provides the ability to overload or change existing relationships. It is understood that such aspects of the present disclosure are merely exemplary and are not intended to limit the scope of the disclosure thereto. It is with respect to these and other general considerations that embodiments have been made.
As illustrated, system 100 may include one or more client computing devices 104 (e.g., client computing devices 104A and 104B) that may execute a client version of a spreadsheet application capable of implementing rich data types in a spreadsheet. In some examples, the client spreadsheet application may execute locally on a client computing device 104. In other examples, a client spreadsheet application (e.g., a mobile app on a thin client computing device 104) may operate in communication (e.g., via network 106) with a corresponding server version of spreadsheet application 110 executing on one or more server computing devices, e.g., server computing device 108. In still other aspects, rather than executing a client version of a spreadsheet application, the one or more client computing devices 104 may remotely access, e.g., via a browser over network 106, the spreadsheet application 110 implemented on the server computing device 108 or multiple server computing devices (e.g., in a distributed computing environment such as a cloud computing environment).
As illustrated by
In a basic configuration, the one or more client computing devices 104 are personal or handheld computers having both input elements and output elements operated by one or more users 102 (e.g., user 102A and user 102B). For example, the one or more client computing devices 104 may include one or more of: a mobile telephone; a smart phone; a tablet; a phablet; a smart watch; a wearable computer; a personal computer; a desktop computer; a laptop computer; a gaming device/computer (e.g., Xbox®); a television; and the like. This list is exemplary only and should not be considered as limiting. Any suitable client computing device for executing a client spreadsheet application and/or remotely accessing spreadsheet application 110 may be utilized.
In some aspects, network 106 is a computer network such as an enterprise intranet and/or the Internet. In this regard, the network 106 may include a Local Area Network (LAN), a Wide Area Network (WAN), the Internet, wireless and wired transmission mediums. In further aspects, server computing device 108 may communicate with some components of the system via a local network (e.g., an enterprise intranet), whereas server computing device 108 may communicate with other components of the system via a wide area network (e.g., the Internet). In addition, the aspects and functionalities described herein may operate over distributed systems (e.g., cloud computing systems), where application functionality, memory, data storage and retrieval, and various processing functions may be operated remotely from each other over a distributed computing network, such as the Internet or an intranet.
As described above, the spreadsheet application 110 may be implemented on a server computing device 108. In a basic configuration, server computing device 108 may include at least a processing unit and a system memory for executing computer-readable instructions. In some aspects, server computing device 108 may comprise one or more server computing devices 108 in a distributed environment (e.g., cloud computing environment). Server computing device 108 may provide data to and from the one or more client computing devices 104 and/or one or more other server computing devices (e.g., server computing devices 120A and/or 120B) via network 106.
As used herein, rich data values may be stored in cells of the spreadsheet application 110. As will be described in further detail herein, in an example embodiment, cells that store rich data values may each be associated with a unit/value table. Accordingly, one or more unit/value tables (e.g., unit value tables 124A and 124B) may be stored in storage (e.g., storage 122) accessible to spreadsheet application 110. The unit/value tables may be retrieved based on a reference pointer or a file locator, which may be a uniform resource locator (URL) identifying a file path from a local storage location or a remote storage location. Still further, one or more unit reference tables (e.g., unit reference tables 126A and 126B) may also be stored in a storage location, such as storage 122. The unit reference tables may be retrieved based on a reference pointer or a file locator, which may be a uniform resource locator (URL) identifying a file path from a local storage location or a remote storage location. In other embodiments, cells that store rich data values may each be connected to an online database, wherein the online database stores contextual and relationship information regarding that particular rich data type. The disclosed spreadsheet application may implement rich data values by implementing unit/value tables and reference tables, by implementing an online database, or any combination thereof.
In some examples, the one or more unit/value tables and unit reference tables may be stored in different storage locations within a distributed environment (e.g., cloud computing environment) accessible to spreadsheet application 110 over a network, e.g., network 106. As described herein, the location of a unit/value table and reference table in storage may be represented by a reference pointer, a file locator, which may be a URL to local storage or to remote storage accessible over a network. In particular, a URL may provide a file path to a storage location hosted by a third party (e.g., Dropbox®, etc.), in a public or private cloud storage location (e.g., OneDrive®, iCloud®, Amazon® Cloud Drive, etc.), in an enterprise storage location (e.g., SharePoint®, etc.), in a public storage location accessed over the Internet, and the like.
As illustrated in
As described above, the spreadsheet application 110 may be configured to implement rich data types and storage of rich data values. As should be appreciated, while examples and descriptions provided below may generally reference implementing a rich data type and storage of a rich data value, the methods and systems described may similarly include implementing multiple rich data types and the storage of multiple rich data values. In cases where application of the methods or systems may differ, additional disclosure will be provided.
In aspects, the identification component 112 may scan a spreadsheet or multiple spreadsheets to analyze rich data values stored therein. In particular, the identification component 112 may scan a spreadsheet to identify rich data values and corresponding units. The identification component 112 may also identify cells organized in columns or rows that contain values having units or types. The identification component 112 may also identify a header cell or cells having a label referencing a particular unit or type that would be applied to a multiple cells of a column or row. The identification component 112 may further identify inconsistent values, for example, cells that store values of units or types that are inconsistent with other values stored in that column or row. The identification component 112 may also identify units or types in formulas. For example, the identification component 112 may identify cell references in a formula to identify the type of data required by a particular formula. The identification component 112 may further parse a formula to identify units or types defined therein. The identification component 112 may also parse values stored in, for example, a compound value (e.g., “5 days 4 hours 23 minutes” may be stored as three values in a single cell as a compound object). The identification component 112 may also suggest appropriate units.
In aspects the math component 114 may determine whether unit conversion is required. In particular, the math component 114 may analyze a formula to determine whether that formula requires each value to have consistent units (e.g., a sum function requires each unit to be consistent, however multiplication of two values having inconsistent units is generally allowed). For calculations requiring consistent units, the math component 114 may also identify a common unit to which each value is converted and to convert each unit to a value of that identified unit using, for example, a reference table as will be described in further detail herein. The math component 114 may also perform calculations. The math component 114 may also determine whether an operation is impermissible and reject such impermissible operations (e.g., adding values having inconsistent units, subtracting a location from a date, etc.).
In some aspects, the display/UI component 116 displays various user interfaces. For example, the display/UI component 116 may display warning messages indicating that a value is of an inconsistent data type or that a calculation error has occurred as well as accompanying description of the warning. The display/UI component 116 may provide a user interface prompting the user to select a desired conversion unit, for example, if a formula requires each unit to be of consistent units. Furthermore the display/UI component 116 may provide a unit suggestion user interface to identify available units, frequently used units, particular formatting, etc.
In some aspects, the pattern detection component 118 may determine whether an entry of a value matches a predetermined pattern. For example, as a user enters, into a cell or a formula bar, a value, the pattern detection component 118 may identify a predetermined pattern such that the display/UI component 116, for example, can display suggested units based on the detected pattern.
As should be appreciated, the various devices, components, etc., described with respect to
As described herein, a rich data value is a data value having context, which may be unit information or information about the data's type (e.g., distance, duration, geo-location, stock, NCAA football team, restaurant, etc.) and established relationships with other types of data (e.g., how that value might relate to other values). In an example, a cell may contain the value “2 meters” wherein the “meters” unit has context (e.g., it is a unit of distance) and relationships to other units (e.g., it is associated with other units of distance such as feet, kilometers, and miles, etc.; it can be converted to other units of distance; it has rules, such as, for example, it cannot be summed with a value with the type “kg,” etc.). Although some examples provided herein may describe numbers and associated units, this disclosure is not intended to be so limiting. Rather, any value with associated type information is also disclosed. For example, the value “Chicago” may be of type “city” or “geo-location.” Additionally, the value “fall” has an associated “season” type. Furthermore, the value “blue” has an associated “color” type, etc.
Referring back to
In the example embodiment, for each cell, the spreadsheet application 110 may store a unit/value table (e.g., unit/value table 124A and 124B). The unit/value table 216 is may be, for example, a table that stores a value field and a unit field, wherein each value field includes the value stored in the cell, and the unit field includes the unit associated with that value. Additionally or alternatively, the unit/value table may include one or more type fields that include the type associated with the value stored in that cell. In embodiments, these unit/value tables are stored in the cell table of the spreadsheet. As illustrated in
The example reference table 300 is a universal table that stores unit information, including, for example, one or more units, unit relationships to other units, conversion logic to convert among units, pointer identification information of each unit, the type of each unit, etc. In an example, the reference table 300 may be a single table or it may be distributed across multiple tables, wherein each table may be stored in memory (e.g. in storage 122) or externally and accessed by the spreadsheet application 110. In this example, the reference table 300 includes four columns: a reference unit column 302, a unit column 304, a base multiplier column 306, and a type column 308. Although this example reference table 300 includes four columns, it is understood by one of ordinary skill in the art that more or fewer columns may be provided in the reference table 300 as necessary. Furthermore, the particular arrangement of the reference table 300 is merely exemplary and may be modified as necessary.
In this example, the reference unit column 302 corresponds to the pointer reference number used to reference the particular unit identified in the unit column 304. Accordingly, as described and illustrated in the example of
The type column 308 specifies the type of each corresponding unit specified in the unit column 304. In particular, units are arranged, in this example reference table 300 by the type. Types may be further defined as categorizing the value and may correspond to one or more units. Types may be, for example, “Distance,” “Duration,” “Weight,” “Speed,” “Date,” “Distance/Duration,” “geo-location,” “football team,” “stock,” “mutual fund,” “school,” “movie,” “store,” etc. As further illustrated in this example, each type includes multiple units. For example, the “distance” type includes at least nine units (e.g., nm, mm, cm, m, km, in, ft, yd, and mi) as specified by the unit column 304. In some embodiments, however, the type may include just one unit. Although only a few units and types are illustrated in this example reference table 300, it is understood that more or fewer types and corresponding units may also be stored. As also discussed, some values may not have a unit (e.g., the value “Chicago” has no unit, but instead has a type). Accordingly, the reference table 300 may further store types of data with no associated unit.
Now referring back to
It is further understood that conversions of a value to another value may be performed among units sharing the same type and typically cannot be performed outside of a particular type. For example, conversions can be performed among units that are within the “distance” type. For example, conversions can be performed among units “nm, in, ft, m, yd, mi” because they are of the same “distance” type. However, conversions cannot be performed among units of different types. For example, conversions cannot be performed between the unit “cm” and unit “oz” because they are of different types. In particular, the unit “cm” is of the “distance” type while the unit “oz” is of the “weight” type.
Although conversions cannot be performed among units of different types, other calculations among units of different types may be performed. For example, multiplication and division operations can be performed among units of different types. For example, the unit “m” (type distance) can be divided by the unit “s” (type duration) to arrive at “m/s” which is yet another unit having a type of “distance/duration.” Such calculation rules and conversion logic may be stored in the reference table 300. In other embodiments, such calculation rules may be stored in the actual formula itself. For example, a conversion formula may store the logic to perform such conversions and the rules associated with convertible values. Other mathematical formulas such as multiplication and division formulas may store separate logic and rules associated with the respective formula.
Furthermore, a mathematical formula may require conversion logic to arrive at a solution. For example, a formula multiplying “m/s” with “1/km” would first need to convert the values having different units to a common unit (e.g., convert the value “m/s” to “km/s” or convert the value “1/km” to “1/m”) in order to perform the necessary multiplication. These examples are described in further detail herein.
The reference table 300 may be extensible. In particular, in some embodiments, user-defined or user imported types and corresponding units may be added to the reference table 300, as will be described in further detail herein. Further aspects of the present disclosure provide that such newly added units and types may also fully participate in calculations and spreadsheet functions. In particular, users may add units and types to the reference table 300, and provide conversion information and rules for units and types that may not be in the reference table 300. For example, units such as “lightyears” of type “distance” might not be included in the reference table 300. Accordingly, the spreadsheet application 110 provides for the extensibility of the reference table 300 to add such units and corresponding relationships to other units. In an example, a user may also provide a unit and provide the associated type and the base multiplier, which defines the conversion factor for the new unit to the base unit within that type. Additionally or alternatively, the user may obtain, from an online database, such information to apply to the added unit. Alternatively or additionally, in some embodiments, the user may add unknown units and types to the unit reference table 300 and provide the base multiplier.
Aspects further include the ability of the user to add types that may exist, but are not included in the reference table 300. For example, the user may add the type “Temperature” and add one or more units within that type, such as, for example, “Fahrenheit,” “Celsius,” and “Kelvin” and identify an added unit as the base unit. The user may also provide, for each added unit, the associated base multiplier. As described herein, the user may obtain, from an online database, such type and unit information.
Furthermore, users may have the ability to define more complex conversions. In an example, users can define more complex conversions, via an entry or new column in the reference table 300, which instructs the spreadsheet application to call an API to call an online service, for example, to perform the conversion. Accordingly, in examples in which conversion between values is more complex, the reference table 300 may call one or more APIs in order to perform the conversion. In some embodiments in which multiple APIs are provided, a display may be provided that shows the conversion from each API so that the user may decide which API to call. Thus, extensibility allows for conversions between values to be expressed as more complex algorithms. In an example in which a value is a city having the type geo-location, calculating the distance between two locations may require complex conversions. For example, city values may be converted to, for example, latitude and longitudinal coordinates, which may be converted via the calling of an API. Accordingly, calculating the distance between two locations may be performed through a service. Additionally, such a calculation may be provided by a service that offers options such as calculate the distance between two locations based on “driving,” “as the crow flies,” “train,” “airplane” etc. In such an embodiment, the value returned may be provided with additional information, such as the mode of travel.
Although the use of APIs is described in the context of a user-defined unit or conversion, it is understood that all conversions may be performed by a service via the calling of an API. Furthermore, an API may be called to verify the validity of units and to verify conversions.
Aspects further include the ability to add and define new types and associated units that do not exist, but are fully defined by the user. In an example, a user may provide a new type and define one or more units within that type. The user may also identify a base value unit and base multipliers for each defined unit. Accordingly, a user may define a new type and associated units as well as conversions among those newly defined units.
Another example of an added type may be a media type having units such as, sounds, images, and videos. The user may define the base unit and conversions among units, if possible. The user may further define calculation rules for each unit. For example, the user may define the calculation result when two sound files are added together, for example, to create a single sound file by sequentially adding the two sound files. Alternatively or additionally, the user may define the calculation result when a video file is subtracted from another video file, resulting in a single, cropped video file. Alternatively or additionally, a user may add a non-linear type such as a decibel (dB) and the corresponding logarithmic calculations thereon.
Adding types and units may be done through a separate user experience that enables the user to provide parameters for each added unit and type. Parameters may include, for example, the name of the added unit(s), the name or selection of a type associated with the added unit(s), selection of a base unit, conversion rules, and calculation rules. The spreadsheet application 110 may, in response to the creation of the added unit or type, provide a reference number used to reference each new unit (as identified in the reference unit column 302). Additionally, in some embodiments, functions may be used to create units (e.g., dividing a value having the unit “meters” by a value having the unit “seconds” may result in the creation of the unit “m/s”). Such created units may persist in the spreadsheet application throughout the file and may also be applied to other files and shared among users. Furthermore, extensibility further includes a user interface for specifying how such newly added units may be displayed in the spreadsheet application (e.g., include dashes between values, spaces, unit labels, etc.).
Additionally, new units and types can be temporarily or permanently added to the reference table 300. In particular, the user experience may provide the option to temporarily add the unit or type to the reference table 300 such that the new unit or type is only applied to the present spreadsheet. Alternatively, the user experience may provide the option to permanently add the unit or type to the reference table 300 such that the new unit or type is applied to other spreadsheets and may be shared among users.
Accordingly, aspects disclose the ability to extend the reference table 300 by providing the ability to add, to the reference table 300, new types and associated units or the ability to extend types by adding new units thereto. Aspects further enable providing conversion logic and calculation rules for each unit or type. The spreadsheet application 110 may further use the newly added units and types in pattern matching and autosuggestion features that are described herein.
The disclosed spreadsheet application 110 further supports the dynamic updating of volatile rich data values. Volatile rich data values are values that are subject to change over time. Examples of volatile rich data include, but are not limited to, stock quotes, weather forecasts, currency rates, sports scores, etc. The disclosed spreadsheet application 110 further includes the ability to dynamically update such volatile rich data values stored in a spreadsheet using, for example, an API call to an online database. In an example, a spreadsheet may contain one or more currency values having units, such as, for example, Yen, Dollar, and Pound. Each cell storing such a currency value may reference, in its corresponding unit/value table (e.g., unit/value table 206), the current value and a reference pointer to the corresponding unit (Yen, Dollar, or Pound) stored in the reference table 300. The value part (e.g., value 222) of the unit/value table may change over time. This change may be the result of, for example, daily currency value fluctuations. As described herein, some units stored in the reference table are associated with a base multiplier, which is the multiplication factor used to convert a value of that particular unit to a value of another unit. Accordingly, for volatile rich data values, such as currency, such base multipliers may change over time. In an example, the value of the Dollar is dynamic and is thus subject to change on a periodic basis, and therefore the conversion rate (as reflected by the base multiplier value) of the Dollar to other currencies is also subject to change. The reference table 300 may therefore reference, for each currency unit, an API that calls a dynamically updated conversion table. Accordingly, currency data stored in the spreadsheet can correspondingly update and display the most current currency values. The spreadsheet application 110 may provide the user with the ability to control the refresh rate of the data, or it may refresh at every occurrence of a change in a currency value. Moreover, the user may override the currency conversion table and instead enter a fixed conversion value, if desired. Still further, the spreadsheet application 110 provides the ability to define multiple currency conversion tables, wherein the user may specify which currency conversion table to use for specific spreadsheets or calculations. In such an example, a currency conversion function may reference a particular table. In yet another example, a currency conversion function may reference a particular table to be applied on a particular date, and may reference another table to be applied on another date. Such conversion tables may also be stored in the reference table 300.
As described herein, present spreadsheet applications do not have the capability to intelligently detect erroneous calculations. Rather, present spreadsheet applications are capable of detecting obvious, erroneous calculations, such as, for example, when adding a cell having a string value, and adding a cell having a numerical value. However, current spreadsheet applications are incapable of detecting less obvious errors, such as, for example, adding numerical values having units of different types. In an example, current spreadsheet applications may view a date value and a dollar value simply as numerical values and therefore allow the sum of such values by returning a seemingly valid, yet erroneous value. Furthermore, even if a spreadsheet application can detect an obvious error, it does not provide a description, let alone a detailed description of that error. According to novel aspects of the present disclosure, the spreadsheet application implements values that are rich data types and therefore have context about the rich data values stored therein and established relationships with other types of data. In particular, the disclosed spreadsheet application has the ability to differentiate among different types of values. This ability to differentiate among different values provides enhanced error detection, thereby minimizing calculation errors. Still further, the disclosed spreadsheet application can also provide detailed explanations of the resultant error.
Now referring to
In addition to the indication of an error in cell B4 406, an error message 418 may also be displayed. This error message 418 may include a detailed description of the particular error. In this particular example, the error message 418 indicates that the values stored in cell B2 402 and cell B3 404 are incompatible units and therefore cannot be added together. Accordingly, aspects provide an improved error experience in which descriptive error strings are displayed in response to erroneous calculations that may be propagated through the spreadsheet and downstream calculations. Such descriptive error strings may further identify a particular cell or cells in which the inconsistencies were initially introduced by highlighting, for example, the source cells in which the erroneous data was entered. Such description allows users to better understand the reasons why the error occurred and enables the user to correct such mistakes more quickly and easily. The error strings also ensure that fewer errors result and fewer errors propagate through a spreadsheet or a series of related spreadsheets.
In some embodiments, the error result indicated in cell B4 406 and the corresponding error message 418 may be provided immediately after the formula 414 is entered. Yet in other embodiments, the result in cell B4 406 and the corresponding error message 410 may be provided dynamically and in real time as the formula is being constructed. Providing errors dynamically enables users to detect errors earlier, making formula creation more accurate and efficient. In an example, if a formula definition itself contains unit or type information, errors can be identified in real time and a corresponding error message can be displayed. In an example, a formula defined as “=3 meters+A1” indicates that 3 meters is to be added to the value stored in cell A1. The formula itself indicates that the value stored in cell A1 is expected to be of the same unit (e.g., “meter”) or type (e.g., “distance”) so that the two values can be summed. Any value in cell A1 that is not of the unit “meter” or a value that is not of the type “distance” would result in an error. Alternatively or additionally, in another example, a formula defined as “=file5.jpg+C8” indicates that an image file is to be summed with cell C8. In such an example, the types of values that could be stored in that cell depends on how the logic associated with the sum function is defined to interact with image files. For example, the sum function may include logic that allows an image file to be added to another image, resulting in two images positioned side-by-side. In other embodiments, the sum function may include logic that allows an image file to be added to text, resulting in the text positioned above the image. In another embodiment, the sum function may include logic that does not allow an image file to be added to a date value. Accordingly, based on the logic defined in a particular function, the spreadsheet application can identify the types of values that can and cannot be used. If a value that cannot be used is passed through that function, an error will result. Accordingly, the disclosed spreadsheet application 110 may display an error, either upon completion of the formula definition or in real-time, indicating that the value is incompatible. This may be in the form of an error string or it may be a display format that indicates the value is an error (e.g. bold red text). The error may additionally be displayed in the formula bar in which the formula is constructed. Construction of a formula in the formula bar is described with further detail with reference to
Furthermore, in the example provided herein, for the formula “=3 meters+A1), the value stored in cell A1 must have the unit “meter” or be of the type “distance.” Accordingly, if the value stored in cell A1 has a type “distance,” the disclosed the spreadsheet application 110 can still perform the sum operation by performing a unit conversion such that the two values may be added together. Such aspects are described in further detail herein with reference to
In yet another example, a formula definition itself may include parameters having expected types. For example, a loan calculation formula may include parameters such as an interest rate (percentage type), a principal amount (currency type), and a term (duration type). Any entry of a value, for each parameter, that is not of the expected type would result in an error. Accordingly, an error message may be displayed dynamically as the formula is constructed and values are specified. Alternatively, such an error or displayed error message may be provided after construction of the formula.
In addition to identifying errors within formulas, the disclosed spreadsheet application 110 can further identify inconsistent values stored in one or more columns and rows. In some embodiments, the spreadsheet application 110 may detect labels in header cells (e.g., the “city” label representing the type “city geo-location”) in the header cell C1 504) or it may detect patterns in multiple cells of a row or column (e.g., if each cell C2-C5 506 individually includes unit or type information) to identify inconsistencies in entered values. As illustrated in
In some embodiments, the spreadsheet application 110 may include an example audit mode that enables a quick review of units or types applied to cells throughout the spreadsheet. Such an audit mode, if selected, may cause the spreadsheet application 110 to review the data and corresponding units and types stored in the entire spreadsheet and display any inconsistencies. In an example, inconsistencies discovered may be viewed from the spreadsheet as, for example, a highlighted cell or bold, red font that alerts the user of the inconsistency. As described herein, inconsistencies may be discovered through the analysis of headers, data patterns, or other relevant techniques. In audit mode, all cells having values that may be of an inconsistent unit or type may be highlighted or otherwise brought to the user's attention. For example, a cell including a time value may be highlighted if entered in a column representing weight values. This may be useful if one or more cells may be hidden and identification of the type of data may be difficult to ascertain. Although highlighting is described, any other appropriate method may be used to distinguish where the errors or inconsistencies might be located in the spreadsheet or spreadsheets. Such aspects may act on both visible and hidden data.
The spreadsheet application 110 may also warn the user about unit display inconsistencies. For example, if a value without a unit is entered in a column of values having units, a warning screen may be displayed indicating the inconsistency. Alternatively or additionally, if a value with a unit is entered in a column of values without units, a warning screen may be displayed indicating the inconsistency. Alternatively or additionally, if a value without a unit is used in a formula with a value having a unit, a warning screen may be displayed indicating the inconsistency. The spreadsheet application 110 may further suggest units for values without units entered in a column or row of one or more values having units.
Accordingly, the disclosed spreadsheet application 110 recognizes unit and type information and how such information propagates throughout the spreadsheet. Accordingly, an incorrect or inconsistent entry can be more readily identified. Such identification of inconsistent values may further minimize errors and the propagation of such errors throughout a spreadsheet. By leveraging unit and type information, the spreadsheet application 110 can prevent spreadsheet errors and calculation errors by identifying such inconsistencies.
The method 600 begins at the start operation. The method 600 proceeds to the identify units and types operation 602. In the identify units and type operation 602, an identification component (e.g., identification component 112) scans the values stored in the spreadsheet to identify rich data values. In particular, the identification component may determine the unit (e.g., “meters”) or the corresponding type (e.g., “geo-location”) associated with each cell. The identification component may also identify a header cell or cells having a label referencing a particular unit or type that would be applied to a multiple cells of a column or row. The identification component may also identify whether a particular unit or type is applied or set to an entire row or column, regardless of whether a value is actually entered in cells of that row or column. In an example, for a column header containing the unit “seconds” the identification component identifies the unit (seconds) and even the corresponding type (duration) and applies that information to each cell within that column.
The identify units and types operation 602 may also identify patterns in values stored in the spreadsheet. In particular, determining inconsistencies in values may be performed by initially identifying at least two or more cells storing values, each having a unit or type associated therewith. Accordingly, in the identifying units and types operation 602, the identification component may identify two or more contiguous cells organized in columns or rows that contain values having units or an associated type.
In the units or types identified operation 604, the identification component determines, based on the analysis performed in the identify units and types operation 602, whether the spreadsheet includes two or more contiguous cells organized in columns or rows that contain units or types (i.e., rich data values). In another embodiment, the identification component If, in the units identified decision operation 604, the identification component determines that the spreadsheet does not include two or more cells organized in columns or rows that contain units or types, the method 600 ends. If, alternatively, in the units identified decision operation 604, the identification component determines that the spreadsheet does include two or more cells organized in columns or rows that contain units or types, the method 600 proceeds to the identify unit and type operation 606.
In the inconsistent value operation 606, the identification component determines whether a value, within the identified row or column of contiguous cells, has a unit or type that is different from the identified unit or type of that row or column. Continuing the example from above, for a column header containing the label “kilograms” the identification component identifies “kilograms” as the unit applied to each cell within that column. Thus, a value stored in a cell within that column having, for example, the unit “pounds” would be identified as an inconsistent unit (even though it is within the same “weight” type). In another example, if two contiguous cells of a column store values of the type “NFL team” (e.g., “Seattle Seahawks” stored in cell C1 and “Denver Broncos” stored in cell C2), the value “New York Knicks” (having type “NBA team”) stored in cell C3 would be identified as an inconsistent type.
If the identification component determines that a value has a unit or type that is different from the identified unit or type of that row or column (YES at operation 606), the method 600 proceeds to the display warning message operation 608. In the display warning message operation 608, a display/UI component (e.g., display/UI component 116) displays a warning message (such as, for example, warning message 510 of
If, alternatively, the identification component determines that no value has a unit or type that is different from the identified unit or type of that row or column (NO at operation 606), the method 600 ends.
As should be appreciated, operations 602-608 are described for purposes of illustrating the present methods and systems and are not intended to limit the disclosure to a particular sequence of steps, e.g., steps may be performed in differing order, additional steps may be performed, and disclosed steps may be excluded without departing from the present disclosure.
In particular, the disclosed spreadsheet application (e.g., spreadsheet application 110) is capable of converting values to different units, where possible. For example, the disclosed spreadsheet application can convert, automatically or in response to user input, “500 seconds” to “8.33 minutes.” In another example, the spreadsheet application can convert the value “Chipotle” (of type “restaurant”) to its particular location or to its annual earnings. In yet another example, the spreadsheet application can convert “28.7 miles” to “46.19 kilometers.”
As described herein, conversions may be performed among units sharing the same type and cannot be performed outside of a particular type. For example, conversions can be performed among units that belong to the “distance” type. For example, conversions can be performed among units “nm, in, ft, m, yd, mi” because they belong to the same “distance” type. However, conversions cannot be performed among units of different types. For example, conversions cannot be performed between the unit “cm” and unit “oz” because they belong to different types. In particular, the unit “cm” is within the “distance” type while the unit “oz” is within the “weight” type. In another example, values belonging to the type “geo-location” can be converted. For example, the value “Chicago” is of type “geo-location” and can be converted to latitude/longitude coordinate value, which is also of type “geo-location.” Furthermore, the value “Chicago” or the latitude/longitude coordinate value may be converted to a population value, which is also of type “geo-location.” However none of these values can be converted to, for example, a value belonging to the weight type.
It is further understood that although conversions cannot be performed among units of different types, other calculations including units belonging to different types may still be performed. For example, multiplication and division calculations can be performed using values having units that belong to different types. For example, the unit “meter” (type “distance”) can be divided by the unit “second” (type “duration”) to arrive at “meters/second” which is yet another unit having a type of “distance/duration.” In some examples, these rules are implemented in the formula itself (e.g., in the multiplication formula) or logic may be provided in, for example, the reference table 300. Conversion logic may describe, for example, how to perform conversions, such as, for example, using a base multiplier, using an API to call an online service. The reference table 300 may additionally or alternatively store calculation logic. For example, the reference table 300 may store the logic to perform various calculations involving each unit or type. In an example, the reference table 300 may also store calculation logic describing how to multiply the value “300 meters/second” with the value “20 seconds” to obtain a resultant value of “6000 meters.” The reference table 300 may additionally or alternatively store conversion and calculation rules. For example, the reference table may calculation store rules identifying the types of conversions or calculations that can be performed for each unit or type and the types of conversions or calculations that cannot be performed for each unit or type. In yet other embodiments, such logic or rules may be stored in the actual formula itself. For example, conversion formulas may store conversion logic to perform conversions and the rules associated with convertible values. Additionally, in another example, mathematical formulas may store separate logic and rules associated with the respective formula. In other embodiments, the logic and rules may be stored in another table, it may be stored in storage (e.g., storage 122), or provided in a database executing on a remote computing device and accessible by the spreadsheet application.
It is further understood that in some embodiments, conversion and mathematical formulas may both be used to arrive at a particular solution. For example, a formula multiplying a value having a unit “m/s” with a value having a unit “1/km” would initially convert the “m/s” value to “km/s” or the “1/km” value to “1/m” in order to perform the necessary multiplication. These examples are described in further detail herein.
Referring back to
As further illustrated in this example, the spreadsheet application 110 can provide an option 708 prompting the user to identify the unit in which resultant answer should appear. Although the option 708 illustrates two options (e.g., “conversion to [lb]” and conversion to [kg]), it is understood that aspects provided herein are not so limited. The message 708 may include an option to convert the resultant value to another unit of the same type. Based on the user's selection, the spreadsheet application 110 will first perform the appropriate conversion to a common unit, then will perform the addition calculation, as illustrated in
It is understood that if no option is selected, or if no option to select a unit is provided, the spreadsheet application 110 may automatically perform the necessary conversion. In particular, the spreadsheet application 110 may automatically convert the first listed value to a value having the same unit as the second listed value, or vice versa. The spreadsheet application 110 may also display the result in either unit. In yet another example, the spreadsheet application 110 may convert and display the result to a value having the same unit as the unit appearing in the greatest number of arguments. In another example, the spreadsheet application 110 may convert and display the result to a unit resulting in a reasonable order of magnitude (e.g., showing the value in kilometers rather than nanometers). Alternatively, in another example, the spreadsheet application 110 may convert and display the result to a predetermined unit.
Accordingly, the disclosed spreadsheet application 110 can perform complex conversions of data having different units. The spreadsheet application 110 can further analyze mathematical equations to identify whether values must be converted and automatically perform those conversions in order to perform the necessary calculations.
The method 800 begins at the start operation and proceeds to the unit identification operation 802. In the unit identification operation 802, an identification component (e.g., identification component 112) identifies each of the units referenced in the formula. For example, a formula may include one or more cell references, wherein those cells store rich data values having units or types. Accordingly, the identification component identifies each cell referenced in the formula and identifies each unit associated with each referenced cell. In some embodiments, this identification requires assessing the unit/value table associated with a referenced cell, such as unit/value table 206 illustrated in
In the conversion required decision operation 804, a math component (e.g., math component 114) determines whether unit conversion is required. In particular, the math component may analyze the formula to determine whether that formula requires each value to have consistent or specific units. In an example, the math component may determine that a “SUM” formula requires each value of the formula to have consistent units. In another example, the math component may determine that a “PRODUCT” formula does not require each value of the formula to have consistent units. Other formulas may not necessarily require common units, but may require specific units. For example, a net present value formula may include a currency value, an interest value, and a time value. Accordingly, based on a determination that the formula does not require each value to have consistent or specific units (NO decision at operation 804), the method 800 proceeds to the perform calculation operation 812. If, alternatively, the math component determines that the formula does require each value to have consistent or specific units (YES decision at operation 804) the method 800 proceeds to the identify common unit operation 806.
In the identify common unit operation 806, the math component identifies the unit to which each identified value must be converted. As described herein, a formula may require that values have consistent units and other formulas may require that value have a specific unit. In the example in which consistent units are required, the user may select such a common unit. For example, a display/UI component (e.g., display/UI component 116) may provide a user interface having an option to select a desired unit to which the identified values are to be converted. For example, in the formula “2 meters+3 feet,” the user may have an option to convert the value “2 meters” to a value in feet, the value “3 feet” to a value in meters, or both values to a value in another common unit. In other embodiments, the math component 114 may select the most recurring unit in the formula as the common unit. Yet in other embodiments, the math component may identify a predetermined unit as the common unit. Conversion to a common unit is further described with reference to
Similarly, the math component identifies values referenced in the formula that are required to be specific values. In the net present value formula example, the currency value may be expected in dollars. Accordingly, for a cell storing a currency value in Yen, the math component identifies that referenced cell requiring conversion to the specified Dollar unit. Alternatively or additionally, the user may select the specified value. In the net present value example, the user may select an option to obtain the net present value in British Pounds. Accordingly, a cell referenced in the formula that stores a value in Dollars must be converted to British Pounds.
In the convert identified values operation 808, the math component converts each value identified in operation 806 to the necessary value. In particular, this might involve using the conversion logic and rules, stored in the reference table (e.g., reference table 300) to perform the conversions. As described herein, conversions may involve more than one conversion step. In an example, converting a value having the unit “km” to a value having the unit “cm” may require first converting the value in “km” to a value having the base unit “m” and thereafter converting the value in “m” to a value in “cm.” Furthermore, conversions may require calling a service, such as, for example, identifying the most recent currency rate of the Dollar to the Yen. This may be performed, for example, by calling an API to an online database that is dynamically updated.
In the each value represented in the desired unit operation 810, the math component determines whether each value in the formula has been converted to the common or specified unit, as identified in operation 806. If each value has not been converted to the common or specified unit (NO decision at operation 810), the method 800 proceeds to the convert identified values operation 808 until each value in the formula is converted to the common or specified unit. If, alternatively, each value has been converted to the common or specified unit (YES decision at operation 810), the method 800 proceeds to perform calculation operation 812 in which the math component performs the calculation. After performing the calculation, the method 800 ends.
As should be appreciated, operations 802-812 are described for purposes of illustrating the present methods and systems and are not intended to limit the disclosure to a particular sequence of steps, e.g., steps may be performed in differing order, additional steps may be performed, and disclosed steps may be excluded without departing from the present disclosure.
In particular, aspects of the present disclosure provide a spreadsheet application that enables the easy and intelligent application of units to values. Specifically, based on an entry of a value to a cell, using a formula bar or other user interface, the spreadsheet application may provide, in real time, a pre-populated list of suggested units from which the user may select to apply.
Referring now to
As described herein, suggestions may be displayed based on an identification of an entry that corresponds to a predefined pattern. In an example, a predefined pattern may be, for example, a value followed by a space, or a value followed by a space, and followed by a letter. In the example illustrated in
Referring back to
In the embodiment in which a value without a corresponding letter is entered (e.g., only the value “500” is entered into cell C2 902), the spreadsheet application 110 may still provide a unit suggestion menu 904 including a list of selectable units. The unit suggestion menu 904 may be intelligently populated with a list of selectable units based on an understanding of the data in the spreadsheet itself. For example, if the spreadsheet contains financial budgeting information, the spreadsheet application 110 may provide a unit suggestion menu 904 containing a list of currency units and duration units, while not providing units relating to distance, weight, or temperature. In other embodiments, the unit suggestion menu 904 may be populated with a list of units based on the units applied to cells in that same column or row or adjacent cells. As described herein, the spreadsheet application 110 may analyze header values and surrounding values, for example, to obtain contextual cues relating to the type of data entered in the spreadsheet in order to intelligently provide suggestions.
The unit suggestion menu 904 may also surface most recently used units. Thus if a user has been using meters for recent entries, that unit may be classified as a most recently used type and be offered, possibly ahead of other units.
It is understood that the particular organization of the unit suggestion menu 904 is merely illustrative and other such organizations are also contemplated by the present disclosure.
In this particular example, illustrated is a unit suggestion menu comprising compound unit suggestions. Compound units are, for example, units comprising two or more distinct units. Units such as “miles per hour,” “dollars per hour,” “miles/gallon,” “ft. lbs,” “kg/sec{circumflex over ( )}2” are examples of compound units. As described herein, based on a user's entry of a predefined pattern, the spreadsheet application 110 may provide a unit suggestion menu including compound unit suggestions.
Referring back to the example illustrated in
In some embodiments, the unit suggestions menu 904 is dynamically updated based on the further entry of data. For example, based on a user's entry of “500 m” the unit suggestions menu 904 may contain a list of possible values such as “meters, miles, minutes, etc.” As the user continues to type “500 meters per” the unit suggestions menu 904 may automatically and dynamically update to contain a different list of possible values.
Suggestions provided in a unit suggestions menu may be based on, for example, information contained in the column or row header, surrounding cells, or an understanding of the information provided in the spreadsheet. For example, the unit associated with the value “3 m” could represent miles, meters, minutes, megawatts, etc. Alternatively or additionally, the value “3” by itself may be associated with any unit of any type. Accordingly, the disclosed spreadsheet application 110 may analyze the column or row within which the cell containing the entered value resides to identify patterns or units indicated in a header, scan surrounding cells, or scan the entire spreadsheet to identify context associated with the entered value in order to narrow and prioritize the list of units provided in the unit suggestion menu 904. The spreadsheet application 110 may further analyze the format of the cell itself or a surrounding cell to further identify context in an effort to narrow or prioritize the list of units provided in the unit suggestion menu 904. For example if the data entered in a cell is “2:10” it is likely representative of a time value rather than a distance value.
The spreadsheet application 110 may also provide and prioritize, in the unit suggestion menu 904 units already used in the spreadsheet or units used in the same row or column. The spreadsheet application 110 may further provide and prioritize units from the same type as used in the spreadsheet or the same row or column. For example, if a column includes values having the unit “feet” and a user types “3 c” the spreadsheet application 110 may provide and prioritize, in the unit suggestion menu 904, the unit “centimeter” which is of the same type (“distance”) as the unit “feet” rather than, for example, the unit “Celsius” which is of a different type (“temperature”).
The spreadsheet application 110 may further leverage natural language parsing to take contextual clues from column or row headers to provide and prioritize a list of possible units in the unit suggestion menu 904. For example, a cell under a column header having the word “distance” or “miles” is more likely to contain a distance value. Accordingly, the spreadsheet application 110 may provide and prioritize, in the unit suggestions menu 904, units of a distance type.
Additionally, the spreadsheet application 110 may suggest more complex units that have already been applied to cells of the spreadsheet (or applied by the user in another spreadsheet) despite the infrequent usage of such units. For example, the spreadsheet application 110 may suggest the unit “feet/hour” if such a unit was previously applied, despite such a unit being an infrequently used unit. As will be described in further detail herein, the disclosed spreadsheet application 110 may also provide, as a suggestion, user defined units. In particular, a user may construct a unit that is not provided by the spreadsheet application 110. The disclosed spreadsheet application 110 may also suggest such user defined units in the unit suggestion menu 904.
Referring back to
In another example, based on a high confidence that the unit to be applied should be “meter,” because all units in that column are “meter,” the unit suggestion menu 904 may not display alternative suggestions. Even more, based on entry of the value “500,” the unit “meter” may automatically be applied. Accordingly, faster data entry may be achieved.
The spreadsheet application 110 may further analyze supporting information in order to assist the user in correcting potential errors. For example, if the value “4 kg” is entered in a cell of a column containing, for example, values having different units or values having units of a different type, the spreadsheet application 110 may suggest alternative units to maintain consistency.
Accordingly, the disclosed spreadsheet application 110 is capable of automatically and dynamically providing a user with a narrow and prioritized list of suggested values to assist the user in data entry. Providing such a list of units that may be quickly and easily applied to the particular cell or cells enables the user to more efficiently enter data into a spreadsheet. Furthermore, providing such a list of possible values based on an intelligent understanding of the data entered and the surrounding data reduces the risk of erroneously applying the wrong unit to a cell.
The method 1000 begins at a start operation and proceeds to the typing detected decision operation 1002. In the typing detected decision operation 1002, the spreadsheet application (e.g., spreadsheet application 110) identifies whether a value is being entered into a cell, formula bar, or other value entry user interface. If the spreadsheet application 110 determines that no typing is detected (NO at operation 1002), the method 1000 ends.
If the spreadsheet application determines that typing is detected (YES at operation 1002), the method 1000 proceeds to the pattern detected decision operation 1004. In the pattern detected decision operation 1004 an identification component (e.g., pattern detection component 116) determines whether the entry matches a predetermined pattern. For example, a predetermined pattern may be the entry of a value followed by a space, or the entry of a value followed by a space, and followed by a letter. A predefined pattern may further be the entry of a value followed by a space, followed by a unit, followed by “per” or “/”. A pattern may also be described as a pattern of values entered in the spreadsheet, such as, for example, units entered in surrounding cells, units or type information provided in header cells, etc. If the pattern detection component determines that no pattern is detected, the method 1000 proceeds to the typing detected decision operation 1002.
If the pattern detection component determines that a pattern is detected (YES at operation 1004), the method 1000 proceeds to the display unit suggestions operation 1006. In the display unit suggestions 1006 a display/UI component (e.g., display/UI component 116) may display units in a unit suggestion menu, such as unit suggestion menu 904 illustrated in
If the pattern detection component determines that a pattern is not detected (NO at operation 1004), the method 1000 proceeds to the typing detected decision operation 1002. Accordingly, if no pattern is detected, further entry of a value or unit information may need to be provided to detect a pattern in the pattern detected operation 1004.
As should be appreciated, operations 1002-1006 are described for purposes of illustrating the present methods and systems and are not intended to limit the disclosure to a particular sequence of steps, e.g., steps may be performed in differing order, additional steps may be performed, and disclosed steps may be excluded without departing from the present disclosure.
In an example embodiment, the disclosed spreadsheet application includes an edit mode that allows entry of values into cells while maintaining the unit associated with those cells. Such an edit mode allows users to more efficiently and quickly enter data without requiring the user to re-type the unit for each entry in a different cell. For example, a user may edit or add a value to a cell without deleting the associated unit.
Referring back to
Furthermore, in an example embodiment, if a user edits the unit part, then the value may be converted. In this example, if the user enters “5 feet” in a new cell within the column of values corresponding to meters, the new value might be converted to a corresponding value in meters so as to maintain consistency with the other values in the same column. In another example, if the unit part of a previously entered value is edited, then the corresponding value may be converted to the new unit. In such examples, the conversion may be done automatically or it may be converted in response to user input.
In this alternative embodiment, the unit part is displayed as a token 1108. In embodiments, the token 1108 may be a selectable user experience that is positioned outside of the cell in which the value part 1104 resides, however the token 1108 may also be positioned within the cell. The token 1108 may be a user experience that, when selected, provides options to edit the displayed unit or delete the token entirely. Similar to the example illustrated in
Overtyping is the ability to delete or edit the unit part of a cell. As described with reference to
In the example illustrated in
In the example illustrated in
As described herein, the spreadsheet application provides the ability to provide rich data values in a spreadsheet. The spreadsheet application further provides the ability to provide and parse rich data values into the formula bar of the spreadsheet application. The formula bar is a toolbar that displays values and formulas associated with a selected cell. The formula bar also provides the ability to enter and edit values and formulas in a cell or range of cells. The disclosed spreadsheet application also provides the ability to display, enter, and edit rich data values in a cell or range of cells using the formula bar.
As described herein, a problem with current spreadsheet applications is the blind performance of calculations without regard for unit information, yielding unpredictable, and oftentimes erroneous results. The present spreadsheet application 110 solves this problem by identifying the unit or type associated with each parameter listed in a formula and performing, if necessary, any conversions prior to the calculation, thereby reaching a correct result. Referring back to
In this particular example, the formula 1304 is a sum function, which requires all parameters to have the same unit in order to perform the calculation correctly. As described herein, the formula 1304 is a sum function adding five parameters: cell A2 1306 (containing value “3 feet”), A3 1308 (containing the value “2 feet”), A4 1310 (containing the value “6 feet 2 in”), the value “3 m”, and the value “2 feet.” As illustrated in this example, the parameters of the formula 1304 are of the same type “distance” but do not have consistent units. In particular, the values stored in cells A2 1306, A3 1308, and the value “2 feet” are of unit “feet;” the value stored in cell A4 1310 is a compound unit including the units “feet” and “in;” and the value “3 m” is of the unit “m.” Accordingly, the disclosed spreadsheet application 110 must first convert the values to a common unit before adding the values. The disclosed spreadsheet application 110 may first parse the formula 1304 to identify each parameter and the unit or type associated therewith. For each cell parameter (e.g., cells A2-A4) referenced in the formula 1304, the spreadsheet application 110 may look to the associated unit/value table (e.g., unit/value table 206) and the reference table (e.g., reference table 300) of the cell to ascertain the associated unit or type. The spreadsheet application 110 may further parse the formula 1304 to identify parameters that are not stored within a particular cell and therefore do not have an associated unit/value table. For example, the formula 1304 includes the parameters “3 m” and “2 feet” that are not associated with a cell. The spreadsheet application 110 may, for example, implement language parsing to identify both the value and the unit or type of such parameters. Accordingly, the spreadsheet application 110 may convert values to a common unit in order to perform calculations correctly. Converted values may be temporarily stored in cache in order to perform the calculation so as to not modify the actual values stored in the spreadsheet. In this example the result is provided in cell C2 1312. In this example, the result is provided as a value having the unit “feet,” however the value may be provided in another unit, as desired.
For those parameters of the formula 1304 that are not stored in a cell (e.g., the parameter “3 m” and “2 feet”), the spreadsheet application 110 may implement language parsing to identify the unit of such parameters (e.g., “m” and “feet”). The spreadsheet application 110 may use a reference table, such as reference table 300 to match the unit of those parameters to a unit stored in the reference table 300. As is also illustrated, the unit “m” is written in shorthand and the unit “feet” is written fully. The disclosed spreadsheet application 110 can recognize such units written in different formats. In an example, the spreadsheet application 110 can use the reference table 300 in conjunction with an understanding of the context of the formula 1304 to most closely match the associated unit. For example, the spreadsheet application 110 may correlate the shorthand unit “m” to the unit “meter” rather than, for example, the unit “mile” which also begins with the letter “m,” based on an understanding of the units used in the formula 1304. In particular, the spreadsheet application 110 may associate “m” to “meter” rather than “mile”, for example, because of an analysis of the units used in the formula 1304 correspond to shorter distances. The spreadsheet application 110 may also notify the user of the selected unit and provide an option to change the unit.
Accordingly, aspects of the present disclosure leverage the disclosed conversion tables, such as reference table 300, to support rich data types in formula string creation.
The disclosed spreadsheet application can leverage rich data types to guide users in creating valid formulas. As described herein, the disclosed spreadsheet application 110 can leverage rich data types to recognize the type of values stored in the spreadsheet. In an example, the spreadsheet application 110 can leverage the unit/value table associated with each cell storing a rich data value to recognize the unit or type associated with each value. Accordingly, in the example embodiment illustrated in
In another example, the user may be in the process of providing a cash flow formula having parameters such as “total income” and “total expenses.” In such an example, the cash flow function requires that the input parameters be of the same type (e.g., currency) and requires specific currency values to be used for each parameter (e.g., income values can only be used for the first parameter and expense values can only be used for the second parameter). Accordingly, in such an example, the cells having a type different from the required currency type may be dimmed out (e.g., the cells containing text). Even further, cells that store currency values that correspond to expenses may also dimmed out for the first parameter because the first parameter to be provided is an income value (or values), while income values may be dimmed out for the second expense parameter. Accordingly, the user may easily see which values are available to use during construction of the formula. The user may select a cell or a range of cells, which individually correspond to income or expenses or the user may select a cell storing a total income or a total expenses value. Although highlighting and dimming cells is illustrated in
Such features to emphasize or deemphasize cells during formula construction allow users to readily and easily see valid input parameters. This further minimizes errors by minimizing the risk that an invalid input parameter might be entered.
The disclosed spreadsheet application 110 enables users to provide compound values in the spreadsheet, wherein a compound value includes multiple values and associated units or types (e.g., “1 minute 23 seconds” or “3 years 40 days”). In embodiments, the spreadsheet application 110 treats a compound value as a compound object, which is, for example, a data value described in U.S. Provisional Patent Ser. No. 62/249,884, entitled “Compound Data Types” and in U.S. Provisional Patent Ser. No. 62/357,292, entitled “Compound Data Objects” the disclosures of which have been incorporated herein by reference in their entirety. As described therein, a compound object is a value that stores multiple values in a single cell, wherein those multiple values may be rich values and are organized according to a defined structure. Accordingly, in some embodiments, compound values are stored as compound objects comprising two or more values and associated units (e.g., “3 days 2 hours 7 minutes”, “4 feet 7 inches”, “3 meters per 2 feet”) or types into a single cell and organized according to a defined data structure. For example, the value “1 minute 2 seconds” may be stored in a compound object as an array of unit/value pairs (e.g., unit=minute, value=1; unit=second, value=2) or a single unit/value pair (e.g., unit=second, value=62). In some embodiments, the units or types associated with each of the two or more values differ and in other embodiments, the units or types are the same.
In an example embodiment, the spreadsheet application 110 parses compound values, which may be treated like compound objects, to identify each individual value stored therein. Identification of each value and associated unit or type of a compound value allows the spreadsheet application 110 to pass the compound value to a formula, perform conversions on those compound values, provide autosuggestions for compound value completion, etc. As will be appreciated, each individual part of the compound value can be operated on or edited independently as well as the sum total of the individual components of a compound value. For example, the value “5 days 4 hours 32 minutes 17 seconds” can be converted to a single unit of time and used by some other cell or feature of the spreadsheet application, while in other embodiments, the “4 hours” part can be individually referenced.
Now referring to
As illustrated, the compound value “500 minutes 2 seconds” includes two units: minutes and seconds. In an example, the spreadsheet application 110 parses the compound value to identify each unit as well as each associated value. Based on this identification, the spreadsheet application 110 can use the disclosed reference table, such as reference table 300 as illustrated in
In the illustrated example, the compound value “500 minutes 2 seconds” stored in cell C2 1402 is added to the non-compound value “0.25 hours” stored in cell C3 1404. In this example, the two values are passed to the sum function, which requires the values to have common units. Accordingly, the spreadsheet application 110 can, for example, convert the compound value “500 minutes 2 seconds” to a single value in “hours.” In other embodiments, both values can be converted to another common unit. In some embodiments, the converted values can be stored in a cache so that the spreadsheet application 110 can maintain the original values in the cells while performing the final calculation. In other embodiments, the spreadsheet application 110 can change the original values in the cells to the converted values. In this example, based on a conversion to a common unit, the spreadsheet application 110 can perform the sum function operation to arrive at a valid result, stored in cell C4 1406. In this embodiment, the resultant value stored in cell C4 1406 is a compound value “515 minutes 2 seconds”, however in other embodiments, the resultant value may be displayed as a single value in “hours.” In some embodiments, the user may specify the desired unit (or units for compound values) in which the result is to be displayed, and in other embodiments, the spreadsheet application 110 may provide the result in a predetermined unit. Accordingly, the disclosed spreadsheet application 110 enhances the user's experience by allowing the user to enter data as it is naturally written without requiring the user to perform any conversions.
In some embodiments, the spreadsheet application 110 may tokenize the units of a compound value to provide an enhanced editing experience. As described herein, a token is a selectable user experience that displays a unit and may be positioned next to the value in which that unit represents. In some embodiments, the token, when selected, provides options to change the displayed unit to another unit within the same type or delete the unit entirely. If a user changes the unit displayed on the token, the corresponding value will also change. For example, a cell may store the value “60 minutes 5 seconds” wherein the “minutes” and “seconds” units are tokenized. In such an example, the user may elect to change the “minutes” unit to “hours” which would change the “60” value to “1”. In other words, the spreadsheet application 110 would convert the value “60 minutes” to “1 hour” to thereby display “1 hour 5 seconds” in the cell.
Referring now to
Accordingly, by understanding the type, the spreadsheet application 110 can provide a user experience that guides the user in entering such information in the appropriate display pattern. In an example, if a type having a particular display pattern is detected based on, for example, an analysis of the data stored in the spreadsheet, column or row headers, etc. the spreadsheet application 110 can provide a user experience to assist the user in entering data in the appropriate format. In another example, a user may set a particular cell, cells, column, or row to a particular type. Based on an understanding of the type, the spreadsheet application 110 can provide, for example, blank spaces, dashes, colons, or other types of display formatting that allows the user to visualize the display pattern and guides the user in entering data. As illustrated in
Alternatively or additionally, the particular display pattern may be applied to data previously entered. In particular, if data was previously entered and a user, for example, sets that particular cell, cells, column, or row containing that data to a particular type, the value may change display accordingly. Furthermore, the spreadsheet application 110 can provide an “overtype” experience that queries the user to change the type or notify the user that a strict type pattern is violated. In an example, the spreadsheet application 110 can warn the user when a non-numeric character is entered in a cell that is of a credit card type that has no non-numeric characters. The spreadsheet application 110 may also implement display patterns for user-defined units and types.
Further aspects of the present disclosure provide the ability for a user to enter data into the spreadsheet and receive a different display representation of that data. For example, based on the determination, by the spreadsheet application 110, of a cell or cells associated with a type having a particular display pattern, the spreadsheet application 110 can return a display representation of entered data in the identified display pattern. For example, if the spreadsheet application 110 determines that a cell is of the credit card type, the spreadsheet application 110 may return a display representation of those numbers in the appropriate pattern. In another example, the spreadsheet application 110 may determine that a column is of the type “distance” having a particular pattern (e.g., “—————— feet —————— inches”) the spreadsheet application 110 can receive values, which may be in a particular pattern, such as, for example, “3′7″,” and return a display representation of that entry as “3 feet 7 inches.” In yet another example, based on a determination that a cell storing the name of a city is of the type “geo-location,” the spreadsheet application 110 may return a display rendering of a map indicating the location of that city. Such a display rendering may be obtained from, for example, calling an API for an online service that can provide such a display rendering.
An enhanced understanding of the type of data that is present facilitates improved autosuggest results when entering data. As described herein, the disclosed spreadsheet application 110 includes types, including, for example, a geo-location type that includes, for example, cities, states, provinces, countries, continents, etc. Each geo-location type may additionally have a wealth of context associated therewith, for example, a latitudinal/longitudinal location, population, airport names, airport codes, government information, etc. Such information may be stored in a local or online database that is different from the reference table 300. In particular, the reference table 300 may include a reference to a city, but that reference table 300 may additionally point to a database, either local or online, that stores additional context and relationship information.
Referring back to
Additionally, the disclosed spreadsheet application 110 can use contextual cues from the spreadsheet to prioritize suggestions. For example, if all the cities entered in a particular column are from a particular state, the spreadsheet application 110 can return, based on an analysis of the cities stored in that column, a prioritized list of cities from that state in the autosuggestion drop-down menu 1504
As described herein, the disclosed spreadsheet application 110 allows users to define data types (i.e., user defined extensible data types). The spreadsheet application 110 may also allow users to provide data that could be suggested for a given user-defined data type. This suggested data could be stored locally or may be provided from another application or an online service. In the example illustrated in
In particular, the disclosed spreadsheet application is capable of applying special formatting to rich data values. In an example, cells storing rich data values may be specially aligned such that unit labels are aligned in a particular column. In another example, unit labels may be of a different format, font, or color independent of the associated value (e.g., italicize or color the unit labels). The disclosed spreadsheet application 110 may also provide the ability to have different formats displayed for the same unit (e.g., “meter,” “Meter,” “m,” “M” could be alternatively used for the same unit).
Aspects of the disclosed spreadsheet application 110 also provide the ability to apply formatting based on the unit or value of the cell. For example, a cell that stores a value in a particular unit may be highlighted (e.g., any cells having the unit “lbs” may be highlighted, bolded, or may have different textual coloring). Still further, another cell or cells that store a particular value may be highlighted, in the same or different color (e.g., highlight, color, bold, italicize, underline, or otherwise format all cells having values above, at, or below a particular value).
Referring back to
Accordingly, aspects of the present disclosure provide a user with the ability to apply enhanced layout control over rich data values. Such control provides the ability to quickly and easily understand the type of data stored in the spreadsheet.
As described herein, a compound object is a value that stores multiple values in a single cell, wherein those multiple values are organized according to a defined structure. The compound object may store multiple values according to a known data In an example, cell A1 may store a compound object having multiple rich data values according to a data structure such as, for example, a record, table, array, vector, or matrix. Accordingly, any field in a record, array, or table contained in a compound object stored in a cell can be a value of a rich data type. In an example, a compound object storing multiple stock values (one or more of which are rich data values) can be stored in a cell, wherein those values are organized according to a table data structure. In that example, a value may be the ‘high’ price of the stock. That high price can be a currency rich data type and that currency rich data type can be dynamically updated via an API call to a service. In another example, a compound object storing multiple values according to an array data structure may include several values of the type “geo-location” and store information about a particular city. In this example, the “geo-location” type may be associated with further information, such as for example, the geographical coordinates of that city and the population of the city. Accordingly, in this example, the compound object may have at least three values: the name of the city, the geographical coordinates of the city, and the population of the city. Accordingly, a compound object may store multiple rich data values in a single cell. Furthermore, in this example, each rich data value stored in the compound object may be individually referenced and used in calculations. For example, a formula may be defined as, for example, “=A1.population,” which returns the population stored in the compound object stored in cell A1. This example formula (e.g., “=A1.population”) references the cell (e.g., “A1”) in which the compound object is stored and a reference to the desired value (e.g., “population”) stored in the compound object. Thus, such a formula can be used to reference a rich data value among multiple values (rich data values or non-rich data values) stored in a compound object, which is stored in a single cell. In this example, the value associated with the population attribute, for example may be a dynamic value and subject to change. Accordingly, the value may be derived from a local or online database to obtain most up-to-date population data associated with that city. Accordingly, the disclosed spreadsheet application 110 also allows users to enrich their spreadsheets by obtaining data stored locally or from an online database.
Referring back to
Furthermore, in the example illustrated in
Although the examples illustrated herein describe a compound object that stores multiple values that are associated with an online database, it is understood that such association with an online database is not required and is merely exemplary. For example, a compound object may store values associated with a record of a person. In an example, a compound object may store two values: a person's first name and last name. Neither of those values represents volatile data that is subject to change and therefore would not be associated with an online database that updates the corresponding value.
The computing device components described below may have computer executable instructions for implementing a spreadsheet application 1820 on a computing device (e.g., server computing device 108 and/or client computing device 104), including computer executable instructions for spreadsheet application 1820 that can be executed to implement the methods disclosed herein. In a basic configuration, the computing device 1800 may include at least one processing unit 1802 and a system memory 1804. Depending on the configuration and type of computing device, the system memory 1804 may comprise, but is not limited to, volatile storage (e.g., random access memory), non-volatile storage (e.g., read-only memory), flash memory, or any combination of such memories. The system memory 1804 may include an operating system 1805 and one or more program modules 1806 suitable for running spreadsheet application 1820, such as one or more components with regard to
The operating system 1805, for example, may be suitable for controlling the operation of the computing device 1800. Furthermore, embodiments of the disclosure may be practiced in conjunction with a graphics library, other operating systems, or any other application program and is not limited to any particular application or system. This basic configuration is illustrated in
As stated above, a number of program modules and data files may be stored in the system memory 1804. While executing on the processing unit 1802, the program modules 1806 (e.g., spreadsheet application 1820) may perform processes including, but not limited to, the aspects, as described herein. Other program modules that may be used in accordance with aspects of the present disclosure, and in particular for implementing rich data types in a spreadsheet, may include identification component 1811, math component 1813, display/UI component 1815, pattern detection component 1817, etc.
Furthermore, embodiments of the disclosure may be practiced in an electrical circuit comprising discrete electronic elements, packaged or integrated electronic chips containing logic gates, a circuit utilizing a microprocessor, or on a single chip containing electronic elements or microprocessors. For example, embodiments of the disclosure may be practiced via a system-on-a-chip (SOC) where each or many of the components illustrated in
The computing device 1800 may also have one or more input device(s) 1812 such as a keyboard, a mouse, a pen, a sound or voice input device, a touch or swipe input device, etc. The output device(s) 1814 such as a display, speakers, a printer, etc. may also be included. The aforementioned devices are examples and others may be used. The computing device 1800 may include one or more communication connections 1816 allowing communications with other computing devices 1850. Examples of suitable communication connections 1816 include, but are not limited to, radio frequency (RF) transmitter, receiver, and/or transceiver circuitry; universal serial bus (USB), parallel, and/or serial ports.
The term computer readable media as used herein may include computer storage media. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, or program modules. The system memory 1804, the removable storage device 1809, and the non-removable storage device 1810 are all computer storage media examples (e.g., memory storage). Computer storage media may include RAM, ROM, electrically erasable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other article of manufacture which can be used to store information and which can be accessed by the computing device 1800. Any such computer storage media may be part of the computing device 1800. Computer storage media does not include a carrier wave or other propagated or modulated data signal.
Communication media may be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” may describe a signal that has one or more characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media may include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency (RF), infrared, and other wireless media.
One or more application programs 1966 may be loaded into the memory 1962 and run on or in association with the operating system 1964. Examples of the application programs include phone dialer programs, e-mail programs, personal information management (PIM) programs, word processing programs, spreadsheet programs, Internet browser programs, messaging programs, and so forth. The system 1902 also includes a non-volatile storage area 1968 within the memory 1962. The non-volatile storage area 1968 may be used to store persistent information that should not be lost if the system 1902 is powered down. The application programs 1966 may use and store information in the non-volatile storage area 1968, such as email or other messages used by an email application, and the like. A synchronization application (not shown) also resides on the system 1902 and is programmed to interact with a corresponding synchronization application resident on a host computer to keep the information stored in the non-volatile storage area 1968 synchronized with corresponding information stored at the host computer. As should be appreciated, other applications may be loaded into the memory 1962 and run on the mobile computing device 1900, including the instructions for associating one or more images with one or more cells of a spreadsheet as described herein (e.g., identification component, math component, display/UI component, pattern detection component, etc.).
The system 1902 has a power supply 1970, which may be implemented as one or more batteries. The power supply 1970 may further include an external power source, such as an AC adapter or a powered docking cradle that supplements or recharges the batteries. The system 1902 may also include a radio interface layer 1972 that performs the function of transmitting and receiving radio frequency communications. The radio interface layer 1972 facilitates wireless connectivity between the system 1902 and the “outside world,” via a communications carrier or service provider. Transmissions to and from the radio interface layer 1972 are conducted under control of the operating system 1964. In other words, communications received by the radio interface layer 1972 may be disseminated to the application programs 1966 via the operating system 1964, and vice versa.
The visual indicator 1920 may be used to provide visual notifications, and/or an audio interface 1974 may be used for producing audible notifications via an audio transducer 1925 (e.g., audio transducer 1925 illustrated in
A mobile computing device 1900 implementing the system 1902 may have additional features or functionality. For example, the mobile computing device 1900 may also include additional data storage devices (removable and/or non-removable) such as, magnetic disks, optical disks, or tape. Such additional storage is illustrated in
Data/information generated or captured by the mobile computing device 1900 and stored via the system 1902 may be stored locally on the mobile computing device 1900, as described above, or the data may be stored on any number of storage media that may be accessed by the device via the radio interface layer 1972 or via a wired connection between the mobile computing device 1900 and a separate computing device associated with the mobile computing device 1900, for example, a server computer in a distributed computing network, such as the Internet. As should be appreciated such data/information may be accessed via the mobile computing device 1900 via the radio interface layer 1972 or via a distributed computing network. Similarly, such data/information may be readily transferred between computing devices for storage and use according to well-known data/information transfer and storage means, including electronic mail and collaborative data/information sharing systems.
As should be appreciated,
As should be appreciated,
As should be appreciated,
Aspects of the present disclosure, for example, are described above with reference to block diagrams or operational illustrations of methods, systems, and computer program products according to aspects of the disclosure. The functions/acts noted in the blocks may occur out of the order as shown in any flowchart. For example, two blocks shown in succession may in fact be executed substantially concurrently or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved.
The description and illustration of one or more aspects provided in this application are not intended to limit or restrict the scope of the disclosure as claimed in any way. The aspects, examples, and details provided in this application are considered sufficient to convey possession and enable others to make and use the best mode of claimed disclosure. The claimed disclosure should not be construed as being limited to any aspect, example, or detail provided in this application. Regardless of whether shown and described in combination or separately, the various features (both structural and methodological) are intended to be selectively included or omitted to produce an embodiment with a particular set of features. Having been provided with the description and illustration of the present application, one skilled in the art may envision variations, modifications, and alternate aspects falling within the spirit of the broader aspects of the general inventive concept embodied in this application that do not depart from the broader scope of the claimed disclosure.
This application claims priority to U.S. Provisional Application Ser. No. 62/249,869, filed Nov. 2, 2015 and entitled “Rich Data Types; U.S. Provisional Application Ser. No. 62/357,284, filed Jun. 30, 2016, and entitled “Rich Data Types;” U.S. Provisional Application Ser. No. 62/249,884, filed Nov. 2, 2015 and entitled “Compound Data Objects,” and U.S. Provisional Application Ser. No. 62/357,292, filed Jun. 30, 2016 and entitled “Compound Data Objects,” the disclosures of which are incorporated herein by reference in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4815029 | Barker et al. | Mar 1989 | A |
| 5093907 | Hwong et al. | Mar 1992 | A |
| 5148898 | Musachio | Sep 1992 | A |
| 5226118 | Baker et al. | Jul 1993 | A |
| 5255356 | Michelman et al. | Oct 1993 | A |
| 5317686 | Salas et al. | May 1994 | A |
| 5510980 | Peters | Apr 1996 | A |
| 5548703 | Berry et al. | Aug 1996 | A |
| 5717939 | Bricklin et al. | Feb 1998 | A |
| 5848187 | Bricklin et al. | Dec 1998 | A |
| 5850629 | Holm et al. | Dec 1998 | A |
| 5860064 | Henton | Jan 1999 | A |
| 5890174 | Khanna et al. | Mar 1999 | A |
| 5933638 | Cencik | Aug 1999 | A |
| 5983268 | Freivald et al. | Nov 1999 | A |
| 6055549 | Takano | Apr 2000 | A |
| 6065013 | Fuh et al. | May 2000 | A |
| 6088708 | Burch | Jun 2000 | A |
| 6138130 | Adler | Oct 2000 | A |
| 6262736 | Nelson | Jul 2001 | B1 |
| 6282551 | Anderson | Aug 2001 | B1 |
| 6289312 | Raman | Sep 2001 | B1 |
| 6289513 | Bentwich | Sep 2001 | B1 |
| 6292811 | Clancey et al. | Sep 2001 | B1 |
| 6317758 | Madsen | Nov 2001 | B1 |
| 6377965 | Hachamovitch et al. | Apr 2002 | B1 |
| 6415305 | Agrawal et al. | Jul 2002 | B1 |
| 6460059 | Wisniewski | Oct 2002 | B1 |
| 6496832 | Chi et al. | Dec 2002 | B2 |
| 6606633 | Tabuchi | Aug 2003 | B1 |
| 6631497 | Jamshidi et al. | Oct 2003 | B1 |
| 6640234 | Coffen | Oct 2003 | B1 |
| 6701485 | Igra et al. | Mar 2004 | B1 |
| 6779151 | Cahill et al. | Aug 2004 | B2 |
| 6785660 | Fedor et al. | Aug 2004 | B1 |
| 6986099 | Todd | Jan 2006 | B2 |
| 6988241 | Guttman et al. | Jan 2006 | B1 |
| 6988248 | Tang | Jan 2006 | B1 |
| 7007033 | Rothschiller et al. | Feb 2006 | B1 |
| 7047484 | Becker et al. | May 2006 | B1 |
| 7076491 | Tsao | Jul 2006 | B2 |
| 7099890 | Cahill et al. | Aug 2006 | B2 |
| 7138575 | Childs et al. | Nov 2006 | B2 |
| 7350141 | Kotler et al. | Mar 2008 | B2 |
| 7350142 | Kraft | Mar 2008 | B2 |
| 7424668 | DeSpain | Sep 2008 | B2 |
| 7430709 | Cho | Sep 2008 | B2 |
| 7461077 | Greenwood | Dec 2008 | B1 |
| 7594172 | Fish | Sep 2009 | B2 |
| 7639873 | Qian | Dec 2009 | B2 |
| 7647551 | Vigesaa et al. | Jan 2010 | B2 |
| 7698638 | Sargent, III et al. | Apr 2010 | B2 |
| 7735003 | Hearn et al. | Jun 2010 | B1 |
| 7761782 | Warren et al. | Jul 2010 | B1 |
| 7779000 | Vigesaa et al. | Aug 2010 | B2 |
| 7783966 | Mitsui | Aug 2010 | B2 |
| 7849395 | Ellis et al. | Dec 2010 | B2 |
| 7853867 | Egilsson | Dec 2010 | B2 |
| 7885811 | Zimmerman et al. | Feb 2011 | B2 |
| 7962436 | Brelage et al. | Jun 2011 | B2 |
| 8018518 | Nobels | Sep 2011 | B2 |
| 8091024 | Graeber | Jan 2012 | B2 |
| 8121842 | Shih et al. | Feb 2012 | B2 |
| 8145999 | Barrus et al. | Mar 2012 | B1 |
| 8161372 | Ellis et al. | Apr 2012 | B2 |
| 8166385 | Garcia-Molina et al. | Apr 2012 | B2 |
| 8185445 | Perlmuter | May 2012 | B1 |
| 8370750 | Adachi et al. | Feb 2013 | B2 |
| 8375019 | Salinas | Feb 2013 | B2 |
| 8416984 | Liang et al. | Apr 2013 | B2 |
| 8418075 | Gallo | Apr 2013 | B2 |
| 8510266 | Ho | Aug 2013 | B1 |
| 8510650 | Garland et al. | Aug 2013 | B2 |
| 8515241 | Forsyth et al. | Aug 2013 | B2 |
| 8516389 | Fujimoto et al. | Aug 2013 | B2 |
| 8527866 | Sutter et al. | Sep 2013 | B2 |
| 8601361 | Berger et al. | Dec 2013 | B2 |
| 8640022 | Waldman et al. | Jan 2014 | B2 |
| 8645832 | Pea et al. | Feb 2014 | B2 |
| 8786667 | Shanmukhadas | Jul 2014 | B2 |
| 8788928 | McColl et al. | Jul 2014 | B2 |
| 8862646 | Murayama et al. | Oct 2014 | B1 |
| 9020999 | Rai | Apr 2015 | B2 |
| 9042653 | Lin et al. | May 2015 | B2 |
| 9066145 | Kilar et al. | Jun 2015 | B2 |
| 9098484 | Viry | Aug 2015 | B2 |
| 9124856 | Deshpande et al. | Sep 2015 | B2 |
| 9129234 | Campbell et al. | Sep 2015 | B2 |
| 9141938 | Goldberg | Sep 2015 | B2 |
| 9256589 | Chitilian et al. | Feb 2016 | B2 |
| 9270728 | Duncker et al. | Feb 2016 | B2 |
| 9280533 | Rochelle et al. | Mar 2016 | B2 |
| 9317963 | Ruble et al. | Apr 2016 | B2 |
| 9430954 | Dewhurst | Aug 2016 | B1 |
| 9449031 | Barrus et al. | Sep 2016 | B2 |
| 9798889 | Karpel et al. | Oct 2017 | B1 |
| 9892108 | Ghaddar | Feb 2018 | B1 |
| 10331771 | Maresca | Jun 2019 | B2 |
| 10366157 | Campbell et al. | Jul 2019 | B2 |
| 20010007455 | Yoo | Jul 2001 | A1 |
| 20020091871 | Cahill | Jul 2002 | A1 |
| 20020099552 | Rubin | Jul 2002 | A1 |
| 20020175917 | Chakravarty | Nov 2002 | A1 |
| 20030004853 | Ram et al. | Jan 2003 | A1 |
| 20030033329 | Bergman et al. | Feb 2003 | A1 |
| 20030056181 | Marathe | Mar 2003 | A1 |
| 20030182413 | Allen et al. | Sep 2003 | A1 |
| 20030233616 | Gilinsky | Dec 2003 | A1 |
| 20040143788 | Aureglia | Jul 2004 | A1 |
| 20040246376 | Sekiguchi et al. | Dec 2004 | A1 |
| 20050097464 | Graeber | May 2005 | A1 |
| 20050119990 | Lee et al. | Jun 2005 | A1 |
| 20050125401 | Carr | Jun 2005 | A1 |
| 20050246642 | Valderas et al. | Nov 2005 | A1 |
| 20060012568 | Halcrow | Jan 2006 | A1 |
| 20060048044 | Genesereth et al. | Mar 2006 | A1 |
| 20060071942 | Ubillos | Apr 2006 | A1 |
| 20060072848 | Razzano | Apr 2006 | A1 |
| 20060106618 | Racovolis et al. | May 2006 | A1 |
| 20060143651 | Kim | Jun 2006 | A1 |
| 20060179012 | Jacobs | Aug 2006 | A1 |
| 20060212469 | Babanov et al. | Sep 2006 | A1 |
| 20060214776 | O'flaherty et al. | Sep 2006 | A1 |
| 20060218483 | Weitzman et al. | Sep 2006 | A1 |
| 20060270395 | Dhawan | Nov 2006 | A1 |
| 20070047780 | Hull et al. | Mar 2007 | A1 |
| 20070050702 | Chopin et al. | Mar 2007 | A1 |
| 20070078872 | Cohen | Apr 2007 | A1 |
| 20070124319 | Platt et al. | May 2007 | A1 |
| 20070136652 | Ellis | Jun 2007 | A1 |
| 20070244672 | Kjaer | Oct 2007 | A1 |
| 20070244702 | Kahn | Oct 2007 | A1 |
| 20070266315 | Bernardin et al. | Nov 2007 | A1 |
| 20070282976 | Matsuda | Dec 2007 | A1 |
| 20080016436 | Liu et al. | Jan 2008 | A1 |
| 20080046804 | Rui et al. | Feb 2008 | A1 |
| 20080052083 | Shalev | Feb 2008 | A1 |
| 20080134089 | Adachi et al. | Jun 2008 | A1 |
| 20080147501 | Gilliam | Jun 2008 | A1 |
| 20080156171 | Guldi | Jul 2008 | A1 |
| 20080195928 | Matsa et al. | Aug 2008 | A1 |
| 20080200774 | Luo | Aug 2008 | A1 |
| 20080215959 | Lection | Sep 2008 | A1 |
| 20080235625 | Holm et al. | Sep 2008 | A1 |
| 20080276159 | Narayanaswami et al. | Nov 2008 | A1 |
| 20080294903 | Miyazaki | Nov 2008 | A1 |
| 20080301546 | Moore et al. | Dec 2008 | A1 |
| 20080307307 | Ciudad et al. | Dec 2008 | A1 |
| 20090006466 | Ellis | Jan 2009 | A1 |
| 20090006939 | DeSpain et al. | Jan 2009 | A1 |
| 20090037309 | Altberg | Feb 2009 | A1 |
| 20090044090 | Gur et al. | Feb 2009 | A1 |
| 20090160861 | Nakano | Jun 2009 | A1 |
| 20090164880 | Lection | Jun 2009 | A1 |
| 20090228837 | Suzuki | Sep 2009 | A1 |
| 20090254206 | Snowdon | Oct 2009 | A1 |
| 20090307190 | Maresca | Dec 2009 | A1 |
| 20090319542 | Le Brazidec | Dec 2009 | A1 |
| 20100005411 | Duncker et al. | Jan 2010 | A1 |
| 20100058163 | Garcia-Molina et al. | Mar 2010 | A1 |
| 20100083079 | Rapp et al. | Apr 2010 | A1 |
| 20100083089 | Rapp et al. | Apr 2010 | A1 |
| 20100095198 | Bultrowicz | Apr 2010 | A1 |
| 20100128855 | Demo et al. | May 2010 | A1 |
| 20100161471 | Fendick | Jun 2010 | A1 |
| 20100205530 | Butin | Aug 2010 | A1 |
| 20100211575 | Collins et al. | Aug 2010 | A1 |
| 20100214299 | Robertson et al. | Aug 2010 | A1 |
| 20110022629 | Glover | Jan 2011 | A1 |
| 20110029561 | Slaney | Feb 2011 | A1 |
| 20110035652 | McGarry | Feb 2011 | A1 |
| 20110040720 | Zangwill | Feb 2011 | A1 |
| 20110066933 | Ludwig | Mar 2011 | A1 |
| 20110072067 | Gartner | Mar 2011 | A1 |
| 20110078560 | Weeldreyer | Mar 2011 | A1 |
| 20110181617 | Tsuda | Jul 2011 | A1 |
| 20110209048 | Scott | Aug 2011 | A1 |
| 20110252299 | Lloyd et al. | Oct 2011 | A1 |
| 20110314365 | Messerly | Dec 2011 | A1 |
| 20120013539 | Hogan et al. | Jan 2012 | A1 |
| 20120013540 | Hogan | Jan 2012 | A1 |
| 20120039546 | Berger | Feb 2012 | A1 |
| 20120066574 | Lee et al. | Mar 2012 | A1 |
| 20120069028 | Bouguerra | Mar 2012 | A1 |
| 20120088477 | Cassidy | Apr 2012 | A1 |
| 20120151315 | Campbell et al. | Jun 2012 | A1 |
| 20120159298 | Fisher et al. | Jun 2012 | A1 |
| 20120189203 | Lin et al. | Jul 2012 | A1 |
| 20120192050 | Campbell et al. | Jul 2012 | A1 |
| 20120236201 | Larsen | Sep 2012 | A1 |
| 20120294589 | Samra | Nov 2012 | A1 |
| 20120313957 | Fisher et al. | Dec 2012 | A1 |
| 20120324421 | Boeckenhauer et al. | Dec 2012 | A1 |
| 20130016193 | Nepveu | Jan 2013 | A1 |
| 20130031208 | Linton et al. | Jan 2013 | A1 |
| 20130035075 | Seetharaman et al. | Feb 2013 | A1 |
| 20130036346 | Cicerone | Feb 2013 | A1 |
| 20130055058 | Leong et al. | Feb 2013 | A1 |
| 20130067305 | Golan | Mar 2013 | A1 |
| 20130110884 | Eakins | May 2013 | A1 |
| 20130117651 | Waldman et al. | May 2013 | A1 |
| 20130124478 | Ginzburg et al. | May 2013 | A1 |
| 20130124965 | Elias et al. | May 2013 | A1 |
| 20130131537 | Tam | May 2013 | A1 |
| 20130151599 | Santoro | Jun 2013 | A1 |
| 20130198666 | Matas et al. | Aug 2013 | A1 |
| 20130254111 | Gonser et al. | Sep 2013 | A1 |
| 20130298002 | Viry | Nov 2013 | A1 |
| 20130298016 | Chigier | Nov 2013 | A1 |
| 20140047312 | Ruble et al. | Feb 2014 | A1 |
| 20140053055 | Summers et al. | Feb 2014 | A1 |
| 20140073486 | Ahmed et al. | Mar 2014 | A1 |
| 20140074878 | Bomea et al. | Mar 2014 | A1 |
| 20140081634 | Forutanpour | Mar 2014 | A1 |
| 20140082471 | Katouli et al. | Mar 2014 | A1 |
| 20140104279 | Albrecht | Apr 2014 | A1 |
| 20140119673 | Rathnavelu | May 2014 | A1 |
| 20140122516 | Brewer et al. | May 2014 | A1 |
| 20140149838 | Bedard et al. | May 2014 | A1 |
| 20140164890 | Fox et al. | Jun 2014 | A1 |
| 20140173400 | Mingot et al. | Jun 2014 | A1 |
| 20140201126 | Zadeh | Jul 2014 | A1 |
| 20140244668 | Barrus et al. | Aug 2014 | A1 |
| 20140310746 | Larsen | Oct 2014 | A1 |
| 20140337733 | Rodriguez | Nov 2014 | A1 |
| 20140337753 | McKellar | Nov 2014 | A1 |
| 20140359417 | Bar-On | Dec 2014 | A1 |
| 20140372849 | Freedman et al. | Dec 2014 | A1 |
| 20140372850 | Campbell et al. | Dec 2014 | A1 |
| 20140372854 | Otero et al. | Dec 2014 | A1 |
| 20140372857 | Otero et al. | Dec 2014 | A1 |
| 20140372858 | Campbell et al. | Dec 2014 | A1 |
| 20140372952 | Otero et al. | Dec 2014 | A1 |
| 20150019540 | Ganjam et al. | Jan 2015 | A1 |
| 20150033131 | Igor et al. | Jan 2015 | A1 |
| 20150050010 | Lakhani et al. | Feb 2015 | A1 |
| 20150100880 | Matas et al. | Apr 2015 | A1 |
| 20150142418 | Byron | May 2015 | A1 |
| 20150161250 | Elbaz | Jun 2015 | A1 |
| 20150199118 | Berger et al. | Jul 2015 | A1 |
| 20150242093 | Yost et al. | Aug 2015 | A1 |
| 20150378979 | Hirzel et al. | Dec 2015 | A1 |
| 20160026376 | Schultink | Jan 2016 | A1 |
| 20160026613 | Vogel | Jan 2016 | A1 |
| 20160028790 | Eriksson et al. | Jan 2016 | A1 |
| 20160070733 | Gould | Mar 2016 | A1 |
| 20160093079 | Grams | Mar 2016 | A1 |
| 20160117412 | Mungi et al. | Apr 2016 | A1 |
| 20160240187 | Fleizach | Aug 2016 | A1 |
| 20160270740 | Raisoni et al. | Sep 2016 | A1 |
| 20160336003 | Agiomyrgiannakis | Nov 2016 | A1 |
| 20160337059 | Nehls | Nov 2016 | A1 |
| 20160350950 | Ritchie et al. | Dec 2016 | A1 |
| 20170123756 | Canton et al. | May 2017 | A1 |
| 20170124040 | Campbell et al. | May 2017 | A1 |
| 20170124041 | Campbell et al. | May 2017 | A1 |
| 20170124042 | Campbell et al. | May 2017 | A1 |
| 20170124043 | Canton et al. | May 2017 | A1 |
| 20170124044 | Canton et al. | May 2017 | A1 |
| 20170124045 | Canton et al. | May 2017 | A1 |
| 20170124046 | Campbell et al. | May 2017 | A1 |
| 20170124047 | Campbell et al. | May 2017 | A1 |
| 20170124048 | Campbell et al. | May 2017 | A1 |
| 20170124050 | Campbell et al. | May 2017 | A1 |
| 20170124051 | Campbell et al. | May 2017 | A1 |
| 20170124052 | Campbell et al. | May 2017 | A1 |
| 20170124053 | Campbell et al. | May 2017 | A1 |
| 20170124054 | Campbell et al. | May 2017 | A1 |
| 20170124056 | Radakovitz et al. | May 2017 | A1 |
| 20170124057 | Canton et al. | May 2017 | A1 |
| 20170124740 | Campbell et al. | May 2017 | A1 |
| 20170124741 | Campbell et al. | May 2017 | A1 |
| 20170126772 | Campbell et al. | May 2017 | A1 |
| 20170220543 | Canton et al. | Aug 2017 | A1 |
| 20170337040 | Salvi et al. | Nov 2017 | A1 |
| 20190258709 | Campbell et al. | Aug 2019 | A1 |
| Number | Date | Country |
|---|---|---|
| 101796829 | Aug 2010 | CN |
| 102842323 | Dec 2012 | CN |
| 1645972 | Apr 2006 | EP |
| 20140146350 | Dec 2014 | KR |
| 157744 | Aug 2001 | WO |
| 2005050973 | Jun 2005 | WO |
| 2007118228 | Oct 2007 | WO |
| 2015065864 | May 2015 | WO |
| 2017079056 | May 2017 | WO |
| Entry |
|---|
| “FormulaView Help”, Published on: Feb. 10, 2015, 9 pages, available at: http://formulaforge.com/formulaview-help/. |
| “Infty Project ”, Published on: Jan. 18, 2006, 3 pages, available at: http://www.inftyproject.org/en/index.html. |
| “Parameterizing, and working with math equations in Spreadsheet Application”, Feb. 1, 2016, 23 pages. |
| “Setting up Excel Spreadsheets for Single Item or Compound Object Metadata”, Published on: Sep. 7, 2015, 6 pages, available at:http://www.nyheritage.org/sites/default/files/docs/MetadataExcel.pdf. |
| “Use Equation Editor in Excel 2007 for Windows”, Retrieved on: Feb. 24, 2016, 3 pages, available at: https://support.office.com/en-us/article/Use-Equation-Editor-in-Excel-2007-for-Windows-771c7a8b-4b3d-4ab8-982a-8ab22f1212ce. |
| “Use Math Input Panel to write and correct math equations”, Published on: Oct. 5, 2010, 3 pages, available at: http://windows.microsoft.com/en-in/windows7/use-math-input-panel-to-write-and-correct-math-equations. |
| 5 Ways to Extract Video Frames and Save to Images, Published on: Apr. 7, 2016, https://www.raymond.cc/blog/extract-video-frames-to-images-using-vlc-media-player/, 12 pages. |
| An Introduction to Data Validation in Excel, Published on: Mar. 15, 2014, http://trumpexcel.com/2014/03/learn-all-about-data-validation-in-excel/, 4 pages. |
| Anchor image to a cell, Published on: Jan. 14, 2012, http://apache-poi.1045710.n5.nabble.com/Anchor-image-to-a-cell-td4302682.html, 14 pages. |
| Azzarello, Pat, “Group Report: Improving Computer Audio and Music Production Systems User Interfaces”, In Proceedings of Tenth Annual Interactive Music Conference, Oct. 13, 2005, 12 pages. |
| Canton et al., “Compound Data Types”, Oct. 2, 2015, 16 pages. |
| Canton et al., “Condensed Core Design”, Jul. 30, 2015, 312 pages. |
| Canton et al., “Rich Data Types”, Jul. 30, 2015, 217 pages. |
| Chang, et al., “A Spreadsheet Model for Handling Streaming Data”, In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, Apr. 18, 2015, 4 pages. |
| Chang, et al., “A spreadsheet model for using web service data”, In Proceedings of IEEE Symposium on Visual Languages and Human-Centric Computing, Jul. 28, 2014, 8 pages. |
| Chang, et al., “A Spreadsheet Tool for Creating Web Applications Using Online Data”, In Proceedings of CHI Workshop on End User Development in the Internet of Things Era, vol. 12, Issue 2, Apr. 18, 2015, 6 pages. |
| Chang, et al., “Creating interactive web data applications with spreadsheets”, In Proceedings of the 27th annual ACM symposium on User interface software and technology, Oct. 5, 2014, pp. 87-96. |
| Combine the contents of multiple cells, Retrieved on: Jan. 25, 2016, https://support.office.com/en-us/article/Combine-the-contents-of-multiple-cells-3A86C317-6691-4F1D-8781-203320AEFDCE, 3 pages. |
| Create an Excel Drop Down list with Search Suggestions, Published on: Oct. 19, 2013, http://trumpexcel.com/2013/10/excel-drop-down-list-with-search-suggestions/, 11 pages. |
| Dalgleish, Debra, “Excel List of All MP3 Files in a Directory”, Published on: May 5, 2009, http://blog.contextures.com/archives/2009/05/05/excel-list-of-all-mp3-files-in-a-directory/, 3 pages. |
| Deliver content using spreadsheet templates, Published on: Sep. 21, 2015, https://support.google.com/youtube/answer/6066171?hl=en, 3 pages. |
| Eastonz, Trevor, “Embed a Video in Microsoft Excel—It's a breeze”, Published on: Jul. 18, 2013. |
| Embedded Metadata in WAVE Files, Retrieved on: Apr. 25, 2016, http://www.avpreserve.com/wp-content/uploads/2014/04/EmbeddedMetadata.pdf, 10 pages. |
| French, Ted, “Concatenate Text Data in Google Spreadsheets”, Published on: Jun. 15, 2014, http://spreadsheets.about.com/od/exceltextfunctions/ss/2014-06-15-google-spreadsheets-concatenate-text-strings.htm#step1, 6 pages. |
| French, Ted, “Convert Measurements in Excel”, Published on: Mar. 18, 2011, http://spreadsheets.about.com/od/excel2010functionsiss/2011-03-18-Convert-Measurements-In-Excel-2010.htm, 4 pages. |
| Hacid, et al., “A Database Approach for Modeling and Querying Video Data”, In Proceedings of the15th International Conference on Data Engineering, vol. 12, No. 5, Sep. 2000, 22 pages. |
| Harvey, Greg, “How to Edit and Format Inserted Pictures in Excel 2013”, Published on: Jan. 2013, http://www.dummies.com/how-to/content/how-to-edit-and-format-inserted-pictures-in-excel-.html, 3 pages. |
| How to Concatenate Cells in Excel, Published on: Jul. 9, 2007, https://wagda.lib.washington.edu/gishelp/tutorial/concatenate.pdf, 6 pages. |
| How to insert multiple pictures and resize them at once in Excel?, Published on: Oct. 9, 2014, http://www.extendoffice.com/documents/excel/1156-excel-insert-multiple-pictures.html, 18 pages. |
| How to insert picture into excel cell, Published on: May 30, 2013, http://trumpexcel.com/2013/05/insert-picture-into-excel-cell/, 9 page. |
| How to resize pictures to fit cells in Excel?, Published on: Jan. 15, 2013, http://www.extendoffice.com/documents/excel/1060-excel-resize-picture-to-fit-cell.html, 11 pages. |
| How to: Use Text-to-Speech in Excel 2002, Retrieved on: Jul. 7, 2016, https://support.microsoft.com/en-us/kb/288986, 4 pages. |
| Hoydahl, Jan, “Cominvent AS—Enterprise Search Consultants”, Published on: Jan. 25, 2012, http://www.cominvent.com/2012/01/25/super-flexible-autocomplete-with-solr/, 4 pages. |
| In-Cell Dropdown and Validation in Spreadsheets, Published on: Aug. 26, 2010, http://googledrive.blogspot.in/2010/08/in-cell-dropdown-and-validation-in.html, 27 pages. |
| Insert Images into Google Spreadsheet Cells, Published on: Apr. 15, 2016, https://www.bettercloud.com/monitor/the-academy/insert-images-into-google-spreadsheet-cells/, 3 pages. |
| Javaid, Usman, “Excel 2010: Merge Cells (Concatenation)”, Published on: Mar. 25, 2010, http://www.addictivetips.com/microsoft-office/excel-2010-merge-cells-concatenation/, 19 pages. |
| Keng, Kuek Ser Kuang, “Edit video using spreadsheet—GS Video”, Published on: Dec. 24, 2015, https://www.youtube.com/watch?v=-bwFdhJg1MA, 2 pages. |
| Klement, Scott, “Load Images into Your HSSF Spreadsheets”, Published on: Dec. 11, 2008, http://www.easy400.net/hssfcgi/documentation/20081211.html, 9 pages. |
| Kohlhase, et al., “FEncy: Spreadsheet Formulae Exploration”, In Joint Proceedings of the MathUI, OpenMath and ThEdu Workshops and Work in Progress track at CICM co-located with Conferences on Intelligent Computer Mathematics, Jul. 7, 2014, 12 pages. |
| Levoy, Marc, “Spreadsheets for Images”, In Proceedings of 21st International ACM Conference on Computer Graphics and Interactive Techniques, Jul. 24, 1994, 8 pages. |
| Lim, Jon, “Google Spreadsheets: COUNT with Multiple Values in Cells”, Published on: Apr. 7, 2014, http://jonlim.ca/2014/04/google-spreadsheets-count-multiple-values-cells/, 5 pages. |
| Machlis, Sharon, “How to create an automatically updating Google spreadsheet”, Published on: Dec. 8, 2013, http://www.computerworld.com/article/2469616/business-intelligence/business-intelligence-79661-how-to-create-an-automatically-updating-spreadsheet.html, 2 pages. |
| Powerful transcription that's ready for work, Published on: Dec. 17, 2015, http://australia.nuance.com/dragon/transcription-solutions/index.htm, 5 pages. |
| Puls, Ken, “Using VLOOKUP to return a picture”, Published on: Feb. 7, 2014, http://www.cga-pdnet.org/pdf/vlookupforpictures.pdf, 7 pages. |
| Reynolds, Janine, “New in Smartsheet: See Images in Your Sheets”, Published on: Jan. 15, 2016, https://www.smartsheet.com/blog/new-in-smartsheet-embed-images, 16 pages. |
| Rivendell—Scenario: breakaway from normal progaming to playout audiobook chapters, for a length of time and rejoing normal programming. And how to load and playout the audiobook discs/tracks in order, published on: Apr. 3, 2016, https://thebrettblog.wordpress.com/, 31 pages. |
| Sartain, JD., “How to create relational databases in Excel 2013”, Published on: Aug. 7, 2014, http://www.pcworld.com/article/2462281/how-to-create-relational-databases-in-excel-2013.html, 11 pages. |
| Singh, et al., “Transforming Spreadsheet Data Types using Examples”, In Proceedings of Annual Symposium on Principles of Programming Languages, Oct. 26, 2015, 13 pages. |
| Trevi, Javier, “Showing all available MySQL data types when creating a new table with MySQL for Excel”, Published on: Jul. 23, 2014, https://blogs.oracle.com/MySqlOnWindows/entry/showing_all_available_mysql_data, 8 pages. |
| Trying to open audio files from spreadsheet using windows API, Retrieved on: Apr. 25, 2016, http://stackoverflow.com/questions/34459965/trying-to-open-audio-files-from-spreadsheet-using-windows-api, 3 pages. |
| Use Formula AutoComplete, Retrieved on: Oct. 26, 2015, https://support.office.com/en-us/article/Use-Formula-AutoComplete-6d13daa5-e003-4431-abab-9edef51fae6b, 4 pages. |
| Vaziri, et al., “Stream Processing with a Spreadsheet”, In Proceedings of European Conference on Object-Oriented Programming, Jul. 28, 2014, 25 pages. |
| Virostek, Paul, “The Power User's Guide to Soundminer Metadata”, Published on: Jun. 24, 2014, http://www.creativefieldrecording.com/2014/06/24/the-power-users-guide-to-soundminer-metadata/, 12 pages. |
| Wallen, Jack, “Create graphs and complex math equations directly from the Google Docs sidebar with g(Math)”, Published on: Jul. 22, 2015, Available at: http://www.techrepublic.com/article/create-graphs-and-complex-math-equations-directly-from-the-google-docs-sidebar-with-gmath/. |
| Wyatt, Allen, “Conditionally Playing an Audio File”, Published on: Oct. 10, 2011 http://excel.tips.net/T006559_Conditionally_Playing_an_Audio_File.html, 2 pages. |
| Wyatt, Allen, “Displaying Images based on a Result”, Published on: Apr. 10, 2011, http://excel.tips.net/T003128_Displaying_Images_based_on_a_Result.html, 10 pages. |
| Wyatt, Allen, “Displaying Images based on a Result”, Published on: Oct. 28, 2011, http://excel.tips.net/T003128_Displaying_Images_based_on_a_Result.html, 9 pages. |
| Wyatt, Allen, “Hiding Graphics when Filtering”, Retrieved on: Jul. 8, 2016, http://excel.tips.net/T003866_Hiding_Graphics_when_Filtering.html, 2 pages. |
| Wyatt, Allen, “Inserting a Sound File in Your Worksheet”, Published on: Apr. 10, 2011, http://excel.tips.net/T002864_Inserting_a_Sound_File_in_Your_Worksheet.html, 2 pages. |
| Wyatt, Allen, “Inserting a Voice Annotation in Your Worksheet”, Published on: Oct. 19, 2011, http://excel.tips.net/T002870_Inserting_a_Voice_Annotation_in_Your_Worksheet.html, 2 pages. |
| Wyatt, Allen, “Sorting with Graphics”, Published on: Oct. 28, 2011, http://excel.tips.net/T002954_Sorting_with_Graphics.html, 2 pages. |
| PCT International Search Report in PCT/US2016/059852, dated Jan. 25, 2017, 15 pages. |
| PCT Invitation to Pay Additional Fees in PCT/US2016/060180, mailed Feb. 9, 2017, 8 pages. |
| U.S. Appl. No. 15/199,846, Office Action dated Jun. 26, 2017, 20 pages. |
| U.S. Appl. No. 15/199,968, Office Action dated Jul. 12, 2017, 20 pages. |
| Whitmer, “Brigham Young University Improving Spreadsheets for Complex Problems”, All These and Dissertations, Paper 1713, Aug. 4, 2008, http://scholarsarchive.byu.edu/cgi/viewcontent.cgl?artcile=2712&context=etd, pp. 1-7, 15-26. |
| PCT International Search Report and Written Opinion in PCT/US2016/060180, dated Jul. 12, 2017, 22 pages. |
| Han et al., “Situational data integration with data services and nested table”, Service Oriented Computing and Applications, vol. 7, No. 2, Apr. 27, 2012, pp. 129-150. |
| U.S. Appl. No. 15/281,885, Office Action dated Sep. 19, 2017, 16 pages. |
| PCT Second Written Opinion in PCT/US2016/059389, dated Sep. 13, 2017, 11 pages. |
| U.S. Appl. No. 15/199,820, Office Action dated Sep. 20, 2017, 16 pages. |
| U.S. Appl. No. 15/282,269, Office Action dated Sep. 19, 2017, 17 pages. |
| PCT Second Written Opinion in PCT/US2016/060177, dated Sep. 14, 2017, 9 pages. |
| Sundarsean et al., Management and Analysis of Cmaer Trap Data: Alternative Approaches, Bulletin of the Ecological Socierty of America, vol. 92, No. 2, 201-04-01, pp. 188-195. |
| U.S. Appl. No. 15/199,836, Office Action dated Sep. 20, 2017, 14 pages. |
| PCT Second Written Opinion in PCT/US2016/060188, dated Sep. 13, 2017, 7 pages. |
| U.S. Appl. No. 15/199,846, Amendment and Response filed Sep. 26, 2017, 14 pages. |
| PCT Second Written Opinion in PCT/US2016/060192, dated Sep. 11, 2017, 8 pages. |
| U.S. Appl. No. 15/821,114, Office Action dated Oct. 19, 2017, 19 pages. |
| PCT Second Written Opinion in PCT/US2016/059135, dated Nov. 7, 2017, 6 pages. |
| U.S. Appl. No. 15/199,968, Amendment and Response filed Oct. 12, 2017, 9 pages. |
| PCT Second Written Opinion in PCT/US2016/059303, dated Oct. 26, 2017, 8 pages. |
| U.S. Appl. No. 15/199,968, Notice of Allowance dated Nov. 13, 2017, 10 pages. |
| PCT Second Written Opinion in PCT/US2016/060194, dated Oct. 26, 2017, 7 pages. |
| U.S. Appl. No. 15/199,846, Office Action dated Oct. 26, 2017, 22 pages. |
| PCT International Search Report and Written Opinion in PCT/US2017/039609, dated Oct. 13, 2017, 15 pages. |
| U.S. Appl. No. 15/281,885, Amendment and Response filed Dec. 19, 2017, 16 pages. |
| U.S. Appl. No. 15/199,938, Office Action dated Dec. 6, 2017, 24 pages. |
| Launch Excel, Series: Resize & autofit column widths, copyright 2011, published by www.launchexcel.com, http://web.archive.org/web/20110924045718/https://www.launchexcel.com/column-width-resize, 2 pages. |
| U.S. Appl. No. 15/199,820, Amendment and Response filed Dec. 20, 2017, 16 pages. |
| U.S. Appl. No. 15/199,836, Amendment and Response filed Dec. 20, 2017, 13 pages. |
| U.S. Appl. No. 15/199,846, Amendment and Response filed Dec. 26, 2017, 15 pages. |
| U.S. Appl. No. 15/199,846, Advisory Action dated Jan. 5, 2018, 3 pages. |
| U.S. Appl. No. 15/281,885, Notice of Allowance dated Feb. 1, 2018, 10 pages. |
| U.S. Appl. No. 15/282,269, Notice of Allowance dated Jan. 31, 2018, 10 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/059303, dated Jan. 18, 2018, 9 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/060194, dated Jan. 18, 2018, 8 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/060177, dated Jan. 4, 2018, 10 pages. |
| U.S. Appl. No. 15/199,846, Amendment and Response filed Jan. 26, 2018, 15 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/060192, dated Jan. 5, 2018, 9 pages. |
| PCT International Search Report in PCT/U2017/053854, dated Dec. 14, 2017, 17 pages. |
| “Customizing Points”, May 25, 2014, https://developers.google.com/chart/interactive/docs/points, 9 pages. |
| “How to add image as background into chart in Excel?” Jul. 2, 2014, https://www.extendoffice.com/documents/excel/1435-excel-add-image-background-to-chart.html, 10 pages. |
| “PhotoSpread Quick User's Manual”, WebArchive Copy of online PDF, Jul. 8, 2011, 7 pages, http://web.archive.org/web/20110708161116/http://infolab.stanford.edu/˜paepcke/shared-documents/photospread/photospreadmanual010309.pdf. |
| “Sort data in a range or table” WebArchive Microsoft Office Support Webpage, Sep. 24, 2015, 8 pages, http://web.archive.org/web/20150924210037/https://support.office.com/en-us/article/sort-data-in-a-range-or-table-ce451a63-478d-42ba-adba-b6ebd1b4fa24. |
| “Spreadsheet plugin for Lightroom”, Apr. 22, 2016, http://diswantsho.com/spreadsheet-plugin-for-lightroom/, 6 pages. |
| “Spreadsheets (change book settings in bulk)”, Sep. 23, 2014, https://support.google.com/books/partner/answer/3058975?hl=en, 11 pages. |
| “Use a Picture in a Chart”, Apr. 22, 2016, https://support.office.com/en-ie/article/use-a-picture-in-a-chart-c53cf530-160b-4a3e-9b38-efe6cb858d10, 3 pages. |
| Agarwal, Amit., “How to Insert Images in your Google Spreadsheet Cells”, Mar. 9, 2016, http://www.labnol.org/internet/images-in-google-spreadsheet/18167/, 2 pages. |
| Hasler et al., “A High Performance Interactive Image Spreadsheet” Computers in Physics, American Institute of Physics, Woodbury, NY, vol. 8, No. 3, May 1994, 18 pages. |
| Kandel et al., “PhotoSpread: A Spreadsheet for Managing Photos”, The 26th Annual Chi Conference on Human Factors in Computing Systems, Conference Proceedings, Apr. 5, 2005, in Florence, Italy, 10 pages. |
| Kongdenfha et al., “Rapid development of spreadsheet-based web mashups”, International World Wide Web Conference 18th ACM, Madrid, Apr. 20, 2009, 10 pages. |
| Lafond, “eAtlas Image Metadata Editor Application—Tag photos with metadata”, Mar. 20, 2016, http://eatlas.org.au/tools/image-metadata-editor, 15 pages. |
| Lee, “Tips and Tricks: Images in cells”, Nov. 30, 2010, https://drive.googleblog.com/2010/11/tips-and-tricks-images-in-cells.html, 6 pages. |
| PCT International Search Report in PCT/US2016/059876, dated Jan. 25, 2017, 15 pages. |
| PCT International Search Report in PCT/US2016/060177, dated Jan. 25, 2017, 16 pages. |
| PCT International Search Report in PCT/US2016/060190, dated Feb. 9, 2017, 13 pages. |
| PCT International Search Report in PCT/US2016/060192, dated Jan. 25, 2017, 15 pages. |
| Piersol, “Object-oriented spreadsheets: the analytic spreadsheet package”, 1st Annual Conference on Object-Oriented Programming Systems, Languages, and Applications, Portland, Oregon, Jun. 1986, 6 pages. |
| Waldock, “Applying mathematics to digital image processing using a spreadsheet”, In Journal of MSOR Connections, vol. 10, Issue 3, Nov. 2010, pp. 11-16. |
| Wood, “Learn how to use Apple's spreadsheet program, Numbers”, May 4, 2015, http://www.macworld.co.uk/how-to/mac-software/how-to-use-apple-numbers-speadsheet-3609483/, 9 pages. |
| Kandel et al., “The PhotoSpread Query Language”, Sep. 6, 2007, http://ilpubs.stanford.edu:8090/812/1/2007-27.pdf, abstract only, 1 page. |
| Wyatt, “Generating Automatic Links to Audio Files (Microsoft Excel)” Jun. 7, 2014, http://excelribbon.tips.net/T013127_Generating_Automtic_Links_to_audio_files.html, 4 pages. |
| PCT Invitation to Pay Additional Fees in PCT/US2016/059143, mailed Feb. 9, 2017, 9 pages. |
| PCT International Search Report in PCT/US2016/059135, dated Feb. 16, 2017, 15 pages. |
| PCT International Search Report in PCT/US2016/060194, dated Feb. 16, 2017, 14 pages. |
| PCT International Search Report in PCT/US2016/059947, dated Feb. 16, 2017, 17 pages. |
| “Google Spreadsheets—Google Charts—Google Developments,” May 8, 2015, 6 pages, http://web.archive.org/web/20151008210800/https://google-developers.appspot.com/chart/interactive/docs/spreadsheets. |
| PCT International Search Report in PCT/US2016/060188, dated Feb. 15, 2017, 13 pages. |
| Bakke et al., “A spreadsheet-based user interface for managing plural relationships in structured data”, Human Factors in Computing Systems, May 7, 2011, 10 pages. |
| Kapros et al., “Updating database schemas without breaking the UI: modeling using cognitive semantic categories” Proceedings of the 2014 ACM Sigchi Symposhium on Engineering Interactive Computing System, Jun. 17, 2014, 9 pages. |
| PCT International Search Report in PCT/US2016/059303, dated Feb. 16, 2017, 17 pages. |
| Converting text to speech in Excel, Sep. 29, 2015, 2 pages, http://web.archive.org/web/20150929113340/https://support.office/com/en-us/article/converting-text-to-speech-in-excel-3f2ca8G0-90e2-4391-8e69-573832ea7300#_toc307831251. |
| Wang et al., “Development of an image processing based sheet music recognition system for iOS device”, 2014 IEEE International Conference on Consumer Electronics, May 26, 2014, 2 pages. |
| Inglis “DoReMIRE ScoreCloud”, SOS Sound on Sound, Jan. 1, 2015, http://www.soundonsound.com/reviews/doremir-scorecloud, 4 pages. |
| PCT International Search Report in PCT/US2016/059389, dated Feb. 16, 2017, 16 pages. |
| PCT International Search Report in PCT/US2016/060025, dated Apr. 7, 2017, 23 pages. |
| PCT International Search Report in PCT/US2016/059143, dated Apr. 3, 2017, 21 pages. |
| PCT International Search Report in PCT/US2017/016038, dated Apr. 11, 2017, 15 pages. |
| Van Eekelen et al., “Constructing medium sized efficient functional programs in Clean”, May 24, 1995, Advanced Functional Programming, Springer Berlin, pp. 186-188 and 192-194. |
| De Hoon et al., “FunSheet: A Functional Spreadsheet”, 1996, pp. 1-20, https://www.researchgate.net/profile/Marko_Eekelen/publication/2243431_FunSheet_A_Functional_Spreadsheet_links/09e4150ad3d34ad552000000/FunSheet-A-Functinoal-Spreadsheet.pdf. |
| Abdali, “Spreadsheet Computations in Computer Algebra”, Sigsam Bulletin, 1987, pp. 11-16. |
| Tabach et al., “Understanding Equivalence of Symbolic Expressions in a Spreadsheet-Based Environment”, International Journal of Coputers for Mathematical Learning, Kluwer Academic Publishers, vol. 13, No. 1, Jan. 30, 2008, pp. 27-46. |
| Bredenkamp, “Use of Spreadsheets in electrical engineering” IEEE Circuits and Devices Magazine, IEEE, Service Center, Piscataway NJ, US, vol. 3, No. 5, Sep. 1987. |
| “Indexed color—Wikipedia”, Apr. 21, 2015, 6 pages, https://en.wikipedia.org/w/index.php?title=indexed_color&oldid=657815639. |
| Wilbert O. Galitz, The Essential Guide to user Interface Design 535, 2nd edition, Wiley, 2002, 786 pages. |
| Robin Abraham and Martin Erwig, How to communicate unit error messages in spreadsheets, 30 ACM SIGSOFT Software Engineering Notes, pp. 1-5, 2005. |
| U.S. Appl. No. 15/199,836, Amendment and Response filed Jun. 27, 2018, 14 pages. |
| U.S. Appl. No. 15/199,938, Office Action dated May 31, 2018, 36 pages. |
| U.S. Appl. No. 15/282,114, Office Action dated Jun. 6, 2018, 17 pages. |
| U.S. Appl. No. 15/339,170, Office Action dated Jun. 28, 2018, 23 pages. |
| U.S. Appl. No. 15/340,422, Office Action dated Jun. 13, 2018, 15 pages. |
| “Creating Compound Objects”, Retrieved From: https://mediawiki.middlebury.edu/wikis/LIS/images/b/bd/Compound-wizard.pdf, Retrieved on: Sep. 2, 2010, pp. 1-34. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/199,938”, dated Oct. 5, 2018, 34 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/339,101”, dated Sep. 10, 2018, 26 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/339,245”, dated Aug. 10, 2018, 6 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,251”, dated Aug. 10, 2018, 17 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,321”, dated Oct. 17, 2018, 11 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,374”, dated Sep. 7, 2018, 10 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,422”, dated Sep. 26, 2018, 11 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,874”, dated Sep. 28, 2018, 28 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,886”, dated Oct. 2, 2018, 17 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/199,953”, dated Sep. 17, 2018, 33 Pages. |
| “Sort and Filter: The basics of spreadsheets,” School of Data, copyright 2012, schoolofdata.org, Retrieved From: https://web.archive.org/web/20121217023142/https://schoolofdata.org/handbook/courses/sort-and-filter, 2012., 8 Pages. |
| PCT International Preliminary Report on Patentability in PCT/US2017/016038, dated Aug. 7, 2018, 9 pages. |
| European Communications in Application 16798045.7, dated Jun. 8, 2018, 4 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/059135, dated Jan. 30, 2018, 16 pages. |
| PCT International Search Report in PCT/US2017/040251, dated Dec. 18, 2017, 14 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/059389, dated Feb. 12, 2018, 12 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/060188, dated Feb. 12, 2018,8 pages. |
| U.S. Appl. No. 15/282,114, Amendment and Response filed Feb. 20, 2018, 25 pages. |
| U.S. Appl. No. 15/340,422, Office Action dated Feb. 22, 2018, 10 pages. |
| U.S. Appl. No. 15/199,846, Notice of Allowance dated Mar. 20, 2018, 10 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/060025, dated May 8, 2018, 16 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/060180, dated May 8, 2018, 15 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/059947, dated May 8, 2018, 13 pages. |
| U.S. Appl. No. 15/199,938, Amendment and Response filed Apr. 6, 2018, 21 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/059143, dated May 8, 2018, 13 pages. |
| U.S. Appl. No. 15/199,820, Office Action dated Apr. 26, 2018, 16 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/059852, dated May 8, 2018, 11 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/059876, dated May 8, 2018, 8 pages. |
| U.S. Appl. No. 15/199,836, Office Action dated Apr. 9, 2018, 16 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2016/060190 dated May 8, 2018, 9 pages. |
| U.S. Appl. No. 15/340,422, Amendment and Response filed May 22, 2018, 18 pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,201”, dated Jan. 2, 2019, 14 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/339,170”, dated Jan. 11, 2019, 21 pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/340,874”, dated Feb. 5, 2019, 22 pages. |
| “Non-Final Office Action Issued in U.S. Appl. No. 15/395,667”, dated Jan. 3, 2019, 17 pages. |
| PCT International Preliminary Report on Patentability in PCT/US2017/040251, dated Jan. 1, 2019, 8 pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/199,938”, dated Feb. 26, 2019, 37 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/199,953”, dated Apr. 18, 2019, 40 Pages. |
| “Notice of Allowance Issued in U.S. Appl. No. 15/395,667”, dated Apr. 25, 2019, 14 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/339,245”, dated Mar. 7, 2019, 06 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/339,330”, dated Apr. 17, 2019, 21 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/340,422”, dated Feb. 11, 2019, 12 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/340,886”, dated May 3, 2019, 21 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/340,251”, dated Mar. 6, 2019, 17 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/340,374”, dated Apr. 5, 2019, 11 Pages. |
| “Notice of Allowance in Issued in U.S. Appl. No. 15/339,101”, dated Jan. 17, 2019, 10 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/199,836”, dated Jul. 10, 2019, 18 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/199,938”, dated Jun. 27, 2019, 24 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/340,201”, dated Jul. 11, 2019, 15 Pages. |
| “Notice of Allowance Issued in U.S. Appl. No. 15/340,422”, dated Jun. 10, 2019, 6 Pages. |
| “Advisory Action Issued in U.S. Appl. No. 15/340,874”, dated Jun. 10, 2019, 4 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,874”, dated Jun. 27, 2019, 22 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/340,321”, dated Jul. 5, 2019, 13 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/282,114”, dated Jul. 18, 2019, 17 pages. |
| “Non-Final Office Action Issued in U.S. Appl. No. 15/199,820”, dated Jul. 17, 2019, 24 pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/339,170”, dated Oct. 4, 2019, 25 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,251”, dated Oct. 3, 2019, 19 Pages. |
| Zarowin, Stanley, “Hiding Cells in Excel—just One or Two or Even 100 at a Time”, In Journal of Accountancy, Oct. 1, 2008, pp. 1-2. |
| “Advisory Action Issued in U.S. Appl. No. 15/339,170”, dated Jul. 5, 2019, 5 Pages. |
| “Advisory Action Issued in U.S. Appl. No. 15/340,321”, dated Sep. 24, 2019, 6 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,886”, dated Sep. 26, 2019, 21 Pages. |
| “Notice of Allowance Issued in U.S. Appl. No. 15/395,667”, dated Aug. 8, 2019, 6 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/199,953”, dated Dec. 3, 2019, 23 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/339,330”, dated Nov. 22, 2019, 18 Pages. |
| “Non Final Office Action Issued in U.S. Appl. No. 15/340,321”, dated Nov. 4, 2019, 12 Pages. |
| “Final Office Action Issued in U.S. Appl. No. 15/340,874”, dated Nov. 20, 2019, 24 Pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20170124049 A1 | May 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62249869 | Nov 2015 | US | |
| 62357284 | Jun 2016 | US | |
| 62249884 | Nov 2015 | US | |
| 62357292 | Jun 2016 | US |
