Patent Application
20150169733
Embodiments of the subject matter described herein relate generally to computer systems and applications for conducting performance reviews, and more particularly to techniques for supplementing answers to questions with objective evidence.
Incentivizing employees is a key metric in the success of any business. Thorough and unbiased performance summaries promote employee satisfaction. Performance Reviews, a graphical user interface (GUI) tool available at www.successfactors.com, measures employee performance, facilitates legal and regulatory compliance, creates a review audit trail, identifies top performers, and deploys using configurable review routing and email integration for reminders and deadlines.
7Geese™, available at www.7geese.com, provides a social performance tool for continuous feedback, coaching, recognition, and goal tracking without relying on traditional written performance reviews.
In addition, collaborative technologies have changed the way groups of related users (e.g., sales teams) share information about sales opportunities and support other team members. Presently known enterprise social network platforms such as Chatter™, released in June 2010 by Salesforce™ and available at www.salesforce.com, provide users with a feed-based stream of tracked objects such as sales goals, badges, and coaching.
Traditional employee evaluations, also referred to as performance summaries, are often boring, bland, and merely text based. Answers to questions about a person's performance over the previous employment cycle (e.g., one year) often rely on memory and subjective feelings instead of objective data and proof. As a result, performance summaries are frequently inaccurate and/or biased, which tends to degrade employee morale. Accordingly, it is desirable to provide techniques which address these shortcomings.
At the same time, software development is evolving away from the client-server model toward network-based processing systems that provide access to data and services via the Internet or other networks. In contrast to traditional systems that host networked applications on dedicated server hardware, a “cloud” computing model allows applications to be provided over the network “as a service” supplied by an infrastructure provider. The infrastructure provider typically abstracts the underlying hardware and other resources used to deliver a customer-developed application so that the customer no longer needs to operate and support dedicated server hardware. The cloud computing model can often provide substantial cost savings to the customer over the life of the application because the customer no longer needs to provide dedicated network infrastructure, electrical and temperature controls, physical security and other logistics in support of dedicated server hardware.
Multi-tenant cloud-based architectures have been developed to improve collaboration, integration, and community-based cooperation within tenant organizations without sacrificing data security. Generally speaking, multi-tenancy refers to a system where a single hardware and software platform simultaneously supports multiple user groups (also referred to as “organizations” or “tenants”) from a common data storage element (also referred to as a “multi-tenant database”). The multi-tenant design provides a number of advantages over conventional server virtualization systems. First, the multi-tenant platform operator can often make improvements to the platform based upon collective information from the entire tenant community. Additionally, because all users in the multi-tenant environment execute applications within a common processing space, it is relatively easy to grant or deny access to specific sets of data for any user within the multi-tenant platform, thereby improving collaboration and integration between applications and the data managed by the various applications. The multi-tenant architecture therefore allows convenient and cost effective sharing of similar application features between multiple sets of users.
Presently known tools for evaluating employee performance are disadvantageous in that they do not adequately incorporate objective performance metrics. Accordingly, systems and methods are needed which more effectively exploit existing databases of tracked objects relevant to employee performance.
A more complete understanding of the subject matter may be derived by referring to the detailed description and claims when considered in conjunction with the following figures, wherein like reference numbers refer to similar elements throughout the figures, and:
Embodiments of the subject matter described herein generally relate to systems and methods for providing objective evidence to support answers to questions in the context of an employee performance review. As explained in greater detail below, the present disclosure describes tools for providing ready access to various categories of information for use by a reviewer in supplementing a Q&A performance summary format.
In one embodiment, a user interface for preparing an employee performance evaluation creates a link to a timeline view of various metrics associated with the employee's performance during the period covered by the evaluation. For example, throughout the work year, as facts and/or activities are generated, an employee creates a link in the employee's own version of a performance summary to various tracked objects representative of the employee's recent work in a timeline view. Additionally, the employee may browse through activity generated and available to reviewers and highlight certain items with a “star” or other tag.
The user interface displays the Q&A portion of the performance summary, augmented by a timeline of specific instances of performance metrics such as goals, feedback, coaching, thanks, and previous performance summaries retrieved from a linked database. For example, the employee may display the timeline view of recent work to a reviewer to assist the reviewer in filling out the reviewer's performance summary. In one embodiment, the timeline view of work related activity may show, along a horizontal or vertical axis, summarized tiles of activity.
The user interface may be configured to allow the user to select a “recent work” link from within the performance evaluation template, to thereby reveal various categories of performance metrics. Such metrics may include text from peer summaries, graphics or images (such as dashboards, reports), feedback, thanks, and badges received from other users, goals, and/or actions taken. Upon clicking on a tile or card in the timeline view, a modal view or an immersive view of the activity may be provided for display to show a more detailed level of activity.
In another embodiment, a user interface provides a link within a performance summary to a hybrid timeline and object type view of various metrics associated with the employee's performance during the period covered by the evaluation. The hybrid timeline and object type view of these facts combines a timeline view, such as by month, and an object or category type view, such as by thanks, feedback, goals, and actions.
In a further embodiment, a user interface provides a link within a performance summary to a system-generated highlight of user work associated with the employee's performance during the period covered by the evaluation. For example, below one question, a text box may include a toggle button for the reviewer to view “Recent Work.” Upon selecting the recent work toggle button, the reviewer is provided with various views of the employee's performance, which may include the employee's citation of the employee's own work, activity received about the employee in various views, such as by timeline view or hybrid timeline and object type view, and system-generated highlights/widgets for the employee being reviewed. Throughout the work year, as important milestones, moments, and/or achievements are reached, the system may automatically populate a linked database with pieces of evidence or proof of the employee's recent work as a portfolio of work related highlights. The system-generated highlights/widgets may include graphs, dashboards, and reports based on actual data, such as leads created, closed opportunities, pipeline generation, and opportunities lost.
In another embodiment, a link may be included proximate the Q&A portion of the performance summary to “continue your answer” using the citation feature. The reviewer may navigate the presented data, and tag or annotate the data in such a way to effectively answer the question in addition to or without having to manually generate responsive text. By way of non-limiting example, if a question asks “How well did the employee accomplish his goals?” the system may automatically present the reviewer with the employee's goals, along with the methods and metrics of the employee's achievement of those goals, and also may be presented with the employee's own user-created highlights of activity. The reviewer may simply identify that the employee completed all or some portion of the goal related methods and metrics, providing citations of the raw data to answer the question.
In a further embodiment, the worksheet interface may also display text from peer summaries. The worksheet interface may display a timeline view that includes text from peer summaries in addition to the previously discussed metrics.
Various implementations of the foregoing embodiments are described in greater detail below in conjunction with
Turning now to
Each application 128 is suitably generated at run-time (or on-demand) using a common application platform 110 that securely provides access to the data 132 in the database 130 for each of the various tenant organizations subscribing to the service cloud 100. In accordance with one non-limiting example, the service cloud 100 is implemented in the form of an on-demand multi-tenant customer relationship management (CRM) system that can support any number of authenticated users for a plurality of tenants.
As used herein, a “tenant” or an “organization” should be understood as referring to a group of one or more users (typically employees) that shares access to common subset of the data within the multi-tenant database 130. In this regard, each tenant includes one or more users and/or groups associated with, authorized by, or otherwise belonging to that respective tenant. Stated another way, each respective user within the multi-tenant system 100 is associated with, assigned to, or otherwise belongs to a particular one of the plurality of enterprises supported by the system 100.
Each enterprise tenant may represent a company, corporate department, business or legal organization, and/or any other entities that maintain data for particular sets of users (such as their respective employees or customers) within the multi-tenant system 100. Although multiple tenants may share access to the server 102 and the database 130, the particular data and services provided from the server 102 to each tenant can be securely isolated from those provided to other tenants. The multi-tenant architecture therefore allows different sets of users to share functionality and hardware resources without necessarily sharing any of the data 132 belonging to or otherwise associated with other organizations.
The multi-tenant database 130 may be a repository or other data storage system capable of storing and managing the data 132 associated with any number of tenant organizations. The database 130 may be implemented using conventional database server hardware. In various embodiments, the database 130 shares processing hardware 104 with the server 102. In other embodiments, the database 130 is implemented using separate physical and/or virtual database server hardware that communicates with the server 102 to perform the various functions described herein.
In an exemplary embodiment, the database 130 includes a database management system or other equivalent software capable of determining an optimal query plan for retrieving and providing a particular subset of the data 132 to an instance of application (or virtual application) 128 in response to a query initiated or otherwise provided by an application 128, as described in greater detail below. The multi-tenant database 130 may alternatively be referred to herein as an on-demand database, in that the database 130 provides (or is available to provide) data at run-time to on-demand virtual applications 128 generated by the application platform 110, as described in greater detail below.
In practice, the data 132 may be organized and formatted in any manner to support the application platform 110. In various embodiments, the data 132 is suitably organized into a relatively small number of large data tables to maintain a semi-amorphous “heap”-type format. The data 132 can then be organized as needed for a particular virtual application 128. In various embodiments, conventional data relationships are established using any number of pivot tables 134 that establish indexing, uniqueness, relationships between entities, and/or other aspects of conventional database organization as desired. Further data manipulation and report formatting is generally performed at run-time using a variety of metadata constructs. Metadata within a universal data directory (UDD) 136, for example, can be used to describe any number of forms, reports, workflows, user access privileges, business logic and other constructs that are common to multiple tenants.
Tenant-specific formatting, functions and other constructs may be maintained as tenant-specific metadata 138 for each tenant, as desired. Rather than forcing the data 132 into an inflexible global structure that is common to all tenants and applications, the database 130 is organized to be relatively amorphous, with the pivot tables 134 and the metadata 138 providing additional structure on an as-needed basis. To that end, the application platform 110 suitably uses the pivot tables 134 and/or the metadata 138 to generate “virtual” components of the virtual applications 128 to logically obtain, process, and present the relatively amorphous data 132 from the database 130.
The server 102 may be implemented using one or more actual and/or virtual computing systems that collectively provide the dynamic application platform 110 for generating the virtual applications 128. For example, the server 102 may be implemented using a cluster of actual and/or virtual servers operating in conjunction with each other, typically in association with conventional network communications, cluster management, load balancing and other features as appropriate. The server 102 operates with any sort of conventional processing hardware 104, such as a processor 105, memory 106, input/output features 107 and the like. The input/output features 107 generally represent the interface(s) to networks (e.g., to the network 145, or any other local area, wide area or other network), mass storage, display devices, data entry devices and/or the like.
The processor 105 may be implemented using any suitable processing system, such as one or more processors, controllers, microprocessors, microcontrollers, processing cores and/or other computing resources spread across any number of distributed or integrated systems, including any number of “cloud-based” or other virtual systems. The memory 106 represents any non-transitory short or long term storage or other computer-readable media capable of storing programming instructions for execution on the processor 105, including any sort of random access memory (RAM), read only memory (ROM), flash memory, magnetic or optical mass storage, and/or the like. The computer-executable programming instructions, when read and executed by the server 102 and/or processor 105, cause the server 102 and/or processor 105 to create, generate, or otherwise facilitate the application platform 110 and/or virtual applications 128 and perform one or more additional tasks, operations, functions, and/or processes described herein. It should be noted that the memory 106 represents one suitable implementation of such computer-readable media, and alternatively or additionally, the server 102 could receive and cooperate with external computer-readable media that is realized as a portable or mobile component or platform, e.g., a portable hard drive, a USB flash drive, an optical disc, or the like.
The application platform 110 is any sort of software application or other data processing engine that generates the virtual applications 128 that provide data and/or services to the client devices 140. In a typical embodiment, the application platform 110 gains access to processing resources, communications interfaces and other features of the processing hardware 104 using any sort of conventional or proprietary operating system 108. The virtual applications 128 are typically generated at run-time in response to input received from the client devices 140. For the illustrated embodiment, the application platform 110 includes a bulk data processing engine 112, a query generator 114, a search engine 116 that provides text indexing and other search functionality, and a runtime application generator 120. Each of these features may be implemented as a separate process or other module, and many equivalent embodiments could include different and/or additional features, components or other modules as desired.
The runtime application generator 120 dynamically builds and executes the virtual applications 128 in response to specific requests received from the client devices 140. The virtual applications 128 are typically constructed in accordance with the tenant-specific metadata 138, which describes the particular tables, reports, interfaces and/or other features of the particular application 128. In various embodiments, each virtual application 128 generates dynamic web content that can be served to a browser or other client program 142 associated with its client device 140, as appropriate.
The runtime application generator 120 suitably interacts with the query generator 114 to efficiently obtain multi-tenant data 132 from the database 130 as needed in response to input queries initiated or otherwise provided by users of the client devices 140. In a typical embodiment, the query generator 114 considers the identity of the user requesting a particular function (along with the user's associated tenant), and then builds and executes queries to the database 130 using system-wide metadata 136, tenant specific metadata 138, pivot tables 134, and/or any other available resources. The query generator 114 in this example therefore maintains security of the common database 130 by ensuring that queries are consistent with access privileges granted to the user and/or tenant that initiated the request.
With continued reference to
In exemplary embodiments, the application platform 110 is utilized to create and/or generate data-driven virtual applications 128 for the tenants that they support. Such virtual applications 128 may make use of interface features such as custom (or tenant-specific) screens 124, standard (or universal) screens 122 or the like. Any number of custom and/or standard objects 126 may also be available for integration into tenant-developed virtual applications 128. As used herein, “custom” should be understood as meaning that a respective object or application is tenant-specific (e.g., only available to users associated with a particular tenant in the multi-tenant system) or user-specific (e.g., only available to a particular subset of users within the multi-tenant system), whereas “standard” or “universal” applications or objects are available across multiple tenants in the multi-tenant system.
The data 132 associated with each virtual application 128 is provided to the database 130, as appropriate, and stored until it is requested or is otherwise needed, along with the metadata 138 that describes the particular features (e.g., reports, tables, functions, objects, fields, formulas, code, etc.) of that particular virtual application 128. For example, a virtual application 128 may include a number of objects 126 accessible to a tenant, wherein for each object 126 accessible to the tenant, information pertaining to its object type along with values for various fields associated with that respective object type are maintained as metadata 138 in the database 130. In this regard, the object type defines the structure (e.g., the formatting, functions and other constructs) of each respective object 126 and the various fields associated therewith.
Still referring to
Typically, the user operates a conventional browser application or other client program 142 executed by the client device 140 to contact the server 102 via the network 145 using a networking protocol, such as the hypertext transport protocol (HTTP) or the like. The user typically authenticates his or her identity to the server 102 to obtain a session identifier (“SessionID”) that identifies the user in subsequent communications with the server 102. When the identified user requests access to a virtual application 128, the runtime application generator 120 suitably creates the application at run time based upon the metadata 138, as appropriate. However, if a user chooses to manually upload an updated file (through either the web based user interface or through an API), it will also be shared automatically with all of the users/devices that are designated for sharing.
As noted above, the virtual application 128 may contain Java, ActiveX, or other content that can be presented using conventional client software running on the client device 140; other embodiments may simply provide dynamic web or other content that can be presented and viewed by the user, as desired. As described in greater detail below, the query generator 114 suitably obtains the requested subsets of data 132 from the database 130 as needed to populate the tables, reports or other features of the particular virtual application 128. In various embodiments, application 128 embodies the functionality of an interactive performance review template linked to a database of performance metrics, as described below in connection with
Referring now to
More particularly,
In response to the selection of a particular category of performance metrics, the system displays immersive detail associated with the selected category.
As described in greater detail below, after reviewing the immersive detail for one or more categories, the user can cite one or more objects from the detail for inclusion into the performance summary to thereby provide objective data to support an answer.
More particularly,
Referring now to
With reference to
A method is thus provided for augmenting performance summary answers with objective data elements retrieved from a linked database of tracked objects. The method involves: displaying a question to a reviewer in a user interface; displaying a link to a database of recent work to the reviewer in the user interface; in response to the reviewer selecting the recent work link, displaying a plurality of categories of the tracked objects to the reviewer; determining a data element to be appended to an answer to the question; and processing a request from the reviewer to add the selected data element to the answer.
In an embodiment, the method also includes displaying a detail view of the selected category in response to the reviewer selecting one of the categories of tracked objects.
In an embodiment, the detail view comprises a time line view of chronologically sequential elements of the selected category.
In an embodiment, displaying a plurality of categories of the tracked objects to the reviewer comprises displaying a plurality of virtual buttons, each corresponding to a respective category of performance metrics.
In an embodiment, displaying a plurality of categories of the tracked objects to the reviewer comprises displaying a detail view of the plurality of categories.
In an embodiment, the detail view comprises a time line view of chronologically interleaved elements from the plurality of categories.
In an embodiment, displaying a plurality of categories of the tracked objects comprises defining a beginning date and an end date within which the plurality of categories are bounded.
In an embodiment, displaying the plurality of categories of tracked objects comprises presenting a citation icon to the reviewer, and receiving an indication that the reviewer has selected the citation icon.
In an embodiment, the plurality of categories comprises at least two of: current summaries; past summaries; goals; thanks; feedback; and coaching.
In an embodiment, the database of recent work comprises a remote electronic database of tracked data objects.
In an embodiment, the method also involves appending a written answer received from the reviewer to the displayed question, and processing a request from the reviewer comprises appending the selected data element to the answer.
Machine readable computer code stored in a non-transient medium is also provided for use in a computer system of the type including a display configured to present an interactive user interface to a reviewer, an input module configured to receive input from a reviewer, and a processor configured to execute the computer code to implement the steps of: displaying a question in the user interface; appending an answer to the question received from the reviewer; displaying a link to a database of recent work in the user interface; in response to selection of the recent work link, displaying a plurality of categories of tracked data objects in the user interface, each category comprising at least one data element; and appending a selected data element to the answer.
In an embodiment, the machine readable computer code is further configured to display a detail view of the selected category in response to the reviewer selecting one of the categories of tracked data objects, wherein the detail view comprises a time line view of chronologically sequential elements of the selected category.
In an embodiment, displaying a plurality of categories of the tracked data objects comprises one of: displaying a plurality of virtual buttons, each corresponding to a respective category of performance metrics; and displaying a detail view of the plurality of categories.
In an embodiment, the detail view comprises a time line view of chronologically interleaved elements from the plurality of categories.
In an embodiment, displaying a plurality of categories of tracked data objects comprises defining a beginning date and an end date within which the plurality of categories are bounded.
In an embodiment, the machine readable computer code is further configured to implement the steps of: presenting a citation icon to the reviewer; receiving an indication that the reviewer has selected the citation icon; and displaying the plurality of categories of tracked objects in response to receiving an indication that the reviewer has selected the citation icon.
In an embodiment, the plurality of categories comprises at least two of: current summaries; past summaries; goals; thanks; feedback; and coaching.
In an embodiment, the machine readable computer code is further configured to implement the steps of: appending the selected data elements to the answer in response to the reviewer selecting at least one data element from each of at least two categories.
A user interface is also provided for appending data objects to answers while conducting performance reviews. The user interface includes an interactive module for presenting a question and receiving an associated answer; a selection field including virtual buttons corresponding to a plurality of respective performance metrics; a timeline feed configured to present an immersive view of at least one of the plurality of respective performance metrics; and a citation icon for use in appending at least one data element to the answer-
The foregoing description is merely illustrative in nature and is not intended to limit the embodiments of the subject matter or the application and uses of such embodiments. Furthermore, there is no intention to be bound by any expressed or implied theory presented in the technical field, background, or the detailed description. As used herein, the word “exemplary” means “serving as an example, instance, or illustration.” Any implementation described herein as exemplary is not necessarily to be construed as preferred or advantageous over other implementations, and the exemplary embodiments described herein are not intended to limit the scope or applicability of the subject matter in any way.
For the sake of brevity, conventional techniques related to computer programming, computer networking, database querying, database statistics, query plan generation, XML and other functional aspects of the systems (and the individual operating components of the systems) may not be described in detail herein. In addition, those skilled in the art will appreciate that embodiments may be practiced in conjunction with any number of system and/or network architectures, data transmission protocols, and device configurations, and that the system described herein is merely one suitable example. Furthermore, certain terminology may be used herein for the purpose of reference only, and thus is not intended to be limiting. For example, the terms “first”, “second” and other such numerical terms do not imply a sequence or order unless clearly indicated by the context.
Embodiments of the subject matter may be described herein in terms of functional and/or logical block components, and with reference to symbolic representations of operations, processing tasks, and functions that may be performed by various computing components or devices. Such operations, tasks, and functions are sometimes referred to as being computer-executed, computerized, software-implemented, or computer-implemented. In this regard, it should be appreciated that the various block components shown in the figures may be realized by any number of hardware, software, and/or firmware components configured to perform the specified functions.
For example, an embodiment of a system or a component may employ various integrated circuit components, e.g., memory elements, digital signal processing elements, logic elements, look-up tables, or the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices. In this regard, the subject matter described herein can be implemented in the context of any computer-implemented system and/or in connection with two or more separate and distinct computer-implemented systems that cooperate and communicate with one another. That said, in exemplary embodiments, the subject matter described herein is implemented in conjunction with a virtual customer relationship management (CRM) application in a multi-tenant environment.
Other implementations may include a non-transitory computer readable storage medium storing instructions executable by a processor to perform a method as described above. Yet another implementation may include a system including memory and one or more processors operable to execute instructions, stored in the memory, to perform a method as described above.
The examples illustrating the use of technology disclosed herein through social networking system should not be taken as limiting or preferred. This example sufficiently illustrates the technology disclosed without being overly complicated. It is not intended to illustrate all of the technologies disclosed. For instance, it does not illustrate the use of tagging mechanism in enterprise applications and other personalized applications and with a multi-tenant database with complex and sophisticated architecture.
A person having ordinary skill in the art may appreciate that there are many potential applications for one or more implementations of this disclosure and hence, the implementations disclosed herein are not intended to limit this disclosure in any fashion.
While at least one exemplary embodiment has been presented in the foregoing detailed description, it should be appreciated that a vast number of variations exist. It should also be appreciated that the exemplary embodiment or embodiments described herein are not intended to limit the scope, applicability, or configuration of the claimed subject matter in any way. Rather, the foregoing detailed description will provide those skilled in the art with a convenient road map for implementing the described embodiment or embodiments. It should be understood that various changes can be made in the function and arrangement of elements without departing from the scope defined by the claims, which includes known equivalents and foreseeable equivalents at the time of filing this patent application. Accordingly, details of the exemplary embodiments or other limitations described above should not be read into the claims absent a clear intention to the contrary.
This application claims the benefit of the following U.S. provisional patent applications: i) Ser. No. 61/904,704 filed Nov. 15, 2013; ii) Ser. No. 61/904,723 filed Nov. 15, 2013; and iii) Ser. No. 61/904,733 filed Nov. 15, 2013. The entire contents of the foregoing applications are incorporated herein by this reference.
| Number | Date | Country | |
|---|---|---|---|
| 61904704 | Nov 2013 | US | |
| 61904723 | Nov 2013 | US | |
| 61904733 | Nov 2013 | US |
