Interviewing of candidates, particularly in the employment context, college admissions context and the like, is well known in the art. However, typically, known methods and processes for interviewing candidates are constrained in that they require an interviewer to conduct in-person interviews for a number of candidates, summarize the conducted interviews and provide the summary to others interested in hiring or admission decisions. Thus, evaluation of candidates typically includes decisions made based on hearsay accounts provided by the in person interviewer.
In addition, interviews are typically conducted with one individual person at a time in a private setting. As such, memories can become faded and direct comparisons of candidates are difficult. For example, it is often difficult to directly compare one candidate's response to a given question to another candidate's response to the same question. This is due to the disjoint in time nature of in person interviewing.
Questionnaires and forms, which may allow for side-by-side comparisons, lack the ability to evaluate a candidate's physical demeanor and responses. Additionally, it is difficult using questionnaires and forms to place pressure time constrains on the candidate so as to elicit an impromptu response.
The subject matter claimed herein is not limited to embodiments that solve any disadvantages or that operate only in environments such as those described above. Rather, this background is only provided to illustrate one examplary technology area where some embodiments described herein may be practiced.
It is desirable to provide a method and system for enhancing the efficiency of the interview process. Furthermore, it is particularly desirable to provide such a method and system, which provides an on-line mechanism for collecting information and impressions of a candidate in a systematic and consistent matter.
One embodiment described herein allows for interview questions to be sent from a server to an interviewee client computer. An interviewee at the interviewee client computer provides responses which are received at the server computer. The server computer can then provide the response to an evaluator at an evaluator client computer. The interview questions may be a standard set of questions for a particular interview that are asked of all interviewees taking the interview. An evaluator at the client computer can use user interface tools to interviews. The user interface tools allow for an evaluator to navigate an interview by navigating to particular interviewees and/or particular questions and their corresponding responses. In one embodiment, interviewees provide responses to questions using a video camera and microphone connected to an interviewee client computer which streams the responses to the server computer. The server computer can then stream these responses to the evaluator client computer.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
Additional features and advantages will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the teachings herein. Features and advantages of the invention may be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims. Features of the present invention will become more fully apparent from the following description and appended claims, or may be learned by the practice of the invention as set forth hereinafter.
In order to describe the manner in which the above-recited and other advantages and features can be obtained, a more particular description of the subject matter briefly described above will be rendered by reference to specific embodiments which are illustrated in the appended drawings. Understanding that these drawings depict only typical embodiments and are not therefore to be considered to be limiting in scope, embodiments will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
Embodiments herein may comprise a special purpose or general-purpose computer including various computer hardware, as discussed in greater detail below.
Embodiments described herein may include is a software and computer system tool that facilitates the efficient interviewing of individuals, typically for jobs or college admissions, by providing a mechanism for collecting real time information from candidates without requiring a real time meeting. This tool enhances the interview process by facilitating the creation of interview which may include multiple choice, yes/no, true/false, short answer questions and video recorded questions. By “real time information gathering” the inventor means that the person being interviewed (hereafter the “interviewee”) is asked questions and promptly gives unrehearsed answers. In some embodiments, the time the interviewee takes in responding is recorded along with the answer. This ensures that the interview does not have an opportunity to rehearse answers or receive assistance. In other embodiments, the interviewee may be given a limited amount of time to review a question and to answer a question. For example, an interviewee may be given 30 seconds to read a question, and two minutes to respond to the question. These times are exemplary, and other times may be used in alternative embodiments. In the present embodiment, the video recorded questions store a video of the interviewee responding to selected questions in addition to the responses themselves. This approach provides a realistic interview scenario for these questions because the person(s) evaluating (hereafter the “evaluator”) the interview is provided more than simply the answers given by the interviewee, but also the demeanor and responsiveness of the interviewee. Moreover, this technique helps to minimize the possibility that the interviewee will receive assistance in giving answers to the questions.
After the interview is taken, the evaluator can not only evaluate and comment on the interviewees themselves, but can also pass the collected interview information to others for their evaluation. As the evaluators score the interviewees, this process collects and compiles the resulting scores into a clear summary format, appropriate for printing for management review and legal compliance. One embodiment also provides the mechanism for job seekers, potential interviewees, to take and have stored a generic interview for the industry or job of their choice. The interview information and interviewee biographical information are then stored in a database, which is made available to potential employers for review, consideration and as an aid in recruiting.
The following example is provided to illustrate the use of one or more embodiments in the following description. A company has an open position for a Sales Representative. A number of applications are received. The company's initial review of the applications narrows the number of applicants to ten. Embodiments can then used to create, implement and evaluate an on-line interview for the ten candidates. An administrator of the company enters the questions, which are appropriate for the candidate evaluation into the process of some embodiments. Typically, the administrator also enters the names of the candidates, the basis for evaluation and the list of evaluators who will review the interviews and evaluate them. The candidates are contacted, typically by email, and the interview is conducted, typically using a computer with a web cam networked through the Internet to a server computer (hereinafter the “process computer”) executing the process of some embodiments. The candidate may be provided with an interview code that can be entered when the candidate accesses an on-line interview site. The interview information is captured and stored. The evaluators then login to the process computer and watch the interviews and evaluate the candidates. The evaluation is entered into, received and stored in the process computer for subsequent summarizing and reporting.
Referring to the Sales Representative Example, if an interview is created with the job title being “Sales Rep 1” with its appropriate job description, each time a user (administrator or evaluator” enters “Sales Rep 1” as the job of interest, the job description and previously entered interview questions automatically populate the interview creation screens of this process, thus speeding up the interview creation process. Questions are created 202. The questions creation step 202 presently permits the user to select and input the type of question, which is, received 203 by the process. Question types may be, for example: (1) audio/video recorded questions; (2) multiple choice questions; (3) true/false questions; (4) yes/no questions; (5) short answer questions, where the interviewee is asked to type in a response; and (6) uploaded file document based questions, such as a diagram, a section of text, mathematical problems and the like with one or more questions asking the interviewee to view and analyze the file document. For each question, the type is received 203 by entering the type from a pull-down menu. Other embodiments allow for text boxes, radio buttons, and the like to be used to designate the question type. The question itself is then received 204, presently by being entered into a text box field in the display screen. If the question has a “correct” answer, this answer is received 205, presently by the selection of an “answer available” box and the receipt of the answer in a text box field in the display screen. Again referring to the “Sale Rep 1” example, each time the administrator or evaluator uses “Sales Rep 1” as the job title of interest, the questions previously entered are automatically populated in the “Create Questions” screen or menu. In one embodiment, this ensures that the questions for the same job can be asked in the same order and the same fashion for each interviewee, thereby standardizing the interview process and avoiding potential legal or policy problems in the hiring procedure. The candidate information is received 206. During this 206 step, the candidates contact information (name, address, telephone number, fax number, email address and the like) are received 207 and saved. The candidate's name may be added 208 to an editable list for contacting and tracking. An interview is set up 209 by using an appropriate contact method. In some of the presently envisioned embodiments, a contact method may include one or more of the following: automatically generated letters, faxes or email and/or a voice synthesized automatic phone call or the like. Preparation 210 for the evaluation is performed. In the present embodiment, this preparation further includes receiving 211 the names (and contact information in some embodiments) of the desired evaluators. These evaluators are typically the people in the hiring organization that will have access to the interviews. These individuals are then typically contacted by email (from their received contact information) giving them a list of individual interviews to be evaluated, a login code and a password. Some embodiments support the use of single evaluators or a “committee” including of a group of evaluators. The evaluation criteria 212 is received in order to assure that the candidates are evaluated using a standard criteria by the evaluators. For example, some received criteria could be such skills as “communication skills” or “negotiating skills”. Once received, the present process can provide the criteria for evaluation to the evaluators as a matrix or Cartesian coordinate system with the criteria as the axis. A display 213 of the summary and payment information is made. Presently, the summary and payment information screen (or page) is a printable page that shows the data (job title, job description, interview questions, candidate information, access information, evaluation criteria and the like) that has been entered and provides options for payment for the service of this process. Currently envisioned payment options include: direct account, credit card and the like.
If there are gradable questions in the interview of interest, such as multiple choice, true/false or yes/no, the candidates test score 708 (
As the users watch the candidates answer the questions, they can input their ratings of the candidates. For example,
The user may also enter comments in a comments section and in some embodiments the user may choose to see comments from other users who have viewed the interview. For example at 720 in
Additional functionality is also illustrated in
Organizations looking for individuals from the database for hiring, first login 407. A query page is presented where the hiring person selects 408 the criteria that should be matched by job seekers. The results from this query are presented 409, typically using a tiered approach with the first level being job seekers that are exact matches, the second tier being close matches, and etc. After receiving a list of job seekers the hiring person can select from a list of names that he or she wishes to review. This selection is received 410 and the pre-interview information and resumes of the job seekers are displayed 411. After reviewing this information, the hiring person can add the name of one or more job seekers to the list for contact. The contact list is received 412 and the hiring person is offered 413 the opportunity to invite persons to take an invited specific interview. If an invited interview is selected, the hiring person is given the opportunity to design an interview as described above with regard to step 102.
Attention is now directed to
The interviewee clients 802 may include any one of a number of clients which may be embodied, for example, as client computer systems being connected via a high-speed internet connection or other suitable network connection. In one embodiment, one or more of the interviewee clients 802 may be located at an on-site interview facility. In this example, interviewees can access the interviewee clients 802 by visiting an office or other location where computer systems have been set up by an organization wishing to have candidates take interviews. The computers may have cameras, such as webcams, connected to the computer system. The computer system of the interviewee clients 802 in this embodiment may be connected to the server 804 through an internet connection, local area network (LAN) connection, other wide area network (WAN) connection, or through any other suitable client to server connection.
In an alternative embodiment, one or more of the interviewee clients 802 may be located off site. In this example, an interviewee may use their own personal web cam and microphone, or may be provided with a web cam and microphone that can be connected to a personal computer at home or some other off site location that can serve as the interviewee client 802. Additionally, as some of the actions between the interviewee clients 802 do not require a video feed and can be conducted at different times, the different interviewee clients 802 can be used at different locations for different portions of the interview process even when some of the interviewee clients 802 do not have access to a video camera and microphone. In embodiments where the interviewee client 802 is off site, the interviewee client 802 should have access to an Internet connection with sufficient speed to transmit appropriate data. For example, lower speed connections may be used to transmit textual application materials or textual responses to questions. However, a higher speed connection should be used to stream video responses to the server 804.
In yet another alternative embodiment similar to the on-site example above, a campus network may be used to provide suitable computers and network connections to enable the interviewee clients 802. In this embodiment, a company can design and post a request for interviews to a college career center. The career center or company can then invite applicants to sit for an interview on-campus.
The server 804 coordinates messaging for inviting candidates to interview, receiving candidate's application materials, taking the candidate's interview, and providing the interview to evaluators. While a single server 804 is shown, it should be understood that the server 804 may include one or more servers such as the Flash Communication server 504, Web Server 505, and Database server 506 all shown in
The evaluator clients 806 may be implemented in a number of different ways. For example, the evaluator clients 806 may be home computers of evaluators where the home computers are connected to a suitable Internet connection. In an alternative embodiment, the evaluator clients 806 may be company computers that are connected to the server 804 through a company LAN, WAN, or other suitable connection. While evaluator clients 806 is used as a descriptor, it should be understood the one need not necessarily evaluate an interview to use an evaluator client 806. For example administrators, managers, and the like may use evaluator clients to create interviews, assign user rights, schedule interviews, add candidates to interviews, and the like, as illustrated in more detail below, but do not need to necessarily evaluate any interviews.
At 810 application materials are received by the server which are sent from an interviewee client 802. Application materials 810 may be for example, an electronic version of a resume, information from an on-line job application, information entered by a campus career center, or other similar information.
A company representative at an evaluator client 806 can review potential candidates by their application materials 810 and select candidates to be interviewed by sending a select candidate message 812 from an evaluator client 806 which is received at the server 804. The server 804 can notify interviewees by sending an invitation and access credentials 814 to interviewee clients 802. As noted previously herein, different actual machines may be used to implement the functionality of the interviewee clients 802. For example, an interviewee's own personal home computer may receive an email message which includes the invitation and access credentials 814. The actual on-line interview may take place on a different computer, but the interviewee's own personal home computer still implements interviewee client 802 functionality.
The access credentials may be some type of token, identifier, and the like, such as a user name and password, that may be provided to the server 804 to access the server 804 to have an interview taken. For example, as illustrated, the access credentials 816 are sent by an interviewee client 802 and received by the it server 804. The server 804 can then authenticate a candidate so that the candidate can take the interview. In one embodiment, the access credentials may include the interview code described previously that allows the candidate to take the appropriate interview.
To take the interview, questions 820 are sent by the server 804 and received by an interviewee client 802. As mentioned previously, the interviewee client 802 may be for example, an interviewee's own personal computer, an on-site computer, an off-site computer, etc. As mentioned previously, an indicator of when the question 820 was sent may be maintained by the server 804 so as to limit the amount of time that an interviewee has to read and comprehend the question 820 or to time the amount of time an interviewee takes to respond to the question 820. As described previously, the questions may be for example, audio/video recorded questions; multiple choice questions; true/false questions; yes/no questions; short answer questions, where the interviewee is asked to type in a response; uploaded file document based questions, such as a diagram, a section of text, mathematical problems and the like with one or more questions asking the interviewee to view and analyze the file document; etc.
Responses 822 are sent by an interviewee client 802 and received by the server 804 in response to the question 820. An audio/video recorded question may be sent as a text question that is answered by responding verbally while being recorded by a camera and microphone. In one embodiment, the response 822 to an audio/video question may be streamed to the server 804. For example, using streaming audio and video technology, the audio and video of the response 822 is sent directly to the server 804 in near real time. While a temporary cache of some of the audio and video data may be maintained at the interviewee client 802, a permanent cache is not maintained. In one embodiment, this provides increased security in that confidential responses 822 can only be made available by the server 804 and are thus not accessible by having been stored at the interviewee client 802 where they were provided.
Multiple choice responses 822, true/false responses 822; yes/no responses 822; and short answer responses 822 may be provided by an interviewee at an interviewee client 802 by the interviewee selecting appropriate check boxes, radio buttons, or filling in text boxes. Uploaded file document based responses, may be provided by scanning documents, uploading electronic documents, sketching on a pen tablet input device, inputting drawings and text by using interface devices such a mouse and keyboard, etc.
Interviews that have been taken can then be viewed by an evaluator at an evaluator client 806. However, the ability of an evaluator to view an interview may be limited by role and may be specified by a company representative with a more senior role. For example, an administrative user such as a master company member may have the ability to specify other company member's rights in the interview process. For example, a master company member may be able to specify what members have rights to create interview, add questions to interview, add candidates to interviews, add college access to interview, watch and evaluate interviews, create accounts with an interview hosting company, create groups of candidates for a particular viewing audience, grant and revoke rights to access groups, etc.
For example, a company may have a database with over 1000 interviews from candidates, which may include video data files, and/or typed/selected responses, for 50 different positions. A master company member may wish to show three particular candidates to a hiring manager but does not want to allow the hiring manager to see the entire pool of candidates. As such, the master company member can create an account for their hiring manager including a “User” status. From there, the master company member can define one or more a groups within a group of interviews. This may be done, for example, by dividing by job title. The master company member can then name the group and select which candidates out of the larger group candidates they want the hiring manager to see. When the hiring manager logs into interview server 804, the hiring manager will be brought to a view page where the hiring manager will only see the groups of interviews to which the master company member has granted him access. For example, the server 804 may only provide a user interface to the evaluator client 806 that includes the groups specified by the master company member. The hiring manager can select the group to view and will then proceed into an evaluator screen provided by the server 804 to the evaluator client 806 such as the user interface 700 illustrated in
Returning once again to
The evaluator at the evaluator client can send a select candidate message 826 from the evaluator client 806 that is received at the server 804. For example, as illustrated in
As illustrated in
While not shown in
Embodiments may also include computer-readable media for carrying or having computer-executable instructions or data structures stored thereon. Such computer-readable media can be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code means in the form of computer-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a computer, the computer properly views the connection as a computer-readable medium. Thus, any such connection is properly termed a computer-readable medium. Combinations of the above should also be included within the scope of computer-readable media.
Computer-executable instructions comprise, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions. Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
As just one illustrative example, the server 804 may include computer executable instructions stored on a computer hard disk to enable the sending of messages and storing of data.
The present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
This application claims the benefit of U.S. Provisional Application No. 60/669,460 titled METHOD AND SYSTEM FOR INTERVIEW PROCESSING, filed on Apr. 9, 2005, which is incorporated herein by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
60669460 | Apr 2005 | US |