The present application is related to and claims priority under 35 U.S.C. §119 to Spanish patent application P201200289, filed in Spain on Mar. 12, 2012, the entire contents being incorporated herein by reference.
1. Field of the Invention
The present invention generally relates to the field of project management and project organization, and it more specifically relates to a competence assessment method for assessing the competences of project managers or directors having influence on a project, as well as project technicians, and an implementation system for implementing said method.
2. Discussion of the Background Art
Project management and organization is currently a relevant field in any social-occupational and industrial environment. Good or bad management of a given project can be fundamental for its satisfactory or unsatisfactory development, which will ultimately dictate obtaining a commercially viable product or not or will facilitate a strategic change or not in an organization.
Competence assessment or management systems are known in the state of the art. For example document US2005159968 relates to a system that allows the acts of workers to be followed and consequently allows a possible assessment of the tasks performed. Document US2005228762 relates to a competence assessment system, where business objectives and market conditions are used for identifying the particular competences and corresponding requirements of the progress, which allows rating the degree of user preparation. Document US2008140485 relates to a system that allows assessing a project throughout its development, where the information is collected throughout the execution of the project and the milestones to be achieved are monitored. Another document, US2010198847, relates to a competence assessment system for assessing competence in project management. The information obtained in the execution of the project is simply compared with the best practices for obtaining a rating of the competences. However none of these documents allows assessing the competences of the user objectively, since the user's assessment and final grade usually depends on a single person. Furthermore, the known systems are usually adapted to a very definite assessment environment, therefore their application is very limited. Finally, none of the known systems allows obtaining a numerical rating of the competences in an automated and objective manner taking into account a multitude of simulation environment parameters.
Despite the enormous importance that this field has for the industry, substantial research efforts are not dedicated to it and there is currently no adequate method or system that allows assessing the organization of a project and foreseeing its viability, therefore allowing preventative corrective measures to be performed if necessary for optimizing its outcome.
An objective of the present invention is to therefore cover a void existing in the prior art providing a competence assessment method and system that facilitates consistently assigning resources for improving project organization and management.
In a first aspect, there is a competence assessment method for assessing the competences of participants in a project. The project to which the method can be applied includes at least one phase, at least one competence of an assessed participant intervening in at least one phase of the project, and the competence is assessed by at least one assessor figure by means of at least one piece of evidence. The method includes specifically determining, in a simulation environment, a numerical assessment of the achievement level of each competence depending on given variables:
Cmp
i
=f
i(Evj,s,Wx,kr,pj)
More preferably, the above formula fi is the following formula:
wherein
Therefore, it is possible to obtain a numerical assessment of the participants of a project in each of the competences they carry out, thus allowing assessing their suitability for carrying out specific functions on the basis of their abilities in specific competences and, depending on the results obtained, improving the organization of the project by assigning the various functions to the participants with the highest score in the competences relevant to these functions.
According to a second aspect of the present invention, there is a competence assessment system for assessing the competences of participants in a project implementing the method according to the first aspect of the invention is provided. is the competence assessment system includes a computer system with a processor configured to operate in accordance with a multilayer architecture, the multilayer architecture including at least three layers:
The present invention will be better understood with reference to the following drawings which illustrate an embodiment of the invention, provided by way of example, and which must not be interpreted as limiting the invention in any manner.
The present invention firstly provides a competence assessment method for assessing the competences of the various participants in a project. A project is understood as being a time and cost limited operation for producing a set of specific deliverables, i.e., meeting the objectives of the project according to quality standards and requirements.
As can be observed in
The organizational structure shown in
It is thus evident that said structure can also be applied without any modifications at other levels within a more complex structure, such as for example to a structure formed by: program, project and subcontract project or to a structure formed by a project portfolio, project and subcontract project. For the sake of clarification, a program may be understood as being a set of related projects established for attaining a strategic objective, while a portfolio is understood as being a set of projects or programs, not necessarily related to one another, brought together for the purpose of controlling, coordinating and optimizing the portfolio in its entirety.
In turn, each project, subproject or subcontract project is divided into several phases including, for example, the following phases:
In each of the above phases, the assessable participants develop specific competences, which are assessed by at least one assessor figure by means of at least one piece of evidence. Said numerical assessments of the various pieces of evidence are performed by means of forms. However, a person skilled in the art will easily understand it is possible to apply the method according to the present invention for assessing a participant participating in one or all of the phases of the project and/or develops one or all of the competences.
The following table 1 shows a list by way of example of the various competences which can be developed by each participant together with the forms with which said competences are assessed (the forms are called the same as the phases in which they are carried out, but are in brackets: for example, form [A] assesses the competences developed in phase A).
Form [BC] is used for assessing the behavior competences throughout the entire simulation. Form [TW] is used for assessing the technical competences related with the teamwork developed throughout the entire simulation. Form [N] is used for assessing negotiation competences. Form [DS] is used for the self-assessment of the author of a deliverable product him/herself, while form [DC] is used for assessing the author of a deliverable product by whoever receives said deliverable product. According to the ICB-IPMA Competence Baseline (Version 3.0) of the International Project Management Association (IPMA), the deliverables of a project, program or portfolio are tangible or intangible assets created by the project, program or portfolio for the client. The deliverables are depicted by plans, diagrams, descriptions, models, prototypes, systems and products of different classes. The deliverables are not only the product sold or the service put into use after closing a project, but also the operating processes, the organizational changes and the changes in human resources necessary so that a successful organization can operate.
According to an embodiment of the competence assessment method, each assessed participant is assessed by all the other participants of the project interacting with the participant in question for a given competence.
Accordingly, as shown in
Each of the competences described hereinabove is assessed by means of the aforementioned forms, by means of at least one piece of evidence clearly having those criteria determining the maximum degree of performance specified therein. In an embodiment of the invention for example, technical competence 5 (Time & Project phases) is assessed by means of 11 pieces of evidence, said pieces of evidence being produced throughout three phases (4 pieces of evidence in phase A, 6 pieces of evidence in phase B and 1 piece of evidence in phase D). Thus, for example, piece of evidence 6 of competence 5 in phase B, assessed by the auditor (AD) in form [B*], can be: “The project work plan as well as the project baseline have been defined in the project management software. Below is a list of example criteria that determine maximum performance:
[a] The task duration, start-end dates and priorities are observed.
[b] The work plan tasks are correctly related with the phases of the project.
[c] There are pieces of evidence in the records that the work plan has been presented and agreed on by the project management team.
[d] All the agreed on deliverables that are related with their corresponding tasks.
[e] There is a project baseline.
In each assessment form, the assessor will introduce his/her opinion on the achievement level attained by the assessed participant in each piece of evidence given, using a Likert scale (of 1 to 5), for example, in which:
Other assessment scales may be used as well. Each piece of evidence of each competence developed by an assessed participant thus receives a numerical assessment by each project participant interacting with said assessed participant with respect to that competence.
The method according to the present invention therefore comprises applying, in a simulation environment, the numerical data obtained by means of the assessment described above in the following formula:
wherein
A numerical assessment value of each competence developed by each project participant is thus obtained.
Variables Wx, kr or pj can take different values for each phase, opinion or piece of evidence.
As mentioned above, it is evident that the organizational structure shown in
A specific non-limiting example of numerical application of the competence assessment method according to an embodiment of the present invention is shown below. The numerical assessment of competence 15 (engagement and motivation) developed by a subproject manager is shown by way of example. Said competence is assessed only by means of form [BC] (see Table 1 above) by means of four pieces of evidence. In the present example, the assessment of this competence at the end of phase E of the subproject is all that will be taken into account. The following Table 2 shows the pertinent data in this example:
It is seen that in this specific case, the total number of phases in which the competence is assessed is 1 (phase E), in this case phase E having a weight (WE) of 3. The weight of the assessor figures (k1-6) is shown in Table 2 above. The total number of assessor figures (m) in this case is 4, since neither the subproject manager him/herself nor the auditor assess competence 15. The weight of each of the pieces of evidence (p1-4) for competence 15 is also provided in Table 2 above.
It must be observed that in this case there is only one assessor whose function (assessor figure) is that of main project manager; just as there is only one assessor whose function is that of subcontract project manager. However, there are three assessors whose function is that of subproject team member. There are also three assessors whose function is that of subproject manager, different from the subproject manager being assessed. Therefore in the two first cases, variable qr is equal to 1, while in the two last cases variable qr in the above formula is equal to 3.
When introducing the numerical values depicted in Table 2 above into the formula of the present invention:
the following result is obtained:
Cmp
15=3.41
In other words, the subproject manager assessed has obtained a numerical value for competence 15 of 3.41, with respect to a maximum numerical value of 5 which can be assigned.
As can be seen, the method according to the present invention allows assessing project management competences through putting said competences into practice in a simulation environment. The system is characterized in that it allows rating individual competences through a set of performance indicators. The indicators are obtained both from pieces of analytical evidence and from the opinions of other participants in the simulation in relation to the abilities demonstrated by the candidate through his/her specific actions. The system further allows obtaining information about the level of competences demonstrated not through measuring individual knowledge, but from the result of use in the simulation environment. There is no dependency relationship between the type of simulation which is developed (for example, for one type of project) and the competences which are measured are rated through indicators which are produced at different times of the simulation life cycle, paying attention to the roles of each participant, to the purpose of the participation, to the project structure itself, to the specific product which is being created, etc. The competence assessment system is independent of the purpose of the developed project; it also allows developing all or part of the defined competences as all the phases of the project or some in particular.
According to an additional embodiment of the present invention, the method comprises:
In other words, the method of the present invention can be used, resorting to historical data of previous projects, for determining the competences having more influence on the final result of a project, such that taking preventative measures for optimizing said final result of the project is allowed. Specifically, according to an additional embodiment of the present invention, the method further comprises:
According to another embodiment of the present invention, the method further comprises determining, after the data mining step described above, an optimized function for determining a final numerical qualification of an assessed participant. Said step further includes varying the weight of the competences having the greatest influence on the final quality of the project for optimizing the obtained result.
According to an embodiment of the competence assessment method of the present invention, data mining techniques can be applied for identifying the competences which best define the performance of the assessed person, in this example the PM.
The Auditor assesses the projects in which each participant has participated, qualifying them as, for example, Good, Fair and Poor (other levels can be determined). The quality of a project is determined in terms of degree of compliance with the agreements reached with the client: quality of the deliverables, compliance with the deadline and cost, level of satisfaction, etc. The numerical qualifications of the level of development of each of the competences in each project, obtained by the assessor figures, are known for each participant. Therefore, when using data mining techniques, for example, “Supervised Classification” by means of “Discriminant Analysis”, it allows obtaining a discriminant function, Q, which allows:
Therefore, by having numerical values for all the competences developed and the optimized function (optimized F) it is possible to obtain the numerical assessment of the achievement level of all the competences developed by the PM according to the formula:
K[PM]=optimized F(Cmpi)
Evidently, although the method of the present invention has been described with reference to specific embodiments thereof, persons skilled in the art understand that modifications and variations can be made without departing the scope of protection of the attached claims. For example, according to specific embodiments of the invention, each assessed participant will only be able to be assessed by the Auditor figure, specifically dedicated to this function.
As described hereinabove, a second aspect of the present invention discloses a competence assessment system for assessing the competences of participants in a project, or in a set of related projects or a set of projects not related to one another, which allows implementing the competence assessment method according to the first aspect of the invention described hereinabove. It specifically relates to a computer system with multilayer architecture comprising at least three layers:
More preferably, the competence assessment system has at least three levels. A first level is a client level, comprising the user interface installed in a user device with internet access. The second level is an intermediate level comprising a presentation layer and an application layer. This intermediate level comprises a web server responsible for constructing the user interface (presentation layer) as well as an application server responsible for receiving events from the users, executing them in the specific tools of the competence assessment method and replying to them (application layer). Said application server also manages communication with the data layer. Finally, the third level is a data level, in which the data layer is located, which manages and stores data generated by the application layer.
According to an embodiment of the present invention, the competence assessment system comprises:
In the above described embodiments, the term simulation environment is the name given to a set of information systems (hardware and software) interconnected through a TCP/IP communications network which facilitates the competence assessment in project management. As seen in
The software tools encompassed in this simulation environment are implemented in a computer system with a multi-tier architecture (“n-tier”) including at least
As seen in
As seen in
One skilled in the art would know that each of client tier, web/app tier and data tier includes one or more processors, and may include one or more displays, data input units and various input and output connections.
The system of the present invention preferably comprises at least the functions of proprietor, auditor and assessed participant (although, as seen hereinabove, it can comprise more functions). However, it must be understood that one and the same person can perform various functions within the competence assessment system of the present invention. For example, the functions of proprietor and auditor can be performed by one and the same person.
Furthermore, the system allows the remote interaction of participants, with different locations, time zones, cultural bases, etc., so it is not restricted to a single specific time or physical space.
The competence assessment method and system of the present invention are widely applicable in any field of the industry since they allow maximizing the final result of any project, optimizing the use of the available resources assigning to specific managers the competences in which they obtain higher numerical competence assessment scores.
However, the method and system of the present invention also find other types of applications within the art which are equally interesting. For example, they can be used as professional project manager certification tool. They are also are useful as an instrument to improve the recruitment of staff for project management.
Number | Date | Country | Kind |
---|---|---|---|
P201200289 | Mar 2012 | ES | national |