There are two methods of gathering data: one-on-one interviews and panel/focus groups. One-on-one interviews can be conducted via telephone or in a face to face situation. The value of data analysis and the success of the competency model are dependent upon the precise recollection of the data and interpretation of the incumbent’s point of view.
The surveying of data can be done in a variety of ways. The simplest way is to use average scores and a frequency distribution. However, a more complex analysis that uses more advanced statistical techniques, such as the t-test, standard deviation and one-way ANOVA could be used to help the competency draw its conclusions. “Although utilizing average scores, frequency of responses, and median scores assist the team in eyeballing levels of agreement between groups the more sophisticated analysis increases your confidence in the final conclusions” (Lepsinger & Lucia, 1999).
To determine the validity of a model, a mean efficiency rating could be conducted that would divide the population into two groups: performers above the median and performers below the median. "Competency scores could then be compared between greater groups by using t-test and ANOVA comparisons with a significance cutoff of p < .05." A value of .05 would indicate that there is a five percent (or a one in twenty) likelihood that the variation found amid the groups being compared is by chance. Significance values less than or equal to .05 would indicate that there is a significant difference between the groups (Schwabb, 1999).
Upon evaluating the data, the competency model requires finalization. This means that any categories or items that do not correlate with effectives in the job can be eliminated. "The result is a set of competencies and their associated behaviors which can be used as the basis for developing or enhancing tools used for human resource decision making" (Guion, 1998).
An example of the use of competency models can be seen in a 1999 study at St. Frances Hospital in Tulsa, Oklahoma. Researchers surveyed three critical care units at the hospital. Upon completion, they had a total of 27 competencies to work with. They were able to perform statistical analyses to identify the most critical job tasks, the necessary knowledge, skills and abilities, known as KSA's, and other pertinent characteristics.
There were a total of six (6) phases in performing the analysis. Researchers interviewed 75 critical care nurses (CCN's). Panel discussions were conducted in which between one and six participants were involved. This is where the job requirements of the critical care nursing positions were determined.
As a result of these interviews, all tasks performed by CCN's were compiled. These tasks were then organized into ten different groups which were then evaluated by a nurse manager. After the nurse manager made revisions, the tasks were presented to a management team. The team was then able to determine what the necessary KSA's were for successful job performance. The last step involved the researchers using the revised list to create the job analysis questionnaire.
The job analysis questionnaire was comprised of four sections. Section I contained demographic information, while the second section was a 106-point scale to measure the importance of each task, and a six-point scale which was used to rate the significance of error in performing these tasks. Frequency ratings ranged from “0” if the task was never performed to ”5” if it was performed daily or more often. Importance ratings ranged from “0” if the task was viewed as irrelevant to “5” if it was viewed as unquestionably critical to job performance. Finally, consequence of error ratings ranged from “0” if no problems occurred as a result of error in performing the task to “5” if an error resulted in severe problems or legal action.
Section III consisted of 60 KSA's. "The KSA's were rated on three different scales. They are as follows: a yes/no scale to determine if the KSA was required, a five-point scale that indicated the importance of each KSA for effective job performance, and a three-point scale to determine when the KSA is needed." The importance scale could range from “1” if the KSA was immaterial to “5” if it was absolutely necessary to achieve effective performance on the job. Section IV asked respondents to show the percentage of the job that they felt was described by the Job Analysis Questionnaire.
Descriptive statistics representing the demographics of the CCN's is seen in Appendix A below. Statistical results are displayed in Appendix B as shown below. "In order for a task to be considered critical for effective job performance, the mean ratings must be equal to or exceed 4.0 (4=weekly performance of task) for task importance, greater than or equal to 3.0 (3=average performance of task for task importance, and greater than or equal to 2.0 (2=several minor problems occur) for consequence of error" (Radford, 1999).
Results indicated that approximately 87% of the job of critical care nurse was covered by the questionnaire. Overall, the data indicates that the majority of the critical care nurse position was captured by this job analysis. Additionally, over 75% of the job tasks presented in the questionnaire were rated as critical to effective job performance (Radford, 1999).
As we can see by the study at St. Francis Hospital, the use of competencies in the workplace can be beneficial to all involved. While the study takes time, work and can be costly, the benefits are clearly visible.
(Radford, 1999)
(Radford, 1999)
(Radford, 1999)
References
Guion, R. M. (1998). Assessment, Measurement, and Prediction for Personnel Decisions. Mahwah, NJ: Lawrence Erlbaum Associates.
Lucia, A.D. & Lepsinger, R. (1999). The Art and Science of Competency Models. San Francisco, CA: Jossey-Bass/Pfeiffer.
Pritchard, K. H. Society for Human Resource Management. (2002). Selecting And Using Compensation Surveys: Critical Issues For Today’s HR Professionals Retrieved May 30, 2005, from
Radford University. (1999). Job Analysis Technical Report Radford, VA: Author. Retrieved June 10, 2005, from http://www.runet.edu/~smrobson/psy381/Job%20Analysis%20Report.pdf
Schwab, D. P. (1999). Research Methods for Organizational Studies. Mahwah, NJ: Lawrence Erlbaum Associates.
Spencer, Jr. L.M. & Spencer, S.M. (1993). Competence at Work. John Wiley & Sons.
Still deciding whether to add…
