A CASE STUDY OF PERFORMANCE APPRAISAL IN A SMALL PUBLIC SECTOR ORGANISATION

Authors Avatar

A CASE STUDY OF PERFORMANCE APPRAISAL IN A SMALL PUBLIC SECTOR ORGANISATION: THE GAPS BETWEEN EXPECTATIONS AND

EXPERIENCE

JOHN MOONEY

A dissertation submitted in partial fulfilment of the requirements of the University of

Chester for the degree of Masters of Business Administration

CHESTER BUSINESS SCHOOL December 2009


Acknowledgements

To my beloved wife Lesley, and children, Liam, Shaun and Hannah, who tolerated my regular withdrawals from normal family life throughout my MBA studies. And to the talented and approachable lecturers and staff on the Chester MBA programme.


Abstract

The research project sets out to identify the gaps between expectations and experiences of performance appraisal in a small public sector organisation. The document explains how Passenger Focus, the rail watchdog, has undergone a successful corporate transformation from the previous federal network of regional committees into a new credible consumer body. The organisation has a new vision, and robust business planning processes have been introduced. However, there is a need to improve performance management through a new performance appraisal system. The overall purpose of the research is to assess the gaps between expectations and experiences in order to inform a new system.

The literature review explains the background to the development of performance and its measurement in the public sector. It includes a detailed analysis of thinking on performance appraisal. The literature review concludes that performance appraisal can greatly benefit organisations, but appears to not be delivering in many cases. A conceptual model is developed to frame the empirical research.

The research takes the form of a case study, and the findings are collated through qualitative interviews. A focus group was conducted, which framed the issues of concern, and these were explored in much more detail through semi-structured interviews. The findings revealed that there was a high level of understanding from staff of the need for performance appraisal. The largest gap between expectations and experiences lay in the current system, with respondents particularly concerned about the lack of training and over-simplistic documentation. Non-measurement of competencies was also a concern. Respondents were generally positive about recent experiences of appraisal. The findings suggest that motivated managers have made the system work for them, despite concerns about process, and respondents believe fairness is generally achieved. More attention is required to appraise team effort. There was little appetite

for a system that links appraisal to financial reward.

The conclusions of the research have informed the main recommendation, to develop a new system that is much more comprehensive, and incorporates training and guidelines. That new system should be developed through engagement with staff.


Declaration

This work is original and has not been submitted previously for any academic purpose. All secondary sources are acknowledged.

Signed……………………………………………………………………………………

Date………………………………………………………………………………………


Table of contents

page

Acknowledgements………………………………...……………………………………2

Abstract……………………………………………...……………………………….…..3

Declaration……………………………………………………………………………….4

Table of contents……………………………………………………………………...…5

List of tables……………………………………………………………………………..7

List of figures……………………………………………………………….……………8

1. Introduction……………………………………………………………….………..…9

1.1 Background to the research……………………………………….………....9

1.2 Research question……………………………….…………………...……..12

1.3 Justification for the research…………………………………………...…...13

1.4 Methodology………………………………………………………………..14

1.5 Outline of the chapters………………………………………………...……14

1.6 Summary…………………………………………………………………....16

2. Literature review…………………………………………………………………......17

2.1 Introduction……………………………………………………………...…17

2.2 Performance defined……………………………………………………..…17

2.3 Performance management features………………………………………....18

2.4 Performance management in the public sector…………………………..…19

2.5 The Passenger Focus Performance Management cycle…………………….20

2.6 Performance appraisal ……………………………………….…………….21

2.6.1 The purpose of performance appraisal……………..…………….22

2.6.2 Performance appraisal systems……………………...……………25

2.6.2.1 Who appraises?................................................................26

2.6.2.2 Other sources of feedback……………………………..26

2.6.2.3 Self appraisal………………………………………..…26

2.6.2.4 Frequency of appraisal………………………………...27

2.6.2.5 Training and guidelines………………………………...27

2.6.2.6 The performance appraisal interview………………….28

2.6.2.7 What is appraised ……………………………………...29

2.6.2.8 Ratings systems and fairness………………………..…30

2.6.3 Outcomes of the system……………………………………….….32

2.6.3.1 Improving performance……………………………...…32


2.6.3.2 Appraisal and financial reward…………………..……..32

2.6.3.3 Personal development and training……………….…….33

2.6.3.4 Motivation and job satisfaction…………………….…..34

2.7 Conceptual model……………………………………………………….….35

2.8 Summary……………………………………………………………………37

3. Methodology………………………………………………………………………...38

3.1 Introduction………………………………………………………………...38

3.2 Research philosophy………………………………………………………..38

3.3 Research approach………………………………………………….......…..40

3.4 Research strategy……………………………………………………..…….40

3.5 Research methods…………………………………………………….…….41

3.6 Ethical considerations………………………………………………..……..44

3.7 Summary……………………………………………………………………45

4. Findings……………………………………………………………………..……….46

4.1 Introduction………………………………………………………….……..46

4.2 Findings from the focus group………………………………………..……46

4.2.1 Responses from the focus group…………………………………47

4.3 Findings from semi-structured interviews…………………………………51

4.3.1 Framework of semi-structured interviews…………………….…51

4.3.1.1 Background……………………………….…………....52

4.3.1.2 General questions………………………….…………...52

4.3.1.3 Purpose of performance appraisal………….…………..52

4.3.1.4 The current system……………………………………..52

4.3.1.5 Delivery of performance appraisal…………………..…52

4.3.1.6 Outcomes……………………………………………….53

4.4 Analysis of findings by theme…………………………………………..….53

4.4.1 Background issues………………………………………………..53

4.4.2 Purpose of performance appraisal………………………….…….54

4.4.3 The appraisal system – expectations and experience………….…55

4.4.4 Delivery of appraisal – expectations and experience……………56

4.4.5 Outcomes – expectations and experience……………………..….57

4.4.6 Other issues raised…………………………………………..……57

4.5 Summary…………………………………………………………………....58

5. Conclusions………………………………………………………………………….60

5.1 Introduction………………………………………………………...………60


5.2 Conclusions about research findings………………………………………60

5.2.1 Understanding of the purpose of performance appraisal………....60

5.2.2 Current system – identified gaps……………………………...….61

5.2.3 Delivery of performance appraisal – identified gaps……………..63

5.2.4 Outcomes – identified gaps………………………………..……..65

5.2.5 Conclusions on other issues raised………………….……………66

5.2.6 Conclusions set against conceptual framework…………….…….67

5.3 Conclusions about research objectives………………………………….….68

5.4 Critical evaluation of the adopted methodology……………………….…..70

5.5 Limitations of the study……………………………………….……………71

5.6 Opportunities for further research……………………………………...…..72

6. Recommendations………………………………………………………………..….73

6.1 A new performance appraisal system……………………………………....73

6.2 Design of system – engagement with staff…………………………………73

6.3 Multi source feedback……………………………………………………...73

6.4 Training and guidelines…………………………………………………….73

6.5 Improved performance management……………………………………….74

7. Bibliography………………………………...……………………………………….75

8. Appendices

8.1 Passenger Focus Performance Appraisal Guidelines

8.2 Passenger Focus Appraisal Forms

8.3 Summary of responses from semi-structured interviews


List of tables

1.1        Summary of scale of change from RPC to Passenger Focus……...……………11

2.1        Purpose of performance appraisal……………………………....…..………….24

2.2        Range of issues discussed in appraisal………………………………...……….29

2.3        Examples of competencies measured…………………………………..………30

2.4        Performance appraisal ratings guidance…………………………………..……31

4.1        Summary of comments from focus group……………………………………...47

4.2        Response to purpose of performance appraisal question………………….……55


List of figures

1.1        Satisfaction levels – extract from Employee Opinion Survey 2007……………12

2.1        Commitment to Goals - extract from Employee Opinion Survey 2007………..23

2.2        Manager feedback - extract from Employee Opinion Survey 2007....................27

2.3        Psychological contract and performance appraisal.............................................35

2.4        Conceptual framework…………………………………………………………36

3.1        Chosen research method………………………………………………………..38

3.2        Matrix for plotting gap between expectations and experience............................44

4.1        Focus group perception of expectations and experiences...................................51

4.2        Employee engagement - extract from Employee Opinion Survey 2007……….54

5.1        Teamwork - extract from Employee Opinion Survey 2007................................61

5.2        Overview of gap – performance appraisal system……………………………..63

5.3        Accuracy of appraisal - extract from Employee Opinion Survey 2007………..64

5.4        Overview of gap – performance appraisal delivery…........................................65

5.5        Benefits package - extract from Employee Opinion Survey 2007.....................66

5.6        Findings set against conceptual model…….......................................................67


1. Introduction

The overall purpose of this research report is to assess the gap between expectations and experiences, from the staff perspective, of performance appraisal, in order to inform an improved system that will be implemented in a small non departmental public body. This  first  chapter  provides  an  overview  of  the  whole  dissertation.  It  will  give background to the research, explain exactly what the issue is that requires research, justify the project, and give an overview of the methodology that will be used.

1.1 Background to the research

Passenger Focus is the statutory watchdog for rail passengers in the UK.        It acts as a passenger advocacy service, pushing for service improvements, by engaging with passengers to understand their needs, and then representing their views to the rail industry and relevant public agencies.

The organisation was formed in January 2006, resulting from the Railways Act 2005. It took over from the previous Rail Passengers Council and Committees (RPC) federal network that was  considered ineffective by stakeholders. In particular, a House of Commons Transport Select Committee Report (2004) criticised the RPC, suggesting that whilst rail passengers need a strong consumer voice, the profile of the RPC is too low. Following this, the Government published its white paper The Future of Rail (H.M.Government 2004). That paper was critical of the RPC, stating that the current federal structure inhibits effectiveness, the profile of the organisation was low, and that involvement with the industry and passengers could be better focussed. The proposals, which have now been implemented, created a new national body, and the regional autonomous committees were abolished.

A new three year corporate plan has been adopted and the emphasis of the organisation has moved away from dealing with local parochial issues towards a more strategic operation that ensures the views of passengers are captured and acted upon. Anecdotal views of committee members and staff are no longer used. The views of users are now captured through major research programmes, so the organisation can speak to stakeholders in the rail industry with authority. Output targets for the new organisation include measurement of the numbers of passengers engaged with, and outcomes are measured in terms of service improvements introduced on the basis of passenger views.


This is a considerable departure from the previous model. The transformation        was considerable, and the end result is   consistent with the views expressed by Nutt and Backhoff (1997 p235) ; A transformation creates a sustainable metamorphosis from a vision        that        produces        radical        changes        in        an        organisations        products/services, consumers/clients, market channel, skills, sources of margin, competitive advantage, and persona, integrating these changes with core competencies.

The table below demonstrates the scale of change.

Table 1.1 Summary of scale of change from RPC to Passenger Focus

New corporate measures are in place, and the organisation is considered “fit for purpose” by the sponsor body, the Department for Transport. From a staff perspective, it would appear the transformation has been successful. The figure below shows the

2007 overall measurement of staff satisfaction with the organisation. It can be considered very positive, and is 13% higher than the national government benchmark.


Figure 1.1  Satisfaction levels - Extract from Passenger Focus Employee Opinion

Survey 2007

Q80. Considering everything, I am satisfied to be working for Passenger Focus.

69%        7%        14% (Difference from national benchmark +13%)

Key

Positive        neutral        negative

Source: Passenger Focus Employee Opinion Survey 2007

However, one work stream associated with the transformation remains outstanding, that is to design and implement a revised performance appraisal system. Previous work by the author (Mooney 2005) identified weaknesses in the appraisal element of the existing appraisal system. That study also highlighted research by Brumbach (2003) who suggested that the appraisal system can be perceived as a dishonest annual ritual. The literature review of this dissertation will examine this issue much more closely, and test these findings against empirical research. The conclusions will lead to recommendations that the organisation can incorporate into a new system that will be introduced as soon

as possible.

1.2 Research Question

The overall research problem concerns the credibility and effectiveness of performance appraisal systems. The literature review will outline many criticisms about the design and application of such systems. It was clear from conducting the literature review that much had been written about experiences of performance appraisal, but little could be found about expectations of the system.

The aim, therefore, of this dissertation is to assess the gaps between expectations and experiences, from the staff perspective, of performance appraisal, in order to inform an improved system.

Five objectives have been identified, and by tackling these inter-related objectives, through the linking of previous research, a detailed literature review, and new empirical research, solutions to the problem should be identified. The objectives of this research are;

i.        To analyse and critically review literature on performance, and in particular how it is appraised


ii.        To conduct a critical review of the features of the current Passenger Focus appraisal system.

iii.        To understand what staff expect from the system iv.        To capture experiences of the appraisal process

v.        To use the gap between expectations and experiences to provide empirical evidence that will inform an improved system.

1.3 Justification for the research

There are two key reasons for undertaking this research. One is to deal with a current “live” performance management issue, and the other is to try to fill a gap in academic research.

Consumer representation of rail passengers has recently undergone considerable change. Out of the embers of the previously inefficient federal network of Rail Passenger Council Committees has been born Passenger Focus. The new body was launched in January 2006, with a new corporate plan, three year business plan, and, critically, new ways of working. The previous ways of helping passengers, through tackling anecdotal issues was cast aside. The new organisation would put rail users at the heart of industry decisions. It would do that through undertaking significant market research. ie actually asking passengers what mattered to them. With the launch of the new organisation came a new streamlined national board, and a small Executive

Management Team (EMT). The author, as a member of the inaugural EMT was charged with ensuring effective staff performance is delivered from the outset. A new, but interim, Performance Appraisal system was put in place, but it was recognised that it would not be fit for purpose as the organisation took off. So, answering the research questions will assist in the development of a new effective performance appraisal

system -  a “live” management problem. If employees are not happy with the existing appraisal system, they would be unwilling to take a full part in it, which in turn would lead to lower productivity (Wright and Cheung 2005).

Secondly, an initial examination of relevant literature found gaps in the research. Much research has been undertaken on performance appraisal, not much of that

complimentary of theory and practice. Roberts and Pregitzer (2007), as an example, suggest that performance appraisal is a yearly right of passage that triggers dread and apprehension in the most experienced, battle hardened managers. This study provides


new empirical research on the views of recipients of performance appraisal – an area identified as a major gap in research on the subject (Simmons 2002, Redman et al

2000).

1.4 Methodology

1.4.1 The research        paradigm adopted is        interpretive. According to Saunders et al (2007) the interpretive paradigm  is  a philosophical position which is concerned with understanding the way we humans make sense of the world around us.  The reasons for this approach are set out in detail in the methodology.

1.4.2 The research approach is inductive (or qualitative). The approach is more concerned with human issues than pure science.  The literature review does not set out a definite theory, but does establish a conceptual framework to aid the gathering and analysis of data to answer the research question.

1.4.3. Research strategy. The chosen research strategy is a cross-sectional case study. The empirical data will be based on qualitative interview  methods. This will offer the highest chance of successful research, as it will measure human response. It can also be achieved within the timescale of the project.

In summary, the research methods will include

•        Focus group with volunteers from staff forum

•        Semi-structured   interviews   focusing   on   expectations   and        experience   of performance appraisal

•        Use  of  secondary data  from  detailed  (and  independent)  Employee  Opinion

Survey

The research will allow comparison between groups of employees, to determine if length of service or seniority is a factor. Confidentiality will be assured to participants, and the report will be edited to protect identification of individuals before it is circulated to the organisation’s management board.

1.5 Outline of the chapters

1.5.1 Chapter 1

This chapter gives an overview of the whole project. It sets out what the research area is,  breaks it down into a series of objectives for the project, and relates this


to the background of the organisation that is to be studied in depth. This chapter also gives an overview of why an interpretive paradigm has been selected, and sets out and justifies the research strategy.

1.5.2 Chapter 2

This chapter reviews literature relevant to the research objectives. It builds a theoretical foundation upon which the research is based. It commences with an examination of what performance is, and why it is measured. The chapter then considers how performance appraisal fits into the parent discipline of performance management. A review of literature   covering  appraisal systems and  their application follows, and this includes  reference to recent appraisals at Passenger Focus. The above secondary data will then lead to the building of the conceptual model that will be developed through the research.

1.5.3 Chapter 3

This chapter describes the methodology that will be used to gather the primary data. It will outline the research paradigm selected, set out the research strategy, and also justify the selection of the methodology. Ethical issues will also be addressed in this chapter.

1.5.4 Chapter 4

This chapter will present the findings of the  research. Due to the different methods used to research the questions, some of the findings will be set out in text, and some will be presented in tables.        The data will be analysed        in preparation for the following chapter, which sets out the conclusions.

1.5.5. Chapter 5

Chapter 5 will set out conclusions about the research objectives through  linking the research findings, with the findings of chapter 2. The chapter will discuss limitations of the research and set out opportunities for additional research that will further enlighten the problem area.

1.5.6 Chapter 6

Based on the conclusions of chapter 5, this chapter includes recommendations for a new performance appraisal system.


1.6 Summary

This opening chapter has introduced the reader to the organisation Passenger Focus, and cited its recent transformation. The chapter has  revealed the need for Passenger Focus to develop a performance culture, and within that, a robust performance appraisal system. The research question and objectives have been set out, together with the methodology to be used to tackle the objectives.


2. Literature review

2.1 Introduction

This chapter reviews literature relevant to the research objectives. It builds a theoretical foundation upon which the research is based. It commences with an examination of what performance is, and why it is measured. The chapter then considers how performance appraisal fits into the parent discipline of performance management. A literature review   covering  appraisal systems and  their application follows, and this includes  reference to the system in place   at Passenger Focus. The above secondary data will then lead to the building of the conceptual model that will be tested through the research.

2.2 Performance defined

The Oxford English dictionary defines performance as the “accomplishment, execution, carrying out, and working out of anything ordered or undertaken”. Armstrong and Baron (2005) argue that performance is a matter not only of what people achieve, but how they achieve it. Bates and Holton (1995) suggest that performance is a multi- dimensional construct, the measurement of which depends on a variety of factors. Brumbach (1988) offers the most precise definition. “Performance means both behaviours and results. Behaviours are also outcomes in their own right and can be judged apart from results”.

From the definition, and interpretations above, it can be argued that performance is not just about outputs, it is also concerned with actions and behaviours demonstrated to achieve given targets. This issue will feature strongly through the research.

Much has been written on the need to manage performance. The Audit Commission acknowledged this,  suggesting in  1995  that  performance management  had  become something of an industry in its own right, dominated by “industry experts” and management consultancies (Audit Commission 1995). Performance management is now considered an essential part of normal management (Rose and Lawton 1999) and is increasingly accepted as an integral part of public sector management (Wisniewski and Olafson 2004). However, Hale and Whitman (2000) cite research by the Institute of Personnel Management (1992) that suggests no consistent definition emerged from over


1800 employers surveyed. Williams (2002) also indicates that performance management is difficult to define.   This suggests a lack of understanding of performance measure issues from those who are subject to the processes, and this will be explored later. During research for this project, over 30 definitions of performance management  were uncovered. Most adopted a common strand along the lines of the definition provided by Armstrong (2000) who writes “performance management is a strategic and integrated process that delivers sustained success to organisations by improving the performance of people who work in them, and by developing the capabilities of individuals and teams”.

The author, as a practitioner of Performance Management, offers the following, adapted from by Walters (1995)

Performance        Management        is        about        the        arrangements organisations make to get the right things done successfully. The essence of Performance Management is the organisation of work to achieve optimum results and this involves attention to both process

and people.

Further  research  by Armstrong (2000)  suggests  that  when  it  is  used  well,  it  will contribute to organisation success, and as such, is a vital management function. Radnor and McGuire (2004) also argued this point, but their research revealed, through a case study at  Bradford Health Authority, that effective performance management in the public sector could be considered to be closer to fiction than fact. Of all the literature reviewed  on  the  wider  subject  of  performance management,  Radnor  and  McGuire (2004) are amongst the minority in conducting in-depth attitudinal surveys that aid their findings.

2.3 Performance Management features

McMaster (1994) and Williams (2002) amongst others, suggest that the key sequences of performance management are as follows;

i.        Identification of strategic objectives ii.        Setting of departmental/team goals

iii.        Activities identified/performance plan developed iv.        Outputs agreed


v.        Monitor/review of performance through appraisal vi.        Determine development needs

vii.        Allocate reward

For individuals, this entails they should be able to answer the following questions – What is expected of me?

How am I doing? What shall I do next? What help will I need ?

(Macauley and Cook 1994)

Very little of the literature researched relates this to team performance. Notable exceptions are Armstrong and Baron (1998) who lament the lack of attention paid to team performance, and Brumbach (2003) who argues strongly for the importance of team management, and suggests the above four questions could be adapted to us/we.

2.4 Performance Management in the public sector

So when and why did Performance Management emerge into the public sector? Performance management is an increasingly common phenomenon in the public sector (Adcroft and Willis 2005). All public sector organisations will be required to scrutinise the performance of the organisation and its staff. Examination of the literature review traces back first steps into performance management by the public sector to the conservative government of the late 1980’s and early 1990’s. It was under those Governments that organisational  and managerial reforms were introduced, and public sector performance management became firmly established (Boland and Fowler 2000). The public sector was becoming much more market orientated, and successive conservative governments tried to improve accountability by developing standards and targets (Harrison and Goulding 1997). These increased standards led to the development of the Citizen’s Charter in 1991, and this was the trigger for the launch of many charters in the public sector. The Citizens Charter  (1991) developed the idea that there should be a link between an individual’s performance and their pay. It did not, however, examine whether money does motivate people.

In  1993,  the  Local  Government  Management  Board  (LGMB)  published  the  first guidance to performance management aimed specifically at the public sector (LGMB

1993). Its clear message was that performance management links the  strategy and service objectives of the organisation to jobs and people. It again linked the option of relating performance management  to  reward  strategies.  The  guidance  gave  a  clear


emphasis on the  fact  that  organisational performance is  a  product of  what  people achieve and do (Rogers 1999).  The Audit Commission published papers in the mid- nineties to strengthen the case for performance management in the public sector. Three key elements emerged relevant to the individual perspective of performance management;

i.        There should be qualitative and quantitative standards for judging individual and organisation performance

ii.        Organisation and individual feedback on performance should be provided

iii.        Training and development needs should be identified to improve individual performance.

(Audit Commission 1995)

This guidance indicated that performance appraisal was just as much about development

(forward looking) as review of performance ( backward looking).

Rose and Lawton (1999) noted how stressful it was at that time for managers to have to introduce new management practises, whilst continuing to deliver for customers, with little or no additional resources to facilitate implementation. They further argue that this was compounded by the fact that almost all systems were top down imposed, with little participation in design by participants. This key issue will be explored further.

There were further drives to improve the effectiveness of public services as New Labour came to power in 1997 (Radnor and Maguire 2004). A report by Gershon in 2004 provided  a  further  catalyst  for  the  not-for-profit sector  to  adopt  improved  service delivery (Manville 2007).  This report was the catalyst for the Rail Passengers Council (predecessor to Passenger Focus) to significantly improve its corporate and business planning and link to individual staff objectives. Subsequent literature, notably Wisniewski and Olafsson (2004) and Radnor and Macguire (2004) recognise the importance of performance measurement and management in the public sector. Most of those public sector employees are labour intensive, and so they need to capitalise on the abilities and performance of staff. Following this, the goal of performance management is to achieve human capital advantage, recognising that the individual staff member is the most important source of capital advantage (Armstrong & Baron 2005).

2.5 The Passenger Focus Performance Management Cycle

The current Passenger Focus model of performance management is set out below. It is very much individual based and allows for no measurement of team performance.


Armstrong and Baron (1998) and Brumback (203) lament the lack of attention paid to the management of team performance and this will be explored further in this research. The sequence is as follows and is similar to the normal model as outlined above;

i.        Identify strategic objectives ii.        Develop team plans

iii.        Develop individual targets and outputs iv.        Performance appraisal

v.        Personal Development Plans/Rewards

The theory appears reasonable, but application will be tested in detail throughout this research.

The Passenger Focus model is generally “owned” by its HR Department and no formal training is given, apart from a briefing note circulated to managers. Williams (2002) recommends training being incorporated into the cycle to ensure consistency of application.

Join now!

2.6 Performance appraisal

Performance Appraisal is increasingly considered one of the most important human resource practices (Boswell and Boudreau 2002). The following section will show how appraisal, although only one part of the wider system described above, is central to the effectiveness of Performance Management ( Piggot-Irvine 2003). The Oxford English Dictionary defines appraise as “estimate the value or quality of”. Linking this to performance, Bird (2003) suggest performance appraisal is the assessment of what we produce and how. A workshop facilitated by the author prior to the commencement of this research, defined performance appraisal as measurement ...

This is a preview of the whole essay