Development of scale and model for evaluating the individual performance appraisals—Process in public management
Abstract
The need for strategic alignment within HR management increased managers’ concern about individual behavior and how this behavior was related to the achievement of goals. In public management, effectively managing employees’ performance has been necessary since Weber’s bureaucratic administration. The individual performance appraisal is the right tool to assess employees’ competencies. Thus, we proposed the following research question: Which factors, as pointed out by theory, have the most significant influence on the individual performance appraisal process? The quantitative method was applied to answer this question, developing and testing a scale via EFA and a hypothetical model via SEM-CB. The results indicated a scale with 25 items able to access the main points of the IPA process and a hypothetical model with 7 constructs that indicate the influence on employee engagement. The main finding is the significant influence of feedback on the whole process. The main theoretical contribution was the construction of the MIPAS scale, and the practical contribution was to identify the points where managers should focus on improving the IPA process with their subordinates.
References
Ahenkan, A., Tenakwah, E. S., & Bawole, J. N. (2018). Performance management implementation challenges in Ghana’s local government system. International Journal of Productivity and Performance Management, 67(3), 519–535. https://doi.org/10.1108/ijppm-06-2016-0124
Allen, M. R., & Wright, P. (2007). Strategic management and HRM. In: Boxall, P., Purcell, J., & Wright, P. (editors). The Oxford Handbook of Human Resource Management. Oxford University Press.
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Alves, M. V. B., Kubo, E. K. de M., Marques, G. C., Capellari, M. R. dos S., & Oliva, E. de C. (2017). 360-degree feedback in federal regulatory agencies (Portuguese). Cadernos Gestão Pública e Cidadania, 22(72). https://doi.org/10.12660/cgpc.v22n72.65656
Ammons, D. N., & Roenigk, D. J. (2015). Performance Management in Local Government: Is Practice Influenced by Doctrine? Public Performance & Management Review, 38(3), 514–541. https://doi.org/10.1080/15309576.2015.1006461
Bakker, A., & Leiter, M. P. (2010). Where to go from here: integration and future research on work engagement. In: Bakker, A. B., & Leiter, M. P. (editors). Work Engagement: A Handbook of Essential Theory and Research. Psychology Press. pp. 181–196.
Barney, J. (1991). Firm Resources and Sustained Competitive Advantage. Journal of Management, 17(1), 99–120. https://doi.org/10.1177/014920639101700108
Bergamini, C. W., & Beraldo, D. G. R. (2008). Human Performance Evaluation in the Company (Portuguese), 4th ed. Atlas.
Bergue, S. T. (2010). People Management in Public Organizations (Portuguese). 3th ed. EDUCS.
Beuren, I. M., von Eggert, N. S., & Santos, E. A. dos. (2020). Influence of formal performance evaluation and its mechanisms on interpersonal trust between managers: perceived procedural fairness and quality of feedback (Portuguese). Organizações & Sociedade, 27(92), 113–131. https://doi.org/10.1590/1984-9270926
Bezerra, L. F., Filho, O. O., Gomes, M. B., & Zouain, D. M. (2019). Individual performance appraisal of the national nuclear energy commission: A meta-evaluative study (Portuguese). Revista Meta Avaliação, 11(32), 495. https://doi.org/10.22347/2175-2753v11i32.1774
Bido, D. S., Mantovani, D. M. N., & Cohen, E. D. (2018). Destruction of measurement scale through exploratory factor analysis in production and operations research. Gestão e Produção, 25(2), 384–397. https://doi.org/10.1590/0104-530x3391-16
Bohlander, G., & Snell, S. (2011). Administração de Recursos Humanos, 14th ed. Cengage Learning.
Brown, T. A. (2006). Confirmatory Factor Analysis for Applied Research. The Guilford Press.
Charmaz, K. (2006). Constructing Grounded Theory: A Practical guide through Quantitative Analysis. Sage Publication.
Chiang, F. F. T., & Birtch, T. A. (2010). Pay for performance and work attitudes: The mediating role of employee–organization service value congruence. International Journal of Hospitality Management, 29(4), 632–640. https://doi.org/10.1016/j.ijhm.2009.11.005
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003) Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 3th ed. Lawrence Erlbaum Associates.
Conway, J. M., & Huffcutt, A. I. (2003). A Review and Evaluation of Exploratory Factor Analysis Practices in Organizational Research. Organizational Research Methods, 6(2), 147–168. https://doi.org/10.1177/1094428103251541
Côrtes, F. G., & Meneses, P. P. M. (2019). Strategic people management in the Brazilian federal legislature: conditions for implementation (Portuguese). Revista de Administração Pública, 53(4), 657–686. https://doi.org/10.1590/0034-761220180061
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1–9.
Cropanzano, R., Bowen, D. E., & Gilliland, S. W. (2007). The Management of Organizational Justice. Academy of Management Perspectives, 21(4), 34–48. https://doi.org/10.5465/amp.2007.27895338
Cunha, M. P. e., Vieira, D. V., Rego, A., & Clegg, S. (2018). Why does performance management not perform? International Journal of Productivity and Performance Management, 67(4), 673–692. https://doi.org/10.1108/ijppm-11-2016-0243
Cunliffe, A. L. (2010). Crafting Qualitative Research: Morgan and Smircich 30 Years On. Organization Research Methods. 14(4), 1–27. https://doi.org/10.1177/1094428110373658
da Silva Monteiro, R., Brauer, M., de Queirós Mattoso, C. L., Albertin, A. L., & de Carvalho Oriol, E. (2021). Motivation and engagement in corporate education mediated by information technology (Portuguese). Revista Ibérica de Sistemas e Tecnologias de Informação, (E41), 178–192.
da Silveira, F. C. G., da Silva Monteiro, R., de Carvalho Oriol, E., Brauer, M., & Albertin, A. L. (2021). Comparison Between Traditional Learning and Learning Mediated by Information Technology in the Corporate Environment. Information Technology and Systems, 146–156. https://doi.org/10.1007/978-3-030-68418-1_16
Dalmoro, M., & Vieira, K. M. (2014) Dilemmas in the construction of Likert-type scales: the number of items and the layout influence the results (Portuguese). Revista Gestão Organizacional, 6(3). https://doi.org/10.22277/rgo.v6i3.1386
DeNisi, A., & Smith, C. E. (2014). Performance Appraisal, Performance Management, and Firm-Level Performance: A Review, a Proposed Model, and New Directions for Future Research. Academy of Management Annals, 8(1), 127–179. https://doi.org/10.5465/19416520.2014.873178
Dixon-Woods, M. (2010). Systematic Reviews and Qualitative Methods. Qualitative Research: Theory, Method and Practice, 3rd ed. Sage. pp. 331-334.
Draganidis, F., & Mentzas, G. (2006). Competency based management: a review of systems and approaches. Information Management & Computer Security, 14(1), 51–64. https://doi.org/10.1108/09685220610648373
Fávero, L. P., Belfiore, P., Silva, F. L., & Chan, B. L. (2009). Data Analysis: Multivariate Modeling for Decision Making (Portuguese). 1st ed. Elsevier.
Feitosa, C. D. M. C., & Lima, A. V. D. Q. (2014). Performance evaluation in the public sector: critical factors and opportunities for improvement (Portuguese). Available online: https://www.gov.br/servidor/pt-br/acesso-a-informacao/gestao-de-pessoas/gestao-de-desempenho-de-pessoas/AvaliaodeDesempenhonoSetorPblicofatorescrticos.pdf (accessed on 23 February 2024).
Fernandez, S., & Moldogaziev, T. (2012). Using Employee Empowerment to Encourage Innovative Behavior in the Public Sector. Journal of Public Administration Research and Theory, 23(1), 155–187. https://doi.org/10.1093/jopart/mus008
Fisher, A. L. (2002). A conceptual and historical overview of people management models (Portuguese). In: Fleury, M. T. L. (editor). People in the Organization (Portuguese), 4th ed. Gente.
Fonseca, D. R., & Menezes, P. P. M. (2016). Factors for implementing and developing competency-based management in federal regulatory agencies (Portuguese). Revista Eletrônica Científica da UERGS, 2(2), 117–133.
Fornell, C., & Larcker, D. F. (1981). Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104
Gomes, R. C., & Lisboa, E. de F. (2020). Public management reform in Brazil (2002-2019). Public Management Review, 23(2), 159–167. https://doi.org/10.1080/14719037.2020.1752037
Granovetter, M. (1992). Economic Institutions as Social Constructions: A Framework for Analysis. Acta Sociologica, 35(1), 3–11. https://doi.org/10.1177/000169939203500101
Guimarães, T. A., Nader, R. M., & Ramagem, S. P. (1998). Personnel performance evaluation: a methodology integrated with organizational planning and evaluation (Portuguese). Revista de Administração Pública, 32(6), 43–61.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate Data Analysis, 7th ed. Prentice Hall.
Hartmann, F., & Slapničar, S. (2012). The perceived fairness of performance evaluation: The role of uncertainty. Management Accounting Research, 23(1), 17–33. https://doi.org/10.1016/j.mar.2011.10.004
Hinkin, T. R. (1995). A Review of Scale Development Practices in the Study of Organizations. Journal of Management, 21(5), 967–988. https://doi.org/10.1177/014920639502100509
Hofstede, G., Hofstede G. J., & Minkov, M. (2010). Cultures and organizations: Software of the mind, Intercultural cooperation and its importance for survival. McGraw Hill.
Huselid, M. A. (1995). The Impact of Human Resource Management Practices on Turnover, Productivity, And Corporate Financial Performance. Academy of Management Journal, 38(3), 635–672. https://doi.org/10.2307/256741
IBGE. (2014). Synthesis of social indicators: An analysis of the living conditions of the Brazilian population 2014 (Portuguese); Available online: https://biblioteca.ibge.gov.br/index.php/biblioteca-catalogo?view=detalhes&id=291983 (accessed on 23 February 2024).
Ikramullah, M., Van Prooijen, J.-W., Iqbal, M. Z., & Ul-Hassan, F. S. (2016). Effectiveness of performance appraisal. Personnel Review, 45(2), 334–352. https://doi.org/10.1108/pr-07-2014-0164
Iqbal, M. Z., Akbar, S., & Budhwar, P. (2014). Effectiveness of Performance Appraisal: An Integrated Framework. International Journal of Management Reviews, 17(4), 510–533. https://doi.org/10.1111/ijmr.12050
Jackson, B. (2019). The power of place in public leadership research and development. International Journal of Public Leadership, 15(4), 209–223. https://doi.org/10.1108/ijpl-09-2019-0059
Judge, T. A., Thoresen, C. J., Bono, J. E., & Patton, G. K. (2001). The job satisfaction–job performance relationship: A qualitative and quantitative review. Psychological Bulletin, 127(3), 376–407. https://doi.org/10.1037/0033-2909.127.3.376
Kim, T., & Holzer, M. (2014). Public Employees and Performance Appraisal. Review of Public Personnel Administration, 36(1), 31–56. https://doi.org/10.1177/0734371x14549673
Lacombe, B. M. B., & Albuquerque, L. G. de. (2008). Evaluating and measuring results in people management: A study of the largest companies in Brazil (Portuguese). Revista de Administração—RAUSP, 43(1), 5–16.
Lee, H.-W. (2017). Performance-Based Human Resource Management and Federal Employee’s Motivation: Moderating Roles of Goal-Clarifying Intervention, Appraisal Fairness, and Feedback Satisfaction. Review of Public Personnel Administration, 39(3), 323–348. https://doi.org/10.1177/0734371x17721300
Lengnick-Hall, M. L., Lengnick-Hall, C. A., Andrade, L. S., & Drake, B. (2009). Strategic human resource management: The evolution of the field. Human Resource Management Review, 19(2), 64–85. https://doi.org/10.1016/j.hrmr.2009.01.002
Levy, P. E., & Williams, J. R. (2004). The Social Context of Performance Appraisal: A Review and Framework for the Future. Journal of Management, 30(6), 881–905. https://doi.org/10.1016/j.jm.2004.06.005
Malhotra, N. K., Nunan, D., & Birks, D. F. (2017). Marketing Research: An Applied Approach. Person.
Marras, J. P. (2012). Human Performance Evaluation (Portuguese). Elsevier.
Murphy, K. R., & DeNisi, A. (2008). A model of the appraisal process. In: Varma, A., Budhwar, P. S., & DeNisi, A. (editors). Performance Management Systems, 1st ed. Routledge. pp. 81–94.
Odelius, C. (2000). Performance evaluation experiences in the Federal Public Administration (Portuguese). Available online: https://repositorio.enap.gov.br/handle/1/617 (accessed on 23 February 2024).
Odelius, C. C. & Santos, P. R. G. dos. (2007). Individual performance evaluation in the federal public administration: aspects involved in the process and results (Portuguese). Revista Economia e Gestão, 7(15), 10-30.
Onça, S. da S., Bido, D. de S., & Carvalho, A. dos S. C. (2018). Group learning climate and behaviors (Portuguese). Organizações & Sociedade, 25(86), 392–412. https://doi.org/10.1590/1984-9250863
Peiperl, M. (2001). Getting 360-degree feedback right. Harvard Business Review, 79(1), 142–177.
Pichler, S. M., Varma, A., & Petty, R. (2008). Rater-ratee relationships and performance management. In: Varma, A., Budhwar, P. S., & DeNisi, A. (editors). Performance Management Systems, 1st ed. Routledge. pp. 55–66.
Pires, J. C. de S., & Macêdo, K. B. (2006). Cultura organizacional em organizações públicas no Brasil. Revista de Administração Pública, 40(1), 81–104. https://doi.org/10.1590/s0034-76122006000100005
Pontes, B. R. (2010). Performance Evaluation: Classic and Contemporary Methods, Evaluation by Objectives, Competencies and Teams (Portuguese), 11th ed. LTR.
Roberts, G. E. (2003). Employee Performance Appraisal System Participation: A Technique That Works. Public Personnel Management, 32(1), 89–98. https://doi.org/10.1177/009102600303200105
Sameera-Begum, G., & Sumalatha, A. P. (2015). A Study on performance appraisal private sector vs. public sector. IOSR Journal of Business and Management, 17(2), 75–80.
Sánchez-Elvira, E. J. (2018). Analysis of the effectiveness of the individual performance evaluation policy in the Brazilian federal administration 2018 (Portuguese). Available online: https://buscaintegrada.ufrj.br/Record/aleph-UFR01-000867214/Details (accessed on 23 February 2024).
Siddaway, A. P., Wood, A. M., & Hedges, L. V. (2019). How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-Syntheses. Annual Review of Psychology, 70(1), 747–770. https://doi.org/10.1146/annurev-psych-010418-102803
Špalková, D., Špaček, D., & Nemec, J. (2015). Performance Management and Performance Appraisal: Czech Self-Governments. NISPAcee Journal of Public Administration and Policy, 8(2), 69–88. https://doi.org/10.1515/nispa-2015-0009
Tate, K. A., Bloom, M. L., Tassara, M. H., & Caperton, W. (2014). Counselor Competence, Performance Assessment, and Program Evaluation. Measurement and Evaluation in Counseling and Development, 47(4), 291–306. https://doi.org/10.1177/0748175614538063
TTrevor, C. O., Reilly, G., & Gerhart, B. (2012). Reconsidering Pay Dispersion’s Effect on the Performance of Interdependent Work: Reconciling Sorting and Pay Inequality. Academy of Management Journal, 55(3), 585–610. https://doi.org/10.5465/amj.2006.0127
Ulrich, D., Allen, J., Brockbank, W., Youger, J., & Nyman, M. (2011). HR Transformation: Building Human Resources from the Outside in. RBL Intitute.
Van Dijk, D., & Schodl, M. M. (2015). Performance Appraisal and Evaluation. In: Wright, J. D. (editor). International Encyclopedia of the Social & Behavioral Sciences, 2nd ed. pp. 716–721. https://doi.org/10.1016/b978-0-08-097086-8.22034-5
Vandenabeele, W., Ritz, A., & Neumann, O. (2017). Public Service Motivation: State of the Art and Conceptual Cleanup. The Palgrave Handbook of Public Administration and Management in Europe, 261–278. https://doi.org/10.1057/978-1-137-55269-3_13
Weiss, H. M., & Cropanzano, R. (1996). Affective events theory. Research in Organizational Behavior, 18(1), 1–74.
Copyright (c) 2024 Leonardo Ferreira Bezerra, Ettore de Carvalho Oriol, Marcus Brauer
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors contributing to this journal agree to publish their articles under the Creative Commons Attribution 4.0 International License, allowing third parties to share their work (copy, distribute, transmit) and to adapt it, under the condition that the authors are given credit, and that in the event of reuse or distribution, the terms of this license are made clear. With this license, the authors hold the copyright without restrictions and are allowed to retain publishing rights without restrictions as long as this journal is the original publisher of the articles.
