“How ‘good’ is good enough?” Defining evaluative worth and merit criteria
DOI:
https://doi.org/10.18222/eae.v30i73.5879Keywords:
Program Evaluation, Evaluation Criteria, Merit, Worth.Abstract
This text discusses concepts associated with the notion of value and the action of valuing in program evaluation, considering the need to make judgments about the quality of a policy, program, project or social action that is inherent to it. It seeks to contribute to foment the discussion about valuation in the evaluation of social programs. To that end, it reviews the US and Brazilian literature in order to identify how valuation questions have been theoretically proposed and made explicit in evaluative research. Reports and articles on program evaluation with a focus on education are examined. It concludes, based on this bibliographical analysis, that the discussion about the attribution of value has seldom been conducted in the national literature in an explicit way, which reinforces the need for improving it.
Downloads
References
ALKIN, Marvin; CHRISTIE, Cristina A. An evaluation theory tree. In: ALKIN, Marvin C. (ed.). Evaluation roots: tracing theorists’ views and influences. Thousand Oaks: Sage Publications, 2004. p. 12-65.
ARRETCHE, Marta. Tendências no estudo sobre avaliação. In: RICO, E. M. (org.). Avaliação de políticas sociais: uma questão em debate. São Paulo: Cortez/IEE, 2009. p. 29-40.
BAUER, Adriana. Avaliação de impacto no Brasil: é possível mensurar impactos de programas de formação docente? Estudos em Avaliação Educacional, São Paulo, v. 21, n. 46, p. 229-252, maio/ago. 2010.
BAUER, Adriana. Avaliação de impacto de formação docente e serviço: o programa Letra e Vida. 2011. 232 f. Tese (Doutorado em Educação) – Faculdade de Educação, Universidade de São Paulo, São Paulo, 2011. doi:10.11606/T.48.2011.tde-15072011-105940. Acesso em: 12 out. 2018.
CONTANDRIOPOULOS, André-Pierre; CHAMPAGNE, François; DENIS, Jean-Louis; PINEAULT, Raynald. A avaliação na área da saúde: conceitos e métodos. In: HARTZ, Zulmira M. de Araújo (org.). Avaliação em saúde: dos modelos conceituais à prática na análise da implantação de programas. Rio de Janeiro: Fiocruz, 1997. p. 29-47.
COUSINS, Bradley; SHULHA, Lyn M. Complexities in setting program standards in collaborative evaluation. In: SMITH, Nick L.; BRANDON, Paulo R. Fundamental issues in evaluation. New York: The Guilford Press, 2008. p. 139-158.
DAVIDSON, Jane. Merit. In: MATHISON, Sandra. Encyclopedia of evaluation. Thousand Oaks, CA: Sage Publications, 2005. p. 245.
DRAIBE, Sônia M. Avaliação de implementação: esboço de uma metodologia de trabalho em políticas públicas. In: BARREIRA, Maria Cecília R. Nobre; CARVALHO, Maria do Carmo B. (org.). Tendências e perspectivas na avaliação de políticas e programas sociais. São Paulo: IEE/PUC-SP, 2001. p. 13-42.
FIGUEIREDO, Marcus; FIGUEIREDO, Argelina. Avaliação política e avaliação de políticas: um quadro de referência teórica. Aná1ise e Conjunturas, Belo Horizonte, v. 1, n. 3, p. 107-127, set./dez. 1986.
GUBA, Egon G.; LINCOLN, Yvonna S. The distinction between merit and worth in evaluation. Educational Evaluation and Policy Analysis, v. 2, n. 4, p. 61-71, 1980.
HOUSE, Ernest R.; HOWE, Kenneth R. Deliberative democratic evaluation. In: KELLAGHAN, T.; STUFFLEBEAM, D. L. (ed.). International handbook of educational evaluation. Boston: Kluwer Academic, 2003. v. 2, p. 79.
HOUSE, Ernest R. Intellectual history in evaluation. In: ALKIN, Marvin C. (ed.). Evaluation roots: tracing theorists’ views and influences. Thousand Oaks: Sage Publications, 2004. p. 218-224.
JANNUZZI, Paulo M. Eficiência econômica, eficácia procedural ou efetividade social: três valores em disputa na avaliação de políticas e programas sociais. Desenvolvimento em Debate, Rio de Janeiro, v. 4, n. 1, p. 117-142, 2016.
JANNUZZI, Paulo M. A implementação como centro da avaliação de políticas públicas: reflexões à luz da experiência da SAGI/MDS 2004-maio 2016. In: SEMINÁRIO BRASILEIRO SOBRE IMPLEMENTAÇÃO DE POLÍTICAS PÚBLICAS, 1., Brasília, 20-21 de março de 2018. Anais [...]. Brasília: Enap, 2018.
MACDONALD, Barry. La evaluación como servicio público: perspectivas de futuro. In: SÁEZ BREZMES, María José (ed.). Conceptualizando la evaluación en España. Madrid: Universidad de Alcalá de Henares, 1995. (Collección Pautas, 3). Disponível em: https://ueaeprints.uea.ac.uk/31854/. Acesso em: 10 jul. 2018.
MACDONALD, Barry; JENKINS, David; KEMMIS, Stephen; VERMA, Gajendra. Racism and education evaluation. In: VERMA, Gajendra; BUGLEY, Christopher (ed.). Racism and educational evaluation education and identity. London: Macmilliam, 1979.
MADAUS, George; SCRIVEN, Michael; STUFFLEBEAM, Daniel L. Program evaluation: an historical overview. In: MADAUS, George; SCRIVEN, Michael; STUFFLEBEAM, Daniel L. (ed.). Evaluation models: viewpoints on Educational and Human Services Evaluation. Boston: Kluwer-Nijhoff, 1983. p. 3-22.
MATHISON, Sandra. Encyclopedia of evaluation. Thousand Oaks, CA: Sage Publications, 2005.
MULLER, Pierre; SUREL, Yves. A análise das políticas públicas. Tradução: Agemir Bavaresco, Alceu R. Ferraro. Pelotas: Educat, 2002.
PROGRAMA DAS NAÇÕES UNIDAS PARA O DESENVOLVIMENTO. Garantía de calidad del diseño y la metodología de la evaluación. Manual de planificación, seguimiento y evaluación de los resultados de desarrollo. New York: PNUD, 2009. p. 161-178.
RAWLS, John. Uma teoria da justiça. São Paulo: Martins Fontes, 1997.
SCHWANDT, Thomas. Values. In: MATHISON, Sandra. Encyclopedia of evaluation. Thousand Oaks, CA: Sage Publications, 2005. p. 443-444.
SCRIVEN, Michael. Evaluating educational programs. In: CARO, Francis G. (ed.). Readings in evaluation research. New York: Russell Sage Foundation, 1971. p. 49-53.
SCRIVEN, Michael. Payoffs from evaluation, In: ABT, Clark C. The evaluation of social programs. Beverly Hill: Sage Publications, 1976. p. 217-224.
SCRIVEN, Michael. New frontiers of evaluation. Evaluation Practice. Science Direct, v. 7, n. 1, p. 7-44, Feb. 1986.
SCRIVEN, Michael. Evaluation thesaurus. Newbury Park, CA: Sage Publications, 1991.
SCRIVEN, Michael. Hard-won lessons in program evaluation. New directions for program evaluation. San Franciso, CA: AEA/Sage Publications, 1993.
SCRIVEN, Michael. Evaluation in the new millennium: the transdisciplinary vision. In: DONALDSON, Stewart I.; SCRIVEN, Michael (ed.). Evaluating social programs and problems. Mahwah NY: Erlbaum, 2003. p. 19-41.
SHADISH, Willian; COOK, Thomas; LEVITON, Laura. Foundations of program evaluation: theories of practice. Newbury Park, CA: Sage Publications, 1991.
STAKE, Robert. Stake and responsive evaluation. In: ALKIN, Marvin C. (ed.). Evaluation roots: tracing theorists’ views and influences. Thousand Oaks: Sage Publications, 2004. p. 203-217.
STUFFLEBEAM, Daniel L. Evaluation values and criteria checklist. Evaluation Checklists Project. Kalamazoo, MI: The Evaluation Center, March 2001.
STUFFLEBEAM, Daniel L. Institutionalizing evaluation checklist. Evaluation Checklists Project. Kalamazoo, MI: The Evaluation Center, 2002. Disponível em: http://www.wmich.edu/evalctr/ archive_checklists/institutionalizingeval.pdf. Acesso em: 23 fev. 2011.
STUFFLEBEAM, Daniel L.; SHINKFIELD, Antony J. Evaluation theory, models, and applications. San Francisco, CA: Jossey-Bass, 2007.
SUCHMAN, Edward A. Evaluating educational programs. In: CARO, Francis (ed.). Readings in evaluation research. New York: Russell Sage Foundation, 1971. p. 43-48.
VIANNA, Heraldo M. Avaliação de programas educacionais: duas questões. Estudos em Avaliação Educacional, São Paulo, v. 16, n. 32, p. 43-56, jul./dez. 2005.
WORTHEN, Blane; SANDERS, James; FITZPATRICK, Jody. Avaliação de programas: concepções e práticas. São Paulo: Edusp/Gente, 2004.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2019 Estudos em Avaliação Educacional
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who publish in this journal agree to the following terms:
a. Authors retain the copyright and grant the journal the right to first publication, with the paper simultaneously licensed under the Creative Commons Attribution license that allows the sharing of the paper with acknowledgment of authorship and initial publication in this journal.
b. Authors are authorized to assume additional contracts separately, for non-exclusive distribution of the version of the paper published in this journal (for example publishing in institutional repository or as a book chapter), with acknowledgment of authorship and initial publication in this journal.
c. Authors are allowed and encouraged to publish and distribute their paper on-line (for example in institutional repositories or on their personal page) at any moment before or during the editorial process, as this can generate productive changes, as well as increase the impact and citation of the published paper (See The Effect of Open Access).
