During last years a large debate was developed among academics about research evaluation procedure. Approaches proposed in literature considers quantitative and/or qualitative aspects of each journal but each methodology has limits and characteristics high heterogeneous. The meaning and implication of results achieved with a ranking procedure is strictly influenced by the approach selected for the journal evaluation. The paper presents a literature review of the main qualitative and quantitative approaches proposed for journal ranking focusing the attention on the main differences of approaches. The study is completed with an empirical analysis on the database Thompson Scientific, one of the main provider of quantitative rankings. The analysis considers the characteristics of quantitative rankings proposed, look at the qualitative characteristics of best and worst ranked journals and compares results obtained with those achieved by an international qualitative survey (Harzing database). Results obtained demonstrate the low degree of coherence of ranking based on different approaches and point out some risks related to the use of these approaches to evaluate research.

Carretta, A., & Mattarocci, G. (2009). Evaluating scientific journals: properties, limits and conditions of effectiveness of classification methodologies. JOURNAL OF ECONOMICS AND ECONOMIC EDUCATION RESEARCH, 10(2), 95-122.

Evaluating scientific journals: properties, limits and conditions of effectiveness of classification methodologies

CARRETTA, ALESSANDRO;MATTAROCCI, GIANLUCA
2009

Abstract

During last years a large debate was developed among academics about research evaluation procedure. Approaches proposed in literature considers quantitative and/or qualitative aspects of each journal but each methodology has limits and characteristics high heterogeneous. The meaning and implication of results achieved with a ranking procedure is strictly influenced by the approach selected for the journal evaluation. The paper presents a literature review of the main qualitative and quantitative approaches proposed for journal ranking focusing the attention on the main differences of approaches. The study is completed with an empirical analysis on the database Thompson Scientific, one of the main provider of quantitative rankings. The analysis considers the characteristics of quantitative rankings proposed, look at the qualitative characteristics of best and worst ranked journals and compares results obtained with those achieved by an international qualitative survey (Harzing database). Results obtained demonstrate the low degree of coherence of ranking based on different approaches and point out some risks related to the use of these approaches to evaluate research.
Pubblicato
Rilevanza internazionale
Articolo
Esperti anonimi
Settore SECS-P/11 - Economia degli Intermediari Finanziari
English
Senza Impact Factor ISI
Carretta, A., & Mattarocci, G. (2009). Evaluating scientific journals: properties, limits and conditions of effectiveness of classification methodologies. JOURNAL OF ECONOMICS AND ECONOMIC EDUCATION RESEARCH, 10(2), 95-122.
Carretta, A; Mattarocci, G
Articolo su rivista
File in questo prodotto:
File Dimensione Formato  
Carretta-Mattarocci.pdf

non disponibili

Licenza: Copyright dell'editore
Dimensione 308.39 kB
Formato Adobe PDF
308.39 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/2108/18753
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact