Normalization and Valuation of Research Evaluation Indicators in Different Scientific Fields

Abdolreza Noroozi Chakoli | Roghayeh Ghazavi

---

URL :   http://research.shahed.ac.ir/WSR/WebPages/Report/PaperView.aspx?PaperID=31906
Date :  2016/05/10
Publish in :    Journal of Information Science Theory and Practice
DOI :  https://doi.org/10.1633/JISTAP.2016.4.1.2
Link :  http://www.kpubs.org/article/articleMain.kpubs?articleANo=E1JSCH_2016_v4n1_21
Keywords :Valuation, Research, Evaluation, Indicators, Scientific

Abstract :

---

Abstract Given the difference in research performance in various scientific fields, this study aims to weight and valuate current indicators used for evaluation of scientific productions (publications), in order to adjust these indicators in comparison to each other and make possible a more precise evaluation of scientific productions. This is a scientometrics study using documentary, evaluative, and survey techniques. The statistical population consisted of 106 top Iranian researchers, scientists, and scientific and research managers. Then their research résumé information was gathered and analyzed based on research questions. In order to compare values, the data gathered from research production performance of the population was weighted using Shannon entropy method. Also, the weights of each scientific production importance according to expert opinions (extracted from other works) was analyzed and after adjustment the final weight of each scientific production was determined. A pairwise matrix was used in order to determine the ratios. According to the results, in the area of engineering sciences, patents (0.142) in the area of science, international articles (0.074) in the area of humanities and social sciences, books (0.174), and in the area of medical sciences, international articles (0.111) had the highest weight compared to other information formats. By dividing the weights for each type of publication, the value of each scientific production compared to other scientific productions in the same field and productions of other fields was calculated. Validation of the results in the studied population resulted in very high credibility for all investigated indicators in all four fields. By using these values and normalized ratios of publication indicators it is possible to achieve precise and adjusted results, making it possible to feasibly use these results in realistic policy making. Keywords Valuation ; Normalization ; Research Evaluation Indicators ; Scientific Fields ; Scientific Areas ; Scientific Production