APPLICATION OF RASCH MODEL FOR ANALYSIS OF THE SCALE OF COMPETENCE ASSESSMENT OF EXPERTS IN THE FIELD OF HIGHER EDUCATION
Abstract
The results of the study of the scale for assessing the competence of experts in higher education using the Rusсh model are presented in the article. Initial expert data was processed with using special software. This model uses special diagnostic features and special graphical features. One statistic focuses on the overall performance of the item or person, and the other covers rare events and unexpected events. The scale of the consistent response of each person to each element (Rusch scale) has the properties of interval scale.
The results of the transformation of input raw data by criteria and experts into Rusch measurements are presented. The analysis of the evaluation results showed that the selected scale of criteria for the evaluation of experts meets the established requirements for the Rusch model. Analyzing the input data for this model allows you to verify that the added results in the data are justified by what is called a data-matching test. The values obtained for the criteria used and the evaluated experts are within the established limits.
The results of the assessment of the competence of education experts using the Rusch model are analyzed. Comparison of the results of the experts’ evaluation with the results of their evaluation by other methods showed their high correlation. The application of the evaluation method considered and other known method sources has yielded almost the same results. Most experts were ranked almost equally. All the least competent experts are also identified when using the Rush model.
The results showed that the Rush model could be used to analyze the scale of competence assessment of experts in higher education.The analysis of the results showed that the selected scale of criteria for the evaluation of experts meets the established requirements for the Rush model.
The measurement data obtained by the Rush model allowed us to calculate the established statistics for both the criteria and the experts evaluated.
Downloads
| Abstract views: 376 | PDF Downloads: 149 |
References
Rasch G. Probabilistic models for some intelligence and attainment tests. Copenhagen: Danish Institution for Educational Research, 1960.
Andrich D. Rasch models for measurement. Beverly Hills: Sage Publications, 1988.
Andrich D. Sufficiency and conditional estimation of person parameters in the polytomous Rasch model. Psychometrika. – 2010. – 75(2). – Р. 292–308.
Linacre J. M. Rasch dichotomous model vs. One-parameter Logistic Model. Rasch Measurement Transactions. – 2005, 19:3, 1032.
Masters G. N., Keeves J. P. (Eds.). Advances in measurement in educational research and assessment. – New York: Pergamon, 1999.
Bond T. G., Fox C. M. Applying the Rasch model: fundamental measurement in the human sciences, 2nd edn. Mahwah: Lawrence Erlbaum Associates, 2007.
Hagquist C., Bruce M., Gustavsson J. P. Using the Rasch model in nursing research: an introduction and illustrative example. Int. J. Nurs. Stud. – 2009, 3. – Р. 380–393.
Ehlan A. H., Kucukdeveci A. A., Tennant A. The Rasch Measurement Model. In: Franco Franchignoni (Ed). Research Issues in Physical & Rehabilitation Medicine. Pavia: Maugeri Foundation. – 2010. – Р. 89–102.
Wright B. D., Linacre J. M. A measurement is the quantification of a specifically defined comparison. Rasch model derived from objectivity. Rasch Measurement Transactions. – 1987, 1:1. – Р. 4–5.
Demenchyonok O. G. Matematicheskie osnovy Rasch Measurement // Pedagogicheskie izmereniyayu – 2010. – № 1. – S. 3–21.
Velychko O., Gordiyenko T. A comparative analysis of the assessment results of the competence of technical experts by methods of analytic hierarchy process and with using the Rasch model // Eastern-European Journal of Enterprise Technologies. Control processes. – 2018. – № 3/3(93). – P. 14–21.
Velychko O. M., Hordiienko T. B. Analiz shkaly dlia otsiniuvannia kompetentnosti ekspertiv z metrolohii iz zastosuvanniam modeli Rasha. Metrolohiia i prylady. – 2018. – # 1. – S. 63–68.
A User’s Guide to WINSTEPS®MINISTEP Rasch-Model Computer Programs. Program Manual 4.0.0 by John M. Linacre, 2017.
Evaluation scales in rehabilitation – http://www.rehab-scales.org.
Rasch Model / Rasch Analysis: Definition, Examples. Statistics How To – http://www.statisticshowto.com/rasch-model.
Institute for Objective Measurement, Inc. – http://www.rasch.org/rmt/rmt101k.htm.
Institute for Objective Measurement, Inc. – http://www.rasch.org/rmt/rmt101k.htm.
Velychko O. M., Hordiienko T. B., Kolomiiets L. V. Osnovy teorii testovykh zavdan IRT. Pidruchnyk. – Odesa: Bondarenko M. O., 2019. – 120 s.
Cramer, J. S. Logit Models from Economics and Other Fields, Cambridge University Press. – 2003. – Р. 13.
Velychko O., Gordiyenko T., Gaber A. Comparative assessment of the competence of experts by different methods // Eastern-European Journal of Enterprise Technologies. Control processes. – 2018. – № 5/3 (95). – P. 25–32.
Velychko O. M., Hordiienko T. B., Kolomiiets L. V., Shevtsov A. H., Haber A. A. Zastosuvannia prohramnykh zasobiv dlia otsinky kompetentnosti ekspertiv u sferi vyshchoi osvity. Visnyk Inzhenernoi akademii Ukrainy, Vypusk 1, Kyiv 2015. – S. 275–280.
Velychko O. M., Kolomiiets L. V., Hordiienko T. B., Shevtsov A. H., Karpenko S. R., Haber A. A. Hrupove ekspertne otsiniuvannia ta kompetentnist ekspertiv / Za zahal. red. d-ra tekhn. nauk O. M. Velychka. – Odesa: VMV, 2015. – 285 s.
