{"id":7508,"date":"2021-06-21T19:57:19","date_gmt":"2021-06-21T19:57:19","guid":{"rendered":"https:\/\/sutoit.es\/ea.sutoit.es\/?page_id=7508"},"modified":"2021-12-19T20:44:29","modified_gmt":"2021-12-19T20:44:29","slug":"recommendations-for-mutual-recognition-of-institutional-evaluations","status":"publish","type":"page","link":"https:\/\/ecahe.eu\/archive\/recommendations-for-mutual-recognition-of-institutional-evaluations\/","title":{"rendered":"Recommendations for mutual recognition of institutional evaluations"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-page\" data-elementor-id=\"7508\" class=\"elementor elementor-7508\" data-elementor-post-type=\"page\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-39fefc3d elementor-section-height-min-height elementor-section-boxed elementor-section-height-default elementor-section-items-middle\" data-id=\"39fefc3d\" data-element_type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-1e445b30\" data-id=\"1e445b30\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-2388dd76 elementor-widget elementor-widget-heading\" data-id=\"2388dd76\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Archive<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-38fd888 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"38fd888\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-6853c8f\" data-id=\"6853c8f\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-7979a52 elementor-widget elementor-widget-text-editor\" data-id=\"7979a52\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<header class=\"page-header\"><h2 class=\"entry-title\"><strong>Recommendations for mutual recognition of institutional evaluations<\/strong><\/h2><\/header><div class=\"page-content\"><div class=\"elementor elementor-7508 elementor-edit-area elementor-edit-mode elementor-edit-area-active\" data-elementor-type=\"wp-page\" data-elementor-id=\"7508\" data-elementor-title=\"Page\"><div class=\"elementor-section-wrap ui-sortable\">\u00a0<\/div><\/div><\/div><h2>Contents<\/h2><div id=\"toc\" class=\"toc\"><ul><li class=\"toclevel-1 tocsection-1\"><span class=\"tocnumber\">1<\/span> <span class=\"toctext\">Introduction<\/span><\/li><li class=\"toclevel-1 tocsection-2\"><span class=\"tocnumber\">2<\/span> <span class=\"toctext\">Recommendations<\/span><ul><li class=\"toclevel-2 tocsection-3\"><span class=\"tocnumber\">2.1<\/span> <span class=\"toctext\">Institutional evaluations<\/span><ul><li class=\"toclevel-3 tocsection-4\"><span class=\"tocnumber\">2.1.1<\/span> <span class=\"toctext\">The composition and independence of the panel<\/span><ul><li class=\"toclevel-4 tocsection-5\"><span class=\"tocnumber\">2.1.1.1<\/span> <span class=\"toctext\">Procedures<\/span><\/li><li class=\"toclevel-4 tocsection-6\"><span class=\"tocnumber\">2.1.1.2<\/span> <span class=\"toctext\">Composition<\/span><\/li><\/ul><\/li><li class=\"toclevel-3 tocsection-7\"><span class=\"tocnumber\">2.1.2<\/span> <span class=\"toctext\">The evaluation standards<\/span><\/li><li class=\"toclevel-3 tocsection-8\"><span class=\"tocnumber\">2.1.3<\/span> <span class=\"toctext\">The basis for evaluation, as put together by the institution<\/span><\/li><li class=\"toclevel-3 tocsection-9\"><span class=\"tocnumber\">2.1.4<\/span> <span class=\"toctext\">The site visit<\/span><\/li><li class=\"toclevel-3 tocsection-10\"><span class=\"tocnumber\">2.1.5<\/span> <span class=\"toctext\">The outcome and the consequences<\/span><\/li><li class=\"toclevel-3 tocsection-11\"><span class=\"tocnumber\">2.1.6<\/span> <span class=\"toctext\">Publication of the outcome and report<\/span><\/li><\/ul><\/li><\/ul><\/li><\/ul><\/div><h2><span id=\"Introduction\" class=\"mw-headline\">Introduction<\/span><\/h2><p>One can imagine a continuum between pure programme accreditation on the left side of the continuum, pure institutional evaluations (accreditations, audits or assessments) on the right side, and mixes between programme and institutional evaluations in the middle. Programme accreditation used to be most frequent type of evaluation in Europe. However, there is a tendency in European \u201cexternal quality assurance\u201d to switch from programme accreditation to combinations of some forms of \u201cinstitutional evaluations\u201d and programme evaluations. These forms may differ in quite meaningful ways: the Austrian colleagues of \u00d6AR execute real \u201cinstitutional accreditations\u201d of the private universities in Austria, whereas in other countries the institutional evaluations are restricted to the \u201cinternal quality assurance systems\u201d on the institutional level. In some countries (e.g. 2010 system in the Netherlands) the institutional evaluation (audit) and programme accreditation are intertwined; a positive institutional audit results in a lighter touch for the programme accreditations of that institution. In other countries institutional and programme evaluations are separate systems of evaluation. It is also possible that one type of evaluation is mandatory and the other voluntary. Of course, these different types of evaluations might cause trouble for \u201cmutual recognition\u201d, especially if it is not clear how teaching or the quality of the programmes are involved in these evaluations. We should therefore strive for a common description of the institutional evaluations in order to make mutual recognitions possible.<\/p><h2><span id=\"Recommendations\" class=\"mw-headline\">Recommendations<\/span><\/h2><dl><dd><b>Recommendation 1<\/b>:<\/dd><dd>\u201cin mutual recognition agreements, institutional \u201cevaluations\u201d are regarded as fit for these agreements if they are carried out according to the commonly agreed rules and guidelines of ECA (code of good practice, selection criteria for experts, commonly agreed evaluation standards)\u201d<\/dd><\/dl><dl><dd><b>Recommendation 2<\/b>:<\/dd><dd>\u201cinstitutional evaluations optimally fulfil the purpose of mutual recognition agreements if:<\/dd><\/dl><ul><li>they focus at least on the internal quality assurance systems of higher education institutions;<\/li><li>they provide sufficient and reliable information about at least the quality of educational provision;<\/li><li>they are based upon transparent and internationally accepted standards (ESG).<\/li><\/ul><h3><span id=\"Institutional_evaluations\" class=\"mw-headline\">Institutional evaluations<\/span><\/h3><p>For the process of the institutional evaluations it is necessary to get the outlines of the procedure known and to obtain information on topics, standards and outcome of the evaluation. Six topics seem essential in order to understand the quality of the evaluation process and the meaning of the outcome:<\/p><ol><li>the composition and independence of the panel;<\/li><li>the standards used;<\/li><li>the basis for the evaluation, as prepared by Higher Education institution;<\/li><li>the site visit;<\/li><li>the outcome and consequences;<\/li><li>publication of the outcome and report.<\/li><\/ol><h4><span id=\"The_composition_and_independence_of_the_panel\" class=\"mw-headline\">The composition and independence of the panel<\/span><\/h4><p>ECA has adopted \u201ccommon principles for the selection of experts\u201d in Dublin, June 2, 2005. For institutional evaluations the following principles for selection procedures and panel composition are relevant.<\/p><h5><span id=\"Procedures\" class=\"mw-headline\">Procedures<\/span><\/h5><ul><li>any decision regarding the expert panel should be based on the policies, procedures and criteria of the accreditation organisation or on relevant legislation<\/li><li>panel members must be independent and in a position to make unbiased judgements. Any possible conflict of interest must be disclosed<\/li><li>the selection criteria for experts panels must be established and published by the accreditation organisation<\/li><li>applicants undergoing evaluations are given the opportunity to comment on the selection of panel members<\/li><li>the decisions on the evaluation should be made by the relevant authority and not by the group of experts themselves<\/li><li>panel members must be committed to treat all material and findings as strictly confidential<\/li><li>panel members are briefed adequately by the accreditation organisation on the context within which they are operating (national legislative environment, criteria, procedures and guidelines)<\/li><\/ul><h5><span id=\"Composition\" class=\"mw-headline\">Composition<\/span><\/h5><p>The number of panel members may vary depending on the range of competence of individual members. Gender balance should be taken into consideration when appointing a panel of experts. The expert panel should have the following mix of expertise appropriate to the objectives of the accreditation procedure:<\/p><ul><li>experience in quality assurance in higher education<\/li><li>appropriate academic or professional qualifications<\/li><li>expertise in institutional governance and management<\/li><li>leadership experience in research\/academic\/professional management<\/li><li>relevant international experience that provides a basis for making international comparisons<\/li><li>knowledge on teaching and learning methods<\/li><li>expertise in development, design, provision and evaluation of higher education programmes<\/li><li>knowledge of the country-specific system of higher education, institutions and applicable legislation<\/li><\/ul><p>Depending on the national context it is recommendable to include in the institutional evaluation panel:<\/p><ul><li>student representative(s)<\/li><li>representative(s) from the labour market<\/li><li>a significant proportion of panel members from outside the country<\/li><\/ul><dl><dd><b>Recommendation 3<\/b>:<\/dd><dd>The <a class=\"mw-redirect\" title=\"ECA\" href=\"https:\/\/ecahe.eu\/\/member-directory\/\">ECA<\/a>-members should put the guidelines on the procedures and the composition of the panels for the institutional evaluation into practice.<\/dd><\/dl><h4><span id=\"The_evaluation_standards\" class=\"mw-headline\">The evaluation standards<\/span><\/h4><p>The institutional evaluation does at least involve the \u201cinternal quality assurance system\u201d on teaching and learning. There are of course different methods and criteria to assess this system. Some organisations use a limited set of standards and criteria, whereas others are using a larger number. The standards and criteria used have to be published.<\/p><dl><dd><b>Recommendation 4<\/b>:<\/dd><dd>The ECA-members should publish the standards and criteria used in the \u201cinstitutional evaluation\u201d process in the English language.<\/dd><\/dl><h4><span id=\"The_basis_for_evaluation.2C_as_put_together_by_the_institution\" class=\"mw-headline\">The basis for evaluation, as put together by the institution<\/span><\/h4><p>In the evaluation report should be mentioned what has been the basis for the evaluation by the panel. In some countries self-evaluation reports are made by the institutions (\u201ccritical self-reflection\u201d), in other countries management reviews are used for the evaluation, and in <a class=\"mw-redirect\" title=\"Norway\" href=\"https:\/\/ecahe.eu\/w\/index.php?title=Norway\">Norway<\/a> for instance annual reports and the \u201cgoing concern\u201d are used by the panel.<\/p><h4><span id=\"The_site_visit\" class=\"mw-headline\">The site visit<\/span><\/h4><p>The programme of the site visit and the participants in the site visit should be mentioned in the report.<\/p><dl><dd><b>Recommendation 5<\/b>:<\/dd><dd>There should always be a site visit when carrying out an institutional evaluation.<\/dd><\/dl><h4><span id=\"The_outcome_and_the_consequences\" class=\"mw-headline\">The outcome and the consequences<\/span><\/h4><p>The outcome should be mentioned in the report as well as the different categories in which the outcome may be classified. Some systems are dichotomous: only \u201cyes\u201d or \u201cno\u201d are possible. Other systems will allow the accreditation organisation to give a \u201cconditional yes\u201d as an outcome of the evaluation. The consequences of the evaluation may differ from system to system. It would be very helpful if the possible outcomes of the evaluation are published by the accreditation organisation and if the consequences are explained.<\/p><dl><dd><b>Recommendation 6<\/b>:<\/dd><dd>The ECA-members publish and explain the possible outcomes of the evaluation process, and explain the consequences of the different outcomes.<\/dd><\/dl><h4><span id=\"Publication_of_the_outcome_and_report\" class=\"mw-headline\">Publication of the outcome and report<\/span><\/h4><p>Publication is an essential condition for mutual recognition; without a published outcome there is nothing to recognise. Although it is possible to recognise a positive outcome without an underlying public report, there is a problem of transparency. The ideal situation is that both the outcome and the report are published. However, in practice the report is often not published, e.g. if the outcome is negative or the application withdrawn after a negative outcome. In the latter case, and also in some systems in case of a negative outcome, not even the negative outcome is published. There are also systems in which only an extract of the report and not the full report is published.<\/p><dl><dd><b>Recommendation 7<\/b>:<\/dd><dd>ECA members should take steps to increase the publication of both outcomes and reports of institutional evaluations.<\/dd><\/dl><p><a class=\"internal\" title=\"Mutual-recognition-of-institutional-evaluations-recommendations.pdf\" href=\"http:\/\/sutoit.es\/ea.sutoit.es\/wp-content\/uploads\/2021\/06\/Mutual-recognition-of-institutional-evaluations-recommendations.pdf\">ECA Mutual recognition of institutional evaluations recommendations<\/a><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Archive Recommendations for mutual recognition of institutional evaluations \u00a0 Contents 1 Introduction 2 Recommendations 2.1 Institutional evaluations 2.1.1 The composition and independence of the panel 2.1.1.1 Procedures 2.1.1.2 Composition 2.1.2 The evaluation standards 2.1.3 The basis for evaluation, as put together by the institution 2.1.4 The site visit 2.1.5 The outcome and the consequences 2.1.6 [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":6139,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"_links":{"self":[{"href":"https:\/\/ecahe.eu\/wp-json\/wp\/v2\/pages\/7508"}],"collection":[{"href":"https:\/\/ecahe.eu\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/ecahe.eu\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/ecahe.eu\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ecahe.eu\/wp-json\/wp\/v2\/comments?post=7508"}],"version-history":[{"count":12,"href":"https:\/\/ecahe.eu\/wp-json\/wp\/v2\/pages\/7508\/revisions"}],"predecessor-version":[{"id":10846,"href":"https:\/\/ecahe.eu\/wp-json\/wp\/v2\/pages\/7508\/revisions\/10846"}],"up":[{"embeddable":true,"href":"https:\/\/ecahe.eu\/wp-json\/wp\/v2\/pages\/6139"}],"wp:attachment":[{"href":"https:\/\/ecahe.eu\/wp-json\/wp\/v2\/media?parent=7508"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}