
{"id":181720,"date":"2025-09-26T08:00:15","date_gmt":"2025-09-26T06:00:15","guid":{"rendered":"https:\/\/uniavisen.dk\/aktindsigter-viser-store-spaend-mellem-bedoemmere-paa-jura\/"},"modified":"2025-09-26T10:24:05","modified_gmt":"2025-09-26T08:24:05","slug":"wide-disparities-at-university-of-copenhagen-law-exams-revealed","status":"publish","type":"post","link":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/","title":{"rendered":"Wide disparities at University of Copenhagen law exams revealed"},"content":{"rendered":"<p>Most students know the feeling: You leave the exam room with a clear sense of how it went. Maybe you were sure of getting a solid 10 on the Danish grading system. But you ended up with only a mid-range grade of 4. Or perhaps you left feeling unsure of yourself \u2014 only to be positively surprised by the maximum grade of 12.<\/p>\n<p>Grading can feel like a bit of a lottery, where you either draw the winning ticket or come up empty-handed. Former law student at the University of Copenhagen (UCPH) Morten Kromann knows that feeling. During his studies, he sometimes experienced that a grade depended more on which examiner he got \u2014 than on his actual exam performance.<\/p>\n<p>\u00bbIt makes no sense that in the same subject, and on the same term, you can be lucky with one examiner and unlucky with another \u2014 and that the difference can be several grades,\u00ab says Morten Kromann.<\/p>\n<p>This is the reason why he decided to investigate all the grades awarded at the Faculty of Law at UCPH from the winter semester 2021 to the summer of 2024.<\/p>\n<h3>Striking discrepancies<\/h3>\n<p>Through a series of freedom of information requests, he has gained access to data from 734 examiners in the compulsory subjects and analysed the differences in grading. The University Post has seen the material.<\/p>\n<blockquote><p>These are huge discrepancies that can mean the difference between getting a good grade or failing<\/p>\n<p class=\"quotee\">Morten Kromann, former law student<\/p>\n<\/blockquote>\n<p>The results show striking discrepancies: In several subjects, the average grade varied between examiners by more than four grade points \u2014 enough to determine the difference between failing and getting a top grade.<\/p>\n<p>\u00bbIn <em>Erstatning og kontrakt,<\/em> the Torts and Contracts course in the summer of 2022, one examiner who assessed 51 students gave an average of 1.57 with no grades above 4 \u2014 while the course director\u2019s average was 5.9,\u00ab says Morten Kromann, and continues:<\/p>\n<p>\u00bbIn International Law in the winter of 2022\/23, you could be assessed by one examiner who gave an average of 3.9, or by another whose average was 8.76 \u2014 they each assessed 52 and 53 assignments respectively. That\u2019s a span of 4.86 in grades, and these are huge discrepancies that can mean the difference between getting a good grade or failing.\u00ab<br \/>\n<!-- end of module 1 --><br \/>\nThe large fluctuations in grade averages are even more striking when you consider that assignments and students are distributed randomly between examiners.<\/p>\n<p>Even in the most recent exams, there are major variations in average grades depending on the examiner.<\/p>\n<p>In the EU Law written exam in the winter of 2023\/24, the average grades ranged from 3.69 to 7.34 between the strictest and the most lenient examiners. Both of them assessed assignments from 32 students.<\/p>\n<p>For students, the differences in grades can, according to Morten Kromann, have serious consequences.<\/p>\n<p>\u00bbStudent jobs at the big law firms are often applied for in the third semester. They look at specific first-year subjects. So if you happen to get a strict examiner there, you take it with you,\u00ab says Morten Kromann.<\/p>\n<p>A strict examiner can not only result in a resit exam, but also cost you a student job, a professional network, and an exchange opportunity.<\/p>\n<h3>Data assessed by statistics professor<\/h3>\n<p>The University Post asked Helle S\u00f8rensen, professor of statistics at the University of Copenhagen, to take a closer look at the data.<\/p>\n<p>Using a so-called <em>linear mixed model<\/em>, she examined the dataset and separated the variation that stems from students, courses, and examiners.<\/p>\n<p>She finds that while differences between examiners are, in fact, there, they are \u2014 in the bigger picture \u2014 smaller than the variation between individual students and between courses.<\/p>\n<blockquote><p>Clearly you want as little variation as possible between examiners when it comes to grades<\/p>\n<p class=\"quotee\">Helle S\u00f8rensen, professor of statistics, University of Copenhagen<\/p>\n<\/blockquote>\n<p>According to Helle S\u00f8rensen, the spread is estimated at 0.34 grade points between examiners, around 1 between courses, and 3.7 between students.<\/p>\n<p>\u00bbThis leads me to conclude that the variation between examiners is significantly smaller than the differences between courses \u2014 and far smaller than the differences between students, which is, after all, what we are interested in when we hold exams,\u00ab she says.<\/p>\n<p>Helle S\u00f8rensen emphasises that she has deliberately not looked at individual subjects or specific exams, but only at the overall patterns in the material.<\/p>\n<p>\u00bbWhen you look for extremes, then you will also find extreme things. I find it more important to look for the general pattern,\u00ab she explains.<\/p>\n<p>Despite the fact that variation between students and courses statistically outweighs the differences between examiners, the latter is not entirely negligible, according to Helle S\u00f8rensen.<\/p>\n<p>\u00bbClearly you want as little variation as possible between examiners when it comes to grades. As a student, you should be able to trust that you are being assessed fairly,\u00ab she says.<\/p>\n<h3>Faculty aware of the issue<\/h3>\n<p>The University Post has tried to secure an interview with Faculty of Law management to get them to respond to the results, and the criticism raised by Morten Kromann. They declined.<\/p>\n<p>Instead, the University Post got written responses from the faculty\u2019s associate dean for education, Liselotte Madsen.<\/p>\n<p>She writes that the faculty already uses lots of resources on monitoring academic grading standards, but that grades will always include a certain an element of discretion.<\/p>\n<blockquote><p>This is a criticism that we take very seriously<\/p>\n<p class=\"quotee\">Liselotte Madsen, Associate Dean for Education, Faculty of Law<\/p>\n<\/blockquote>\n<p>Assignments and grading guidelines are quality assured by a commission consisting of the course leaders and the external examiners, and after the exam, the examiners meet for a pre-assessment to ensure a uniform benchmark. Experiences are then discussed with teaching staff.<\/p>\n<p>The associate dean stresses, however, that the faculty is attentive to the criticism that has been raised about grading in some subjects.<\/p>\n<p>\u00bbThis is a criticism that we take very seriously. This is why we will also investigate the issue further in dialogue with the study board and the course leaders at the Faculty of Law,\u00ab she writes.<\/p>\n<p>They have also decided that in future, the course leader in each course will receive the average grades per examiner for each exam.<\/p>\n<p>\u00bbShould it turn out that there is a structural problem with grading, we are of course interested in solving it. However, I am not in a position to comment on analyses that we have not carried out ourselves, as we have not had the opportunity to verify the calculations,\u00ab she writes in her response.<\/p>\n<h3>Never completely objective<\/h3>\n<p>For Morten Kromann, the conclusion is not that grades can ever be made completely objective, but that the system should be designed to minimise variation as much as possible.<\/p>\n<p>He points to several specific measures that could help: Fewer examiners per subject, closer monitoring of grading patterns, mandatory calibration between examiners, and double marking in borderline cases \u2014 for example when the grade falls between 00 and 02, or between 10 and 12.<\/p>\n<p>\u00bbIt would be relatively easy to introduce systems to monitor if an examiner is consistently at one extreme. This would give more consistent and fairer grades,\u00ab says Morten Kromann.<br \/>\n<!-- end of module 2 --><br \/>\nHe acknowledges that the variation among examiners is, in the bigger picture, smaller than the variation between students, but he still believes there should be more focus on the extremes.<\/p>\n<p>\u00bbThe extremes are not just random statistics: They are very specific cases where one examiner can ruin a student\u2019s opportunities. If we want to protect students, we have to focus on the individual extreme assessments and not just the averages. Of course, there will be differences between students. What needs to be ensured is that equal performances are assessed equally,\u00ab says Morten Kromann.<\/p>\n<p>He acknowledges that grading can never be an exact science, no matter how many measures are introduced.<\/p>\n<p>\u00bbThere will always be a degree of uncertainty in assessments, but I think we owe it to the students to minimise chance as much as possible,\u00ab he says.<\/p>\n<p>According to him, the problem is not just technical but also cultural: Grades are often treated as an objective and immutable measure of academic ability, even though they to a large extent reflect chance.<\/p>\n<p>\u00bbIt is an illusion to believe that a grade is an objective truth. As long as we hold on to that notion, nothing will change,\u00ab says Morten Kromann.<\/p>\n<p><em>This article was first written in Danish and published on 25 September 2025. It has been translated into English and post-edited by Mike Young.<\/em><br \/>\n<!-- end of module 3 --><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A former law student has mapped out the grades from more than 700 examiners at the Faculty of Law. The results show differences of up to five grade points between examiners on the same exam \u2014 enough to mean the difference between failing and getting a top grade.<\/p>\n","protected":false},"author":106,"featured_media":160934,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[42],"tags":[],"class_list":["post-181720","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-education","expression-news_article"],"acf":[],"aioseo_notices":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Wide disparities at law exams exposed \u2014 University Post<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Wide disparities at law exams exposed \u2014 University Post\" \/>\n<meta property=\"og:description\" content=\"A former law student has mapped out the grades from more than 700 examiners at the Faculty of Law. The results show differences of up to five grade points between examiners on the same exam \u2014 enough to mean the difference between failing and getting a top grade.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/\" \/>\n<meta property=\"og:site_name\" content=\"University Post\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/uniavis\" \/>\n<meta property=\"article:published_time\" content=\"2025-09-26T06:00:15+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-09-26T08:24:05+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/0318emiliepaajurastudiet_web2048x1365.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2048\" \/>\n\t<meta property=\"og:image:height\" content=\"1365\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Martin Juhl\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/0318emiliepaajurastudiet_web2048x1365.jpg\" \/>\n<meta name=\"twitter:creator\" content=\"@Uniavisen\" \/>\n<meta name=\"twitter:site\" content=\"@Uniavisen\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Martin Juhl\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/\"},\"author\":{\"name\":\"Martin Juhl\",\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/#\\\/schema\\\/person\\\/ff6534f5b2402ad00c090ce725c33b27\"},\"headline\":\"Wide disparities at University of Copenhagen law exams revealed\",\"datePublished\":\"2025-09-26T06:00:15+00:00\",\"dateModified\":\"2025-09-26T08:24:05+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/\"},\"wordCount\":1383,\"image\":{\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/uniavisen.dk\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/0318emiliepaajurastudiet_web.jpg\",\"articleSection\":[\"Education\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/\",\"url\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/\",\"name\":\"Wide disparities at law exams exposed \u2014 University Post\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/uniavisen.dk\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/0318emiliepaajurastudiet_web.jpg\",\"datePublished\":\"2025-09-26T06:00:15+00:00\",\"dateModified\":\"2025-09-26T08:24:05+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/#\\\/schema\\\/person\\\/ff6534f5b2402ad00c090ce725c33b27\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/#primaryimage\",\"url\":\"https:\\\/\\\/uniavisen.dk\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/0318emiliepaajurastudiet_web.jpg\",\"contentUrl\":\"https:\\\/\\\/uniavisen.dk\\\/wp-content\\\/uploads\\\/2024\\\/03\\\/0318emiliepaajurastudiet_web.jpg\",\"width\":2400,\"height\":1600,\"caption\":\"Oversigtsbillede over et auditorium p\u00e5 Jura. Gulver skr\u00e5ner ikke, det er flat, s\u00e5 der er nem tilg\u00e6ngelighed for k\u00f8restolsbrugere, og rampen ude til venstre i billedet er der for at give adgang til at forel\u00f8se for undervisere, der m\u00e5tte v\u00e6re k\u00f8restolsbrugere.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Wide disparities at University of Copenhagen law exams revealed\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/#website\",\"url\":\"https:\\\/\\\/uniavisen.dk\\\/\",\"name\":\"University Post\",\"description\":\"Independent of management\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/uniavisen.dk\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/uniavisen.dk\\\/#\\\/schema\\\/person\\\/ff6534f5b2402ad00c090ce725c33b27\",\"name\":\"Martin Juhl\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1797e6a2f5504b0011d25ea810ff777cf9961880304ebea2975858e118970e05?s=96&d=identicon&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1797e6a2f5504b0011d25ea810ff777cf9961880304ebea2975858e118970e05?s=96&d=identicon&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1797e6a2f5504b0011d25ea810ff777cf9961880304ebea2975858e118970e05?s=96&d=identicon&r=g\",\"caption\":\"Martin Juhl\"},\"url\":\"https:\\\/\\\/uniavisen.dk\\\/en\\\/author\\\/martin_juhl_petersen\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Wide disparities at law exams exposed \u2014 University Post","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/","og_locale":"en_US","og_type":"article","og_title":"Wide disparities at law exams exposed \u2014 University Post","og_description":"A former law student has mapped out the grades from more than 700 examiners at the Faculty of Law. The results show differences of up to five grade points between examiners on the same exam \u2014 enough to mean the difference between failing and getting a top grade.","og_url":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/","og_site_name":"University Post","article_publisher":"https:\/\/www.facebook.com\/uniavis","article_published_time":"2025-09-26T06:00:15+00:00","article_modified_time":"2025-09-26T08:24:05+00:00","og_image":[{"width":2048,"height":1365,"url":"http:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/0318emiliepaajurastudiet_web2048x1365.jpg","type":"image\/jpeg"}],"author":"Martin Juhl","twitter_card":"summary_large_image","twitter_image":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/0318emiliepaajurastudiet_web2048x1365.jpg","twitter_creator":"@Uniavisen","twitter_site":"@Uniavisen","twitter_misc":{"Written by":"Martin Juhl","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/#article","isPartOf":{"@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/"},"author":{"name":"Martin Juhl","@id":"https:\/\/uniavisen.dk\/#\/schema\/person\/ff6534f5b2402ad00c090ce725c33b27"},"headline":"Wide disparities at University of Copenhagen law exams revealed","datePublished":"2025-09-26T06:00:15+00:00","dateModified":"2025-09-26T08:24:05+00:00","mainEntityOfPage":{"@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/"},"wordCount":1383,"image":{"@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/#primaryimage"},"thumbnailUrl":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web.jpg","articleSection":["Education"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/","url":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/","name":"Wide disparities at law exams exposed \u2014 University Post","isPartOf":{"@id":"https:\/\/uniavisen.dk\/#website"},"primaryImageOfPage":{"@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/#primaryimage"},"image":{"@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/#primaryimage"},"thumbnailUrl":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web.jpg","datePublished":"2025-09-26T06:00:15+00:00","dateModified":"2025-09-26T08:24:05+00:00","author":{"@id":"https:\/\/uniavisen.dk\/#\/schema\/person\/ff6534f5b2402ad00c090ce725c33b27"},"breadcrumb":{"@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/#primaryimage","url":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web.jpg","contentUrl":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web.jpg","width":2400,"height":1600,"caption":"Oversigtsbillede over et auditorium p\u00e5 Jura. Gulver skr\u00e5ner ikke, det er flat, s\u00e5 der er nem tilg\u00e6ngelighed for k\u00f8restolsbrugere, og rampen ude til venstre i billedet er der for at give adgang til at forel\u00f8se for undervisere, der m\u00e5tte v\u00e6re k\u00f8restolsbrugere."},{"@type":"BreadcrumbList","@id":"https:\/\/uniavisen.dk\/en\/wide-disparities-at-university-of-copenhagen-law-exams-revealed\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/uniavisen.dk\/en\/"},{"@type":"ListItem","position":2,"name":"Wide disparities at University of Copenhagen law exams revealed"}]},{"@type":"WebSite","@id":"https:\/\/uniavisen.dk\/#website","url":"https:\/\/uniavisen.dk\/","name":"University Post","description":"Independent of management","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/uniavisen.dk\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/uniavisen.dk\/#\/schema\/person\/ff6534f5b2402ad00c090ce725c33b27","name":"Martin Juhl","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1797e6a2f5504b0011d25ea810ff777cf9961880304ebea2975858e118970e05?s=96&d=identicon&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1797e6a2f5504b0011d25ea810ff777cf9961880304ebea2975858e118970e05?s=96&d=identicon&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1797e6a2f5504b0011d25ea810ff777cf9961880304ebea2975858e118970e05?s=96&d=identicon&r=g","caption":"Martin Juhl"},"url":"https:\/\/uniavisen.dk\/en\/author\/martin_juhl_petersen\/"}]}},"advancedCustomFields":{"expression":{"term_id":15,"name":"News Article","slug":"news_article","term_group":0,"term_taxonomy_id":15,"taxonomy":"expression","description":"","parent":0,"count":11485,"filter":"raw"},"enable_comments":true,"align_content":"alignleft","feature_color":"","article_updated":"","layout_group":[{"acf_fc_layout":"Headline","use_post_title":true,"headline":"","style":"default","highlighted_words":"","text_size":"small"},{"acf_fc_layout":"Image","image":{"ID":160933,"id":160933,"title":"Emilie Ghali p\u00e5 jurastudiet - kan man komme omkring p\u00e5 jura i en k\u00f8restol og med handicap04","filename":"0318emiliepaajurastudiet_web.jpg","filesize":483579,"url":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web.jpg","link":"https:\/\/uniavisen.dk\/en\/uniavisen-undersoeger-kan-man-komme-omkring-paa-jura-i-en-koerestol\/0318-emilie-paa-jurastudiet_web\/","alt":"","author":"8","description":"","caption":"Oversigtsbillede over et auditorium p\u00e5 Jura. Gulvet skr\u00e5ner ikke, men er fladt, s\u00e5 der er nem tilg\u00e6ngelighed for k\u00f8restolsbrugere, og rampen ved tavlen til venstre giver adgang for undervisere, der ogs\u00e5 er k\u00f8restolsbrugere.","name":"0318-emilie-paa-jurastudiet_web","status":"inherit","uploaded_to":160636,"date":"2024-03-05 09:24:57","modified":"2025-10-17 07:42:15","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/uniavisen.dk\/wp-includes\/images\/media\/default.png","width":2400,"height":1600,"sizes":{"thumbnail":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-150x150.jpg","thumbnail-width":150,"thumbnail-height":150,"medium":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-480x320.jpg","medium-width":480,"medium-height":320,"medium_large":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-768x512.jpg","medium_large-width":768,"medium_large-height":512,"large":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-1280x853.jpg","large-width":1280,"large-height":853,"1536x1536":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-1536x1024.jpg","1536x1536-width":1536,"1536x1536-height":1024,"2048x2048":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-2048x1365.jpg","2048x2048-width":2048,"2048x2048-height":1365,"featured-soft":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-290x193.jpg","featured-soft-width":290,"featured-soft-height":193,"featured-hard":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-290x180.jpg","featured-hard-width":290,"featured-hard-height":180,"narrow":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-700x467.jpg","narrow-width":700,"narrow-height":467,"extended":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-990x660.jpg","extended-width":990,"extended-height":660}},"style":"extended","text_placement":"metadata-below","image_link_url":"","image_link_title":"","caption_prefix":"","enable_alternative_caption":true,"alternative_caption":"There are major discrepancies in examiners\u2019 grading on several subjects at the Faculty of Law at UCPH. According to Morten Kromann, who compiled the results, the large differences can ultimately determine a student\u2019s future."},{"acf_fc_layout":"Standfirst","subject":"Grading scale","text":"This is a story about what will follow","use_post_excerpt":true},{"acf_fc_layout":"Byline","is_author":true,"contributors":false},{"acf_fc_layout":"Content","content":"<p>Most students know the feeling: You leave the exam room with a clear sense of how it went. Maybe you were sure of getting a solid 10 on the Danish grading system. But you ended up with only a mid-range grade of 4. Or perhaps you left feeling unsure of yourself \u2014 only to be positively surprised by the maximum grade of 12.<\/p>\n<p>Grading can feel like a bit of a lottery, where you either draw the winning ticket or come up empty-handed. Former law student at the University of Copenhagen (UCPH) Morten Kromann knows that feeling. During his studies, he sometimes experienced that a grade depended more on which examiner he got \u2014 than on his actual exam performance.<\/p>\n<p>\u00bbIt makes no sense that in the same subject, and on the same term, you can be lucky with one examiner and unlucky with another \u2014 and that the difference can be several grades,\u00ab says Morten Kromann.<\/p>\n<p>This is the reason why he decided to investigate all the grades awarded at the Faculty of Law at UCPH from the winter semester 2021 to the summer of 2024.<\/p>\n<h3>Striking discrepancies<\/h3>\n<p>Through a series of freedom of information requests, he has gained access to data from 734 examiners in the compulsory subjects and analysed the differences in grading. The University Post has seen the material.<\/p>\n<blockquote><p>These are huge discrepancies that can mean the difference between getting a good grade or failing<\/p>\n<p class=\"quotee\">Morten Kromann, former law student<\/p>\n<\/blockquote>\n<p>The results show striking discrepancies: In several subjects, the average grade varied between examiners by more than four grade points \u2014 enough to determine the difference between failing and getting a top grade.<\/p>\n<p>\u00bbIn <em>Erstatning og kontrakt,<\/em> the Torts and Contracts course in the summer of 2022, one examiner who assessed 51 students gave an average of 1.57 with no grades above 4 \u2014 while the course director\u2019s average was 5.9,\u00ab says Morten Kromann, and continues:<\/p>\n<p>\u00bbIn International Law in the winter of 2022\/23, you could be assessed by one examiner who gave an average of 3.9, or by another whose average was 8.76 \u2014 they each assessed 52 and 53 assignments respectively. That\u2019s a span of 4.86 in grades, and these are huge discrepancies that can mean the difference between getting a good grade or failing.\u00ab<\/p>\n"},{"acf_fc_layout":"Image","image":{"ID":181624,"id":181624,"title":"MortenKromann1","filename":"mortenkromann1-scaled.jpg","filesize":596653,"url":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-scaled.jpg","link":"https:\/\/uniavisen.dk\/en\/aktindsigter-viser-store-spaend-mellem-bedoemmere-paa-jura\/mortenkromann1\/","alt":"","author":"106","description":"","caption":"","name":"mortenkromann1","status":"inherit","uploaded_to":181618,"date":"2025-09-23 13:50:31","modified":"2025-09-23 13:50:48","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/uniavisen.dk\/wp-includes\/images\/media\/default.png","width":2560,"height":1889,"sizes":{"thumbnail":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-150x150.jpg","thumbnail-width":150,"thumbnail-height":150,"medium":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-480x354.jpg","medium-width":480,"medium-height":354,"medium_large":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-768x567.jpg","medium_large-width":768,"medium_large-height":567,"large":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-1280x945.jpg","large-width":1280,"large-height":945,"1536x1536":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-1536x1134.jpg","1536x1536-width":1536,"1536x1536-height":1134,"2048x2048":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-2048x1512.jpg","2048x2048-width":2048,"2048x2048-height":1512,"featured-soft":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-290x214.jpg","featured-soft-width":290,"featured-soft-height":214,"featured-hard":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-290x180.jpg","featured-hard-width":290,"featured-hard-height":180,"narrow":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-700x517.jpg","narrow-width":700,"narrow-height":517,"extended":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann1-990x731.jpg","extended-width":990,"extended-height":731}},"style":"narrow","text_placement":"metadata-below","image_link_url":"","image_link_title":"","caption_prefix":"","enable_alternative_caption":true,"alternative_caption":"Morten Kromann obtained grading data from 734 examiners at the Faculty of Law via freedom of information requests, and shared it with the University Post"},{"acf_fc_layout":"Content","content":"<p>The large fluctuations in grade averages are even more striking when you consider that assignments and students are distributed randomly between examiners.<\/p>\n<p>Even in the most recent exams, there are major variations in average grades depending on the examiner.<\/p>\n<p>In the EU Law written exam in the winter of 2023\/24, the average grades ranged from 3.69 to 7.34 between the strictest and the most lenient examiners. Both of them assessed assignments from 32 students.<\/p>\n<p>For students, the differences in grades can, according to Morten Kromann, have serious consequences.<\/p>\n<p>\u00bbStudent jobs at the big law firms are often applied for in the third semester. They look at specific first-year subjects. So if you happen to get a strict examiner there, you take it with you,\u00ab says Morten Kromann.<\/p>\n<p>A strict examiner can not only result in a resit exam, but also cost you a student job, a professional network, and an exchange opportunity.<\/p>\n<h3>Data assessed by statistics professor<\/h3>\n<p>The University Post asked Helle S\u00f8rensen, professor of statistics at the University of Copenhagen, to take a closer look at the data.<\/p>\n<p>Using a so-called <em>linear mixed model<\/em>, she examined the dataset and separated the variation that stems from students, courses, and examiners.<\/p>\n<p>She finds that while differences between examiners are, in fact, there, they are \u2014 in the bigger picture \u2014 smaller than the variation between individual students and between courses.<\/p>\n<blockquote><p>Clearly you want as little variation as possible between examiners when it comes to grades<\/p>\n<p class=\"quotee\">Helle S\u00f8rensen, professor of statistics, University of Copenhagen<\/p>\n<\/blockquote>\n<p>According to Helle S\u00f8rensen, the spread is estimated at 0.34 grade points between examiners, around 1 between courses, and 3.7 between students.<\/p>\n<p>\u00bbThis leads me to conclude that the variation between examiners is significantly smaller than the differences between courses \u2014 and far smaller than the differences between students, which is, after all, what we are interested in when we hold exams,\u00ab she says.<\/p>\n<p>Helle S\u00f8rensen emphasises that she has deliberately not looked at individual subjects or specific exams, but only at the overall patterns in the material.<\/p>\n<p>\u00bbWhen you look for extremes, then you will also find extreme things. I find it more important to look for the general pattern,\u00ab she explains.<\/p>\n<p>Despite the fact that variation between students and courses statistically outweighs the differences between examiners, the latter is not entirely negligible, according to Helle S\u00f8rensen.<\/p>\n<p>\u00bbClearly you want as little variation as possible between examiners when it comes to grades. As a student, you should be able to trust that you are being assessed fairly,\u00ab she says.<\/p>\n<h3>Faculty aware of the issue<\/h3>\n<p>The University Post has tried to secure an interview with Faculty of Law management to get them to respond to the results, and the criticism raised by Morten Kromann. They declined.<\/p>\n<p>Instead, the University Post got written responses from the faculty\u2019s associate dean for education, Liselotte Madsen.<\/p>\n<p>She writes that the faculty already uses lots of resources on monitoring academic grading standards, but that grades will always include a certain an element of discretion.<\/p>\n<blockquote><p>This is a criticism that we take very seriously<\/p>\n<p class=\"quotee\">Liselotte Madsen, Associate Dean for Education, Faculty of Law<\/p>\n<\/blockquote>\n<p>Assignments and grading guidelines are quality assured by a commission consisting of the course leaders and the external examiners, and after the exam, the examiners meet for a pre-assessment to ensure a uniform benchmark. Experiences are then discussed with teaching staff.<\/p>\n<p>The associate dean stresses, however, that the faculty is attentive to the criticism that has been raised about grading in some subjects.<\/p>\n<p>\u00bbThis is a criticism that we take very seriously. This is why we will also investigate the issue further in dialogue with the study board and the course leaders at the Faculty of Law,\u00ab she writes.<\/p>\n<p>They have also decided that in future, the course leader in each course will receive the average grades per examiner for each exam.<\/p>\n<p>\u00bbShould it turn out that there is a structural problem with grading, we are of course interested in solving it. However, I am not in a position to comment on analyses that we have not carried out ourselves, as we have not had the opportunity to verify the calculations,\u00ab she writes in her response.<\/p>\n<h3>Never completely objective<\/h3>\n<p>For Morten Kromann, the conclusion is not that grades can ever be made completely objective, but that the system should be designed to minimise variation as much as possible.<\/p>\n<p>He points to several specific measures that could help: Fewer examiners per subject, closer monitoring of grading patterns, mandatory calibration between examiners, and double marking in borderline cases \u2014 for example when the grade falls between 00 and 02, or between 10 and 12.<\/p>\n<p>\u00bbIt would be relatively easy to introduce systems to monitor if an examiner is consistently at one extreme. This would give more consistent and fairer grades,\u00ab says Morten Kromann.<\/p>\n"},{"acf_fc_layout":"Image","image":{"ID":181626,"id":181626,"title":"MortenKromann2","filename":"mortenkromann2-scaled.jpg","filesize":583231,"url":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-scaled.jpg","link":"https:\/\/uniavisen.dk\/en\/aktindsigter-viser-store-spaend-mellem-bedoemmere-paa-jura\/mortenkromann2\/","alt":"","author":"106","description":"","caption":"","name":"mortenkromann2","status":"inherit","uploaded_to":181618,"date":"2025-09-23 13:50:35","modified":"2025-09-23 13:51:54","menu_order":0,"mime_type":"image\/jpeg","type":"image","subtype":"jpeg","icon":"https:\/\/uniavisen.dk\/wp-includes\/images\/media\/default.png","width":2560,"height":1709,"sizes":{"thumbnail":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-150x150.jpg","thumbnail-width":150,"thumbnail-height":150,"medium":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-480x320.jpg","medium-width":480,"medium-height":320,"medium_large":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-768x513.jpg","medium_large-width":768,"medium_large-height":513,"large":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-1280x855.jpg","large-width":1280,"large-height":855,"1536x1536":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-1536x1025.jpg","1536x1536-width":1536,"1536x1536-height":1025,"2048x2048":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-2048x1367.jpg","2048x2048-width":2048,"2048x2048-height":1367,"featured-soft":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-290x194.jpg","featured-soft-width":290,"featured-soft-height":194,"featured-hard":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-290x180.jpg","featured-hard-width":290,"featured-hard-height":180,"narrow":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-700x467.jpg","narrow-width":700,"narrow-height":467,"extended":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2025\/09\/mortenkromann2-990x661.jpg","extended-width":990,"extended-height":661}},"style":"narrow","text_placement":"metadata-below","image_link_url":"","image_link_title":"","caption_prefix":"","enable_alternative_caption":true,"alternative_caption":"\u00bbThe extremes are not just random statistics: They are concrete cases where an examiner can ruin a student\u2019s opportunities,\u00ab says Morten Kromann."},{"acf_fc_layout":"Content","content":"<p>He acknowledges that the variation among examiners is, in the bigger picture, smaller than the variation between students, but he still believes there should be more focus on the extremes.<\/p>\n<p>\u00bbThe extremes are not just random statistics: They are very specific cases where one examiner can ruin a student\u2019s opportunities. If we want to protect students, we have to focus on the individual extreme assessments and not just the averages. Of course, there will be differences between students. What needs to be ensured is that equal performances are assessed equally,\u00ab says Morten Kromann.<\/p>\n<p>He acknowledges that grading can never be an exact science, no matter how many measures are introduced.<\/p>\n<p>\u00bbThere will always be a degree of uncertainty in assessments, but I think we owe it to the students to minimise chance as much as possible,\u00ab he says.<\/p>\n<p>According to him, the problem is not just technical but also cultural: Grades are often treated as an objective and immutable measure of academic ability, even though they to a large extent reflect chance.<\/p>\n<p>\u00bbIt is an illusion to believe that a grade is an objective truth. As long as we hold on to that notion, nothing will change,\u00ab says Morten Kromann.<\/p>\n<p><em>This article was first written in Danish and published on 25 September 2025. It has been translated into English and post-edited by Mike Young.<\/em><\/p>\n"},{"acf_fc_layout":"ArticleEnd"},{"acf_fc_layout":"Newsletter","lang_select":"en","identifier":"Newsletter","headline":"Get an email with upcoming events and top University of Copenhagen events","button_text":"Sign up here","class":""},{"acf_fc_layout":"OtherStories","headline":"","hand_picked_posts":false,"references":false,"category":false,"theme":false,"number_of_posts":"4","style":"default"}]},"taxonomyData":{"category":[{"term_id":42,"name":"Education","slug":"education","term_group":0,"term_taxonomy_id":42,"taxonomy":"category","description":"","parent":0,"count":661,"filter":"raw"}],"post_tag":[],"post_format":[],"expression":[{"term_id":15,"name":"News Article","slug":"news_article","term_group":0,"term_taxonomy_id":15,"taxonomy":"expression","description":"","parent":0,"count":11485,"filter":"raw"}],"translation_priority":[{"term_id":5468,"name":"Optional","slug":"optional-en","term_group":0,"term_taxonomy_id":5468,"taxonomy":"translation_priority","description":"","parent":0,"count":671,"filter":"raw"}]},"featured_media_url":"https:\/\/uniavisen.dk\/wp-content\/uploads\/2024\/03\/0318emiliepaajurastudiet_web-1280x853.jpg","_links":{"self":[{"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/posts\/181720","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/users\/106"}],"replies":[{"embeddable":true,"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/comments?post=181720"}],"version-history":[{"count":11,"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/posts\/181720\/revisions"}],"predecessor-version":[{"id":181772,"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/posts\/181720\/revisions\/181772"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/media\/160934"}],"wp:attachment":[{"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/media?parent=181720"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/categories?post=181720"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/uniavisen.dk\/en\/wp-json\/wp\/v2\/tags?post=181720"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}