{"id":70,"date":"2018-11-14T14:47:02","date_gmt":"2018-11-14T14:47:02","guid":{"rendered":"http:\/\/blogs.sussex.ac.uk\/business-school-teaching\/?p=70"},"modified":"2018-11-14T14:47:02","modified_gmt":"2018-11-14T14:47:02","slug":"is-the-time-of-the-assessed-essay-over","status":"publish","type":"post","link":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/2018\/11\/14\/is-the-time-of-the-assessed-essay-over\/","title":{"rendered":"Is the \u2018time of the assessed essay\u2019 over?"},"content":{"rendered":"<h3><img loading=\"lazy\" class=\"alignnone wp-image-72\" src=\"http:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-1024x683.jpg\" alt=\"\" width=\"600\" height=\"400\" srcset=\"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-1024x683.jpg 1024w, https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-300x200.jpg 300w, https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-768x512.jpg 768w, https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-100x67.jpg 100w, https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-150x100.jpg 150w, https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-200x133.jpg 200w, https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-450x300.jpg 450w, https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-600x400.jpg 600w, https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/files\/2018\/11\/Essays-900x600.jpg 900w\" sizes=\"(max-width: 600px) 100vw, 600px\" \/><\/h3>\n<h3>By Phil Race<\/h3>\n<p>Let me say at the outset that in many disciplines, there are few problems caused by assessed essays \u2013 they may not even be used at all. Before 1791 when it is said that the University of Cambridge introduced the first unseen written examinations to Britain, assessment used to be mostly oral, with face-to-face questioning of students about what they knew and didn\u2019t know. There are many advantages of oral assessment \u2013 not least the ability to use \u2018probing\u2019 questions to delve deeper into what students can do. Questions such as the following can give us far deeper information about the student\u2019s knowledge status:<\/p>\n<ul>\n<li>Why do you think this is the strongest reason?<\/li>\n<li>What else could cause this?<\/li>\n<li>What do you think is the main weakness of Blogg\u2019s theorem?<\/li>\n<\/ul>\n<p><!--more--><\/p>\n<p>Face-to-face we have all the advantages of tone of voice, body language, facial expression, gesture, eye-contact, (all important in everyday human communication) to bring to bear both on asking questions and judging students\u2019 answers. Just about all of these dimensions are completely missed with written answers. And there\u2019s already lots of research showing that with handwritten answers factors such as legibility matter a great deal, despite this having ever-decreased significance in the everyday world around us.<\/p>\n<p>I caused a bit of a stir back in September 2018 when I published in THE a short piece about dropping assessed coursework essays. This was prompted by recent publicity about online essay mills. Phil Newton\u2019s\u00a0<a href=\"https:\/\/www.frontiersin.org\/articles\/10.3389\/feduc.2018.00067\/full\">recent research<\/a>\u00a0on the extent of \u201ccontract cheating\u201d in the academy makes for sobering reading. Based on recent surveys, Newton, director of learning and teaching at\u00a0<a href=\"https:\/\/www.timeshighereducation.com\/world-university-rankings\/swansea-university\">Swansea University<\/a>\u00a0Medical School, concludes that as many as one in seven recent graduates across the world may have submitted assessed essays that someone else wrote. But of course here we\u2019re thinking about <em>coursework <\/em>essays \u2013 are essays in exams safe?<\/p>\n<p>Back in 2014 I published a table about the \u2018status of essays\u2019 and \u2018disadvantages of essays\u2019 relating both to coursework and exams. The status of essays against the criteria of validity, fairness (reliability), whodunit?, real-world relevance and feedback to students fares badly.<\/p>\n<ul>\n<li><strong>Validity:<\/strong> rarely good (prose which comes out of a pen in an exam, or through a keyboard in coursework, is rarely the best way of measuring evidence of achievement of intended outcomes).<\/li>\n<li><strong>Fairness:<\/strong> poor (a great deal of research evidence is available showing that different markers award very different marks for the same essay).<\/li>\n<li><strong>Whodunit?<\/strong> very unsafe, except for essays under exam conditions. Coursework essays can be commissioned and purchased online from well-practised, skilled writers! That said, concerns about Whodunit? regarding coursework essays may be relatively minimal with small groups of students, where tutors regularly talk to students and would usually quickly know if submitted work was not their own.<\/li>\n<li><strong>Real world:<\/strong> not close to the sorts of writing relevant to most careers.<\/li>\n<li><strong>Feedback to students:<\/strong> can be useful, but usually comes too late, not least because of the length of time it takes to mark a set of essays. There is usually no feedback at all on essays handwritten in exams.<\/li>\n<\/ul>\n<p>Setting aside the dangers of contract cheating, <strong>ten disadvantages of assessed essays<\/strong> can be summed up as follows:<\/p>\n<ol>\n<li>Essays take forever to mark, and marking is unreliable (unfair) anyway, as proved by a great deal of research!<\/li>\n<li>Tends to advantage students who are good at written \u2018waffling\u2019!<\/li>\n<li>Unless there are tight word-limits, a longer essay will usually score higher than a shorter one.<\/li>\n<li>Where there is an element of choice (e.g. coursework essays) some choices may prove harder to bring off in practice than others, disadvantaging some students.<\/li>\n<li>In coursework essays, there can be a tendency to copy in (suitably rephrased) sentences from literature sources, without really thinking about the meaning of the elements copied in.<\/li>\n<li>Spelling, punctuation and grammar may disproportionately affect marking.<\/li>\n<li>\u2018Coherence\u2019, flow, ease of reading essays disproportionately influences most markers. A \u2018smooth\u2019 essay is usually awarded higher marks than a \u2018jerky\u2019 one, even if the content of the latter is much better.<\/li>\n<li>Where essays are handwritten in exams, it is not at all easy for students to edit and adjust along the way, e.g. to go back and rephrase the start of the essay appropriately after the main thrust has been addressed.<\/li>\n<li>Handwritten essays in exams are subject to concerns about measuring \u2018what comes out of a pen\u2019 rather than \u2018what\u2019s in a head\u2019, and are subject to the effects of speed of writing, legibility and so on.<\/li>\n<li>Handwriting an essay in an exam is quite a different game than composing a word-processed coursework essay, so coursework is poor preparation for the exam experience, and feedback on coursework essays may not help exam candidates.<\/li>\n<\/ol>\n<p>What may be the <strong>advantages of using assessed essays<\/strong>? In 2015 I suggested the following are included:<\/p>\n<ul>\n<li><em>Essays allow for student individuality and expression.<\/em> They are a medium in which the \u2018best\u2019 students can distinguish themselves. This means, however, that the marking criteria for essays must be flexible enough to be able to reward student individuality fairly.<\/li>\n<li><em>Essays can provide students with opportunities to demonstrate their own particular \u2018take\u2019 on a topic.<\/em> While this may be an advantage, it is also a disadvantage in that it can turn out to be particularly troublesome to <em>assess<\/em> students\u2019 own \u2018take\u2019 fairly and without prejudice.<\/li>\n<li><em>Essays can reflect the depth of student learning.<\/em> Writing freely about a topic is a process which can demonstrate understanding and grasp of the material involved.<\/li>\n<li><em>Essay-writing is a measure of students\u2019 written style.<\/em> It is useful to include good written communication somewhere in the overall assessment strategy. The danger of students in science disciplines, where essays are used less, missing out on the development of such skills is becoming increasingly recognised.<\/li>\n<li><em>Students are relatively familiar with essays.<\/em> They\u2019ve normally done this sort of writing beforehand, but assessors at university level justifiably grumble that students don\u2019t seem to have had any real training in structuring essays, particularly when it comes to logical argument and coming to a resounding conclusion.<\/li>\n<\/ul>\n<p>But I also redeveloped the <strong>disadvantages:<\/strong><\/p>\n<ul>\n<li><em>The assessment of essays is well proven to be unreliable.<\/em> Different markers often award the same essay quite different marks, and students are quick to notice such unfairness. Essays are demonstrably the form of assessment where the dangers of subjective marking are greatest. Essay-marking exercises at workshops on assessment show marked differences between the mark or grade that different assessors award the same essay \u2013 even when equipped with clear sets of assessment criteria.<\/li>\n<li><em>The validity of essays as an assessment device remains questionable.<\/em> Students\u2019 knowledge of the subject is only tested to a limited extent, and technique for essay-writing is tested rather better sometimes.<\/li>\n<li><em>Essay-writing is very much an art in itself.<\/em> Students from some backgrounds are disadvantaged regarding essay-writing skills as they have simply never been coached in how to write essays well. For example, a strong beginning, a coherent and logical middle, and a firm and decisive conclusion combine to make up the hallmarks of a good essay. The danger becomes that when essays are over-used in assessment strategies, the presence of these hallmarks is measured time and time again, and students who happen to have perfected the art of delivering these hallmarks are repeatedly rewarded irrespective of any other strengths and weaknesses they may have.<\/li>\n<li><em>Essays take a great deal of time to mark.<\/em> Even with well thought out assessment criteria, it can be difficult to \u2018get into one\u2019s stride\u2019 applying a marking scheme, and it is not unusual for markers to need to work back through the first dozen or so of the essays they have already marked, as they become aware of the things that the best students are doing with the questions, and the difficulties experienced by other students.<\/li>\n<li><em>\u2018Halo effects\u2019 are significant.<\/em> If the last essay answer you marked was an excellent one, you may tend to approach the next one with greater expectations, and be more severe in your assessment decisions based upon it.<\/li>\n<li><em>Essays take time to write (whether as coursework or in exams).<\/em> This means that assessment based on essay-writing necessarily is restricted regarding the amount of the syllabus that is covered directly. There may remain large untested tracts of syllabus.<\/li>\n<li><em>With coursework essays, it is increasingly difficult to guarantee that the essay is the work of the candidate.<\/em> Ready-made essays can be purchased online on just about any subject, or even directly commissioned. Plagiarism is always a possibility, and there is the need to check authenticity by some other means, such as face-to-face questioning to guarantee that the work is the students\u2019 own. This adds even more time to what is already a high-burden kind of assessment.<\/li>\n<li><em>Traditional ways of giving students feedback on essays are known to be problematic, and rarely worth the time taken.<\/em> Writing comments on students\u2019 work is particularly troublesome, in that it is well known that students don\u2019t often make good use of the feedback, not least because it often arrives too late, when they\u2019ve already moved on in their studies. Using the comments function in word-processing \u2018track-changes\u2019 can be much better, however.<\/li>\n<\/ul>\n<p><strong>So what am I saying overall? <\/strong>That as an assessment device, essays are unsafe and far too time-consuming for everyone involved. Contract cheating and the work of essay mills is not confined to essays however. Just about any form of submitted written product can be involved, including post-graduate and doctoral theses, so just banning the use of essays is only a first step perhaps. Let me however emphasise that I\u2019m not saying we shouldn\u2019t help students to become good at writing essays \u2013 and indeed give students feedback on their developing skills at writing essays. Just that it shouldn\u2019t contribute to assessment.<\/p>\n<p>&nbsp;<\/p>\n<p>(Phil Race\u00a0is a writer and speaker on assessment, feedback, teaching and learning in higher education. He is a visiting professor at Edge Hill and Plymouth universities and emeritus professor at\u00a0Leeds Beckett University).<\/p>\n<p><strong>References<\/strong><\/p>\n<p>Newton, P. <a href=\"https:\/\/www.frontiersin.org\/articles\/10.3389\/feduc.2018.00067\/full\">https:\/\/www.frontiersin.org\/articles\/10.3389\/feduc.2018.00067\/full<\/a><\/p>\n<p>Race, P. (2014) <em>Making Learning Happen: 3<sup>rd<\/sup> edition, <\/em>London: Sage.<\/p>\n<p>Race, P. (2015) <em>The Lecturer\u2019s Toolkit: 4<sup>th<\/sup> edition, <\/em>London: Routledge.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>By Phil Race Let me say at the outset that in many disciplines, there are few problems caused by assessed essays \u2013 they may not even be used at all. Before 1791 when it is said that the University of<span class=\"ellipsis\">&hellip;<\/span><\/p>\n<div class=\"read-more\"><a href=\"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/2018\/11\/14\/is-the-time-of-the-assessed-essay-over\/\">Read more &#8250;<\/a><\/div>\n<p><!-- end of .read-more --><\/p>\n","protected":false},"author":255,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[250],"tags":[],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/parRft-18","_links":{"self":[{"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/posts\/70"}],"collection":[{"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/users\/255"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/comments?post=70"}],"version-history":[{"count":4,"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/posts\/70\/revisions"}],"predecessor-version":[{"id":75,"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/posts\/70\/revisions\/75"}],"wp:attachment":[{"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/media?parent=70"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/categories?post=70"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/business-school-teaching\/wp-json\/wp\/v2\/tags?post=70"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}