Innovative assessment methods and benefits/challenges when using them

Presentations and other oral/non-written assessments (group/individual presentation, discussion-debate, audio-video, role-play)

Benefits/motivation to use them:

• offer opportunities to engage students with learning, to develop communication skills and to simulate authentic situations not available with traditional written coursework and examinations. 
• Group presentations facilitating group working skills. 
• Oral assessment methods are likely to foster deep learning and lead to better engagement of students with assessment tasks. 
• A common theme was the notion of a public performance being particularly motivating (as well as scary) for students, and the idea of openness and interactivity in questioning leading to critical understanding. 
• Furthermore, students may be involved in the negotiation and setting of assessment criteria, as well as the marking of the presentations (democratising assessment or changing power relationships). 
• Students with special educational needs and from minority backgrounds are likely to perform better in these assessments than in more traditional written ones.

challenges/hindrances

• there is a call for clear criteria because of the subjectivity and unreliability of oral versus written assessment. 
• Students fear and apprehension before oral assessments are maybe scarier than other types of assessment. 
• The public aspect of oral assessments, such as presentations before peers, as crucial in fostering greater engagement with the task, but also in adding to the stress. 
• These types of assessment are likely to be very time-consuming and thus restricted to relatively small classes. 
• While it is trivially true that oral assessment methods are likely to improve oral communication skills more than written assessments, it does not follow that they will also engender deep learning, as was often claimed in the literature reviewed. It is likely that methods that allow more open dialogue (discussion and vivas) will do this better than more closed unidirectional methods (presentations). (p.35)

Portfolios and other unconventional writing assignments (learning journals, project documentation, diaries, reading logs and reflexive notebooks)


Benefits/motivation to use them:
The impetus to use portfolios, learning journals or diaries was related to principles of lifelong learning, active learning and in particular this form of assessment provided a place reflection on experience. This form of assessment was process driven and considered to foster metacognitive skills, self-directed learning and to
integrate learning.

challenges/hindrances:
clear criteria referenced frameworks are necessary to underpin the process. Some question the marking of portfolios and the inter-rater reliability of markers.


Assessment of groups and collaboration (students may work on projects leading to reports, posters and/or presentations)
Benefits/motivation to use them:

• group assessment is seen as helpful for developing learning skills or to instil in students the notion of a learning culture which is collaborative rather than competitive
• produce graduates who have transferable skills, including the ability to work in teams and collaborate
• Collaboration and group assessments may help students to see new perspectives and provide a fuller consideration of issues, helping them to develop their ability to understand, analyse and interpret. Self- and peerassessment is often seen within this context as helping students to reflect on their experiences of group work. And providing an assessment element may encourage participation in group tasks.

challenges/hindrances:

• Giving grades for group work was considered important if students were to take the task seriously
• how to allocate marks to groups and in what sense marks could be considered 'fair' for any individual student.
• how far group work might benefit weaker students or hinder brighter students, and whether that mattered. 
• The issue of what was being assessed, whether it was the product or the process or both, was considered and whether the skills needed to produce good group assignments were as valid as those that produce good individual work.

Student involvement in assessment (peer-self assessment)
Benefits/motivation to use them:

• empowering learners
• encouraging attention (relating to oral presentations), dialogue/creating
• partnerships, more proactive strategies in teachers and students,
• reflection
• enhancement of learning, performance, personal development/autonomy
• improvement of affect, student understanding of assessment, student understanding of criteria.

challenges/hindrances:

• the need for preparation and training for both students and teachers
• The need to create a supportive atmosphere to encourage students to air their concerns was also identified. 
• Time allocated to the implementation and experience in carrying it out were also seen as important (the implementation is time-consuming)

Use of new technology in assessment (where assessment is mediated through or delineated by the

technological medium)
examples of this category include: multiple choice type assessment and its variants, computer mediated communication in the form of discussion boards and possible collaborative work by students, and the ways that could be incorporated into assessments, the creation of a website as an assessment, submission of assessment using multimedia.

Emerging themes from the use of new technology in assessment:

• opens the dialogue about assessment and learning
• highlights the importance of feedback and the desirability of swift feedback for a positive effect on learning
• emphasises the value of aligning assessment with learning outcomes
• highlights the importance of staff familiarity with the medium and the possible provision of training and support
• highlights the importance of feedback, support and facilitation for students, including the provision of opportunities to practise assessment tasks
• emphasises the resource implications and the often ‘front loaded’ nature of introducing technologically based assessment.
• highlights the use of computer-medicated communication and collaborative work as a resource base for assessment.
• the value of ICT in diagnostic testing
• creative possibilities in assessment such as web page design
• the need to design assessment to minimise risk.

implications:

• alignment of assessment to learning outcomes
• clarity of purpose of assessment
• the importance of clear and transparent assessment and marking criteria
• the need for adequate resource to establish electronic assessment
• acknowledgement that the design and implementation of assessment using the electronic medium is often ‘front loaded’ and has implications for staff workload and for student support as it is implemented for the first time
• the need for training of both staff and students in the use of electronic assessment and feedback and the management of the ensuing dialogue about learning.

Conclusion:

Apart from some of the work on the use of ICT to allow students to present their work in the form of a website, it can be seen that although the use of technology may be innovative in assessment, the type of assessment being used may not be so.

What guidance and feedback is given, by what means, and when (This theme concerns innovation in the provision of guidance from tutors about expectations for assessed work, and in the generation and provision of feedback to students (in the form of comments and marks, grades or criterion specific ratings) on the quality of the work they have submitted. Guidance and feedback are generally seen as central to the important formative function of assessment, which is crucial in helping students to achieve high-quality learning outcomes)

Benefits/motivation to use them:

• widespread evidence of dissatisfaction on the part of many students with provision of feedback and guidance
• teacher concerns that some students at least seemed to show little interest in engaging with or even scrutinising feedback comments.

References:
Hounsell, D., Blair, S., Falchikov, N., Hounsell, J., Huxham, M., Klampfleitner, M. and Thomson, K. (2007). Innovative Assessment Across the Disciplines: An Analytical Review of the Literature. Final Report. York: Higher Education Academy (HEA).