Tip:
Highlight text to annotate it
X
This video was produced for the Queensland VET Development Centre.
Case Study: Audio Assessment Technology: Interactive Flash application
Brisbane North Institute of TAFE
Meha and Rajesh have both completed a Certificate III in Tourism. Both have been assessed as
competent by their Registered Training Organisations. But when these two learners with the same
qualification go out into the workplace and are confronted with an angry customer, their
responses are very different
Meha has practiced in class and did quite well in the practice sessions with other students.
But in a real life scenario, the upset customer intimidates her into silence.
Rajesh on the other hand has practiced this scenario many times - not with other students,
but by responding in real time to the angry tirade of a virtual customer. His assessor
provided nearly instant feedback and he was able to adjust his performance and try again.
Why audio assessment?
In a classroom role-play situation, learners have time to think about and plain their responses
and are working with people who they know.
In the real world, tourism graduates are dealing with strangers who expect immediate answers
and solutions.
Overall assessment strategy.
Voice over of Peter Rutherford, Learning Advisor, Brisbane North Institute of TAFE: The key
to this assessment item is in the delivery of the scenarios and the capturing of the
student responses. Once the learner has watched each video stimulus,
they've only seconds to prepare and deliver their responses - just as they would have
to in the real world. The teacher can quickly establish how well
each student performs. They can download the students' responses from a server and check
their performance against the rubric.
This innovative approach to assessment is part of an overall assessment strategy that
includes self-assessment review tools, individual assessment task and a project.
Tools and technologies.
There are several technologies that the Brisbane North Institute of TAFE are using.
For the scenarios response, they are developing an in-house Flash tool that records student
responses including pauses and response times. For other parts of the assessment process,
they are making use of text-based tools like discussion forums, wikis and Moodle’s workshop
module as well as live text chat.
From phones to voice over internet tools and recorders, the technologies that support audio
in assessment come into play at just about every stage of the Assessment process when
working with hearing people.
Lessons learned.
On the limitations side of the equation, the tool was expensive to develop. Like most RTOs,
Brisbane North Institute of TAFE doesn’t have in house expertise in Flash development.
As well, Flash as a technology is being phased out. So eventually, the tool will need to
be redeveloped.
However the benefits are outstanding. This is authentic assessment - that replicates
real-life scenarios and is moderated by industry. Plus, it is easy for both students and educators
to use.
Principles of assessment and Rules of Evidence.
By allowing students opportunities to practice, providing for flexibility in how assessment
can be undertaken, providing a tool that performs consistently and opening up to industry moderation,
Brisbane North Institute of TAFE has ticked all the boxes for Principles of Assessment.
The rules of evidence are also satisfied, as there are a range of real-life situations,
the assessor gets to know the students and their voices and can tell when the assessment
was undertaken, industry is involved and the audio assessment is one part of a larger assessment
process.
Thanks to Peter Rutherford and his team at Brisbane North Institute of TAFE for sharing
their case study.
This is one example of audio based evidence using a custom built system. But many other
options are available to capture audio evidence such as mobile phones, voice recorders and
webinars. Audio can be used for a range of assessments including interviews, practices
for presentations and role plays. We invite you to explore the range of options and the
other types of eAssessment you can use. V
This case study video is one of five illustrating the use of eAssessment, produced for the Queensland
VET Development centre. The others are: Text-based assessment; Social and collaborative assessment;
Visual assessment and Simulations.
To get the most out of your learning experience, explore the web site located at evet.qld.edu.au.
There you can: watch the other case study videos; download more detailed information
about this and the other case studies; watch the advancing practice series videos introducing
the various types of assessment; and, share your insights and questions with other learners
in the discussion area.