Evaluating Interactive Learning
Thomas C. Reeves
Professor of Instructional Technology, University of Georgia
Mary Marlino
Director of the University Corporation for Atmospheric Research, Boulder,
Colorado
Ms Marlino was previously Director of Educational Technology and Associate
Professor of Instructional Technology at the United States Air Force Academy.
Objectives/Outcomes:
Participants in this tutorial will learn how to implement specific models
and procedures for evaluating interactive learning at all levels of education.
The content of the tutorial includes specific plans, strategies, and tools
for all four major facets of evaluating interactive learning, including:
-
documentation evaluation
-
formative evaluation
-
effectiveness evaluation, and
-
impact evaluation.
Content:
The following topics will be presented in this tutorial:
-
Establishing a Rationale for Evaluating Interactive Learning
-
Four Facets of Evaluation for Interactive Learning
-
How to Prepare a Plan for Evaluating Interactive Learning
-
Specific Strategies for Evaluating Interactive Learning
-
Tools for Evaluating Interactive Learning
-
Reporting Evaluations for Maximum Effect
-
Ten Commandments for Evaluating Interactive Learning
In addition, participants will be provided with copies of an electronic
performance support system (EPSS) designed to help educators evaluate interactive
learning.
Overview:
The tutorial will include presentations, demonstrations, and hands-on activities
with a variety of evaluation strategies. After attending this tutorial,
the participants will be able to perform the following tasks:
1. Describe different paradigms for evaluation in education and training.
2. Compare and contrast various evaluation "models."
3. Distinguish between:
a. assessment and evaluation;
b. internal and external evaluation;
c. intrinsic and extrinsic evaluation; and
d. formative and summative evaluation.
4. Implement four facets of evaluation for interactive learning:
5. Write an evaluation plan for various forms of interactive learning.
6. Evaluate interactive learning in a variety of practical situations.
7. Analyse the data collected during an evaluation.
8. Report an evaluation of interactive learning for maximum impact.
Importance:
A comprehensive approach to evaluating interactive learning requires multiple
approaches. No single evaluation strategy can provide the complete picture
of the effectiveness and impact of interactive learning. To conduct a comprehensive
evaluation of interactive learning requires a "triangulation" approach
whereby multiple models and procedures are applied. Conducting comprehensive
evaluations of interactive learning
in a timely and efficient manner is the focus of this tutorial.
Why is evaluation of interactive learning so important?
Around the world, each month sees the introduction of more and more commercially
produced or locally developed software packages promoted by their developers
as effective learning systems. Yet systematic evaluation of the implementation
and efficacy of these systems is sadly lacking. This tutorial is specifically
designed to establish evaluation as a key strategy throughout the design,
development, and implementation of interactive learning at all levels of
education.
Intended Level of Presentation:
Designers and developers of interactive learning systems including computer-based
training, interactive multimedia, and instructional applications of the
World Wide Web.
Max./Min. Number of Participants:
15-100