Monday, October 18, 2010
1:30 PM-5:00 PM
Abstract:
To conduct a comprehensive evaluation of e-learning requires a "triangulation" approach whereby multiple models and procedures are applied. Conducting comprehensive evaluations of e-learning in a timely and efficient manner is the focus of this tutorial. Why is evaluation of e-learning so important? Around the world, each month sees the introduction of many commercially produced or locally developed programs promoted as effective e-learning systems. Yet systematic evaluation of the implementation and efficacy of these systems is often lacking. This tutorial is specifically designed to establish evaluation as a key strategy throughout the design, development, and implementation of e-learning at all levels of education and training. Participants will be given access to an electronic performance support system (EPSS) designed to help educators evaluate e-learning.
Objectives:
Objectives:
Participants in this tutorial will learn how to implement models and procedures for evaluating e-learning at all levels of education and training. Tutorial participants will learn to develop, implement, and report specific plans, strategies, and tools for six major phases of the evaluation of e-learning:
1. review,
2. needs assessment,
3. formative evaluation,
4. effectiveness evaluation,
5. impact evaluation, and
6. maintenance evaluation.
Outline:
Topical Outline:
The following topics will be presented in this tutorial:
• Establishing a Rationale for Evaluating E-Learning
• Six Facets of Evaluation for E- Learning
• How to Prepare a Plan for Evaluating E-Learning
• Specific Strategies for Evaluating E-Learning
• Tools for Evaluating E-Learning
The tutorial includes presentations with actual case studies that are focused on a variety of e-learning evaluation strategies. After attending this tutorial, the participants will be able to perform the following tasks:
1. Describe different paradigms for evaluation in education and training.
2. Distinguish between:
a. assessment and evaluation;
b. internal and external evaluation;
c. intrinsic and extrinsic evaluation; and
d. formative and summative evaluation.
3. Implement six facets of evaluation for e-learning:
a. review;
b. needs assessment;
c. formative evaluation;
d. effectiveness evaluation;
e. impact evaluation; and
f. maintenance evaluation.
4. Outline an evaluation plan for various forms of e-learning.
5. Recognize the advantages and limitations of e-learning evaluation.
Prerequisites:
Designers, developers, and users of e-learning systems including computer-based training, distance education, interactive multimedia, and web-based learning environments.
Intended Experience Level:
Beginner
Instructor Qualifications:
Dr. Thomas C. Reeves is Professor Emeritus of Learning, Design, and Technology at The University of Georgia where he teaches program evaluation, multimedia design, and research courses. Since receiving his Ph.D. at Syracuse University, he has developed and evaluated numerous interactive multimedia programs for both education and training. In addition to numerous presentations and workshops in the USA, he has been an invited speaker in more than 30 other countries. In 1995, he was selected as one of the “Top 100” people in multimedia by Multimedia Producer magazine, and from 1997 - 2000, he was the editor of the Journal of Interactive Learning Research. In 2003, he was the first person to receive the AACE Fellowship Award from the Association for the Advancement of Computing in Education. His Interactive Learning Systems Evaluation book (co-authored with John Hedberg) was also published in 2003. Dr. Ikseon (Ike) Choi is an Associate Professor of Learning, Design, and Technology at the University of Georgia, where he teaches learning theories, learning environments design, and program evaluation courses. Since receiving his Ph.D. at Penn State University, he has led a series of research and development projects for case-based e-learning environments and real-world problem solving in both higher education and corporate settings. Through his multi-disciplinary collaborations with leading scholars in the areas of agricultural science, human medicine, veterinary medicine, teacher education, and engineering, he investigates effective ways of promoting and evaluating the development of learners’ real-world problem solving abilities. His research has been acknowledged by receiving the Outstanding Practices Awards from the Association of Educational Communications and Technology in 2005 and in 2007, respectively. He has been an invited speaker at national and international conferences, including E-Learn and Global HR Forum, and at various universities around the globe.