|
Published Date: 10/08/2007
 MEASURING E-LEARNING SUCCESS
By Will Thalheimer, Steve Wexler, Brent Schlenker, Bill Coscarelli, Margaret Martinez, Jim Ong, Roy Pollock, Allison Rossett, and Sharon Shrock
This Guild Research 360° Report is one of the most thorough we've ever published and deals with two fundamental issues that are at the core of learning endeavors:
When you test, are you truly able to show that someone has learned something; and, Are you able to show that your learning interventions benefit your organization?
If you’re flummoxed by the questions above, take comfort in knowing that you have a LOT of company! This research report shows that only 20% are able to do the measurement they want to do, and only 10.9% have data that shows that their measurement approach provides value to the organization. So, what is it that these 10.9% of survey respondents do differently from the other 89% that adds value to their organization? How do they measure learning and how do they show business impact? We will closely examine what these organizations do, as well as pick the collective brains of some extraordinary people to see how to conduct effective assessment and measurement on both the micro and macro levels.
In this section we review and analyze the over 900 responses we received from the Guild’s Measuring e-Learning Success survey. As of October 7, 2007, 2,740 members had told us which Testing and Assessment tools they use and this data forms the basis for our market share and satisfaction results. Key findings in this report include:Only 15.8% of respondents in heavily regulated industries are able to do the type of measurement they want to do
10.9% of respondents have data showing that their measurement approach provides very high value to their organizations
In comparing the practices of those who report that their measurement efforts have high value with those that don’t, we found that 56% of those reporting high value are able to do the type of measurement they want (vs. 20% for all Guild members)
We also found that 81% of those reporting high value meet with business line leaders and stakeholders BEFORE beginning work to define success criteria vs. 69% for all respondents
Aligning Measurement Methods with Measurement Goals
Will Thalheimer, President, Work-Learning Research
Point/Counterpoint: Line Leaders Versus Learning Professionals
Roy Pollock, Chief Learning Officer, Fort Hill Company and Will Thalheimer
What Does Fundamental Learning Research Tell us About Measurement?
Will Thalheimer
Measuring Learning: Evaluating Level II Assessments Within The eLearning Guild
Sharon Schrock, Professor of Instructional Design, and Bill Coscarelli, Professor of Instructional Design, Southern Illinois University Carbondale
Documenting Level III and IV Results in Real Time
Roy Pollock
Beyond Multiple Choice
Jim Ong, Group Manager, Stottler Hencke
Transforming the Field by Doing More and Better Measurement
Will Thalheimer
Mike Echols, Vice President of Strategic Initiatives, Bellevue University
Dorothy Martin, National Tuition Assistance Program Manager, Verizon Wireless
You'll find a comprehensive resource directory that includes Web sites, organizations, books, and examples you can use to continue your exploration of Measurement strategies. In addition, this report includes a Glossary of Terms related to Measurement. Finally, this report is completely indexed so you can actually use it as a reference resource.
|
|
|
|
|
