Measurement Demystified Field Guide

Peggy Parskey, Vance David

Description

The Bridge to Your L&D Measurement and Reporting Strategy

Building measurement skills is critical for talent development professionals who seek to align their L&D programs to business outcomes for organizational success. Designed to improve your measurement capability and advance the measurement maturity of your organization, the Measurement Demystified Field Guide presents a refresher on the talent development reporting principles framework and measurement strategy. While the Field Guide serves as a standalone volume, it is also a companion to the authors’ first book, Measurement Demystified.

In an easy-to-use workbook style, the Field Guide provides nearly 100 skill-building exercises of varying types to help you uncover what measurement work your organization is doing; assess organizational maturity and gaps; understand how to apply specific concepts; and determine what’s right for your organization moving forward. It also offers interview questions to better understand users’ wants and needs; case study exercises to test your knowledge gaps; and reflection questions that focus on your deepening knowledge and skill. You can write your answers in the book or use the resource on ATD’s website.

Achieving measurement maturity is a change effort requiring commitment and discipline. Understanding your current capabilities and gaps is an essential first step followed by determining where your organization wants to go in this area. Once both are achieved, you will be able to develop your desired measurement and reporting strategy—the bridge between where you are today and where you aspire to be. The Measurement Demystified Field Guide is that bridge.

Sujets

• Sciences formelles
• Mathématiques appliquées
• Mathématiques appliquées
• Efficacité professionnelle
• Efficacité
• Business
• Economics
• Training
• Employabilité, métiers et formations

Informations

• Publié par: Association for Talent Development
• Date de parution: 28 décembre 2021
• Nombre de lectures: 0
• EAN13: 9781952157691
• Langue: English
• Poids de l'ouvrage: 2 Mo

Extrait

Praise for Measurement Demystified Field Guide
“This book is designed to help L&D professionals advance their skills in an area where many fear to tread: measurement. It focuses on applying the Talent Development Reporting principles (TDRp) so L&D can bridge the communication gap that exists when explaining the true value and impact of development efforts to business leaders. If Measurement Demystified explains what the principles are and why they are important, the Measurement Demystified Field Guide explains how to use them. This is where practical insights are delivered and skill-building occurs. As a soup-to-nuts guide, professionals will likely need a second, unused copy to share with colleagues.”
—John R. Mattox, Sr. Principal, Sales Engineer, TalentNeuron, Gartner
“Peggy and Dave have hit the mark, yet again. Their new book, Measurement Demystified Field Guide offers thought-provoking and actionable exercises that will move any reader’s measurement practice forward.”
—Patti P. Phillips, CEO, ROI Institute
“ Measurement Demystified Field Guide aims to help increase your organization’s capability and capacity to improve its overall performance. Think of it as a coach—it uses templates and reflective exercises to break down processes into simple and doable chunks of work to help you build and expand your measurement muscle and expertise.”
—Kimo Kippen, Founder, Aloha Learning Advisors; Former CLO, Hilton
“My copy of Measurement Demystified Field Guide is already dog-eared and shopworn on my desk. It offers clear case studies, suggestions and opportunities to reflect on the practices that will help make L&D a greater contributor to business success.”
—Cushing Anderson, Vice President for IT Education and Skills Research, IDC

© 2022 ASTD DBA the Association for Talent Development (ATD)
All rights reserved. Printed in the United States of America.
25 24 23 22          1 2 3 4 5
No part of this publication may be reproduced, distributed, or transmitted in any form or by any means, including photocopying, recording, information storage and retrieval systems, or other electronic or mechanical methods, without the prior written permission of the publisher, except in the case of brief quotations embodied in critical reviews and certain other noncommercial uses permitted by copyright law. For permission requests, please go to copyright.com , or contact Copyright Clearance Center (CCC), 222 Rosewood Drive, Danvers, MA 01923 (telephone: [phone]; fax: [phone]).
ATD Press is an internationally renowned source of insightful and practical information on talent development, training, and professional development.
ATD Press
1640 King Street
Alexandria, VA 22314 USA
Ordering information: Books published by ATD Press can be purchased by visiting ATD’s website at td.org/books or by calling 800.628.2783 or 703.683.8100.
Library of Congress Control Number: 2021948346
ISBN-10: 1-952157-68-4
ISBN-13: 978-1-952157-68-4
e-ISBN: 978-1-952157-69-1
ATD Press Editorial Staff
Director: Sarah Halgas
Manager: Melissa Jones
Content Manager, Learning & Development: Eliza Blanchard
Developmental Editor: Kathryn Stafford
Production Editor: Hannah Sternberg
Text Design: Shirley E.M. Raybuck
Cover Design: Rose Richey
Printed by Color House Graphics, Grand Rapids, MI
T O THOSE IN OUR FIELD WHO USE MEASUREMENT, ANALYTICS, AND REPORTING ON A DAILY BASIS TO DELIVER GREATER ORGANIZATIONAL VALUE AND MAKE A DIFFERENCE IN PEOPLE’S LIVES.
Contents
List of Figures
List of Tables
Acknowledgments
Introduction
Part 1. The TDRp Framework
1. Reasons to Measure
2. Three Types of Measures
3. Five Types of Reports
Part 2. Creating Your Measurement and Reporting Strategy
4. Planning Your Strategy
5. Selecting Measures
6. Selecting and Creating Reports
7. Plans, Results, and Forecasts
8. Putting It All Together
Appendixes
A. Case Study: Electronic Specialty Products
B. Example Reporting and Measurement Strategy
C. Answer Key for Chapter Exercises
Index
About the Authors
Figures
Figure I-1. Chapter Layout
Figure 1-1. The Complete TDRp Framework
Figure 1-2. Reasons to Measure
Figure 2-1. TDRp Framework
Figure 2-2. HC BRidge Framework
Figure 2-3. Taxonomy of Efficiency Measures for Formal Learning
Figure 2-4. Effectiveness Measurement Hierarchy Comparison
Figure 2-5. Four Categories of Outcome Measures
Figure 3-1. TDRp Framework
Figure 3-2. Example of a Dashboard
Figure 3-3. Sample Management Report
Figure 3-4. Three-Slide PowerPoint Program Evaluation Report
Figure 3-5. Custom Analysis Report Example
Figure 3-6. Example of a Strategic Program Report
Figure 3-7. Example of a More Complex Program Report
Figure 3-8. Example of a Non-Strategic Program Report
Figure 3-9. Sample Operations Report
Figure 3-10. Sample Summary Report
Figure 4-1. We Can Observe What and How Organizations Report
Figure 4-2. Eight Dimensions of Measurement Maturity
Figure 4-3. Three Waves of TDRp Implementation
Figure 4-4. Wave 1 Dimensions to Implement
Figure 4-5. Wave 2 Dimension to Implement
Figure 4-6. Wave 3 Dimensions to Implement
Figure 4-7. Elements of a Strategy
Figure 4-8. Steps to Create Your Strategy
Figure 4-9. Example Interview Synthesis
Figure 5-1. TDRp Framework
Figure 6-1. Dashboard Layout Options
Figure 6-2. Components of a Program Evaluation Report
Figure 6-3. Components of a Custom Analysis Report
Figure 7-1. Reporting YTD Results in a Program Report
Figure 7-2. Sample Summary Report Showing YTD Results for Outcome Measures When Outcome Data Are Available
Figure 7-3. Sample Summary Report Showing Comparison of YTD Results to Plan for Outcome Measures When Outcome Data Is Not Available
Figure 7-4. Sample Summary Report With Alternative Comparison of YTD Results to Plan for Outcome Measures
Figure 7-5. Sample Summary Report Showing Comparison of YTD Results to Plan for Qualitative Outcome Measures
Figure 7-6. Graph of Data to Uncover Seasonality
Figure 7-7. Sample Summary Report With Quantitative Outcome Measures
Figure 7-8. Forecast Outcome Measures When YTD Results Are Not Available
Figure 7-9. Sample Summary Report With Qualitative Outcome Measures
Figure 7-9. Sample Summary Report With Qualitative Outcome Measures
Figure 8-1. Elements of a Measurement & Reporting Strategy
Figure 1. Benefits of a Measurement and Reporting Strategy
Figure 2. TDRp Framework for Measurement and Reporting
Figure 3. Sample Report for a Strategic Program
Figure 4. Sample Report for a Non-Strategic Program
Figure 5. Sample Operations Report
Figure 6. Sample Summary Report
Tables
Table I-1. Interaction of Practitioner’s Expertise and Organizational Measurement Maturity
Table I-2. Mapping Measurement Demystified Field Guide to Measurement Demystified
Table 2-1. Common Efficiency Measures
Table 2-2. Common Effectiveness Measures
Table 2-3. Comparison of Quantitative and Qualitative Measures
Table 3-1. Reports by Measurement Purpose
Table 3-2. Example of a Simple Scorecard
Table 3-3. Example of a Scorecard With Thresholds
Table 3-4. Mapping Management Report Type to the Type of Program
Table 4-1. Mapping Strategy Elements to Chapters in the Field Guide
Table 5-1. Selecting Measures for Strategic Programs
Table 5-2. Selecting Measures for Non-Strategic Programs
Table 5-3. Examples of Recommended Measures Table (Organized by Program)
Table 5-4. Example of Recommended Measures Table (Organized by Measure)
Table 5-5. Example of Recommended Measures Matrix
Table 5-6. Sample Data Sources
Table 5-7. Example of a Measures Library
Table 5-1. Selecting Measures for Strategic Programs
Table 5-2. Selecting Measures for Non-Strategic Programs
Table 5-3. Examples of Recommended Measures Table (Organized by Program)
Table 5-4. Example of Recommended Measures Table (Organized by Measure)
Table 5-5. Example of Recommended Measures Matrix
Table 5-6. Sample Data Sources
Table 5-7. Example of a Measures Library
Table 6-1. Mapping of Reasons to Measure to Recommended Reports
Table 6-2. Sample Report List With User and Frequency
Table 6-3. Layout of a Simple Scorecard
Table 6-4. Layout of a Simple Scorecard With Period Summaries
Table 6-5. Layout for a Scorecard to Monitor
Table 6-6. Mapping Management Report Type to Type of Program
Table 7-1. Guidance for Creating Plans for Efficiency and Effectiveness Measures in Program Reports
Table 7-2. Example of Seasonality in the Number of Total Participants
Table 7-3. Example of Seasonality Showing Cumulative Percentage
Table 8-1. Summary of L&D Programs, Initiatives, and Research Studies
Table 1. Users and Their Needs
Table 2. 2022 Programs and Initiatives for L&D
Table 3. Summary of Measures by Type, Program, and Initiative
Table 4. Specific Measures by Program
Table 5. Specific Measures by Initiative
Table 6. Additional Measures to Be Aggregated Across All Programs and Courses
Table 7. Reporting Framework for 2022
Table 8. Plans to Create and Distribute Regular Reports
Table 9. Sources for the Measures
Table 10. Sampling and Surveying Strategy
Table 11. Resource Requirements for FY2022
Table 2. 2022 Programs and Initiatives for L&D
Table 3. Summary of Measures by Type, Program, and Initiative
Table 4. Specific Measures by Program
Table 5. Specific Measures by Initiative
Table 6. Additional Measures to Be Aggregated Across All Programs and Courses
Table 7. Reporting Framework for 2022
Table 8. Plans to Create and Distribute Regular Reports
Table 9. Sources for the Measures
Table 10. Sampling and Surveying Strategy
Table 11. Resource Requirements for FY2022
Table 6. Additional Measures to Be Aggregated Across All Programs and Courses
Table 7. Reporting Framework for 2022
Table 8. Plans to Create and Distribute Regular Reports
Table 9. Sources for the Measures
Table 10. Sampling and Surv