Designing a Training Metrics Framework That Spans the Entire Learning Lifecycle — A U.S. Census Bureau Case Study

Most L&D organizations measure something — but few measure systematically. Selecting the right metrics, gathering them from the right sources, and presenting them in ways that resonate with stakeholders are three very different challenges. This session tackles all three.

We'll share how the U.S. Census Bureau — an organization for which measurement is quite literally a core mission — built a comprehensive training performance measurement framework spanning the full spectrum of learning activity: engagement and completion metrics, assessment performance data, and on-the-job performance indicators drawn from operations. Attendees will learn how to think about metric selection across that spectrum (heavily influenced by the Learning Transfer Evaluation Model, LTEM), what's realistically achievable with SCORM-based systems, how to partner with operations teams to access on-the-job data, and how stakeholder management can make or break even the best measurement program.

Whether you're starting from scratch or looking to mature your existing approach, this session offers a practical, proven model you can adapt for your own organization. 

This session presents a real-world case study from the U.S. Census Bureau's decennial training program, one of the largest and most logistically complex training operations in the federal government. Attendees will hear about how we approached this multi-faceted project:

Metric selection: How to build a comprehensive measurement model covering learning engagement metrics (completions, time-on-task, drop-off rates), assessment performance (pre/post scores, item analysis, pass rates), and on-the-job performance indicators (productivity, accuracy, supervisor ratings)

Feasibility and tooling: What SCORM can and can't deliver — and how we designed around its limitations to maximize the data you can capture

Cross-functional data access: How the Census Bureau worked with its operations organization to obtain and integrate workforce performance data, and the relationship-building required to make that work

Stakeholder management: How to frame measurement results for different audiences — from training managers to senior executives — and why communication strategy is as important as the data itself

While the Census Bureau's culture of measurement rigor makes it an ideal case study,  its lessons translate directly to any large-scale training operation where accountability and performance outcomes are under scrutiny.