← All articles

Why Good Six Sigma Projects Die at the Data-Collection Plan

By XNM Technologies · November 19, 2021 · 3 min read
Why Good Six Sigma Projects Die at the Data-Collection Plan

Most failed Six Sigma projects do not fail in the dramatic phases. They fail quietly, back in Measure, when the team writes a sloppy data-collection plan and then spends the rest of the project defending numbers nobody trusts. Analyse, Improve and Control all stand on the data you gather; if that foundation is cracked, every conclusion downstream is suspect. After eighteen months of disrupted supply chains and patched-together processes, this matters more than usual, because the 'before' picture many teams are measuring is itself unstable.

A data-collection plan is simply a clear, written agreement about what you will measure, how, by whom, and over what period, settled before a single data point is gathered. It is the bridge between defining the problem and analyzing it. Skipping it, or improvising it, is where good DMAIC projects start to rot.

The mistakes that quietly wreck the plan

  1. Measuring what is easy instead of what matters. Teams gravitate to data the system already spits out, even when it only loosely relates to the problem. Start from the question you need to answer, then find or build the measure, not the other way around.

  2. Vague operational definitions. If two people can record the same event differently, your data is noise. 'Defect', 'on time' and 'complete' each need a precise, written definition so that everyone counts the same thing the same way.

  3. Ignoring measurement-system error. Before trusting the numbers, confirm the measurement system itself is reliable. A quick Gauge R&R or attribute agreement check reveals whether variation is real or just inconsistent measuring. Skip this and you may 'improve' nothing but your gauge.

  4. Sampling carelessly. Grabbing whatever is convenient introduces bias. Decide deliberately how much data, over what time span, and from which sources, so the sample actually represents the process rather than one shift or one supplier.

  5. No stratification. Lumping everything together hides the signal. Plan upfront to capture context such as line, shift, region or supplier, so Analyse can slice the data instead of staring at one undifferentiated average.

Building a plan you can defend

A trustworthy plan is short but explicit. Tie every measure back to the project's problem statement, write down the operational definitions, prove the measurement system, and decide your sampling and stratification before collection starts. Then run a small pilot. A handful of trial records almost always exposes an ambiguous definition or a missing field while it is still cheap to fix.

  • List each metric, its operational definition, and the data type (continuous or discrete).

  • Name who collects it, from what source, and exactly when.

  • Record the stratification factors you will capture alongside each data point.

  • Validate the measurement system, then pilot the form before full collection.

None of this is glamorous, and that is exactly why teams rush it. But the few hours spent making the data-collection plan watertight are the cheapest insurance in the entire DMAIC cycle. With supply and demand still volatile, the discipline of measuring the right thing, well, is what separates a real improvement from a confident guess.

If you want a second set of eyes on how your organization measures and improves its processes, XNM's strategic advisory can help you build measurement you can actually trust.