Improving a Prototype Using Test Data and Tradeoffs
A busy middle-school maker lab where Atlas, a sturdy robot guide with glowing amber eyes, crouches beside a battered cardboard bridge stretched between two stacks of books, marking failure points on a data sheet with a stylus while a pile of replacement materials waits on the workbench beside a ruler and a small set of test weights.
- Explain why systematic testing is necessary before deciding what to change in a prototype.
- Identify specific failure points in a prototype by analyzing test data.
- Compare two or more design changes and predict how each affects performance and tradeoffs.
- Describe how each iteration of a prototype should be guided by evidence from the previous test.
- Justify a design decision by citing test data and acknowledging the tradeoffs accepted.
Key terms
- Failure point
- The exact spot where a prototype breaks first
- Tradeoff
- Gaining one quality by sacrificing another in a design
- Iteration
- One full build, test, analyze, and redesign cycle
- Systematic testing
- Changing one variable at a time and measuring each result
Read the Data, Then Aim
A broken prototype is information, not failure. The location of the break tells you precisely where to focus the next change. If a bridge collapses on the left support under load, redesigning the right side or the deck wastes effort. Targeting the documented failure point means each new version answers a specific question raised by the last test, so progress compounds instead of scattering across guesswork.
Expect the Tradeoff
Fixing one weakness often exposes another, because design qualities pull against each other. Adding material to a weak left support makes it stronger but heavier, and the extra weight can make the center sag. This is a tradeoff, not a mistake. Skilled engineers anticipate that improving strength may cost mass, so after each fix they retest the whole structure to see what the change shifted, then iterate again.
Worked examples
A catapult arm always snaps at the same notch under load. Describe the evidence-based next iteration.
- Read the data: the repeated break at one notch identifies it as the failure point.
- Choose the smallest targeted fix: reinforce the material at that notch only.
- Note the tradeoff: extra material there adds weight or stiffness that may affect throw distance.
- Retest the new version and check whether the failure moved elsewhere.
Answer: Reinforce the notch where it snaps, retest, and watch for a new failure point.
Activity
Atlas's team tested a cardboard bridge prototype and recorded observations. Sort each observation into the correct column: 'Failure Point Identified' or 'Not a Failure Point'.
Practice
Your tower bends at the base every test, so name one targeted fix.
Describe a tradeoff you would accept to make a paper bridge stronger.
Common mistakes to avoid
- Redesign everything after a failureScrapping the whole design discards the parts that worked, so target the specific failure point the data revealed.
- A new failure means the method failedFixing one weakness often exposes another, which is a normal tradeoff that signals you should analyze and iterate again.
Check your understanding
A student tests a prototype catapult and finds that the throwing arm always snaps at the same notch. What should guide the NEXT prototype iteration?
A team reinforces the weak side of their prototype and it no longer fails there — but now the opposite side fails first. This is BEST described as:
Why is it important to change only ONE variable between prototype iterations?
Recap
A prototype is a question you test by changing one variable at a time, reading the data to find the failure point, applying the smallest fix while accepting its tradeoff, then rebuilding and retesting in iterations until the design steadily improves.
Reflect
Why might fixing the obvious failure first sometimes hide a deeper design flaw?