UNIT 2 · LESSON 6 · 60-MINUTE SUGGESTED PLAN

Training से अलग testing

Keep an unseen test set to check a model.

Understand

Performance on examples already seen during training can overstate how well a system handles new examples. Reserve a test set before practising a rule. Do not silently move difficult test items into training and continue to call the old test score independent. Record both successes and failures.

Original classroom scenario / sample claim
A classifier got all six training cards right. Its maker claims: “It will classify every new card correctly.”

Try it and check it

Create ten fictional object cards and reserve four without looking at their answers while designing a rule.
Design a rule using the other six.
Test it on the reserved cards and record correct/total.
State what the test result supports and what it cannot guarantee.

Without a device: Print this lesson, use paper cards or the supplied fictional text, and discuss the checks in pairs. A student can later enter their own notebook record for teacher review when a device is available.

Notebook: write your corrected or unresolved conclusion, the evidence you actually checked, and a reflection. Do not include passwords, identity documents or private information. Original BrainCheck companion content, BCAI-v1.

QUICK CHECK • PRACTICE FEEDBACK

Which set gives a more independent check after training?

The same examples memorised during training

A separate previously unseen test set

Only examples chosen after seeing their answers

No examples

Write notebook entry Print worksheet / Save PDF Next lesson →