The science mentor's job: coach, judge and reviewer
A swimming coach helps you practise before the race. The judge at the race only watches and gives the score. If your coach were also the judge, it would not be fair to the other swimmers. Science mentors are the same: you help, or you judge, but not both for the same student.
- Before this course: Research Projects: statistics (course 15.9.3), which came after Experiment Design: variables and controls (course 15.9.2) and The Scientific Method & Science Fair Projects (course 15.9). You already know fair tests, controls, analysis plans, means, SD, SE, confidence intervals, t-tests, correlation and honest graphs. This course turns that knowledge into the work of a mentor: judging, coaching and reviewing other people's science.
- Three jobs, three hats:
| Hat | When | What you do | What you do not do |
|---|---|---|---|
| Coach (mentor) | Weeks before the fair | Ask questions, teach a skill, point to problems | Do the work, choose the answers or write the report |
| Reviewer | When a plan or report is ready | Write a clear review: major issues, minor issues, questions | Rewrite it for the student |
| Judge | On fair day | Score against the fair's criteria and give feedback | Coach during the interview, or judge a student you coached |
- Conflict of interest: a reason you might not be fair, such as judging your own student, a relative or a friend's child. The safe rule: say it out loud to the organiser and step aside. Society for Science (which runs the Regeneron International Science and Engineering Fair, ISEF) tells its affiliated fairs to have procedures to eliminate any potential conflict of interest and to make judging just and equitable, without bias.
- The student owns the project. In the ISEF interview criteria, one point judges look at is the student's "degree of independence in conducting project". For work done at home or in a school lab, ISEF judges assess whether the student received mentoring or professional guidance. Good help is visible: it is listed in the acknowledgements.
- Every fair is different. One fair may let students use a research lab; another may not. One may need forms for any survey; another may ban some topics. Your first job as a mentor or judge is to read the current rules of the fair you work with.
- What makes an expert mentor: knows the science and the statistics, asks more than tells, keeps the three hats apart, protects safety and honesty, and can teach other adults to do the same.
- Write the name of a fair you could mentor or judge for (a school, regional or online fair) and find its current rules page.
- List which hat you would wear for each student you know: coach, reviewer or judge.
- For each student, write any reason you might not be fair (family, friend, your own student).
- If there is one, write the sentence you would say to the organiser: "I have a conflict of interest with this project, so I should not judge it."
- Write a short "help I give / help I do not give" list for students.
- Check: for every student on your list, you wear only one hat, and your help would appear honestly in their acknowledgements.
Videos by other creators on YouTube, for reference. They are not made by or affiliated with The Future Market.
Read the video script
[Host holding three different hats] "A science mentor wears three hats: coach, reviewer and judge."
[Text on screen: Coach. Reviewer. Judge. One at a time.] "Coach before the fair. Review when the report is ready. Judge on fair day. Never two hats for the same student."
[Screen: a judge raising a hand to an organiser] "Know the student? Say so, and step aside. That is a conflict of interest."
[Host] "And remember: the project belongs to the student. Your help should make them stronger, not do the work for them."
Write a one-page "mentor agreement" you could give a student: what help you will give, what you will not do, how you will record your help, and how a conflict of interest is handled. Show it to a teacher for comments.
ClaudeStuck? Copy a ready-made prompt for Claude
Copy this, open Claude, paste it, and Claude will walk you through the lesson step by step.
For a grown-up: Claude is for adults (18+). Copy this, paste it into Claude, and use the answer to explain the lesson to your child.
I'm learning "Science Mentor: judging and coaching" on The Future Market. Lesson 1: "The science mentor's job: coach, judge and reviewer". What the lesson teaches: - Before this course: Research Projects: statistics (course 15.9.3), which came after Experiment Design: variables and controls (course 15.9.2) and The Scientific Method & Science Fair Projects (course 15.9). You already know fair tests, controls, analysis plans, means, SD, SE, confidence intervals, t-tests, correlation and honest graphs. This course turns that knowledge into the work of a mentor: judging, coaching and reviewing other people's science. - Three jobs, three hats: - Hat - When - What you do - What you do not do - Coach (mentor) - Weeks before the fair - Ask questions, teach a skill, point to problems - Do the work, choose the answers or write the report - Reviewer - When a plan or report is ready - Write a clear review: major issues, minor issues, questions - Rewrite it for the student - Judge - On fair day - Score against the fair's criteria and give feedback - Coach during the interview, or judge a student you coached - Conflict of interest: a reason you might not be fair, such as judging your own student, a relative or a friend's child. The safe rule: say it out loud to the organiser and step aside. Society for Science (which runs the Regeneron International Science and Engineering Fair, ISEF) tells its affiliated fairs to have procedures to eliminate any potential conflict of interest and to make judging just and equitable, without bias. The exercise I'm working on: Write a one-page "mentor agreement" you could give a student: what help you will give, what you will not do, how you will record your help, and how a conflict of interest is handled. Show it to a teacher for comments. I'm stuck. Please: 1. Explain the main idea in plain, simple words with one everyday example. 2. Walk me through the exercise one small step at a time. Ask me what I've done so far before giving the next step. 3. Don't just give me the final answer. Help me do it myself, and check my work when I share it.
I'm a parent helping my child (about 8 years old) with a lesson called "The science mentor's job: coach, judge and reviewer" from the course "Science Mentor: judging and coaching". Here's what the lesson says: A swimming coach helps you practise before the race. The judge at the race only watches and gives the score. If your coach were also the judge, it would not be fair to the other swimmers. Science mentors are the same: you help, or you judge, but not both for the same student. The activity: Write a one-page "mentor agreement" you could give a student: what help you will give, what you will not do, how you will record your help, and how a conflict of interest is handled. Show it to a teacher for comments. Please explain this so an 8-year-old understands: short sentences, a fun everyday example, and no hard words. Then give me 3 simple questions I can ask my child to check they understood, and a way to do the activity together, one tiny step at a time.
Sources
- Society for Science, Judging at your Fair (conflict of interest, equitable judging): www.societyforscience.org/isef/affiliated-fair-network/judging-at-your
- Society for Science, Regeneron ISEF Grand Award judging criteria (independence, mentoring): www.societyforscience.org/isef/grand-award/criteria/
Coaching a student with questions
This lesson is part of full access: every course and every level for one payment.
Reviewing a project like a scientist
This lesson is part of full access: every course and every level for one payment.
Judging with a rubric
This lesson is part of full access: every course and every level for one payment.
Fair and consistent judging: bias, calibration and agreement
This lesson is part of full access: every course and every level for one payment.
Integrity, safety and privacy
This lesson is part of full access: every course and every level for one payment.
Leading judges and teaching mentors
This lesson is part of full access: every course and every level for one payment.
Final project
This lesson is part of full access: every course and every level for one payment.
Quiz
What are the three hats of a science mentor?
Coach, reviewer and judge.
You coached a student for a month. Should you judge their project at the fair?
No. That is a conflict of interest; say so and step aside.
Why ask questions before telling a student the answer?
It shows where their thinking is and keeps the project theirs.
What should good feedback include?
One real strength, one or two priorities and a next step the student can do.
A report says "± 0.10 (SD)", but the recalculated SD is 0.29 and the SE is 0.10. What is wrong?
The standard error was labelled as the standard deviation.
Why do rubric weights matter?
Different weights can change which project wins.
What does it mean to judge against the criteria, not the room?
Score each project against the rubric's standard, not against the other projects you saw.
What is the halo error?
One strong feature raises the scores for every criterion.
What does a z-score show in judging?
How a project did compared with the other projects the same judge saw.
Why use Cohen's kappa instead of only percent agreement?
Kappa removes the agreement that would happen by chance.
Is an honest mistake research misconduct?
No. Misconduct is fabrication, falsification or plagiarism; honest error is not.
What do you do if a student's data look too perfect?
Ask open questions, look at the logbook, write down facts and tell the fair's official process; do not accuse or investigate alone.
Why must you read your own fair's rules?
Science fair rules differ by country and by fair.
Final exam
This lesson is part of full access: every course and every level for one payment.
Certificate
This lesson is part of full access: every course and every level for one payment.