Intermediate Project: A Checked Research Brief
Build a repeatable process that turns three sources into a short, trustworthy brief: a grounded prompt, one combined checker for numbers, quotes, length and private details, a fix, and a record.
In this lesson you will
- Gather and label independent sources
- Write a grounded prompt with limits
- Check numbers, quotes, length and privacy in one pass
- Record and improve the process
About 28 minutes
Priya has to brief the committee by tomorrow
The committee wants a one-paragraph brief on the library: when it opened, how many books it holds and how busy it is. Priya has three sources, a council page, a news article and a statistics office report. She plans to use Claude to draft the brief. In the earlier lessons she learned what can go wrong: a wrong number, an invented quote, a confident gap, a private detail. For this project, she builds a small, repeatable process that turns sources into a short brief that she can trust, with Claude doing the drafting and her checks doing the guarding.
The brief
- A short brief, no more than 60 words, for the committee.
- Built only from three supplied sources, with no outside facts.
- Every number and every quotation traceable to a source.
- No private details, such as an email address.
- A checked draft, a fixed draft and a note of what changed.
Step 1: gather and label the sources
Priya puts the three source texts in one place and labels each with its origin and date. She checks that they are independent, as lesson 15 taught: different websites, and at least one primary. She removes anything private from the texts, as lesson 9 taught. She will give Claude only these texts, and tell it to use only them.
Step 2: write a grounded prompt
You are a careful research assistant. Using only the three sources below, write a brief of no more than 60 words for the library committee. Include when the library opened, how many books it holds, how many branches it has and how many visits it had last year. Quote nothing unless the words appear exactly in a source. If a fact is not in the sources, write [NOT IN SOURCES].
<source name="council">[paste]</source>
<source name="news">[paste]</source>
<source name="office">[paste]</source>
Look at what the prompt borrows from earlier lessons: the five ingredients, a word limit, material marked off, permission to say ‘not in the sources’, and a rule against unverified quotes.
Step 3: check the draft
Here is a draft of the kind a fluent assistant can produce, together with a corrected version. The program below holds three short source texts, and runs one checker over each version. The checker looks for numbers that do not appear in the sources, quotations that do not appear in the sources, text over the word limit, and anything that looks like an email address. It uses the same ideas as the checkers in lessons 7, 9 and 11, combined into one pass. The draft is a made-up example written to contain typical mistakes.
import difflib, re
sources = {
"council": "The Parkside Library opened in 1958. It holds 12,400 books across 3 branches.",
"news": "The reading club began in 2019 and meets every Wednesday at the library.",
"office": "Annual visits reached 52,000 last year, up from 50,000.",
}
text = " ".join(sources.values())
def check(summary):
out = []
NUM = r"\d+(?:,\d{3})*"
nums = set(re.findall(NUM, text))
for n in re.findall(NUM, summary):
if n not in nums:
out.append("number not in sources: " + n)
for q in re.findall(r'"([^"]+)"', summary):
if q.lower() not in text.lower():
out.append("quote not found: " + q[:24])
if len(summary.split()) > 60:
out.append("over 60 words")
if re.search(r"[\w.]+@[\w.]+", summary):
out.append("contains an email address")
return out
draft = ('The Parkside Library opened in 1985 and holds 12,400 books. Its reading club began in 2019. '
'Visits reached 52,000, and a spokesperson said "we are the busiest library in the county".')
fixed = ('The Parkside Library opened in 1958 and holds 12,400 books across 3 branches. '
'Its reading club began in 2019. Visits reached 52,000, up from 50,000.')
for label, s in (("draft", draft), ("fixed", fixed)):
problems = check(s)
print(f"{label}: {len(problems)} problem(s), {len(s.split())} words")
for p in problems:
print(" -", p)
print()
print("sources used:", len(sources))
print("ready to share:", not check(fixed))
draft: 2 problem(s), 31 words
- number not in sources: 1985
- quote not found: we are the busiest libra
fixed: 0 problem(s), 25 words
sources used: 3
ready to share: True
The first draft has 2 problems in 31 words. It says the library opened in 1985, a number that is not in the sources, because the council page says 1958, which is a typical swapped-digit slip. And it includes a quotation, ‘we are the busiest library in the county’, that appears in none of the 3 sources. A smooth, confident sentence about being the busiest library is the kind of thing that sounds right and has no support. The fixed version has 0 problems in 25 words. It uses the correct year, drops the invented quote, and adds the branch count from the council source. The final line says it is ready to share, but that means only that it passes the checks. Priya still reads it against the sources once with her own eyes, because the checker only looks for patterns it knows.
Step 4: record what you did
- Save the sources, the prompt, the draft, the checks and the final brief together.
- Write two lines on what the checker caught, so that you learn which mistakes to watch for.
- Add the failing draft to your prompt test set from lesson 19.
- Share the brief with a line saying it was drafted with AI help and checked against the named sources, if your workplace expects that.
- Keep the checker and improve it whenever a new kind of error gets through.
Your finished-brief checklist
- Is every number found in a source?
- Is every quotation found, word for word, in a source?
- Are the sources independent, recent and, where possible, primary?
- Is the length within the limit, and is nothing private included?
- Did I read it against the sources myself?
- Could someone else repeat the process from my notes?
Treating a passed check as a guarantee. A checker can only find what it was built to find. It would not notice a wrong name, a reversed meaning or a missing caveat. Use it to catch the routine errors, and use your own judgement for the rest.
You have now finished the Intermediate level of Claude basics: documents, data, reasoning, instructions, research, long writing, images, tools and testing, all tied together by one habit, which is to give Claude good material and check what comes back.
Practice for this lesson
Check what you learned
Five quick questions. Pick an answer and you will see straight away whether it is right and why.
Why tell Claude to use only the supplied sources?
- It stops outside facts from creeping in
- It makes the reply longer
- It speeds up search
- It hides errors
Restricting to the sources keeps the brief grounded and checkable.
What did the checker flag in the draft?
- A missing title
- A wrong year and an invented quote
- A typo only
- A colour
The year 1985 and the “busiest library” quote were not in the sources.
What does “ready to share: True” mean here?
- It is guaranteed correct
- It is published
- It is private
- It passed the checks, but still needs a human read
A checker finds only known patterns, so you still read the brief against the sources.
Why add the failing draft to your test set?
- It makes the set bigger for fun
- Past failures are the best tests
- It removes errors
- It saves tokens
Cases that went wrong are the most likely to go wrong again.
What should the record include?
- Only the final brief
- Nothing
- Only the prompt
- Sources, prompt, draft, checks and the final brief
A full record lets you or someone else repeat and improve the process.
Summary
- Ground the brief in sources you chose and checked.
- One checker can combine number, quote, length and privacy checks.
- A passed check still needs a human read.
- Record the process and feed failures back into your tests.
Questions
Do I need code to do this project?
No. The same checks can be done by hand with a checklist. Code just makes them faster and repeatable.
How many sources should I use?
At least three independent ones where possible, including a primary source. For this project, three short sources keep it manageable.
Should I tell people AI helped?
Follow your workplace or school rules. Being open about AI help and about how you checked the facts builds trust.
