Settings

These settings need JavaScript, which is off in this browser, so choosing one changes nothing.

Changes apply as you choose them.

Theme
Font
Why these fonts?

Choose the font you find easiest to read. Studies have not found that special "dyslexia fonts" help people read faster or more accurately. More space between letters and words does help some readers, so try the spacing setting too.

Text size
Reading layout
Letter and word spacing
Line spacing
More reading controls

Focus mode hides the Map and Help links, the breadcrumb and the footer, so only the page you are reading is left.

Reading voice and speed

Emma is a computer voice, made with the open Kokoro model. Her readings are saved on this site. Where a part has no Emma reading yet, your device's own voice reads it.

Reading speed

The number is how many times faster than normal. 1.5 is one and a half times as fast. The voice keeps its pitch.

Move or delete progress
Move your progress

This device's save code:

Or open this restore link on the other device:

Lesson 4.1

Check it before you use it

After this lesson you can check an AI answer's claims and citations against real sources.

About 10 minutes, or 16 with the Deep layers

Reading depth for every section

In short

  • A link or a citation in an AI answer is not proof. Open it, and find the claim in the source.
  • We asked two AI models, Claude and Ministral, the same question five times each. All twenty of Claude's sources were real and relevant. Ministral's twenty were not.
  • For health, law or money, ask a qualified person.

A citation is a note in an answer that points to a source, such as a study. It gives the authors, the year and where it was published.

A chatbot is a program that can write text for you, such as ChatGPT. Its answers can be factually wrong.

A chatbot can write a citation that looks right and leads nowhere. It can also name a real paper that says something else.

So the check is not reading the citation. The check is opening it. Lesson 1.6, Why they make things up, looks at why chatbots can do this.

Two researchers, Walters and Wilder, tested this in April 2023. ChatGPT is a chatbot. They asked two versions of it to write short papers on 42 topics. They found 636 citations in the 84 papers, and searched databases and websites for each one.

They wrote that 55% (just over 1 in 2) of the GPT-3.5 citations and 18% (about 1 in 5) of the GPT-4 citations were fabricated. Fabricated means the work does not exist: it was never published, presented or posted. Of the real citations, 43% (about 4 in 10) from GPT-3.5 and 24% (about 1 in 4) from GPT-4 had substantive errors, such as a wrong author, title, date, journal or page number.

These are results for two models, one prompt and 42 topics, on texts made in the first week of April 2023. They are not a rate for any chatbot today. Our own test in this lesson is a separate, smaller one.

Pick the claims that matter

A claim is one thing an answer says is true. One answer can hold many claims, and one source may back only one of them.

Here is an invented example. An answer says: “The scheme began in 2023, cut costs by a third and is open to everyone in Ireland.” That is four claims. It began in 2023. It cut costs by a third. It is open to everyone. It is in Ireland.

Our steps: start with the claims that would change what you do. Open the source for each one. Find the claim in it.

A source can back the main idea of an answer and not a detail. In our test, Claude described Singer and Alexander’s 2017 review in three of its answers. Two of them said paper “tends to do better for longer or more complex texts”. The review’s abstract says only that the medium “plays an influential role under certain text or task conditions or for certain readers”. We did not open the full text, so we could not settle that detail. We left it out of our count and say so here.

Many citations come with a DOI. A DOI is a long-lasting number that identifies a work. It is made of a prefix and a suffix, split by a slash, such as 10.1000/182.

Put https://doi.org/ (opens in a new tab) in front of a DOI and it opens as a link. Then compare what opens with the citation. Check the title, the authors, the journal and the year.

If the link fails, search the exact title on Crossref. Crossref is a website where you can search the details of published papers, books and more. If you still find nothing, write “could not find it”. Do not write “it does not exist”.

The doi.org page says a DOI can identify “any object”. So a DOI opening a record does not tell you the record is the work the answer named. In our test, ten of Ministral’s DOIs opened a different work from the one named.

Here is how we checked each of the forty sources, in this order. First, we opened the link as given. Second, if it was a DOI, we asked the DOI resolver, the doi.org service that sends you to the work a DOI names, and the Crossref record what it opens. Third, if it failed, we searched the exact title on Crossref and then on the web. We used no university library search, because we have no library login. Some publishers’ sites refused our requests, and we say so in the notes.

A source is real and relevant when it has the named title and authors, the DOI matches, and its own summary backs the answer’s main finding. It is real but unrelated when the DOI opens another work, or the work does not say what the answer says. It is not there when no work of that title could be found.

A search that finds nothing cannot prove a paper never existed. That is why our word is “not there”, and why our note says “we could not find it”.

The Source checker

The Source checker shows four citations from one answer a chatbot gave us. We saved it as it was written. For each, you predict what the check will find.

The choices are real and relevant, real but unrelated, not there, or can’t tell yet. Real but unrelated means the link or the details lead to a different work. Not there means we could not find it.

Then you see what we found and how we checked. Nothing is counted or saved.

After the four, you can read all ten answers in full, with the model and the date.

We asked each model this question five times: “What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.” The recording is R-4.1, made on 8 October 2026. Maker A is Claude Sonnet 5.5, called through Anthropic’s Messages API (a way for one program to send a request to another). Maker B is Ministral 3 14B, called through Mistral AI’s API. There was no system prompt (instructions placed behind your message) and no tools (such as web search), so neither model could search the web. We did not send a temperature (a setting that changes how even the chances are before each piece of text is picked), so each service used its own default, and for Claude the value used was not recorded. We set the longest answer to 4000 tokens (a token is a small piece of text, often a whole word). These are settings of the request. They say nothing about whether an answer is true.

The four citations in the checker are from Ministral’s first run. We chose it because its four citations lead to different places. Claude’s first run names four real papers, which would show one result four times. Our notes mark each citation we checked in all ten runs.

Try it: Source checker

Here are four citations from one recorded answer. Ministral 3 14B, a model made by Mistral AI, wrote it on 8 October 2026. It had no web search.

We asked it: "What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links." The links are shown as text on purpose.

For each citation, predict what the check will find. A citation can look exactly right and lead nowhere.

Citation 1

Mangen, A., Walgermo, B. R., & Lexner, H. (2013). "Reading linear texts on paper versus computer screens: Effects on reading comprehension." PLOS ONE, 8(4), e61279. Link: https://doi.org/10.1371/journal.pone.0061279. The answer says paper readers did better on deep comprehension.

What will the check find?

Nothing is counted or saved.

Citation 1: the answer

Our reading: Real but unrelated

What we found: The link opens a different paper. It is a genetics paper by Lo and others, in PLoS ONE, volume 8, issue 4, article e61279. That matches the journal details in the citation, but not the title or the authors. A paper with the named title exists. It is by Mangen, Walgermo and Brønnick, in the International Journal of Educational Research, volume 58, 2013.

How we checked: We put the DOI into the DOI resolver and read the Crossref record it points to. Then we searched the exact title on Crossref.

Official entry: Crossref record of DOI 10.1371/journal.pone.0061279, read 9 October 2026: Lo and others, "Identification of a Functional Variant in the MICA Promoter Which Regulates MICA Expression and Increases HCV-Related Hepatocellular Carcinoma Risk", PLoS ONE 8(4), e61279, 2013.

Citation 2

Delaney, B. D., & Pasek, J. J. (2012). "The effects of reading on paper vs. screen on reading comprehension." Computers in Human Behavior, 28(4), 1181-1185. Link: https://doi.org/10.1016/j.chb.2012.01.021. The answer says there was no significant difference for short, simple texts.

What will the check find?

Our reading: Real but unrelated

What we found: The link opens a different paper, in the same journal, volume and issue. It is by Lindgren and is about learning in a virtual environment, on pages 1130 to 1139. Our title searches on Crossref and the web did not find a paper with that title and those authors.

How we checked: We put the DOI into the DOI resolver and read the Crossref record it points to. Then we searched the exact title on Crossref and on the web.

Official entry: Crossref record of DOI 10.1016/j.chb.2012.01.021, read 9 October 2026: Lindgren, "Generating a learning stance through perspective-taking in a virtual environment", Computers in Human Behavior 28(4), 1130-1139, 2012.

Citation 3

Clark, A., & Pavlik, P. (2013). "Reading on paper versus reading on screens: A review of the research." Journal of Computing in Higher Education, 25(1), 1-20. Link: https://doi.org/10.1007/s12528-012-9070-4. The answer says paper is better for deep reading.

What will the check find?

Our reading: Not there

What we found: The DOI resolver says it cannot find this DOI. Title searches on Crossref and the web found no paper with this title and these authors. We could not find it.

How we checked: We put the DOI into the DOI resolver. When that failed, we searched the exact title on Crossref and then on the web.

Official entry: DOI resolver, https://doi.org/10.1007/s12528-012-9070-4, tried 9 October 2026: no record. Crossref title search, 9 October 2026: no match.

Citation 4

Dillon, A. (1992). "The paper versus screen debate: A review of the empirical literature." Journal of Documentation, 48(3), 243-263. Link: https://doi.org/10.1108/eb026833. The answer says paper was better for comprehension in lab studies.

What will the check find?

Our reading: Real but unrelated

What we found: The link opens a different paper. It is a 1988 paper by Maguire and Lovelace about marketing in the Australian food industry, in the same journal. A 1992 review by Dillon on this topic does exist, with another title and in another journal: Ergonomics, volume 35, pages 1297 to 1326.

How we checked: We put the DOI into the DOI resolver and read the Crossref record it points to. Then we searched for the author and topic on Crossref.

Official entry: Crossref record of DOI 10.1108/eb026833, read 9 October 2026: Maguire and Lovelace, "Marketing in the Australian food industry: the information base", Journal of Documentation 44(4), 315-338, 1988. Dillon, "Reading from paper versus screens: a critical review of the empirical literature", Ergonomics 35, 1297-1326, 1992.

The check was opening the source, not reading the citation.

This is one answer from one model on one day. It does not show how often AI invents citations.

We checked on 9 October 2026 with the DOI resolver, a title search on Crossref and a web search. We did not use a university library search, because we have no library login. A search that finds nothing cannot show a work never existed, so "not there" means we could not find it.

What all ten answers showed

We asked two models one question, five times each. It was about reading on paper and on a screen. It asked for four sources with links. We recorded the answers on 8 October 2026. We checked all forty sources on 9 October 2026.

Claude Sonnet 5.5 named four sources in each of its five answers, twenty in all. All twenty were real and relevant. They were five papers, each named several times.

Ministral 3 14B also named twenty. None was real and relevant. Twelve were real but unrelated: the link or the details led to a different work. Eight were not there: we could not find them.

So across the forty: twenty were real and relevant, twelve real but unrelated and eight not there. Neither model had web search.

This is two models, one question and one day. It does not show how often AI invents citations.

How we counted: we opened each link as given. A DOI that opened a different work was real but unrelated. If a link failed, we searched the exact title. If we found nothing, it was not there.

The two AIs and their settings

Claude Sonnet 5.5

claude-sonnet-5-5, on Anthropic Messages API. Recorded on 8 October 2026.

  • Longest answer, in tokens: 4000
  • Temperature: not sent, and the value the service used was not recorded
  • Tools: no tools
  • Instructions from us behind the message: none

Ministral 3 14B

ministral-14b-2512, on Mistral AI API. Recorded on 8 October 2026.

  • Model name sent: ministral-14b-2512
  • Longest answer, in tokens: 4000
  • The model's default temperature, read from its model list: 0.3
  • Temperature: not sent, and the value the service used was not recorded
  • Tools: no tools
  • Instructions from us behind the message: none
Show all runs

The same question, five answers from each AI

Claude Sonnet 5.5 Run 1 Recorded 8 October 2026

All four sources are real and relevant. One description goes past its source. The words "with the size of the difference varying by factors such as the measure used and the type of text" are not supported by the abstract of Kong, Seo and Zhai. It says: "None of the moderators were significant at the 0.05 level." So the study did not find that these factors made a significant difference.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Paper vs. screen reading comprehension

Research generally finds a small to moderate advantage for paper, especially for informational texts and when readers are under time pressure. The effect is not large, and it depends on the type of text, the task, and the reader.

Sources
  1. Delgado, Vargas, Ackerman & Salmerón (2018). "Don't throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension." Educational Research Review, 25, 23-38.
    https://doi.org/10.1016/j.edurev.2018.09.003

    • This meta-analysis of studies from 2000 to 2017 found a paper advantage. The advantage was strongest under time constraints and for informational (as opposed to narrative) texts. It also appeared to grow over the period studied, not shrink.
  2. Clinton (2019). "Reading from paper compared to screens: A systematic review and meta-analysis." Journal of Research in Reading, 42(2), 288-325.
    https://doi.org/10.1111/1467-9817.12269

    • This meta-analysis found that paper readers did better on objective comprehension measures. Screen readers also tended to overestimate how well they had understood.
  3. Kong, Seo & Zhai (2018). "Comparison of reading performance on screen and on paper: A meta-analysis." Computers & Education, 123, 138-149.
    https://doi.org/10.1016/j.compedu.2018.05.005

    • This meta-analysis reported better performance on paper, with the size of the difference varying by factors such as the measure used and the type of text.
  4. Mangen, Walgermo & Brønnick (2013). "Reading linear texts on paper versus computer screen: Effects on reading comprehension." International Journal of Educational Research, 58, 61-68.
    https://doi.org/10.1016/j.ijer.2012.12.002

    • In this study of Norwegian tenth-graders, students who read longer texts on paper scored better on comprehension than those who read the same texts as PDFs on a screen.
Read the full recorded answer, Claude Sonnet 5.5, run 1
Caveats
  • Differences are often modest, and results vary by population, device, and task.
  • Proposed explanations include less effective navigation on screens, a tendency to skim, and overconfidence while reading digitally.
  • Some studies find no difference, particularly for narrative texts or when readers have plenty of time.

I'm confident in these citations, but please check the DOI links before relying on them in academic work.

Claude Sonnet 5.5 Run 2 Recorded 8 October 2026

All four sources are real and relevant. One description goes past its source. The words "with differences depending on factors like time limits and text type" are not supported by the abstract of Kong, Seo and Zhai. It says: "None of the moderators were significant at the 0.05 level." So the study did not find that these factors made a significant difference.

The details about text type and reader control in the Clinton (2019) description are not checked. We could not read the full text.

The longer or more complex text claim about Singer and Alexander (2017) is not checked. We could not read the full text.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Paper vs. screen reading comprehension

Overall finding: Most research finds a small advantage for paper, especially for informational texts and when readers are under time pressure. The effect is modest and varies with the study conditions.

Sources
  1. Delgado, Vargas, Ackerman, & Salmerón (2018). "Don't throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension." Educational Research Review, 25, 23-38.

    • https://doi.org/10.1016/j.edurev.2018.09.003
    • A meta-analysis of studies from 2000 to 2017. It found a small but reliable advantage for paper. The advantage was larger under time constraints and for informational texts, and it appeared to grow over the period studied.
  2. Clinton, V. (2019). "Reading from paper compared to screens: A systematic review and meta-analysis." Journal of Research in Reading, 42(2), 288-325.

    • https://doi.org/10.1111/1467-9817.12269
    • Another meta-analysis that found better comprehension outcomes on paper. It also examined how factors such as text type and reader control affect the result.
  3. Kong, Seo, & Zhai (2018). "Comparison of reading performance on screen and on paper: A meta-analysis." Computers & Education, 123, 138-149.

    • https://doi.org/10.1016/j.compedu.2018.05.005
    • A meta-analysis that also found a paper advantage in comprehension, with differences depending on factors like time limits and text type.
  4. Singer & Alexander (2017). "Reading on paper and digitally: What the past decades of empirical research reveal." Review of Educational Research, 87(6), 1007-1041.

    • https://doi.org/10.3102/0034654317722961
    • A broader review of decades of research. It found that paper tends to do better for longer or more complex texts, while differences are smaller for short, simple ones.
Read the full recorded answer, Claude Sonnet 5.5, run 2
Caveats
  • The effect sizes are small, and results depend on the text type, time limits, and the reader's experience with screens.
  • Some explanations for the paper advantage involve "shallower" processing on screens or overconfidence in one's understanding, but these mechanisms are still debated.
  • I'm confident these papers exist and roughly what they found, but check the details against the originals, since I may not have every figure exactly right.

Claude Sonnet 5.5 Run 3 Recorded 8 October 2026

All four sources are real and relevant. The answer asks the reader to check the links.

The description of Singer and Alexander (2017), including that readers often prefer print, is not checked. We could not read the full text.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Paper vs. screen reading comprehension

Overall: Most research finds a small but consistent advantage for paper, especially for informational texts and when readers are under time pressure. The effect is not large, and it depends on the text, the task, and the device.

Sources
  1. Delgado, Vargas, Ackerman & Salmerón (2018). "Don't throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension." Educational Research Review, 25, 23-38.
    https://doi.org/10.1016/j.edurev.2018.09.003
    This meta-analysis of studies from 2000 to 2017 found a small advantage for paper. It was larger under time constraints and for informational (or mixed) texts than for narratives. The gap appeared to grow over the period studied.

  2. Clinton, V. (2019). "Reading from paper compared to screens: A systematic review and meta-analysis." Journal of Research in Reading, 42(2), 288-325.
    https://doi.org/10.1111/1467-9817.12269
    This meta-analysis also found better comprehension from paper. It additionally looked at reading time and how well readers judged their own understanding.

  3. Singer & Alexander (2017). "Reading on paper and digitally: What the past decades of empirical research reveal." Review of Educational Research, 87(6), 1007-1041.
    https://doi.org/10.3102/0034654317722961
    This review covers decades of studies. It finds that medium can affect comprehension depending on the text and task, and that readers often prefer print.

  4. Mangen, Walgermo & Brønnick (2013). "Reading linear texts on paper versus computer screen: Effects on reading comprehension." International Journal of Educational Research, 58, 61-68.
    https://doi.org/10.1016/j.ijer.2012.12.002
    In this experiment with Norwegian tenth graders, students who read on paper scored better on comprehension than those who read the same texts as PDFs on a computer. The authors suggest that scrolling and the lack of physical cues may play a role.

Read the full recorded answer, Claude Sonnet 5.5, run 3
Caveats
  • The effects are modest, and some studies find no difference, particularly for narrative texts.
  • Screen readers tend to be more overconfident about their understanding, which may contribute to shallower processing.
  • Results may differ with newer devices, e-readers, and people who grew up reading digitally.

I'm confident these papers exist, but check the DOI links, since I can't verify them live. Searching the titles will also work.

Claude Sonnet 5.5 Run 4 Recorded 8 October 2026

All four sources are real and relevant. One description goes past its source. The words "which varied with factors such as text type and how reading was measured" are not supported by the abstract of Kong, Seo and Zhai. It says: "None of the moderators were significant at the 0.05 level." So the study did not find that these factors made a significant difference.

The longer or more complex text claim about Singer and Alexander (2017) is not checked. We could not read the full text.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Research mostly finds a small advantage for paper, especially for informational texts and under time pressure. The effect is not large or universal.

Four sources
  1. Delgado, Vargas, Ackerman & Salmerón (2018). "Don't throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension." Educational Research Review, 25, 23-38.
    https://doi.org/10.1016/j.edurev.2018.09.003

    • Synthesizes studies from 2000 to 2017. Paper had a small but reliable advantage.
    • The advantage was clearest when readers were under time constraints and when texts were informational or mixed rather than purely narrative.
    • The gap appeared to widen over the years studied.
  2. Clinton (2019). "Reading from paper compared to screens: A systematic review and meta-analysis." Journal of Research in Reading, 42(2), 288-325.
    https://doi.org/10.1111/1467-9817.12269

    • Also found better comprehension from paper, and readers were often more overconfident about their understanding on screens.
  3. Kong, Seo & Zhai (2018). "Comparison of reading performance on screen and on paper: A meta-analysis." Computers & Education, 123, 138-149.
    https://doi.org/10.1016/j.compedu.2018.05.005

    • Found a small paper advantage, which varied with factors such as text type and how reading was measured.
  4. Singer & Alexander (2017). "Reading on paper and digitally: What the past decades of empirical research reveal." Review of Educational Research, 87(6), 1007-1041.
    https://doi.org/10.3102/0034654317722961

    • A broad review. Results are mixed, but paper tends to do better for longer or more complex texts. It also notes that readers' preferences and habits matter.
Read the full recorded answer, Claude Sonnet 5.5, run 4
Caveats
  • The effects are small, and screen reading can match paper under some conditions, such as short or narrative texts and untimed reading.
  • Results depend on the device, the text, the task, and how comprehension is measured.
  • Some researchers suggest the gap reflects reading habits, such as skimming on screens and less careful self-monitoring, rather than anything inherent to screens.

I'm confident these papers exist and in their general findings, but please verify the DOI links resolve correctly, since I can't check them live.

Claude Sonnet 5.5 Run 5 Recorded 8 October 2026

All four sources are real and relevant. The answer asks the reader to check the links.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Paper vs. screen reading comprehension

Overall finding: Most meta-analyses find a small but consistent advantage for paper, especially for informational (expository) texts and when readers are under time pressure. The gap is much smaller or absent for narrative texts and relaxed reading. The effect appears to depend on the context.

Four sources
  1. Delgado, Vargas, Ackerman & Salmerón (2018). "Don't throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension." Educational Research Review, 25, 23-38.

    • Link: https://doi.org/10.1016/j.edurev.2018.09.003
    • Pooled studies from 2000 to 2017 and found a small advantage for paper. The advantage was larger under time constraints and for informational or mixed texts. It also seemed to grow over the years studied.
  2. Clinton (2019). "Reading from paper compared to screens: A systematic review and meta-analysis." Journal of Research in Reading, 42(2), 288-325.

    • Link: https://doi.org/10.1111/1467-9817.12269
    • Also found that paper readers tended to perform better on comprehension, with a small overall effect, and examined moderators such as text type and reading time.
  3. Kong, Seo & Zhai (2018). "Comparison of reading performance on screen and on paper: A meta-analysis." Computers & Education, 123, 138-149.

    • Link: https://doi.org/10.1016/j.compedu.2018.05.005
    • Reached a similar conclusion, with paper associated with better reading performance. It also looked at factors like text type and the kind of device.
  4. Mangen, Walgermo & Brønnick (2013). "Reading linear texts on paper versus computer screen: Effects on reading comprehension." International Journal of Educational Research, 58, 61-68.

    • Link: https://doi.org/10.1016/j.ijer.2012.12.002
    • An experiment with Norwegian 10th graders found better comprehension of texts read on paper. The authors suggest physical, tactile cues and the difficulty of navigating scrolled text may play a role.
Read the full recorded answer, Claude Sonnet 5.5, run 5
Caveats
  • Effect sizes are small, and results vary by text type, time limits, and reader experience.
  • Newer screens and reading habits may change the picture.
  • I'm giving DOI links from memory, so please verify them. Searching the titles will turn up the papers if a link fails.

Ministral 3 14B Run 1 Recorded 8 October 2026

Citation 1 is real but unrelated.

Citation 2 is real but unrelated.

Citation 3 is not there.

Citation 4 is real but unrelated.

Citation 1 also describes results the real study does not report.

Citation 1 also describes a result the real study does not report.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Research on whether people understand text better on paper or screen has yielded mixed but generally nuanced findings. While paper often leads to slightly better comprehension and retention—especially for deep processing tasks—screens can be just as effective (or even superior) for certain contexts, such as hypertext reading, note-taking, or when interactive features are involved. Key factors include text complexity, reading purpose, individual differences (e.g., age, prior knowledge), and medium-specific affordances (e.g., searchability, annotations).

Here are four peer-reviewed sources with links supporting these findings:


1. Mangen, A., Walgermo, B. R., & Lexner, H. (2013).

"Reading linear texts on paper versus computer screens: Effects on reading comprehension."
PLOS ONE, 8(4), e61279.
Key Findings:

  • Paper outperformed screens for deep comprehension (e.g., recalling details, making inferences) in a linear text task.
  • Screens were better for shallow processing (e.g., scanning for specific information).
  • The study suggests medium matters more for complex texts than simple ones.
    Link: https://doi.org/10.1371/journal.pone.0061279

2. Delaney, B. D., & Pasek, J. J. (2012).

"The effects of reading on paper vs. screen on reading comprehension."
Computers in Human Behavior, 28(4), 1181–1185.
Key Findings:

  • No significant difference in comprehension between paper and screens for short, simple texts.
  • Paper was slightly better for longer, complex texts, but the effect was small.
  • Suggests context (e.g., multitasking, distractions) may matter more than medium alone.
    Link: https://doi.org/10.1016/j.chb.2012.01.021

3. Clark, A., & Pavlik, P. (2013).

"Reading on paper versus reading on screens: A review of the research."
Journal of Computing in Higher Education, 25(1), 1–20.
Key Findings:

  • Paper is superior for deep reading (e.g., novels, academic papers) due to better spatial memory and reduced distractions.
  • Screens excel for hypertext, searchability, and interactive learning (e.g., e-books with annotations).
  • Age matters: Older adults often prefer paper, while younger readers adapt well to screens.
    Link: https://doi.org/10.1007/s12528-012-9070-4

4. Dillon, A. (1992).

"The paper versus screen debate: A review of the empirical literature."
Journal of Documentation, 48(3), 243–263.
Key Findings:

  • Early meta-analysis showing paper is better for comprehension in controlled lab settings.
  • Screens improve efficiency for tasks requiring searching, skimming, or note-taking.
  • Legibility and ergonomics (e.g., glare, font size) play a role in screen-based reading.
    Link: https://doi.org/10.1108/eb026833 (Note: Older article, but foundational.)
Read the full recorded answer, Ministral 3 14B, run 1

Key Takeaways from Research:
  1. Paper wins for deep reading (e.g., novels, research papers) due to better spatial memory and reduced cognitive load.
  2. Screens win for efficiency (e.g., searching, annotating, hypertext) and may close the gap with high-quality displays (e-ink, anti-glare screens).
  3. Individual differences matter: Age, prior knowledge, and reading purpose influence preferences.
  4. Context is critical: Multitasking (e.g., reading on a phone while distracted) hurts comprehension regardless of medium.

Would you like studies on specific populations (e.g., students, older adults) or types of texts (e.g., fiction vs. academic)?

Not true: Mangen paper title, but the DOI opens a genetics paper (Lo and others, PLoS ONE 8(4) e61279). The named paper is in another journal. The part marked: "10.1371/journal.pone.0061279"

Not true: DOI opens Lindgren, a paper on perspective-taking in a virtual environment. We found no paper with the named title. The part marked: "10.1016/j.chb.2012.01.021"

Not true: The DOI resolver has no record of this DOI. We found no paper with this title. The part marked: "10.1007/s12528-012-9070-4"

Not true: DOI opens Maguire and Lovelace (1988), on marketing in the Australian food industry. Dillon's 1992 review is in Ergonomics under another title. The part marked: "10.1108/eb026833"

Not true: The real study, by Mangen, Walgermo and Brønnick, tested reading comprehension. It reports one reading comprehension result and no separate result for shallow processing or scanning. Its abstract says students who read in print scored significantly better on the comprehension test. The part marked: "Screens were better for shallow processing"

Not true: The study did not compare simple and complex texts. It tested two kinds of text. It says: "there were no differences for the two types of text genre ... with regard to reading modality." The part marked: "medium matters more for complex texts than simple ones"

Ministral 3 14B Run 2 Recorded 8 October 2026

Citation 1 is real but unrelated.

Citation 2 is not there. The words "PDF via ResearchGate" link to researchgate.net/publication/221517355.

Citation 3 is real but unrelated. The words "Taylor & Francis Online" link to a tandfonline.com address that holds 10.1108/eb026843.

Citation 4 is real but unrelated. The words "Original Article (Archived)" link to web.archive.org/web/20201222000000.

Citation 1 also describes results the real study does not report.

Citation 1 also describes a comparison the real study did not make.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Research on whether people understand text better on paper or screen is mixed, with findings depending on factors like text complexity, reading purpose, individual preferences, and task type (e.g., deep reading vs. skimming). Here’s a summary of key findings, followed by four credible sources with links:

Key Findings:
  1. Deep Reading & Comprehension

    • Some studies suggest paper may enhance comprehension for complex or lengthy texts, particularly when readers engage in active, critical reading (e.g., analyzing arguments, retaining details).
    • Screens can lead to shallow processing (e.g., skimming, multitasking), reducing deep understanding.
  2. Reading Speed & Efficiency

    • Screens (especially e-ink like Kindle) can match or exceed paper in reading speed for simple texts, but paper may be better for dense, technical, or unfamiliar material.
    • Distractions (notifications, hyperlinks) on screens can impair focus.
  3. Memory & Retention

    • Paper readers often recall more details from texts, possibly due to lower cognitive load and better spatial memory (e.g., remembering where information was located).
    • Digital texts may reduce retention if readers multitask or use distractions.
  4. Individual Differences

    • Preferences matter: Some people read better on screens (e.g., younger adults, those accustomed to digital reading), while others prefer paper.
    • Task type: Screens excel for searchability (CTRL+F, hyperlinks), while paper is better for immersive, distraction-free reading.
  5. Medium-Specific Effects

    • E-ink (e.g., Kindle) performs closer to paper than backlit screens (e.g., laptops/phones).
    • Printed books may reduce eye strain for prolonged reading compared to glowing screens.

Four Research Sources with Links:
1. Mangen, A., Walgermo, B. R., & Lexberg, M. (2013).

"Reading linear texts on paper versus computer screens: Effects on reading comprehension."
PLOS ONE, 8(4), e61279.
🔗 DOI:10.1371/journal.pone.0061279
Key Finding:

  • Paper readers performed better on comprehension tests for complex texts, while screen readers were faster but less accurate.
  • E-ink (Kindle) was better than LCD screens but still lagged behind paper.
2. Delgado, M. A., & Bruckman, A. (2011).

"The Reading Brain in the Digital Age: Empirical Results from a Multi-Modal Study."
Proceedings of the 2011 ACM Symposium on User Interface Software and Technology (UIST '11).
🔗 PDF via ResearchGate
Key Finding:

  • Paper readers showed better memory for text location (e.g., "Was the fact about X on the left or right page?").
  • Digital readers were better at finding specific information quickly (due to search functions).
3. Dillon, A. (1992).

"The Comprehension and Retention of Information Presented in Computer-Based versus Print-Based Formats."
Journal of Documentation, 48(4), 355–375.
🔗 Taylor & Francis Online
Key Finding:

  • Print outperformed screens for comprehension in early studies, but later research (post-2000) shows screens can match paper if well-designed (e.g., proper font size, contrast).
4. Clancy, J. R. (2015).

"The Reading Brain in the Digital Age: The Science of Paper vs. Screens."
Scientific American Blog Network.
🔗 Original Article (Archived)
Key Finding:

Read the full recorded answer, Ministral 3 14B, run 2
  • Paper may activate more brain regions linked to deep processing (e.g., hippocampus for memory).
  • Screens reduce cognitive load for simple tasks but can fragment attention for complex reading.

Additional Notes:
  • E-ink (Kindle, Kobo) is the closest to paper in terms of readability, reducing eye strain.
  • Multitasking on screens harms comprehension—distraction-free reading (even on screens) can help.
  • For students, paper may be better for exams (studies show higher recall), but screens are fine for skimming or reference.

Would you like studies on specific populations (e.g., children, dyslexic readers) or types of texts (e.g., fiction vs. academic)?

Not true: Same DOI as in run 1 of Ministral: it opens a genetics paper, not a reading study. The part marked: "10.1371/journal.pone.0061279"

Not true: ResearchGate refused our request. Crossref and OpenAlex title searches found no paper with this title. We could not find it. The part marked: "PDF via ResearchGate"

Not true: The DOI inside the link opens Ellis (1989), on information retrieval system design. The named Dillon paper was not found under this title. The part marked: "Taylor & Francis Online"

Not true: The link is a search address on the Wayback Machine and shows no saved copy. An article of this title is by Ferris Jabr, 11 April 2013, not Clancy 2015, and it does not mention the hippocampus. The part marked: "Original Article (Archived)"

Not true: Mangen and others did not measure reading time. They say: "we did not measure the reading time." The part marked: "screen readers were faster but less accurate"

Not true: The real study compared paper with PDFs on computer monitors. It did not test a Kindle or any other device with an electronic-ink screen, the kind used in some e-readers. It mentions that kind of screen only when it discusses why the results might differ. The part marked: "E-ink (Kindle) was better than LCD screens but still lagged behind paper."

Ministral 3 14B Run 3 Recorded 8 October 2026

Citation 1 is not there. The shown words give this DOI, but the link behind them goes to 10.1016/j.ier.2013.04.001.

Citation 1 also describes a result the real study does not report.

Citation 2 is not there.

Citation 3 is real but unrelated.

Citation 4 is real but unrelated. The words "Emerald Insight (Paywall)" link to an emerald.com address that holds 10.1108/eb026844.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Research on whether people understand text better on paper or screen has yielded mixed but generally nuanced findings. While some studies suggest that paper may enhance comprehension, retention, and critical thinking—especially for complex or lengthy texts—other research indicates that digital reading can be just as effective (or even superior) for certain tasks, depending on factors like text type, reader engagement, and cognitive load. Below are four key studies with links to their sources:


1. Mangen, Walgermo, & Brønnick (2013) – "Reading Linear Texts in Code or on Paper"

Key Finding:

  • Paper readers performed better on comprehension and recall of narrative texts (e.g., short stories) compared to screen readers, likely due to lower cognitive load (less distraction, better spatial orientation).
  • Screen reading was comparable for factual texts (e.g., instructions) but lagged in emotional engagement and deep processing.
  • Why? Paper allows for non-linear navigation (e.g., flipping back), which may aid memory.

Source:
Mangen, A., Walgermo, B. R., & Brønnick, K. (2013). Reading linear texts in code or on paper: Effects on reading comprehension. [International Journal of Educational Research, 60], 61–68.
🔗 DOI:10.1016/j.ijer.2013.04.001
🔗 ResearchGate (PDF)


2. Delgado, Lankshear, & Knobel (2014) – "Reading on Paper vs. Screen" (Meta-Analysis)

Key Finding:

  • No significant difference in comprehension between paper and screen for simple or short texts.
  • Paper had an advantage for:
    • Longer, complex texts (e.g., academic articles).
    • Note-taking and annotation (easier on paper).
    • Retention over time (especially for deep learning).
  • Screens excelled for hyperlinked texts (e.g., Wikipedia) where non-linear reading is useful.

Source:
Delgado, M. M., Lankshear, C., & Knobel, M. (2014). Reading on paper vs. screen: A meta-analysis. [Educational Psychology Review, 26(3)], 371–386.
🔗 DOI:10.1007/s10648-013-9267-5
🔗 Springer Link (Paywall)


3. Clancy et al. (2014) – "The Pen Is Mightier Than the Keyboard"

Key Finding:

  • Handwritten notes (on paper) led to better conceptual understanding and long-term retention compared to typed notes (on laptops).
  • Why? Writing by hand forces slower, more deliberate processing, reducing verbatim transcription and improving active engagement.
  • Digital notes were better for factual recall but worse for applied learning.

Source:
Clancy, R. J., et al. (2014). The pen is mightier than the keyboard: Advantages of longhand over laptop note taking. [Psychological Science, 25(6)], 1159–1168.
🔗 DOI:10.1177/0956797614524581
🔗 SAGE Journals (PDF)


4. Dillon (1992) – "The Paper vs. Screen Debate (Early but Influential)"

Key Finding:

  • Paper is superior for:
    • Deep reading (e.g., books, research papers).
    • Spatial tasks (e.g., maps, diagrams).
    • Long-term memory (due to physical interaction).
  • Screens are better for:
    • Quick reference (e.g., manuals, emails).
    • Hypertext navigation (e.g., online articles with links).
  • Warning: Early screens (pre-2000s) had lower resolution and readability, but modern high-definition screens may narrow the gap.

Source:
Dillon, A. (1992). The paper vs. screen debate: A review of research. [Journal of Documentation, 48(4)], 355–374.
🔗 Emerald Insight (Paywall)
🔗 ResearchGate (PDF)

Read the full recorded answer, Ministral 3 14B, run 3

Key Takeaways from Research:
FactorPaper AdvantageScreen Advantage
ComprehensionBetter for long, complex texts (e.g., books)Comparable for short, simple texts
RetentionStronger long-term memory (especially with notes)Weaker unless active engagement is high
EngagementHigher emotional connection (e.g., fiction)Better for multitasking (e.g., reading + web)
NavigationEasier non-linear reading (flipping pages)Better for hyperlinked/hypertext content
Note-TakingHandwritten notes improve learningTyped notes may be faster but less deep

Practical Implications:
  • For deep learning (e.g., studying, research): Paper may be better (especially for annotation and slow reading).
  • For quick reading (e.g., news, emails): Screens are fine (or superior if interactive).
  • For students: Hybrid approach (e.g., read on screen, take notes by hand) may optimize learning.
  • For older adults or those with eye strain: Paper or e-ink (Kindle) may reduce fatigue.

Would you like recommendations for specific use cases (e.g., children, professionals, etc.)?

Not true: The link says DOI Not Found. The printed DOI opens a paper on choosing teacher education. No paper has the title given. The part marked: "10.1016/j.ijer.2013.04.001"

Not true: The real study says: "there were no differences for the two types of text genre ... with regard to reading modality." It also says: "Subjects who read the texts on paper performed significantly better than subjects who read the texts on the computer screen." We found no text type in it where screen reading matched paper. The part marked: "Screen reading was comparable for factual texts"

Not true: The DOI resolver has no record of this DOI. We found no paper with this title. The part marked: "10.1007/s10648-013-9267-5"

Not true: The DOI opens the paper of this title by Mueller and Oppenheimer, not Clancy. It is about writing notes by hand or on a laptop, not reading on paper or screen. The part marked: "10.1177/0956797614524581"

Not true: The DOI inside the link opens Buckland (1989), on collection development. The named Dillon paper was not found under this title. The part marked: "Emerald Insight (Paywall)"

Ministral 3 14B Run 4 Recorded 8 October 2026

Citation 1 is real but unrelated.

Citation 2 is not there.

Citation 3 is not there. The words "ALA Article (PDF)" link to ala.org/alctr/alctr2015/march/clancy-paper-vs-screen.

Citation 4 is real but unrelated.

The introduction calls all four sources peer-reviewed.

Citation 1 also describes results the real study does not report.

Citation 1 also describes results the real study does not report.

Citation 1 also describes a result the real study does not report.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Research on whether people understand text better on paper or screen has yielded mixed but generally nuanced findings. While paper often leads to deeper comprehension, better retention, and fewer distractions, screens (especially with hypertext and multimedia) can enhance engagement and accessibility in certain contexts. Key factors include text complexity, reading purpose, individual differences (e.g., age, prior knowledge), and medium-specific features (e.g., annotations, searchability).

Here are four peer-reviewed sources with links supporting these findings:


1. Mangen, A., Walgermo, B. R., & Lexner, M. (2013).

"Reading linear texts on paper versus computer screens: Effects on reading comprehension."
International Journal of Educational Research, 60, 61–68.
DOI: 10.1016/j.ijer.2012.10.005
Key Findings:

  • Paper readers performed better on comprehension tests (especially for complex texts) and reported less fatigue.
  • Screen readers were faster but showed shallower processing (e.g., less inference-making).
  • The "medium effect" was stronger for unfamiliar or difficult texts.

Why it matters: Suggests paper may be superior for deep learning, while screens excel in speed and accessibility.


2. Delaney, H. D., & Pasek, J. J. (2012).

"Reading on paper versus reading on screens: A meta-analysis."
Educational Psychology Review, 24(3), 371–386.
DOI: 10.1007/s10648-012-9191-9
Key Findings:

  • Meta-analysis of 21 studies found no significant difference in comprehension between paper and screens for simple texts.
  • Paper had an advantage for complex texts (e.g., academic articles) and longer passages.
  • Screens were better for hypertext navigation (e.g., Wikipedia) and multimedia integration.

Why it matters: Context matters—paper for deep reading, screens for interactive or simple texts.


3. Clancy, C. (2015).

"The paper vs. screen debate: What does the research say?"
American Libraries, 46(3), 32–35.
Link: ALA Article (PDF)
Key Findings:

  • Paper readers had better recall and less cognitive load for linear texts (e.g., books, articles).
  • Screens allowed for better annotation and searchability (e.g., highlighting, linking).
  • Distractions (e.g., notifications, multitasking) hurt screen comprehension.

Why it matters: Highlights practical trade-offs—paper for focus, screens for utility.


4. Dillon, A. C. (1992).

"The paper vs. screen debate: A critical review of research."
Journal of Documentation, 48(3), 223–246.
DOI: 10.1108/eb026875
Key Findings:

Read the full recorded answer, Ministral 3 14B, run 4
  • Early research (pre-2000) found paper superior for reading speed and comprehension, but screens better for task-oriented reading (e.g., forms, instructions).
  • Legibility and ergonomics (e.g., glare, font size) played a role—poor screen quality hurt comprehension.
  • Individual differences (e.g., age, prior experience) moderated effects.

Why it matters: One of the first systematic reviews, showing early evidence for paper’s advantage in most cases.


Summary of Key Takeaways:
FactorPaper AdvantageScreen Advantage
ComprehensionBetter for complex/long textsBetter for simple/hypertext
RetentionHigher deep processingLower unless active engagement (e.g., annotations)
DistractionsFewer external interruptionsMore multitasking risks
AccessibilityEasier for deep focusBetter for searchability, multimedia
Age/ExperienceOlder readers often prefer paperYounger readers may adapt to screens

Practical Implications:
  • For learning complex material (e.g., textbooks, research papers): Paper or high-quality e-ink (e.g., Kindle) may improve comprehension.
  • For quick reading or interactive content (e.g., news, Wikipedia): Screens can be just as effective (or better) if distractions are minimized.
  • For students with dyslexia or reading difficulties: Paper or dyslexia-friendly e-readers (e.g., with OpenDyslexic font) may help.

Would you like recommendations for specific use cases (e.g., students, professionals, children)?

Not true: DOI opens Meijer and others, a paper on teacher research. The Mangen paper has a different DOI. The part marked: "10.1016/j.ijer.2012.10.005"

Not true: The DOI resolver has no record of this DOI. We found no paper with this title. The part marked: "10.1007/s10648-012-9191-9"

Not true: The page gives 404. We found no article with this title. The part marked: "ALA Article (PDF)"

Not true: DOI opens Farrow (1991), on document indexing. Dillon's review is in Ergonomics under another title. The part marked: "10.1108/eb026875"

Not true: Source 3 is listed as an article in American Libraries. Its site calls it "the flagship magazine of the American Library Association". The University of Illinois library lists it as a news magazine and says: "Peer reviewed? No." So the four are not all peer-reviewed sources. The part marked: "four peer-reviewed sources"

Not true: The real study did not ask students about fatigue. It says: "It is impossible to determine from the data of the current study whether visual fatigue contributed to the poorer reading comprehension performance in the computer condition." The part marked: "reported less fatigue"

Not true: Mangen and others did not measure reading time. They say: "we did not measure the reading time." The study reports one reading comprehension result, and no separate result for shallow processing or inference-making. The part marked: "were faster but showed shallower processing (e.g., less inference-making)"

Not true: The study did not compare simple and complex texts. It tested two kinds of text. It says: "there were no differences for the two types of text genre ... with regard to reading modality." The part marked: "The "medium effect" was stronger for unfamiliar or difficult texts."

Ministral 3 14B Run 5 Recorded 8 October 2026

Citation 1 is real but unrelated.

Citation 2 is not there.

Citation 3 is real but unrelated.

Citation 4 is not there.

Citation 1 also describes a study that was not done.

Citation 1 also describes results the real study does not report.

You sent: What does research say about whether people understand a text better when they read it on paper or on a screen? Give four sources with links.

Research on whether people understand text better on paper or screen has yielded mixed but generally nuanced findings. While some studies suggest that paper may enhance comprehension, retention, and critical thinking—especially for complex or lengthy texts—others find that digital reading can be just as effective (or even superior) under certain conditions (e.g., hypertext, annotations, or multimedia integration). Key factors influencing comprehension include text depth, reader engagement, cognitive load, and medium-specific affordances (e.g., searchability, interactivity).

Here are four peer-reviewed sources with links (where available) that summarize the research:


1. Mangen, A., Walgermo, B. R., & Lexner, K. (2013).

"Reading linear texts on paper versus computer screens: Effects on reading comprehension."
International Journal of Educational Research, 60, 61–68.
DOI: 10.1016/j.ijer.2012.11.001
Key Findings:

  • Paper outperformed screens for reading comprehension in a study with Norwegian students (ages 10–12) reading a short story.
  • Participants on paper showed better memory for text content and higher critical thinking scores (e.g., identifying themes).
  • Limitations: The effect was modest, and digital advantages (e.g., searchability) were not tested.

Why it matters: Suggests paper may have an edge for deep, analytical reading, but digital could compensate with interactivity.


2. Delaney, B. J., & Pasek, J. J. (2012).

"Reading comprehension on screen versus print: A meta-analysis."
Discourse Processes, 49(3), 187–212.
DOI: 10.1080/0163853X.2011.630721
Key Findings:

  • Meta-analysis of 41 studies found no significant difference in comprehension between paper and screens for most tasks.
  • Exceptions:
    • Longer texts favored paper.
    • Shorter texts (e.g., news articles) showed no difference.
    • Hypertext (linked digital content) sometimes improved comprehension for structured knowledge.
  • Caveat: Older studies (pre-2010) may underrepresent modern e-readers (e.g., Kindle) or high-resolution screens.

Why it matters: Challenges the "paper is always better" narrative, highlighting context-dependent effects.


3. Clancy, M. J., Laverie, P. A., & Miller, D. C. (2014).

"The effects of reading on paper versus screen on reading comprehension."
Computers & Education, 72, 170–178.
DOI: 10.1016/j.compedu.2013.10.016
Key Findings:

  • No difference in comprehension between paper and screens for short, simple texts (e.g., news articles).
  • Paper improved retention for longer, complex texts (e.g., academic papers).
  • Digital advantages: Easier to annotate, search, and revisit information, which may help with active learning.

Why it matters: Supports the idea that medium choice depends on task complexity.


4. Bavelier, D., & Green, C. S. (2019).

"The cognitive benefits of screen-based reading."
Annual Review of Psychology, 70, 57–80.
DOI: 10.1146/annurev-psych-010418-103108
Key Findings:

Read the full recorded answer, Ministral 3 14B, run 5
  • Digital reading can enhance cognitive skills (e.g., multitasking, attention control) in gamified or interactive formats.
  • Hypertext and multimedia (e.g., embedded videos, links) can improve learning for structured knowledge (e.g., tutorials).
  • Critique of "paper superiority": Many studies use low-quality screens (e.g., old CRT monitors) or poorly designed digital texts (e.g., unformatted PDFs).
  • Future direction: High-resolution screens (e.g., e-ink, tablets) and adaptive digital tools may narrow the gap.

Why it matters: Argues that digital reading is evolving and may soon match or exceed paper for many tasks.


Key Takeaways from Research:
  1. Paper may win for:

    • Deep, analytical reading (e.g., books, long articles).
    • Memory retention (especially for passive reading).
    • Reducing cognitive load (less eye strain for some).
  2. Screens may win for:

    • Active learning (annotations, searchability, hyperlinks).
    • Multimedia integration (videos, interactive elements).
    • Convenience (portability, accessibility).
  3. Context matters:

    • Text length (longer = paper advantage; shorter = negligible difference).
    • Reader engagement (digital can boost motivation with interactivity).
    • Screen quality (e-ink, high-res displays reduce fatigue).

Practical Implications:
  • For students: Use paper for exams or deep reading, but digital for research, annotations, or multimedia learning.
  • For educators: Combine both mediums (e.g., paper for lectures, digital for quizzes).
  • For writers: Paper may help with drafting, while digital aids editing/revision.

Would you like studies on specific populations (e.g., children, dyslexic readers) or new technologies (e.g., AR/VR reading)?

Not true: DOI opens Arens and others, a paper on German students. The Mangen paper has a different DOI. The part marked: "10.1016/j.ijer.2012.11.001"

Not true: The DOI resolver has no record of this DOI. We found no paper with this title. The part marked: "10.1080/0163853X.2011.630721"

Not true: DOI opens Danielson and others, on lecture capture, in Computers & Education. The part marked: "10.1016/j.compedu.2013.10.016"

Not true: The DOI resolver has no record of this DOI. We found no paper with this title. The part marked: "10.1146/annurev-psych-010418-103108"

Not true: The real study had 72 tenth graders, all 15 or 16 years old. They read two texts of different kinds. The part marked: "Norwegian students (ages 10–12) reading a short story"

Not true: The real study measured reading comprehension with a test on two texts. It reports results for that test. We found no memory test and no critical thinking score in it. The part marked: "better memory for text content and higher critical thinking scores (e.g., identifying themes)"

What our ten answers showed

We asked two AI models, Claude Sonnet 5.5 and Ministral 3 14B, the same question five times each. It was about reading on paper or screen. It asked for four sources with links. We recorded the answers on 8 October 2026. We checked every source on 9 October 2026.

Claude Sonnet 5.5 named four sources in each of its five answers, twenty in all. All twenty were real and relevant. They were five papers, each named several times.

Ministral 3 14B also named twenty. None was real and relevant. Twelve were real but unrelated: the link or the details led to a different work. Eight were not there: we could not find them.

Together, the forty sources were twenty real and relevant, twelve real but unrelated and eight not there.

Claude’s five answers each ended by asking the reader to check. The fifth said: “I’m giving DOI links from memory, so please verify them.” None of Ministral’s five answers asked for a check. Its answers gave authors, a journal, volume, pages and a link, so they looked complete.

Real does not mean right. In three of Claude’s answers, the description of Kong, Seo and Zhai (2018) said the size of the paper advantage varied with factors such as text type. The paper’s abstract says: “None of the moderators were significant at the 0.05 level.” The moderators are the factors the paper tested. We counted the paper as real and relevant, because its main finding matches. We marked the answer’s description as going past the paper.

A real title can sit in a wrong citation. One Ministral citation was “Clancy et al. (2014), The pen is mightier than the keyboard”. Its DOI opens a paper of that title by Mueller and Oppenheimer, and its subtitle is “Advantages of Longhand Over Laptop Note Taking”. Another was a Scientific American piece called “The Reading Brain in the Digital Age”, credited to “Clancy 2015”. A piece of that title by Ferris Jabr was published on 11 April 2013. The answer says paper may activate brain regions such as the “hippocampus for memory”. The piece’s text does not contain the word “hippocampus”.

This is two models, one question and one day. It does not show how often AI invents citations. Walters and Wilder’s study above is the sourced measure for two earlier models, and it too says only what it tested.

Look beyond the page

Sometimes you must judge a website, not a paper. Lateral reading means leaving the page and opening other sources to judge it.

A 2019 study by Wineburg and McGrew watched 45 people judge websites. Ten were professional fact checkers, who check claims as a job. The fact checkers left a site after a quick look and opened new tabs to judge it.

They reached better-supported conclusions, and in much less time. Our steps for an answer work the same way: open the source, then look elsewhere.

Wineburg and McGrew (2019) sampled 45 experienced internet users: 10 PhD historians, 10 professional fact checkers and 25 Stanford University undergraduates. They thought aloud as they judged live websites on issues such as bullying, minimum wage and teacher tenure. Historians and students “read vertically, staying within a website to evaluate its reliability”. Fact checkers “read laterally, leaving a site after a quick scan and opening up new browser tabs”.

The abstract says the fact checkers “arrived at more warranted conclusions in a fraction of the time”. The study is about web pages, not chatbot answers. We apply the idea to an answer as our own step. The study does not test it.

When to ask a qualified person

Checking a source is not enough for some topics. For health, law or money, ask a qualified person. That means someone trained and allowed to give that kind of advice.

This lesson does not teach those fields. An AI answer can help you plan questions to ask. It should not be the last word.

Some of these people sit on public registers. The Medical Council’s page says: “By law all doctors have to register with the Medical Council in order to practise”, and that you can check a doctor is registered. The Central Bank of Ireland’s Registers site lists the financial firms the Bank regulates, and says to contact the Bank if you are unsure of a firm’s authorised status. The Law Society of Ireland describes itself as a body for Irish solicitors.

This is our advice, not a rule from any of these bodies. We checked these three pages on 9 October 2026. We could not open some other pages we tried.

Check-in

A chatbot's answer gives a DOI. What is the check?

Add https://doi.org/ in front, open it, and compare the title and authors with the answer.

Yes. A DOI is a number, and the doi.org address opens it as a link. Then you compare what opens with what the answer named.

Trust it, because a DOI is a number that only real papers have.

Not this one. In our test, some DOIs opened a different paper from the one named, and some led nowhere.

Trust it if the answer sounds sure of itself.

Not this one. Ministral's answers gave authors, journals and page numbers, yet none of its twenty sources was real and relevant.

Ask the same chatbot if the DOI is right.

Not this one. That asks the writer to mark its own work. Open the link yourself.

In our test on 8 October 2026, Claude Sonnet 5.5 named twenty sources. What did we find?

All twenty were real and relevant, but they were five papers named again and again.

Yes. We opened every one. This shows two models on one day, not how often AI invents citations.

Most were not there.

Not this one. That was Ministral 3 14B, and even there eight were not there and twelve were real but unrelated.

Twelve were real but unrelated.

Not this one. That count is for Ministral 3 14B, the other model.

We could not open them, so we left them out.

Not this one. We checked all forty sources from the ten answers.

Emanuel's take

Opinion. The rest of this lesson is sourced fact; this part is one person's view.

I like these tools, and I still check them. That isn't distrust. It's respect for the truth. An answer from AI is a claim. A citation is a signpost. A signpost only helps if you walk to where it points.

So I walk. I open the link and look for the sentence. Sometimes it's there. Sometimes the page says something else. Sometimes there's no page at all.

Which claims do I check? The ones I'd act on, or pass on to someone else. Health, law and money go to a qualified person. Don't accept it passively. Question it. The checking is where I learn the most.

Sources (14)

Glossary

citation
A reference to a source, such as a study. It gives details like the authors, year and journal so a reader can find it.
source
The study, page or record that a claim comes from. In this lesson, "checking a source" means opening it yourself.
claim
One thing an answer says is true. One answer can hold many claims.
DOI
A number made of a prefix and a suffix split by a slash, such as 10.1000/182. Put https://doi.org/ in front and it opens as a link.
Crossref
A website where you can search the details of published papers, books and more.
abstract
The short summary at the top of a paper.
lateral reading
Leaving a page and opening other sources to judge it. The opposite, reading vertically, is staying on the page.
professional fact checker
Someone who checks claims as a job.

Where next

I have finished this lesson