Midterms 2026See who we think should earn your vote, based on our standardsThe guide →
WRITTEN IN PLAIN AMERICAN ENGLISH.
CLAY TRIBUNE.
Advertisement

Study Shows Objective Text Difficulty Scores Track Readers’ Perceptions—Up to a Point

A study finds English text difficulty measured objectively and subjectively agree in the middle but diverge at the extremes.

By mitch·4 min read
A book lies open upon a desk, its pages suggesting the complexity of its contents.

English teachers have long argued over what makes a book too hard for a student. Is it the words themselves? The length of the sentences? The ideas packed into each paragraph? Now a new study, published in the journal Reading and Writing, has put those questions to the test. And the answer, it turns out, is both simpler and stranger than anyone expected.

The researchers looked at two ways of measuring text difficulty: the objective kind, which counts words and sentences, and the subjective kind, which asks readers themselves how hard a passage feels. They found that the two measures track each other — up to a point. After that, they diverge wildly.

The Two Measures of Difficulty

Objective measures of text difficulty have been around for decades. Researchers count the number of syllables in words, the length of sentences, the frequency of rare vocabulary, and more. These numbers add up to a score that tells you, in theory, how demanding a passage is.

Advertisement

Subjective measures, by contrast, ask the reader directly. Give someone a page of prose and ask them to rate it on a scale from easy to hard, and you get a completely different picture. One person’s breeze is another person’s slog.

The study found that these two approaches agree in the middle range. But as you move toward the extremes, the two readings start to drift apart.

What the Study Found

The researchers did not set out to prove anything about reading comprehension or learning outcomes. Their goal was narrower: to see whether the two measures of difficulty lined up, and by how much.

The measures correspond to some extent before they diverge. That is, the two measures move together in the middle range. But the correspondence is not strong enough to treat one as a proxy for the other.

The divergence matters because it suggests that the tools researchers and educators rely on may miss something essential about how students actually experience a text. A passage that looks straightforward on paper can feel overwhelming in practice, and vice versa.

Why This Matters for Teachers

The finding has practical implications for anyone who chooses reading material. A teacher picking a novel for a class might look at the word count and assume the text is accessible. The study suggests that assumption could be wrong.

The study does not address standardized tests, but the principle applies broadly. If difficulty is partly in the eye of the beholder, then a test that relies solely on objective metrics may not capture the full picture of what students can handle.

The Limits of Objectivity

The study does not resolve the question of which measure is better. It simply shows that both exist, and that neither fully captures the whole truth.

What the study does offer is a reminder that reading is a personal act. Two people can read the same page and walk away with entirely different impressions of how hard it was. That difference matters for teaching, testing, and even for the students themselves, who need to know what they are capable of.

The study is a small step, but it is an honest one. It does not claim that objective measures are useless or that subjective ones are everything. It claims only what it can prove: that the two measures move together, but they do not always meet.

A Note on the Journal

The study was published in Reading and Writing, a peer-reviewed academic journal. That means the findings have been reviewed by other experts in the field before publication.

For anyone who teaches English or works with language learners, the takeaway is simple: trust the data, but listen to the reader. Objective measures are a starting point, not a destination. The final verdict belongs to the person doing the reading.

Measure Focus How It Works
Objective Text features Word count, sentence length, vocabulary rarity
Subjective Reader perception Self-reported difficulty rating

The study does not settle the question of which measure is better. It simply shows that both exist, and that neither fully captures the whole truth. The divergence matters because it suggests that the tools researchers and educators rely on may miss something essential about how students actually experience a text.

Source material: “Subjective and objective difficulty of English texts are related—but not the same,” Phys.org.

The Notebook

Get the Notebook.

The day's best stories and every fresh verdict, in plain English, in your inbox by seven. One email a day, no more.

We send one note to confirm. Every issue has a one-click way out.

Advertisement

Leave a Reply

Your email address will not be published. Required fields are marked *

As an Amazon Associate, Clay Tribune earns from qualifying purchases.