Which Country Has the Best Education? It Depends Who You Ask

Five methodological choices that reshape international learning rankings

International education rankings shape billions in policy spending. But the rankings depend as much on measurement design as on educational quality. Five methodological choices — each defensible, none neutral — produce substantially different answers.

24
Position rank swing for the US across PISA subjects
82 pts
Score gap, same country on PISA vs TIMSS math
81 pts
China's single-cycle math swing from sampling changes

1. Which subject? A 24-position swing

PISA tests three subjects: mathematics, reading, and science. A country's ranking changes dramatically depending on which one you report. In PISA 2018, 26% of countries shifted 10 or more positions depending on subject. The average rank span was 6.9 positions.

The United States illustrates the extreme: 37th in mathematics but 13th in reading. Vietnam: 4th in science, 24th in math. The Netherlands: 8th in math, 27th in reading. Which subject gets the headline determines what the public "knows" about educational quality.

Subject choice reshuffles country rankings
PISA 2018 — rank in each subject (1 = highest). Dot span shows the measurement choice effect.
Math Reading Science
Show data table
CountryMath rankReading rankScience rankSpan
United States37131824
Vietnam2414420
Netherlands8271519
Switzerland10292319
Kazakhstan54696815
New Zealand27121215
Albania48625914
Chile58444514
Ireland2082214
Thailand56675314
Denmark12182513
Jordan64565113

2. Which test? PISA and TIMSS disagree

Even for the same subject (mathematics), different assessments produce different rankings. In 2015, 28 countries participated in both PISA and TIMSS. The average score gap was 30 points — despite both using ~500-point scales.

Kazakhstan ranks 19th on PISA but 6th on TIMSS — a 13-position difference. The US: 18th on PISA, 9th on TIMSS. Korea scores 524 on PISA but 606 on TIMSS — an 82-point gap for the "same" subject. PISA measures "mathematical literacy" (applied problems); TIMSS tests curriculum-based knowledge. The assessment you cite is a choice about what "mathematics ability" means.

Same subject, different test, different answer
PISA vs TIMSS 8th-grade math scores, 2015. Both use ~500-point scales.
PISA score TIMSS score
Show data table
CountryPISATIMSSGap
Korea52460682
Kazakhstan46052868
Singapore56462157
Japan53258654
Georgia40445349
United States47051848
Hong Kong54859446
Lebanon39644246
Russia49453844
Israel47051141
Turkey42045838
UAE42746538

3. Which cycle? An 81-point swing from design changes

PISA scores should reflect educational change over time. But some of the largest swings correlate with assessment design changes, not educational shifts.

China scored 613 in math in 2012 (highest in the world), dropped to 531 in 2015 (−81 points), then recovered to 591 in 2018 (+60 points). These swings represent changes in which provinces were sampled, not educational revolution and collapse. Across all 1,006 country-subject-cycle observations, 44 swings (4.4%) exceed 30 points — implausible as actual learning changes in a three-year window.

Largest single-cycle PISA swings
Point change between consecutive PISA rounds. A 30-point swing in 3 years is implausible as real educational change.
Show data table
CountrySubjectPeriodChange
ChinaMath2012–2015−81
ChinaReading2012–2015−76
PeruMath2000–2009+73
ChinaScience2015–2018+73
ChinaScience2012–2015−62
ChinaReading2015–2018+61
ChinaMath2015–2018+60
QatarReading2006–2009+60
KazakhstanScience2015–2018−59
QatarMath2006–2009+50
TurkeyReading2012–2015−47
ArgentinaReading2000–2006−45

4. Which assessment system? Parallel measurement universes

The most consequential measurement choice may be the most invisible: which assessment a country participates in at all.

PISA covers 85 countries (mostly OECD and middle-income). TIMSS covers 64. SACMEQ covers 14 Southern and Eastern African countries. The overlap between PISA and SACMEQ is exactly one country (South Africa). Zero countries participate in all three. Eleven African countries — Kenya, Uganda, Tanzania, Malawi, Zambia, and others — exist in a measurement universe entirely disconnected from PISA. A Kenyan student's learning outcomes literally cannot be compared to a Finnish student's using the same test.

Assessment coverage and overlap
Number of countries participating in each assessment system
85
PISA countries
64
TIMSS countries
14
SACMEQ countries
51
PISA ∩ TIMSS
1
PISA ∩ SACMEQ
0
All three

SACMEQ-only (incomparable to PISA): Kenya, Uganda, Tanzania, Malawi, Zambia, Zimbabwe, Mozambique, Namibia, Eswatini, Lesotho, Seychelles

5. How precise? 29% of countries are statistically tied

In PISA Math 2018, 23 countries — 29% of participants — score within 15 points of the OECD average (489). The range from 478 (United States) to 502 (Sweden) contains countries that could plausibly swap positions with any neighbour. The league-table format presents these statistically indistinguishable countries as having clear ordinal relationships.

23 countries within one standard error of the OECD average
PISA Math 2018 — scores within 15 points of 489. These countries are statistically indistinguishable.
Show data table
CountryScoreDiff from avg
Sweden502+13
United Kingdom502+13
Norway501+12
Germany500+11
Ireland500+11
Czechia499+10
Austria499+10
Latvia496+7
Vietnam496+7
France495+6
Iceland495+6
New Zealand494+5
Portugal492+3
Australia491+2
Russia488−1
Italy487−2
Slovakia486−3
Luxembourg483−6
Spain481−8
Lithuania481−8
Hungary481−8
United States478−11

The measurement layer in education

These five choices — subject, assessment, cycle design, assessment system, and statistical precision — form an education measurement layer that sits between the question ("which countries have the best education?") and the answer. None of the choices are wrong. But they are invisible to the typical consumer of education rankings.

This pattern is not unique to education. In earlier analyses, we found the same structure in IATI aid data (21% measurement artifact), governance indicators (43% of country pairs have overlapping confidence intervals), and poverty statistics (a 240× range from methodological choices alone). The measurement layer is a general feature of international development data.

Education rankings are useful, but only when the measurement choices are visible. When citing PISA scores, specify the subject, the year, and the participant pool. When comparing countries, check whether they took the same test. When tracking trends, distinguish design changes from educational changes. The data measures something real — but what it measures is shaped by how it measures.