Reading Nutrition Evidence: What a Study Can and Cannot Show
A critical-thinking lesson using real food-science examples to separate trials, biomarkers, observational links, mechanisms and hype.
Nutrition headlines are usually written about the most exciting thing a study measured, not the most important thing it showed. Learning to ask what exactly was tested, in whom, and for what outcome is a general skill that works on any claim. This page uses real food-science studies as worked examples. It is educational, not medical advice.
The ladder of evidence
This is a simplified teaching ladder, not a formal hierarchy; findings sit on it, and each rung up is harder to reach and more relevant to your life:
- Test-tube and animal experiments (mechanisms).
- Short-term biomarkers in people: blood pressure, glucose, cholesterol.
- Observational links between diet and outcomes in populations.
- Randomised trials of clinical events: heart attacks, fractures, deaths.
Most food headlines come from the lower rungs. That does not make them worthless; it limits what they can claim. As an analogy only (not evidence), compare the structure of Plato's Divided Line, which ranks kinds of cognition from opinion to knowledge by how well grounded they are.
Worked examples
Flaxseed and blood pressure
Rodriguez-Leyva and colleagues (2013) randomised 110 patients with peripheral artery disease to about 30 g of milled flaxseed daily or placebo for six months. Systolic blood pressure fell more in the flax group. The limits: the dose is much larger than a tablespoon, the patients had a specific disease, and a blood-pressure change is not a measured reduction in strokes. It is not a medication substitute.
Beans and rice
Thompson and colleagues (2012) ran a crossover trial in 17 adults with type 2 diabetes, comparing carbohydrate-matched meals. Rice-and-bean meals produced better after-meal glucose responses on several measures than rice alone, with differences by bean and measure. An acute response after one meal is not disease prevention, and 17 people is small.
Blueberries
Curtis and colleagues (2019) gave 115 adults with metabolic syndrome blueberry powder or placebo for six months. Some vascular and lipid measures improved, but the trial reported no improvement in insulin resistance, its primary outcome. Secondary positives do not erase a null primary result, since testing many outcomes makes some chance findings likely.
Combination diets
The Portfolio diet (Jenkins et al., 2011), DASH (Appel et al., 1997) and PREDIMED (Estruch et al., 2018) changed several foods together. They show that patterns can help; they cannot say which ingredient did the work, so they cannot rank single foods. PREDIMED also had to be republished after randomisation problems were found, an example of science correcting itself.
Food chemistry
Cooking can inactivate myrosinase, the broccoli enzyme involved in forming sulforaphane, and food-chemistry work describes adding a myrosinase source such as mustard seed to restore formation (see the Linus Pauling Institute summary). That is a mechanism. More sulforaphane produced is not proof of fewer cancers.
Extract versus food
Turmeric, amla, black cumin and mushroom findings often use concentrated extracts, cell cultures or animals. A spoonful of spice in a meal is a different dose, form and matrix. A result at the extract level does not transfer to the culinary level without a trial at that level.
Experts disagree
Some clinicians favour restricting nuts and oils for heart disease; the Portfolio and Mediterranean trials include nuts and, in the latter, olive oil. That disagreement is real. Do not count names as votes, and do not treat one popular author's framework as an authority; it is a popular framework to be checked against primary sources. This matters as much as any single study, which is why The Daily Dozen and Roles Over Ingredients presents its checklist as a prompt for variety rather than proof.
A checklist for any claim
- What was measured: a disease event, a biomarker, or a mechanism?
- Who took part, how many, and for how long?
- What was compared with what? Was there a control?
- Was the main outcome the one that improved?
- Was the dose and form like what I would actually eat?
- Is the study funded by someone selling the food?
- Has anyone replicated it?
Peirce's essay on Peirce on the Fixation of Belief explains why this matters: methods of settling belief that ignore external checks (tenacity, authority) produce comfort, not truth. The Socratic elenchus asks the same of a claim: define it and test it. A fuller reading path is in What Does It Take to Know Something?.
Honest uncertainty
Evidence usually yields probabilities, not proofs; see Judgment Under Uncertainty: Probability, Causation and Forecasting. Good practice means forming a hypothesis, deciding what would count against it, and only then looking at the data (Hypotheses, Predictions and Tests). When a result surprises you, use the same method as Evidence-Based Troubleshooting: Separating Explanations: ask what the observation really establishes before choosing the next test.
A final caution that applies to this whole wing: a food ranking is a synthesis, not an experiment, and a transparent method will say so; see How to Rank Foods Honestly: A Transparent Scoring Method. Rankings combine nutrient data, category evidence and usefulness. They are not results of a trial. For the overview of this wing, see Health and Nutrition: Start Here.
Try this
- Take one nutrition headline from this week and find the original paper's abstract. Fill in the checklist above.
- Place the finding on the ladder. What rung is it?
- Write one sentence stating what the study cannot show.
Further reading
- Peirce C. S., "The Fixation of Belief" (1877).
- Plato, Republic, Book VI.
- Rodriguez-Leyva et al. (2013), Hypertension 62:1081-1089.
- Estruch R. et al. (2018), N Engl J Med 378:e34.
- Ioannidis J. P. A. (2018). The challenge of reforming nutritional epidemiologic research. JAMA, 320, 969-970.
Sources
- Rodriguez-Leyva D. et al. (2013). Potent antihypertensive action of dietary flaxseed in hypertensive patients. Hypertension, 62, 1081-1089.
- Thompson S. V., Winham D. M. and Hutchins A. M. (2012). Bean and rice meals reduce postprandial glycemic response in adults with type 2 diabetes: a cross-over study. Nutrition Journal, 11:23.
- Curtis P. J. et al. (2019). Blueberries improve biomarkers of cardiometabolic function in participants with metabolic syndrome: results from a 6-month, double-blind, randomized controlled trial. American Journal of Clinical Nutrition, 109, 1535-1545.
- Jenkins D. J. A. et al. (2011). Effect of a dietary portfolio of cholesterol-lowering foods given at 2 levels of intensity of dietary advice on serum lipids in hyperlipidemia. JAMA, 306, 831-839.
- Estruch R. et al. (2018). Primary prevention of cardiovascular disease with a Mediterranean diet supplemented with extra-virgin olive oil or nuts. New England Journal of Medicine, 378, e34.
- Appel L. J. et al. (1997). A clinical trial of the effects of dietary patterns on blood pressure (DASH). New England Journal of Medicine, 336, 1117-1124.
- Linus Pauling Institute, Oregon State University. Micronutrient Information Center: Isothiocyanates (myrosinase and sulforaphane formation).
- Peirce C. S. (1877). The Fixation of Belief. Popular Science Monthly, 12, 1-15.
- Plato. Republic, Book VI (the Divided Line), 509d-511e.