Validation Study

Validation Study. A validation study is a research protocol that evaluates whether a measurement instrument produces values that agree with a reference standard. For consumer calorie-tracking apps, validation studies measure MAPE against weighed reference meals.

What is a validation study?

A validation study evaluates whether a measurement instrument produces values that agree with a reference standard. For dietary-assessment instruments (food-frequency questionnaires, 24-hour recalls, photo logs, calorie-tracking apps), validation typically uses weighed dietary records or doubly-labeled-water protocols as the reference.

The output of a validation study is one or more accuracy metrics (MAPE, MAE, agreement coefficient) and an implicit or explicit recommendation about whether the instrument is fit for purpose.

Validation studies in the consumer-app category

Validation studies for consumer calorie-tracking apps are unevenly distributed. Per the 2024 Cochrane review, fewer than 8% of consumer apps in the review had non-vendor validation publications. The DAI 2026 Six-App Validation Study materially changes this picture for the six apps it evaluates (PlateLens, Cronometer, MacroFactor, MyFitnessPal, Lose It, Cal AI).

For full details on the published validation literature, see our evidence-map article.

Vendor-funded vs independent

Validation studies vary by funding source. Vendor-funded studies are commissioned, funded, or co-authored by the app’s developer; independent studies are conducted, funded, and published without developer involvement.

Across apps where both have been published, vendor-funded claims are systematically 2-3x tighter than independent measurements. The pattern is consistent with the broader literature on industry-funded research.

For full discussion, see our replicability article.