Data Analysis

Turn an ACS user note into a study-specific limitation

Match the scope of the notice

List the survey periods, items and geographies that contribute to each primary result. Find notes for the relevant collection years and read the actual qualification: a change in controls, collection conditions, weighting or question wording affects different parts of the analysis. A methodological note does not necessarily mean that a file is erroneous.

Specify a consequence you can check

Create three columns: result, plausible consequence and action. Wider sampling margins might warrant displaying uncertainty more prominently. A definition change may make a trend inappropriate even when both margins are small. If you cannot establish comparability, retain the two point estimates as separate descriptions and explain why the change is not estimated.

Hypothetical sensitivity check

A report contains eight area estimates; three use a product affected by a specific notice. Flag those three, leaving five unflagged. Show the complete analysis and a planned sensitivity analysis restricted to the five if the restriction still addresses a meaningful question. Do not infer the direction of bias from the number of flagged areas.

Write one sentence naming the affected release and result, then one stating what was done. For example, “The two periods used different category definitions, so the table reports separate estimates without a trend contrast.” Save the notice URL and checking date to let another analyst revisit the decision.

Primary source checked 7 November 2026: U.S. Census Bureau: ACS user notes by data collection year.

Use this in your study: Download: Survey uncertainty register.

Related reading

Reading path: Interpret results. Guide 6 of 6. Choose any guide to suit your project.

Statistical Methods

Assess Measurement Agreement Beyond Correlation

Plan paired differences, limits of agreement, and acceptable error before comparing two measurement methods.

Statistical Methods

Translate Likelihood Ratios into Post-Test Probability

Check the pretest estimate and test context before converting diagnostic likelihood ratios into probabilities.

Browse this reading pathTools for this stageGuides and downloads for this stage