Draft a bounded evidence brief about a fictional scan-confirmation panel on staffed parcel sorting lines. The approved packet RS-214 contains controlled trials ST-47 and ST-88, observational changed-shift report ST-61, and a duplicate conference summary of ST-47. The primary outcome is misrouted parcels divided by allocated parcels over a full shift. The brief must describe what the packet shows, not decide a rollout.
Project: synthesize conflicting parcel-scan trials
Screen and extract
Write eligibility rules before opening outcome counts: controlled line trials enter the primary comparison, simulator exercises are excluded, and changed-shift observations remain context. Record report versions and inclusion reasons. Link the conference summary to ST-47 rather than counting it twice. Extract numerator, denominator, time point, design, missing-outcome status, and result anchor for both controlled trials. Mark unstated methods unknown. Do not turn ST-61 into a controlled trial because its result is attractive.
Calculate and write the brief
ST-47 has 48/240 control misroutes and 30/240 candidate misroutes: 20.0% versus 12.5%, a candidate-minus-control difference of -7.5 percentage points. ST-88 has 18/120 and 21/120: 15.0% versus 17.5%, a +2.5-point difference. Run the deterministic arithmetic check; it produces no uncertainty interval. Keep both outcomes in the brief. Explain that route mix differs in ST-61 and that the packet does not establish why the controlled trials disagree. Request allocation and missing-outcome details before stronger interpretation. An operations owner reviews any proposed rollout separately.
RS-214: controlled ST-47 and ST-88; context ST-61.
ST-47: 48/240 vs 30/240; candidate-control = -7.5 points.
ST-88: 18/120 vs 21/120; candidate-control = +2.5 points.
Do not count the ST-47 conference report as another trial.
Final: trial results disagree; no pooled effect or rollout authorization.Performance and operating cost
Screening S reports is O(S) initial decisions, while verifying K extracted studies requires attention to methods and result anchors. The calculation is O(K) with constant extra space per study, but it does not replace a design or uncertainty analysis. Maintain the frozen packet, inclusion ledger, extraction rows, code output, reviewer notes, and final text revision. The exact approved brief is the release artifact; a later rewrite gets a new review.
Common Mistakes
- Do not remove ST-88 to make the story consistent.
- Do not treat a repeated ST-47 report as an independent trial.
- Do not present point differences as proof of a general effect.
Connected lessons
- Research prompts: fix the question and eligibility first
- Study extraction prompts: preserve the result behind each claim
- Study effects: calculate the measure outside the model
- Conflicting studies: inspect design before averaging outcomes
- Research synthesis release: expose the method and its limits
- Report summaries: preserve contrary results and missing data
- Document prompts: anchor each field to a page and resolve conflicts
- Prompt release review: assemble the decision packet
- Research-synthesis prompt decisions
