Skip to content
Strange Lab

Evidence

Find the evaluations behind each world. The linked studies report the data, methods, results, and limits of each comparison.

Oversight

Agent screening results report how the screen ranked agent trajectories against human review. The Oversight world also describes a separate cybersecurity evaluation.

Software

Software evaluations cover outcome and timing forecasts on held-out repositories. Earlier Project OSS results retain the original comparison.

Clinical trials

Trial registry evaluations cover forecasts of enrollment shortfall, termination, and completion. Project Confirm reports the separate oncology study.

Companies

Company study results compare outcomes in the Co Insights operating benchmark, score financial forecasts against later disclosures, and report the product planning study. Company Research sign-in is required.

Economy

Economy Desk compares forecasts with released outcomes in its Accuracy view. It uses a separate sign-in. Macro History shows how the historical scenario experiment uses a fixed record.

Earlier studies

Earlier scored results retain the comparisons from historical, fictional, and other experimental worlds.