Re-envisioning Reporting of Scientific Methods
Summary
The information contained in the methods section of the overwhelming majority of research publications is insufficient to definitively evaluate research practices, let alone reproduce the work. Publication—and subsequent reuse—of detailed scientific methodologies can save researchers time and money, and can accelerate the pace of research overall. However, there is no existing mechanism for collective action to improve reporting of scientific methods. The Biden-Harris Administration should direct research-funding agencies to support development of new standards for reporting scientific methods. These standards would (1) address ongoing challenges in scientific reproducibility, and (2) benefit our nation’s scientific enterprise by improving research quality, reliability, and efficiency.
AI’s high-stakes outputs directly shape American economic, industrial, and technological outcomes. They must not be accepted entirely on the basis of institutional faith rather than verifiable evidence.
The clearinghouse will also neutrally mediate the assignment of auditors to audits—strengthening independence, trust, and ethical governance across the AI ecosystem.
Soft law was never meant to be a permanent solution. Treating it as one, and letting the sandcastle stand in for the skyscraper indefinitely, is how we end up with a decade of voluntary commitments and no enforceable accountability to show for it.
Jobseekers, employees at smaller organizations, and local public workers need more than a weekend crash course in AI. They need practice choosing useful tasks, protecting data, testing outputs, and explaining where human judgment remains necessary.