- Who it helps
- Developers reviewing generated projects and evaluation researchers.
- Availability
- September 30 preprint; public abstract checked October 31. Runnable artifacts were not verified.
Compare three dependency sets
The framework distinguishes declared packages, packages installed at runtime, and the dependencies actually needed to execute the project.
Functional tests miss some gaps
Across three agents, four languages and fifty tasks, the authors report incomplete, redundant or inconsistent dependency declarations. The findings are limited to that study design.
What you can do
- Read the protocol before treating an existing test pass as evidence of environment portability. Open reference ↗
Where the evidence stops
No dependency audit or reproduction was executed. The abstract alone does not establish the cause of every mismatch.
Sources read. Sources checked October 31, 2026 UTC. No third-party software, model inference or complete workflow was executed.
Sources & further reading
Paper · paper
Working code can still have an unreproducible environment ↗
Supports the cited capability or limit in Working code can still have an unreproducible environment.
Bhanu Prakash Vangala and Tanu Malik · page checked 2026-10-31
Coverage note: Independent attention and end-to-end execution remain unverified.
The record over time (1)
Dated source checks and published explanations. An observation date can differ from the original release date.
- · Added to Current
A study separates whether generated software works from whether its declared dependencies let someone else run it.