Nicholas Arcolano examines Jellyfish data on coding assistants and engineering workflows. He describes a shift in model use following a change in tool defaults and reports no clear change in merged pull request throughput in that comparison.
Using a curated dataset of about 50,000 engineers across 447 companies, Nicholas Arcolano compares tool choice, skill use, token consumption, organizational context and individual differences. He reports associations rather than proving that these factors independently cause the measured outcomes.
The talk uses merged pull requests as a throughput measure, and Nicholas Arcolano acknowledges that the analysis shown does not include a quality metric. He argues that leaders should consider workflow and team context alongside model choice.
Watch on YouTube
