Noah Shinn

Contact

San Francisco, CA
Email: noahrshinn[at]gmail[dot]com
Github
Google scholar

About

I am a research scientist at Sierra working on large language models. Previously, I worked on equivariant graph neural networks for accelerating excited-state molecular dynamics programs with Solvent and SolventDynamics and on code generation programs with OpenTau and Reflexion. I enjoy reading about programming language affordances, evolutionary theories of complex behavior, limits of human concept acquisition and expressibility, and any other writings that explain why some things are hard to do.

Papers

Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions
Federico Cassano, Luisa Li, Akul Sethi, Noah Shinn, Abby Brennan-Jones, Anton Lozhkov, Carolyn Anderson, Arjun Guha
LLM4Code (ICSE Workshop) 2024
paper | code
Type Prediction With Program Decomposition and Fill-in-the-Type Training
Federico Cassano, Ming-Ho Yee, Noah Shinn, Arjun Guha, Steven Holtzen
In submission
paper | code
Reflexion: Language Agents with Verbal Reinforcement Learning
Noah Shinn, Federico Cassano, Beck Labash, Ashwin Gopinath, Karthik Narasimhan, Shunyu Yao
Neural Information Processing Systems (NeurIPS) 2023
paper | code

Other

gitm: A search tool for git and Github
The Collaborative Browser: a web browser for all users
llm-chat: Question answering in your terminal
gcl: Tool for git commits and GitHub issues
bashllm: Tool for auto cli suggestions
A blog post written with Ashwin Gopinath
kstateagent: Classification + q-learning written in OCaml and Rust
erica: A project from a hackathon written in Rust and Python
Leetcode Hard Gym: A hard benchmark for programming tests

Last updated: 03/2024