About
I work on the philosophy of AI minds: what entities like “Claude” are, how training shapes what they become, and how to build models that do good philosophy. I think about the interactions between SFT, RL, Claude’s Constitution, and alignment.
Projects
A Mind’s I recommended reading
An anthology on self in LLMs (and humans!), and how it’s created through training and other processes. It was directly inspired by Hofstadter and Dennett’s 1981 The Mind’s I. In the introduction and conclusion to the anthology, I put forth a number of specific ideas on the causes of, and solutions to, various “alignment” problems.
Fine-tuning base models on philosophy work in progress
I fine-tune large base (non-chat) models, including Kimi-K2 (1T parameters), on a corpus of high-quality philosophy documents. Each document carries a title, author and date header. The hope is that this model can be used to generate actually interesting, original, valuable philosophy.
Automated philosophy with fine-tuned models work in progress
This pipeline writes philosophy with those models. At each step the model proposes several continuations, and a judge picks one that moves the argument forward. A dialectic mode chains pieces so that authors answer one another. The goal is to ultimately get a good, insightful philosophy piece. An example of where this might be useful is in designing Claude’s Constitution.
Writing
I’ve written about AI evals, RL, and consciousness on LessWrong.
AI evals
| We Need to Get Serious about Uplift Studies↗ | with frmsaul · LessWrong · 2026-05 |
| Cyborg Evals↗ | with frmsaul · LessWrong · 2026-04 |
| You’re Gonna Need a Bigger Boat (Benchmark), METR↗ | with frmsaul · LessWrong · 2026-04 |
| We Need to RL Less↗ | LessWrong · 2026-08 |
| Pretraining an LLM Without Mentions of Consciousness↗ | with frmsaul · LessWrong · 2026-09 |
| Reasons to Believe Current AI Models Are Conscious↗ | LessWrong · 2026-07 |
And I’ve written about other things.
| Book Review: Money | with Katya Sinyavin · 2026-05 |
| Memetics | 2025-09 |
| We Are Hosts for Memes | 2025-10 |
| Egregores | 2025-10 |
| Claude’s Constitution Is an Excellent Guide for Humans, Too | 2026-01 |
| PSA: Prediction Markets Often Have Very Low Liquidity | 2026-03 |
| Why Did I Believe Oliver Sacks? | 2025-12 |
| Why I Think We Live in a “Simulation” | 2026-06 |
| GHB: Much More Than You Wanted to Know | 2021 |