Research

Here's a compilation of my published research work, scraped from Scholar by an agent. Some of my most popular projects and products have come out of chasing independent research ideas. I still work on them, but with the advent of LLMs, and with most research now needing a multi-GPU setup, it's been difficult to run large-scale experiments on wild ideas. I'm hopeful post-training could be a nice middle ground, and that's what I'm exploring at the moment.

Published work

Independent work

July 2026

A Little RoPE Goes a Long Way

Three weeks of RoPE experiments, then a review I designed to kill my own paper.