Blog

I write when I'm trying to get something straight in my own head, which usually means taking a system apart and explaining it back to myself until it makes sense. Some of it is technical, some of it isn't.

July 2026

A Little RoPE Goes a Long Way

Three weeks of RoPE experiments, then a review I designed to kill my own paper. It killed three of my claims.

September 2020

Comparing Modern Scalable Hyperparameter Tuning Methods

Which search strategy is actually worth the compute? I ran four of them on the same problem to find out.