a deep dive into TCP because I felt frustrated that I didn't understand these things from first principles. it was pretty interesting to go deep into the linux kernel after I learned more in school. I really loved learning more about RX / TX on CPUs; it's just so beautiful that these machines all work :)
a basic implementation of paged attention, but with a focus on fault tolerance (we have a fault tolerant KV store for the KV cache manager!). This has been the most fun project I've ever worked on despite sleeping only an hour, entirely due to my good friend Vishal Nandakumar, who I argued with for 7 hours before writing a single line of code.
modifications and experiments with a SOTA unlearning algorithm, focusing on robustness against adversarial relearning attacks. deeply inspired by Phoenix Wu and Timothy Qian, to whom I owe a tremendous debt for introducing this paper to me and for their all-around kindness as floor chairs.