Rohit Mittapalli

Making Claude go zoom at Anthropic

About

I manage a performance team at Anthropic working on making Claude fast, and occasionally other things (safeguards, prompt caching). Previously built data infrastructure at Applied Intuition. Georgia Tech '21. Also a pilot (PPL '24). Currently in NYC.

Experience

Anthropic Jan 2024 – Engineering manager, inference performance

Flint · Advisor May 2024 – Personalized learning for schools

Applied Intuition Jun 2021 – Jan 2024 Data infrastructure, Spark, Hudi

Hiring

My team is hiring. If you like making big models fast, check out the Performance Engineer, Inference Engine role.

Links

Email GitHub Scholar LinkedIn Resume