FOLLOW A QUESTION FURTHER

Library

Practical lessons, original research, and the details that make systems work.

Refine your reading (1)
1 articleReset filters

Articles

Implementation
Cloudflare· Ryan Skidmore

Cutting our inference bill by 68% by being obsessive about optimization (opens in a new tab)

When we previously blogged about our AI code reviewer in April, an average review cost a palatable $1.19. By the end of August, that figure had shot up to about $2.46. We hadn't made any significant architectural changes: the coordinator was still handing work to the same set of specialist reviewers, and the same risk tiers decided how intensive of