Batch Processing Solution (PBs/day)

Built a distributed batch processing system to analyze millions of git repositories per day while keeping costs at a reasonably low level.