Optimizing Web Services and Database Queries at Amazon & Convoy

I specialize in enhancing the efficiency and performance of data-intensive applications. Here are some example projects I have done for Amazon and Convoy:

Optimized bulk I/O to storage service by replacing the underlying database framework, leveraging batch SQL queries, and using parallel Java streams. Reduced update times to 1.5 minutes (down from 60 minutes) for 1 million records.

Enhanced big data scripts to reduce computation and storage costs by 75%, cutting $600,000 in monthly expenses.

Built Python script to automatically tune the parameters for Spark jobs in AWS EMR to maximize speed to cost ratio of jobs.

Audited and optimized legacy SQL queries using PGAnalyze. Cut DB utilization by 50% and improved the run time of our biggest hourly job by 500x (from 2 hours down to 15 seconds). Provided training on SQL Optimization to other engineers on the team.