Data Transformation Tool for Machine Learning Dataset Generation
Thanyasit Lieamsiriwong
bb-transform is a small but powerful tool designed to transform raw data from a database into a structured machine learning dataset. It is deployed as a serverless function on AWS Lambda and triggered by messages from AWS SQS. The entire AWS infrastructure is provisioned using Terraform, ensuring consistent and reproducible deployments.This project demonstrates a typical workflow for preparing data for machine learning, leveraging cloud-native technologies for scalability and efficiency.
Like this project
Posted Feb 18, 2025
A Go-based serverless application on AWS Lambda that leverages SQS and Terraform to convert database data into ready-to-use machine learning datasets.
