AutoCleanML: Automated Data Cleaning and Preprocessing FrameworkAutoCleanML: Automated Data Cleaning and Preprocessing Framework
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
Ayush's avatar
Ayush Agrawal
• 4h
AutoCleanML | Automated Data Cleaning & Preprocessing Framework
AutoCleanML is a Python-based framework designed to simplify data preparation by automating repetitive cleaning and preprocessing tasks. It combines data profiling, statistical analysis, and AI-assisted recommendations to help make datasets more consistent and ready for machine learning workflows.
Key Features
Missing Value Handling: Detects missing data and supports automated cleaning strategies.
Outlier Detection: Identifies potentially anomalous values to improve data quality.
Data Standardization: Detects inconsistent formats and helps normalize data across columns.
Duplicate Detection: Identifies duplicate records and supports dataset deduplication.
Data Profiling: Analyzes column types, distributions, and data-quality characteristics.
Exploratory Data Analysis (EDA): Generates visualizations and summaries to help users understand datasets.
Identifier Detection: Identifies potential ID and identifier columns to support appropriate preprocessing.
AI-Assisted Recommendations: Uses semantic analysis and LLM-assisted capabilities to improve cleaning decisions.
Automated Pipelines: Organizes cleaning operations into reusable preprocessing workflows.
Efficient Data Processing: Supports CSV-to-Parquet conversion and integrates high-performance data processing libraries.
API Integration: Uses FastAPI to expose data-processing functionality through REST endpoints.
Tech Stack: Python, Pandas, Polars, Scikit-learn, FastAPI, REST APIs, and LLM integration.
Impact: Reduces repetitive data-cleaning effort, improves consistency, and helps prepare datasets more efficiently for downstream analytics and machine learning tasks.
pandasData AnalysisData EngineeringMachine Learning EngineeringFastAPIPython
Post image
Back to feed
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started