The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Back to feedPost
I developed a Python web scraping automation script using Selenium, Undetected ChromeDriver, Pandas, WebDriverWait, and Excel. The script automatically opens car parts product URLs from an Excel file, loads each page, handles pop-ups, waits for dynamic content, and extracts product details such as title, OE number, and interchange part number. It includes error handling, fallback methods, random delays, and browser automation to make the scraping process more reliable. Finally, it stores all collected data in a structured Excel file using Pandas.
#Web_scraping #Automation #Python
How are you handling IP rotation for larger scraping runs? Are you using a proxy pool with session-level rotation, or relying more on request throttling and browser-level fingerprints to reduce blocking?
For larger scraping runs, I mainly use request throttling with randomized time delays and browser-level techniques. I use incognito windows or undetected browser when needed, and if a CAPTCHA appears, the scraper pauses for a random period and waits for the CAPTCHA to be...
The network for creativity
Join 1.25M professional creatives like you
Connect with clients, get discovered, and run your business 100% commission-free
Creatives on Contra have earned over $150M and we are just getting started
Trending
retrofuturism
Share your favorite designs from the past exploring the distant future. Or your own take on the aesthetic 🚀
halftone
Dots. Texture. Grain. Let's see your designs using the halftone technique.
Midjourney
Creatives are showing off what they're making with Midjourney.
colorgrade
Video editors sound off: How do you enhance the mood of your video in color grading?
Related posts
Hi everyone!
I'm new here, so I wanted to introduce myself.
I learned the basics of Python about two years ago, and a year ago I started a degree in AI and Data Science. I'm currently in my third semester, and I'm focused on developing my programming and data skills while building my first real-world experience.
For now, I'm looking to contribute to smaller tasks such as data cleaning, data analysis, automation, and logical scripting. I don't expect to jump directly into complex projects; my goal is to help with the work I can handle while learning how software and data projects actually work in the industry.
I'm also very interested in how AI fits into programming. In my personal projects, I try to use AI primarily as a learning and reasoning tool rather than as a replacement for understanding or writing the code myself. I like using it more as a Socratic teacher: asking questions, challenging my reasoning, explaining concepts, and helping me find mistakes.
At the same time, I recognize that AI is becoming almost indispensable in modern development. But I believe that understanding the fundamentals is just as important. I want to learn how things work, not simply how to get an AI to produce them.
Currently, I'm working on a physics simulator as a personal project. It's still a work in progress, but I hope to share my progress here in the future.
I'm here to learn, contribute, and get a better understanding of what working in the industry is actually like. If there are small tasks where I can be useful while continuing to learn, I'd be happy to help.
Best regards!
Built an AI-powered Log Analyzer using Python and FastAPI to automate log analysis and troubleshooting. The system processes application/system logs, performs rule-based analysis, and uses an LLM to identify problems, root causes, severity, possible causes, and recommended actions. Exposed the functionality through REST APIs with structured Pydantic responses for reliable and consistent results.
Tech: Python, FastAPI, LLM/Ollama, Pydantic, REST APIs, Log Parsing, Prompt Engineering, Git.
My recent client is an Australian printing firm.
They already had clients coming in.
The problem was what happened after the agreement.
When a client agrees to payment terms, every delay matters.
A payment process that sits waiting for someone to follow up can slow down the entire client journey. And when clients experience unnecessary delays, it can affect more than cash flow. It can affect their confidence in the business.
So I built an Agreed Payment System in Make.com designed around the client journey.
The goal wasn’t simply to automate emails.
It was to create a process that keeps agreed payments moving, keeps communication consistent, and reduces the amount of manual follow-up required from the team.
The workflow takes the agreed payment process and routes it through the appropriate steps, conditions, and Gmail communications.
The system helps keep the process moving.
And this is where my background in sales development and client retention comes into the automation work.
I don’t look at automation as:
Trigger → Action → Done.
I look at it as:
Lead → Sale → Client → Experience → Retention → Repeat business.
Because getting a client is only part of the job.
You also need systems that make it easy for that client to keep doing business with you.
Sales development + client retention + workflow automation.
That’s the intersection I build around.
Can any extra client we will build and team work
also interested?