Ali Colgecen
I have created an API service for a client to scrape newspaper and journal articles from their paid sources, automatically summarize, and match to their experts network. It is made up of two main parts: web scraper and API. Web scraper regularly visits selected data sources, scrapes data and cleans them on the spot with its GPT-powered algorithms. Also, my own NLP summarizer summarizes the text. I used a PostgreSQL database to keep records and deployed my API as a Digital Ocean app. Paid users may request articles with numerous filters available: exact text matching, AI matching, time periods etc. See the free dataset.