Website to RAG knowledge base (Apify tool) by Serkan BalWebsite to RAG knowledge base (Apify tool) by Serkan Bal

Website to RAG knowledge base (Apify tool)

Portfolio project
Serkan Bal
A published Apify Store tool I built and maintain. Give it a website or help center; it crawls the public pages (respecting robots.txt and using the sitemap), removes menus and repeated boilerplate, and splits the content into heading-aware chunks sized for retrieval, each with its page URL and heading path. An optional mode re-processes only pages that changed since the last run, so a chatbot's knowledge stays current at low cost. Pay per result: about $1 per 1,000 chunks. Live example runs: GitHub billing docs (30 pages, 132 chunks) and the Python tutorial (18 pages, 221 chunks). It powers the knowledge side of my support chatbot builds.

0 likes · 0 views · Nov 18, 2026

Published Apify tool that crawls a website or help center and outputs clean, heading-aware chunks ready for a RAG chatbot, with change-only re-runs.

Tags