Eliminating 94% Index Bloat on a Magento 2 E-Commerce Store by Milan StoyakovEliminating 94% Index Bloat on a Magento 2 E-Commerce Store by Milan Stoyakov

Eliminating 94% Index Bloat on a Magento 2 E-Commerce Store

Portfolio project
Milan Stoyakov

The Challenge

Tactical-Expressions.com, a Magento 2 e-commerce store, had severe index bloat in Google Search Console (November 2025):
37,300 pages indexed when only 4,000–5,000 legitimate pages existed (~85% index bloat)
3.35 million URLs crawled, not indexed
90%+ of Google's crawl budget wasted on low-value URLs, including thousands of internal search pages (/catalogsearch/) and 9,000+ AJAX endpoints

The Solution

Executed a 4-phase technical SEO cleanup over a 3-month timeline:
Immediate Blocking: Added noindex tags to internal search pages (/catalogsearch/), noindex headers for 9,000+ AJAX endpoints, restructured robots.txt via direct server access (bypassing the broken Magento editor), and consolidated 17 XML sitemaps into 1.
Duplicate Consolidation: Implemented canonical tags across 28,000+ product variation URLs to consolidate link equity to parent product pages.
Technical Corrections: Fixed AJAX endpoint Content-Type headers to prevent future re-indexing of system pages.
Accelerated Removal: Submitted URL removal requests in Google Search Console to expedite de-indexing of internal search result pages.

The Results (Dec 2025 – Mar 2026)

Pages Indexed: 37,300 → 2,212 (-94%, removing 35,088 junk pages)
Crawl Waste: 3.35M → 1.82M URLs (46% improvement in crawl efficiency)
Canonical Duplicates: 300,000+ → 75,200 (-75%)
Noindexed Pages: 3,000+ → 1,700 (-43%)
Index Bloat: 85% → 0% (eliminated)

0 likes · 0 views · Nov 14, 2026

Cut Google index bloat by 94% (37,300 to 2,212 pages) and reduced crawl waste by 46% on a Magento 2 e-commerce store in 3 months.

Timeline

Nov 1, 2025 - Mar 13, 2026

Tags