Do AI crawlers read llms.txt? We measured 7 sites
Lefty Media
Like this project
Posted Sep 30, 2026
1,549 fetches when robots.txt points to the file. 2 when nothing does. Published research on how AI crawlers find llms.txt.
Likes
0
Views
1
Lefty Media
Posted Sep 30, 2026
1,549 fetches when robots.txt points to the file. 2 when nothing does. Published research on how AI crawlers find llms.txt.
0
1
