antanst/gemini-grs
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
27 Commits 1 Branch 0 Tags
8b341d2ac66acd386e9d22cc8ea718d6df648cff
Commit Graph

2 Commits

Author SHA1 Message Date
antanst
ef3f009709 Add robots.txt checking 
Still needs periodic cache refresh
 2024-10-31 16:58:08 +02:00
antanst (aider)
e51d84cad8 feat: Implement robots.txt parser 2024-10-23 09:26:39 +03:00