antanst/gemini-grc
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
20 Commits 1 Branch 0 Tags
daaa61c884ab44458d4b4fea8539e068865d33c0
Commit Graph

2 Commits

Author SHA1 Message Date
antanst
daaa61c884 Add robots.txt checking 
Still needs periodic cache refresh
 2024-10-23 14:26:42 +03:00
antanst (aider)
e51d84cad8 feat: Implement robots.txt parser 2024-10-23 09:26:39 +03:00