antanst/gemini-grc
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
18 Commits 1 Branch 0 Tags
561f83a007b4ea19374a90f8f597f4c1a10cb661
Commit Graph

2 Commits

Author SHA1 Message Date
antanst
561f83a007 Add robots.txt checking 
Still needs periodic cache refresh
 2024-10-23 14:56:14 +03:00
antanst (aider)
e51d84cad8 feat: Implement robots.txt parser 2024-10-23 09:26:39 +03:00