Files
gemini-grc/blacklist.txt
antanst fee7d3e01c Lots of features, first version that reliably crawls Geminispace.
- [x] Concurrent downloading with workers
- [x] Concurrent connection limit per host
- [x] URL Blacklist
- [x] Save image/* and text/* files
- [x] Configuration via environment variables
- [x] Storing snapshots in PostgreSQL
- [x] Proper response header & body UTF-8 and format validation
.

.
2024-10-21 20:03:28 +03:00

6 lines
174 B
Plaintext

gemini://gemi.dev/cgi-bin/waffle.cgi
gemini://alexey.shpakovsky.ru/maze
gemini://kennedy.gemi.dev
gemini://musicbrainz.uploadedlobster.com
gemini://gemini.bunburya.eu/remini