Lots of features, first version that reliably crawls Geminispace.

- [x] Concurrent downloading with workers
- [x] Concurrent connection limit per host
- [x] URL Blacklist
- [x] Save image/* and text/* files
- [x] Configuration via environment variables
- [x] Storing snapshots in PostgreSQL
- [x] Proper response header & body UTF-8 and format validation
.

.

.

.gitignore

@@ -1,6 +1,8 @@
 .idea
 **/.#*
 **/*~
-/run.sh
+/cmd
+/db/initdb.sql
+/run*.sh
 /gemini-grc
 /snaps