antanst 62369d90ae fix: Refactor ConnectAndGetData function to return GeminiPageData struct

2024-10-23 12:46:02 +03:00

..

blacklist.go

Change blacklist to comprise domains.

2024-10-22 16:43:55 +03:00

connectionPool.go

Lots of features, first version that reliably crawls Geminispace.

2024-10-21 20:04:09 +03:00

files.go

Change blacklist to comprise domains.

2024-10-22 16:43:55 +03:00

gemini_url.go

Lots of features, first version that reliably crawls Geminispace.

2024-10-21 20:04:09 +03:00

gemini.go

Lots of features, first version that reliably crawls Geminispace.

2024-10-21 20:04:09 +03:00

ip-address-pool.go

Lots of features, first version that reliably crawls Geminispace.

2024-10-21 20:04:09 +03:00

network_test.go

Lots of features, first version that reliably crawls Geminispace.

2024-10-21 20:04:09 +03:00

network.go

fix: Refactor ConnectAndGetData function to return GeminiPageData struct

2024-10-23 12:46:02 +03:00

persistence.go

feat: Batch insert links to improve database performance

2024-10-23 09:05:50 +03:00

processing_test.go

Lots of features, first version that reliably crawls Geminispace.

2024-10-21 20:04:09 +03:00

processing.go

Lots of features, first version that reliably crawls Geminispace.

2024-10-21 20:04:09 +03:00

robots_test.go

feat: Implement robots.txt parser

2024-10-23 09:26:39 +03:00

robots.go

feat: Implement robots.txt parser

2024-10-23 09:26:39 +03:00

snapshot.go

Lots of features, first version that reliably crawls Geminispace.

2024-10-21 20:04:09 +03:00

worker.go

feat: Batch insert links to improve database performance

2024-10-23 09:05:50 +03:00