Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• 43f2242558 Update README main antanst 2024-12-09 19:54:15 +02:00
• aa4aecdc14 Preliminary web server antanst 2024-12-09 19:54:08 +02:00
• 6cf507bdc9 DB scripts and migrations antanst 2024-12-09 19:54:00 +02:00
• 7a36614232 Better error handling, many fixes all around antanst 2024-12-09 19:53:15 +02:00
• b52d4f6532 refactor: Update error message and remove commented JSON conversion methods antanst 2024-11-26 09:51:25 +02:00
• 825c7e3391 . antanst 2024-11-18 16:28:45 +02:00
• f0452ff9f7 fix: Change URL Value method to use value receiver for database encoding antanst 2024-11-11 16:19:07 +02:00
• bb49ea8565 fix: Update URL Value method to use pointer receiver for consistency antanst 2024-11-11 16:19:06 +02:00
• a19f157c80 fix: Implement database serialization for gemini URL type antanst 2024-11-11 16:14:59 +02:00
• 8b341d2ac6 refactor: Simplify URL parsing and remove JSON-related methods antanst 2024-11-11 16:14:58 +02:00
• 2bb8589eb7 feat: Improve error handling with custom error types and detailed messages antanst 2024-11-11 15:01:20 +02:00
• 6346c9a829 refactor: Remove default configuration constants and simplify config parsing antanst 2024-11-11 15:01:18 +02:00
• c7b0778b77 refactor: Add config validation, defaults, and unit tests antanst 2024-11-11 14:58:09 +02:00
• bea0d22c26 refactor: Replace switch statement with map-based config parsing antanst 2024-11-11 14:56:41 +02:00
• 6bcc7081b2 Fix dependency on go-nanoid antanst 2024-11-05 12:43:28 +02:00
• f34ac651b7 Add Makefile and remove ad-hoc lint script antanst 2024-11-05 12:40:30 +02:00
• d5da9ac62d Better unicode conversion antanst 2024-11-05 12:39:14 +02:00
• a0563074ed Lint fixes. antanst 2024-11-01 10:10:42 +02:00
• ef3f009709 Add robots.txt checking antanst 2024-10-23 14:24:10 +03:00
• c49a69728a Simplify robots.txt parsing logic antanst 2024-10-23 14:06:55 +03:00
• 8d9ea6cdec fix: use hostname instead of host in gemini network connection antanst 2024-10-23 12:46:48 +03:00
• f9b5fd5e7f fix: Use parsedUrl.Hostname() for TLS SNI antanst 2024-10-23 12:46:03 +03:00
• 62369d90ae fix: Refactor ConnectAndGetData function to return GeminiPageData struct antanst 2024-10-23 12:46:02 +03:00
• e51d84cad8 feat: Implement robots.txt parser antanst 2024-10-23 09:26:39 +03:00
• 17ef03d621 feat: Batch insert links to improve database performance antanst 2024-10-23 09:05:50 +03:00
• a2a6bd200a Optimize worker random snapshot selection antanst 2024-10-22 23:37:31 +03:00
• 3c5206ae43 Change blacklist to comprise domains. antanst 2024-10-22 15:50:28 +03:00
• cd60c1363b Lots of features, first version that reliably crawls Geminispace. antanst 2024-10-21 20:04:09 +03:00
• 212345764b Properly decode URLs antanst 2024-10-10 18:39:27 +03:00
• 8278f2b204 Proper mimetype parsing, refactoring antanst 2024-10-09 13:31:49 +03:00
• 91f8e69fdf Work on header parsing & saving other files antanst 2024-10-08 18:16:47 +03:00
• 7e849feffe Add README.md antanst 2024-10-08 17:28:10 +03:00
• c3d6481de0 Add configuration via env vars antanst 2024-10-08 12:42:08 +03:00
• 74e9327b0b Persist pages to file system antanst 2024-10-07 13:36:20 +03:00
• 74be6b4d0d Basic functionality antanst 2024-10-04 13:15:07 +03:00
• eb963542b7 Initial commit. antanst 2024-10-04 13:14:00 +03:00