antanst ee2076f337 Clean up logging in worker processing ...

- Move response code logging to happen after successful snapshot save
- Remove error message from log output for cleaner display
- Consolidate logging logic in saveSnapshotAndRemoveURL function

2025-06-29 22:38:38 +03:00

..

blackList

Enhance crawler with seed list and SQL utilities

2025-06-29 22:38:38 +03:00

contextlog

Implement structured logging with slog

2025-06-29 22:38:38 +03:00

errors

Change errors to use xerrors package.

2025-06-29 22:38:38 +03:00

linkList

Update and refactor core functionality

2025-06-29 22:38:38 +03:00

seedList

Enhance crawler with seed list and SQL utilities

2025-06-29 22:38:38 +03:00

snapshot

Fix infinite recrawl loop with skip-identical-content

2025-06-29 22:38:38 +03:00

text

Improvements in error handling & descriptions

2025-02-27 09:20:22 +02:00

url

Enhance crawler with seed list and SQL utilities

2025-06-29 22:38:38 +03:00

whiteList

Enhance crawler with seed list and SQL utilities

2025-06-29 22:38:38 +03:00

shared.go

Improve crawler performance and worker coordination

2025-06-29 22:38:38 +03:00

worker.go

Clean up logging in worker processing

2025-06-29 22:38:38 +03:00