- [x] Concurrent downloading with workers - [x] Concurrent connection limit per host - [x] URL Blacklist - [x] Save image/* and text/* files - [x] Configuration via environment variables - [x] Storing snapshots in PostgreSQL - [x] Proper response header & body UTF-8 and format validation . .
6 lines
98 B
SQL
6 lines
98 B
SQL
SELECT host, COUNT(*) AS row_count
|
|
FROM snapshots
|
|
GROUP BY host
|
|
ORDER BY row_count DESC
|
|
LIMIT 10;
|