From d3689b928e972efdb67b5f7a767c711edc5d9fe2 Mon Sep 17 00:00:00 2001 From: gigirassy Date: Sun, 23 Aug 2026 20:57:54 +0200 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 00abc9e..fb6875f 100644 --- a/README.md +++ b/README.md @@ -1,6 +1,6 @@ # blogfetch -tiny crystal web crawler to crawl a blogspot blog and all other blogspot blogs it links recursively until a set amount of urls (5000) is reached +tiny crystal web crawler to crawl a blogspot blog and all other blogspot blogs it links recursively until a set amount of unique blogspot blog urls (5000) is reached this is especially helpful for archiveteam.