Update README.md

This commit is contained in:
gigirassy
2026-08-23 20:57:54 +02:00
parent c52695c581
commit d3689b928e
+1 -1
View File
@@ -1,6 +1,6 @@
# blogfetch
tiny crystal web crawler to crawl a blogspot blog and all other blogspot blogs it links recursively until a set amount of urls (5000) is reached
tiny crystal web crawler to crawl a blogspot blog and all other blogspot blogs it links recursively until a set amount of unique blogspot blog urls (5000) is reached
this is especially helpful for archiveteam.