mirror of
https://codeberg.org/gigirassy/blogfetch
synced 2026-08-30 15:27:41 +00:00
Update README.md
This commit is contained in:
@@ -1,6 +1,6 @@
|
||||
# blogfetch
|
||||
|
||||
tiny crystal web crawler to crawl a blogspot blog and all other blogspot blogs it links recursively until a set amount of urls (5000) is reached
|
||||
tiny crystal web crawler to crawl a blogspot blog and all other blogspot blogs it links recursively until a set amount of unique blogspot blog urls (5000) is reached
|
||||
|
||||
this is especially helpful for archiveteam.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user