mirror of
https://codeberg.org/gigirassy/blogfetch
synced 2026-08-30 23:37:42 +00:00
Update README.md
This commit is contained in:
@@ -1,6 +1,6 @@
|
|||||||
# blogfetch
|
# blogfetch
|
||||||
|
|
||||||
tiny crystal web crawler to crawl a blogspot blog and all other blogspot blogs it links recursively until a set amount of urls (5000) is reached
|
tiny crystal web crawler to crawl a blogspot blog and all other blogspot blogs it links recursively until a set amount of unique blogspot blog urls (5000) is reached
|
||||||
|
|
||||||
this is especially helpful for archiveteam.
|
this is especially helpful for archiveteam.
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user