riptide

quick, recursive, sitemap url extractor

installation and usage:

install rust, cargo and git. then install riptide with...

cargo install --git https://codeberg.org/gigirassy/riptide/

then in your shell...

riptide \
                               --sitemap https://example.com/sitemap.xml \
                               --output examplecomurls.txt \
                               --scheme https \
                               --workers 16 \
                               --user-agent "Mozilla/5.0 (X11; Linux i686; rv:151.0) Gecko/20100101 Firefox/151.0"

for searching for terms in urls after output is completed, i recommend ripgrep.

by default, riptide identifies itself in user agent, the above example overrides it.

license

isc