We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
78e4a57
Upgrade to .NET 8.
5386f4d
Adds a new command line option to specify the user agent to use when crawling.
E.g.
.\crawler.exe --url https://awesomesite.net --useragent "My Crawler"
9a5b44f
Initial release.
