Skip to content

vlntsolo/multiprocessing-webscraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Async webscraper with native multiprocessing and threading support

Dependencies:

  • aiohttp
  • aiosqlite
  • beautifulsoup4

Instalattion

python -m pip install -r requirements.txt or

pipenv install -r requirements.txt

Spinning up

python main.py

ToDo:

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages