Crawly v0.9.0 Release Notes
Release Date: 2020-04-14 // almost 4 years ago-
๐ This release contains the following features:
Automatic cookies management (allows scraping websites under login form or a form with ZIP code)
Spider custom settings (allows overriding settings like concurrency on the spider level)
Injected on_spider_closed_callback (allows notifying other parts of the system on the crawl end)
๐ Fixes and improvements of the documentation