Crawly v0.9.0 Release Notes

Release Date: 2020-04-14 // almost 4 years ago
  • ๐Ÿš€ This release contains the following features:

    Automatic cookies management (allows scraping websites under login form or a form with ZIP code)
    Spider custom settings (allows overriding settings like concurrency on the spider level)
    Injected on_spider_closed_callback (allows notifying other parts of the system on the crawl end)
    ๐Ÿ›  Fixes and improvements of the documentation