Crawler v0.3.0 Release Notes

Release Date: 2017-08-26 // over 2 years ago
    • [Added] :retrier option to allow custom fetch retrying logic
    • [Added] :url_filter option to allow custom url filtering logic
    • 📜 [Improved] Parser is now more stable and skips unparsable files
    • 🛠 [Improved] Varies small fixes and improvements