Crawler v0.3.0 Release Notes

Release Date: 2017-08-26 // over 6 years ago
    • [Added] :retrier option to allow custom fetch retrying logic
    • [Added] :url_filter option to allow custom url filtering logic
    • ๐Ÿ“œ [Improved] Parser is now more stable and skips unparsable files
    • ๐Ÿ›  [Improved] Varies small fixes and improvements