Crawler v0.3.0 Release Notes
Release Date: 2017-08-26 // over 6 years ago-
- [Added]
:retrier
option to allow custom fetch retrying logic - [Added]
:url_filter
option to allow custom url filtering logic - ๐ [Improved] Parser is now more stable and skips unparsable files
- ๐ [Improved] Varies small fixes and improvements
- [Added]