Crawler v0.2.0 Release Notes
Release Date: 2017-08-21 // over 6 years ago-
- ๐ท [Added]
:workers
option - [Added]
:interval
option - โฑ [Added]
:timeout
option - [Added]
:user_agent
option - [Added]
:save_to
option - ๐ฑ [Added]
:assets
option - ๐ [Added]
:parser
option to allow custom parsing logic - [Improved] Renamed
:max_levels
to:max_depths
- ๐ [Improved] Varies small fixes and improvements
- ๐ท [Added]