Crawler v0.2.0 Release Notes

Release Date: 2017-08-21 // over 6 years ago
    • ๐Ÿ‘ท [Added] :workers option
    • [Added] :interval option
    • โฑ [Added] :timeout option
    • [Added] :user_agent option
    • [Added] :save_to option
    • ๐Ÿฑ [Added] :assets option
    • ๐Ÿ“œ [Added] :parser option to allow custom parsing logic
    • [Improved] Renamed :max_levels to :max_depths
    • ๐Ÿ›  [Improved] Varies small fixes and improvements