Crawler v0.2.0 Release Notes

Release Date: 2017-08-21 // over 2 years ago
    • 👷 [Added] :workers option
    • [Added] :interval option
    • ⏱ [Added] :timeout option
    • [Added] :user_agent option
    • [Added] :save_to option
    • 🍱 [Added] :assets option
    • 📜 [Added] :parser option to allow custom parsing logic
    • [Improved] Renamed :max_levels to :max_depths
    • 🛠 [Improved] Varies small fixes and improvements