Popularity

8.3

Stable

Activity

0.0

Stable

Stars 329

Watchers 16

Forks 43

Last Commit over 4 years ago

Monthly Downloads: 46

Programming language: Elixir

License: GNU Lesser General Public License v3.0 only

Tags: HTTP

scrape alternatives and similar packages

Based on the "HTTP" category.
Alternatively, view scrape alternatives based on common mentions on social networks and blogs.

mint

9.6 7.0 scrape VS mint

Functional HTTP client for Elixir with support for HTTP/1 and HTTP/2 🌱
gun

9.5 6.2 scrape VS gun

HTTP/1.1, HTTP/2, Websocket client (and more) for Erlang/OTP.

Nutrient – The #1 PDF SDK Library, trusted by 10K+ developers

Other PDF SDKs promise a lot - then break. Laggy scrolling, poor mobile UX, tons of bugs, and lack of support cost you endless frustrations. Nutrient’s SDK handles billion-page workloads - so you don’t have to debug PDFs. Used by ~1 billion end users in more than 150 different countries.

Promo www.nutrient.io

finch

9.5 6.2 scrape VS finch

Elixir HTTP client, focused on performance
Crawler

9.4 6.8 scrape VS Crawler

A high performance web crawler / scraper in Elixir.
Crawly

9.4 7.0 scrape VS Crawly

Crawly, a high-level web crawling & scraping framework for Elixir.
PlugAttack

8.4 0.0 scrape VS PlugAttack

A plug building toolkit for blocking and throttling abusive requests
neuron

8.3 2.1 scrape VS neuron

A GraphQL client for Elixir
Ace

8.1 0.0 scrape VS Ace

HTTP web server and client, supports http1 and http2
webdriver

7.1 0.0 scrape VS webdriver

WebDriver client for Elixir.
spell

6.3 0.0 scrape VS spell

DISCONTINUED. Spell is a Web Application Messaging Protocol (WAMP) client implementation in Elixir. WAMP is an open standard WebSocket subprotocol that provides two application messaging patterns in one unified protocol: Remote Procedure Calls + Publish & Subscribe: http://wamp.ws/
web_socket

6.2 0.0 scrape VS web_socket

An exploration into a stand-alone library for Plug applications to easily adopt WebSockets.
AbsintheClient

6.1 5.0 scrape VS AbsintheClient

A GraphQL client designed for Elixir Absinthe.
river

5.7 0.0 scrape VS river

An HTTP/2 client for Elixir (a work in progress!)
cauldron

5.7 0.0 scrape VS cauldron

I wonder what kind of Elixir is boiling in there.
http_proxy

5.1 0.0 scrape VS http_proxy

http proxy with Elixir. wait request with multi port and forward to each URIs
bolt

4.3 0.0 scrape VS bolt

DISCONTINUED. Simple and fast http proxy living in the Erlang VM
explode

4.2 2.7 scrape VS explode

An easy utility for responding with standard HTTP/JSON error payloads in Plug- and Phoenix-based applications
sparql_client

4.1 6.4 scrape VS sparql_client

A SPARQL client for Elixir
Mechanize

4.0 10.0 scrape VS Mechanize

DISCONTINUED. Build web scrapers and automate interaction with websites in Elixir with ease!
mnemonic_slugs

3.7 0.0 scrape VS mnemonic_slugs

An Elixir library for generating memorable slugs.
SpiderMan

3.6 3.8 scrape VS SpiderMan

SpiderMan,a base-on Broadway fast high-level web crawling & scraping framework for Elixir.
etag_plug

3.3 2.8 scrape VS etag_plug

A simple to use shallow ETag plug
uri_query

3.2 5.2 scrape VS uri_query

URI encode nested GET parameters and array values in Elixir
ivar

3.2 0.0 scrape VS ivar

Ivar is an adapter based HTTP client that provides the ability to build composable HTTP requests.
Tube

3.2 0.0 scrape VS Tube

WebSocket client library written in pure Elixir
fuzzyurl

3.0 0.0 scrape VS fuzzyurl

An Elixir library for non-strict parsing, manipulation, and wildcard matching of URLs.
uri_template

2.9 0.0 scrape VS uri_template

RFC 6570 compliant URI template processor for Elixir
httprot

2.6 0.0 scrape VS httprot

Prot prot prot.
yuri

2.4 0.0 scrape VS yuri

Elixir module for easier URI manipulation.
http_digex

1.2 0.0 scrape VS http_digex

HTTP Digest Auth Library to create auth header to be used with HTTP Digest Authentication
lhttpc

0.9 0.0 scrape VS lhttpc

What used to be here -- this is a backwards-compat user and repo m(
plug_wait1

0.8 0.0 scrape VS plug_wait1

Plug adapter for the wait1 protocol
Ralitobu.Plug

0.8 0.0 scrape VS Ralitobu.Plug

Elixir Plug for Ralitobu, the Rate Limiter with Token Bucket algorithm

Do you think we are missing an alternative of scrape or a related project?

Add another 'HTTP' Package

Popular Comparisons

README

Scrape

Structured Data extraction from common web resources, using information-retrieval techniques. See the docs

Installation

The package can be installed by adding scrape to your list of dependencies in mix.exs:

def deps do
  [
    {:scrape, "~> 3.0.0"}
  ]
end

Known Issues

This package uses an outdated version of httpoison because of keepcosmos/readability. You can override this in your app with override: true and everything should work.
The current version 3.X is a complete rewrite from scratch, so some new issues might occur and the API has changed. Please provide some URL to a HTML/Feed document when submitting issues, so I can look into it for bugfixing.

Usage

Scrape.domain!(url) -> get structured data of a domain-type url (like https://bbc.com)
Scrape.feed!(url) -> get structured data of a RSS/Atom feed
Scrape.article!(url) -> get structured data of an article-type url

License

LGPLv3. You can use this package any way you want (including commercially), but I want bugfixes and improvements to flow back into this package for everyone's benefit.

*Note that all licence references and agreements mentioned in the scrape README section above are relevant to that project's source code only.