Popularity

4.1

Stable

Activity

0.0

Stable

Stars 25

Watchers 4

Forks 6

Last Commit about 3 years ago

Monthly Downloads: 2

Programming language: Elixir

License: MIT License

Tags: Queue

kafka_consumer alternatives and similar packages

Based on the "Queue" category.
Alternatively, view kafka_consumer alternatives based on common mentions on social networks and blogs.

oban

9.9 8.7 kafka_consumer VS oban

💎 Robust job processing in Elixir, backed by modern PostgreSQL or SQLite3
broadway

9.8 0.0 kafka_consumer VS broadway

Concurrent and multi-stage data ingestion and data processing with Elixir

Access the most powerful time series database as a service

Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

Promo www.influxdata.com

exq

9.7 3.8 kafka_consumer VS exq

Job processing library for Elixir - compatible with Resque / Sidekiq
verk

9.2 0.0 kafka_consumer VS verk

A job processing system that just verks! 🧛‍
amqp

9.2 0.0 kafka_consumer VS amqp

Idiomatic Elixir client for RabbitMQ
kafka_ex

9.2 7.7 kafka_consumer VS kafka_ex

Kafka client library for Elixir
honeydew

9.1 0.0 kafka_consumer VS honeydew

Job Queue for Elixir. Clustered or Local. Straight BEAM. Optional Ecto. 💪🍈
que

9.0 0.0 kafka_consumer VS que

Simple Job Processing in Elixir with Mnesia :zap:
Rihanna

8.7 0.0 kafka_consumer VS Rihanna

Rihanna is a high performance postgres-backed job queue for Elixir
toniq

8.5 0.0 kafka_consumer VS toniq

Simple and reliable background job library for Elixir.
enm

8.3 0.0 kafka_consumer VS enm

Erlang driver for nanomsg
ecto_job

8.1 0.0 kafka_consumer VS ecto_job

Transactional job queue with Ecto, PostgreSQL and GenStage
gen_rmq

7.9 0.0 kafka_consumer VS gen_rmq

Elixir AMQP consumer and publisher behaviours
task_bunny

7.8 0.0 kafka_consumer VS task_bunny

TaskBunny is a background processing application written in Elixir and uses RabbitMQ as a messaging backend
kaffe

7.7 0.0 kafka_consumer VS kaffe

An opinionated Elixir wrapper around brod, the Erlang Kafka client, that supports encrypted connections to Heroku Kafka out of the box.
elixir_nsq

7.6 0.0 kafka_consumer VS elixir_nsq

An NSQ client for Elixir and Erlang, written in Elixir.
opq

7.6 0.0 kafka_consumer VS opq

Elixir queue! A simple, in-memory queue with worker pooling and rate limiting in Elixir.
pqueue

7.4 0.0 kafka_consumer VS pqueue

Erlang Priority Queues
hulaaki

7.0 0.0 kafka_consumer VS hulaaki

DEPRECATED : An Elixir library (driver) for clients communicating with MQTT brokers(via the MQTT 3.1.1 protocol).
conduit

6.8 0.0 kafka_consumer VS conduit

A message queue framework, with support for middleware and multiple adapters.
Ravenx

6.5 0.0 kafka_consumer VS Ravenx

Notification dispatch library for Elixir applications
Cafex

6.0 0.0 kafka_consumer VS Cafex

Cafex is a pure Elixir implementation of Kafka client
exrabbit

5.7 0.0 kafka_consumer VS exrabbit

Simple rabbitmq bindings for elixir
RBMQ

5.1 0.0 kafka_consumer VS RBMQ

Simple API for spawning RabbitMQ Producers and Consumers.
faktory_worker

5.0 10.0 kafka_consumer VS faktory_worker

Elixir Faktory worker https://hexdocs.pm/faktory_worker
mqs

4.9 0.0 kafka_consumer VS mqs

🌍 MQS: AMQP Library
flume

4.9 4.7 kafka_consumer VS flume

A blazing fast job processing system backed by GenStage & Redis.
work_queue

4.7 0.0 kafka_consumer VS work_queue

Simple implementation of the hungry-consumer model in Elixir
elixir_talk

3.9 0.0 kafka_consumer VS elixir_talk

An Elixir client for beanstalkd
cspex

3.5 0.0 kafka_consumer VS cspex

A library that brings all the CSP joy to the Elixir land.
adap

2.8 0.0 kafka_consumer VS adap

Create a data stream across your information systems to query, augment and transform data according to Elixir matching rules.
exdisque

2.7 0.0 kafka_consumer VS exdisque

Elixir client for Disque (https://github.com/antirez/disque), an in-memory, distributed job queue.
heapq

2.0 0.0 kafka_consumer VS heapq

A Heap-based Priority Queue Implementation in Elixir.
queuex

2.0 0.0 kafka_consumer VS queuex

Elixir Priority Queue
dbus

1.2 0.0 kafka_consumer VS dbus

A dumb message bus for sharing data between microservices in a relatively decoupled mechanism
ActiveJorb

1.0 0.0 kafka_consumer VS ActiveJorb

An Elixir-based ActiveJob Compatible Queueing Library
stream_weaver

- kafka_consumer VS stream_weaver

Library for working with streams.

Do you think we are missing an alternative of kafka_consumer or a related project?

Add another 'Queue' Package

Popular Comparisons

README

Kafka consumer

Scalable consumer for Kafka using brod.

Installation

If available in Hex, the package can be installed as:

Add kafka_consumer to your list of dependencies in mix.exs:

def deps do
  [{:kafka_consumer, "~> 2.0"}]
end

Ensure kafka_consumer is started before your application:

def application do
  [applications: [:kafka_consumer]]
end

Usage

Set config or pass default attributes

config :brod,
  clients: [
    kafka_client: [
      endpoints: [{'localhost', 9092}],
      auto_start_producers: true
    ]
  ]

Write your own Consumer. Functions handle_async/1 and handle_sync/2 is overridable

defmodule KafkaConsumer.ExampleConsumer do
  use KafkaConsumer.Consumer

  def handle_async(_message) do
    :ok
  end
end

Set event handlers in config.

config :kafka_consumer,
  consumers: [
    [client: :kafka_client,
     group_id: "messaging",
     topics: ["message-events", "system-events"],
     callback: KafkaConsumer.ExampleConsumer,
     callback_args: []]
  ]

Define KafkaConsumer.Supervisor as child supervisor of your app.

children = [
  supervisor(KafkaConsumer.Supervisor, []),
]
opts = [strategy: :one_for_one, name: YourApplication.Supervisor]
Supervisor.start_link(children, opts)

Start your app.

kafka_consumer

Consumer for Kafka using brod and elixir (production ready)