
Benthos Has a Free API — Heres How to Build Stream Processing Pipelines
Benthos (now Redpanda Connect) is a stream processor that connects everything — Kafka, HTTP, S3, databases, and 200+ connectors. Configure pipelines in YAML, no code needed. Why Benthos? 200+ connectors : Kafka, NATS, S3, HTTP, AMQP, Redis, PostgreSQL YAML config : No code needed for data pipelines Processors : Map, filter, transform with Bloblang Exactly-once : Delivery guarantees Single binary : No JVM, no dependencies Testable : Built-in unit testing for pipelines Install # Binary curl -Lsf https://sh.benthos.dev | bash # Docker docker run --rm -v ./config.yaml:/benthos.yaml jeffail/benthos # Homebrew brew install benthos Basic Pipeline # config.yaml input : http_server : path : /post allowed_verbs : [ POST ] pipeline : processors : - mapping : | root.message = this.text.uppercase() root.timestamp = now() root.source = "api" output : stdout : {} Run: benthos -c config.yaml Kafka to S3 Pipeline input : kafka : addresses : [ localhost : 9092 ] topics : [ events ] consumer_group : bent
Continue reading on Dev.to Tutorial
Opens in a new tab
