Spring Tips: Spring Batch and Apache Kafka

SpringDeveloper · 37K views · 2019 · 44:15

Open on YouTube

Software architecture & designDistributed systemsWeb developmenttutorialdated

Why Stack Overflow recommends it

Stack Overflow users link it as the reference example when building Spring Batch jobs that read from or write to Kafka, including when debugging deserializer configuration or asking when Spring Batch's Kafka support beats plain batch listeners.

Recommended by 0 people across 0 different months, 2020 to 2024.

What it is

A Spring Tips episode in which Josh Long walks through the then-new community contribution that adds Apache Kafka support to Spring Batch. It shows how to bridge batch and streaming workloads, such as staging large writes through Kafka and draining them with Spring Batch, and touches on related Spring projects.

What people said

Cites PAA · 2020-04 · Stack Overflow · on “Caused by: org.apache.kafka.common.errors.SerializationException: Can't deserialize data [”

I'm working on Spring Batch and Apache Kafka Stream . Inspiration from : [this video] . In this example, I am simply trying to read the customers stream looking to write that data into CSV. Error: org.apache.kafka.common.errors.SerializationException: Error deserializing key/value for partition customers-0 at offset 0. If needed, please seek past the record to continue consumption. Caused by: org.apache.kafka.common.errors.SerializationException: Can't deserialize data [[123, 34, 105, 100, 34, 58, 49, 44, 34, 102, 105, 114, 115, 116, 78, 97, 109, 101, 34, 58, 34, 32, 74, 111, 104, 110, 34, 44, 34, 108, 97, 115, 116, 78, 97, 109, 101, 34, 58, 34, 32, 68, 111, 101, 34, 44, 34, 98, 105, 114, 116, 10

Cites Ash3060 · 2021-05 · Stack Overflow · on “Spring Batch and Apache Kafka”

I am in learning phase of Kafka.I came across this video This Video [this video] This confuses me alot. I am able to understand kafka consumer and producer and i can see lot of reference materials related to that. We have batch listeners already there so why we need spring batch support here .Is there any specific advantage of using spring kafka batch over using normal batch listeners? Please help me in understanding as i can't see any reference materials comparing both.What i felt that we have more freedom and customisations using normal consumer and producer.Please correct me if i am wrong.

Cites Turkhan Badalov · 2024-01 · Stack Overflow · on “Error - is in unnamed module of loader org.springframework.boot.devtools.restart.classloader.RestartClassLoader @74b715ff)”

In case with Kafka, I saw the same issue in this tutorial [this video] . The problem was that the key-deserializer and value-deserializer were misconfigured.