Skip to content

max-prosper/stringify-json-smt

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Kafka Connect SMT to convert values to JSON strings

This lib implements Kafka connect SMT (Single Message Transformation) to convert values of specified fields to JSON strings (stringify).

Config

Use it in connector config file:

...
"transforms": "stringify",
"transforms.stringify.type": "com.github.maxprosper.smt.stringifyjson.StringifyJson$Value",
"transforms.stringify.targetFields": "field1,field2",
...

Use dot notation for deeper fields (e. g. level1.level2).

Install to Kafka Connect

After build copy file target/stirngify-json-smt-0.0.4-jar-with-deps.jar to Kafka Connect container `` copying to its docker image or so.

It can be done adding this line to Dockerfile:

COPY ./target/stringify-json-smt-0.0.4-jar-with-deps.jar $KAFKA_CONNECT_PLUGINS_DIR

Or download current release:

RUN curl -fSL -o /tmp/plugin.tar.gz \
    https://github.com/max-prosper/stringify-json-smt/releases/download/0.0.4/stringify-json-smt-0.0.4.tar.gz && \
    tar -xzf /tmp/plugin.tar.gz -C $KAFKA_CONNECT_PLUGINS_DIR && \
    rm -f /tmp/plugin.tar.gz;

Build release file

  • Increment version in pom.xml (e.g. to 0.0.5).
  • Run build script: ./scripts/build-release.sh 0.0.5.
  • Take *.tar.gz file from target folder and publish it.