Skip to content

Latest commit

 

History

History
48 lines (33 loc) · 1.71 KB

README.md

File metadata and controls

48 lines (33 loc) · 1.71 KB
Raw

node-kafka-0.8-plus

nodejs library for Apache Kafka 0.8 and above

Goal

The main goal of this library is to implement the kafka 0.8 protocol to enable the implementation of consumers and producers in javascript

Environment setup

Docker - https://www.docker.io/

  • If you are running docker within vagrant and want to connect to your broker from outside vagrant, ensure you've enabled port forwarding
    • FORWARD_DOCKER_PORTS='true' vagrant up
  • Start a broker
    • start-broker.sh <brokerId> <port> <hostIp>
  • Start a kafka shell
    • start-kafka-shell.sh
  • From within the shell, create a topic
    • $KAFKA_HOME/bin/kafka-topics.sh --create --topic node-topic --partitions 2 --zookeeper $ZK_PORT_2181_TCP_ADDR --replication-factor 1
  • For more details and troubleshooting see https://github.com/wurstmeister/kafka-docker

Vagrant - http://www.vagrantup.com/

Testing

  1. git clone https://github.com/wurstmeister/node-kafka-0.8-plus.git
  2. cd node-kafka-0.8-plus
  3. npm install
  4. node test/LowLevelConsumerTest.js --host=<hostIp> --port=<port> | ./node_modules/.bin/bunyan
  5. node test/ProducerTest.js --host=<hostIp> --port=<port> | ./node_modules/.bin/bunyan

Todo

  • error handling
  • configuration
  • support for gzip/snappy
  • high level consumer implementation