Streaming from mongodb community server to kinesis


I am looking for a guide to find guide to stream live data from mongodb community edition installed on aws EC2 to aws kinesis and than to redshift.

Hi @malik_kamran,

I’m not completely sure if I got you right, but you could do it as follows:

  1. You could stream changes from mongodb to kafka using the official source connector for MongoDB

  2. The data in Kafka topics can be written to kinesis using a kinesis sink connector e.g.
    GitHub - awslabs/kinesis-kafka-connector: kinesis-kafka-connector is connector based on Kafka Conn

  3. Additionally you can write the same data from MongoDB which already resides in Kafka topics into redshift using a redshift sink connector

Please let me know if this is what you had in mind.