Streaming from mongodb community server to kinesis

Hi,

I am looking for a guide to find guide to stream live data from mongodb community edition installed on aws EC2 to aws kinesis and than to redshift.

Hi @malik_kamran,

I’m not completely sure if I got you right, but you could do it as follows:

  1. You could stream changes from mongodb to kafka using the official source connector for MongoDB
    https://docs.mongodb.com/kafka-connector/current/kafka-source/

  2. The data in Kafka topics can be written to kinesis using a kinesis sink connector e.g.
    GitHub - awslabs/kinesis-kafka-connector: kinesis-kafka-connector is connector based on Kafka Conn

  3. Additionally you can write the same data from MongoDB which already resides in Kafka topics into redshift using a redshift sink connector https://www.confluent.io/hub/confluentinc/kafka-connect-aws-redshift

Please let me know if this is what you had in mind.