Streaming from mongodb community server to kinesis

Working with Data Connectors & Integrations
1

Hi,

I am looking for a guide to find guide to stream live data from mongodb community edition installed on aws EC2 to aws kinesis and than to redshift.

2

Hi @malik_kamran,

I’m not completely sure if I got you right, but you could do it as follows:

  1. You could stream changes from mongodb to kafka using the official source connector for MongoDB
    https://docs.mongodb.com/kafka-connector/current/kafka-source/

  2. The data in Kafka topics can be written to kinesis using a kinesis sink connector e.g.
    GitHub - awslabs/kinesis-kafka-connector: kinesis-kafka-connector is connector based on Kafka Connect to publish messages to Amazon Kinesis streams or Amazon Kinesis Firehose.

  3. Additionally you can write the same data from MongoDB which already resides in Kafka topics into redshift using a redshift sink connector Amazon Redshift Sink Connector | Confluent Hub

Please let me know if this is what you had in mind.