Connect MongoDB Atlas as source to Kafka on Kubernetes

Other MongoDB Topics Open Source Projects
, ,
1

Hi everyone,

Thank you for taking the time to read my query.

I am trying to use Python to connect my MongoDB Atlas as a source to push to a topic present on kafka (Bitnami) on Kubernetes. Almost all the material/documentation/videos I have read use Confluent.

I want to leverage an open-source, cloud-agnostic method using Python-Kafka on Kubernetes to leverage MongoDB Atlas as a source. I am looking for a sample code/connector where I can track MongoDB Atlas using the KafkaProducer command.

Here is my docker file for reference for Kafka on Kubernetes.

version: "3"
services:
  zookeeper:
    image: 'bitnami/zookeeper:latest'
    ports:
      - '2181:2181'
    environment:
      - ALLOW_ANONYMOUS_LOGIN=yes
  kafka:
    image: 'bitnami/kafka:latest'
    ports:
      - '9092:9092'
    environment:
      - KAFKA_BROKER_ID=1
      - KAFKA_CFG_LISTENERS=PLAINTEXT://:9092
      - KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://127.0.0.1:9092
      - KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper:2181
      - ALLOW_PLAINTEXT_LISTENER=yes
    depends_on:
      - zookeeper

Your help and time is much appreciated.