MongoDB Developer
MongoDB Developer Centerchevron-right
Developer Topicschevron-right

Kafka

plus Follow
Sign in to follow topics

Featured

random alt
Tutorial

Migrate from Azure CosmosDB to MongoDB Atlas Using Apache Kafka

Learn how to migrate your data in Azure CosmosDB to MongoDB Atlas using Apache Kafka....
KafkaAtlasJavaScript

May 09, 2022
Robert Walters
Play Button
Podcast

MongoDB Podcast Interview with Connectors and Translators Team


Sep 23, 2022
Tutorial

Kafka to MongoDB Atlas End to End Tutorial


May 13, 2022
All Kafka Content
search
  • Newest
  • Highest Rated
  • Closest Upcoming
Play Button
Podcast

Ep. 115 Exploring Kafka with Kris Jenkins and Rob Walters

Today on the show we're talking about streaming data and streaming applications with Apache Kafka. We're joined by Kris Jenkins, Developer Advocate from Confluent, and Rob Walters, Product Manager at MongoDB, who will discuss how you can leverage this technology to your benefit and use it in your applications.


Kafka is traditionally used for building real time streaming data pipelines and real time streaming applications. It began its life in 2010 at LinkedIn and made its way to the public open-source space through a relationship with Apache, the Apache Foundation, in 2011. Since then, the use of Kafka has grown massively and it's estimated that approximately 30% of all Fortune 500 companies are already using Kafka in one way or another.


A great example for why you might want to use Kafka would be perhaps capturing all of the user activity that happens on your website. As users visit your website, they're interacting with links on the page and scrolling up and down. This is potentially large volumes of data. You may want to store this to understand how users are interacting with your website in real time. Kafka will aid in this process by ingesting and storing all of this activity data while serving up reads for applications on the other side.


Conversation highlights include:

  • [03:38] What is Kafka?
  • [05:29] At the heart of every database
  • [08:03] The difference between Kafka and a database
  • [09:03] What Kafka's architecture looks like
  • [12:03] Kafka as a data backbone of system architecture
  • [14:06] MongoDB and Kafka working together
  • [15:40] What are "Topics" in Kafka?
  • [17:53] Chain stream events
  • [19:58] Kafka's history
  • [22:07] MongoDB Connector, and Kafka via Confluent Cloud
  • [25:53] Popular use cases using Kafka and MongoDB
  • [27:48] Kafka and stream processing with games and event data
  • [29:13] KSQL and processing against the stream of data
  • [30:59] Developer.Confluence.io, a place to learn everything about Kafka
...

Jun 24, 2022
alt not provided
Article

Learn How to Leverage MongoDB Data within Kafka with New Tutorials!

MongoDB Documentation has released a series of new tutorials based upon a self-hosted Docker compose environment that includes all the components needed to learn....

Jun 06, 2022
Robert Walters
alt not provided
Tutorial

Integrating MongoDB with Amazon Managed Streaming for Apache Kafka (MSK)

In this article, learn how to set up Amazon MSK, configure the MongoDB Connector for Apache Kafka, and how it can be used as both a source and sink for data integration with MongoDB Atlas running in AWS....

May 06, 2022
Igor Alekseev (+1)
alt not provided
Tutorial

Tuning the MongoDB Connector for Apache Kafka

When building a MongoDB and Apache Kafka solution, the default configuration values satisfy many scenarios, but there are some tweaks to increase performance. In this article, we walk through important configuration properties as well as general best practice recommendations. ...

Mar 01, 2022
Robert Walters (+1)
alt not provided
Tutorial

Go to MongoDB Using Kafka Connectors - Ultimate Agent Guide

Go is a cross-platform language. When combined with the power of Confluent Kafka streaming to MongoDB Atlas, you’ll be able to form tools and applications with real-time data streaming and analytics. Here’s a step-by-step tutorial to get you started....

Feb 08, 2022
Pavel Duchovny
alt not provided
Tutorial

Kafka to MongoDB Atlas End to End Tutorial

A simple step-by-step tutorial on how to use MongoDB Atlas with a Kafka Connector and connect it to any Remote Kafka Cluster....

Jan 25, 2022
Pavel Duchovny
Play Button
Podcast

MongoDB Podcast Interview with Connectors and Translators Team

MongoDB Podcast Interview with Connectors and Translators Team...

Jan 10, 2022
alt not provided
Tutorial

Migrate from Azure CosmosDB to MongoDB Atlas Using Apache Kafka

Learn how to migrate your data in Azure CosmosDB to MongoDB Atlas using Apache Kafka....

Nov 09, 2021
Robert Walters