Hi everyone,
I have huge amounts of data to insert and want to use a data pipeline which is called “Vector”. Does anyone have any idea how to connect it to mongodb? Or use any other datapipline that is compatible with mongodb.
Hi @Farbod_Seidali ,
Looking at the Vector “sinks” documentation I don’t see a direct MongoDB option:
https://vector.dev/docs/reference/configuration/sink
However, there are a few options you can consider:
- Running the data into a Kafka Topic and using the Kafka connector SINK to write your data to MongoDB.
- Build an HTTPs service that uses MongoDB driver to batch insert the data.
- Use Atlas HTTPS endpoints or Data API with the vector HTTPS sink to write data into an Atlas Cluster.
Ty
Pavel
Stay tuned for MongoDB 7 product announcements