Should I store embeddings in the same document as the data?

[Will_Calderwood]

I did a bit more digging and created a separate post related to performance here:

Why do these perform so differently?

I have tested two methods of fetching the same data from a MongoDb Atlas hosted database. embeddingOpenAi3Large is an array of 3072 numbers . Method 1 individually fetches all 50 items, if I include the embeddingOpenAi3Large it takes 1400ms seconds, if I don’t, it takes 380ms. let startTime = Date.now(); const promises: Promise<INewsItemWithEmbeddedContent[]>[] = new Array< Promise<INewsItemWithEmbeddedContent[]> >(); for (const result of results) { promises.push( …

My assumption is that it’s to do with memory limits and paging. It is indeed a M0 cluster.