The goal is to query data on an regular schedule while pulling all data that has been created since the last load. This incremental load logic will allow us to analyze the most up to date data. We are having trouble with the query response time when using a WHERE clause on the timestamp
WHERE createdAt >= ‘2022-09-10 12:00:00’
Are other MongoDB users querying data with this much volume? Can this be done using MySQL in the BI connector?