Time Series
Time series data is a sequence of data points in which insights are gained by analyzing changes over time.
Time series data is generally composed of these components:
Time when the data point was recorded.
metadata (sometimes referred to as source), which is a label or tag that identifies a data series and rarely changes. Metadata is stored in a metaField. You cannot add metaFields to time series documents after you create them. For more information on metaField behavior and selection, see metaFields.
Measurements (sometimes referred to as metrics or values), which are the data points tracked at increments in time. Generally these are key-value pairs that change over time.
This table shows examples of time series data:
Example | Measurement | Metadata |
|---|---|---|
Stock data | Stock price | Stock ticker, exchange |
Weather data | Temperature | Sensor identifier, location |
Website visitors | View count | URL |
For efficient time series data storage, MongoDB provides time series collections.
Time Series Collections
New in version 5.0.
Time series collections efficiently store time series data. In time series collections, writes are organized so that data from the same source is stored alongside other data points from a similar point in time.
You can create time series collections in the UI for deployments hosted in MongoDB Atlas.
Benefits
Compared to normal collections, storing time series data in time series collections improves query efficiency and reduces the disk usage for time series data and secondary indexes. MongoDB 6.3 and later automatically creates a compound index on the time and metadata fields for new time series collections.
Time series collections use an underlying columnar storage format and store data in time-order. This format provides the following benefits:
Reduced complexity for working with time series data
Improved query efficiency
Reduced disk usage
Reduced I/O for read operations
Increased WiredTiger cache usage
Behavior
Time series collections generally behave like other MongoDB collections. You insert and query data as usual.
Warning
Match expressions in update and delete commands can only specify the metaField. You can't update other fields in a time series document. For more details, see Time Series Delete and Update Limitations.
MongoDB treats time series collections as writable non-materialized views backed by an internal collection. When you insert data, the internal collection automatically organizes time series data into an optimized storage format.
Starting in MongoDB 6.3: if you create a new time series collection, MongoDB also generates a compound index on the metaField and timeField fields. To improve query performance, queries on time series collections use the new compound index. The compound index also uses the optimized storage format.
Tip
To improve query performance, you can manually add secondary indexes on measurement fields or any field in your time series collection.
Important
Backward-Incompatible Feature
You must drop time series collections before downgrading:
MongoDB 6.0 or later to MongoDB 5.0.7 or earlier.
MongoDB 5.3 to MongoDB 5.0.5 or earlier.
Warning
Do not attempt to create a time series collection or view with the
name system.profile. MongoDB 6.3 and later versions return an
IllegalOperation error if you attempt to do so. Earlier MongoDB
versions crash.
Starting in MongoDB 8.0, use of the timeField as a shard key in a
time series collection is deprecated. Instead, reshard a collection with
the metaField. For details, see
Shard a Time Series Collection.
Also, starting in MongoDB 8.0, if you create a time series collection
with a shard key containing the timeField, a log message is added to the log file on the primary shard.
In addition, a log message is added every 12 hours on the primary node
of the config server replica set. The log messages state
that using the timeField as a shard key in a time series collection
is deprecated and you must reshard your collection using the
metaField.
metaFields
Time series documents can contain a metaField with metadata about each document. MongoDB uses the metaField to group sets of documents, both for internal storage optimization and query efficiency. For more information about the metaField, see metaField Considerations.
Indexes
MongoDB automatically creates a compound index on both the metaField and timeField of a time series collection.
Get Started
To get started with time series collections, see Create and Query a Time Series Collection.