What is Chunking in AI? A Solution to Passing Large Documents
Rate this video
Passing large documents as input to an LLM means that the LLM has to parse out the most relevant information to answer user queries. This can be challenging given that LLMs are designed to process input sequentially, token by token. This is where chunking helps.
-
Learn more about chunking in AI on Developer Center: https://mdb.link/choosing-chunking-strategy