Read large documents

The AI Agent splits the document in chunks to handle documents of any size efficiently. This chunking mechanism is essential because:

1. Large documents may exceed the context window of the LLM
2. Editing chunks is more efficient for multi-turn conversations
3. It allows the AI Agent to focus on specific parts of the document

Chunking mechanism

By default, the document is split into chunks of approximately 32000 characters each, while preserving HTML structure. The AI Agent reads one chunk at a time and can navigate to the next or previous chunk as needed.

Customize the amount of characters per chunk by setting the chunkSize option:

const provider = new AiAgentProvider({
  chunkSize: 2000, // Define a smaller chunk size
  // ...other options
})

Custom chunking

You can customize how the document is chunked by providing a custom chunkHtml function:

const provider = new AiAgentProvider({
  // ...other options
  chunkHtml: ({ html, chunkSize }) => {
    // Custom logic to split HTML into chunks
    // Must return an array of HTML strings
    return customSplitFunction(html, chunkSize)
  },
})