techniques
Chunking
Splitting documents into smaller pieces for storage in a vector database. Chunk size is a critical design choice: too big and you retrieve irrelevant context, too small and you lose meaning. Typical sizes: 200-1,000 tokens per chunk.
Want to learn more about AI?
Peter Saddington has trained 17,000+ people on agile and AI. Let’s talk.
Work with Peter