Semantic chunking crumbled when my sentences appeared worlds aside.
My first try at semantic chunking collapsed when distant sentences shared an excessive amount of which means. Nonetheless, an agentic method is expensive and too gradual typically. I wished to discover a candy spot in between. I wished it to be moderately correct but cheaper.
RAG apps closely rely upon chunking methods. Higher chunks result in higher responses. There are a lot of methods to chunk a textual content. The best and hottest is recursive character chunking, and the marginally difficult but useful one is semantic chunking. The extra human-like method is agentic -chunking.
Should you’re new, take a look at my prior posts about chunking.