n8n/packages/@n8n/nodes-langchain/utils/tokenizer
2025-06-20 16:08:16 +02:00
..
cl100k_base.json feat(Token Splitter Node): Replace remote tiktoken encoding with local implementation (#16548) 2025-06-20 16:08:16 +02:00
o200k_base.json feat(Token Splitter Node): Replace remote tiktoken encoding with local implementation (#16548) 2025-06-20 16:08:16 +02:00
tiktoken.ts feat(Token Splitter Node): Replace remote tiktoken encoding with local implementation (#16548) 2025-06-20 16:08:16 +02:00