github-mirror/n8n
1
0
Fork 0
mirror of https://github.com/n8n-io/n8n.git synced 2026-06-02 09:47:00 +02:00
Code Issues Actions 26 Packages Projects Releases Wiki Activity Graph
cc39c50737
n8n/packages/@n8n/nodes-langchain/utils/tokenizer
History
oleg c5ec056eb5
fix(Token Splitter Node): Prevent tiktoken blocking on repetitive content (#16769)
2025-06-27 16:08:14 +02:00
..
tests fix(Token Splitter Node): Prevent tiktoken blocking on repetitive content (#16769) 2025-06-27 16:08:14 +02:00
cl100k_base.json feat(Token Splitter Node): Replace remote tiktoken encoding with local implementation (#16548) 2025-06-20 16:08:16 +02:00
o200k_base.json feat(Token Splitter Node): Replace remote tiktoken encoding with local implementation (#16548) 2025-06-20 16:08:16 +02:00
tiktoken.ts feat(Token Splitter Node): Replace remote tiktoken encoding with local implementation (#16548) 2025-06-20 16:08:16 +02:00
token-estimator.ts fix(Token Splitter Node): Prevent tiktoken blocking on repetitive content (#16769) 2025-06-27 16:08:14 +02:00