Kwaroran
|
338d1cfec2
|
Add models
|
2025-01-29 05:38:26 +09:00 |
|
Kwaroran
|
fe47f58c61
|
Add LoadingStatusState and improve tokenizer functionality
|
2024-12-26 06:00:07 +09:00 |
|
kwaroran
|
b94323510d
|
feat: Add support for Cohere AI model in tokenizer
|
2024-05-28 02:30:43 +09:00 |
|
kwaroran
|
007f6bf59e
|
feat: Add gemini tokenizer for gemma model
|
2024-05-28 02:25:06 +09:00 |
|
kwaroran
|
f46df1af20
|
Add Llama3 tokenizer support
|
2024-04-23 23:02:27 +09:00 |
|
kwaroran
|
6f54c90187
|
[feat] add mistral support
|
2023-12-13 12:33:58 +09:00 |
|
kwaroran
|
560f6b56e3
|
[feat] llama tokenzier
|
2023-09-09 07:18:20 +09:00 |
|
kwaroran
|
401498b76d
|
[feat] nerdslash
|
2023-07-29 09:48:59 +09:00 |
|
kwaroran
|
e0b04784da
|
[feat] trin & claude tokenizer + novellist support
|
2023-06-25 21:43:28 +09:00 |
|