kwaroran f46df1af20 Add Llama3 tokenizer support

2024-04-23 23:02:27 +09:00

..

claude

[feat] trin & claude tokenizer + novellist support

2023-06-25 21:43:28 +09:00

llama

Add Llama3 tokenizer support

2024-04-23 23:02:27 +09:00

mistral

[feat] add mistral support

2023-12-13 12:33:58 +09:00

nai

[feat] nerdslash

2023-07-29 09:48:59 +09:00

trin

[feat] trin & claude tokenizer + novellist support

2023-06-25 21:43:28 +09:00