Commit Graph

38 Commits

Author SHA1 Message Date
kwaroran
b94323510d feat: Add support for Cohere AI model in tokenizer 2024-05-28 02:30:43 +09:00
kwaroran
007f6bf59e feat: Add gemini tokenizer for gemma model 2024-05-28 02:25:06 +09:00
IHaBiS02
1aade242ec Add supports of gpt-4o tokenizer for reverse_proxy 2024-05-14 06:30:36 +09:00
kwaroran
a79a00bd00 chore: Update version to 1.102.4 2024-05-14 03:02:48 +09:00
kwaroran
58513ed54a Add tokenizer playground 2024-04-24 22:06:02 +09:00
kwaroran
f46df1af20 Add Llama3 tokenizer support 2024-04-23 23:02:27 +09:00
kwaroran
da272d83d8 Add custom tokenizers 2024-04-19 13:35:56 +09:00
kwaroran
dbe1a45317 Refactor multimodal and add claude-3 vision support 2024-03-17 23:48:24 +09:00
kwaroran
e6f6ef829c Remove console.log statements 2024-03-16 14:41:44 +09:00
kwaroran
66fd70c01a Add postfile function 2024-02-26 23:13:29 +09:00
kwaroran
9db4810bbc Experimental llamacpp support 2024-01-16 10:56:23 +09:00
justpain02
ff4c67b993 Add selectable tokenizer supports on Ooba 2024-01-05 23:57:59 +09:00
kwaroran
6f54c90187 [feat] add mistral support 2023-12-13 12:33:58 +09:00
kwaroran
341ea3c364 [ref] remove unused 2023-12-10 03:38:21 +09:00
kwaroran
10710b6bc2 [fix] ban 2023-12-07 00:03:50 +09:00
kwaroran
a3dba9f306 [feat] strongban 2023-12-06 18:21:06 +09:00
kwaroran
6a6321c5dc [fix] ooba to use llama tokenizer 2023-12-03 21:31:14 +09:00
kwaroran
26f4ce94fa [fix] consistant tokenizing 2023-11-24 14:50:06 +09:00
kwaroran
634fe418b4 [feat] accurate tokenizing 2023-11-23 17:52:00 +09:00
kwaroran
714c81017d [feat] ooba mode 2023-11-16 04:02:59 +09:00
kwaroran
da49cf05f6 [feat] inlay images 2023-11-10 19:49:16 +09:00
kwaroran
78b963625c [ref] tokenizer.ts 2023-09-09 07:23:23 +09:00
kwaroran
0f32e58939 [ref] tokenizer.ts 2023-09-09 07:22:06 +09:00
kwaroran
560f6b56e3 [feat] llama tokenzier 2023-09-09 07:18:20 +09:00
kwaroran
4aefd681fe [feat] better nai 2023-08-04 21:00:40 +09:00
kwaroran
c7454be769 [fix] chat 2023-08-03 14:15:47 +09:00
kwaroran
401498b76d [feat] nerdslash 2023-07-29 09:48:59 +09:00
kwaroran
2f1cae91f9 [fix] stringlize ain and revert cha 2023-06-25 23:55:47 +09:00
kwaroran
15d7b188c5 [fix] tokenizers not working 2023-06-25 21:56:02 +09:00
kwaroran
e0b04784da [feat] trin & claude tokenizer + novellist support 2023-06-25 21:43:28 +09:00
kwaroran
2de284f4e9 [feat] data sync 2023-06-12 12:27:01 +09:00
kwaroran
08cd214bcb [fix] tokenizer problem 2 2023-06-10 02:38:36 +09:00
kwaroran
6fc60805e6 [fix] tokenizer 2023-06-10 02:27:54 +09:00
kwaroran
dbf5f6b25a [feat] new tokenizing 2023-06-09 22:27:34 +09:00
kwaroran
9974ff0df1 [refactor] transformer tokenizer 2023-06-07 09:23:29 +09:00
kwaroran
f37ae13d83 [feat] novellist api 2023-06-07 08:57:42 +09:00
kwaroran
205cc2744f [feat] node hosting support 2023-05-27 23:15:23 +09:00
kwaroran
2c5c7d2694 Risuai 0.6.3 first commit 2023-05-07 12:41:45 +09:00