Commit Graph

113 Commits

Author SHA1 Message Date
kwaroran
980f9688c2 [feat] aws test 2023-10-08 02:56:18 +09:00
kwaroran
dc65a386f2 [feat] custom proxy requst model 2023-09-23 16:24:57 +09:00
kwaroran
4a34dc3e23 [feat] add autofill option 2023-09-23 16:18:20 +09:00
kwaroran
a8fd602d5d [fix] stop tokens 2023-09-20 15:37:53 +09:00
kwaroran
fa0046a890 [fix] stop tokens 2023-09-20 15:12:41 +09:00
kwaroran
93e6e5299b [feat] add instruct 2023-09-20 14:30:41 +09:00
kwaroran
84ef5a1aff [fix] remoable 2023-09-10 08:59:33 +09:00
kwaroran
a9564189c4 [fix] continue 2023-09-09 07:48:34 +09:00
kwaroran
1b39526474 [feat] improve ooba template & ooba config 2023-08-30 20:04:21 +09:00
kwaroran
1290021d94 [feat] added miro and cfg to nai 2023-08-28 01:57:12 +09:00
kwaroran
f1fce49b89 [feat] better nai support 2023-08-28 00:32:57 +09:00
kwaroran
269673c671 [fix] risuidentify 2023-08-27 23:52:47 +09:00
kwaroran
bf1bd127ab gptq processing 2023-08-18 19:38:52 +09:00
kwaroran
4a66a585f7 [feat] continue response 2023-08-17 17:00:10 +09:00
kwaroran
22ea6b0890 mancer support 2023-08-15 16:31:47 +09:00
kwaroran
84a0af041d [fix] claude proxy model 2023-08-05 14:54:44 +09:00
kwaroran
38195761f8 [feat] ain bias 2023-08-04 21:05:12 +09:00
kwaroran
4aefd681fe [feat] better nai 2023-08-04 21:00:40 +09:00
kwaroran
c788399321 [feat] force openai option 2023-08-04 17:46:04 +09:00
kwaroran
b5e9b378ed [fix] oobabooga prompt template and autosuggest (#226)
# PR Checklist
- [x] Did you check if it works normally in all models? *ignore this
when it dosen't uses models*
- [x] Did you check if it works normally in all of web, local and node
hosted versions? if it dosen't, did you blocked it in those versions?
- [x] Did you added a type def?

# Description
The changes in #225 didn't seem to be enough, so I made an additional
fix.
2023-08-04 11:42:43 +09:00
kwaroran
d3dccbc80a [fix] antropic 2023-08-04 11:21:22 +09:00
aegkmq
2d2eb63fac Merge branch 'kwaroran:main' into main 2023-08-03 13:34:06 +09:00
kwaroran
7f03cbbff5 [fix] throw only on web 2023-08-03 13:11:56 +09:00
kwaroran
2bb3937d0d [feat] local request warn 2023-08-03 13:03:23 +09:00
kwaroran
7d369221dc [feat] log for streaming 2023-08-03 07:02:58 +09:00
aegkmq
838eaf81c8 [fix] prompt template and autosuggest 2023-08-02 21:14:24 +09:00
kwaroran
59dea11635 [fix] oobabooga (#225)
# PR Checklist
- [x] Did you check if it works normally in all models? *ignore this
when it dosen't uses models*
- [x] Did you check if it works normally in all of web, local and node
hosted versions? if it dosen't, did you blocked it in those versions?
- [x] Did you added a type def?

# Description
- Fix the sampling parameter inputs and remove unused settings (#224)
- Add the streaming features
- Force to use the model's prompt template
- Strict end-of-text checking with many stop strings
- Replace the oobabooga prebuilt preset with simple-1 (oobabooga preset
arena winner)
- Increase the default oobabooga truncation length from 2048 to 4096
(LLaMA 1 -> LLaMA 2)
2023-08-02 13:56:48 +09:00
aegkmq
dfb03d08d4 [fix] local model's prompt template 2023-08-02 12:23:50 +09:00
aegkmq
daf2118ebb [fix] meaningless stream.cancel() 2023-08-01 18:20:52 +09:00
aegkmq
f0257aca50 [feat] oobabooga streaming 2023-08-01 17:23:06 +09:00
aegkmq
8aacea9f1a [fix] oobabooga prompts 2023-08-01 15:58:41 +09:00
kwaroran
c5ab158f3d [feat] claude request 2023-08-01 07:29:15 +09:00
kwaroran
8d1c223423 [fix] kayra fix 2023-07-29 14:46:40 +09:00
kwaroran
538d664baf [feat] new nai formating/kayra 2023-07-29 08:57:28 +09:00
kwaroran
a370b9c033 [feat] add kayra 2023-07-29 08:07:01 +09:00
kwaroran
c96491d353 [feat] added risuidentify 2023-07-27 11:02:05 +09:00
kwaroran
d5a057168d [fix] model using submodel even if simple mode 2023-07-22 02:31:08 +09:00
kwaroran
26f6c911f6 [fix] tokens not going on streaming 2023-07-22 01:10:44 +09:00
kwaroran
873f9cf6f8 [feat] added tokens for reverse proxy 2023-07-22 01:04:29 +09:00
kwaroran
132a39384b [fix] request models 2023-07-21 03:13:01 +09:00
kwaroran
81c58d6d9f [feat] added reverse proxy claude 2023-07-20 16:20:24 +09:00
kwaroran
e57e133cb4 [fix] fixed huburl 2023-07-16 17:29:35 +09:00
LL
2bbb0ff9ca [fix] apply plain fetch option when use Streaming 2023-07-11 00:52:28 +09:00
kwaroran
86bc533e1b [fix] auth problem 2023-07-09 22:24:25 +09:00
kwaroran
7079e960f8 [fix] openrouter request 2023-07-09 22:16:14 +09:00
kwaroran
77502416b5 [feat] add openrouter 2023-07-09 21:59:47 +09:00
kwaroran
d4157d3ab6 [feat] added ain param 2023-07-09 21:30:53 +09:00
kwaroran
3564190235 [feat] added ooba 2023-07-09 21:13:47 +09:00
kwaroran
5f8be5a06c [fix] ooba force new api 2023-07-09 17:26:53 +09:00
kwaroran
8ba2c24674 [feat] ooba auto url 2023-07-09 17:26:11 +09:00