hypav2 working update

Everything works as intended.
when the first chat limit is reached, it succesfully summarize the previous chats according to the chunk size, and then returns the chat with summarized text as a system prompt, with other chats after that summarized point correctly appended.
Automatic sub-chunking also works perfectly.

Tested with sub-model.
This commit is contained in:
LightningHyperBlaze45654
2024-06-15 23:34:00 -07:00
parent 901d07bcf1
commit 4ef256dcf9
2 changed files with 52 additions and 68 deletions

View File

@@ -733,6 +733,7 @@ export async function sendChat(chatProcessIndex = -1,arg:{chatAdditonalTokens?:n
else if(db.hypav2){ //HypaV2 support needs to be changed like this.
const sp = await hypaMemoryV2(chats, currentTokens, maxContextTokens, currentChat, nowChatroom, tokenizer)
if(sp.error){
console.log(sp)
alertError(sp.error)
return false
}