The day has come:
https://codeberg.org/owner451/simplex-koboldcpp-llm-bot/src/branch/main

Codeberg repo for my fork of the simplex-llm-bot using koboldcpp:

#privacy
#messenger
#simplex
#SimpleX
@SimpleX Chat
#nostr
#ai
#llm
#diy
#selfhosting
#linux
#koboldcpp
#bot
#datenschutz
#privatsphäre

Rewrote my bot to read values from a config file and the result has been great so far. Here is how it looks for me:
[Sampler]
temperature = 0.62
max_length = 14500
max_context_length = 32768
top_p = 0.90
min_p = 0.07
top_k = 25
rep_pen = 1.04
rep_pen_range = 330
rep_pen_slope = 0.6
enable_thinking = False
stop_sequence = <end_of_turn>\n<start_of_turn>user, <end_of_turn>\n<start_of_turn>model, <end_of_turn>
[Settings]
host = http://localhost:5001
display_name=UEAIB
full_name=unofficial experimental AI bot
description=I'm not responsible for alien invasions
welcome_message=This is a test chatbot running on my shitbox. I can see all of your queries.\nUse /reset command to start a new session. Session will automatically reset after 5 minutes without messages.\nDo NOT share private or security-sensitive information!\ntemporary contact: https://smp5.simplex.im/a#-m-PgMG-4tFTrzkwF3BFf5x-rDHbaW7oeFOWNrhLtFs
auto_accept_message=
command_prefix=/
image = data:image/jpg;base64,/9j/4AAQSkZJRgABAQAAAQABAA(long base64 image)
[Adapter]
system_start: <|im_start|>system\n
system_end: <|im_end|>\n
user_start: <|im_start|>user\n
user_end: <|im_end|>\n
assistant_start: <|im_start|>assistant\n
assistant_end: <|im_end|>\n

I'm too lazy to write anything else, just beleave me that this is exciting.

Link:
https://smp6.simplex.im/a#cSOiK--O58xQht8Nz5B0-qygNSl-l3IAVN6rJ6qTGeI

#simplex
#SimpleX
#bot
#messenger
#privacy
#nost
#introductions
Profile picture by @Vyram Kraven

I've made updates and improvements to the unofficial experimental AI bot, so that now, fox ex., the /reset command is terminating the generation task, while running all commands asyncronously.

https://smp6.simplex.im/a#cSOiK--O58xQht8Nz5B0-qygNSl-l3IAVN6rJ6qTGeI

Check out my @SimpleX Chat LLM bot using koboldcpp. It's pretty self explanetory, here is the link:

https://smp6.simplex.im/a#cSOiK--O58xQht8Nz5B0-qygNSl-l3IAVN6rJ6qTGeI

Ps: I can see what you type into there ofc

#simplex
#SimpleX
#privacy
#technology
#messenger
#messengers
#datenschutz