/b/ - Random

nothing wrong with this but nigga you probably need help

OP, what AI is this please?

>>5690
Good morning saar

link?

>>5690
>>5692
I'm running it locally on my machine. It's not a website you go to to run it.

>>5691
good morning nigger
>>5693
okay smartypants, what is the local software then?

>>5694
The frontend is the user interface you see. That's SillyTavern. The backend is what loads the AI model, that's kobolcpp. The model itself I believe is a compressed version of llama3.3 70b. I'm just testing out models, so the one I'm using isn't the best for role-playing.

>>5695
The models are downloaded from huggingface.co and the format you're looking for is gguf since that's what koboldcpp loads. The model you should download and run depends on how much vram your gpu has. The model size needs to be less than the amount of vram your gpu has.

>>5695
>>5696
alright thanks my nigga. im sort of busy so ill try it out later and post an update

>>5697
You're probably not going to figure this shit out by yourself unless you follow a tutorial. 

https://inv.nadeko.net/watch?v=bHqJ6mo1P-4

>>5696
How did you get the prompt for the girl? Did you just make up your own prompt?

>>5699
You can type whatever you want in the character definitions. If I recall correctly, the only thing I typed in there for Sara was that she was a pale spanish 5 year old girl with brown hair and blue eyes. Then you just start the conversation however you want. You're given an example with the Seraphina character when you start up SillyTavern. It's a default character that comes preinstalled.

bump

why the fuck are there so many steps

ts works.

im gonna make my waifu