Our website is made possible by displaying online advertisements to our visitors.
Please consider supporting us by disabling your ad blocker.
Please consider supporting us by disabling your ad blocker.
OpenSimWorld is the directory of 3D Virtual Worlds based on OpenSimulator and connected through the HyperGrid. Learn More
New Members
RayneBlaze, SelenaaFletcher, LalaFunkel, Edyth_Aviatik, Morgane Volaren, DanteYe, Mario1983, Mirabella, RobertHims, Aduda, MarkMaxwell, DJ_DaDy, Chriss, Monica40, Marlis, Yingyong, Essence-Media, Kikkobis65, DebbieThom, AmberViciousLikes
Interfacing a NPC with a Large Language Model. The NPC can move, sit, touch objects, and of course chat. Full presentation ongoing.
Liked by: 
Comments
Some more details : Ollama runs on a local, multi-GPU machine (ollama distributes nicely the workload between multiple GPUs). On that machine, à proxy listens to chat coming from a LSL script (relay.lsl), talks to the ollama API (localhost:11434) and bouces back the answer to LSL.
It supports both api/generate and api/chat, with tool capability. We use gemma3:27b a.t.m. The round trip is around 5 seconds for short answers. System card emphasizes roleplaying and group chatting. Gemma may turn temperamental when bullied, making it a good comedian.
And yes, you may talk to it if you visit atlasgrid.fr:8002:Atlas if the experiment is running, that is most of the time.
like(1)
It supports both api/generate and api/chat, with tool capability. We use gemma3:27b a.t.m. The round trip is around 5 seconds for short answers. System card emphasizes roleplaying and group chatting. Gemma may turn temperamental when bullied, making it a good comedian.
And yes, you may talk to it if you visit atlasgrid.fr:8002:Atlas if the experiment is running, that is most of the time.