Присоединяйтесь к Сэп Libre у партнера и партнерскую программу и поддержать нашу бесплатную открытую платформу
Self, AIML, and scripting

implementation of local LLM on local install of Bot Libre Community Edition.

по invzame опубликовано May 29 2023, 14:50

I have a local install of CE installed on docker. Its running great with no issues. My question is, in SELF, is there any way I can integrate a locally running LLM running on PyTorch to my bot? Another idea I had was to also try and make an inference API call on one of the pretrained models on huggingface and I haven't been able to get that to work either. I'm new to self and I'm kind of scratching my head with this problem. 


by admin posted May 30 2023, 8:18
You will need to create a web API to expose your Python API such as using the Flask Python web server.
You can then call the web API from Self.

Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 551, today: 0, week: 0, month: 12

Идентификатор: 47685232
Опубликовано: May 29 2023, 14:50
Ответы: 1
Вид: 587, сегодня: 1, неделю: 1, месяц: 13
0 0 0.0/5