Purposes

This repository provides the connection to a ollama server. It's an API (suprise!), which is bound to an inbuild PocketBase authentification system.

The main benefit of using this repo is, that it's running 100% on your machines. No data ever leaves your network.

Prerequisits

• Ollama running & reachable
• ChromaDB running & reachable
• MongoDB running & reachable
• npm installed

Install

git clone git@gitlab.rrz.uni-hamburg.de:zbhai/ragchat-api.git
cd ragchat-api
npm i

Configure

populate the .env file with proper information

Start

npm start

optional - if pm2 installed

pm2 start ./ecosystem.config.cjs

Sources

Ollama

• Ollama API
• Ollama js

PocketBase

• PocketBase Docs
• PocketBase JS SDK

ChromaDB

• Chroma
• CheatSheet

Roadmap

• configure URLs in mail templates to match front end
• stresstest with artillery