Ollama Integration

[steventkrawczyk]

🚀 The feature

We want to integrate with Ollama: https://github.com/jmorganca/ollama

Goal is to build an experiment, like the LlamaCpp example: https://github.com/hegelai/prompttools/blob/main/prompttools/experiment/experiments/llama_cpp_experiment.py

Motivation, pitch

Ollama is a new way to run local models. It would be good to support this so developers can compare Ollama to LlamaCpp and other models/frameworks.

Alternatives

No response

Additional context

No response

[osamanatouf2]

@steventkrawczyk Can I take care of this issue?

[steventkrawczyk]

Sure! We had someone else interested in it but if you can raise a PR we'll check it out and get it merged 🚀

[steventkrawczyk]

@osamanatouf2 For more context, we need a python API to the Ollama server to run experiments. You can look at other experiments as examples.