forked from Mirror/ollama4j
153 lines
5.0 KiB
Markdown
153 lines
5.0 KiB
Markdown
### Ollama4j
|
|
|
|
<img src='https://raw.githubusercontent.com/amithkoujalgi/ollama4j/65a9d526150da8fcd98e2af6a164f055572bf722/ollama4j.jpeg' width='100' alt="ollama4j-icon">
|
|
|
|
A Java library (wrapper/binding) for [Ollama](https://ollama.ai/) server.
|
|
|
|
Find more details on the [website](https://amithkoujalgi.github.io/ollama4j/).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
[](https://codecov.io/gh/amithkoujalgi/ollama4j)
|
|
|
|
|
|
|
|
## Table of Contents
|
|
|
|
- [How does it work?](#how-does-it-work)
|
|
- [Requirements](#requirements)
|
|
- [Installation](#installation)
|
|
- [API Spec](#api-spec)
|
|
- [Demo APIs](#try-out-the-apis-with-ollama-server)
|
|
- [Development](#development)
|
|
- [Contributions](#get-involved)
|
|
- [References](#references)
|
|
|
|
#### How does it work?
|
|
|
|
```mermaid
|
|
flowchart LR
|
|
o4j[Ollama4j]
|
|
o[Ollama Server]
|
|
o4j -->|Communicates with| o;
|
|
m[Models]
|
|
subgraph Ollama Deployment
|
|
direction TB
|
|
o -->|Manages| m
|
|
end
|
|
```
|
|
|
|
#### Requirements
|
|
|
|
|
|
|
|
[![][ollama-shield]][ollama] **Or** [![][ollama-docker-shield]][ollama-docker]
|
|
|
|
[ollama]: https://ollama.ai/
|
|
|
|
[ollama-shield]: https://img.shields.io/badge/Ollama-Local_Installation-blue.svg?style=just-the-message&labelColor=gray
|
|
|
|
[ollama-docker]: https://hub.docker.com/r/ollama/ollama
|
|
|
|
[ollama-docker-shield]: https://img.shields.io/badge/Ollama-Docker-blue.svg?style=just-the-message&labelColor=gray
|
|
|
|
#### Installation
|
|
|
|
In your Maven project, add this dependency:
|
|
|
|
```xml
|
|
|
|
<dependency>
|
|
<groupId>io.github.amithkoujalgi</groupId>
|
|
<artifactId>ollama4j</artifactId>
|
|
<version>1.0.57</version>
|
|
</dependency>
|
|
```
|
|
|
|
Latest release:
|
|
|
|
|
|
|
|
[![][lib-shield]][lib]
|
|
|
|
[lib]: https://central.sonatype.com/artifact/io.github.amithkoujalgi/ollama4j
|
|
|
|
[lib-shield]: https://img.shields.io/badge/ollama4j-get_latest_version-blue.svg?style=just-the-message&labelColor=gray
|
|
|
|
#### API Spec
|
|
|
|
Find the full API specifications on the [website](https://amithkoujalgi.github.io/ollama4j/).
|
|
|
|
#### Development
|
|
|
|
Build:
|
|
|
|
```shell
|
|
make build
|
|
```
|
|
|
|
Run unit tests:
|
|
|
|
```shell
|
|
make ut
|
|
```
|
|
|
|
Run integration tests:
|
|
|
|
```shell
|
|
make it
|
|
```
|
|
|
|
#### Releases
|
|
|
|
Releases (newer artifact versions) are done automatically on pushing the code to the `main` branch through GitHub
|
|
Actions CI workflow.
|
|
|
|
#### Traction
|
|
|
|
[](https://star-history.com/#amithkoujalgi/ollama4j&Date)
|
|
|
|
### Areas of improvement
|
|
|
|
- [x] Use Java-naming conventions for attributes in the request/response models instead of the
|
|
snake-case conventions. (
|
|
possibly with Jackson-mapper's `@JsonProperty`)
|
|
- [x] Fix deprecated HTTP client code
|
|
- [x] Setup logging
|
|
- [x] Use lombok
|
|
- [x] Update request body creation with Java objects
|
|
- [ ] Async APIs for images
|
|
- [ ] Add custom headers to requests
|
|
- [x] Add additional params for `ask` APIs such as:
|
|
- [x] `options`: additional model parameters for the Modelfile such as `temperature` -
|
|
Supported [params](https://github.com/jmorganca/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values).
|
|
- [x] `system`: system prompt to (overrides what is defined in the Modelfile)
|
|
- [x] `template`: the full prompt or prompt template (overrides what is defined in the Modelfile)
|
|
- [x] `context`: the context parameter returned from a previous request, which can be used to keep a
|
|
short
|
|
conversational memory
|
|
- [x] `stream`: Add support for streaming responses from the model
|
|
- [ ] Add test cases
|
|
- [ ] Handle exceptions better (maybe throw more appropriate exceptions)
|
|
|
|
### Get Involved
|
|
|
|
Contributions are most welcome! Whether it's reporting a bug, proposing an enhancement, or helping
|
|
with code - any sort
|
|
of contribution is much appreciated.
|
|
|
|
### Credits
|
|
|
|
The nomenclature and the icon have been adopted from the incredible [Ollama](https://ollama.ai/)
|
|
project.
|
|
|
|
### References
|
|
|
|
- [Ollama REST APIs](https://github.com/jmorganca/ollama/blob/main/docs/api.md) |