mirror of https://github.com/amithkoujalgi/ollama4j.git synced 2025-10-14 17:38:58 +02:00

Refactor error handling and update tests

Refactored error handling in OllamaChatEndpointCaller by extracting status code checks into a helper method. Improved logging for image loading errors in OllamaChatRequestBuilder. Updated integration and unit tests to relax assertions and clarify comments. Minor documentation formatting fixes and Makefile improvement for reproducible npm installs.

2025-09-18 01:50:23 +05:30

4.3 KiB

Raw Blame History

sidebar_position

sidebar_position
5

import CodeEmbed from '@site/src/components/CodeEmbed';

Generate with Tools

This API lets you perform tool/function calling using LLMs in a synchronous way. This API corresponds to the generate API with raw mode.

:::note

This is an only an experimental implementation and has a very basic design.

Currently, built and tested for Mistral's latest model only. We could redesign this in the future if tooling is supported for more models with a generic interaction standard from Ollama.

:::

Tools/Function Calling

Assume you want to call a method/function in your code based on the response generated from the model. For instance, let's say that based on a user's question, you'd want to identify a transaction and get the details of the transaction from your database and respond to the user with the transaction details.

You could do that with ease with the function calling capabilities of the models by registering your tools.

Create Tools/Functions

We can create static functions as our tools.

This function takes the arguments location and fuelType and performs an operation with these arguments and returns fuel price value.

This function takes the argument city and performs an operation with the argument and returns the weather for a location.

Another way to create our tools is by creating classes by extending ToolFunction.

This function takes the argument employee-name and performs an operation with the argument and returns employee details.

Define Tool Specifications

Lets define a sample tool specification called Fuel Price Tool for getting the current fuel price.

Specify the function name, description, and required properties (location and fuelType).
Associate the getCurrentFuelPrice function you defined earlier.

Lets also define a sample tool specification called Weather Tool for getting the current weather.

Specify the function name, description, and required property (city).
Associate the getCurrentWeather function you defined earlier.

Lets also define a sample tool specification called DBQueryFunction for getting the employee details from database.

Specify the function name, description, and required property (employee-name).
Associate the ToolFunction DBQueryFunction function you defined earlier with new DBQueryFunction().

Now put it all together by registering the tools and prompting with tools.

Run this full example and you will get a response similar to:

:::tip[LLM Response]

[Result of executing tool 'current-fuel-price']: Current price of petrol in Bengaluru is Rs.103/L

[Result of executing tool 'current-weather']: Currently Bengaluru's weather is nice.

[Result of executing tool 'get-employee-details']: Employee Details {ID: 6bad82e6-b1a1-458f-a139-e3b646e092b1, Name: Rahul Kumar, Address: King St, Hyderabad, India, Phone: 9876543210}

:::

4.3 KiB Raw Blame History

Generate with Tools

Tools/Function Calling

Create Tools/Functions

Define Tool Specifications

4.3 KiB

Raw Blame History