2025-04-18 22:45:30 +05:30

2.1 KiB

sidebar_position
sidebar_position
1

import CodeEmbed from '@site/src/components/CodeEmbed';

Generate (Sync)

This API lets you ask questions to the LLMs in a synchronous way. This API corresponds to the completion API.

Use the OptionBuilder to build the Options object with extra parameters. Refer to this.

Try asking a question about the model

You will get a response similar to:

::::tip[LLM Response]

I am a large language model created by Alibaba Cloud. My purpose is to assist users in generating text, answering questions, and completing tasks. I aim to be user-friendly and easy to understand for everyone who interacts with me. ::::

Try asking a question, receiving the answer streamed

You will get a response similar to:

::::tip[LLM Response]

The

The capital

The capital of

The capital of France

The capital of France is

The capital of France is Paris

The capital of France is Paris. ::::

Generate structured output

With response as a Map

You will get a response similar to:

::::tip[LLM Response]

{
    "available": true,
    "age": 22
}

::::

With response mapped to specified class type

::::tip[LLM Response] Person(age=28, available=false) ::::