---
title: "Obtain a response to the user query from LLMs hosted on HuggingFace."
method: GET
path: "/demo_inference"
tags: ["demo_inference"]
---

# Obtain a response to the user query from LLMs hosted on HuggingFace.

`GET /demo_inference`

Given an input prompt, returns the response from text completion using LLMs hosted on HuggingFace.

## Query parameters

- `prompt` string
- `model_id` string
- `max_new_tokens` string
- `temperature` string

## Response `200`

successful text completion

## Other responses

- `404` — invalid input parameters or model unavailable

## Changes

- **2026-07-17** `289f88c3eca1` — 1 info
  - endpoint added
- **2024-08-09** `c9a4b3a38ef7` — 1 breaking
  - api path removed without deprecation

[Change history](https://skmtc.dev/ibm/apis/responsible-prompt-recommendation-api/changes/demo_inference/get.md)

---

[API](https://skmtc.dev/ibm/apis/responsible-prompt-recommendation-api.md) · [All operations](https://skmtc.dev/ibm/apis/responsible-prompt-recommendation-api/llms.txt) · [OpenAPI document](https://skmtc-service-production.skmtc.workers.dev/v1/apis/ibm/responsible-prompt-recommendation-api/revisions/289f88c3eca1/schema)