Text Generation Inference

Generate a stream of token using Server-Sent Events

Generate a stream of token using Server-Sent Events

post/generate_stream

Request body

GenerateRequest required— unresolved $ref

Response

Generated Text

Changes

Changed in 7 of the 26 revisions of this API.251434

    • added the new optional request property parameters/decoder_input_details

      new-optional-request-property

  • de34bec00da8451See the full diff
    • the response property details became nullable for the status 200

      response-property-became-nullable

    • the details response's property type/format changed from object/ to / for status 200

      response-property-type-changed

    • removed the required property details/finish_reason from the response with the 200 status

      response-required-property-removed

    • removed the required property details/generated_tokens from the response with the 200 status

      response-required-property-removed

    • the parameters/best_of request property's min was set to 0.00

      request-property-min-set

    • the parameters/max_new_tokens request property's min was set to 0.00

      request-property-min-set

    • the parameters/seed request property's min was set to 0.00

      request-property-min-set

    • the parameters/truncate request property's min was set to 0.00

      request-property-min-set

    • removed the optional property details/seed from the response with the 200 status

      response-optional-property-removed

    • added StreamDetails to the details response property allOf list for the response status 200

      response-property-all-of-added

  • 7bbd67c90f871111See the full diff
    • the response property details/seed became nullable for the status 200

      response-property-became-nullable

    • the parameters/seed request property's exclusiveMinimum was set to 0.00

      request-property-exclusive-min-set

    • added the new optional request property parameters/best_of

      new-optional-request-property

    • added the new optional request property parameters/truncate

      new-optional-request-property

    • added the new optional request property parameters/typical_p

      new-optional-request-property

    • the request property parameters/return_full_text became nullable

      request-property-became-nullable

    • the request property parameters/seed became nullable

      request-property-became-nullable

    • the seed request property default value null was added

      request-property-default-value-added

    • the return_full_text request property default value changed from None to null

      request-property-default-value-changed

    • added the required property error_type to the response with the 422 status

      response-required-property-added

    • added the required property error_type to the response with the 424 status

      response-required-property-added

    • added the required property error_type to the response with the 429 status

      response-required-property-added

    • added the required property error_type to the response with the 500 status

      response-required-property-added

    • added the new optional request property parameters/return_full_text

      new-optional-request-property

    • added the new optional request property parameters/watermark

      new-optional-request-property

    • added the required property token/special to the response with the 200 status

      response-required-property-added

  • 85e3db450aba512See the full diff
    • the response's body type/format changed from array/ to object/ for status 200

      response-body-type-changed

    • the response's body type/format changed from array/ to object/ for status 422

      response-body-type-changed

    • the response's body type/format changed from array/ to object/ for status 424

      response-body-type-changed

    • the response's body type/format changed from array/ to object/ for status 429

      response-body-type-changed

    • the response's body type/format changed from array/ to object/ for status 500

      response-body-type-changed

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 200

      response-media-type-name-specialized

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 422

      response-media-type-name-specialized

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 424

      response-media-type-name-specialized

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 429

      response-media-type-name-specialized

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 500

      response-media-type-name-specialized

    • added the optional property details to the response with the 200 status

      response-optional-property-added

    • added the optional property generated_text to the response with the 200 status

      response-optional-property-added

    • added the required property error to the response with the 422 status

      response-required-property-added

    • added the required property error to the response with the 424 status

      response-required-property-added

    • added the required property error to the response with the 429 status

      response-required-property-added

    • added the required property error to the response with the 500 status

      response-required-property-added

    • added the required property token to the response with the 200 status

      response-required-property-added

  • a9059df72b921586See the full diff
    • the request property parameters/seed became not nullable

      request-property-became-not-nullable

    • the response's body type/format changed from object/ to array/ for status 200

      response-body-type-changed

    • the response's body type/format changed from object/ to array/ for status 422

      response-body-type-changed

    • the response's body type/format changed from object/ to array/ for status 424

      response-body-type-changed

    • the response's body type/format changed from object/ to array/ for status 429

      response-body-type-changed

    • the response's body type/format changed from object/ to array/ for status 500

      response-body-type-changed

    • removed the required property error from the response with the 422 status

      response-required-property-removed

    • removed the required property error from the response with the 424 status

      response-required-property-removed

    • removed the required property error from the response with the 429 status

      response-required-property-removed

    • removed the required property error from the response with the 500 status

      response-required-property-removed

    • removed the required property error_type from the response with the 422 status

      response-required-property-removed

    • removed the required property error_type from the response with the 424 status

      response-required-property-removed

    • removed the required property error_type from the response with the 429 status

      response-required-property-removed

    • removed the required property error_type from the response with the 500 status

      response-required-property-removed

    • removed the required property token from the response with the 200 status

      response-required-property-removed

    • removed the request property parameters/best_of

      request-property-removed

    • removed the request property parameters/decoder_input_details

      request-property-removed

    • removed the request property parameters/return_full_text

      request-property-removed

    • removed the request property parameters/truncate

      request-property-removed

    • removed the request property parameters/typical_p

      request-property-removed

    • removed the request property parameters/watermark

      request-property-removed

    • removed the optional property details from the response with the 200 status

      response-optional-property-removed

    • removed the optional property generated_text from the response with the 200 status

      response-optional-property-removed

    • the seed request property default value null was removed

      request-property-default-value-removed

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 200

      response-media-type-name-specialized

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 422

      response-media-type-name-specialized

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 424

      response-media-type-name-specialized

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 429

      response-media-type-name-specialized

    • media type text/event-stream was changed to a more specific media type text/event-stream for the response status 500

      response-media-type-name-specialized

    This revision also has 4 changes that name no endpoint, such as unreferenced schemas being removed. See the revision's changelog