Changes to Update Project Settings
- warning
added the new
Checks whether a response is supported by text and image context. PDF files are not yet supported.enum value to the////response property for the response status - warning
added the new
Detects personally identifiable information in text and images in the model's response. PDF files are not yet supported.enum value to the////response property for the response status - warning
added the new
Detects personally identifiable information in text and images in the user's input. PDF files are not yet supported.enum value to the////response property for the response status - warning
added the new
Detects prompt injection attempts in text and image inputs. PDF files are not yet supported.enum value to the////response property for the response status - warning
added the new
Scores text and images in the model's response for sexism. PDF files are not yet supported.enum value to the////response property for the response status - warning
added the new
Scores text and images in the model's response for toxicity. PDF files are not yet supported.enum value to the////response property for the response status - warning
added the new
Scores text and images in the user's input for sexism. PDF files are not yet supported.enum value to the////response property for the response status - warning
added the new
Scores text and images in the user's input for toxicity. PDF files are not yet supported.enum value to the////response property for the response status
- warning
- warning
added the new
Tracks the presence of personal identifiable information in the LLM's audio responsesenum value to the////response property for the response status - warning
added the new
Tracks the presence of personal identifiable information in the LLM's image or document responsesenum value to the////response property for the response status - warning
added the new
Tracks the presence of personal identifiable information in the user's audio inputenum value to the////response property for the response status - warning
added the new
Tracks the presence of personal identifiable information in the user's image or document inputenum value to the////response property for the response status
- warning
- info
added the new optional request property
- info
added the optional property
to the response with the status
- info
- warning
added the new
Detects whether model output concretely violates one or more applicable configured output-policy rules.enum value to the////response property for the response status - info
added the new
Detects whether model output concretely violates one or more applicable configured output-policy rules.enum value to the request property////
- warning
- breaking
removed the enum value
Measures which documents or chunks retrieved were used by the model to generate a responseand how much of the text in the retrieved chunks was used by the model to compose its response.of the request property//// - warning
removed the request property
- warning
removed the optional property
from the response with the status - warning
removed the optional property
from the response with the status - warning
removed the optional property
from the response with the status - warning
removed the optional property
from the response with the status - warning
removed the optional property
from the response with the status - info
removed the
Measures which documents or chunks retrieved were used by the model to generate a responseand how much of the text in the retrieved chunks was used by the model to compose its response.enum value from the////response property for the response status
- breaking
- warning
added the new
Assesses whether a chatbot interaction that includes audio left the user feeling satisfied and positiveor frustrated and dissatisfiedbased on toneengagementand overall experience.enum value to the////response property for the response status - warning
added the new
Assesses whether a chatbot interaction that includes images or documents left the user feeling satisfied and positiveor frustrated and dissatisfiedbased on toneengagementand overall experience.enum value to the////response property for the response status - warning
added the new
Measures how sexist audio input content might be perceivedranging from 0 to 1.enum value to the////response property for the response status - warning
added the new
Measures how sexist image or document input content might be perceivedranging from 0 to 1.enum value to the////response property for the response status - warning
added the new
Measures how well the LLM follows system instructions provided in the prompt.enum value to the////response property for the response status - warning
added the new
Measures how well the LLM follows system instructions provided in the prompt.enum value to the////response property for the response status - info
added the new
Assesses whether a chatbot interaction that includes audio left the user feeling satisfied and positiveor frustrated and dissatisfiedbased on toneengagementand overall experience.enum value to the request property//// - info
added the new
Assesses whether a chatbot interaction that includes images or documents left the user feeling satisfied and positiveor frustrated and dissatisfiedbased on toneengagementand overall experience.enum value to the request property//// - info
added the new
Measures how sexist audio input content might be perceivedranging from 0 to 1.enum value to the request property//// - info
added the new
Measures how sexist image or document input content might be perceivedranging from 0 to 1.enum value to the request property//// - info
added the new
Measures how well the LLM follows system instructions provided in the prompt.enum value to the request property//// - info
added the new
Measures how well the LLM follows system instructions provided in the prompt.enum value to the request property////
- warning
- breaking
removed the enum value
A measure of the model's own confusion in its output. Higher scores indicate higher uncertainty.of the request property//// - breaking
removed the enum value
BLEU is a case-sensitive measurement of the difference between an model generation and target generation at the sentence-level.of the request property//// - breaking
removed the enum value
Measures the perplexity of the prompt. Lower perplexity score is generally considered to be better because it means the model is less surprised by the text and can predict the next word in a sentence with higher accuracy.of the request property//// - breaking
removed the enum value
ROUGE measures the unigram overlap between model generation and target generation as a single F-1 score.of the request property//// - breaking
removed from the
///request propertyoneOflist - warning
removed the optional property
//from the response with the status - warning
removed the optional property
//from the response with the status - warning
removed the optional property
//from the response with the status - warning
removed the optional property
//from the response with the status - warning
added the new
Detects a significant shift in the user's primary conversational goal or workflow during a session that includes audio.enum value to the////response property for the response status - warning
added the new
Detects a significant shift in the user's primary conversational goal or workflow during a session that includes images or documents.enum value to the////response property for the response status - warning
added the new
Detects whether the user successfully accomplished all of their goals in a session that includes audio.enum value to the////response property for the response status - warning
added the new
Detects whether the user successfully accomplished all of their goals in a session that includes images or documents.enum value to the////response property for the response status - warning
added the new
Measures how well the workflow's response aligns with ground truth that includes audio.enum value to the////response property for the response status - warning
added the new
Measures how well the workflow's response aligns with ground truth that includes images or documents.enum value to the////response property for the response status - warning
added the new
Measures the coherence of the reasoning process by evaluating the consistency and logical flow of reasoning steps with audio context.enum value to the////response property for the response status - warning
added the new
Measures the coherence of the reasoning process by evaluating the consistency and logical flow of reasoning steps with image or document context.enum value to the////response property for the response status - warning
added the new
Measures the potential presence of factual errors or inconsistencies in the model's responseincluding audio content.enum value to the////response property for the response status - warning
added the new
Measures the potential presence of factual errors or inconsistencies in the model's responseincluding image or document content.enum value to the////response property for the response status - info
the endpoint scheme security
ClassicAPIKeyHeaderwas added to the API - info
removed
bleuprompt_perplexityrougeuncertaintydiscriminator mapping keys from the///request property - info
added the new
Detects a significant shift in the user's primary conversational goal or workflow during a session that includes audio.enum value to the request property//// - info
added the new
Detects a significant shift in the user's primary conversational goal or workflow during a session that includes images or documents.enum value to the request property//// - info
added the new
Detects whether the user successfully accomplished all of their goals in a session that includes audio.enum value to the request property//// - info
added the new
Detects whether the user successfully accomplished all of their goals in a session that includes images or documents.enum value to the request property//// - info
added the new
Measures how well the workflow's response aligns with ground truth that includes audio.enum value to the request property//// - info
added the new
Measures how well the workflow's response aligns with ground truth that includes images or documents.enum value to the request property//// - info
added the new
Measures the coherence of the reasoning process by evaluating the consistency and logical flow of reasoning steps with audio context.enum value to the request property//// - info
added the new
Measures the coherence of the reasoning process by evaluating the consistency and logical flow of reasoning steps with image or document context.enum value to the request property//// - info
added the new
Measures the potential presence of factual errors or inconsistencies in the model's responseincluding audio content.enum value to the request property//// - info
added the new
Measures the potential presence of factual errors or inconsistencies in the model's responseincluding image or document content.enum value to the request property//// - info
removed
bleuprompt_perplexityrougeuncertaintydiscriminator mapping keys from the///response property for the response status - info
removed the
A measure of the model's own confusion in its output. Higher scores indicate higher uncertainty.enum value from the////response property for the response status - info
removed the
BLEU is a case-sensitive measurement of the difference between an model generation and target generation at the sentence-level.enum value from the////response property for the response status - info
removed the
Measures the perplexity of the prompt. Lower perplexity score is generally considered to be better because it means the model is less surprised by the text and can predict the next word in a sentence with higher accuracy.enum value from the////response property for the response status - info
removed the
ROUGE measures the unigram overlap between model generation and target generation as a single F-1 score.enum value from the////response property for the response status - info
removed from the
///response propertyoneOflist for the response status
- breaking