For AI agents: a documentation index is available at /llms.txt. Append .md to any page URL for markdown, or send Accept: text/markdown.
Update Eval Grader (partial)
Rename a grader or replace its definition. Runs already scored keep the definition they ran with.
Rename a grader or replace its definition. Runs already scored keep the definition they ran with.
https://statsigapi.net/console/v1/eval_graders/{name}Authorizations
STATSIG-API-KEYstringrequiredapiKey (header)
Path parameters
namestringrequiredname
Body
application/jsonnamestringmin length: 1promptobjectReplaces the whole definition when present.
Show child attributes
typestringrequiredlabel_model is an LLM judge over {{output}} (content is the rubric); string_check compares {{output}} to a dataset column with operation; text_similarity scores {{output}} against a column with evaluation_metric; python runs source.
label_modelstring_checktext_similaritypythoncontentstringRubric for label_model. May reference {{output}} and dataset columns.
nullableoperationstringeqnelikeilikenullableevaluation_metricstringSimilarity measure for text_similarity.
fuzzy_matchbleugleumeteorrouge_1rouge_2rouge_3rouge_4rouge_5rouge_lcosinenullablecolumnstringDataset column compared against for string_check and text_similarity.
nullablesourcestringPython source for a python grader.
nullableResponse
application/jsonmessagestringrequiredA simple string explaining the result of the operation.
dataobjectrequiredShow child attributes
idstringrequirednamestringrequiredtypestringrequiredGrader type: label_model, string_check, text_similarity, python, completion_tokens, completion_latency, or logged_score.
isGlobalbooleanrequiredpromptoneOfrequiredobjectobjectobjectobjectobjectobjectobjectobjecttypestringrequiredlabel_modelstring_checktext_similaritypythonprogrammatic_gradercompletion_tokenscompletion_latencylogged_scorecontentstringoperationstringeqnelikeilikecolumnstringevaluation_metricstringfuzzy_matchbleugleumeteorrouge_1rouge_2rouge_3rouge_4rouge_5rouge_lcosinesourcestringchoiceScoresobjectrequirednullablecreatedTimenumberrequiredformat: doublelastModifiedTimenumberrequiredformat: doublestatusintegerrequired404messagestringrequiredWas this helpful?