Skip to main content
POST
/
v1
/
eval-rules
Create an eval rule
curl --request POST \
  --url https://api.trulayer.ai/v1/eval-rules \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "project_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "metric_name": "<string>",
  "evaluator_type": "llm",
  "config": {},
  "enabled": true,
  "model_tier": "cheap",
  "min_score_drop": 1
}
'
{
  "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "tenant_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "project_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "metric_name": "<string>",
  "evaluator_type": "llm",
  "enabled": true,
  "model_tier": "cheap",
  "created_at": "2023-11-07T05:31:56Z",
  "updated_at": "2023-11-07T05:31:56Z",
  "config": {},
  "min_score_drop": 1
}

Documentation Index

Fetch the complete documentation index at: https://docs.trulayer.ai/llms.txt

Use this file to discover all available pages before exploring further.

Authorizations

​
Authorization
string
header
required

SDK API key (tl_...) or Clerk session JWT

Body

application/json
​
project_id
string<uuid>
required
​
metric_name
string
required
​
evaluator_type
enum<string>
required
Available options:
llm,
rule
​
config
object
​
enabled
boolean
default:true
​
model_tier
enum<string>
default:cheap
Available options:
cheap,
premium
​
min_score_drop
number<double> | null

Optional per-rule RemediationRegression threshold (TRU-387). See EvalRule.min_score_drop for semantics.

Required range: x >= 0

Response

Eval rule created

​
id
string<uuid>
required
​
tenant_id
string<uuid>
required
​
project_id
string<uuid>
required
​
metric_name
string
required
​
evaluator_type
enum<string>
required
Available options:
llm,
rule
​
enabled
boolean
required
​
model_tier
enum<string>
default:cheap
required
Available options:
cheap,
premium
​
created_at
string<date-time>
required
​
updated_at
string<date-time>
required
​
config
object
​
min_score_drop
number<double> | null

Per-rule floor for the RemediationRegression detector (TRU-387). A regression alert fires only when the post-remediation score has dropped by at least this much from the original score. Omitted or null means "use the platform default (0.0)" — alert on any drop. Negative values are rejected.

Required range: x >= 0