Variable RagSampleSchema`Const`

RagSampleSchema: ZodObject<
    {
        id: ZodOptional<ZodString>;
        question: ZodString;
        answer: ZodString;
        contexts: ZodArray<ZodString>;
        groundTruth: ZodOptional<ZodString>;
        tenantId: ZodOptional<ZodString>;
        metadata: ZodOptional<ZodRecord<ZodString, ZodUnknown>>;
    },
    $strip,
> = ...

A single RAG pipeline evaluation sample.

Represents one question-answer-context triple to be scored by the LLM judge. Provide a groundTruth whenever you want to run the contextRecall metric.

Example

const sample: RagSample = {
  id: 'q1',
  question: 'What is the capital of France?',
  answer: 'The capital of France is Paris.',
  contexts: ['France is a country in Western Europe. Its capital is Paris.'],
  groundTruth: 'Paris',
}

Variable RagSampleSchemaConst

Example

Settings

Variable RagSampleSchema`Const`