> ## Documentation Index
> Fetch the complete documentation index at: https://docs.runflow.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Submit an image for quality evaluation

> Create a quality evaluation for an image generated anywhere — no Runflow run required (pass `run_id` to associate one of your runs). Asynchronous: returns **202** with a `pending` evaluation; poll `GET /v1/evaluations/{id}` or supply a `callback_url` for a signed terminal webhook. Admission requires credits covering the job class's price (see `GET /v1/evaluations/job-classes`); the quoted price is frozen at submission and charged when the evaluation completes (or fails after processing started). Optional `Idempotency-Key` header makes retries safe.



## OpenAPI

````yaml /api/openapi.public.json post /v1/evaluations
openapi: 3.1.0
info:
  title: Runflow API
  version: 0.1.0
  description: >-
    Public Runflow API. Run AI image and video models, manage media, inspect run
    history, and configure webhooks. Auth: HTTP Bearer.


    This document is the customer integration surface only. Admin and internal
    operations plus generic system reference-data tables are intentionally
    omitted.
servers:
  - url: https://api.runflow.io
    description: Production
security:
  - HTTPBearer: []
tags:
  - name: Models
    description: >-
      Browse the model catalog and dispatch model runs. The primary surface for
      running AI image and video generation.
  - name: Runs
    description: >-
      Inspect, cancel, and re-run model executions. Fetch logs, node-runs, and
      callback delivery history.
  - name: Media
    description: >-
      Upload images and videos as inputs. Organize assets into folders.
      Three-step presigned upload flow for large files.
  - name: Batches
    description: >-
      Run a model on multiple inputs in one request. Includes per-item status
      and a single callback when the batch completes.
  - name: Evaluations
    description: >-
      Submit an image generated anywhere for automated quality evaluation, then
      read a pass verdict, a 0-1 score, and structured issues. No Runflow run
      required.
  - name: Webhooks
    description: >-
      Subscribe to platform events. Inspect delivery history, redeliver failed
      callbacks, manage signing secrets.
  - name: Account
    description: Read your account identity and credit balance.
  - name: Status
    description: Health and readiness probes for the API.
paths:
  /v1/evaluations:
    post:
      tags:
        - Evaluations
      summary: Submit an image for quality evaluation
      description: >-
        Create a quality evaluation for an image generated anywhere — no Runflow
        run required (pass `run_id` to associate one of your runs).
        Asynchronous: returns **202** with a `pending` evaluation; poll `GET
        /v1/evaluations/{id}` or supply a `callback_url` for a signed terminal
        webhook. Admission requires credits covering the job class's price (see
        `GET /v1/evaluations/job-classes`); the quoted price is frozen at
        submission and charged when the evaluation completes (or fails after
        processing started). Optional `Idempotency-Key` header makes retries
        safe.
      operationId: createEvaluation
      parameters:
        - name: X-Organization-Id
          in: header
          required: false
          schema:
            anyOf:
              - type: string
              - type: 'null'
            title: X-Organization-Id
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/EvaluationSubmissionCreate'
      responses:
        '202':
          description: Successful Response
          content:
            application/json:
              schema:
                $ref: >-
                  #/components/schemas/models__evaluation__Evaluation__FullValidator
        '400':
          description: Bad request
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
        '401':
          description: Unauthorized
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
        '402':
          description: Insufficient credits for the quoted job-class price
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
        '403':
          description: >-
            Forbidden — inspect response body `code` for the specific reason
            (for example: PERMISSION_DENIED, EMAIL_NOT_VERIFIED,
            ORGANIZATION_MEMBERSHIP_REQUIRED, ROLE_UNRESOLVED,
            IMPERSONATION_READ_ONLY)
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
        '409':
          description: Conflict
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
        '422':
          description: Validation error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
        '429':
          description: Per-organization in-flight evaluation cap reached
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
        '503':
          description: Evaluations API not configured on this deployment
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ErrorResponse'
      security:
        - HTTPBearer: []
components:
  schemas:
    EvaluationSubmissionCreate:
      properties:
        generated_image_url:
          type: string
          maxLength: 12000000
          title: Generated Image Url
          description: >-
            The image to evaluate: a public ``https://`` URL, a
            ``runflow://assets/{uuid}`` reference from POST /v1/asset-uploads,
            or a ``data:image/...`` URI (materialized into a hosted asset).
        task_type:
          type: string
          maxLength: 100
          minLength: 1
          title: Task Type
          description: >-
            What kind of generation produced the image, e.g. ``headshot`` or
            ``image_generation``.
        task_description:
          anyOf:
            - type: string
              maxLength: 4000
            - type: 'null'
          title: Task Description
          description: >-
            Longer description of the generation task, used to plan the
            evaluation.
        generation_prompt:
          anyOf:
            - type: string
              maxLength: 10000
            - type: 'null'
          title: Generation Prompt
          description: >-
            The prompt that produced the image — strongly recommended for
            prompt-adherence judging.
        evaluation_instructions:
          anyOf:
            - type: string
              maxLength: 4000
            - type: 'null'
          title: Evaluation Instructions
          description: 'Free-text rubric: what the evaluator should prioritize or ignore.'
        input_attributes:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Input Attributes
          description: >-
            Structured generation attributes (e.g. ``{"style": "corporate"}``)
            shown to the evaluator.
        reference_images:
          anyOf:
            - items:
                $ref: '#/components/schemas/EvaluationReferenceImage'
              type: array
              maxItems: 4
            - type: 'null'
          title: Reference Images
          description: Reference images for identity/garment comparison (max 4).
        run_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Run Id
          description: >-
            Optional: associate this evaluation with one of your Runflow runs.
            The submitted image does not need to be the run's output (e.g. a
            post-processed export). Platform auto-evaluation of the run's own
            output is unaffected.
        client_ref:
          anyOf:
            - type: string
              maxLength: 255
            - type: 'null'
          title: Client Ref
          description: >-
            Your correlation label, echoed in responses and callbacks. Not an
            idempotency key.
        job_class:
          type: string
          maxLength: 50
          title: Job Class
          description: >-
            Evaluation job class — see GET /v1/evaluations/job-classes for
            active classes and per-class prices. Currently only ``standard``.
          default: standard
        callback_url:
          anyOf:
            - type: string
              maxLength: 2048
            - type: 'null'
          title: Callback Url
          description: >-
            HTTPS endpoint to receive a signed ``evaluation.completed`` /
            ``evaluation.failed`` callback when the evaluation terminates.
      additionalProperties: false
      type: object
      required:
        - generated_image_url
        - task_type
      title: EvaluationSubmissionCreate
    models__evaluation__Evaluation__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        org_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Org Id
        run_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Run Id
        target_type_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Target Type Code
        model_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Id
        flow_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Flow Id
        comfyui_workflow_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Comfyui Workflow Id
        status_code:
          anyOf:
            - $ref: '#/components/schemas/EvaluationStatusCodeLiteral'
            - type: 'null'
        task_type:
          anyOf:
            - type: string
            - type: 'null'
          title: Task Type
        task_description:
          anyOf:
            - type: string
            - type: 'null'
          title: Task Description
        generation_prompt:
          anyOf:
            - type: string
            - type: 'null'
          title: Generation Prompt
        generated_image_url:
          anyOf:
            - type: string
            - type: 'null'
          title: Generated Image Url
        input_attributes:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Input Attributes
        evaluation_instructions:
          anyOf:
            - type: string
            - type: 'null'
          title: Evaluation Instructions
        reference_images:
          anyOf:
            - items:
                additionalProperties: true
                type: object
              type: array
            - type: 'null'
          title: Reference Images
        overall_passed:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Overall Passed
        weighted_pass_rate:
          anyOf:
            - type: number
            - type: 'null'
          title: Weighted Pass Rate
        override_reason:
          anyOf:
            - type: string
            - type: 'null'
          title: Override Reason
        top_issues:
          anyOf:
            - items:
                type: string
              type: array
            - type: 'null'
          title: Top Issues
        top_strengths:
          anyOf:
            - items:
                type: string
              type: array
            - type: 'null'
          title: Top Strengths
        check_summary:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Check Summary
        analysis_modules_executed:
          anyOf:
            - type: integer
            - type: 'null'
          title: Analysis Modules Executed
        primary_action_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Primary Action Code
        parent_evaluation_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Parent Evaluation Id
        attempt_number:
          anyOf:
            - type: integer
            - type: 'null'
          title: Attempt Number
        superseded_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Superseded At
        eval_duration_ms:
          anyOf:
            - type: integer
            - type: 'null'
          title: Eval Duration Ms
        feedback_is_positive:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Feedback Is Positive
        feedback_reason:
          anyOf:
            - type: string
            - type: 'null'
          title: Feedback Reason
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
        source_code:
          anyOf:
            - $ref: '#/components/schemas/EvaluationSourceCodeLiteral'
            - type: 'null'
        client_ref:
          anyOf:
            - type: string
            - type: 'null'
          title: Client Ref
        submitted_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Submitted At
        completed_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Completed At
        callback_url:
          anyOf:
            - type: string
            - type: 'null'
          title: Callback Url
        cost:
          anyOf:
            - type: string
              pattern: ^(?!^[-+.]*$)[+-]?0*\d*\.?\d*$
            - type: 'null'
          title: Cost
        failure_code:
          anyOf:
            - $ref: '#/components/schemas/EvaluationFailureCodeLiteral'
            - type: 'null'
        job_class_code:
          anyOf:
            - $ref: '#/components/schemas/EvaluationJobClassCodeLiteral'
            - type: 'null'
        links:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Links
        judges:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__evaluation__EvaluationJudge__FullValidator
              type: array
            - type: 'null'
          title: Judges
        gate_failures:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__evaluation__EvaluationGateFailure__FullValidator
              type: array
            - type: 'null'
          title: Gate Failures
        action:
          anyOf:
            - $ref: >-
                #/components/schemas/models__evaluation__EvaluationAction__PublicValidator
            - type: 'null'
        run:
          anyOf:
            - $ref: '#/components/schemas/models__run__Run__FullValidator'
            - type: 'null'
        model:
          anyOf:
            - $ref: '#/components/schemas/models__model__Model__FullValidator'
            - type: 'null'
        parent_evaluation:
          anyOf:
            - $ref: >-
                #/components/schemas/models__evaluation__Evaluation__FullValidator
            - type: 'null'
      type: object
      title: FullValidator
    ErrorResponse:
      properties:
        code:
          type: string
          title: Code
        message:
          type: string
          title: Message
        errors:
          anyOf:
            - items:
                additionalProperties: true
                type: object
              type: array
            - type: 'null'
          title: Errors
      type: object
      required:
        - code
        - message
      title: ErrorResponse
      description: Standard error envelope — matches exception handler output.
    EvaluationReferenceImage:
      properties:
        url:
          type: string
          maxLength: 12000000
          title: Url
          description: >-
            Reference image location: a public ``https://`` URL, a
            ``runflow://assets/{uuid}`` reference from POST /v1/asset-uploads,
            or a ``data:image/...`` URI (materialized into a hosted asset).
        kind:
          anyOf:
            - type: string
              maxLength: 100
            - type: 'null'
          title: Kind
          description: >-
            Role of this reference for the evaluator, e.g. ``source_face`` or
            ``garment``.
        description:
          anyOf:
            - type: string
              maxLength: 500
            - type: 'null'
          title: Description
          description: Free-text note telling the evaluator what this reference shows.
      additionalProperties: false
      type: object
      required:
        - url
      title: EvaluationReferenceImage
      description: One reference image attached to a submission (e.g. the source face).
    EvaluationStatusCodeLiteral:
      type: string
      enum:
        - pending
        - running
        - completed
        - failed
    EvaluationSourceCodeLiteral:
      type: string
      enum:
        - platform
        - api
    EvaluationFailureCodeLiteral:
      type: string
      enum:
        - invalid_media
        - dispatch_failed
        - processing_failed
        - timed_out
    EvaluationJobClassCodeLiteral:
      type: string
      enum:
        - standard
        - quick
    models__evaluation__EvaluationJudge__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        evaluation_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Evaluation Id
        name:
          anyOf:
            - type: string
            - type: 'null'
          title: Name
        description:
          anyOf:
            - type: string
            - type: 'null'
          title: Description
        category:
          anyOf:
            - type: string
            - type: 'null'
          title: Category
        passed:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Passed
        confidence:
          anyOf:
            - type: number
            - type: 'null'
          title: Confidence
        weight:
          anyOf:
            - type: number
            - type: 'null'
          title: Weight
        reasoning:
          anyOf:
            - type: string
            - type: 'null'
          title: Reasoning
        evidence:
          anyOf:
            - items:
                type: string
              type: array
            - type: 'null'
          title: Evidence
        sub_point_results:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Sub Point Results
        sub_points_evaluated:
          anyOf:
            - type: integer
            - type: 'null'
          title: Sub Points Evaluated
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        issues:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__evaluation__EvaluationIssue__FullValidator
              type: array
            - type: 'null'
          title: Issues
      type: object
      title: FullValidator
      description: Response shape.
    models__evaluation__EvaluationGateFailure__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        evaluation_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Evaluation Id
        output_key:
          anyOf:
            - type: string
            - type: 'null'
          title: Output Key
        module:
          anyOf:
            - type: string
            - type: 'null'
          title: Module
        reason:
          anyOf:
            - type: string
            - type: 'null'
          title: Reason
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
      type: object
      title: FullValidator
      description: Response shape.
    models__evaluation__EvaluationAction__PublicValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        evaluation_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Evaluation Id
        primary_action:
          anyOf:
            - type: string
            - type: 'null'
          title: Primary Action
        failure_summary:
          anyOf:
            - type: string
            - type: 'null'
          title: Failure Summary
        improved_prompt:
          anyOf:
            - type: string
            - type: 'null'
          title: Improved Prompt
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
      type: object
      title: PublicValidator
    models__run__Run__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        flow_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Flow Id
        model_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Id
        comfyui_workflow_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Comfyui Workflow Id
        target_type:
          anyOf:
            - $ref: '#/components/schemas/RunTargetTypeCodeLiteral'
            - type: 'null'
        target_version:
          anyOf:
            - type: string
            - type: 'null'
          title: Target Version
        org_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Org Id
        status_code:
          anyOf:
            - $ref: '#/components/schemas/RunStatusCodeLiteral'
            - type: 'null'
        source_code:
          anyOf:
            - $ref: '#/components/schemas/RunSourceCodeLiteral'
            - type: 'null'
        input:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Input
        output:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Output
        context:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Context
        duration_ms:
          anyOf:
            - type: integer
            - type: 'null'
          title: Duration Ms
        cost:
          anyOf:
            - type: string
              pattern: ^(?!^[-+.]*$)[+-]?0*\d*\.?\d*$
            - type: 'null'
          title: Cost
        cost_breakdown:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Cost Breakdown
        nodes_total:
          anyOf:
            - type: integer
            - type: 'null'
          title: Nodes Total
        nodes_completed:
          anyOf:
            - type: integer
            - type: 'null'
          title: Nodes Completed
        resolved_template_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Resolved Template Id
        batch_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Batch Id
        client_ref:
          anyOf:
            - type: string
            - type: 'null'
          title: Client Ref
        jurisdiction_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Jurisdiction Code
        flow_version_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Flow Version Id
        request_id:
          anyOf:
            - type: string
            - type: 'null'
          title: Request Id
        created_by:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Created By
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        started_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Started At
        completed_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Completed At
        callback_url:
          anyOf:
            - type: string
            - type: 'null'
          title: Callback Url
        metadata:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Metadata
        has_logs:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Has Logs
        has_node_runs:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Has Node Runs
        links:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Links
        failure_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Failure Code
          description: >-
            Failure classification (FK to run_failure_codes.code). None on
            successful runs.
        failure_message:
          anyOf:
            - type: string
            - type: 'null'
          title: Failure Message
          description: >-
            Human-readable failure detail. See /v1/runs/{id}/logs for full audit
            history.
        failure_stage_code:
          anyOf:
            - $ref: '#/components/schemas/RunFailureStageCodeLiteral'
            - type: 'null'
          description: >-
            Pipeline stage where the failure originated (FK to
            run_failure_stages.code).
        feedback_is_positive:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Feedback Is Positive
          description: Customer thumb (TRUE = 👍, FALSE = 👎, NULL = no rating yet).
        feedback_reason:
          anyOf:
            - type: string
            - type: 'null'
          title: Feedback Reason
          description: Optional customer-supplied note explaining the feedback.
        source_chat_message_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Source Chat Message Id
          description: Chat message that dispatched this run, if any.
        current_evaluation_summary:
          anyOf:
            - $ref: '#/components/schemas/RunEvaluationSummary'
            - type: 'null'
        node_runs:
          anyOf:
            - items:
                $ref: '#/components/schemas/models__run__FlowNodeRun__FullValidator'
              type: array
            - type: 'null'
          title: Node Runs
        logs:
          anyOf:
            - items:
                $ref: '#/components/schemas/models__run__RunLog__FullValidator'
              type: array
            - type: 'null'
          title: Logs
        model:
          anyOf:
            - $ref: '#/components/schemas/models__model__Model__FullValidator'
            - type: 'null'
        comfyui_workflow:
          anyOf:
            - $ref: >-
                #/components/schemas/models__comfyui__ComfyUIWorkflow__FullValidator
            - type: 'null'
      type: object
      title: FullValidator
      description: Response shape.
    models__model__Model__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        org_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Org Id
        model_creator_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Creator Id
        slug:
          anyOf:
            - type: string
            - type: 'null'
          title: Slug
        name:
          anyOf:
            - type: string
            - type: 'null'
          title: Name
        description:
          anyOf:
            - type: string
            - type: 'null'
          title: Description
        version:
          anyOf:
            - type: string
            - type: 'null'
          title: Version
        is_public:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Is Public
        is_open_source:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Is Open Source
        icon_url:
          anyOf:
            - type: string
            - type: 'null'
          title: Icon Url
        cover_url:
          anyOf:
            - type: string
            - type: 'null'
          title: Cover Url
        category_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Category Code
        status_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Status Code
        family_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Family Id
        family_variant_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Family Variant Code
        param_count:
          anyOf:
            - type: string
            - type: 'null'
          title: Param Count
        architecture:
          anyOf:
            - type: string
            - type: 'null'
          title: Architecture
        license_code:
          anyOf:
            - type: string
            - type: 'null'
          title: License Code
        max_resolution:
          anyOf:
            - type: string
            - type: 'null'
          title: Max Resolution
        lora_support:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Lora Support
        fine_tuning:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Fine Tuning
        supports_streaming:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Supports Streaming
        paper_url:
          anyOf:
            - type: string
            - type: 'null'
          title: Paper Url
        github_url:
          anyOf:
            - type: string
            - type: 'null'
          title: Github Url
        is_official:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Is Official
        availability_status:
          anyOf:
            - type: string
            - type: 'null'
          title: Availability Status
        seo:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Seo
        notable_features:
          anyOf:
            - items: {}
              type: array
            - type: 'null'
          title: Notable Features
        content:
          anyOf:
            - type: string
            - type: 'null'
          title: Content
        pricing_note:
          anyOf:
            - type: string
            - type: 'null'
          title: Pricing Note
        created_by:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Created By
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
        deleted_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Deleted At
        deleted_by:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Deleted By
        inputs:
          anyOf:
            - items:
                $ref: '#/components/schemas/models__model__ModelInput__FullValidator'
              type: array
            - type: 'null'
          title: Inputs
        outputs:
          anyOf:
            - items:
                $ref: '#/components/schemas/models__model__ModelOutput__FullValidator'
              type: array
            - type: 'null'
          title: Outputs
        examples:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__model_content__ModelExample__FullValidator
              type: array
            - type: 'null'
          title: Examples
        faq_entries:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__model_content__ModelFaqEntry__FullValidator
              type: array
            - type: 'null'
          title: Faq Entries
        pricing:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__model_content__ModelCustomerPricing__FullValidator
              type: array
            - type: 'null'
          title: Pricing
        related_links:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__model_content__ModelRelatedLink__FullValidator
              type: array
            - type: 'null'
          title: Related Links
      type: object
      title: FullValidator
      description: Response shape.
    models__evaluation__EvaluationIssue__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        evaluation_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Evaluation Id
        evaluation_judge_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Evaluation Judge Id
        category:
          anyOf:
            - type: string
            - type: 'null'
          title: Category
        subcategory:
          anyOf:
            - type: string
            - type: 'null'
          title: Subcategory
        detail:
          anyOf:
            - type: string
            - type: 'null'
          title: Detail
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
      type: object
      title: FullValidator
      description: Response shape.
    RunTargetTypeCodeLiteral:
      type: string
      enum:
        - model
        - flow
        - comfyui
    RunStatusCodeLiteral:
      type: string
      enum:
        - queued
        - dispatching
        - running
        - succeeded
        - failed
        - cancelled
        - partial_succeeded
    RunSourceCodeLiteral:
      type: string
      enum:
        - playground
        - api
        - flow-node
    RunFailureStageCodeLiteral:
      type: string
      enum:
        - dispatch
        - execution
        - callback
        - reconciliation
    RunEvaluationSummary:
      properties:
        passed:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Passed
          description: >-
            Whether the current evaluation passed overall. ``null`` when the
            evaluator did not emit a verdict.
        score:
          anyOf:
            - type: number
              maximum: 1
              minimum: 0
            - type: 'null'
          title: Score
          description: >-
            Weighted pass rate (0.0-1.0) of the current evaluation. ``null``
            when the evaluator did not emit a score.
        status_code:
          type: string
          const: completed
          title: Status Code
          description: >-
            Status of the current evaluation. Always ``completed`` given the
            current-scope subquery.
      type: object
      required:
        - passed
        - status_code
      title: RunEvaluationSummary
      description: >-
        Slim projection of a run's *current* evaluation, surfaced as the

        ``current_evaluation_summary`` custom embed on ``GET /v1/runs``.


        "Current" = ``status_code == 'completed' AND superseded_at IS NULL``.
        The

        embed loader (``routers/runs._populate_evaluation_summary``) writes

        ``None`` for runs with no current evaluation so the wire shape is

        ``{"current_evaluation_summary": null}`` rather than an absent key once

        the caller opts into the embed. The field is gated behind

        ``evaluations:read`` — see ``_RUN_CUSTOM_EMBED_PERMISSIONS``.


        ``status_code`` is typed as ``Literal["completed"]`` because the
        loader's

        subquery (``RunRepository._current_evaluation``) filters to completed

        rows only; any other value would be a contract violation.
    models__run__FlowNodeRun__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        run_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Run Id
        node_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Node Id
        flow_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Flow Id
        state_code:
          anyOf:
            - type: string
            - type: 'null'
          title: State Code
        input:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Input
        output:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Output
        input_signature:
          anyOf:
            - type: string
            - type: 'null'
          title: Input Signature
        preview_type:
          anyOf:
            - type: string
            - type: 'null'
          title: Preview Type
        preview_value:
          anyOf:
            - type: string
            - type: 'null'
          title: Preview Value
        duration_ms:
          anyOf:
            - type: integer
            - type: 'null'
          title: Duration Ms
        cost:
          anyOf:
            - type: string
              pattern: ^(?!^[-+.]*$)[+-]?0*\d*\.?\d*$
            - type: 'null'
          title: Cost
        retry_count:
          anyOf:
            - type: integer
            - type: 'null'
          title: Retry Count
        error_message:
          anyOf:
            - type: string
            - type: 'null'
          title: Error Message
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        started_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Started At
        completed_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Completed At
      type: object
      title: FullValidator
      description: Response shape.
    models__run__RunLog__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        run_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Run Id
        level_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Level Code
        message:
          anyOf:
            - type: string
            - type: 'null'
          title: Message
        timestamp:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Timestamp
        meta:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Meta
        run:
          anyOf:
            - $ref: '#/components/schemas/models__run__Run__FullValidator'
            - type: 'null'
      type: object
      title: FullValidator
      description: Response shape.
    models__comfyui__ComfyUIWorkflow__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        org_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Org Id
        slug:
          anyOf:
            - type: string
            - type: 'null'
          title: Slug
        name:
          anyOf:
            - type: string
            - type: 'null'
          title: Name
        description:
          anyOf:
            - type: string
            - type: 'null'
          title: Description
        workflow_json:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Workflow Json
        version:
          anyOf:
            - type: string
            - type: 'null'
          title: Version
        is_public:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Is Public
        status_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Status Code
        created_by:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Created By
        environment:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Environment
        models:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Models
        custom_nodes:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Custom Nodes
        graph:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Graph
        resources:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Resources
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
        deleted_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Deleted At
        deleted_by:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Deleted By
        category_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Category Code
        gpu_mode:
          anyOf:
            - $ref: '#/components/schemas/ComfyUIGpuModeNameLiteral'
            - type: 'null'
        gpu_current_tier_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Gpu Current Tier Code
        inputs:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__comfyui__ComfyUIInput__FullValidator
              type: array
            - type: 'null'
          title: Inputs
        outputs:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__comfyui__ComfyUIOutput__FullValidator
              type: array
            - type: 'null'
          title: Outputs
        gpu_explicit_models:
          anyOf:
            - items:
                $ref: >-
                  #/components/schemas/models__comfyui__ComfyUIWorkflowGpuModel__FullValidator
              type: array
            - type: 'null'
          title: Gpu Explicit Models
      type: object
      title: FullValidator
      description: Response shape.
    models__model__ModelInput__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        model_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Id
        name:
          anyOf:
            - type: string
            - type: 'null'
          title: Name
        display_name:
          anyOf:
            - type: string
            - type: 'null'
          title: Display Name
        description:
          anyOf:
            - type: string
            - type: 'null'
          title: Description
        variable_type_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Variable Type Code
        default_behavior_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Default Behavior Code
        validator_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Validator Code
        validator_attrs:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Validator Attrs
        is_required:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Is Required
        default_value:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Default Value
        sort_order:
          anyOf:
            - type: integer
            - type: 'null'
          title: Sort Order
        is_featured:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Is Featured
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
      type: object
      title: FullValidator
      description: Response shape.
    models__model__ModelOutput__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        model_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Id
        name:
          anyOf:
            - type: string
            - type: 'null'
          title: Name
        display_name:
          anyOf:
            - type: string
            - type: 'null'
          title: Display Name
        description:
          anyOf:
            - type: string
            - type: 'null'
          title: Description
        variable_type_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Variable Type Code
        validator_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Validator Code
        validator_attrs:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Validator Attrs
        sort_order:
          anyOf:
            - type: integer
            - type: 'null'
          title: Sort Order
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
      type: object
      title: FullValidator
      description: Response shape.
    models__model_content__ModelExample__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        model_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Id
        title:
          anyOf:
            - type: string
            - type: 'null'
          title: Title
        description:
          anyOf:
            - type: string
            - type: 'null'
          title: Description
        input:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Input
        output:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Output
        status_code:
          anyOf:
            - type: integer
            - type: 'null'
          title: Status Code
        cost:
          anyOf:
            - type: string
              pattern: ^(?!^[-+.]*$)[+-]?0*\d*\.?\d*$
            - type: 'null'
          title: Cost
        start_type:
          anyOf:
            - type: string
            - type: 'null'
          title: Start Type
        timing:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Timing
        duration_ms:
          anyOf:
            - type: integer
            - type: 'null'
          title: Duration Ms
        total_ms:
          anyOf:
            - type: integer
            - type: 'null'
          title: Total Ms
        thumbnail_url:
          anyOf:
            - type: string
            - type: 'null'
          title: Thumbnail Url
        category_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Category Code
        is_featured:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Is Featured
        is_public:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Is Public
        sort_order:
          anyOf:
            - type: integer
            - type: 'null'
          title: Sort Order
        ran_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Ran At
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
      type: object
      title: FullValidator
      description: Response shape.
    models__model_content__ModelFaqEntry__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        model_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Id
        question:
          anyOf:
            - type: string
            - type: 'null'
          title: Question
        answer:
          anyOf:
            - type: string
            - type: 'null'
          title: Answer
        sort_order:
          anyOf:
            - type: integer
            - type: 'null'
          title: Sort Order
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
      type: object
      title: FullValidator
      description: Response shape.
    models__model_content__ModelCustomerPricing__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        model_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Id
        pricing_model_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Pricing Model Code
        rule_effect_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Rule Effect Code
        model_input_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Input Id
        match_value:
          anyOf:
            - {}
            - type: 'null'
          title: Match Value
        dimension_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Dimension Code
        min_value:
          anyOf:
            - type: string
              pattern: ^(?!^[-+.]*$)[+-]?0*\d*\.?\d*$
            - type: 'null'
          title: Min Value
        max_value:
          anyOf:
            - type: string
              pattern: ^(?!^[-+.]*$)[+-]?0*\d*\.?\d*$
            - type: 'null'
          title: Max Value
        price:
          anyOf:
            - type: string
              pattern: ^(?!^[-+.]*$)[+-]?0*\d*\.?\d*$
            - type: 'null'
          title: Price
        currency_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Currency Code
        unit_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Unit Code
        multiplier_label:
          anyOf:
            - type: string
            - type: 'null'
          title: Multiplier Label
        description:
          anyOf:
            - type: string
            - type: 'null'
          title: Description
        sort_order:
          anyOf:
            - type: integer
            - type: 'null'
          title: Sort Order
        disabled_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Disabled At
        measurement_source:
          anyOf:
            - type: string
            - type: 'null'
          title: Measurement Source
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
      type: object
      title: FullValidator
      description: Response shape.
    models__model_content__ModelRelatedLink__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        model_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Model Id
        related_model_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Related Model Id
        sort_order:
          anyOf:
            - type: integer
            - type: 'null'
          title: Sort Order
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
      type: object
      title: FullValidator
      description: Response shape.
    ComfyUIGpuModeNameLiteral:
      type: string
      enum:
        - auto
        - explicit
    models__comfyui__ComfyUIInput__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        comfyui_workflow_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Comfyui Workflow Id
        name:
          anyOf:
            - type: string
            - type: 'null'
          title: Name
        display_name:
          anyOf:
            - type: string
            - type: 'null'
          title: Display Name
        description:
          anyOf:
            - type: string
            - type: 'null'
          title: Description
        variable_type_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Variable Type Code
        default_behavior_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Default Behavior Code
        validator_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Validator Code
        validator_attrs:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Validator Attrs
        is_required:
          anyOf:
            - type: boolean
            - type: 'null'
          title: Is Required
        default_value:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Default Value
        sort_order:
          anyOf:
            - type: integer
            - type: 'null'
          title: Sort Order
        comfyui_node_id:
          anyOf:
            - type: string
            - type: 'null'
          title: Comfyui Node Id
        comfyui_field_name:
          anyOf:
            - type: string
            - type: 'null'
          title: Comfyui Field Name
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
      type: object
      title: FullValidator
      description: Response shape.
    models__comfyui__ComfyUIOutput__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        comfyui_workflow_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Comfyui Workflow Id
        name:
          anyOf:
            - type: string
            - type: 'null'
          title: Name
        display_name:
          anyOf:
            - type: string
            - type: 'null'
          title: Display Name
        description:
          anyOf:
            - type: string
            - type: 'null'
          title: Description
        variable_type_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Variable Type Code
        validator_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Validator Code
        validator_attrs:
          anyOf:
            - additionalProperties: true
              type: object
            - type: 'null'
          title: Validator Attrs
        sort_order:
          anyOf:
            - type: integer
            - type: 'null'
          title: Sort Order
        comfyui_node_id:
          anyOf:
            - type: string
            - type: 'null'
          title: Comfyui Node Id
        comfyui_field_name:
          anyOf:
            - type: string
            - type: 'null'
          title: Comfyui Field Name
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
        updated_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Updated At
      type: object
      title: FullValidator
      description: Response shape.
    models__comfyui__ComfyUIWorkflowGpuModel__FullValidator:
      properties:
        id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Id
        comfyui_workflow_id:
          anyOf:
            - type: string
              format: uuid
            - type: 'null'
          title: Comfyui Workflow Id
        gpu_model_code:
          anyOf:
            - type: string
            - type: 'null'
          title: Gpu Model Code
        created_at:
          anyOf:
            - type: string
              format: date-time
            - type: 'null'
          title: Created At
      type: object
      title: FullValidator
      description: Response shape — populated on ``?embed=gpu_explicit_models``.
  securitySchemes:
    HTTPBearer:
      type: http
      scheme: bearer

````