Skip to content

Latest commit

 

History

History
232 lines (186 loc) · 7.42 KB

api-coverage-report.md

File metadata and controls

232 lines (186 loc) · 7.42 KB

CLI API Coverage Report

This report compares the published Coval OpenAPI catalog with first-class CLI commands, each covered operation's published request-body properties with the serde fields on the Rust struct the CLI sends, and its published header and query parameters with the ones the CLI can send. It is intentionally timestamp-free so the weekly workflow opens or updates a PR only when coverage changes or a reviewed gap passes its re-review deadline.

Each reviewed gap in api-coverage.toml is due for re-review 120 days after its reviewed_at date. Implement an overdue gap, or review it again and update reviewed_at.

Summary

Metric Value
Reconciliation status PASS
Published operations 199
First-class CLI operations 131
Reviewed gaps 68
Client operations 155
Published request fields on covered operations 475
Request fields modeled by the CLI 474
Reviewed request-field gaps 1
Published header and query parameters on covered operations 196
Parameters the CLI can send 144
Reviewed parameter gaps 52
Reviewed gaps overdue for re-review 0
Earliest re-review deadline 2026-11-27

Catalog: https://api.coval.dev/v1/openapi

Reviewed gaps overdue for re-review

  • None.

New published operations without CLI commands

  • None.

Reviewed gaps no longer present

  • None.

CLI operations absent from published OpenAPI

  • None.

Allowed extras no longer present

  • None.

Planned operations no longer present

  • None.

Client methods not mapped to operations

  • None.

Coverage snapshot mismatches

  • None.

Client-only operations

  • None.

All current published gaps

  • DELETE /alerts/{alert_id}
  • DELETE /integrations/slack
  • DELETE /metrics/flows/{flow_id}
  • DELETE /test-sets/{test_set_id}/agents/{agent_id}
  • DELETE /webhooks/{webhook_id}
  • GET /agents/{agent_id}/versions
  • GET /alerts
  • GET /alerts/{alert_id}
  • GET /alerts/{alert_id}/events
  • GET /conversation-python-analyses/{analysis_id}
  • GET /conversations/simulated/{conversation_id}/comments
  • GET /conversations/simulated/{conversation_id}/comments/{comment_id}
  • GET /conversations/uploaded/{conversation_id}/comments
  • GET /conversations/uploaded/{conversation_id}/comments/{comment_id}
  • GET /integrations/slack
  • GET /metrics/flows
  • GET /metrics/recently-deleted
  • GET /metrics/sql-schema
  • GET /metrics/tags
  • GET /metrics/template-variables
  • GET /metrics/{metric_id}/baselines/{baseline_id}/history
  • GET /organization/conversation-metrics
  • GET /organization/monitoring-metrics
  • GET /organization/users
  • GET /personas/tags
  • GET /personas/{persona_id}/versions
  • GET /review-annotations/metric-health-stats
  • GET /review-projects/{project_id}/insights
  • GET /review-projects/{project_id}/metric-agreement
  • GET /review-projects/{project_id}/progress
  • GET /runs/tags
  • GET /scheduled-runs/{scheduled_run_id}/runs
  • GET /simulations/{simulation_id}/attributes/{attribute_name}
  • GET /simulations/{simulation_id}/connect
  • GET /test-sets/{test_set_id}/agents
  • GET /test-sets/{test_set_id}/records
  • GET /test-sets/{test_set_id}/versions
  • GET /webhooks
  • PATCH /alerts/{alert_id}
  • PATCH /metrics/flows/{flow_id}
  • PATCH /organization/conversation-metrics
  • PATCH /organization/monitoring-metrics
  • PATCH /webhooks/{webhook_id}
  • POST /agents/{agent_id}/duplicate
  • POST /agents/{agent_id}/versions/{version_id}/revert
  • POST /alerts
  • POST /alerts/{alert_id}/test-evaluate
  • POST /audio:upload
  • POST /conversation-python-analyses
  • POST /conversations/simulated:rerunMetrics
  • POST /integrations/slack/connect
  • POST /metrics/flows
  • POST /metrics/outputs:batchGet
  • POST /metrics/sql:test
  • POST /metrics/{metric_id}/restore
  • POST /metrics/{metric_id}/versions/{version_id}/revert
  • POST /personas/{persona_id}/duplicate
  • POST /personas/{persona_id}/versions/{version_id}/revert
  • POST /python-metrics:fromAnalysis
  • POST /review-annotations:withMetricOutputs
  • POST /review-projects/disagreement-state
  • POST /review-projects/{project_id}/complete-conversation
  • POST /sofia/delegation-token
  • POST /test-sets/{test_set_id}/agents:add
  • POST /test-sets/{test_set_id}/duplicate
  • POST /test-sets/{test_set_id}/versions/{version_id}/revert
  • POST /traces
  • POST /webhooks

New published request fields the CLI drops

  • None.

Reviewed request-field gaps no longer present

  • None.

CLI request fields absent from published OpenAPI

  • None.

Allowed extra request fields no longer present

  • None.

All current request-field gaps

  • POST /workspaces slug

New published parameters the CLI cannot send

  • None.

Reviewed parameter gaps no longer present

  • None.

CLI parameters absent from published OpenAPI

  • None.

Allowed extra parameters no longer present

  • None.

All current parameter gaps

  • DELETE /review-annotations/{id} query project_id
  • GET /agents query tag_filters
  • GET /conversations/simulated query include
  • GET /conversations/simulated query time_zone
  • GET /conversations/simulated query view
  • GET /conversations/simulated query volume_end_date
  • GET /conversations/simulated query volume_start_date
  • GET /conversations/simulated/{id}/metrics query filter
  • GET /conversations/simulated/{id}/metrics query include_superseded
  • GET /conversations/simulated/{id}/metrics query order_by
  • GET /conversations/simulated/{id}/metrics query page_size
  • GET /conversations/simulated/{id}/metrics query page_token
  • GET /conversations/simulated/{id}/metrics query view
  • GET /conversations/uploaded query aggregation
  • GET /conversations/uploaded query consistency
  • GET /conversations/uploaded query end_date
  • GET /conversations/uploaded query group_by_metadata
  • GET /conversations/uploaded query start_date
  • GET /conversations/uploaded query time_zone
  • GET /conversations/uploaded query view
  • GET /conversations/uploaded query volume_end_date
  • GET /conversations/uploaded query volume_start_date
  • GET /conversations/uploaded/{id} query include_progress
  • GET /conversations/uploaded/{id}/metrics query filter
  • GET /conversations/uploaded/{id}/metrics query include_superseded
  • GET /conversations/uploaded/{id}/metrics query order_by
  • GET /conversations/uploaded/{id}/metrics query page_size
  • GET /conversations/uploaded/{id}/metrics query page_token
  • GET /conversations/uploaded/{id}/metrics query view
  • GET /metrics query tag_filters
  • GET /metrics/{id}/baselines query agent_id
  • GET /metrics/{id}/baselines query persona_id
  • GET /metrics/{id}/baselines query sigma_levels
  • GET /metrics/{id}/baselines query status
  • GET /metrics/{id}/baselines query test_set_id
  • GET /metrics/{id}/baselines/{id} query sigma_levels
  • GET /metrics/{id}/thresholds query page_size
  • GET /metrics/{id}/thresholds query page_token
  • GET /personas query tag_filters
  • GET /review-annotations/{id} query project_id
  • GET /run-templates query tag_filters
  • GET /runs query include
  • GET /tags query include_usage
  • GET /tags query page_size
  • GET /tags query page_token
  • GET /tags query search
  • GET /tags query tag_id
  • GET /tags query unused_only
  • GET /test-sets query tag_filters
  • PATCH /reports/{id} header If-Match
  • PATCH /review-annotations/{id} query project_id
  • POST /review-annotations query project_id