All servers · Markets & trading · Marketing & SEO

ML Referee

io.github.scarrico/mlreferee · v1.1.0

New (7 days)Has write/delete tools

Measured by MCP Station

Last check	Reachable
Checked at	—
Check success 7 / 30 days	—
First-try success 30 days	—
Median response	—
Lookups 30 days	—
Authentication	No auth
MCP version	2025-11-25
Rank score	—
Declared risk	Has destructive tools (destructiveHint)
Capabilities declared	tools
Tool definitions	26 tools · with description 100% · input schema is an object 100% · read/destructive hints 100%

Description written by the publisher, not verified

Evaluate ML features beyond a baseline and test bounded feature repairs. Invite-only beta.

Connect

streamable-http · https://api.mlreferee.com/mcp

claude mcp add --transport http mlreferee https://api.mlreferee.com/mcp

{
  "mcpServers": {
    "mlreferee": {
      "url": "https://api.mlreferee.com/mcp"
    }
  }
}

Tools as reported by the server

describe_referee
Discover capabilities, privacy, and the approved public catalog.
list_verticals
List the three supported evaluation profiles and their discovery tags.
get_referee_readiness
Report connection, credential, audit-credit, and submission readiness with the next action.
get_referee_usage
Read aggregate, privacy-preserving Referee activity and outcome evidence for the selected audience.
get_input_schema
Get neutral column roles and validation defaults for a vertical.
get_repair_schema
Get the feature-only contract for diagnosing degradation and testing bounded repairs.
upload_private_dataset
Encrypt a de-identified CSV/JSON payload for a short tenant-private retention window.
upload_campaign_shard
Encrypt one of up to 64 private feature shards for a large campaign; retain for at least 4,200 seconds.
upload_repair_matrix
Encrypt one complete de-identified repair matrix of up to 100 MB and 1,000 diagnostic features.
preflight_dataset
Validate a tenant-private upload and its baseline evidence/row identity without spending a credit.
preflight_repair
Validate a tenant-private feature-repair matrix without spending a credit.
quote_audit
Create a contract-bound quote for one audit credit; baseline mode and evidence cannot be substituted.
quote_repair
Preflight and quote label-based feature repair; large jobs return a measured ETA and credit requirement.
quote_campaign
Preflight all private feature shards, time a pilot, and quote credits and ETA for up to 1,000 candidates in one corrected search family.
get_credits
Read beta or paid audit-credit availability and usage.
redeem_beta_invite
Redeem one operator-issued invite for free beta audit credits before January 1, 2027.
request_beta_access
Request operator-reviewed beta access without purchasing or granting credits.
get_beta_request_status
Read the authenticated tenant's beta-access request status.
submit_audit
Accept a quote and atomically reserve its disclosed audit credits.
record_audit_followup
Record whether a completed audit changed a decision or was confirmed prospectively.
get_audit_status
Read the state of an audit owned by the authenticated tenant.
get_audit_result
Read a completed tenant-private result and signed output manifest.
get_audit_receipt
Read a tenant-private report fingerprint retained after report expiry or deletion. Older reports may have no record. This does not retrieve report contents.
verify_audit_report
Compare a locally computed SHA-256 with the retained tenant-private receipt. Use the exact downloaded result JSON bytes (not the API envelope), or UTF-8 result.report text with representation report_text. Never copy the expected hash as the candidate: compute it from the supplied artifact. A digest
delete_audit write/delete
Delete retained inputs and results for an audit owned by this tenant.
delete_upload write/delete
Delete a tenant-private upload that is no longer needed.

Website · JSON · Text for agents · Registry updated 2026-10-26