Manufact

LeaderboardBack to leaderboard

Sol OpenRouter QA Weather

calm-wave-yg17a.run.dev.mcp-use.com/mcp

Disposable synthetic weather fixture

View checks

Protocol: MCP 2025-11-25
Server version: 1.0.0
Supports: Tools
Resources

Overall score

How is this score calculated?

Last reviewed at Oct 26, 2026, 02:45:03 UTC

Server metadata

Warnings30/100

Identity, discovery, and usage metadata advertised during the MCP handshake.

Stable server name

Sol OpenRouter QA Weather

10/10Source

Human-readable title

Add a human-readable title for clients and directories.

0/10Source

Useful description

Describe what the server helps an agent do.

0/20Source

Server version

Version 1.0.0

10/10Source

Public website

Link to a public website or documentation page.

0/10Source

Scalable or high-resolution icon

Advertise a vector or at least 128px server icon.

0/10Source

Server instructions

Add concise instructions that explain how an agent should use the server.

0/20Source

Declared capabilities

Supports Tools, Resources.

10/10Source

Discoverability

Not checked0/100

Client listings and public setup information.

mcp.json or server-card.json

Either mcp.json or an MCP Server Card declaring this endpoint passes.

UnverifiedSource

Setup instructions at MCP URL

Checks the MCP endpoint for public connection instructions.

Unverified

ChatGPT

No ChatGPT listing has been confirmed yet.

UnverifiedHow to get listed

Claude

No Claude listing has been confirmed yet.

UnverifiedHow to get listed

CursorGrok BotGrok

No Cursor marketplace listing has been confirmed yet.

UnverifiedHow to get listed

Muse

No Muse listing has been confirmed yet.

UnverifiedHow to get listed

6 unverified checks. Unverified checks earn no points until confirmed.

Protocol

Pass100/100

Connection, authentication, and protocol compatibility.

MCP negotiation succeeds (v1/v2)

MCP legacy negotiation succeeded in 1390ms

Source

Tools list returns results

1 tool(s) returned

Source

Resources list responds

1 resource(s) returned

Source

Server declares tools capability

Server declares tools capability in initialize response

Source

Tools

Issues93/100

Tool definitions, annotations, and client compatibility.

Skills over MCP resources are readable

Server does not advertise the Skills over MCP extension

All tools have descriptions

All tools have non-empty descriptions

Claude Code metadata fits its 2 KB fields

Tool descriptions and server instructions fit Claude Code's 2 KB fields

Source

All tools have OpenAI behavior hints

All tools declare the three OpenAI behavior hints as booleans

Source

Claude tools declare applicable behavior hints

All tools include an applicable readOnlyHint or destructiveHint

Source

All tools have a display title

1 tool(s) missing a display title: get_weather

How to fix: Set the top-level tool.title to a short human-readable label (for example, "Search catalog"). Claude directory submission requires tool titles; annotations.title remains accepted only as a legacy fallback.

errorClaude.ai

Source

Tool names use valid characters

All tool names use valid characters

Source

Claude tool names are within 64 characters

All tool names are within Claude's 64-character limit

Source

Cursor tool-name budget advisory

No tool name independently exhausts Cursor's observed 60-character combined budget

Observed behavior

Tool names follow the MCP 1–128 character range

All tool names follow the MCP recommended length

Source

ChatGPT tool names are unique

All tool names are unique

Source

Tool names follow MCP uniqueness guidance

All tool names are unique

Source

Tool input schemas have a valid object structure

All tool input schemas have a valid object structure

Source

Tool input header annotations are valid

All x-mcp-header annotations satisfy Streamable HTTP requirements

Source

OpenAI file parameters use valid schemas

All declared OpenAI file parameters use reviewer-valid schemas

Source

Declared output schemas have a valid basic structure

0 declared output schema(s) pass basic structural validation; schemas may describe any JSON value, including arrays

Source

Tool text has no hidden control characters

No invisible or control characters found in tool-facing text

Source

MCP Apps

Issues86/100

App resources, metadata, and rendering requirements.

All discovered view resources were inspected

Inspected all 1 discovered view resource(s)

Source

View resource envelope is valid

All view resources are readable and use ui:// with a supported MCP Apps HTML MIME type

Tool invocation metadata present

All view-linked tools have invoking/invoked metadata

Source

Tool-linked resource URI is readable

All tool-linked resource URIs are readable

Source

View resource metadata complete

All view resources have a mimeType and widget description

Source

Tool visibility metadata is valid

All explicit ui.visibility arrays are valid

Source

CSP metadata covers literal external origins

All statically detectable external origins are declared in CSP metadata

Source

View resources declare a domain

1 ChatGPT UI domain issue(s) found

How to fix: For ChatGPT submission, set one exact HTTPS origin such as "https://app.example.com" on every view via _meta.ui.domain (or openai/widgetDomain). Paths are not valid and all views in one app must share the origin.

errorChatGPT

Source

Declared domains respond

All declared domains are reachable

Tool documentation quality

37/100

How clearly each tool’s title, description, input and output schemas, and behavior annotations guide an agent.

get_weatherTitles 37Descriptions 31Inputs 43Annotations 75Outputs 037/100

get_weather

Title37/100

Not provided

Add a human-readable title so users do not have to interpret the tool identifier.

Description31/100

Show the weather card for San Francisco. Returns sunny weather and 72 degrees Fahrenheit.

Resolve contradictions between the description, input schema, and annotations.

Inputs43/100

Remove validation rules already expressed in this field’s schema; describe its meaning and usage instead.

city

City to show

Remove validation rules already expressed in this field’s schema; describe its meaning and usage instead.

Annotations75/100

Declare idempotentHint based on the tool’s actual behavior.

{
  "readOnlyHint": true,
  "openWorldHint": false,
  "destructiveHint": false
}

Output schema0/100

No output schema is declared. Add one for structured results so clients can interpret returned fields.

Not declared

Original tool metadata

{
  "name": "get_weather",
  "description": "Show the weather card for San Francisco. Returns sunny weather and 72 degrees Fahrenheit.",
  "inputSchema": {
    "type": "object",
    "required": [
      "city"
    ],
    "properties": {
      "city": {
        "type": "string",
        "description": "City to show"
      }
    }
  },
  "annotations": {
    "readOnlyHint": true,
    "openWorldHint": false,
    "destructiveHint": false
  }
}

Put your MCP to the test

A few tasks worth trying with this server, chosen from its reviewed tools. These have not been run.

01Show the weather card for San Francisco

Want to run these tasks against your MCP server with us?

Test your MCP in Cloud Book a test call

FAQ

Sol OpenRouter QA Weather setup, tools, quality score, publishing readiness, and alternatives.

How do I add Sol OpenRouter QA Weather to Claude, ChatGPT, or Cursor?

Add Sol OpenRouter QA Weather to Claude, ChatGPT, or Cursor by connecting its remote MCP URL in each client's MCP settings. In Claude, add a custom connector. In ChatGPT, add an MCP app. In Cursor, add an MCP server under Settings. The MCP URL is https://calm-wave-yg17a.run.dev.mcp-use.com/mcp.

Is Sol OpenRouter QA Weather MCP ready for ChatGPT and Claude?

As of October 26, 2026, Sol OpenRouter QA Weather scores 92/100 on Manufact's MCP publishing checklist. The scan does not yet meet ChatGPT publishing checks and does not yet meet Claude publishing checks. Passing these checks does not guarantee marketplace approval.

How clear is Sol OpenRouter QA Weather's MCP tool documentation?

As of October 26, 2026, Sol OpenRouter QA Weather scores 37/100 in Manufact's review of tool titles, descriptions, input and output schemas, and behavior annotations. The review covers 1 of 1 discovered tools. The quality score measures documentation clarity; runtime behavior and marketplace readiness require separate checks.

How can Sol OpenRouter QA Weather improve its MCP documentation?

get_weather is the lowest-scoring reviewed tool at 37/100. No output schema is declared. Add one for structured results so clients can interpret returned fields. Open its review for feedback and a copyable fix prompt, then rerun the documentation review after updating your tool metadata.

Not your MCP?

Review any public or OAuth MCP server for protocol compatibility, tool documentation, and ChatGPT and Claude publishing readiness. No account required.

Get your MCP score

LeaderboardBack to leaderboardLeaderboardBack to leaderboard

Opening report…

Loading report overview

Server metadata

Loading server metadata

Discoverability

Loading discoverability

Protocol

Loading protocol

Tools

Loading tools

MCP Apps

Loading mcp apps

Tool documentation quality

Loading tool documentation quality

Manufact

Server metadata

Discoverability

Protocol

Tools

MCP Apps

Tool docsTool documentation quality

Title37/100

Description31/100

Inputs43/100

Annotations75/100

Output schema0/100

Put your MCP to the test

FAQ

Not your MCP?

Server metadata

Discoverability

Protocol

Tools

MCP Apps

Tool documentation quality

Server metadata

Discoverability

Protocol

Tools

MCP Apps

Tool docsTool documentation quality

Title37/100

Description31/100

Inputs43/100

Annotations75/100

Output schema0/100

Put your MCP to the test

FAQ

Not your MCP?

Tool documentation quality

Tool documentation quality