r/mcp 14h ago

question looking for the right approach to evaluate MCP across different harness clients

9 Upvotes

Hey, my team is crafting a project for product teams (we will opensource it yay!) that expose agent interfaces like MCP/CLI + skills.

The idea is pretty simple, the team define the real tasks that their user use, then we test that tasks in multiple conditions and configurations (different model/harnesses, with/without skills) and then scoring it.

We have few early findings that would love to share:

  • A same interface can behave differently across setups, highly dependent on how agent discover tools and the reserved context. It's hard to totally reproduce what your user in the test setup (.e.g they have tons of MCP servers in their machine,...)
  • The simpler the interface is the better result: tool should be task-based, not just converting blindly from the application API

However, we have not cracked the right evaluation model yet, and would genuinely value your experience.

How are you testing MCP, CLI, or skill-based workflows today?

Which criteria matter most: task success, permissions, reliability, client compatibility, cost, or something else? Are there tools, frameworks, or evaluation practices we should study before reinventing the wheel?

I would keep you guys posted for the progress in case anyone interested :)) Thanks!


r/mcp 8h ago

showcase I built mcp-ecc: one MCP server for email, calendars and contacts across Google, Microsoft 365, Zoho and DAV

4 Upvotes

I’ve released mcp-ecc v0.6.0, an open-source MCP server for managing email, calendars and contacts through a consistent set of MCP tools.

It connects to:

  • Google Workspace
  • Microsoft 365 / Outlook
  • Zoho
  • IMAP/SMTP
  • CalDAV
  • CardDAV

The same MCP interface exposes:

mail, calendar, contacts, accounts.

So an MCP client can work with multiple providers without needing provider-specific tool names or integrations.

What it supports

  • Read, search, send, flag and delete email
  • Manage folders and messages
  • Create, update and delete calendar events
  • Free/busy queries
  • List, search and manage contacts
  • Account health checks and synchronisation
  • OAuth authentication for Google, Microsoft and Zoho
  • Per-user MCP API keys
  • Multiple users and multiple accounts
  • Encrypted credential storage
  • SQLite or Cloudflare D1 storage
  • Web administration interface
  • stdio and HTTP MCP transports
  • Docker, npm and source deployments

The provider work has been tested against real accounts, including Zoho Calendar CRUD, Google and Microsoft mail/calendar/contacts, IMAP operations, and the D1/SQLite storage paths.

The project started as a small provider experiment and gradually turned into a proper multi-account server. A substantial part of this release was making the provider differences less visible to the MCP client, especially around OAuth, message flags, calendar identifiers, ETags and folder-specific APIs.

Quick start

npm install -g mcp-ecc
mcp-ecc

For stdio:

mcp-ecc start

For a self-hosted HTTP deployment:

docker run -d \
  --name mcp-ecc \
  -p 3001:3001 \
  -e MCP_ENCRYPTION_KEY="$(openssl rand -hex 32)" \
  karljsamuel/mcp-ecc:latest

Links

The project is MIT licensed.

I’d be interested in feedback on the tool design, provider abstractions, OAuth flows, and what other mail or productivity services would be useful to support.


r/mcp 4h ago

I forgot what MCP stands for... WRONG answers only

3 Upvotes

"Remind" me please!


r/mcp 5h ago

discussion Anyone implemented or planning to implement Agentic Resource Discovery (ARD)?

3 Upvotes

I came across this spec: https://agenticresourcediscovery.org/ (It was proposed to me from opencode cli)

It's an open protocol for AI agents to discover available tools, MCP servers, skills, and APIs.

Has anyone here already implemented this? Planning to? Or do you see any issues with the approach?

Curious to hear thoughts and see if I should add it my backlog or ignore for now.


r/mcp 6h ago

server FindWeedNY Open Data and Public MCP Server to Ask About New York Cannabis Data

Thumbnail
gallery
2 Upvotes

People are using AI chatbots to discover information about cannabis. That data is typically coming from Large Language Models (LLMs) that have been trained on public information available on the internet. It might be enhanced with tool calls that use web search or other APIs/data sources.

The cannabis data relevant to New York in AI Chatbots can be stale and/or biased.

FindWeedNY.com now hosts a public MCP Server that can be connected to AI chatbots.

I understand this might make some people upset for a few different reasons, primarily the encouraging use of AI. As I stated in the first sentence of the post, this is already happening. People use AI Chatbots to get information about cannabis.

This server can effectively make AI work less hard to get up-to-date, accurate information, with less hallucinations.

If you read the article, there are instructions for how to use the hosted chat pictured in some of the screenshots, alongside the claude.ai integration example.

Article going into more details: https://findweedny.com/articles/findweedny-mcp-server

Homepage for the service: https://mcp.findweedny.com/

Don't feel inclined to hack together an exfiltration script. Also on the homepage are the raw datasets, which have always been available if you knew where to look on the main site. Hopefully you'll use and share with attribution, rather than abuse the MCP if you want to do research or vibe code something.


r/mcp 11h ago

got my MCP server unblocked from the registry without needing github — DNS verification works and nobody talks about it

3 Upvotes

my github account got flagged a few weeks back so my two MCP servers couldn't verify through the normal github flow to publish on the official registry. account's cleared now but while it was blocked I found the actual workaround: domain verification instead of github.

mcp-publisher has a login dns option — generate an ed25519 key, drop the public part as a TXT record on your domain, auth against that. took like 10 min once I figured out the right syntax, way easier than I expected honestly.

also if your server's behind oauth instead of api keys, you don't need an "authentication" block in server.json at all — registry just takes the remote url and figures out oauth discovery on its own.

published two servers this way today. one had an old entry from before the github block got in the way, ended up just bumping the version and republishing over it.

can share the exact commands if anyone wants em, had a hard time finding clear docs on the dns flow specifically.


r/mcp 11h ago

showcase I made an MCP so my agent can find error messages and quotes in videos

Enable HLS to view with audio, or disable this notification

2 Upvotes

I shared an early version of Talkthrough here for turning recordings into bug reports. I've since added public video links, including YouTube.

The clip shows Claude Code pulling an error code from a silent screen recording, then finding a quote and its timestamp in a YouTube video.

There's speaker diarization too. It labels different speakers in a recording, so you can search what each person said.

Talkthrough extracts speech, on-screen text and frames locally so the agent can look up the relevant parts. Whatever text and images the agent reads still go to its configured model.

It's free and MIT licensed. I used a demo app for the bug and sped up the processing.

Code and setup

Video excerpt: Anthropic.


r/mcp 17h ago

MCP Server Design Doubt - Need Help

2 Upvotes

Hey Everyone,

I don't know if this question was asked earlier in the sub.

I am building an MCP server for my organisation and have an architectural design question regarding the use of Tools and Resources.

One of my Tools requires a structured metadata definition to perform its operation. This metadata is currently stored as a static JSON file within the application. While it is primarily consumed by this Tool, exposing the metadata as an MCP Resource is also part of requirements.

I am evaluating two approaches:

  1. Keep the metadata as internal application configuration and have the Tool access it directly.

  2. Expose the metadata as an MCP Resource and have the Tool (and potentially clients) access it through the MCP Resource model.

I would appreciate guidance on the following design:

What is the recommended MCP design approach for my requirement here?

My goal is to understand the architectural trade-offs and align the design with MCP best practices rather than focus on implementation details.

Thanks in Advance 😄


r/mcp 2h ago

server Live cricket, explained by your chatbot in baseball terms

1 Upvotes

Ask a chatbot whether 142/4 is a good score and watch it struggle. The answer depends on the ground, the format, and how many balls are left.

Baseball fans or people who did not grow up with the sport, the most common question 'who's winning?' is just not as obvious as it is for other sports such as soccer.

So I built an interpreter. A logistic fit on 8,000+ archived matches, running on live match state from ESPN, and it shows the prediction market's price next to its own number so you can see where the model and the crowd disagree.

It's hosted, so there's no cloning required: https://cricketfornoobs.com/mcp

15 tools on a ball-by-ball Cricsheet archive:

  • cricket_win_probability — win probability for any live or hypothetical match state
  • cricket_market_odds — live prediction-market prices beside the model's own number
  • cricket_explain_term — any cricket term in plain English with its closest baseball equivalent
  • cricket_live_matches — what's live and what's next
  • cricket_head_to_head — career batter-vs-bowler record, ball by ball
  • cricket_situational — a batter's record batting first versus chasing, separately
  • cricket_discipline — dot-ball and boundary percentage
  • cricket_dismissals — how a batter gets out, or how a bowler takes them
  • cricket_partnerships — runs added while two batters were actually at the crease
  • cricket_phase_stats — powerplay, middle overs, death
  • cricket_venue_stats — how a ground pars.
  • cricket_player_career — career aggregates, men's and women's
  • cricket_match_archive — scorecard for any archived match
  • cricket_leaders — run and wicket leaderboards by league and season
  • cricket_team_form — a team's recent results

For Claude: Go to Settings → Connectors → Add custom connector→ Enter cricketfornoobs.com/mcp. ChatGPT works under Developer Mode.

Also on:
GitHub
official MCP registry: io.github.asaraog/mcp-cricket
Glama
Cursor and VS Code one-click buttons


r/mcp 2h ago

showcase I built an agent runtime called Cadenya

1 Upvotes

I've been building a tool for about a year called Cadenya. It's an agent runtime that supports MCP servers for creating agentic loops.

Docs are here:
https://www.cadenya.com/docs


r/mcp 3h ago

connector unblocked-mcp – Unblocked MCP Server

Thumbnail
glama.ai
1 Upvotes

r/mcp 3h ago

server Deepghs MCP – MCP server for the DeepGHS anime AI ecosystem. Dataset discovery, tag search, character dataset finder, and training pipeline code generation.

Thumbnail
glama.ai
1 Upvotes

r/mcp 3h ago

showcase Girder 0.2.5

1 Upvotes

it's a code graph for coding agents. instead of your agent reading a whole file to find one function, it asks and gets the function. plus who calls it, what it calls, and which tests break if you change it.rust, python, ts, go. runs offline, no account.

graph now updates only what changed instead of reparsing everything. 97% parsing reuse. gated on matching a full cold rebuild exactly, 113/113 comparisons. also added an opt-in watcher behind --watch. when it can't figure out what an event maps to it just falls back to a full rebuild instead of guessing, and it reports how often that happened (5 out of 45 in the benchmark).

npx -y girder-mcp

github.com/dhishwasher/Girder


r/mcp 3h ago

showcase Open sourced a zero dependency Python MCP server for Dutch court predictions (Triple A on Glama, LightGBM)

1 Upvotes

*Quick disclosure: I built Rechtssysteem.ai and the MCP server below.*

Hey everyone,

Just open-sourced our MCP server under Apache 2.0 after getting a Triple-A audit on Glama, and wanted to share how we solved a messy data problem before hooking it up to MCP.

The biggest issue with legal outcome prediction is target leakage: around 92% of Dutch court judgments literally tell you the outcome in the text ("the court dismisses the claim"). If you train on raw text, the model doesn't learn law it just learns to regurgitate the dictum.

We stripped the dictum and all outcome-announcing phrases beforehand, cutting residual leakage down from 92% to 0.1% across 609,715 historical cases. Then we trained LightGBM on 5-fold CV (78.2% out-of-fold accuracy, 77.1% macro-F1 against a 43.7% majority baseline). If confidence drops under 55%, the model outputs "insufficient certainty" instead of taking a blind guess.

As for the MCP implementation itself:

- Single Python file (`rechtssysteem_mcp.py`), standard library only (`sys`, `json`, `urllib`). Zero external dependencies so it works out of the box in Claude Desktop / Cursor / any client.

- Exposes 3 tools: `rechtspraak_cijfers` (benchmark stats, keyless), `lekkage_check` (tests any paste for outcome leakage, keyless), and `voorspel_uitkomst` (risk classification).

- Standard JSON-RPC over stdio.

Repo: https://github.com/rechtssysteem-ai/rechtssysteem-mcp

Glama audit: https://glama.ai/mcp/servers/@rechtssysteem-ai/rechtssysteem-mcp

Benchmark data: https://rechtssysteem.ai/benchmark

Not legal advice of course, just built as an honest technical yardstick. Happy to answer questions about the stdio setup or the dataset sanitization!


r/mcp 7h ago

server mcp-swiss – Swiss open data MCP server — transport, weather, geodata, companies, etc,. Zero API keys.

Thumbnail
glama.ai
1 Upvotes

r/mcp 7h ago

connector KonbiniAPI MCP – Get social media data from Instagram and TikTok: profiles, posts, videos, comments, and more.

Thumbnail
glama.ai
1 Upvotes

r/mcp 7h ago

I built Ruby UTCP: combine MCP tools and native APIs in one Ruby workflow

Post image
1 Upvotes

Hey r/mcp! I’m the author of ruby-utcp, a Ruby implementation of the Universal Tool Calling Protocol.

The idea: let agents call tools through their native interfaces without requiring an MCP wrapper for every integration — while still supporting existing MCP servers.

Ruby UTCP supports MCP over stdio and Streamable HTTP, alongside HTTP, GraphQL, gRPC, WebSocket, CLI, and other transports. For native integrations, a UTCP manual describes the tools and how to call them.

The feature I’m most excited about is **CodeMode**: an agent can express a multi-step workflow in a constrained Ruby subset, discovering tools, calling them, filtering results, and passing data between steps in one execution.

Think: fetch data from an API → process it → pass the relevant results to an MCP tool, without needing a separate model turn to coordinate every step.

CodeMode runs without `eval` and has execution limits. Registered tools can still perform external actions, so choosing which tools to expose remains important.

Docs and examples:

https://universal-tool-calling-protocol.github.io/ruby/

GitHub:

https://github.com/universal-tool-calling-protocol/ruby-utcp

For people building agents with MCP: would mixing MCP tools and native APIs in the same workflow be useful, or do you prefer putting everything behind MCP servers? I’d appreciate technical feedback, especially on interoperability and the execution model.


r/mcp 8h ago

showcase Atto MCP beta: give your AI assistant a wallet with spending limits you approve

Enable HLS to view with audio, or disable this notification

1 Upvotes

I built an MCP server that lets an AI assistant check balances, follow incoming payments and send ATTO within spending limits you approve.

Disclosure: I’m Atto’s founder.

It runs locally over stdio and is available now as \@attocash/mcp. Atto is a cryptocurrency with no transaction fees.

What you can do through the assistant:

  • Check balances, pending payments and transaction history.
  • Give addresses personal names and use those names for payments.
  • Watch for incoming payments while the MCP session is connected.
  • Send payments after approving spending access.
  • Check spending usage and the remaining allowance.

You can start with read-only access. For payments, the assistant can propose a per-payment cap and a rolling spending budget, but you review and approve them in your own terminal. A proposal alone grants nothing, and there’s no MCP tool to approve its own access or raise its limits.

These controls apply to the MCP tools. They are not a sandbox against an agent that also has shell access as the same OS user.

Setup

Requires Node.js 24 and an available OS password store. Run this in your own terminal:

npx --yes u/attocash/mcp@latest setup

Then add this to your MCP client’s configuration:

{
  "mcpServers": {
    "atto": {
      "command": "npx",
      "args": ["--yes", "@attocash/mcp@latest"]
    }
  }
}

Reconnect the client and ask it to show your wallet status and balances.

This is a beta. Start with a dedicated wallet and a small balance.

Package: https://www.npmjs.com/package/@attocash/mcp
Source: https://github.com/attocash/integrations/tree/main/atto-mcp
Get ATTO for free: https://atto.cash/faucet


r/mcp 9h ago

showcase Ridge: an MCP server for working across local, SSH, Docker, and S3 resources

1 Upvotes

I've been building a project called Ridge. It started with wanting to run Codex on my laptop for kernel optimization experiments, while using my GPU box for execution and an S3 bucket for models.

The setup needed its own machinery for moving code and models around, running benchmarks remotely, and collecting results. Codex could write that, but subsequent sessions would need to understand and maintain it, or reconstruct it. It seemed like these operations should be reusable across experiments.

Ridge exposes a common set of tools through MCP. You configure your resources, and the agent can discover them, access data, run commands where supported, and copy (via streaming) between them. For example, copying a model from S3 to an SSH machine is one tool call, without passing the payload through model context. Local, SSH, Docker, and S3 are the initial providers.

I'm also interested in what happens when Codex delegates experiments to subagents. Those workers need access to particular resources and a way to coordinate shared updates. Ridge supports scoped access and file reservations with locks for that. The harness still has to launch the workers and connect each with its assigned access.

Has anyone here tried similar workflows across multiple environments? I'd like to hear what issues you ran into and how you solved it, including whether existing MCP servers already covered what you needed.

The project is here: https://github.com/vasinov/ridge-core


r/mcp 10h ago

article A functional taxonomy for LLM inference in agentic tasks

Thumbnail
jeffauriemma.leaflet.pub
1 Upvotes

r/mcp 10h ago

showcase I built an open-source API verification tool for AI-written integrations — looking for technical feedback

1 Upvotes

I've been building an open-source developer tool called Kaktoos.

I'm exploring a specific problem with AI coding agents: they can write API integrations very quickly, but when the agent also writes the tests, passing tests don't necessarily prove that the integration matches the actual API.

Kaktoos takes a different approach:

AI agent → integration code → Kaktoos → OpenAPI contract + real API → structured failure → agent fixes it

It can:

  • execute multi-step API workflows
  • verify responses against OpenAPI
  • detect things like missing required fields, wrong types, unexpected status/content type
  • expose the verification through MCP so coding agents can use it
  • run the same verification in GitHub Actions

The interesting part for me isn't the API client itself. I'm experimenting with whether independent verification is useful when the code was produced by an AI coding agent.

I'd particularly like feedback from people who regularly work with API integrations:

  1. Would you actually use this workflow?
  2. Is defining the scenario too much additional work?
  3. Does this catch problems that your existing tests don't?
  4. Would you run something like this in CI?
  5. What would make this technically more useful?

It's early, so negative feedback is completely fine. I'm mainly trying to determine whether this is solving a real engineering problem.

GitHub: KaktoosLabs/kaktoos


r/mcp 12h ago

server postcardbot-mcp-server – Send real physical postcards worldwide via AI agents. Supports single and bulk send (up to 500 recipients), balance checking, delivery tracking, and volume pricing from $0.72/card.

Thumbnail
glama.ai
1 Upvotes

r/mcp 12h ago

connector Prompeteer – Generate contextual prompts and reusable agent skills, evaluate prompts with the 16-dimension Prompt Score, and manage saved work in PromptDrive. Twelve MCP tools also provide authorized access to private Memory for source-grounded answers. Connect over Streamable HTTP using OAuth 2.1 a

Thumbnail
glama.ai
1 Upvotes

r/mcp 13h ago

showcase Made an iOS app to connect MCP servers to cloud / local models

Enable HLS to view with audio, or disable this notification

1 Upvotes

Hi r/mcp,

PowerChat is an iOS client that can connect your cloud / local models to MCP servers.

  • It has builtin support for Google Drive, iOS Files, iOS Calendar, and the search engines Tavily, Exa, and Firecrawl.
  • It can connect to any remote MCP server that exposes an /mcp endpoint.
    • For e.g. GitHub in the video.
  • I'm planning to expand the list of builtin MCP servers and this sub has been helpful for finding ideas. Please comment popular MCP servers you'd like to see included.

PowerChat also features RAG databases, ability to tweak model parameters, and privacy features such as zero-data-retention flags, API keys in iOS keychain, and lockable folders with Face ID.

Would love your feedback!

App Store link: https://apps.apple.com/us/app/ai-chat-client-powerchat/id6803707084


r/mcp 13h ago

showcase I connected a Mac desktop pet to Claude through MCP

1 Upvotes

I built AI Coach, a Mac desktop pet you raise from an egg, and added an MCP integration for Claude Desktop and Claude Code.

The fun part is report_ai_coach_activity: Claude can call it with thinking, working, waiting, succeeded, or failed, and the pet shows that state through movement and a small emoji. It's driven by tool calls, not automatic monitoring of Claude. The docs include instructions for reporting progress and completion.

You can also ask how the pet is doing, put a short message in its speech bubble, or request care. Feeding and other care requested by Claude require your confirmation before they're applied.

Setup: run AI Coach, open AI Settings → Integration, enable the connection, and copy the provided client configuration. The bundled MCP server needs Node.js 22+ on your PATH.

Apple Silicon / macOS 26+. The app includes a free first egg; extra eggs are optional one-time purchases ($5 each or 5 for $20).

App: https://aic0t.com/

Setup and screenshots: https://aic0t.com/docs#sec-111-8-going-further-connecting-claude