MCP-YOLO

mcp-name: io.github.rjn32s/mcp-yolo

MCP-YOLO is an agent-first development platform that provides Zero-Shot Object Detection and Segmentation as a Model Context Protocol (MCP) server. Powered by Ultralytics YOLOE, it enables developers and AI agents to detect and segment objects using arbitrary text prompts without retraining.

Key Features

• Zero-Shot Detection: Detect any object using natural language (e.g., "the blue coffee cup next to the spoon").
• Instance Segmentation: Precise polygon masks for discovered objects.
• Flexible Image Inputs: Supports local file paths, remote URLs, and Base64 encoded strings.
• Agent Optimized: Includes custom "Skills" for autonomous deployment and benchmarking.

YOLOE Performance Reference

YOLOE builds upon the latest YOLO architectures (like YOLO11 and YOLO26) to provide state-of-the-art open-vocabulary performance.

Note: Performance varies depending on the hardware and input resolution. mcp-yolo uses yoloe-26l-seg.pt by default for high precision.

Quick Start

Installation

uv pip install mcp-yolo

Running the Server

uv run mcp-yolo

MCP Tools

detect_objects

Performs zero-shot detection.

• Arguments:
  • image_source (str): Path, URL, or Base64.
  • classes (list[str], optional): Custom text prompts to detect.

segment_objects

Performs zero-shot instance segmentation.

• Arguments:
  • image_source (str): Path, URL, or Base64.
  • classes (list[str], optional): Custom text prompts to segment.

Publishing

This project is configured for automated PyPI publishing. See the pypi_setup_guide.md for details.