ai.smithery/oxylabs-oxylabs-mcp

平台与服务

by oxylabs

使用 Oxylabs Web Scraper API 从指定 URL 抓取并处理网页内容,适合自动化数据采集。

想自动化采集网页数据时,用它可直接从指定 URL 抓取并处理内容,背靠 Oxylabs Web Scraper API,稳定性和规模化能力更省心。

什么是 ai.smithery/oxylabs-oxylabs-mcp

使用 Oxylabs Web Scraper API 从指定 URL 抓取并处理网页内容,适合自动化数据采集。

README

<p align="center"> <img src="https://storage.googleapis.com/oxylabs-public-assets/oxylabs_mcp.svg" alt="Oxylabs + MCP"> </p> <h1 align="center" style="border-bottom: none;"> Oxylabs MCP Server </h1> <p align="center"> <em>The missing link between AI models and the real‑world web: one API that delivers clean, structured data from any site.</em> </p> <div align="center">

smithery badge pypi package Licence Verified on MseeP Coverage badge

<br/> <a href="https://glama.ai/mcp/servers/@oxylabs/oxylabs-mcp"> <img width="380" height="200" src="https://glama.ai/mcp/servers/@oxylabs/oxylabs-mcp/badge" alt="Oxylabs Server MCP server" /> </a> </div>

📖 Overview

The Oxylabs MCP server provides a bridge between AI models and the web. It enables them to scrape any URL, render JavaScript-heavy pages, extract and format content for AI use, bypass anti-scraping measures, and access geo-restricted web data from 195+ countries.

🛠️ MCP Tools

Oxylabs MCP provides two sets of tools that can be used together or independently:

Oxylabs Web Scraper API Tools

  1. universal_scraper: Uses Oxylabs Web Scraper API for general website scraping;
  2. google_search_scraper: Uses Oxylabs Web Scraper API to extract results from Google Search;
  3. amazon_search_scraper: Uses Oxylabs Web Scraper API to scrape Amazon search result pages;
  4. amazon_product_scraper: Uses Oxylabs Web Scraper API to extract data from individual Amazon product pages.

Oxylabs AI Studio Tools

  1. ai_scraper: Scrape content from any URL in JSON or Markdown format with AI-powered data extraction;
  2. ai_crawler: Based on a prompt, crawls a website and collects data in Markdown or JSON format across multiple pages;
  3. ai_browser_agent: Based on prompt, controls a browser and returns data in Markdown, JSON, HTML, or screenshot formats;
  4. ai_search: Search the web for URLs and their contents with AI-powered content extraction.

✅ Prerequisites

Before you begin, make sure you have at least one of the following:

  • Oxylabs Web Scraper API Account: Obtain your username and password from Oxylabs (1-week free trial available);
  • Oxylabs AI Studio API Key: Obtain your API key from Oxylabs AI Studio. (1000 credits free).

📦 Configuration

Environment variables

Oxylabs MCP server supports the following environment variables:

NameDescriptionDefault
OXYLABS_USERNAMEYour Oxylabs Web Scraper API username
OXYLABS_PASSWORDYour Oxylabs Web Scraper API password
OXYLABS_AI_STUDIO_API_KEYYour Oxylabs AI Studio API key
LOG_LEVELLog level for the logs returned to the clientINFO

Based on provided credentials, the server will automatically expose the corresponding tools:

  • If only OXYLABS_USERNAME and OXYLABS_PASSWORD are provided, the server will expose the Web Scraper API tools;
  • If only OXYLABS_AI_STUDIO_API_KEY is provided, the server will expose the AI Studio tools;
  • If both OXYLABS_USERNAME and OXYLABS_PASSWORD and OXYLABS_AI_STUDIO_API_KEY are provided, the server will expose all tools.

❗❗❗ Important note: if you don't have Web Scraper API or Oxylabs AI studio credentials, delete the corresponding environment variables placeholders. Leaving placeholder values will result in exposed tools that do not work.

Configure with uvx

  • Install the uvx package manager:
    bash
    # macOS and Linux
    curl -LsSf https://astral.sh/uv/install.sh | sh
    
    OR:
    bash
    # Windows
    powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"
    
  • Use the following config:
    json
    {
      "mcpServers": {
        "oxylabs": {
          "command": "uvx",
          "args": ["oxylabs-mcp"],
          "env": {
            "OXYLABS_USERNAME": "OXYLABS_USERNAME",
            "OXYLABS_PASSWORD": "OXYLABS_PASSWORD",
            "OXYLABS_AI_STUDIO_API_KEY": "OXYLABS_AI_STUDIO_API_KEY"
          }
        }
      }
    }
    

Configure with uv

  • Install the uv package manager:

    bash
    # macOS and Linux
    curl -LsSf https://astral.sh/uv/install.sh | sh
    

    OR:

    bash
    # Windows
    powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"
    
  • Use the following config:

    json
    {
      "mcpServers": {
        "oxylabs": {
          "command": "uv",
          "args": [
            "--directory",
            "/<Absolute-path-to-folder>/oxylabs-mcp",
            "run",
            "oxylabs-mcp"
          ],
          "env": {
            "OXYLABS_USERNAME": "OXYLABS_USERNAME",
            "OXYLABS_PASSWORD": "OXYLABS_PASSWORD",
            "OXYLABS_AI_STUDIO_API_KEY": "OXYLABS_AI_STUDIO_API_KEY"
          }
        }
      }
    }
    

Configure with Smithery Oauth2

json
  {
    "mcpServers": {
      "oxylabs": {
        "url": "https://server.smithery.ai/@oxylabs/oxylabs-mcp/mcp"
      }
    }
  }
  • Follow the instructions to authenticate Oxylabs MCP with Oauth2 flow

Configure with Smithery query parameters

In case your client does not support the Oauth2 authentication, you can pass the Oxylabs authentication parameters directly in url

json
  {
    "mcpServers": {
      "oxylabs": {
        "url": "https://server.smithery.ai/@oxylabs/oxylabs-mcp/mcp?oxylabsUsername=OXYLABS_USERNAME&oxylabsPassword=OXYLABS_PASSWORD&oxylabsAiStudioApiKey=OXYLABS_AI_STUDIO_API_KEY"
      }
    }
  }

Manual Setup with Claude Desktop

Navigate to Claude → Settings → Developer → Edit Config and add one of the configurations above to the claude_desktop_config.json file.

Manual Setup with Cursor AI

Navigate to Cursor → Settings → Cursor Settings → MCP. Click Add new global MCP server and add one of the configurations above.

📝 Logging

Server provides additional information about the tool calls in notification/message events

json
{
  "method": "notifications/message",
  "params": {
    "level": "info",
    "data": "Create job with params: {\"url\": \"https://ip.oxylabs.io\"}"
  }
}
json
{
  "method": "notifications/message",
  "params": {
    "level": "info",
    "data": "Job info: job_id=7333113830223918081 job_status=done"
  }
}
json
{
  "method": "notifications/message",
  "params": {
    "level": "error",
    "data": "Error: request to Oxylabs API failed"
  }
}

🛡️ License

Distributed under the MIT License – see LICENSE for details.


About Oxylabs

Established in 2015, Oxylabs is a market-leading web intelligence collection platform, driven by the highest business, ethics, and compliance standards, enabling companies worldwide to unlock data-driven insights.

image

<div align="center"> <sub> Made with ☕ by <a href="https://oxylabs.io">Oxylabs</a>. Feel free to give us a ⭐ if MCP saved you a weekend. </sub> </div>

✨ Key Features

<details> <summary><strong> Scrape content from any site</strong></summary> <br>
  • Extract data from any URL, including complex single-page applications
  • Fully render dynamic websites using headless browser support
  • Choose full JavaScript rendering, HTML-only, or none
  • Emulate Mobile and Desktop viewports for realistic rendering
</details> <details> <summary><strong> Automatically get AI-ready data</strong></summary> <br>
  • Automatically clean and convert HTML to Markdown for improved readability
  • Use automated parsers for popular targets like Google, Amazon, and more
</details> <details> <summary><strong> Bypass blocks & geo-restrictions</strong></summary> <br>
  • Bypass sophisticated bot protection systems with high success rate
  • Reliably scrape even the most complex websites
  • Get automatically rotating IPs from a proxy pool covering 195+ countries
</details> <details> <summary><strong> Flexible setup & cross-platform support</strong></summary> <br>
  • Set rendering and parsing options if needed
  • Feed data directly into AI models or analytics tools
  • Works on macOS, Windows, and Linux
</details> <details> <summary><strong> Built-in error handling and request management</strong></summary> <br>
  • Comprehensive error handling and reporting
  • Smart rate limiting and request management
</details>

Why Oxylabs MCP?  🕸️ ➜ 📦 ➜ 🤖

Imagine telling your LLM "Summarise the latest Hacker News discussion about GPT‑5" – and it simply answers.
MCP (Multi‑Client Proxy) makes that happen by doing the boring parts for you:

What Oxylabs MCP doesWhy it matters to you
Bypasses anti‑bot walls with the Oxylabs global proxy networkKeeps you unblocked and anonymous
Renders JavaScript in headless ChromeSingle‑page apps, sorted
Cleans HTML → JSONDrop straight into vector DBs or prompts
Optional structured parsers (Google, Amazon, etc.)One‑line access to popular targets

mcp-name: io.oxylabs/oxylabs-mcp

常见问题

ai.smithery/oxylabs-oxylabs-mcp 是什么?

使用 Oxylabs Web Scraper API 从指定 URL 抓取并处理网页内容,适合自动化数据采集。

相关 Skills

MCP构建

by anthropics

Universal
热门

聚焦高质量 MCP Server 开发,覆盖协议研究、工具设计、错误处理与传输选型,适合用 FastMCP 或 MCP SDK 对接外部 API、封装服务能力。

想让 LLM 稳定调用外部 API,就用 MCP构建:从 Python 到 Node 都有成熟指引,帮你更快做出高质量 MCP 服务器。

平台与服务
未扫描111.1k

Slack动图

by anthropics

Universal
热门

面向Slack的动图制作Skill,内置emoji/消息GIF的尺寸、帧率和色彩约束、校验与优化流程,适合把创意或上传图片快速做成可直接发送的Slack动画。

帮你快速做出适配 Slack 的动图,内置约束规则和校验工具,少踩上传与播放坑,做表情包和演示都更省心。

平台与服务
未扫描111.1k

MCP服务构建器

by alirezarezvani

Universal
热门

从 OpenAPI 一键生成 Python/TypeScript MCP server 脚手架,并校验 tool schema、命名规范与版本兼容性,适合把现有 REST API 快速发布成可生产演进的 MCP 服务。

帮你快速搭建 MCP 服务与后端 API,脚手架完善、扩展顺手,尤其适合想高效验证服务能力的开发者。

平台与服务
未扫描9.6k

相关 MCP Server

Slack 消息

编辑精选

by Anthropic

热门

Slack 是让 AI 助手直接读写你的 Slack 频道和消息的 MCP 服务器。

这个服务器解决了团队协作中需要 AI 实时获取 Slack 信息的痛点,特别适合开发团队让 Claude 帮忙汇总频道讨论或发送通知。不过,它目前只是参考实现,文档有限,不建议在生产环境直接使用——更适合开发者学习 MCP 如何集成第三方服务。

平台与服务
83.0k

by netdata

热门

io.github.netdata/mcp-server 是让 AI 助手实时监控服务器指标和日志的 MCP 服务器。

这个工具解决了运维人员需要手动检查系统状态的痛点,最适合 DevOps 团队让 Claude 自动分析性能数据。不过,它依赖 NetData 的现有部署,如果你没用过这个监控平台,得先花时间配置。

平台与服务
78.3k

by d4vinci

热门

Scrapling MCP Server 是专为现代网页设计的智能爬虫工具,支持绕过 Cloudflare 等反爬机制。

这个工具解决了爬取动态网页和反爬网站时的头疼问题,特别适合需要批量采集电商价格或新闻数据的开发者。不过,它依赖外部浏览器引擎,资源消耗较大,不适合轻量级任务。

平台与服务
34.8k

评论