ai.smithery/oxylabs-oxylabs-mcp
平台与服务by oxylabs
使用 Oxylabs Web Scraper API 从指定 URL 抓取并处理网页内容,适合自动化数据采集。
想自动化采集网页数据时,用它可直接从指定 URL 抓取并处理内容,背靠 Oxylabs Web Scraper API,稳定性和规模化能力更省心。
什么是 ai.smithery/oxylabs-oxylabs-mcp?
使用 Oxylabs Web Scraper API 从指定 URL 抓取并处理网页内容,适合自动化数据采集。
README
📖 Overview
The Oxylabs MCP server provides a bridge between AI models and the web. It enables them to scrape any URL, render JavaScript-heavy pages, extract and format content for AI use, bypass anti-scraping measures, and access geo-restricted web data from 195+ countries.
🛠️ MCP Tools
Oxylabs MCP provides two sets of tools that can be used together or independently:
Oxylabs Web Scraper API Tools
- universal_scraper: Uses Oxylabs Web Scraper API for general website scraping;
- google_search_scraper: Uses Oxylabs Web Scraper API to extract results from Google Search;
- amazon_search_scraper: Uses Oxylabs Web Scraper API to scrape Amazon search result pages;
- amazon_product_scraper: Uses Oxylabs Web Scraper API to extract data from individual Amazon product pages.
Oxylabs AI Studio Tools
- ai_scraper: Scrape content from any URL in JSON or Markdown format with AI-powered data extraction;
- ai_crawler: Based on a prompt, crawls a website and collects data in Markdown or JSON format across multiple pages;
- ai_browser_agent: Based on prompt, controls a browser and returns data in Markdown, JSON, HTML, or screenshot formats;
- ai_search: Search the web for URLs and their contents with AI-powered content extraction.
✅ Prerequisites
Before you begin, make sure you have at least one of the following:
- Oxylabs Web Scraper API Account: Obtain your username and password from Oxylabs (1-week free trial available);
- Oxylabs AI Studio API Key: Obtain your API key from Oxylabs AI Studio. (1000 credits free).
📦 Configuration
Environment variables
Oxylabs MCP server supports the following environment variables:
| Name | Description | Default |
|---|---|---|
OXYLABS_USERNAME | Your Oxylabs Web Scraper API username | |
OXYLABS_PASSWORD | Your Oxylabs Web Scraper API password | |
OXYLABS_AI_STUDIO_API_KEY | Your Oxylabs AI Studio API key | |
LOG_LEVEL | Log level for the logs returned to the client | INFO |
Based on provided credentials, the server will automatically expose the corresponding tools:
- If only
OXYLABS_USERNAMEandOXYLABS_PASSWORDare provided, the server will expose the Web Scraper API tools; - If only
OXYLABS_AI_STUDIO_API_KEYis provided, the server will expose the AI Studio tools; - If both
OXYLABS_USERNAMEandOXYLABS_PASSWORDandOXYLABS_AI_STUDIO_API_KEYare provided, the server will expose all tools.
❗❗❗ Important note: if you don't have Web Scraper API or Oxylabs AI studio credentials, delete the corresponding environment variables placeholders. Leaving placeholder values will result in exposed tools that do not work.
Configure with uvx
- Install the uvx package manager:
OR:bash
# macOS and Linux curl -LsSf https://astral.sh/uv/install.sh | shbash# Windows powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex" - Use the following config:
json
{ "mcpServers": { "oxylabs": { "command": "uvx", "args": ["oxylabs-mcp"], "env": { "OXYLABS_USERNAME": "OXYLABS_USERNAME", "OXYLABS_PASSWORD": "OXYLABS_PASSWORD", "OXYLABS_AI_STUDIO_API_KEY": "OXYLABS_AI_STUDIO_API_KEY" } } } }
Configure with uv
-
Install the uv package manager:
bash# macOS and Linux curl -LsSf https://astral.sh/uv/install.sh | shOR:
bash# Windows powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex" -
Use the following config:
json{ "mcpServers": { "oxylabs": { "command": "uv", "args": [ "--directory", "/<Absolute-path-to-folder>/oxylabs-mcp", "run", "oxylabs-mcp" ], "env": { "OXYLABS_USERNAME": "OXYLABS_USERNAME", "OXYLABS_PASSWORD": "OXYLABS_PASSWORD", "OXYLABS_AI_STUDIO_API_KEY": "OXYLABS_AI_STUDIO_API_KEY" } } } }
Configure with Smithery Oauth2
- Go to https://smithery.ai/server/@oxylabs/oxylabs-mcp;
- Click Auto to install the Oxylabs MCP configuration for the respective client;
- OR use the following config:
{
"mcpServers": {
"oxylabs": {
"url": "https://server.smithery.ai/@oxylabs/oxylabs-mcp/mcp"
}
}
}
- Follow the instructions to authenticate Oxylabs MCP with Oauth2 flow
Configure with Smithery query parameters
In case your client does not support the Oauth2 authentication, you can pass the Oxylabs authentication parameters directly in url
{
"mcpServers": {
"oxylabs": {
"url": "https://server.smithery.ai/@oxylabs/oxylabs-mcp/mcp?oxylabsUsername=OXYLABS_USERNAME&oxylabsPassword=OXYLABS_PASSWORD&oxylabsAiStudioApiKey=OXYLABS_AI_STUDIO_API_KEY"
}
}
}
Manual Setup with Claude Desktop
Navigate to Claude → Settings → Developer → Edit Config and add one of the configurations above to the claude_desktop_config.json file.
Manual Setup with Cursor AI
Navigate to Cursor → Settings → Cursor Settings → MCP. Click Add new global MCP server and add one of the configurations above.
📝 Logging
Server provides additional information about the tool calls in notification/message events
{
"method": "notifications/message",
"params": {
"level": "info",
"data": "Create job with params: {\"url\": \"https://ip.oxylabs.io\"}"
}
}
{
"method": "notifications/message",
"params": {
"level": "info",
"data": "Job info: job_id=7333113830223918081 job_status=done"
}
}
{
"method": "notifications/message",
"params": {
"level": "error",
"data": "Error: request to Oxylabs API failed"
}
}
🛡️ License
Distributed under the MIT License – see LICENSE for details.
About Oxylabs
Established in 2015, Oxylabs is a market-leading web intelligence collection platform, driven by the highest business, ethics, and compliance standards, enabling companies worldwide to unlock data-driven insights.
<div align="center"> <sub> Made with ☕ by <a href="https://oxylabs.io">Oxylabs</a>. Feel free to give us a ⭐ if MCP saved you a weekend. </sub> </div>✨ Key Features
<details> <summary><strong> Scrape content from any site</strong></summary> <br>- Extract data from any URL, including complex single-page applications
- Fully render dynamic websites using headless browser support
- Choose full JavaScript rendering, HTML-only, or none
- Emulate Mobile and Desktop viewports for realistic rendering
- Automatically clean and convert HTML to Markdown for improved readability
- Use automated parsers for popular targets like Google, Amazon, and more
- Bypass sophisticated bot protection systems with high success rate
- Reliably scrape even the most complex websites
- Get automatically rotating IPs from a proxy pool covering 195+ countries
- Set rendering and parsing options if needed
- Feed data directly into AI models or analytics tools
- Works on macOS, Windows, and Linux
- Comprehensive error handling and reporting
- Smart rate limiting and request management
Why Oxylabs MCP? 🕸️ ➜ 📦 ➜ 🤖
Imagine telling your LLM "Summarise the latest Hacker News discussion about GPT‑5" – and it simply answers.
MCP (Multi‑Client Proxy) makes that happen by doing the boring parts for you:
| What Oxylabs MCP does | Why it matters to you |
|---|---|
| Bypasses anti‑bot walls with the Oxylabs global proxy network | Keeps you unblocked and anonymous |
| Renders JavaScript in headless Chrome | Single‑page apps, sorted |
| Cleans HTML → JSON | Drop straight into vector DBs or prompts |
| Optional structured parsers (Google, Amazon, etc.) | One‑line access to popular targets |
mcp-name: io.oxylabs/oxylabs-mcp
常见问题
ai.smithery/oxylabs-oxylabs-mcp 是什么?
使用 Oxylabs Web Scraper API 从指定 URL 抓取并处理网页内容,适合自动化数据采集。
相关 Skills
MCP构建
by anthropics
聚焦高质量 MCP Server 开发,覆盖协议研究、工具设计、错误处理与传输选型,适合用 FastMCP 或 MCP SDK 对接外部 API、封装服务能力。
✎ 想让 LLM 稳定调用外部 API,就用 MCP构建:从 Python 到 Node 都有成熟指引,帮你更快做出高质量 MCP 服务器。
Slack动图
by anthropics
面向Slack的动图制作Skill,内置emoji/消息GIF的尺寸、帧率和色彩约束、校验与优化流程,适合把创意或上传图片快速做成可直接发送的Slack动画。
✎ 帮你快速做出适配 Slack 的动图,内置约束规则和校验工具,少踩上传与播放坑,做表情包和演示都更省心。
MCP服务构建器
by alirezarezvani
从 OpenAPI 一键生成 Python/TypeScript MCP server 脚手架,并校验 tool schema、命名规范与版本兼容性,适合把现有 REST API 快速发布成可生产演进的 MCP 服务。
✎ 帮你快速搭建 MCP 服务与后端 API,脚手架完善、扩展顺手,尤其适合想高效验证服务能力的开发者。
相关 MCP Server
Slack 消息
编辑精选by Anthropic
Slack 是让 AI 助手直接读写你的 Slack 频道和消息的 MCP 服务器。
✎ 这个服务器解决了团队协作中需要 AI 实时获取 Slack 信息的痛点,特别适合开发团队让 Claude 帮忙汇总频道讨论或发送通知。不过,它目前只是参考实现,文档有限,不建议在生产环境直接使用——更适合开发者学习 MCP 如何集成第三方服务。
by netdata
io.github.netdata/mcp-server 是让 AI 助手实时监控服务器指标和日志的 MCP 服务器。
✎ 这个工具解决了运维人员需要手动检查系统状态的痛点,最适合 DevOps 团队让 Claude 自动分析性能数据。不过,它依赖 NetData 的现有部署,如果你没用过这个监控平台,得先花时间配置。
by d4vinci
Scrapling MCP Server 是专为现代网页设计的智能爬虫工具,支持绕过 Cloudflare 等反爬机制。
✎ 这个工具解决了爬取动态网页和反爬网站时的头疼问题,特别适合需要批量采集电商价格或新闻数据的开发者。不过,它依赖外部浏览器引擎,资源消耗较大,不适合轻量级任务。
