ARTICLE AD BOX
AgentQL allows you to scrape immoderate website pinch unstructured information by defining nan nonstop style of nan accusation you want. It gives you consistent, system results—even from pages pinch move contented aliases often changing layouts.
In this tutorial, we’ll instrumentality an AgentQL MCP server wrong Claude Desktop, and usage Claude’s built-in visualization capabilities to research nan data. Specifically, we’ll scrape an Amazon hunt results page for AI books, extracting specifications for illustration price, rating, and number of reviews.
Step 1: Setting up dependencies
Node JS
We request npx to tally nan AgentQL server, which comes pinch Node.js.
- Download nan latest type of Node.js from nodejs.org
- Run nan installer.
- Leave each settings arsenic default and complete nan installation
Claude Desktop
Download Claude utilizing https://claude.ai/download.
AgentQL API
Create your AgentQL API cardinal astatine dev.agentql.com/api-keys and shop it securely — you’ll request it later successful this tutorial.
Step 2: Installing nan packages
Once Node.js is installed, unfastened your terminal and tally nan pursuing command:
Step 3: Configuring nan MCP Server
Next, configure Claude to link to your MCP server. Open nan claude_desktop_config.json record located successful nan Claude installation directory utilizing immoderate matter editor. If nan record doesn’t exist, you tin create it manually. Once opened, participate nan pursuing code:
Replace <YOUR_API_KEY> pinch nan cardinal you generated.
Step 4: Running nan server
Once nan MCP configuration is complete, your server should look successful Claude. The AgentQL server includes a azygous powerful instrumentality — extract_web_data — which takes a URL and a earthy connection explanation of nan information building you want to extract.
You tin usage immoderate URL you want to scrape. For this tutorial, I utilized an Amazon hunt results page for AI books and asked Claude to visualize nan extracted data. Claude provides an interactive terminal wherever it generates codification to process and visualize nan information — and you tin edit that codification arsenic needed. Once nan codification was finalized, Claude presented a barroom floor plan pinch interactive options to research prices, ratings, reappraisal counts, and moreover a value vs. standing scatter plot, on pinch cardinal summary statistics.
AgentQL tin beryllium utilized to scrape websites, and we tin link it pinch different servers for illustration Notion aliases GitHub to automatically nonstop system information for documentation, tracking, aliases further automation.
This makes AgentQL a powerful instrumentality for turning unstructured web contented into actionable insights — each wrong a simple, earthy connection workflow.
Here’s a little overview of what we’re building astatine Marktechpost:
- Newsletter– airesearchinsights.com/(30k+ subscribers)
- miniCON AI Events – minicon.marktechpost.com
- AI Reports & Magazines – magazine.marktechpost.com
- AI Dev & Research News – marktechpost.com (1M+ monthly readers)
- ML News Community – r/machinelearningnews (92k+ members)
I americium a Civil Engineering Graduate (2022) from Jamia Millia Islamia, New Delhi, and I person a keen liking successful Data Science, particularly Neural Networks and their exertion successful various areas.