# Scrapling

## Docs

- [Introduction to Scrapling](https://mintlify.wiki/D4Vinci/Scrapling/introduction.md): An adaptive web scraping framework that handles everything from a single request to a full-scale crawl
- [Installation](https://mintlify.wiki/D4Vinci/Scrapling/installation.md): Install Scrapling and its optional dependencies for fetchers, AI features, and CLI tools
- [Quick Start](https://mintlify.wiki/D4Vinci/Scrapling/quickstart.md): Get up and running with Scrapling in minutes
- [Architecture Overview](https://mintlify.wiki/D4Vinci/Scrapling/concepts/architecture.md): Understanding Scrapling core architecture and design principles
- [Fetchers](https://mintlify.wiki/D4Vinci/Scrapling/concepts/fetchers.md): Understanding Scrapling fetcher types and when to use each
- [Parsing System](https://mintlify.wiki/D4Vinci/Scrapling/concepts/parsing.md): Deep dive into Scrapling HTML/XML parsing and data extraction
- [Session Management](https://mintlify.wiki/D4Vinci/Scrapling/concepts/sessions.md): Understanding persistent connections and state management in Scrapling
- [Choosing the Right Fetcher](https://mintlify.wiki/D4Vinci/Scrapling/fetching/choosing-fetcher.md): Guide to selecting the appropriate fetcher for your web scraping needs
- [Static Requests (Fetcher)](https://mintlify.wiki/D4Vinci/Scrapling/fetching/static-requests.md): Fast HTTP requests with TLS fingerprint impersonation
- [Stealthy Mode (StealthyFetcher)](https://mintlify.wiki/D4Vinci/Scrapling/fetching/stealthy-mode.md): Bypass anti-bot systems like Cloudflare Turnstile with advanced stealth capabilities
- [Browser Automation (DynamicFetcher)](https://mintlify.wiki/D4Vinci/Scrapling/fetching/browser-automation.md): Full browser automation with Playwright for JavaScript-heavy websites
- [Sessions](https://mintlify.wiki/D4Vinci/Scrapling/fetching/sessions.md): Manage persistent sessions and cookies across multiple requests
- [Proxy Rotation](https://mintlify.wiki/D4Vinci/Scrapling/fetching/proxy-rotation.md): Automatically rotate proxies across all fetcher and session types
- [Selectors](https://mintlify.wiki/D4Vinci/Scrapling/parsing/selectors.md): Query elements using CSS, XPath, and text-based selectors
- [DOM Navigation](https://mintlify.wiki/D4Vinci/Scrapling/parsing/navigation.md): Navigate the HTML tree structure using parent, children, and sibling relationships
- [Data Extraction](https://mintlify.wiki/D4Vinci/Scrapling/parsing/extraction.md): Extract text, HTML, attributes, and structured data from elements
- [Adaptive Scraping](https://mintlify.wiki/D4Vinci/Scrapling/parsing/adaptive-scraping.md): Build resilient scrapers that automatically adapt to website changes
- [Getting Started with Spiders](https://mintlify.wiki/D4Vinci/Scrapling/spiders/getting-started.md): Learn how to build concurrent, multi-page crawlers with Scrapling's spider system
- [Spider Architecture](https://mintlify.wiki/D4Vinci/Scrapling/spiders/architecture.md): Understanding the components and data flow of Scrapling's spider framework
- [Requests & Responses](https://mintlify.wiki/D4Vinci/Scrapling/spiders/requests-responses.md): Working with Request and Response objects in Scrapling spiders
- [Multi-Session Support](https://mintlify.wiki/D4Vinci/Scrapling/spiders/sessions.md): Using multiple fetcher sessions simultaneously in Scrapling spiders
- [Advanced Features](https://mintlify.wiki/D4Vinci/Scrapling/spiders/advanced-features.md): Concurrency control, pause/resume, streaming, lifecycle hooks, and logging in Scrapling spiders
- [Pause & Resume with Checkpoints](https://mintlify.wiki/D4Vinci/Scrapling/spiders/pause-resume.md): Checkpoint-based pause/resume system for long-running crawls in Scrapling spiders
- [CLI Overview](https://mintlify.wiki/D4Vinci/Scrapling/cli/overview.md): Command-line interface for web scraping operations
- [Interactive Shell](https://mintlify.wiki/D4Vinci/Scrapling/cli/interactive-shell.md): Interactive console for web scraping exploration
- [Extract Commands](https://mintlify.wiki/D4Vinci/Scrapling/cli/extract-commands.md): Fetch and extract web content from the command line
- [MCP Server](https://mintlify.wiki/D4Vinci/Scrapling/ai/mcp-server.md): Model Context Protocol server for AI-powered web scraping
- [MCP Server Setup](https://mintlify.wiki/D4Vinci/Scrapling/ai/setup.md): Configure Scrapling's MCP server for AI assistants
- [MCP Capabilities](https://mintlify.wiki/D4Vinci/Scrapling/ai/capabilities.md): Tools and features available through Scrapling's MCP server
- [Anti-Bot Bypass Strategies](https://mintlify.wiki/D4Vinci/Scrapling/guides/anti-bot-bypass.md): Learn how to bypass anti-bot systems using Scrapling's StealthyFetcher
- [Bypassing Cloudflare Turnstile](https://mintlify.wiki/D4Vinci/Scrapling/guides/cloudflare-turnstile.md): Automatically solve Cloudflare Turnstile and Interstitial challenges
- [Handling Blocked Requests](https://mintlify.wiki/D4Vinci/Scrapling/guides/handling-blocked-requests.md): Detect, retry, and handle blocked requests in Scrapling
- [Performance Optimization](https://mintlify.wiki/D4Vinci/Scrapling/guides/performance-optimization.md): Speed up your web scraping with performance best practices
- [Error Handling Best Practices](https://mintlify.wiki/D4Vinci/Scrapling/guides/error-handling.md): Comprehensive guide to handling errors in Scrapling
- [Migrating from BeautifulSoup](https://mintlify.wiki/D4Vinci/Scrapling/tutorials/migrating-from-beautifulsoup.md): Complete guide to migrating your BeautifulSoup code to Scrapling
- [Migrating from Scrapy](https://mintlify.wiki/D4Vinci/Scrapling/tutorials/migrating-from-scrapy.md): Complete guide to migrating your Scrapy spiders to Scrapling
- [Building Your First Spider](https://mintlify.wiki/D4Vinci/Scrapling/tutorials/building-first-spider.md): Step-by-step tutorial to create your first web crawler with Scrapling
- [Real-World Scraping Examples](https://mintlify.wiki/D4Vinci/Scrapling/tutorials/real-world-examples.md): Production-ready examples for common web scraping scenarios
- [Fetcher & AsyncFetcher](https://mintlify.wiki/D4Vinci/Scrapling/api/fetcher.md): HTTP-based fetchers for basic GET, POST, PUT, and DELETE requests
- [StealthyFetcher](https://mintlify.wiki/D4Vinci/Scrapling/api/stealthy-fetcher.md): Completely stealthy browser-based fetcher built on Chromium
- [DynamicFetcher](https://mintlify.wiki/D4Vinci/Scrapling/api/dynamic-fetcher.md): Browser-based fetcher with many options to fetch websites through Chromium
- [Fetcher Sessions](https://mintlify.wiki/D4Vinci/Scrapling/api/fetcher-sessions.md): Session managers for persistent connections and browser contexts
- [Selector](https://mintlify.wiki/D4Vinci/Scrapling/api/selector.md): Main class for parsing and selecting HTML elements
- [Selectors](https://mintlify.wiki/D4Vinci/Scrapling/api/selectors.md): A list-like container for multiple Selector objects
- [Response](https://mintlify.wiki/D4Vinci/Scrapling/api/response.md): Unified response object returned by all Scrapling engines
- [AttributesHandler](https://mintlify.wiki/D4Vinci/Scrapling/api/attributes-handler.md): Read-only mapping for element attributes with enhanced functionality
- [TextHandler](https://mintlify.wiki/D4Vinci/Scrapling/api/text-handler.md): Enhanced string class with additional text processing functionality
- [Spider](https://mintlify.wiki/D4Vinci/Scrapling/api/spider.md): Abstract base class for creating web spiders in Scrapling
- [Request](https://mintlify.wiki/D4Vinci/Scrapling/api/request.md): Represents a request to be processed by a Spider
- [CrawlerEngine](https://mintlify.wiki/D4Vinci/Scrapling/api/crawler-engine.md): Orchestrates the crawling process for Scrapling spiders
- [SessionManager](https://mintlify.wiki/D4Vinci/Scrapling/api/session-manager.md): Manages multiple session instances for Scrapling spiders
- [CrawlResult](https://mintlify.wiki/D4Vinci/Scrapling/api/crawl-result.md): Container for spider crawl results and statistics
- [ProxyRotator](https://mintlify.wiki/D4Vinci/Scrapling/api/proxy-rotator.md): Thread-safe proxy rotation with pluggable strategies
- [Custom Types](https://mintlify.wiki/D4Vinci/Scrapling/api/custom-types.md): Custom text handling types in Scrapling