> ## Documentation Index
> Fetch the complete documentation index at: https://mintlify.com/D4Vinci/Scrapling/llms.txt
> Use this file to discover all available pages before exploring further.
# Introduction to Scrapling
> An adaptive web scraping framework that handles everything from a single request to a full-scale crawl
## Effortless Web Scraping for the Modern Web
Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl.
Its parser learns from website changes and automatically relocates your elements when pages update. Its fetchers bypass anti-bot systems like Cloudflare Turnstile out of the box. And its spider framework lets you scale up to concurrent, multi-session crawls with pause/resume and automatic proxy rotation — all in a few lines of Python.
**One library, zero compromises.**
## Quick Example
Get started with Scrapling in seconds:
```python Stealthy Fetcher theme={null}
from scrapling.fetchers import StealthyFetcher
StealthyFetcher.adaptive = True
# Fetch website under the radar!
page = StealthyFetcher.fetch('https://example.com', headless=True, network_idle=True)
# Scrape data that survives website design changes!
products = page.css('.product', auto_save=True)
# Later, if the website structure changes, pass `adaptive=True` to find them!
products = page.css('.product', adaptive=True)
```
```python HTTP Requests theme={null}
from scrapling.fetchers import Fetcher
# Fast HTTP requests with TLS fingerprinting
page = Fetcher.get('https://quotes.toscrape.com/', impersonate='chrome')
# Extract data with CSS selectors
quotes = page.css('.quote .text::text').getall()
```
```python Full Spider theme={null}
from scrapling.spiders import Spider, Response
class MySpider(Spider):
name = "demo"
start_urls = ["https://example.com/"]
async def parse(self, response: Response):
for item in response.css('.product'):
yield {"title": item.css('h2::text').get()}
MySpider().start()
```
## Key Features
Smart element tracking that relocates elements after website changes using intelligent similarity algorithms
Bypass Cloudflare Turnstile, CDP leaks, and other anti-bot systems out of the box with StealthyFetcher
Scrapy-like spider API with concurrent crawling, pause/resume, multi-session support, and streaming mode
Optimized performance outperforming most Python scraping libraries with 10x faster JSON serialization
Persistent sessions with FetcherSession, StealthySession, and DynamicSession for state management across requests
Interactive IPython shell, complete type hints, familiar BeautifulSoup/Scrapy-like API, and auto selector generation
## Three Powerful Ways to Scrape
### 1. HTTP Requests - Fast & Stealthy
Perfect for static pages and APIs. Impersonate browsers' TLS fingerprints and use HTTP/3:
```python theme={null}
from scrapling.fetchers import Fetcher, FetcherSession
with FetcherSession(impersonate='chrome') as session:
page = session.get('https://quotes.toscrape.com/', stealthy_headers=True)
quotes = page.css('.quote .text::text').getall()
```
### 2. Dynamic Loading - Full Browser Automation
For JavaScript-heavy sites using Playwright's Chromium:
```python theme={null}
from scrapling.fetchers import DynamicFetcher
page = DynamicFetcher.fetch(
'https://quotes.toscrape.com/',
headless=True,
disable_resources=True,
network_idle=True
)
data = page.css('.quote .text::text').getall()
```
### 3. Stealthy Fetching - Advanced Anti-Bot Bypass
Bypass Cloudflare and other protection systems:
```python theme={null}
from scrapling.fetchers import StealthyFetcher
page = StealthyFetcher.fetch(
'https://nopecha.com/demo/cloudflare',
solve_cloudflare=True,
headless=True
)
data = page.css('#padded_content a').getall()
```
## Why Choose Scrapling?
* 92% test coverage with full type hints
* Used daily by hundreds of web scrapers
* Memory efficient with optimized data structures
* Complete PyRight and MyPy validation
* CSS selectors, XPath, regex, and text-based search
* Smart element navigation (parent, sibling, child)
* Auto-generate robust selectors for any element
* Find similar elements automatically
* Built-in MCP server for AI-assisted scraping
* Interactive Web Scraping shell with IPython
* Extract content without writing code
* Convert curl requests to Scrapling
## Performance Benchmarks
Scrapling outperforms most Python scraping libraries:
| Library | Text Extraction (5000 elements) | vs Scrapling |
| -------------------- | ------------------------------- | ------------- |
| Scrapling | 2.02 ms | 1.0x |
| Parsel/Scrapy | 2.04 ms | 1.01x |
| Raw Lxml | 2.54 ms | 1.26x |
| PyQuery | 24.17 ms | \~12x slower |
| BeautifulSoup (lxml) | 1584.31 ms | \~784x slower |
See the full [benchmarks](https://github.com/D4Vinci/Scrapling#performance-benchmarks) for detailed methodology and additional comparisons.
## Next Steps
Install Scrapling and set up browsers
Get up and running in minutes
Learn which fetcher fits your use case
Scale up to full crawling