spider 2.22.8

The fastest web crawler written in Rust.
Documentation

spider

There is very little structured metadata to build this page from currently. You should check the main library docs, readme, or Cargo.toml in case the author documented the features in them.

This version has 62 feature flags, 19 of them enabled by default.

default

balance (default)

cookies (default)

disk_native_tls (default)

encoding (default)

This feature flag does not enable additional features.

reqwest_native_tls_native_roots (default)

string_interner_buffer_backend (default)

sync (default)

ua_generator (default)

disk (default)

adblock

cache

cache_chrome_hybrid

cache_mem

cache_openai

cache_request

chrome

chrome_cpu

chrome_headed

chrome_headless_new

chrome_intercept

chrome_screenshot

chrome_stealth

chrome_store_page

control

This feature flag does not enable additional features.

cowboy

This feature flag does not enable additional features.

cron

decentralized

decentralized_headers

disk_aws

flexbuffers

fs

full_resources

This feature flag does not enable additional features.

glob

headers

inline-more

This feature flag does not enable additional features.

jemalloc

openai

openai_slim_fit

This feature flag does not enable additional features.

real_browser

regex

This feature flag does not enable additional features.

remote_addr

This feature flag does not enable additional features.

reqwest_hickory_dns

reqwest_json

reqwest_multipart

reqwest_native_tls

reqwest_native_tls_alpn

reqwest_native_tls_manual_roots

reqwest_native_tls_vendored

reqwest_native_tls_webpki_roots

reqwest_rustls_tls

serde

sitemap

smart

socks

spoof

string_interner_bucket_backend

string_interner_string_backend

tikv-jemallocator

time

This feature flag does not enable additional features.

tokio_io_std

tracing