Bright Data
Search, Crawl and Scrape any site, at scale, without getting blocked
1.0.2Bright Data is a web data platform that enables large-scale scraping, searching, and structured data extraction without getting blocked. The Arcade toolkit exposes Bright Data's proxy and dataset infrastructure through three focused tools.
Capabilities
- Web scraping: Fetch any publicly accessible webpage and receive clean Markdown output, suitable for LLM ingestion or content pipelines.
- Search engine queries: Run searches across Google, Bing, or Yandex with control over result count, search type (web, images, etc.), and country targeting.
- Structured data feeds: Extract pre-structured JSON from major platforms — Amazon, LinkedIn, Instagram, Facebook, X, YouTube, Zillow, Booking.com, and ZoomInfo — without writing custom parsers.
Secrets
This toolkit requires no OAuth flow; authentication is handled entirely via secrets passed at runtime.
BRIGHTDATA_API_KEY
Your Bright Data API key, used to authenticate all requests. Obtain it from the Bright Data dashboard under Account Settings → API Token. A paid Bright Data account is required; the key authorizes billing against your account for proxy and dataset usage.
BRIGHTDATA_ZONE
A Bright Data "zone" identifier that specifies which proxy zone or dataset zone to route requests through. Zones are created and named in the Bright Data control panel under Proxies & Scraping Infrastructure. Each zone has its own configuration (proxy type, country targeting, concurrency limits). Use the exact zone name string shown in your dashboard.
For guidance on storing secrets in Arcade, see the Arcade secrets documentation. You can manage your saved secrets at https://api.arcade.dev/dashboard/auth/secrets.
Available tools(3)
| Tool name | Description | Secrets | |
|---|---|---|---|
Scrape a webpage and return content in Markdown format using Bright Data.
Examples:
scrape_as_markdown("https://example.com") -> "# Example Page
Content..."
scrape_as_markdown("https://news.ycombinator.com") -> "# Hacker News
..."
| 2 | ||
Search using Google, Bing, or Yandex with advanced parameters using Bright Data.
Examples:
search_engine("climate change") -> "# Search Results
## Climate Change - Wikipedia
..."
search_engine("Python tutorials", engine="bing", num_results=5) -> "# Bing Results
..."
search_engine("cats", search_type="images", country_code="us") -> "# Image Results
..."
| 2 | ||
Extract structured data from various websites like LinkedIn, Amazon, Instagram, etc.
NEVER MAKE UP LINKS. IF LINKS ARE NEEDED, FIND THEM WITH A WEB SEARCH FIRST.
Supported source types:
- amazon_product, amazon_product_reviews
- linkedin_person_profile, linkedin_company_profile
- zoominfo_company_profile
- instagram_profiles, instagram_posts, instagram_reels, instagram_comments
- facebook_posts, facebook_marketplace_listings, facebook_company_reviews
- x_posts
- zillow_properties_listing
- booking_hotel_listings
- youtube_videos
Examples:
web_data_feed("amazon_product", "https://amazon.com/dp/B08N5WRWNW")
-> "{"title": "Product Name", ...}"
web_data_feed("linkedin_person_profile", "https://linkedin.com/in/johndoe")
-> "{"name": "John Doe", ...}"
web_data_feed(
"facebook_company_reviews", "https://facebook.com/company", num_of_reviews=50
) -> "[{"review": "...", ...}]" | 1 |