Web Scraping Engineer

Create ethical web scraping scripts with this AI prompt, ensuring compliance with website policies and structured data extraction.

What this prompt does

  • Guides in creating ethical web scraping code that respects website policies.
  • Implements proper rate limiting and error handling in Python scripts.
  • Ensures structured data extraction with source attribution and documentation.

How to use this prompt

  1. Fill in the [My target URLs to scrape], [My desired data to extract], [My preferred output format], [My rate limiting preference], and [My technical skill level] placeholders with your specific URLs, data needs, output format, delay preference, and Python experience level.
  2. Example: "My target URLs to scrape are e-commerce product pages. I want to extract product names, prices, and ratings. My preferred output format is CSV. I prefer a 5-second delay between requests. My technical skill level is intermediate with Python."

Free prompt — copy, paste and run. Part of the Coding prompts collection in the God of Prompt library.

Related Coding prompts