​
ScrapeGraphAI

class ScrapeGraphAI:
ScrapeGraphAI allows you to perform AI-powered web scraping and searching. Parameters:
  • api_key (Optional[str]): API key for authenticating with the ScrapeGraphAI API.
  • References:
  • https: //scrapegraph.ai/

​
init

def __init__(self, api_key: Optional[str] = None):

def search(self, user_prompt: str):
Perform an AI-powered web search using ScrapeGraphAI. Parameters:
  • user_prompt (str): The search query or instructions.
Returns: Dict[str, Any]: The search results including answer and reference URLs.

​
scrape

def scrape(
    self,
    website_url: str,
    user_prompt: str,
    website_html: Optional[str] = None
):
Perform AI-powered web scraping using ScrapeGraphAI. Parameters:
  • website_url (str): The URL to scrape.
  • user_prompt (str): Instructions for what data to extract.
  • website_html (Optional[str]): Optional HTML content to use instead of fetching from the URL.
Returns: Dict[str, Any]: The scraped data including request ID and result.

​
close

def close(self):
Close the ScrapeGraphAI client connection.