Crawl4AI

class Crawl4AI:

Class for converting websites into LLM-ready data.

This class uses asynchronous crawling with CSS selectors or LLM-based extraction to convert entire websites into structured data.

References: https://docs.crawl4ai.com/

init

def __init__(self):