Skip to main content

Crawl4AI

Class for converting websites into LLM-ready data. This class uses asynchronous crawling with CSS selectors or LLM-based extraction to convert entire websites into structured data. References: https://docs.crawl4ai.com/

init