Skip to main content

SearchToolkit

class SearchToolkit(BaseToolkit):
A class representing a toolkit for web search. This class provides methods for searching information on the web using search engines like Google, DuckDuckGo, Wikipedia and Wolfram Alpha, Brave.

init

def __init__(
    self,
    timeout: Optional[float] = None,
    exclude_domains: Optional[List[str]] = None
):
Initializes the SearchToolkit. Parameters:
  • timeout (float): Timeout for API requests in seconds. (default: :obj:None)
  • exclude_domains (Optional[List[str]]): List of domains to exclude from search results. Currently only supported by the search_google function. (default: :obj:None)

search_serper

def search_serper(
    self,
    query: str,
    page: int = 10,
    location: str = 'United States'
):
Use Serper.dev API to perform Google search. Parameters:
  • query (str): The search query.
  • page (int): The page number of results to retrieve. (default: :obj:10)
  • location (str): The location for the search results. (default: :obj:"United States")
Returns: Dict[str, Any]: The search result dictionary containing ‘organic’, ‘peopleAlsoAsk’, etc.

search_wiki

def search_wiki(self, entity: str):
Search the entity in WikiPedia and return the summary of the required page, containing factual information about the given entity. Parameters:
  • entity (str): The entity to be searched.
Returns: str: The search result. If the page corresponding to the entity exists, return the summary of this entity in a string.

search_linkup

def search_linkup(
    self,
    query: str,
    depth: Literal['standard', 'deep'] = 'standard',
    output_type: Literal['searchResults', 'sourcedAnswer', 'structured'] = 'searchResults',
    structured_output_schema: Optional[str] = None
):
Search for a query in the Linkup API and return results in various formats. Parameters:
  • query (str): The search query.
  • depth (Literal["standard", "deep"]): The depth of the search. “standard” for a straightforward search, “deep” for a more comprehensive search.
  • output_type (Literal["searchResults", "sourcedAnswer", "structured"]): The type of output: - “searchResults” for raw search results, - “sourcedAnswer” for an answer with supporting sources, - “structured” for output based on a provided schema.
  • structured_output_schema (Optional[str]): If output_type is “structured”, specify the schema of the output. Must be a string representing a valid object JSON schema.
Returns: Dict[str, Any]: A dictionary representing the search result. The structure depends on the output_type. If an error occurs, returns an error message.

search_duckduckgo

def search_duckduckgo(
    self,
    query: str,
    source: str = 'text',
    number_of_result_pages: int = 10
):
Use DuckDuckGo search engine to search information for the given query. This function queries the DuckDuckGo API for related topics to the given search term. The results are formatted into a list of dictionaries, each representing a search result. Parameters:
  • query (str): The query to be searched.
  • source (str): The type of information to query (e.g., “text”, “images”, “videos”). Defaults to “text”.
  • number_of_result_pages (int): The number of result pages to retrieve. Adjust this based on your task - use fewer results for focused searches and more for comprehensive searches. (default: :obj:10)
Returns: List[Dict[str, Any]]: A list of dictionaries where each dictionary represents a search result.

search_brave

def search_brave(
    self,
    q: str,
    country: str = 'US',
    search_lang: str = 'en',
    ui_lang: str = 'en-US',
    offset: int = 0,
    safesearch: str = 'moderate',
    freshness: Optional[str] = None,
    text_decorations: bool = True,
    spellcheck: bool = True,
    result_filter: Optional[str] = None,
    goggles_id: Optional[str] = None,
    units: Optional[str] = None,
    extra_snippets: Optional[bool] = None,
    summary: Optional[bool] = None,
    number_of_result_pages: int = 10
):
This function queries the Brave search engine API and returns a dictionary, representing a search result. See https://api.search.brave.com/app/documentation/web-search/query for more details. Parameters:
  • q (str): The user’s search query term. Query cannot be empty. Maximum of 400 characters and 50 words in the query.
  • country (str): The search query country where results come from. The country string is limited to 2 character country codes of supported countries. For a list of supported values, see Country Codes. (default: :obj:US )
  • search_lang (str): The search language preference. Use ONLY these exact values, NOT standard ISO codes: ‘ar’, ‘eu’, ‘bn’, ‘bg’, ‘ca’, ‘zh-hans’, ‘zh-hant’, ‘hr’, ‘cs’, ‘da’, ‘nl’, ‘en’, ‘en-gb’, ‘et’, ‘fi’, ‘fr’, ‘gl’, ‘de’, ‘gu’, ‘he’, ‘hi’, ‘hu’, ‘is’, ‘it’, ‘jp’, ‘kn’, ‘ko’, ‘lv’, ‘lt’, ‘ms’, ‘ml’, ‘mr’, ‘nb’, ‘pl’, ‘pt-br’, ‘pt-pt’, ‘pa’, ‘ro’, ‘ru’, ‘sr’, ‘sk’, ‘sl’, ‘es’, ‘sv’, ‘ta’, ‘te’, ‘th’, ‘tr’, ‘uk’, ‘vi’.
  • ui_lang (str): User interface language preferred in response.
  • Format: ‘<language_code>-<country_code>’. Common examples: ‘en-US’, ‘en-GB’, ‘jp-JP’, ‘zh-hans-CN’, ‘zh-hant-TW’, ‘de-DE’, ‘fr-FR’, ‘es-ES’, ‘pt-BR’, ‘ru-RU’, ‘ko-KR’.
  • offset (int): The zero based offset that indicates number of search results per page (count) to skip before returning the result. The maximum is 9. The actual number delivered may be less than requested based on the query. In order to paginate results use this parameter together with count. For example, if your user interface displays 20 search results per page, set count to 20 and offset to 0 to show the first page of results. To get subsequent pages, increment offset by 1 (e.g. 0, 1, 2). The results may overlap across multiple pages.
  • safesearch (str): Filters search results for adult content. The following values are supported: - ‘off’: No filtering is done. - ‘moderate’: Filters explicit content, like images and videos, but allows adult domains in the search results. - ‘strict’: Drops all adult content from search results.
  • freshness (Optional[str]): Filters search results by when they were
  • discovered: - ‘pd’: Discovered within the last 24 hours. - ‘pw’: Discovered within the last 7 Days. - ‘pm’: Discovered within the last 31 Days. - ‘py’: Discovered within the last 365 Days. - ‘YYYY-MM-DDtoYYYY-MM-DD’: Timeframe is also supported by specifying the date range e.g. ‘2022-04-01to2022-07-30’.
  • text_decorations (bool): Whether display strings (e.g. result snippets) should include decoration markers (e.g. highlighting characters).
  • spellcheck (bool): Whether to spellcheck provided query. If the spellchecker is enabled, the modified query is always used for search. The modified query can be found in altered key from the query response model.
  • result_filter (Optional[str]): A comma delimited string of result types to include in the search response. Not specifying this parameter will return back all result types in search response where data is available and a plan with the corresponding option is subscribed. The response always includes query and type to identify any query modifications and response type respectively. Available result filter values are: - ‘discussions’ - ‘faq’ - ‘infobox’ - ‘news’ - ‘query’ - ‘summarizer’ - ‘videos’ - ‘web’ - ‘locations’
  • goggles_id (Optional[str]): Goggles act as a custom re-ranking on top of Brave’s search index. For more details, refer to the Goggles repository.
  • units (Optional[str]): The measurement units. If not provided, units are derived from search country. Possible values are: - ‘metric’: The standardized measurement system - ‘imperial’: The British Imperial system of units.
  • extra_snippets (Optional[bool]): A snippet is an excerpt from a page you get as a result of the query, and extra_snippets allow you to get up to 5 additional, alternative excerpts. Only available under Free AI, Base AI, Pro AI, Base Data, Pro Data and Custom plans.
  • summary (Optional[bool]): This parameter enables summary key generation in web search results. This is required for summarizer to be enabled.
  • number_of_result_pages (int): The number of result pages to retrieve. Adjust this based on your task - use fewer results for focused searches and more for comprehensive searches. (default: :obj:10)
Returns: Dict[str, Any]: A dictionary representing a search result.

search_google

def search_google(
    self,
    query: str,
    search_type: str = 'web',
    number_of_result_pages: int = 10,
    start_page: int = 1
):
Use Google search engine to search information for the given query. Parameters:
  • query (str): The query to be searched.
  • search_type (str): The type of search to perform. Must be either “web” for web pages or “image” for image search. Any other value will raise a ValueError. (default: “web”)
  • number_of_result_pages (int): The number of result pages to retrieve. Must be a positive integer between 1 and 10. Google Custom Search API limits results to 10 per request. If a value greater than 10 is provided, it will be capped at 10 with a warning. Adjust this based on your task - use fewer results for focused searches and more for comprehensive searches. (default: :obj:10)
  • start_page (int): The result page to start from. Must be a positive integer (>= 1). Use this for pagination - e.g., start_page=1 for results 1-10, start_page=11 for results 11-20, etc. This allows agents to check initial results and continue searching if needed. (default: :obj:1)
Returns: List[Dict[str, Any]]: A list of dictionaries where each dictionary represents a search result. For web search, each dictionary contains:
  • ‘result_id’: A number in order.
  • ‘title’: The title of the website.
  • ‘description’: A brief description of the website.
  • ‘long_description’: More detail of the website.
  • ‘url’: The URL of the website.
For image search, each dictionary contains:
  • ‘result_id’: A number in order.
  • ‘title’: The title of the image.
  • ‘image_url’: The URL of the image.
  • ‘display_link’: The website hosting the image.
  • ‘context_url’: The URL of the page containing the image.
  • ‘width’: Image width in pixels (if available).
  • ‘height’: Image height in pixels (if available).
Example web result: \{ 'result_id': 1, 'title': 'OpenAI', 'description': 'An organization focused on ensuring that artificial general intelligence benefits all of humanity.', 'long_description': 'OpenAI is a non-profit artificial intelligence research company. Our goal is to advance digital intelligence in the way that is most likely to benefit humanity as a whole', 'url': 'https://www.openai.com' \} Example image result: \{ 'result_id': 1, 'title': 'Beautiful Sunset', 'image_url': 'https://example.com/image.jpg', 'display_link': 'example.com', 'context_url': 'https://example.com/page.html', 'width': 800, 'height': 600 \}

search_tavily

def search_tavily(
    self,
    query: str,
    number_of_result_pages: int = 10,
    **kwargs
):
Use Tavily Search API to search information for the given query. Parameters:
  • query (str): The query to be searched.
  • number_of_result_pages (int): The number of result pages to retrieve. Adjust this based on your task - use fewer results for focused searches and more for comprehensive searches. (default: :obj:10) **kwargs: Additional optional parameters supported by Tavily’s API: - search_depth (str): “basic” or “advanced” search depth. - topic (str): The search category, e.g., “general” or “news.” - days (int): Time frame in days for news-related searches. - max_results (int): Max number of results to return (overrides num_results). See https://docs.tavily.com/docs/python-sdk/tavily-search/ api-reference for details.
Returns: List[Dict[str, Any]]: A list of dictionaries representing search results. Each dictionary contains:
  • ‘result_id’ (int): The result’s index.
  • ‘title’ (str): The title of the result.
  • ‘description’ (str): A brief description of the result.
  • ‘long_description’ (str): Detailed information, if available.
  • ‘url’ (str): The URL of the result.
  • ‘content’ (str): Relevant content from the search result.
  • ‘images’ (list): A list of related images (if include_images is True).
  • ‘published_date’ (str): Publication date for news topics (if available).

search_bocha

def search_bocha(
    self,
    query: str,
    freshness: str = 'noLimit',
    summary: bool = False,
    page: int = 1,
    number_of_result_pages: int = 10
):
Query the Bocha AI search API and return search results. Parameters:
  • query (str): The search query.
  • freshness (str): Time frame filter for search results. Default is “noLimit”. Options include: - ‘noLimit’: no limit (default). - ‘oneDay’: past day. - ‘oneWeek’: past week. - ‘oneMonth’: past month. - ‘oneYear’: past year.
  • summary (bool): Whether to include text summaries in results. Default is False.
  • page (int): Page number of results. Default is 1.
  • number_of_result_pages (int): The number of result pages to retrieve. Adjust this based on your task - use fewer results for focused searches and more for comprehensive searches. (default: :obj:10)
Returns: Dict[str, Any]: A dictionary containing search results, including web pages, images, and videos if available. The structure follows the Bocha AI search API response format.

search_baidu

def search_baidu(self, query: str, number_of_result_pages: int = 10):
Search Baidu using web scraping to retrieve relevant search results. This method queries Baidu’s search engine and extracts search results including titles, descriptions, and URLs. Parameters:
  • query (str): Search query string to submit to Baidu.
  • number_of_result_pages (int): The number of result pages to retrieve. Adjust this based on your task - use fewer results for focused searches and more for comprehensive searches. (default: :obj:10)
Returns: Dict[str, Any]: A dictionary containing search results or error message.

search_bing

def search_bing(self, query: str, number_of_result_pages: int = 10):
Use Bing search engine to search information for the given query. This function queries the Chinese version of Bing search engine (cn. bing.com) using web scraping to retrieve relevant search results. It extracts search results including titles, snippets, and URLs. This function is particularly useful when the query is in Chinese or when Chinese search results are desired. Parameters:
  • query (str): The search query string to submit to Bing. Works best with Chinese queries or when Chinese results are preferred.
  • number_of_result_pages (int): The number of result pages to retrieve. Adjust this based on your task - use fewer results for focused searches and more for comprehensive searches. (default: :obj:10)
Returns: Dict ([str, Any]): A dictionary containing either:
  • ‘results’: A list of dictionaries, each with:
  • ‘result_id’: The index of the result.
  • ‘snippet’: A brief description of the search result.
  • ‘title’: The title of the search result.
  • ‘link’: The URL of the search result.
  • or ‘error’: An error message if something went wrong.

search_exa

def search_exa(
    self,
    query: str,
    search_type: Literal['auto', 'neural', 'keyword'] = 'auto',
    category: Optional[Literal['company', 'research paper', 'news', 'pdf', 'github', 'tweet', 'personal site', 'linkedin profile', 'financial report']] = None,
    include_text: Optional[List[str]] = None,
    exclude_text: Optional[List[str]] = None,
    use_autoprompt: bool = True,
    text: bool = False,
    number_of_result_pages: int = 10
):
Use Exa search API to perform intelligent web search with optional content extraction. Parameters:
  • query (str): The search query string.
  • search_type (Literal["auto", "neural", "keyword"]): The type of search to perform. “auto” automatically decides between keyword and neural search. (default: :obj:"auto")
  • category (Optional[Literal]): Category to focus the search on, such as “research paper” or “news”. (default: :obj:None)
  • include_text (Optional[List[str]]): Strings that must be present in webpage text. Limited to 1 string of up to 5 words. (default: :obj:None)
  • exclude_text (Optional[List[str]]): Strings that must not be present in webpage text. Limited to 1 string of up to 5 words. (default: :obj:None)
  • use_autoprompt (bool): Whether to use Exa’s autoprompt feature to enhance the query. (default: :obj:True)
  • text (bool): Whether to include webpage contents in results. (default: :obj:False)
  • number_of_result_pages (int): The number of result pages to retrieve. Must be between 1 and 100. Adjust this based on your task - use fewer results for focused searches and more for comprehensive searches. (default: :obj:10)
Returns: Dict[str, Any]: A dict containing search results and metadata:
  • requestId (str): Unique identifier for the request
  • autopromptString (str): Generated autoprompt if enabled
  • autoDate (str): Timestamp of autoprompt generation
  • resolvedSearchType (str): The actual search type used
  • results (List[Dict]): List of search results with metadata
  • searchType (str): The search type that was selected
  • costDollars (Dict): Breakdown of API costs

search_alibaba_tongxiao

def search_alibaba_tongxiao(
    self,
    query: str,
    time_range: Literal['OneDay', 'OneWeek', 'OneMonth', 'OneYear', 'NoLimit'] = 'NoLimit',
    industry: Optional[Literal['finance', 'law', 'medical', 'internet', 'tax', 'news_province', 'news_center']] = None,
    return_main_text: bool = False,
    return_markdown_text: bool = True,
    enable_rerank: bool = True,
    number_of_result_pages: int = 10
):
Query the Alibaba Tongxiao search API and return search results. A powerful search API optimized for Chinese language queries with features:
  • Enhanced Chinese language understanding
  • Industry-specific filtering (finance, law, medical, etc.)
  • Structured data with markdown formatting
  • Result reranking for relevance
  • Time-based filtering
Parameters:
  • query (str): The search query string (length >= 1 and <= 100).
  • time_range (Literal["OneDay", "OneWeek", "OneMonth", "OneYear", "NoLimit"]): Time frame filter for search results. (default: :obj:"NoLimit")
  • industry (Optional[Literal["finance", "law", "medical", "internet", "tax", "news_province", "news_center"]]): Industry-specific search filter. When specified, only returns results from sites in the specified industries. Multiple industries can be comma-separated. (default: :obj:None)
  • return_main_text (bool): Whether to include the main text of the webpage in results. (default: :obj:True)
  • return_markdown_text (bool): Whether to include markdown formatted content in results. (default: :obj:True)
  • enable_rerank (bool): Whether to enable result reranking. If response time is critical, setting this to False can reduce response time by approximately 140ms. (default: :obj:True)
  • number_of_result_pages (int): The number of result pages to retrieve. Adjust this based on your task - use fewer results for focused searches and more for comprehensive searches. (default: :obj:10)
Returns: Dict[str, Any]: A dictionary containing either search results with ‘requestId’ and ‘results’ keys, or an ‘error’ key with error message. Each result contains title, snippet, url and other metadata.

search_metaso

def search_metaso(
    self,
    query: str,
    page: int = 1,
    include_summary: bool = False,
    include_raw_content: bool = False,
    concise_snippet: bool = False,
    scope: Literal['webpage', 'document', 'scholar', 'image', 'video', 'podcast'] = 'webpage'
):
Perform a web search using the metaso.cn API. Parameters:
  • query (str): The search query string.
  • page (int): Page number. (default: :obj:1) (default: 1)
  • include_summary (bool): Whether to include summary in the result. (default: :obj:False)
  • include_raw_content (bool): Whether to include raw content in the result. (default: :obj:False)
  • concise_snippet (bool): Whether to return concise snippet. (default: :obj:False) scope (Literal[“webpage”, “document”, “scholar”, “image”, “video”, “podcast”]): Search scope. (default: :obj:"webpage")
Returns: Dict[str, Any]: Search results or error information.

search_serpapi

def search_serpapi(
    self,
    query: str,
    engine: str = 'google',
    location: str = 'Austin,Texas',
    google_domain: str = 'google.com',
    gl: str = 'us',
    search_lang: str = 'en',
    device: str = 'desktop',
    number_of_result_pages: int = 1,
    safe: str = 'off',
    filter: int = 0,
    custom_params: Optional[Dict[str, Any]] = None
):
Use SerpApi search engine to search information for the given query. SerpApi provides real-time search engine results from multiple search engines including Google, Bing, Yahoo, DuckDuckGo, Baidu, Yandex, and more. Parameters:
  • query (str): The search query string.
  • engine (str): Search engine to use. Supported engines include: ‘google’, ‘bing’, ‘yahoo’, ‘duckduckgo’, ‘baidu’, ‘yandex’, ‘youtube’, ‘ebay’, ‘amazon’, etc. (default: :obj:"google")
  • location (str): Location for localized search results. Can be a city, state, country, or coordinates. (default: :obj:"Austin,Texas")
  • google_domain (str): Google domain to use (e.g., ‘google.com’, ‘google.co.uk’). Only applicable for Google engine. (default: :obj:"google.com")
  • gl (str): Country code for localized results (e.g., ‘us’, ‘uk’, ‘ca’). Only applicable for Google engine. (default: :obj:"us")
  • search_lang (str): Language code for results (e.g., ‘en’, ‘es’, ‘fr’). Only applicable for Google engine. (default: :obj:"en")
  • device (str): Device type: ‘desktop’, ‘tablet’, or ‘mobile’. (default: :obj:"desktop")
  • number_of_result_pages (int): Number of organic results to return. Adjust based on task needs. (default: :obj:1)
  • safe (str): Safe search level: ‘off’, ‘medium’, ‘high’, ‘active’. (default: :obj:"off")
  • filter (int): Filter results: 0 (no filter), 1 (filter similar results). (default: :obj:0)
  • custom_params (Optional[Dict[str, Any]]): Additional custom parameters to pass to SerpApi. (default: :obj:None)
Returns: Dict[str, Any]: A dictionary containing search results:
  • ‘results’: List of organic search results, each containing:
  • ‘title’: The title of the search result
  • ‘link’: The URL of the search result
  • ‘snippet’: The description snippet
  • ‘keywords’: Highlighted keywords in the snippet
  • ‘source’: The source of the result
  • ‘error: Error if any

get_tools

def get_tools(self):
Returns: List[FunctionTool]: A list of FunctionTool objects representing the functions in the toolkit.
def tavily_search(self, *args, **kwargs):
Deprecated: Use search_tavily instead for consistency with other search methods.