[New RM] Add Tavily Search Support (TavilySearchRM)

[Rakshitha-Ireddi]

Description

This PR adds support for Tavily Search as a retrieval module (TavilySearchRM) in STORM. Tavily is a search engine optimized for LLMs and agents, providing high-quality search results with raw content extraction.

Changes

• New Class: Added TavilySearchRM to knowledge_storm/rm.py.
  • Inherits from dspy.Retrieve.
  • Supports retrieving k top results with snippets and raw content.
  • Requires TAVILY_API_KEY environment variable.
• Example Script: Added examples/run_storm_with_tavily.py to demonstrate how to use STORM with Tavily.
• Tests: Added knowledge_storm/test_tavily.py for unit testing the new class.

How to Test

1. Set your Tavily API Key:

   export TAVILY_API_KEY="tvly-... ```
   

2. Run the unit test:

python -m knowledge_storm.test_tavily

3. Run the example script:

python examples/run_storm_with_tavily.py --do-research --do-generate-outline --do-generate-article --do-polish-article

Work done by

• Ireddi Rakshitha
• Yaswanth Devavarapu