🤖 AI Insights Daily

An automated platform that discovers and showcases trending AI tools and news. Combines Python for smart data collection with a modern Next.js website.

🌐 Live Website

🔗 Link to Website: https://ai-resources-and-tools.vercel.app

• 🌍 Live Updates: New content every day
• 📱 Responsive: Works perfectly on all devices
• 🎨 Modern Design: Clean, professional interface
• ⚡ Fast: Optimized for speed

🚀 What It Does

🧠 Smart Discovery

• Finds trending AI tools automatically from 3 primary sources
• Uses comprehensive AI keyword filtering system
• Sophisticated trending score algorithm with engagement metrics
• Advanced quality filtering and deduplication
• Sources: Reddit (10+ subreddits), GitHub (trending), Google News RSS

📊 Daily Content

• Daily Digest: 3-5 top AI tools with trending scores
• Tools Directory: Complete categorized catalog (100+ tools)
• News Updates: Latest AI news with priority scoring
• Website: Modern Next.js presentation with real-time data

🔄 How It Works

┌─────────────────┐    ┌─────────────────┐    ┌─────────────────┐
│   Multi-Source  │    │  Advanced AI    │    │  Structured &   │
│   Discovery     │    │  Processing     │    │  Ranked Output  │
│                 │    │                 │    │                 │
│ • Reddit API    │──▶│ • AI Keyword     │──▶│ • Daily Tools   │
│   (10+ subs)    │    │   Filtering     │    │   Digest        │
│ • GitHub API    │    │ • Trending      │    │ • News Updates  │
│   (trending)    │    │   Scoring       │    │ • Tools Directory│
│ • News RSS      │    │ • Quality       │    │ • Website Data  │
│   (Google News) │    │   Filtering     │    │ • Master CSV    │
└─────────────────┘    └─────────────────┘    └─────────────────┘
         │                       │                       │
         ▼                       ▼                       ▼
   ┌─────────────┐        ┌─────────────┐        ┌─────────────┐
   │   Cache     │        │   Auto-     │        │   Auto-     │
   │ Management  │        │   Categorize│        │   Deploy    │
   └─────────────┘        └─────────────┘        └─────────────┘

Daily Schedule: Runs automatically at 7:30 AM IST via GitHub Actions

🛠️ Quick Commands

# Install
pip install -e .

# Generate daily tools
daily-tools

# Update news
update-news

# Generate tools directory
tools-directory

# Prepare website data
prepare-website-data

# Manage keywords
keyword-manager

# Test system
test-keywords

# Auto-discover tools
discover-tools

🔧 Technical Workflow

1. Discovery Phase

• Reddit API: Monitors 10+ AI subreddits (artificial, MachineLearning, AINews, OpenAI, etc.)
• GitHub API: Scrapes trending repositories for AI tools and libraries
• News RSS: Aggregates AI news from Google News with keyword expansion
• Additional Sources: Product Hunt, Hugging Face, Futurepedia (configured but not in main pipeline)

2. Processing Phase

• AI Keyword Filtering: Comprehensive AI-related keyword matching
• Trending Scoring: Algorithm considers engagement, relevance, and trending indicators
• Quality Filtering: Removes duplicates, non-tool content, and irrelevant items
• Auto-Categorization: Categorizes tools into 9 categories (Text/Chat, Code/Dev, etc.)
• Cache Management: Prevents re-processing same items with JSON caching

3. Output Generation

• Daily Digest: artifacts/ai-tools-daily.md with 3-5 top tools
• News Updates: artifacts/blogs-and-news.md with 10 top news
• Tools Directory: artifacts/ai-tools-directory.md with full catalog
• Master Database: data/master_resources.csv with all tools
• Website Data: website/src/data/content.ts for Next.js frontend

📁 Project Structure

auto-news/
├── artifacts/              # Generated content
│   ├── ai-tools-daily.md   # Daily tools digest
│   ├── blogs-and-news.md   # News aggregation
│   └── ai-tools-directory.md # Tools directory
├── data/                   # Config & cache
│   ├── cache/              # Performance cache
│   ├── config/             # Configuration files
│   └── master_resources.csv # Master tools database
├── src/                    # Python backend
│   ├── scripts/            # Main automation scripts
│   └── utils/              # Utility modules
├── website/                # Next.js frontend
│   ├── src/                # React components
│   └── public/             # Static assets
├── docs/                   # Documentation
└── .github/workflows/      # GitHub Actions automation

🚀 Quick Start

For Users

Visit the website to browse daily AI tools and news!

For Developers

# Backend
pip install -e .
daily-tools

# Frontend
cd website
npm install
npm run dev

🤖 Automation Pipeline

The system runs automatically every day at 7:30 AM IST via GitHub Actions:

1. Daily Tools Discovery (daily-tools)

   • Discovers 3-5 trending AI tools
   • Applies trending score algorithm
   • Updates master database

2. News Aggregation (update-news)

   • Fetches latest AI news
   • Applies priority scoring
   • Generates daily news digest

3. Tools Directory (tools-directory)

   • Generates complete tools catalog
   • Organizes by categories
   • Updates directory markdown

4. Website Data (prepare-website-data)

   • Processes all content
   • Generates TypeScript data
   • Updates website automatically

5. Deployment

   • Commits changes to Git
   • Deploys to Vercel
   • Updates live website

📊 Current Status

• Version: 3.1.0
• Python: 3.11+
• Next.js: 15.3.4
• React: 19.0.0
• Daily Tools: 3-5 trending AI tools
• News Articles: 10 top AI news daily
• Tools Database: 100+ curated AI tools
• Automation: Fully automated daily updates

🤝 Contributing

We welcome contributions! Feel free to:

• Report bugs
• Suggest features
• Submit pull requests
• Improve docs

📄 License

MIT License - see LICENSE file.

---

Made with ❤️ by the AI Insights Daily team