SIBRA Email Scraper

SIBRA Email Scraper is a high-performance, asynchronous web crawler designed to scrape and extract valid email addresses from websites. It supports targeting specific direct URLs or searching and crawling lead lists using keyword search queries via Bing, Yahoo, and DuckDuckGo.

The application contains both a responsive, modern Streamlit Web Dashboard and a fallback command line interface.

Key Features

• Asynchronous Concurrent Engine: Built on Python asyncio and aiohttp to perform non-blocking HTTP requests. This allows the crawler to fetch hundreds of pages concurrently for high throughput.
• Interactive Web Dashboard: Features a responsive, glassmorphic layout developed with Streamlit. Comes with built-in dark and light theme toggles, real-time log streaming, and dynamic metrics cards.
• Automated Lead Generation: Queries multiple search engines (Bing, Yahoo, and DuckDuckGo) across multiple result pages to discover and compile unique root domain targets matching your keywords.
• Zero-False-Positive Validation: Filters out placeholder domains (e.g. contoh.com, example.com), common template emails, web framework scripts, assets, and trailing image extensions.
• De-obfuscation Routines: Identifies and decodes obfuscated email structures found in page HTML (such as name[at]domain.com or name(at)domain.dot.com).
• Flexible Export Formats: Offers one-click downloads of extracted lists into CSV sheets, Excel spreadsheets, and JSON files.
• Automatic Navigation Focus: Automatically switches focus from the active live terminal view to the results table once the crawl finishes.
• CLI Fallback Mode: Supports CLI-only environments for headless operation.

Prerequisites

• Python 3.11
• Dependent Python packages (listed in requirements.txt)

Installation

1. Clone the repository:

   git clone https://github.com/Irfan3006/emailscraper.git
   cd emailscraper

2. Install dependencies:

   pip install -r requirements.txt

Usage

Launching the Streamlit Web Interface

To start the dashboard, execute:

streamlit run app.py

Open http://localhost:8501 in your web browser.

Launching the CLI Tool

To execute the console command line interface, run:

python emailscraper.py

Credits

This project was developed by Irfan Syarifudin, the owner of Sibra Tech.

License

This project is licensed under the MIT License. See the LICENSE file for more information.