Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
434f1d2
chore: restructure optional dependencies and optimize pyright config
HC-ONLINE Feb 20, 2026
ae4a160
chore: skip import of FastAPI and python-multipart if not available f…
HC-ONLINE Feb 20, 2026
9149024
chore: update CI workflow to install both dev and api dependencies fo…
HC-ONLINE Feb 20, 2026
d61729a
chore: restructure optional dependencies and optimize pyright config
HC-ONLINE Feb 20, 2026
6a68f0a
chore: skip import of FastAPI and python-multipart if not available f…
HC-ONLINE Feb 20, 2026
6fa8dc7
chore: update CI workflow to install both dev and api dependencies fo…
HC-ONLINE Feb 20, 2026
7cb361f
Merge branch 'dev-api' of https://github.com/HC-ONLINE/CiberWebScan i…
HC-ONLINE Feb 20, 2026
537c70d
fix: update timestamp field to use timezone-aware datetime in API res…
HC-ONLINE Feb 20, 2026
0f594a7
feat: implement request logging and rate limiting middleware for API
HC-ONLINE Feb 21, 2026
33dc4c7
feat: add health check endpoints and corresponding unit tests
HC-ONLINE Mar 2, 2026
830b9c0
feat: add API configuration models for authentication and rate limiting
HC-ONLINE Mar 2, 2026
56ecca7
refactor: remove unused JWT settings and access control from APIAuthC…
HC-ONLINE Mar 2, 2026
a54dad8
feat: add authentication module and endpoints for API key management
HC-ONLINE Mar 2, 2026
759a7c0
feat: implement main FastAPI application with middleware and routing …
HC-ONLINE Mar 16, 2026
0ae8707
feat: enhance configuration models with new request and response types
HC-ONLINE Mar 16, 2026
1bdcf17
feat: add configuration management endpoints and corresponding unit t…
HC-ONLINE Mar 16, 2026
84ce73b
feat: refactor error handling and include configuration router in Fas…
HC-ONLINE Mar 16, 2026
c24cabf
feat: enhance API request and response models with new fields and val…
HC-ONLINE Mar 18, 2026
81f6622
feat: update health check endpoints to use HealthCheckResponse model
HC-ONLINE Mar 18, 2026
065e27a
feat: enhance request models with new fields for export options and i…
HC-ONLINE Mar 19, 2026
8c673f4
feat: add scraping endpoints for single and batch URL processing
HC-ONLINE Mar 24, 2026
e1ab6b5
refactor: change cve_sources type from list to Sequence
HC-ONLINE Mar 24, 2026
1465828
feat: add security analysis endpoint for URL analysis with detailed o…
HC-ONLINE Mar 24, 2026
39e8136
feat: add attack endpoint for URL attacks with configurable options
HC-ONLINE Mar 27, 2026
278a82e
feat: add unit tests for API endpoints including analyze, attack, aut…
HC-ONLINE Mar 27, 2026
fc4339c
feat: add download token and URL fields to APIResponse; introduce Dow…
HC-ONLINE Apr 2, 2026
01fc4dd
feat: add DownloadRequest model and DownloadConfig settings for file …
HC-ONLINE Apr 11, 2026
e2756f0
feat: add DownloadCleanupScheduler for managing expired download toke…
HC-ONLINE Apr 11, 2026
52d6866
feat: add download_helper module with functions for generating downlo…
HC-ONLINE Apr 16, 2026
5feba0c
feat: implement DownloadService for managing file downloads, includin…
HC-ONLINE Apr 16, 2026
0ac92a3
feat: add export options to AnalyzeRequest for optional result file p…
HC-ONLINE Apr 16, 2026
dc9faa7
refactor: implement _run_async function to handle async coroutines in…
HC-ONLINE Apr 16, 2026
a55194d
feat: add download endpoint with token-based authentication and integ…
HC-ONLINE Apr 16, 2026
4866ffa
feat: update download endpoint tests to use X-API-Key header and refa…
HC-ONLINE Apr 16, 2026
a94f1f9
feat: add FastAPI and related dependencies to pre-commit configuration
HC-ONLINE Apr 17, 2026
fecdbae
feat: enrich responses with download token and URL in analyze, attack…
HC-ONLINE Apr 17, 2026
1f0d01e
refactor: simplify ScrapeBatchResultResponse model - remove success f…
HC-ONLINE Apr 17, 2026
509482d
feat: enrich /api/scrape/batch with download tokens using APIResponse…
HC-ONLINE Apr 17, 2026
ea190ae
feat: add API command to CiberWebScan CLI for server management
HC-ONLINE Apr 17, 2026
8bd79ea
feat: update README to reflect REST API status as beta and enhance in…
HC-ONLINE Apr 17, 2026
9fd6e8b
feat: add community support section to README with contribution guide…
HC-ONLINE Apr 17, 2026
9473da1
feat: add API command and configuration details to CLI and installati…
HC-ONLINE Apr 17, 2026
7ab8085
feat: Add full REST API documentation for CiberWebScan (Beta)
HC-ONLINE Apr 29, 2026
3fc9034
feat: Update CHANGELOG with new REST API features and enhancements
HC-ONLINE Apr 29, 2026
3e9771a
feat: Update ruff-pre-commit version to v0.15.12 in pre-commit config…
HC-ONLINE Apr 29, 2026
ae5c404
style: format code with ruff
HC-ONLINE Apr 29, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,9 @@ jobs:
- name: Install dependencies
run: |
pip install --upgrade pip
pip install -e ".[dev]"
# install both dev and api extras so that the full test
# matrix (unit + integration + API) can execute.
pip install -e ".[api,dev]"

- name: Ruff
run: |
Expand Down
7 changes: 5 additions & 2 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
fail_fast: true
repos:
- repo: https://github.com/astral-sh/ruff-pre-commit
rev: v0.8.4
rev: v0.15.12
hooks:
- id: ruff
args: [--fix]
Expand Down Expand Up @@ -40,12 +40,15 @@ repos:
- pyright==1.1.405
- pydantic
- python-dotenv
- flask
- typer
- rich
- httpx
- playwright
- beautifulsoup4
- pyyaml
- cryptography
- fastapi
- uvicorn
- python-multipart
- starlette
- orjson
64 changes: 54 additions & 10 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ Includes safe, controlled penetration testing capabilities for XSS detection, SQ

### Professional Integration

- **REST API (In Development)**: Planned full-featured API for seamless integration with existing security workflows and tools (currently not publicly available)
- **REST API (Beta)**: A powerful REST interface for seamless integration with existing security workflows. Built with FastAPI, it includes interactive documentation and allows for remote orchestration of scans.
- **Command Line Interface**: Powerful CLI with rich formatting and automation support for security professionals
- **Flexible Export Options**: Generate comprehensive reports in JSON, CSV, and structured formats
- **Configuration Management**: Centralized, persistent configuration system for enterprise deployment
Expand Down Expand Up @@ -82,12 +82,27 @@ Enhance your methodology with systematic reconnaissance tools that uncover hidde
### Installation

```bash
# Install from source
# 1. clone the repository and install the package
git clone https://github.com/HC-ONLINE/CiberWebScan.git
cd CiberWebScan

# 2. create a virtual environment (optional but recommended)
python -m venv venv
source venv/bin/activate # On Windows: venv\Scripts\activate

# 3. install the package and dependencies

# CLI only
pip install -e .

# Verify installation
# CLI + API
pip install -e "[api]"

# Full Developer Setup
# if you are running the developer tests you will also want the dev dependencies, which include testing frameworks and tools
pip install -e "[api,dev]"

# verify that the tool is available
ciberwebscan --help
```

Expand Down Expand Up @@ -123,20 +138,37 @@ ciberwebscan attack --url https://testsite.example.com --xss
ciberwebscan attack --url https://testsite.example.com --enumeration
```

### REST API Integration (In Development)
### REST API Integration

> **API Preview**: The REST interface is functional but considered "unstable." Endpoint signatures and JSON schemas may change as we refine the 2.0.0 specification.

To start the server:

```bash
ciberwebscan api run
```

### Interactive Documentation

Once the server is running, you can explore and test all available endpoints through the built-in interactive UI:

- **Swagger UI**: http://localhost:8000/docs
- **ReDoc**: http://localhost:8000/redoc

> **Note**: The REST API is currently under development and not publicly available. This section shows planned usage examples for future releases.
### Programmatic Access Example

You can also integrate CiberWebScan into your own scripts using the requests library:

```python
import requests

# Security analysis via API (planned)
response = requests.post("http://localhost:5000/api/analyze", json={
"url": "https://target.example.com",
"checks": ["fingerprint", "ssl", "headers", "cve"]
# Security analysis via REST API
response = requests.post("http://localhost:8000/api/analyze", json={
"url": "https://target.example.com"
})

analysis_results = response.json()
results = response.json()
# Returns: {"success": true, "data": {"technologies": [...], "vulnerabilities": [...]}, ...}
```

---
Expand Down Expand Up @@ -192,6 +224,18 @@ ciberwebscan --help

---

## Community & Support

Contributions are what make the open-source community such an amazing place to learn, inspire, and create. Any contributions you make are **greatly appreciated**.

- **Found a bug?** Open an [Issue](https://github.com/HC-ONLINE/CiberWebScan/issues) describing the problem.
- **Want a new feature?** Feel free to submit a [Pull Request](https://github.com/HC-ONLINE/CiberWebScan/pulls) with your proposal.
- **Enjoying the tool?** Give us a ⭐ on GitHub to show your support!

## Before contributing, please read our [Contributing Guide](docs/CONTRIBUTING.md) to maintain code quality and consistency.

---

## Documentation

- **[Installation Guide](docs/INSTALLATION.md)** - Complete setup and installation instructions
Expand Down
Loading
Loading