Clawkit 🦀

Unified DevOps CLI toolkit — 9 tools in one. Zero dependencies.

clawkit merges 9 focused CLI tools into a single, cohesive package. The original individual repos are now archived — all development continues here. One pip install gives you a duplicate finder, .env toolkit, file integrity monitor, permissions auditor, markdown toolkit, tabular data CLI, log forensics engine, secret scanner, and log forensics scanner.

---

Installation

pip install clawkit

Or from source:

git clone https://github.com/Luv-Goel/clawkit.git
cd clawkit
pip install -e .

Quick Start

# Duplicate file finder
clawkit scan ~/Downloads --report duplicates.html

# Check .env file
clawkit dotenv check .env --against .env.example

# Integrity check
clawkit integrity init /etc
clawkit integrity check /etc

# Security audit
clawkit audit /usr/bin --report audit.html

# Markdown tools
clawkit markdown toc README.md
clawkit markdown stats README.md

# Tabular data
clawkit data stats data.csv
clawkit data select data.csv --columns name,age
clawkit data filter data.csv --query "age > 30"

# Log analysis
clawkit logs stats access.log
clawkit logs top access.log --field ip --limit 10
clawkit logs report access.log --output report.html

# Secret scanner
clawkit secrets scan ~/project --format json
clawkit secrets scan ~/project --format html -o secrets.html

# Log forensics scanner (NEW!)
clawkit logscan access.log
clawkit logscan access.log --anomalies
clawkit logscan syslog.log --format syslog --anomalies
clawkit logscan app.json --format json --output report.html

CLI Reference

Command	Description	Origin
clawkit scan	Duplicate file finder by content hash	sift
clawkit dotenv	Load, validate, merge, diff, template .env files	dotenv
clawkit integrity	SHA256-based file integrity monitoring	warden
clawkit audit	Find SUID binaries, world-readable secrets, weak perms	perm
clawkit markdown	TOC, lint, check-links, format, stats for .md files	mark
clawkit data	Tabular data CLI — select, filter, group, join, stats	tally
clawkit logs	Log file parsing, analysis, search, HTML reports	logsmith
clawkit secrets	Secret scanner — 20+ patterns, entropy detection	vault
clawkit logscan	Log forensics scanner — parse, detect anomalies, HTML reports	new

Architecture

clawkit/
├── clawkit/
│   ├── cli.py              # Unified CLI entry point
│   ├── commands/
│   │   ├── scan.py         # Duplicate file finder
│   │   ├── dotenv.py       # .env file toolkit
│   │   ├── integrity.py    # File integrity monitor
│   │   ├── audit.py        # Permissions auditor
│   │   ├── markdown.py     # Markdown toolkit
│   │   ├── data.py         # Tabular data CLI
│   │   ├── logs.py         # Log forensics
│   │   ├── secrets.py      # Secret scanner
│   │   └── logscan.py      # Log forensics scanner (NEW)
│   └── utils/
│       └── __init__.py     # Shared HTML report helpers
├── tests/
├── .github/workflows/ci.yml
├── pyproject.toml
├── CONTRIBUTING.md
├── SECURITY.md
└── README.md

All Tools Included

This project consolidates 9 tools into one package:

Original (Archived)	Now	Description
sift → archived	clawkit scan	Duplicate file finder
dotenv → archived	clawkit dotenv	.env file toolkit
warden → archived	clawkit integrity	File integrity monitor
perm → archived	clawkit audit	Security permissions auditor
mark → archived	clawkit markdown	Markdown toolkit
tally → archived	clawkit data	Tabular data CLI
logsmith → archived	clawkit logs	Log forensics
vault → archived	clawkit secrets	Secret scanner
new	clawkit logscan	Log forensics scanner

Features

• Zero external dependencies — Pure Python 3.8+, stdlib only
• HTML reports — Beautiful dark-mode reports for scan, integrity, audit, secrets, and logscan
• Unified interface — Every tool uses consistent CLI argument patterns
• CI/CD ready — Exit codes for pipeline integration (SARIF support for secrets)
• Anomaly detection — logscan detects error rate spikes, unusual IPs, suspicious paths
• Format auto-detection — logscan automatically detects Apache, syslog, and JSON formats

License

MIT — see LICENSE.