Skip to content

Releases: janhq/OpenCrawl

Release v0.1.6

03 Apr 04:31
@github-actions github-actions
v0.1.6
3ca7262

Choose a tag to compare

View all tags
Release v0.1.6 Latest
Latest

What's Changed

See CHANGELOG.md for details.

Installation

pip install opencrawl

Ethical Crawling

This release maintains our commitment to ethical web crawling through:

  • Strict robots.txt compliance
  • Rate limiting per domain
  • Respectful delays between requests
  • Queue-based processing

Making the web a better place, one respectful crawl at a time 🌐✨

Assets 2
Loading

Release v0.1.5

03 Apr 04:29
@github-actions github-actions
v0.1.5
bb88a2e

Choose a tag to compare

View all tags
Release v0.1.5

What's Changed

See CHANGELOG.md for details.

Installation

pip install opencrawl

Ethical Crawling

This release maintains our commitment to ethical web crawling through:

  • Strict robots.txt compliance
  • Rate limiting per domain
  • Respectful delays between requests
  • Queue-based processing

Making the web a better place, one respectful crawl at a time 🌐✨

Loading

Release v0.1.4

03 Apr 04:23
@github-actions github-actions
v0.1.4
4bd639e

Choose a tag to compare

View all tags
Release v0.1.4

What's Changed

See CHANGELOG.md for details.

Installation

pip install opencrawl

Ethical Crawling

This release maintains our commitment to ethical web crawling through:

  • Strict robots.txt compliance
  • Rate limiting per domain
  • Respectful delays between requests
  • Queue-based processing

Making the web a better place, one respectful crawl at a time 🌐✨

Loading