πŸš€ WaterCrawl v0.5.0 Released
2 min read

πŸš€ WaterCrawl v0.5.0 Released

Amir Asaran
Amir Asaran

Senior Python developer

WaterCrawl v0.5.0 is out! This update brings key improvements to make the platform more powerful, secure, and developer-friendly.


We're thrilled to announce the release of WaterCrawl v0.5.0 β€” our biggest update yet! This version comes with a host of improvements aimed at making the platform more powerful, secure, and developer-friendly.

Whether you’re already using WaterCrawl to crawl and convert websites into AI-ready knowledge, or just hearing about us for the first time, this release brings a ton of enhancements you’ll love.


🧱 Mono-Repo Improvements

We’ve restructured WaterCrawl into a mono-repo, making it easier to contribute, collaborate, and maintain consistency across the entire codebase.

  • πŸ“š Docs migrated into the main repo

  • βš›οΈ Frontend migrated into the main repo
  • πŸ”§ Improved internal tooling and structure for better modularity


πŸ’‘ Developer Experience Upgrades

A smooth dev workflow is key β€” and we’ve doubled down on it:

  • βœ… Added PR linting to enforce code standards

  • 🐳 Improved Docker configuration & setup docs

  • πŸ–ΌοΈ Enhanced README 🎨

  • πŸ› οΈ Added contribution guidelines and GitHub issue/PR templates


πŸ” Stability & Security

Security and reliability are non-negotiable. This release addresses that head-on:

  • ⚠️ Fixed Docker build warnings

  • πŸ” Updated dependencies to patch known vulnerabilities

  • 🧰 Added packageManager to package.json

  • πŸ”„ Enabled MinIO consistency check on startup


✨ New Features

We’re also excited to introduce a major new feature:

  • πŸ“¨ Invitation-based user registration β€” control access to your WaterCrawl instances more easily and securely.


🧠 Why WaterCrawl?

WaterCrawl is designed to help teams extract, structure, and prepare web data for AI workflows. Whether you’re building a knowledge base, training a chatbot, or analyzing web content, WaterCrawl gets you the clean, structured data you need β€” fast.


πŸ’™ Join the Community

We’re building WaterCrawl in the open and would love for you to be part of it!
πŸ› οΈ Try it, contribute, or star the repo on GitHub:
πŸ‘‰ github.com/watercrawl/watercrawl

Let’s shape the future of web crawling and AI-ready content together.


Got feedback or ideas? Drop them in GitHub Issues or reach out directly β€” we’d love to hear from you!