
π WaterCrawl v0.5.0 Released

Senior Python developer
WaterCrawl v0.5.0 is out! This update brings key improvements to make the platform more powerful, secure, and developer-friendly.
We're thrilled to announce the release of WaterCrawl v0.5.0 β our biggest update yet! This version comes with a host of improvements aimed at making the platform more powerful, secure, and developer-friendly.
Whether youβre already using WaterCrawl to crawl and convert websites into AI-ready knowledge, or just hearing about us for the first time, this release brings a ton of enhancements youβll love.
π§± Mono-Repo Improvements
Weβve restructured WaterCrawl into a mono-repo, making it easier to contribute, collaborate, and maintain consistency across the entire codebase.
-
π Docs migrated into the main repo
- βοΈ Frontend migrated into the main repo
-
π§ Improved internal tooling and structure for better modularity
π‘ Developer Experience Upgrades
A smooth dev workflow is key β and weβve doubled down on it:
-
β Added PR linting to enforce code standards
-
π³ Improved Docker configuration & setup docs
-
πΌοΈ Enhanced READMEΒ π¨
-
π οΈ Added contribution guidelines and GitHub issue/PR templates
π Stability & Security
Security and reliability are non-negotiable. This release addresses that head-on:
-
β οΈ Fixed Docker build warnings
-
π Updated dependencies to patch known vulnerabilities
-
π§° Added
packageManager
topackage.json
-
π Enabled MinIO consistency check on startup
β¨ New Features
Weβre also excited to introduce a major new feature:
-
π¨ Invitation-based user registration β control access to your WaterCrawl instances more easily and securely.
π§ Why WaterCrawl?
WaterCrawl is designed to help teams extract, structure, and prepare web data for AI workflows. Whether youβre building a knowledge base, training a chatbot, or analyzing web content, WaterCrawl gets you the clean, structured data you need β fast.
π Join the Community
Weβre building WaterCrawl in the open and would love for you to be part of it!
π οΈ Try it, contribute, or star the repo on GitHub:
π github.com/watercrawl/watercrawl
Letβs shape the future of web crawling and AI-ready content together.
Got feedback or ideas? Drop them in GitHub Issues or reach out directly β weβd love to hear from you!