WaterCrawl is revolutionizing how developers transform web content into structured data for AI applications. Our cutting-edge open-source platform needs a talented Senior Backend Developer to help us scale and enhance our core services. You'll collaborate with a team of passionate engineers to design, implement, and maintain the backend systems that power our data crawling and processing infrastructure.
Senior backend developer
WaterCrawl is seeking an experienced Senior Backend Developer with expertise in Python and Django to join our innovative team. As a key member of our engineering department, you'll help build and optimize our open-source platform that transforms web data into structured, AI-ready formats. The ideal candidate brings strong Python/Django experience, exceptional problem-solving skills, and a passion for creating scalable web intelligence solutions.
Back to all openings
Location
Remote
Job Type
Full-time
Experience
8+ years
Department
Engineering
Job Details
About the Role
Responsibilities
- Design, develop, and maintain scalable backend services using Python and Django
- Optimize application performance and ensure high availability of services
- Write clean, maintainable, and well-tested code following best practices
- Collaborate with cross-functional teams to define, design, and ship new features
- Contribute to architectural decisions and technical strategy
- Troubleshoot and resolve complex technical issues
- Participate in code reviews to ensure code quality and knowledge sharing
- Support and mentor junior developers on the team
- Contribute and Manage the open-source project related to our technology stack.
- Developing technical blog post and content.
Requirements
- 8+ years of professional experience in backend development, with deep expertise in Python and Django.
- Strong proficiency in asynchronous task management using Celery and Redis as a caching and messaging layer.
- Extensive hands-on experience building and optimizing relational databases (PostgreSQL), including schema design, query optimization, and database migration strategies.
- Solid understanding of containerization and deployment using Docker; familiarity with Kubernetes is a plus.
- Experience integrating third-party APIs, including AI services (e.g., OpenAI), and building robust internal APIs.
- Familiarity with object storage solutions like MinIO or similar S3-compatible storage systems.
- Knowledge of developing and extending functionality through a modular and extensible plugin architecture.
- Strong understanding of testing frameworks and continuous integration (CI/CD) pipelines for robust, reliable software delivery.
- Proficient in best practices for security, performance optimization, and scalability in high-traffic backend systems.
- Proficiency with Git and GitHub workflow
- Knowledge of caching mechanisms (Redis)
- Understanding of web scraping concepts and challenges
- Excellent problem-solving and communication skills
- Ability to work effectively in a remote team environment
Preferred Qualifications
-
Exposure to TypeScript or React for collaborative front-end integration.
- Prompt engineering and LLMs.
-
Experience contributing to open-source projects.
-
Familiarity with workflow automation tools such as n8n .
-
Comfortable working with cloud platforms (AWS, GCP, or Azure).
-
Experience mentoring junior engineers and leading technical discussions.
- Familiarity with message queuing systems (RabbitMQ, Kafka)
Benefits
- Flexible working hours and fully remote position
- Competitive salary with monthly sales bonus opportunities
- Professional development and learning stipend
- Opportunity to contribute to cutting-edge open-source technology
- Collaborative and innovative work environment
- Career advancement opportunities in a fast-growing startup
Apply for this position
Submit your application below