Skip to content

Development Roadmap

Phase 0 — Engineering Foundation (v0.1.0)

  • [x] Repository initialization
  • [x] Django project setup
  • [x] PostgreSQL integration
  • [x] Docker Compose
  • [x] Environment configuration
  • [x] Health checks (liveness + readiness)
  • [x] Ruff, mypy, pytest
  • [x] pre-commit
  • [x] GitHub Actions (lint, test, migration check, Docker build)
  • [x] Dependabot
  • [x] Initial documentation + MkDocs
  • [x] Apache-2.0 license

Phase 1 — Domain Modeling (v0.2.0)

  • [x] Workflow entities
  • [x] Task entities
  • [x] WorkflowRun
  • [x] TaskRun
  • [x] State machines
  • [x] Domain services
  • [x] Persistence models
  • [x] State transition tests

Phase 2 — Workflow Definition Engine (v0.3.0)

  • [x] JSON workflow definitions
  • [x] Schema validation
  • [x] DAG validation
  • [x] Cycle detection
  • [x] Topological sorting
  • [x] Dependency resolution
  • [x] Definition versioning

Phase 3 — REST API (v0.4.0)

  • [x] Workflow management endpoints
  • [x] Execution endpoints
  • [x] Authentication
  • [x] Authorization
  • [x] Pagination
  • [x] Error handling
  • [x] OpenAPI documentation

Phase 4 — Scheduler (v0.5.0)

  • [x] Task eligibility logic
  • [x] Scheduler loop
  • [x] Atomic task claiming
  • [x] Transactional outbox
  • [x] RabbitMQ publishing
  • [x] Scheduler recovery (lease reaper)
  • [x] Decision: replace Celery with a custom scheduler (ADR-011)

Phase 5 — Distributed Workers (v0.6.0)

  • [x] Worker process
  • [x] Task consumption
  • [x] Task execution
  • [x] Heartbeats
  • [x] Lease management
  • [x] Fencing tokens
  • [x] Result persistence (task outcome; handler return values are Phase 6)
  • [x] Graceful shutdown

Phase 6 — Reliability (v0.7.0)

  • [ ] Retry policies
  • [ ] Exponential backoff
  • [ ] Idempotency
  • [ ] Lease expiration
  • [ ] Recovery
  • [ ] Dead letter handling
  • [ ] Concurrency tests

Phase 7 — Advanced Workflows (v0.8.0)

  • [ ] Parallel execution
  • [ ] Conditional branching
  • [ ] Scheduling
  • [ ] Cancellation
  • [ ] Execution history
  • [ ] Manual retry
  • [ ] Compensation mechanisms

Phase 8 — Security and Multi-Tenancy (v0.9.0)

  • [ ] Organizations
  • [ ] Memberships
  • [ ] RBAC
  • [ ] Tenant isolation
  • [ ] API keys
  • [ ] Audit logging
  • [ ] Security tests

Phase 9 — Observability and Performance (v0.10.0)

  • [ ] Structured logging
  • [ ] Metrics
  • [ ] Distributed tracing
  • [ ] Dashboards
  • [ ] Load tests
  • [ ] Benchmark reports

Phase 10 — SDK, CLI and Documentation (v0.11.0)

  • [ ] Python SDK
  • [ ] CLI
  • [ ] Examples
  • [ ] Developer documentation
  • [ ] API reference

Phase 11 — Production Hardening (v1.0.0)

  • [ ] Security review
  • [ ] Migration review
  • [ ] Deployment documentation
  • [ ] Backup and recovery
  • [ ] Kubernetes deployment
  • [ ] End-to-end testing
  • [ ] Release preparation