Alternative Approaches
Abouts
These are just some scratch notes on some of the approaches for job workflows. This is a more historical document than anything.
Options
- Dagster
- Red Engine
- Dramtiq
- Temporalio
- Luigi
- AppScheduler
- Go Cadance
- Airflow
- Background jobs in linux
- exec-command
Other Dagster References
- pybokeh/dagster-sklearn
- Gave me the inspiration for the primary folder structure. Although that example is more advanced and utilizes sklearn.
- dagster-io/dagster examples
- Dagster's own examples.
- xyzy-web/dagster-exchangerates
- An example that includes Kubernetes Deployment.
- sephib/dagster-graph-project
- sspaeti-com/practical-data-engineering