Three data pipelines, containerized, tested, yours in one command
For a small data team that wants a working dbt project, a Dagster
orchestration, or a Kafka streaming pipeline today, not after a week of
Docker plumbing. Each kit runs end to end on a laptop with
make run: no cloud account, no warehouse bill.
dbt + DuckDB
Staging-to-marts dbt project on DuckDB: seeds, staging views, two data tests, and an incremental daily mart.
dbt_project.yml docker-compose.yml Dockerfile Makefile models/marts/dim_customers.sql models/marts/fct_orders_daily.sql models/marts/fct_orders.sql models/marts/schema.yml models/staging/schema.yml models/staging/stg_customers.sql models/staging/stg_orders.sql profiles.yml README.md RUNBOOK.md seeds/raw_customers.csv seeds/raw_orders.csv tests/assert_lifetime_revenue_matches_orders.sql tests/assert_no_negative_amounts.sql tests/smoke.sh
Dagster + Postgres
Orders pipeline on Dagster and Postgres: assets, two asset checks, a daily schedule, and a sensor that watches an inbox folder.
dagster_project/db.py dagster_project/definitions.py dagster_project/__init__.py docker-compose.yml Dockerfile Makefile README.md RUNBOOK.md scripts/check_sensor.py scripts/replay.py scripts/run_pipeline.py tests/smoke.sh
Kafka Streaming
An orders producer and consumer on Kafka: valid rows land in
orders, rejects go to a dead-letter queue with a reason.
docker-compose.yml Dockerfile Makefile README.md RUNBOOK.md scripts/consumer.py scripts/dlq_peek.py scripts/producer.py tests/smoke.sh
Smoke Test, All Three Kits
run-all: dbt-duckdb run-all: dbt-duckdb OK in 10s run-all: dagster-postgres run-all: dagster-postgres OK in 23s run-all: kafka-streaming run-all: kafka-streaming OK in 59s run-all: all kits passed
Price
One kit: €39. All three together: €79. 30-day refund, no questions.
FAQ
What do I get? A zip of the kit's Dockerfile, compose file, seeds and tests, downloaded straight after payment.
Do the kits need a cloud account? No: every kit runs on
docker compose on a laptop, against sample data.
Is anything free? Yes: the layout and each kit's own README sit in the public repo below, with no payment step.
Can I see the tests before buying? Yes, the smoke-test log above is this build's own run, not a mockup.
Do you offer a refund? Yes, within 30 days of purchase: write skills@automate-it-all.win.
Where's the source? github.com/automate-it-all/data-pipeline-kits, the free skeleton with links back here.