API Reference¶
Public, user-facing API. For framework internals (codegen, runtime, registry), see Internals.
| Page | Description |
|---|---|
| Tasks | @task, @for_each_task, task_value() |
| Jobs | @job, job_cluster(), params |
| Task Values | set_task_value, get_task_value |
| Built-in IoManagers | Polars (Parquet, Delta, JSON, CSV), Spark (Delta, Parquet), Unity Catalog (Tables, Volumes) |
| Custom IoManagers | IoManager ABC, OutputContext, InputContext |
| Backfill Definitions | BackfillDef, DailyBackfill, WeeklyBackfill, MonthlyBackfill, HourlyBackfill, StaticBackfill, get_run_logical_date, all_partitions |