Incremental Execution With Selective Node Re Computation

via “incremental execution with selective node re-computation”

Python DAG micro-framework for data transformations.

Unique: Implements input-driven incremental execution by comparing input hashes across runs and selectively re-computing only affected downstream nodes, avoiding the overhead of full pipeline re-execution while maintaining correctness through dependency tracking

vs others: More granular than Airflow's task-level caching because it operates at the function/node level with automatic dependency propagation, and simpler than Spark's RDD caching because it doesn't require distributed state management