Skip to Main Content

Xcom In Airflow 🔥 Tested & Working

✅ or ensure upstream dependencies with >> . ❌ Using XComs for many small values across many tasks Each XCom is a DB row. 10 000 tasks × 5 XComs = 50 000 rows – fine. But 100 000 tasks × 10 XComs = 1 million rows – slow. Advanced: XCom Backends Airflow 2.0+ lets you store XComs outside the metadata DB. Useful if you need slightly larger values or lower DB load.

process(extract()) # XCom passed implicitly xcom in airflow

@task def extract() -> dict: return "user_id": 123, "name": "Alice" # pushed automatically ✅ or ensure upstream dependencies with >>