#performance
10 notes, from beginner to advanced.
- Broadcast Joins and Handling Data Skewpyspark · intermediate · 2 min
- Indexes and Query Plans: Why a Query Is Slowsql · intermediate · 2 min
- LLM Inference: Cost and Latency in Productionllms · intermediate · 2 min
- Python UDFs vs Built-in Functions vs Pandas UDFspyspark · intermediate · 2 min
- Sensors, Reschedule Mode and Deferrable Operatorsapache-airflow · intermediate · 2 min
- Spark Partitions and File Sizes: repartition, coalesce and the Small-Files Problemapache-spark · intermediate · 2 min
- Spark Execution Model: Jobs, Stages, Tasks and Shufflesapache-spark · intermediate · 3 min
- Adaptive Query Execution (AQE) in Sparkapache-spark · advanced · 2 min
- Micro-partitions, Pruning and Clustering Keyssnowflake · advanced · 2 min
- OPTIMIZE, Z-ORDER, Liquid Clustering and VACUUMdatabricks · advanced · 2 min