Skills
Browse curated AI skills for development, design, testing, and more.
Showing 1-2 of 2
Spark Optimization
@sickn33
Low Risk
Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
spark
4.3
Spark Engineer
@Jeffallan
Safe
Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operati
data-engineeringdatabase