Senior Spark Developer

This Senior Spark Developer role focuses on designing, optimizing, and maintaining big data applications using Apache Spark and Scala across distributed computing environments. You will tune Spark jobs for performance and cost efficiency, work with storage systems including HDFS, Hive, HBase, Cassandra, Kafka, and Parquet, and maintain reusable libraries following best coding practices. The role requires ensuring compliance with security and governance standards, troubleshooting performance issues in big data pipelines, and mentoring junior developers through code reviews. You will work with cloud platforms such as AWS, Azure, and GCP and leverage tools like EMR, Databricks, and HDInsight for scalable data processing. Experience with Delta Lake, Apache Iceberg, or Spark MLlib integration is a valued advantage for this position.