Apache Spark Senior Developer

As a member of our core Product Engineering and Delivery Team, you will be leading a group of Engineers throughout the software development lifecycle involved in the design, development, integration, and testing of our suite of products. This is a hands-on role and will require you to mentor a team of junior developers and assist the team with problem-solving and process optimization. You will work on Agile frameworks, and popular coding languages and acquire in-depth knowledge of our market-leading product solutions.

Responsibilities:

  • Designed, built, and configured applications to meet business processes and application requirements. Delivery as per agile model.

  • Resource must have good hands-on with relevant Spark experience of a minimum of 6 years in Big Data, including Apache Spark. Good to have Cloud Knowledge.

  • Proficiency in Scala or Python, as these are commonly used languages for Apache Spark development.

  • Extensive experience with Apache Spark, including Spark Core, RDDs (Resilient Distributed Datasets), Data Frames, and Spark SQL.

  • Strong understanding of the broader big data ecosystem, including Hadoop, Hive, HDFS, and related technologies.

  • Expertise in designing and implementing scalable and efficient data processing solutions using Apache Spark.

  • Proficient in data modeling and analysis, with the ability to transform raw data into meaningful insights using Spark.

  • Database Systems: Understanding of database systems and integration with Spark.

  • Troubleshooting and Debugging: Strong troubleshooting and debugging skills to identify and address issues in Spark applications.

  • Collaboration and Communication: Effective collaboration skills to work with cross-functional teams and good communication skills to convey complex technical concepts.

  • Willingness to stay updated on the latest advancements in Apache Spark and related technologies.

Required Skills:

  • Working experience between 6-10 yrs.

  • Working experience with Apache Spark, Hive, Airflow, and Hadoop.

  • Working experience with HTML 5.

  • Cloud Design, Build, and Data Engineering.