Pyspark Developer

Roles & Responsibilities:

• Expected to be an SME, collaborate and manage the team to perform.

• Responsible for team decisions.

• Engage with multiple teams and contribute on key decisions.

• Provide solutions to problems for their immediate team and across multiple teams.

• Lead the development and optimization of data pipelines to support business requirements.

• Ensure adherence to data governance and compliance standards within the team.

• Mentor junior team members to foster skill development and knowledge sharing.

Professional & Technical Skills:

• Must To Have Skills: Proficiency in Py

Spark.

• Experience in designing and implementing scalable data processing workflows using distributed computing frameworks.

• Strong knowledge of data integration techniques and ETL best practices.

• Familiarity with cloud-based data platforms and storage solutions.

• Ability to troubleshoot and optimize complex data pipelines for performance and reliability.

• Experience with scripting and automation to streamline data operations.

Additional Information:

• The candidate should have minimum 5 years of experience in Py

Spark.