Senior Data Engineer - Hybrid

Description :

Hiring :

Senior Data Engineer (AWS | Databricks)Experience : 8 - 12 Years

Location : Bangalore / Chandigarh

Work Mode : Hybrid / WFORole Overview : We are seeking an experienced Senior Data Engineer with around 8+ years of experience in building and optimizing data platforms for banking and financial services.This role involves leading teams to modernize BI, AI, and ML data pipelines, automate manual processes, and build audit-ready, production-grade data systems. You will work on high-impact projects across wholesale lending, retail lending, and credit risk domains, collaborating with global stakeholders.Key Responsibilities : - Lead the architecture and development of end-to-end analytics platforms- Design and build scalable BI, analytics, and reporting data pipelines- Set up and manage AWS Glue for data ingestion and data lake architecture- Deploy and manage Databricks workspaces with secure governance- Refactor SAS scripts into Spark-based solutions (Databricks Notebooks)- Develop Py

Spark / Spark SQL ELT pipelines using Delta Tables (ACID compliance)- Orchestrate data workflows using Databricks Workflows- Build and manage batch processing pipelines for analytics- Lead BI development teams for credit risk and lending transformation projects- Analyze data lineage and implement data quality and validation frameworks- Design and develop interactive dashboards based on stakeholder requirements- Ensure secure deployment of dashboards with row-level security- Transition analytics solutions into production-grade systems

Required Skills : - Strong experience in Python and Py

Spark- Advanced proficiency in SQL and Spark SQL- Hands-on experience with Databricks- Expertise in AWS Glue and cloud-based data pipelines- Experience with Tableau or similar BI tools- Knowledge of SAS programming (migration/refactoring preferred)- Strong understanding of data governance and data quality frameworks- Experience in building scalable data pipelines and analytics systems- Exposure to AI/ML data pipelines and advanced prompt engineering

Preferred Qualifications : - AWS Certified Data Engineer - Associate- Experience in banking, lending, or credit risk domains- Prior experience leading data engineering or BI teams

Benefits : - Comprehensive health insurance- Paid time off and flexible leave policies- Strong focus on learning & development- Opportunity to work on high-impact financial data platforms- Exposure to global stakeholders and modern data technologies (ref:hirist.tech)