Java Backend Developer

Role: Java Developer with Spark / Scala

Location: New York City, New York (Onsite)

Interview Mode :: Final discussion Face to Face

Job Summary

We are seeking a highly skilled Java Spark Developer with strong experience in designing and developing large-scale distributed data processing applications.

The ideal candidate will have expertise in Java, Apache Spark, Hadoop ecosystem, SQL, and Cloud technologies (AWS/Azure/GCP). The candidate will be responsible for building scalable data pipelines, optimizing Spark applications, and collaborating with cross-functional teams to deliver high-performance data solutions.

Key Responsibilities

• Design, develop, and maintain scalable big data applications using Java and Apache Spark.
• Build and optimize batch and real-time data processing pipelines.
• Develop Spark applications using Spark Core, Spark SQL, DataFrames, and Spark Streaming.
• Work with large datasets stored in HDFS, Hive, S3, Delta Lake, or Snowflake.
• Implement data transformation, cleansing, and aggregation processes.
• Optimize Spark jobs for performance, memory utilization, and resource management.
• Develop REST APIs and microservices using Spring Boot where required.
• Collaborate with Data Engineers, Architects, Business Analysts, and DevOps teams.
• Troubleshoot production issues and perform root cause analysis.
• Implement CI/CD pipelines and automated deployment processes.
• Ensure data quality, security, and compliance with enterprise standards.
• Participate in code reviews and follow best coding practices.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 5+ years of Java development experience.
• 3+ years of hands-on Apache Spark experience.
• Strong proficiency in:

o Java 8/11/17

o Apache Spark

o Spark SQL

o Hadoop Ecosystem (HDFS, Hive)

o SQL and Database Development

• Experience with:

o Spring Boot and Microservices

o Kafka or other messaging platforms

o RESTful APIs

o Git, Maven, Jenkins

o Linux/Unix environments

• Strong understanding of distributed computing concepts.
• Experience tuning and optimizing Spark jobs.

Preferred Qualifications

• Experience with cloud platforms:

o AWS (EMR, S3, Glue, Lambda)

o Azure Databricks

o Google Cloud Dataproc

• Experience with:

o Databricks

o Delta Lake

o Snowflake

o Airflow

o Kubernetes and Docker

• Exposure to Scala or Python.
• Banking, Financial Services, Insurance, Retail, or E-commerce domain experience.

Technical Skills

Programming Languages

• Java
• SQL
• Python (Preferred)
• Scala (Preferred)

Big Data Technologies

• Apache Spark
• Spark SQL
• Spark Streaming
• Hadoop
• Hive

Cloud & Data Platforms

• AWS EMR
• Databricks
• Snowflake
• Delta Lake

DevOps & Tools

• Git
• Jenkins
• Maven
• Docker
• Kubernetes

Pay: $105,000.00 - $125,000.00 per year

Benefits

• 401(k)

Work Location: In person