Senior Big Data/Machine Learning Engineer

Job Title: Senior Big Data / Machine Learning Engineer

Location

Plano, TX (Hybrid)

Schedule

Full-Time, W2 Contract

Type

W2 Contract Only (No C2C)

Duration

Approximately 7 Months (Open-Ended)

Pay Rate

$65-$75/hour W2

Relocation: Local candidates only. Relocation assistance is not available, and non-local candidates will not be considered.

Summary

We are seeking an experienced Senior Big Data / Machine Learning Engineer to design, build, and support enterprise-scale data platforms and real-time processing solutions. This role will focus on developing highly reliable, scalable batch and streaming data pipelines while collaborating with cross-functional Agile teams to deliver end-to-end data solutions.

The ideal candidate will have strong experience with cloud technologies, distributed data processing frameworks, data orchestration platforms, and event-driven architectures.

Key Responsibilities

• Design, develop, and maintain large-scale batch and real-time data pipelines that support enterprise data initiatives.
• Build data ingestion, transformation, orchestration, and delivery solutions with an emphasis on scalability, performance, and reliability.
• Develop and support event-driven architectures and real-time streaming solutions.
• Collaborate with Agile teams to design end-to-end data engineering solutions from source systems through downstream consumption layers.
• Optimize data processing workflows and improve overall platform performance.
• Implement data quality, monitoring, observability, and alerting capabilities to ensure data reliability and SLA compliance.
• Develop and maintain cloud-based data solutions leveraging modern data warehousing technologies.
• Partner with stakeholders, architects, and engineering teams to translate business requirements into technical solutions.
• Support secure credential management, secrets handling, and governance best practices across production environments.
• Participate in code reviews, architecture discussions, and continuous improvement initiatives.

Required Qualifications

• Must have a Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent professional experience.
• 4+ years of experience building and supporting data pipeline and orchestration systems.
• 4+ years of hands-on experience with Java, Python, and SQL.
• 4+ years of experience working with real-time, streaming, or event-driven data platforms.
• 4+ years of experience with distributed data processing technologies such as Kafka, Spark, Hadoop, EMR, or similar platforms.
• 4+ years of experience working with cloud data warehousing solutions at scale.
• 4+ years of experience utilizing cloud platforms including AWS, Azure, or Google Cloud Platform (GCP).
• 3+ years of experience with workflow scheduling and orchestration tools.
• 2+ years of experience with secure secrets management and credential handling in production environments.
• 2+ years of experience working within Agile software development teams.
• Strong understanding of data engineering best practices, performance optimization, and scalable architecture design.

Preferred Qualifications

• Experience implementing data observability frameworks, monitoring, alerting, and data quality solutions.
• Background supporting highly regulated or compliance-driven industries, including financial services.
• Familiarity with enterprise-scale machine learning platforms and model deployment pipelines.
• Experience with DevOps, CI/CD automation, and infrastructure-as-code practices.
• Strong communication and stakeholder management skills.
• Experience designing highly available, fault-tolerant data platforms.

#INDPRO