Big Data Specialist with AI Expertise Wanted

Full Description

Job Summary

Arizoglobal is seeking a highly skilled Data Engineer with expertise in AI and ML to lead our Big Data Engineering efforts. This role involves developing and integrating ML solutions to improve data management efficiencies and query optimizations.

Key Responsibilities

• Collaborate with cross-functional teams to identify opportunities for Big Data, Query (Spark, Hive SQL, BigQuery,SQL) tuning using machine learning and generative AI.
• Design and develop scalable, efficient, and maintainable Big Data Engineering Solutions & generative AI Applications.
• Develop and implement prompt engineering techniques to fine-tune and enhance LLMs for better performance and application-specific needs.
• Contribute to the research and development of new Generative AI Applications.

Requirements

Proven experience working as a Big Data & MLOps Engineer, with a focus on Python, Google Cloud, Spark, Spark SQL, BigQuery, and Generative AI Applications, is essential.

A deep understanding and experience in tuning Dataproc, BigQuery, and Spark Applications are also necessary.

Solid knowledge of software engineering best practices, including version control systems (e.g., Git), code reviews, and testing methodologies, is required.