Data Engineer for AI and ML Development

Full Description

Company Overview

Arizoglobal is a leading company in the field of data management and query optimization. We are seeking a talented Data Engineer with expertise in AI and ML to join our team.

Job Description

As a Data Engineer, your primary responsibility will be to develop and integrate ML solutions that focus on technology improvements. Specifically, you will work on projects involving leveraging AI/ML for Data Management Efficiencies & Query Optimizations.

Responsibilities

• Collaborate with cross-functional teams, including Data Scientists, Product Partners, and Partner Team Developers, to identify opportunities for Big Data, Query (Spark, Hive SQL, BigQuery, SQL) tuning using machine learning and generative AI.
• Write clean, high-performance, high-quality, maintainable code.
• Design and develop Big Data Engineering Solutions & generative AI Applications ensuring scalability, efficiency, and maintainability.
• Implement prompt engineering techniques to fine-tune and enhance LLMs for better performance and application-specific needs.
• Stay up-to-date with the latest advancements in Generative AI Application Development and contribute to research and development of new Generative AI Applications.

Required Skills and Qualifications

We require proven experience working as a Big Data & MLOps Engineer, with a focus on Python, Google Cloud, Spark, Spark SQL, BigQuery, and Generative AI Applications.

A deep understanding and experience in tuning Dataproc, BigQuery, and Spark Applications are also essential.

Solid knowledge of software engineering best practices, including version control systems (e.g., Git), code reviews, and testing methodologies, is required.