Data Engineer

Data EngineerInitial 6-Month ContractLocation: Eveleigh, Sydney NSW - Hybrid We are seeking an experienced Data Engineer to join a dynamic team operating within a complex data integration environment. The ideal candidate will possess strong technical expertise combined with the ability to work with partially documented and quality-challenged data sources.

This role involves diagnosing data issues, producing detailed documentation, and effectively communicating technical findings to stakeholders at all levels.

Key Responsibilities

• Work with undocumented and partially defective data extracts, diagnosing issues systematically.
• Develop and maintain data pipelines using core Azure services and modern architecture patterns.
• Produce formal documentation and communicate technical issues clearly to non-technical stakeholders.
• Implement Medallion architecture (Bronze, Silver, Gold) for reliable data processing.
• Profile large datasets, identify data quality issues, and develop solutions.
• Collaborate with teams using version control tools such as Azure DevOps or GIT.

Required Skills and Experience

• Strong experience with core Azure services: Azure Synapse Analytics, Microsoft Fabric, Azure SQL Server, Azure Data Lake Storage, Azure Key Vault, Power BI.Expert-level SQL development, including complex transformations and data analysis.
• Proficiency in Python and PySpark with hands-on pipeline development experience.
• Practical experience implementing Medallion architecture across multiple data layers.
• Advanced knowledge of Power BI, including semantic modeling, DAX, and visual development.
• Deep understanding of dimensional modeling techniques and their implementation.
• Hands-on data profiling and diagnosis of large, undocumented datasets.
• Experience with version control systems, particularly Azure DevOps or GIT. Desirable

Skills

• Metadata-driven or framework-based ELT experience, particularly with Azure Synapse or Azure Data Factory.
• Familiarity with Microsoft Dynamics CRM and Dataverse, including data quality issues and GUID generation patterns.
• If you are a proactive Data Engineer with a passion for tackling complex data challenges and eager to contribute to impactful projects, we encourage you to apply.
• Desired Skills and Experience
• Azure
• Microsoft Fabric
• Azure SQL Server
• Azure Data Lake Storage
• Azure Key Vault
• Power BIPython
• PySpark
• GIT