Senior Data Engineer in Raleigh

Job DescriptionSenior Data Engineer

• This is a hybrid position – candidates local to the Raleigh, NC area only, please
• We are not considering Corp-to-Corp (C2C) arrangements for this position

Description

• We are seeking a skilled mid-level Data Engineer to join our team and focus on quality assurance quality checking and ETL processes.
• The successful candidate will be responsible for ensuring the integrity and accuracy of data transferred from a shared file transfer service to an S3 bucket and subsequently into and through our Snowflake data platform.
• This data will be utilized by downstream applications and reporting systems.
• These applications and the corresponding consumed data are critical to business

process execution.

Responsibilities

• Quality Assurance Quality Checking: Implement and maintain data quality to

ensure the accuracy and reliability of data throughout the ETL process.

• ETL Processes: Design develop and optimize
• ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake.
• Data Integration: Ensure seamless data integration into data platform enabling efficient consumption by downstream applications and reporting tools.
• Data Quality Management: Address data quality challenges including inconsistencies in source data that do not meet ingestion requirements which can lead to load failures or data backouts.
• Collaboration: Work closely with business owners data analysts business intelligence teams and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Monitoring Troubleshooting: To preserve data flow and integrity monitor pipelines identify issues and implement solutions.

Required Skills/Knowledge/Experience

• Demonstrated mid-level+ experience in data engineering, with an emphasis on data quality assurance and ETL processes., Required 5 Years
• Expertise in Python, PyPI, and SQL, Required 5 Years
• Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity., Required 5 Years
• Understanding of fundamental public-cloud capabilities., Required 5 Years
• Proven capacity to comprehend business needs and convert them into technical requirements., Required 5 Years

Proper email communication will only be done to and from @astyra.com email addresses. Please ensure you are communicating with approved Astyra recruiters by checking this point when receiving offers and messages from us. Please ensure you are communicating within these guidelines and proper channels for the quickest possible interview consideration!

#AC