Senior Data Engineer

You will be part of a team building the next generation data warehouse platform and will design, develop, and maintain complex extract, transform, and load (ETL) data pipelines using large heterogeneous datasets. You will also build data engineering solutions for complex data models that express business processes.

Your expertise with leading technologies and tools such as Oracle, Postgres, Python, etc. will result in a valuable modern data warehouse that supports critical business decisions and data analysis processes. Your collaboration and communication skills will help to establish stakeholder relationships and ensure that your work products are in alignment with project goals.

Most importantly, you will be passionate about working with data and will be a significant contributor.

Responsibilities

• Design, develop, and automate scalable data engineering solutions by leveraging cloud infrastructure. Extend or migrate existing data pipelines to new cloud environment.
• Lead technical projects involving design and development of data pipelines for complex datasets. Document project plans, outline tasks and milestones, provide estimation of effort.
• Work closely with business partners to devise and manage data pipelines, load frequency, data delivery mechanisms, and performance tuning.
• Identify and implement best practices for data engineering and software development to ensure quality delivery of enterprise solutions.
• Help enable team alignment by participating in code reviews, change management and team meetings.
• Develop and maintain detailed technical documentation of data engineering solutions.
• Collaborate with key stakeholders, both internal and external, including enterprise data architect, data modelers, and subject matter experts (SMEs).

Qualifications

• Five or more years of professional experience as data engineer. Bachelor’s degree in Computer Science or equivalent experience.
• Demonstrated experience in data warehousing and ETL development.
• Experience building complex data pipelines using large, disparate data sources.
• Demonstrated expert knowledge in SQL.
• Demonstrated experience working with relational databases such as Oracle, Postgres and other modern database technologies.
• Proficiency in modern programming languages such as Python, R, Java.
• Thorough understanding of data movement and transformation tools, such as Informatica, Datastage or equivalent.
• Demonstrated experience in selecting tools, methods, techniques, and evaluation criteria for designing optimal data engineering solutions.
• Demonstrated experience in leading complex technical projects, including assigning tasks and selecting team members.
• Ability to make technical presentations to teams, focus groups, management, and governance committees.
• Excellent customer service, communication and collaboration skills.

Preferred Qualifications

• Five years or more experience as data engineer designing and implementing complex data pipelines.
• Master’s degree in Computer Science, Information Technology or related field.
• Experience with Big Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.).
• Experience with AWS technologies.