Sr. Data Engineer

At PitchBook, a Morningstar company, we are always looking forward. We continue to innovate, evolve, and invest in ourselves to bring out the best in everyone. We're deeply collaborative and thrive on the excitement, energy, and fun that reverberates throughout the company.

Our extensive learning programs and mentorship opportunities help us create a culture of curiosity that pushes us to always find new solutions and better ways of doing things. The combination of a rapidly evolving industry and our high ambitions means there's going to be some ambiguity along the way, but we excel when we challenge ourselves.

We're willing to take risks, fail fast, and do it all over again in the pursuit of excellence.

If you have a good attitude and are willing to roll up your sleeves to get things done, PitchBook is the place for you.

About the Role

As a member of the Product and Engineering team at PitchBook, you will be part of a team of big thinkers, innovators, and problem solvers who strive to deepen the positive impact we have on our customers and our company every day. We value curiosity and the drive to find better ways of doing things.

We thrive on customer empathy, which remains our focus when creating excellent customer experiences through product innovation.

We know that greatness is achieved through collaboration and diverse points of view, so we work closely with partners around the globe. As a team, we assume positive intent in each other's words and actions, value constructive discussions, and foster a respectful working environment built on integrity, growth, and business value. We invest heavily in our people, who are eager to learn and constantly improve.

Join our team and grow with us!

Primary Job Responsibilities

• Expert at building unified data technologies to support advanced and automated business analytics
• Design, develop, document, and maintain database and reporting structures used to compile insights
• Define, develop, and review extract, load, and transform (ELT) processes and data modeling solutions
• Consistently evolve data processes and techniques following industry best practices
• Establish and help define reports and dashboards used to translate business data into insights, identify and prioritize operational improvement opportunities, and measure business KPIs against objectives
• Contribute to the ongoing improvement of quality assurance standards and procedures
• Mentor and guide less experienced data engineers, contributing to their professional development
• Stay updated with the latest data engineering technologies and trends and share your insights with the team
• Support the vision and values of the company through role modeling and encouraging desired behaviors
• Participate in various company initiatives and projects as requested

Skills and Qualifications

• Bachelor's degree in a related field (Computer Science, Engineering, etc.)
• 5+ years of experience in data engineering roles, including creating and maintaining data pipelines, data modeling, and data architecture
• 5+ years of experience in data cleansing, governance, and quality/integrity
• 5+ years of experience in advanced SQL, including expert-level skills in querying large datasets from multiple sources and developing automated reporting
• 5+ years of experience in Python, with skills for diverse components of data pipelines, including scripting, data manipulation, custom extract, transform and loads, and statistical/regression analysis
• Expertise in extract, transform, and load (ETL) and extract, load, transform (ELT) processes and pipelines, platforms (e.g. Airflow), and distributed messaging (e.g. Kafka)
• Experience with tools that capture and control data modeling change management (e.g. SQLMesh)
• Experience building data alerting & notifications (e.g. on deviations, thresholds, etc.)
• Experience building and managing tools for data observability and documentation (e.g. DataLab)
• Proficient in data storage solutions, data warehousing, and cloud-based data platforms (e.g. Snowflake)
• Proficient in deploying data pipelines to a cloud-native, containerized deployment/delivery environment (e.g. Kubernetes)
• Knowledge and applicable working experience establishing and ensuring data governance, data quality, and compliance standards
• Exceptional problem-solving skills and a track record of designing and optimizing data pipelines
• Excellent communication and collaboration skills with the ability to engage with non-technical stakeholders
• Experience working with enterprise technologies (CRM, ERP, Marketing Automation Platforms, Financial Systems, etc.) is a plus
• Must be authorized to work in the United States without the need for visa sponsorship now or in the future

Benefits + Compensation at PitchBook

Physical Health

• Comprehensive health benefits
• Additional medical wellness incentives
• STD, LTD, AD&D, and life insurance

Emotional Health

• Paid sabbatical program after four years
• Paid family and paternity leave
• Annual educational stipend
• Ability to apply for tuition reimbursement
• CFA exam stipend
• Robust training programs on industry and soft skills
• Employee assistance program
• Generous allotment of vacation days, sick days, and volunteer days

Social Health

• Matching gifts program
• Employee resource groups
• Subsidized emergency childcare
• Dependent Care FSA
• Company-wide events
• Employee referral bonus program
• Quarterly team building events

Financial Health

• 401k match
• Shared ownership employee stock program
• Monthly transportation stipend
• Please be aware the above PitchBook benefit and perk offerings are subject to corresponding plan and policy documents and may change during the course of your employment.

Compensation

• Annual base salary: $140,000-$170,000
• Target annual bonus percentage: 10%
• Annual base salary: $140,000-$170,000
• Target annual bonus percentage: 10%

Working Conditions

At the heart of our company is a belief in the power of in-person collaboration. Being together in the office fuels our creativity, strengthens our connections, and drives the innovation that sets us apart. Our culture is built on spontaneous moments-those hallway conversations, whiteboard brainstorms, and shared celebrations in each of our global offices-that simply can't be replicated remotely.

This role is expected to be in the office 5 days a week.

The job conditions for this position are in a standard office setting. Employees in this position use PC and phone on an on-going basis throughout the day. Limited corporate travel may be required to remote offices or other business meetings and events.

We are excited to get to know you and your background. Concerned that you might not meet every requirement? We encourage you to still apply as you might be the right candidate for the role or other roles at PitchBook.

#LI-KL1

#LI-Onsite

PitchBook appreciates and respects diversity, and as such, we are an equal opportunity employer.

Skills

Accidental Death and Dismemberment (AD&D), Apache Kafka, Best Practices, Business Analysis, Business Growth, Change Management, Childcare, Cloud Computing, Communication Skills, Computer Science, Customer Experience, Customer Relationship Management (CRM), Data Collection, Data Management, Data Modeling, Data Processing, Data Quality, Data Sets, Data Storage, Data Warehousing, Database Administration, Database Extract Transform and Load (ETL), Diversity, Documentation, ERP (Enterprise Resource Planning), Emerging Technology, Employee Assistance Plan, Establish Priorities, Financial Systems, Flexible Spending Accounts, Health Plan, Life Insurance, Marketing Automation Software, Matching Gift Programs, Mentoring, Operational Improvement, Performance Metrics, Problem Solving Skills, Process Modeling, Product Engineering, Python Programming/Scripting Language, Quality Assurance, Quality Management, Quality Metrics, Regulatory Compliance, Reporting Dashboards, Reporting Skills, SQL (Structured Query Language), Scripting (Scripting Languages), Snowflake Schema, Statistics, Team Building, Team Player, Technical Support, Training Program, Tuition Reimbursement

About the Company

PitchBook Data