Data Engineer (Junior）

Responsibilities

Be responsible for the operation and maintenance of the overseas part of the group's data warehouse (mobile device data warehouse, IoT data warehouse, app data warehouse), ensuring data availability and reliability.

Have an in-depth understanding of Xiaomi's business, clearly abstract and model business processes, determine the big data architecture system suitable for Xiaomi's complex business scenarios, and continue to iterate.

Continue to build the group's data warehouse, support the testing of data warehouse, and realize the data enabling business.

Develop and maintain ETL/ELT pipelines to ingest, transform, and load data from diverse sources into the data warehouse in a timely and accurate manner.

Monitor data pipeline health, troubleshoot data quality issues, and implement alerting mechanisms to proactively detect anomalies.

Write well-structured, efficient SQL and scripts (Python/Shell) to support data processing, reporting, and ad-hoc analysis requests from business teams.

Collaborate with data scientists, analysts, and product managers to understand data requirements and translate them into scalable data solutions.

Document data models, pipeline logic, and data dictionaries to maintain a healthy and accessible data knowledge base.

Requirements

Bachelor's degree in computer science, software engineering or other related fields.

Have a certain understanding of big data technology architecture (Hadoop, spark, Flink, Doris, kudu, iceberg).

Solid programming ability, with good basic computer knowledge of data structure, algorithm, operating system, etc.

Be good at communication, have good teamwork and coordination communication skills.

#J-18808-Ljbffr