Data Platform Engineer

Job Title : Data Platform Engineer

Responsibilities :

Participate in the maintenance of the big data platform cluster.

Contribute to the ongoing maintenance of the big data platform cluster, ensuring its stability and optimal performance.

Manage daily scheduling and monitoring of the big data platform, including data transmission, scheduling, metadata, lineage, quality center, as well as reporting and Adhoc query systems.

Oversee the day-to-day operations of the big data platform, ensuring seamless data flow, efficient scheduling, and robust monitoring of various components.

Contribute to the design of the data platform, development of data products, and synchronization of data.

Play a key role in designing the data platform architecture, contributing to the development of innovative data products, and ensuring effective data synchronization.

Support business systems' data service requirements.

Collaborate with business teams to address and support their data service requirements, ensuring alignment with organizational objectives.

Participate in cutting-edge technology research and adoption.

Stay abreast of the latest technological advancements, conduct research, and contribute to the introduction of cutting-edge technologies to enhance the data platform.

Qualifications :

Minimum of 4 years of work experience.

Possess a solid foundation with at least 4 years of relevant work experience in data platform engineering.

Strong programming skills with expertise in Java development. Proficient in JVM, web development, caching, distributed architecture, and messaging middleware.

Demonstrate proficiency in Java development, including strong knowledge of JVM, web development, caching, distributed architecture, and messaging middleware.

Proficient in at least one or more distributed open-source projects such as Hadoop, Hive, Spark, Flink, StarRocks.

Showcase expertise and practical experience in the workings of distributed open-source projects, including Hadoop, Hive, Spark, Flink, StarRocks.

Excellent component-level modeling skills. Familiarity with distributed databases, NoSQL, MQ, Cache, TCP / IP principles. Ability to design complex, high-concurrency, and large-scale data systems.

Exhibit strong component-level modeling skills, along with a deep understanding of distributed databases, NoSQL, MQ, Cache, TCP / IP principles. Ability to design intricate systems handling high concurrency and large data volumes.

Experience in developing subsystems related to big data computing scheduling systems, real-time data processing platforms, data transfer services, and data lineage.

Demonstrate hands-on experience in developing subsystems within big data computing scheduling systems, real-time data processing platforms, data transfer services, and data lineage.

Preferred experience with AWS / GCP distributed big data and cloud-native data storage and computing frameworks.

Preferred experience with AWS / GCP, showcasing expertise in distributed big data and cloud-native data storage and computing frameworks.

If you are a seasoned Data Platform Engineer with a passion for cutting-edge technologies and a proven track record in developing robust and scalable data systems, we welcome you to join our team and contribute to the evolution of our data platform.