The Role:
In 2024, the global data team is actively scaling up, and we're eager to explore more talents to join our R&D centers in Singapore and Shanghai. Your contribution will play a pivotal role in steering the data team into the next step - the era of AI in Airwallex.
As a data engineering expert, you'll delve into various facets of data engineering, starting from end-to-end data modeling to writing DBT, enhancing data content, and exploring underlying aspects such as Flink ETL. If you're intrigued by the realm of AI, we wholeheartedly encourage our team members to engage in the journey of AI projects, from conception to fruition.
Join us in shaping the future of finance through innovative data solutions!
Responsibilities：
- We expect you to possess a solid understanding and experience in both the foundational aspects of data engineering and data content. An interest in end-to-end work and topics related to AI is highly desirable. As our data team is distributed across different regions, we value candidates with a global perspective and excellent English communication skills.
- Work in a variety of settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret.
- Develop and automate large-scale, high-performance distributed data processing systems (batch/ streaming) to drive Airwallex business growth and improve the product experience.
- Evangelize high-quality software engineering practices toward building data infrastructure and pipelines at scale.
- Lead data engineering projects to ensure pipelines were reliable, efficient, testable, and maintainable and were largely in charge of architecting solutions.
- Design our data content models for optimal storage and retrieval and to meet critical product and business requirements.
- Contribute to shared Data Engineering tooling standards to improve the productivity and quality of output for Data Engineers across the company.
Requirements:
- Over 5 years of hands-on experience in the dynamic field of data engineering.
- Hold a Bachelor's or Master's degree in CS / CE / CIS or possess equivalent expertise, showcasing proficiency in Kotlin, Java, Scala, Python, and SQL. Familiarity with Spring Boot, Spark, Flink, Hadoop, BigQuery, and Snowflake is a plus.
- Expertise in crafting robust processes that underpin data transformation, and manage data structures, metadata, dependencies, and workloads.
- Possess a strong command of Real-time and Batch-processing systems.
- Proven track record of conducting in-depth root cause analysis on internal and external data and processes, addressing specific business inquiries, and identifying enhancement opportunities.
- Exceptional analytical skills, particularly in handling unstructured datasets.
- Demonstrated ability to take charge of designing, constructing, and maintaining distributed systems, while establishing an overarching data architecture.
- Excellent written and verbal communication skills, facilitating seamless collaboration across teams in both Mandarin and English.
Tech Stack:
- SQL, Python, Spring boot, Spark, Flink, Hadoop, BigQuery, Snowflake, Airflow
- Plus - Java, Kotlin
