JOB SUMMARY
We are looking for a talented and experienced Lead Data Engineer to join our innovative team. The Lead Data Engineer will play a critical role in leading the design, development, and maintenance of our data infrastructure, pipelines, and analytical tools. The ideal candidate will have a strong technical background in data engineering, expertise in analytical tools, and proven leadership skills to mentor and guide a team of data engineers.
JOB DUTIES
- Lead the design, development, and implementation of scalable and efficient data pipelines, databases, and data infrastructure.
- Mentor, coach, and guide a team of data engineers, providing technical leadership and support.
- Collaborate with data scientists, product managers, and business stakeholders to understand data requirements, facilitate data-driven decision-making, and deliver actionable insights.
- Optimize database schemas, tables, and queries to support data storage, retrieval, and analysis.
- Integrate and optimize analytical tools such as Tableau, Power BI, or Looker to enable advanced data analysis, visualization, and reporting capabilities.
- Develop and enforce data engineering best practices, standards, and guidelines to ensure the quality, performance, and reliability of our data solutions.
- Implement ETL processes to integrate data from various sources, ensuring data quality, consistency, and integrity.
- Optimize data pipelines, queries, and infrastructure for performance, scalability, and cost-efficiency.
- Monitor and troubleshoot data pipelines and infrastructure issues, and provide timely resolutions.
- Stay up-to-date with the latest data engineering technologies, analytical tools, and best practices, and drive their adoption within the team.
- Ensure data security, compliance with data governance and privacy regulations, and adherence to analytical tool licensing agreements.
- Work closely with cross-functional teams to identify data needs and requirements, and deliver data solutions that meet business objectives.
- Document data pipelines, processes, and best practices, and contribute to the development of data engineering documentation and standards.
- Stay up-to-date with the latest data engineering technologies, tools, and best practices, and recommend their adoption as appropriate.
JOB REQUIREMENTS
- Bachelor’s degree in Computer Science, Information Systems, or equivalent work experience.
- 6+ years of experience in data engineering, with at least 3 years in a lead or senior engineering role.
- Proven leadership skills with experience in mentoring, coaching, and guiding a team of data engineers.
- Strong technical background in designing and implementing data pipelines, databases, and analytical tools.
- Proficiency in programming languages commonly used in data engineering such as Python, Java.
- Hands-on experience with big data technologies and frameworks such as Hadoop, Spark, Kafka, and Hive.
- Hands-on experience with analytical tools such as Tableau, Power BI, Looker, or similar platforms.
- Solid understanding of relational and NoSQL databases, and experience with database design, optimization, and SQL querying.
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
- Experience with real-time data processing and streaming technologies (e.g., Apache Flink, Kafka Streams).
- Excellent analytical and reasoning skills with an ability to anticipate outcomes of a solution.
- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
- Strong sense of responsibility, initiative, and commitment.
- Self-motivated, proactive, and able to work independently with minimal supervision.
- Knowledge of data governance, data security, and compliance standards and best practices.
- Maintain confidentiality of information processed or prepared.
- Ability to lead, convince and inspire team members in a fast-paced environment.
- Willingness to travel to meet and work with offshore team members.
- Fluency in written and spoken English and Mandarin is highly desirable to liaise with Chinese speaking clients and counterparts.
