Role: ETL Developer
Experience: 6 to 9 yrs
Key Skills: Linux, Shell Script, SQL, Python, Java development, Control M, Remedy, JIRA, Bitbucket, Jenkins, Artifactory, Aldon
Key Responsibilities:
• Participate in end-to-end projects for system implementation of MLS system
• Engage and collaborate with Architects, Security and Development Lead to ensure solution design complies with enterprise design principles, security, and control standards
• Liaise with application teams across group and countries build the enhancements according to the technical solution plan
• Coordinate with Technology Delivery Manager and System Analyst to plan technical deliverables and schedule, perform design and development works to meet project requirements, and produce technical documents
• Escalate issues that impacts project schedule on timely basis and propose workarounds/resolutions
• Perform data profiling, cleansing, transformation and validation to ensure data quality and integrity throughout the shell scripts and ETL pipelines
• Test, maintain and recommend software improvements to ensure strong functionality and optimization
• Create and maintain technical documentation, including ETL specifications, data mappings, data dictionary, process workflows, data ownership and error handling procedures
• Implement project change request and in accordance with deployment schedule
• Partner with Test Management teams to ensure completion of SIT, UAT, performance / load testing and application security testing with quality result
• Facilitate and provide technical and testing support before and after production deployment
• Collaborate with cross-functional teams, such as data scientists, analysts, and business users, to understand their data requirements and provide support as needed
• Work with production support team members to conduct root cause analysis of issues, review new and existing code and/or perform sanity testing and unit testing
• Liaise with other units across IT and Business in the organization
• Manage external vendors for project delivery within schedule
Key Requirements:
Must Have
• Bachelor's degree in computer science, information technology, or a related field
• At least 8 years of experience and knowledge in Control M, Unix Shell Scripting, and SQL
• At least 8 years of experience and knowledge in deployment process, create, manage and maintain CICD from source code repository, version control, code merge to deployment and housekeeping
• At least 6 years of experience in Hadoop, Hive, Hbase, HDFS and Data Engineering
• Experience in Bitbucket, Git, Jenkins, Artifactory and Aldon
• Experience in JIRA, Remedy and Incident Ticket management
• Ability to multitask effectively and handle large amounts of data
• Highly driven, pro-active and a strong team player
• Excellent interpersonal skills and written and verbal communication skills in English
Good to Have
• Experience in Python, Java, NoSQL
• Experience in System Interfaces (SFTP, FTP, Connect Direct, API, Rest)
• Experience in Confluence and SharePoint
