Data Engineer

A leading multinational organisation is seeking a talented Data Engineer to join their regional technology team based in Kuala Lumpur. This role presents an exciting opportunity for you to work with cutting-edge cloud technologies, manage large-scale data processing workloads, and contribute to impactful data and analytics initiatives across the business.

What you'll do:

As a Data Engineer within this regional technology team in Kuala Lumpur, you will play a pivotal role in designing robust solutions that underpin the organisation’s data-driven strategies. Your day-to-day responsibilities will involve architecting scalable pipelines using Microsoft Azure services while working collaboratively with cross-functional teams to ensure seamless integration of business requirements into technical deliverables. You will be entrusted with managing large datasets—ensuring their integrity through rigorous quality checks—and developing curated models for analytics purposes. By implementing advanced transformation logic in SQL and Python alongside distributed frameworks like Apache Spark or PySpark, you will optimise workflows for performance and cost efficiency. Your commitment to best practices in security, governance, version control, and deployment will be essential in maintaining compliance across all stages of the pipeline. Continuous improvement is at the heart of this role; your contributions will help elevate automation standards and expand cloud platform capabilities. Success in this position requires not only technical proficiency but also strong interpersonal skills as you collaborate with stakeholders from various disciplines to deliver reliable solutions that empower business decision-making.

• Design, develop, and maintain scalable data pipelines and integration solutions that support both business operations and analytical requirements across the organisation.
• Build and optimise ETL/ELT processes for efficiently processing, transforming, and loading structured as well as semi-structured data into cloud platforms.
• Develop and sustain cloud-based data platforms using Microsoft Azure technologies such as Azure Data Factory and Azure Data Lake Storage, ensuring seamless workflow automation.
• Work extensively with large datasets to guarantee accuracy, consistency, quality, and availability of information for downstream analytics and reporting.
• Implement sophisticated data transformation logic using SQL, Python, and distributed processing frameworks like Apache Spark or PySpark.
• Optimise data pipelines and processing jobs to enhance performance, scalability, and cost efficiency while maintaining reliability.
• Develop curated datasets and maintain comprehensive data models tailored for analytics teams and business intelligence reporting tools.
• Establish rigorous data quality checks, monitoring systems, and error-handling mechanisms to ensure dependable delivery of information throughout the pipeline.
• Collaborate closely with data architects, analysts, software engineers, and other stakeholders to translate technical requirements into effective solutions that meet organisational goals.
• Apply best practices in areas such as data security, governance, version control, and deployment management to uphold compliance standards.
• Contribute actively to continuous improvement initiatives focused on enhancing data engineering standards, automation capabilities, and cloud platform features.

What you bring:

The ideal candidate for the Data Engineer position brings a wealth of experience from previous roles involving cloud-based platforms—particularly those utilising Microsoft Azure technologies. Your academic background provides a solid foundation upon which your practical expertise has been built over at least five years in the field. You possess advanced skills in SQL and Python programming that enable you to transform complex datasets efficiently. Experience with distributed frameworks such as Apache Spark or PySpark further enhances your capability to process large volumes of information reliably. Familiarity with tools like Azure Databricks or Delta Lake is highly valued given the scale of enterprise projects undertaken by the organisation. Your understanding of ETL/ELT architecture coupled with troubleshooting abilities ensures smooth operation of production pipelines even under challenging circumstances. Knowledge of version control systems (Git) alongside CI/CD deployment practices means you can contribute seamlessly within agile project environments. Beyond technical prowess, your attention to detail sets you apart when it comes to maintaining high standards of accuracy across all stages of the pipeline. Collaborative spirit is essential; your interpersonal skills enable effective teamwork while strong communication ensures clarity when engaging stakeholders from diverse backgrounds.

• Bachelor's degree in Computer Science, Information Technology, Data Engineering or a related discipline is required for foundational knowledge.
• At least 5 years of relevant experience in data engineering or cloud-based platform development demonstrates your proven track record in similar environments.
• Hands-on expertise with Microsoft Azure services such as Azure Data Factory and Azure Data Lake Storage ensures you can build scalable solutions effectively.
• Proficiency in SQL and Python enables you to implement complex transformation logic for processing large volumes of structured or semi-structured information.
• Experience working with distributed processing frameworks like Apache Spark or PySpark allows you to handle big data workloads efficiently.
• Familiarity with Azure Databricks and Delta Lake supports your ability to manage enterprise-scale datasets within cloud environments.
• Strong understanding of ETL/ELT development principles along with experience in troubleshooting production pipelines highlights your problem-solving abilities.
• Knowledge of Git version control systems as well as CI/CD pipeline deployment practices using tools like Azure DevOps or GitHub ensures smooth project delivery.
• Excellent attention to detail combined with collaborative skills enables you to work effectively within cross-functional teams while maintaining high standards of quality.
• Strong communication skills allow you to interact confidently with both technical experts and non-technical stakeholders.

What sets this company apart:

This leading multinational organisation stands out for its commitment to fostering an inclusive workplace where every team member’s contribution is valued. Employees benefit from exposure to modern cloud technologies—such as Microsoft Azure—and participate in enterprise-scale projects that have real impact on business outcomes regionally and globally. The company prioritises continuous learning by providing access to training opportunities that encourage professional growth alongside technical advancement. Collaboration is at the core of their culture; cross-functional teams work together harmoniously towards shared objectives while supportive leadership ensures guidance throughout each stage of your career journey. The environment is designed not only for innovation but also for nurturing talent through mentorship programmes and knowledge-sharing sessions. Flexible working opportunities are available so you can balance personal commitments without compromising on professional aspirations. With generous pension contributions offered as part of their benefits package (where applicable), employees enjoy peace of mind knowing their future is secure while they focus on delivering excellence today. The organisation’s dedication to diversity means under-represented groups are encouraged to apply—ensuring everyone has equal access to rewarding career paths within this global network.

What's next:

If you are ready to take your expertise in data engineering to new heights within a supportive regional team environment—apply now!

Apply today by clicking on the link provided below; don’t miss out on this opportunity to join a global leader in technology-driven solutions.

Do note that we will only be in touch if your application is shortlisted.

Agensi Pekerjaan Robert Walters Sdn Bhd
Business Registration Number : 729828-T
Licence Number : JTKSM 423C