Our client is seeking a Senior Data Engineer to join their growing team. This role offers the opportunity to work on exciting digital projects, helping the organisation extract business value from its data. The successful candidate will be responsible for designing, building, and maintaining data pipelines and systems in a project-based team.
What you'll do:
As a Senior Data Engineer, you will play a pivotal role in enabling the organisation to realise business value from its data. You will be part of a team that designs, builds, and maintains data pipelines. Your expertise in big data computation frameworks and Azure PaaS components will be crucial in architecting scalable solutions for optimal data extraction, transformation, and loading. You will also ensure the quality and consistency of the resulting data products while providing technical support to business partners.
- Design scalable data pipelines for optimal data extraction, transformation, and loading from a wide variety of data sources
- Architect and implement data layers to the development of compound AI systems
- Ensure data quality and consistency
- Develop and optimize existing processes and queries to extract, manipulate, and analyse data from various sources
- Provide technical support and guidance to business partners on data engineering
- Stay updated with the latest trends and best practices in data engineering
What you bring:
The ideal candidate for this Senior Data Engineer position brings a wealth of experience in data engineering tasks such as data modelling, creating, and implementing data pipelines. With at least 5 years of experience under your belt, you are well-versed in cloud computing platforms such as AWS and Azure. Your knowledge extends to Relational, Object-Oriented, NoSQL Database Management Systems Delta Lake storage framework. Proficiency in Python, Apache Spark and Kafka, Databricks platform is expected. A solid understanding of Big Data/Big compute architecture and technologies will set you apart.
- 5 years of experience in data engineering tasks such as data modelling, creating, and implementing data pipelines and ETL processes
- Experience with cloud computing platforms such as AWS and Azure (preferably) and Big Data architectures
- Knowledge of Relational, Object-Oriented, NoSQL Database Management Systems Delta Lake storage framework
- Proficiency in Python, Apache Spark and Kafka, Databricks platform
- Understanding of Big Data/Big compute architecture and technologies
What sets this company apart:
Our client is a global leader in their field, committed to fostering an inclusive and diverse work environment. They are known for their commitment to innovation and digital transformation, making them an ideal workplace for those passionate about technology and data. Their focus on training opportunities ensures that their employees are always at the forefront of industry developments.
What's next:
Ready to take the next step in your career? Apply now!
Apply today by clicking on the link. We look forward to receiving your application!
Do note that we will only be in touch if your application is shortlisted.
Agensi Pekerjaan Robert Walters Sdn Bhd
Business Registration Number : 729828-T
Licence Number : JTKSM 423C
