A reputable company within financial services is looking to expand their data engineering team and is recruiting for a Senior Data Engineer job.
About the Senior Data Engineer Role: Based in Kuala Lumpur, this role will work with a team of data experts in contributing to the transformation programme.
Developing and maintaining ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes to transform data from its source into a format suitable for analysis
Creating and maintaining automated and optimal data pipeline architecture
Integrating and consolidating data from various sources such as Teradata, Oracle, Hadoop, etc.
Developing and implementing a scalable data architecture that supports data integration, transformation, and analysis across the bank's various data sources
Ensuring the quality and accuracy of the data through data validation, cleansing, and data profiling
Writing medium to complex SQL queries, Stored Procedures, etc.
Assembling large, complex data sets that meet functional/non-functional business requirements
Optimising data integration processes for performance and reliability
Troubleshoot and resolve data integration issues
Designing and maintain data pipelines that support real-time data ingestion and processing
To succeed in this Senior Data Engineer role, you will need to have experience with Informatica.
Minimum of six years' experience in data engineering exposed to data lakes and data warehouse
Data modelling and architecting skills including data normalisation, dimensional data modelling
Experience in building automated data pipelines on big data platform - Hive, Spark, Hbase, Kafka, etc.
Experience on working with ETL tool - Informatica Powercenter
Experience on working on relational databases like Teradata, Oracle, MSSQL, etc. (at least one)
Experience in ingesting Semi-structured/unstructured files into Hadoop platform
Good knowledge on Shell scripting and Python scripting
This company is a leading player within the industry. They attract, retain and energise the best people by investing in their professional development and providing them with challenging and rewarding opportunities for personal growth.
If you are driven, determined and want to take the next step in your career, this Senior Data Engineer job is for you. Great career progression opportunities await the right person in this exciting role.
Apply now or email me at email@example.com. Do note that we will only be in touch if your application is shortlisted.
Do note that we will only be in touch if your application is shortlisted.
Agensi Pekerjaan Robert Walters Sdn Bhd Business Registration Number : 729828-T Licence Number : JTKSM 423C
An exciting Head of IT Infrastructure job has just become available at a multinational conglomerate. Your main responsibility is to lead and grow the organisation’s IT Infrastructure function within their shared services centre, supporting the business units across various regions.