Our client is on the hunt for a proficient Technical Specialist in IT Production Data Engineering to become part of their vibrant team in Penang.
This role presents the chance to engage with diverse teams, amalgamating data from a variety of sources into a unified format for comprehensive analysis. The successful candidate will be tasked with crafting ETL processes and real-time data pipelines, choosing suitable tools for data storage, processing, and extraction, and maintaining data quality throughout the pipelines. This is a thrilling opportunity to make a difference in a company that champions diversity, equity, and inclusion.
* Chance to engage with diverse teams
* Tasked with crafting ETL processes and real-time data pipelines
* Role within a company that champions diversity, equity, and inclusion
What you'll do:
As a Technical Specialist in IT Production Data Engineering, you will play an instrumental role in delivering top-notch data solutions. You will collaborate closely with varied teams, understanding their needs and translating these into effective strategies. Your expertise in crafting ETL processes and real-time data pipelines will be key in amalgamating data from various sources into a unified format. You will also be responsible for assessing and selecting the most suitable tools for data storage, processing, and extraction. Ensuring the quality and integrity of the data throughout the pipelines will be a critical part of your role. Additionally, you will design, develop, deploy, and support production applications to facilitate test measurement operations.
* Engage with diverse teams to comprehend requirements and deliver data solutions.
* Amalgamate data from various sources into a unified format for comprehensive analysis.
* Craft ETL processes and real-time data pipelines.
* Assess and choose suitable tools for data storage, processing, and extraction.
* Maintain data quality and integrity throughout the pipelines.
* Execute data extraction and create dashboards/reports for data visualisation.
* Design, develop, deploy and support production applications to facilitate test measurement operations.
What you bring:
The ideal candidate for the Technical Specialist in IT Production Data Engineering position brings a wealth of experience in the field. With a minimum of 7 years in Computer Science or a similar field, and at least 3 years of hands-on experience in data engineering, you are well-equipped to take on this role. Your solid understanding of Agile methodology and proficiency in application development will be crucial in delivering effective solutions. Your skills in Cloud computing, Databricks, Snowflake, and data staging using Python and SQL will be highly valued. Experience with Bigdata tools such as Apache NIFI, Kafka, Airflow will further enhance your ability to excel in this role. Familiarity with manufacturing system architecture and experience in semiconductor manufacturing/ operation technology will be an added advantage.
* Bachelor’s degree in Computer Science or similar field with minimum 7 years of experience.
* Minimum 3 years of hands-on experience in data engineering.
* Solid understanding of Agile methodology.
* Experience in application development (DotNet, SOAP services, Restful API, JAVA, CUDA, ILGPU).
* Proficient in Database skill (Oracle, SQL Server, NoSQL)
* Experience in Cloud computing, Databricks and Snowflake; skilled in data staging using Python and SQL.
* Experience in Bigdata tools such as Apache NIFI, Kafka, Airflow.
* Familiarity with manufacturing system architecture.
* Experience in semiconductor manufacturing/ operation technology is an added advantage.
What sets this company apart:
Our client is a leading player in the industry, recognised for their commitment to diversity, equity, and inclusion. They believe that these values contribute significantly to their success as a company. They offer a vibrant work environment where collaboration and innovation are encouraged. This is an excellent opportunity to join a company that values its employees and offers opportunities for growth and development.
What's next:
Eager to advance your career? Apply now or email me at tenghong.khoo@robertwalters.com.my to discuss this new opportunity!
Don't wait! Apply today by clicking on the provided link!
Do note that we will only be in touch if your application is shortlisted.
Agensi Pekerjaan Robert Walters Sdn Bhd
Business Registration Number : 729828-T
Licence Number : JTKSM 423C
