JP

Data Engineer - #1823

  • Jobster Private Ltd.
  • Singapore
  • On-site
  • Contract, Full Time
  • SGD 8k–9k / month
  • Posted yesterday
Data & AIData IngestionDatabase ScriptingDesignData De-Duplication

ABOUT THE ROLE

We are seeking a Data Engineer to support the design, development, implementation and maintenance of data pipelines and data processing solutions within a Singapore public-sector technology environment.

The successful candidate will be responsible for developing and maintaining data pipelines, performing data extraction, transformation and loading (ETL/ELT), and ensuring data is processed, validated and made available for downstream analytics, reporting and business applications.

Working closely with data analysts, data scientists, application developers, business stakeholders and technology teams, the candidate will translate data requirements into reliable and scalable data engineering solutions.

The role will involve using Python and SQL to develop data processing scripts, manage data transformations, automate data workflows and troubleshoot data pipeline issues.

The overall objective is to establish reliable data processing capabilities that improve data accessibility, quality and availability to support organisational operations, reporting and data-driven decision-making.

KEY RESPONSIBILITIES

  • Develop and Maintain Data Pipelines – Design, develop and maintain automated data pipelines to extract, process, transform and load data from various source systems into target data environments.
  • Implement ETL / ELT Processes – Build and optimise ETL/ELT workflows to support data ingestion, transformation, integration and processing requirements.
  • Develop Data Processing Solutions – Use Python to develop data processing scripts, automation routines and reusable components to support data engineering activities.
  • Perform SQL Development – Write and optimise SQL queries for data extraction, transformation, validation and manipulation across relevant data environments.
  • Implement Data Integration – Integrate data from multiple sources and systems, ensuring data is appropriately structured and made available for downstream consumption.
  • Maintain Data Quality – Implement data validation, cleansing and quality checks to identify inconsistencies, missing values, duplication and other data-related issues.
  • Optimise Data Pipeline Performance – Monitor and improve data processing workflows to enhance execution efficiency, reliability and processing performance.
  • Troubleshoot Data Engineering Issues – Investigate and resolve data pipeline failures, transformation errors, data discrepancies and processing issues through systematic debugging and root-cause analysis.
  • Support Data Consumption Requirements – Work with data analysts, data scientists and business stakeholders to prepare and deliver datasets for analytics, reporting and other downstream applications.
  • Maintain Technical Documentation – Prepare and maintain documentation covering data pipeline workflows, transformation logic, data mappings, technical specifications and operational procedures.
  • Collaborate with Cross-Functional Teams – Work closely with application development, data analytics, infrastructure and business teams to support data integration and delivery requirements.
  • Drive Continuous Improvement – Identify opportunities to automate manual data processes, improve data processing workflows and enhance the overall reliability of data engineering solutions.

MUST-HAVE REQUIREMENTS

Technical

  • Proficiency in Python programming for data processing, transformation and automation.
  • Strong SQL skills, including data extraction, querying, manipulation and transformation.
  • Hands-on experience developing and maintaining ETL/ELT processes.
  • Practical experience building and maintaining automated data pipelines.
  • Understanding of data integration, data transformation and data processing concepts.
  • Experience performing data cleansing, validation and quality checks.
  • Ability to troubleshoot data pipeline failures and resolve data processing issues.
  • Understanding of data structures, relational database concepts and data management principles.

Functional

  • Understanding of data engineering principles and end-to-end data processing workflows.
  • Ability to translate business and data requirements into technical data processing solutions.
  • Familiarity with data ingestion, transformation and downstream data consumption requirements.
  • Understanding of data quality, consistency and data integrity.
  • Ability to work with data analysts, data scientists, application developers and business stakeholders.

Experience

  • Relevant hands-on experience in data engineering, data pipeline development or ETL/ELT implementation.
  • Experience developing data processing scripts using Python and SQL.
  • Experience working with structured data and integrating data from multiple sources.
  • Experience supporting data pipeline maintenance, troubleshooting and optimisation.

Minimum years of experience: 4-6 years of experience

Education

  • Degree or diploma in Computer Science, Information Technology, Data Engineering, Data Science or a related discipline.
  • Equivalent relevant professional experience may be considered, subject to hiring requirements.

Competencies

  • Strong analytical and problem-solving skills.
  • Good attention to detail and data accuracy.
  • Ability to investigate and resolve complex data-related issues.
  • Good communication and stakeholder collaboration skills.
  • Ability to work independently and collaboratively within a technical team.
  • Strong organisational skills and commitment to delivering reliable data solutions.

GOOD-TO-HAVE REQUIREMENTS

The following would be advantageous but are not mandatory:

  • Experience working with large-scale data processing environments.
  • Exposure to cloud-based data engineering platforms.
  • Experience with data warehousing and data lake concepts.
  • Familiarity with workflow orchestration and scheduling tools.
  • Experience with distributed data processing technologies.
  • Exposure to data modelling and database design.
  • Experience implementing data quality monitoring and validation frameworks.
  • Familiarity with version control and collaborative software development practices.
  • Experience working within Singapore Government agencies, statutory boards or public-sector technology environments.
  • Exposure to Agile development methodologies.
  • Relevant data engineering or cloud-related certifications.
Apply on MyCareersFuture

You apply on MyCareersFuture, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.

Get new jobs like this by email

Data & AI · Singapore

Free. Confirm by email first; unsubscribe anytime in one click.

Similar jobs

Data Engineer - #1823 at Jobster Private Ltd. — Singapore | Rivet Commerce job board