Responsibilities
- Develop and maintain data pipelines for data ingestion, transformation and consumption.
- Build ETL/ELT processes using Python, PySpark andSQL.
- Support data engineering activities on Snowflake,Databricks and Cloudera Data Platform.
- Perform data extraction, cleansing, transformation and loading.
- Assist in migrating data from legacy systems to enterprise data platforms.
- Develop and maintain data integration workflows.
- Perform data validation, reconciliation and quality checks.
- Support data modelling and data warehouse development.
- Assist with data encryption, masking and security implementation.
- Troubleshoot pipeline issues and provide production support.
- Participate in testing, deployment and technical documentation.
Requirements
- Bachelor's degree or diploma in Computer Science, IT, Engineering or related discipline.
- Experience in data engineering,ETL development or software development.
- Good programming skills in Python, PySpark and SQL.
- Experience with Snowflake, Data bricks or ClouderaData Platform.
- Understanding of ETL/ELT, data warehouses and data integration.
- Knowledge of Oracle, SQL Server, MySQL or PostgreSQL databases.
- Familiarity with Informatica, Autosys or other ETL/scheduling tools will be an advantage.
- Basic understanding of cloud platforms and big data technologies.
- Familiarity with Git, GitLab and DevOps practices.
- Good analytical and problem-solving skills.
Apply on MyCareersFuture
You apply on MyCareersFuture, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.
