Data Engineer
Unison Group New Zealand
- Oversee day-to-day operations of big data platform to ensure high availability, reliability and performance.
- Proactively monitor big data platform services, components and clusters to identify potential issues. Take corrective actions as needed to maintain platform health
- Manage configuration, upgrades, and patching of big data platform, ensuring all services are up to date
- Work with the Authority's technical teams to ensure smooth deployment and adoption of new solution to support data ingestions, process and workflows
- Maintain clear and detailed documentation of platform configuration, troubleshooting steps and incident resolution.
- Continuously monitor for and address platform security vulnerabilities. Implement patching strategies to resolve identified vulnerabilities and maintain a secure environment.
- Develop automation script to streamline administrative tasks, platform health and ensure operational consistency.
- Ensure the smooth operations and service level of IT solutions.
- Support production issues Requirements
- Hands-on experience, knowledge and troubleshooting of Cloudera Data Platform such as HDFS, YARN, HIVE, Spark, Impala, Ranger, operating systems, security and network.
- Hands on experience with monitoring tools like Cloudera Manager, Zabbix, Grafana, Splunk, SyslogNG
- Familiarity with middleware applications i.e. Informatica, Denodo and scripting languages like bash, python, or shell scripting for automation
- Experience with cloud technology i.e. AWS, Azure is a plus
- Ability to troubleshoot complex issues ranging from system resource to application stack traces.
- Track record in implementing systems with high availability, high performance, high security hosted at various data centres or hybrid cloud environments will be an added advantage.
- Cloudera Certified Administrator or similar certification are a plus.
- Excellent communication skill to work with cross-functional teams
- Ability to handle high-pressure situations and manage critical incidents
Vacancy posted 19 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Singapore vacancy
7500 - 9000 SGD
...Key Responsibilities Design, build, and maintain reliable data pipelines and data-processing workflows. Integrate data from... ...Maintain relevant technical documentation, operational procedures, and engineering standards. Requirements Around 4–7 years or more of...6800 - 7000 SGD
...Role Overview Support the design and development of data ingestion and ETL processes used within the Quantexa demo environment. Required Skills: • Apache Spark • ETL development • Data integration • Data transformation • Data modelling • Elasticsearch / OpenSearch...6000 - 10000 SGD
...We are seeking a Data Engineering & Analytics Engineer to design, build, and support enterprise-grade data platforms and pipelines. This role is responsible for the end-to-end data lifecycle, including ingestion, transformation, modelling, quality management, governance, and...7000 - 12000 SGD
...We are currently working with a cutting edge research firm to seek a motivated Data Engineer to join their team in Singapore. You’ll be the architect and maintainer of the pipelines, data models, and infrastructure that power our industry models, research, and consulting work...4000 - 4500 SGD
...The Data Engineer plays a key role in designing, building and optimising data solutions. This role leads and guides a team of data engineers across data architecture, ETL pipelines and business rule transformation. Expertise in data integration, processing and visualization...7000 - 9000 SGD
...Overview We are seekinga Data Engineer to design, develop, and support enterprise data platforms,cloud-native data architectures, analytics applications, and AI-enabledsolutions. The role combines hands-on data engineering, solution consulting,client engagement, and pre...9000 - 12000 SGD
...Our client, one of Asia-Pacific’s leading organizations is looking for: Data Engineer Responsibilities: Design, build, and operate production-grade data pipelines for data extraction, ingestion, transformation, and loading (ETL/ELT) Integrate data from on-premises...6000 SGD
...Data Engineer RESPONSIBILITY - Design, develop and deploy data tables, views and marts in data warehouses, operational data store, data lake and data virtualization. - Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part...4000 - 5500 SGD
...Description Design, develop and deploy data tables, views and marts in data warehouses, operational data store, data lake and data... .... AWS, Azure, Google Cloud). Experience and passion for data engineering in a big data environment using Cloud platforms such as GPC, GCC...9000 - 14000 SGD
...Intro to the Role and Team We are expanding our Singapore Infrastructure & Data Systems Hub to power Luma's next-generation multimodal foundation models and Physical AI pipelines. As a Data Engineer, you will join an agile engineering group that builds and operates the core...7000 - 12500 SGD
...implemented system functionality. Perform impact analysis and resolve production defects. Manage daily operation chores/nightly data refresh in the IBM PA project and share observations if any. Fix data load failure, errors and warnings. Variance analysis/ data...4000 - 5000 SGD
...Job Summary Design, develop, and maintain scalable data infrastructure and pipelines to support data-driven products. Collaborate... ...cloud platforms such as AWS, Azure, or Google Cloud for big data engineering Experienced in building production-grade data pipelines and ETL...8000 - 8500 SGD
...Responsibilities: Design and operate production-grade ETL/ELT data pipelines for data ingestion, transformation and loading.... ...and improve performance, reliability and cost. Apply software engineering practices including Git, automated testing, CI/CD and Infrastructure...6000 - 9000 SGD
..., leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2025 global revenues of €22.5 billion. Responsibilities Own end to end data pipeline design and delivery Design data models and storage architectures...5400 - 8300 SGD
...Position Overview We are looking to recruit several Data Engineers to design, develop, and maintain scalable, secure, and high-performance data platforms that enable efficient data collection, storage, processing, and analytics. In this role, you will build robust batch...4500 - 8000 SGD
...About EPAM EPAM is a leading global provider of digital platform engineering and development services. EPAM has been expanding in Singapore... ..., and grow with us. What You’ll Do Design and deliver data tables, views and marts across data warehouse, data lake and operational...8000 - 11000 SGD
...What We're Looking For ~ Bachelor’s in Computer Science, Data Engineering, or related field. ~4+ years of experience in data engineering & pipeline development. ~ Strong expertise in SQL (PostgreSQL) and Python (Pandas / PySpark). ~ Hands-on experience with Kafka, AWS...5000 - 8000 SGD
...Proficient in general data cleaning and transformation (e.g. SQL, pandas, R, etc) to ensure data accuracy and consistency. Proficient... .... AWS, Azure, Google Cloud). Experience and passion for data engineering in a big data environment using Cloud platforms such as GPC, GCC...- ...Design, develop, and maintain scalable ETL/ELT pipelines using Python, PySpark, and SQL . Perform data extraction, transformation, and loading from multiple source systems into enterprise data platforms. Develop reusable data transformation logic to support business...
5000 - 8000 SGD
...Data Engineer Roles &Responsibilities We are seeking Data Engineer to establish and lead our data infrastructure. The successful candidate will be responsible for building our data engineering practice from the ground up, implementing robust data systems for industrial...8000 - 14000 SGD
...Role Overview We are looking for a Data Engineer to help build, maintain, and scale our data infrastructure. You will work closely with product, finance, growth, and leadership teams to ensure our business has accurate, reliable, and useful data for decision-making....8000 - 12000 SGD
• Strong hands-on experience with PySpark and Python for data engineering. • Experience developing ETL pipelines using AWS Glue. • Proficiency with AWS Step Functions for workflow orchestration. • Experience building serverless solutions using AWS Lambda. • Hands-on...5000 - 6000 SGD
...ONLY (require security clearance) Location: Ang Mo Kio Working Days/ Hours: Mon-Fri: 8.30am to 6pm Role Overview As a Data Engineer, you will design, build, and operate scalable, secure, and high-performance enterprise data platforms and ETL pipelines that...10000 - 18000 SGD
...As a Lead Data Engineer, you will provide technical leadership, incident management expertise, and strategic oversight in ensuring the reliability, security, and scalability of mission-critical data platforms. You will be responsible for defining and implementing best practices...11250 - 22500 SGD
...About the role We are looking for an ambitious, high-energy Data Operations Engineer to join our team in Singapore. We want someone with strong views on how things should work — and the technical ability and determination to make it happen. The ideal candidate looks at repetitive...8000 - 12000 SGD
...Our client, one of Asia-Pacific’s leading organizations is looking for: Data Engineering and Analytics Requirements: Minimum 3–5 years of experience in data engineering, cloud data engineering, analytics engineering, software engineering, or a related discipline...8000 - 9000 SGD
...Brief Summary: Join a dynamic team as a Data Engineer, where you'll lead the creation of innovative data solutions. This role offers the opportunity to bridge business needs with technical implementations while shaping the technology road map. Responsibilities: Collaborate...16000 - 22000 SGD
...to the Role and Team We are expanding our Singapore Infrastructure & Data Systems Hub to power Luma's next-generation multimodal foundation models and Physical AI pipelines. As a Senior Data Engineer, you will lead the design and scaling of the core data engines feeding our...10000 - 10700 SGD
...Job Summary The Data Engineer will design, develop, and maintain scalable, reliable data pipelines on Databricks and cloud platforms, integrating diverse data sources to support analytics, reporting, and machine learning. Collaborate with cross-functional teams to enhance...4000 - 4500 SGD
...Candidates without prior experience are welcome to apply as on the job training would be provided. Data engineer (Azure) – Synapse and Pyspark, Python, Datawarehouse and Azure Data Explorer, Azure Devops Job Scope • Design, review and development of Pyspark scripts...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
