Data Engineer (SQL, Azure Databricks, PySpark, Azure Data Factory, Python, Azure DevOps, Power BI, Delta Lake, ETL)
6500 - 8000 SGDTemporary
EXASOFT CONSULTING PTE. LTD.
Responsibilities:
- Develop and maintain reliable data pipelines for business and analytical applications.
- Use Azure Data Factory and Azure Databricks to manage data ingestion, transformation, and processing workflows.
- Write optimized SQL, Python, and PySpark code for data preparation and processing.
- Work with Delta Lake and Google BigQuery for storing and managing analytical data.
- Monitor data processes and identify data-related issues using data observability practices.
- Build and maintain REST API integrations for exchanging data between applications and services.
- Process and validate JSON data used within data and API workflows.
- Support automated build and deployment activities through Azure DevOps.
- Develop Power BI dashboards and reports to present data-driven insights.
- Perform API and application performance testing using JMeter to assess response time, reliability, and system performance.
- Investigate technical issues, improve processing efficiency, and coordinate with relevant teams to resolve data-related challenges.
Requirements:
- Qualification in Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related technical discipline.
- 4+ years of professional experience in Data Engineering, Data Analytics, or a related technical role.
- Strong Hands - on experience with SQL and Azure Databricks for data processing and analytical workloads.
- Strong Experience in PySpark, Python, and Azure Data Factory for developing and managing data processing workflows.
- Experience in practical knowledge of Azure DevOps, Delta Lake, REST API, JSON, and Google BigQuery.
- Experience in working with cloud-based data platforms and developing scalable data pipelines.
- Strong Experience of Data Observability, data monitoring, and data reliability practices.
- Experience in developing Power BI dashboards and reports for business and analytical requirements.
- Hands - on experience in JMeter for API, load, or performance testing.
- Hands - on experience in ETL.
- Experience in Anomaly
- Strong analytical, troubleshooting, and problem-solving skills.
- Good communication and collaboration skills with the ability to work effectively with cross-functional teams.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer (SQL, Azure Databricks, PySpark, Azure Data Factory, Python, Azure DevOps, Power BI, Delta Lake, ETL) in Singapore vacancy
- ...Role Overview We are seeking a skilled Data Engineer with hands-on experience in Python, PySpark, and SQL to design, develop, and maintain scalable data pipelines that support enterprise analytics and reporting. The ideal candidate will have strong experience in data...
6500 - 8000 SGD
...Responsibilities ~ Design, develop, and maintain scalable data pipelines for ingesting, transforming, validating, and... ...and semi-structured data. ~ Develop data engineering solutions using Databricks, PySpark, and Apache Spark for large-volume data processing and...6500 - 8500 SGD
...is currently implementing a new Data Platform where data will be... ...questions. The Senior Data Engineer will mentor data engineers to build... ...services. Help maintain data lakes and database infrastructure to... ...one programming language such as Python, Java, or Scala for data...- ...Job Summary We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, and SQL to design, develop, and optimize scalable data pipelines and ETL processes. The ideal candidate should have experience working with large-scale datasets, distributed...
7000 - 12000 SGD
...client in hiring an experienced Senior Data Engineer / Lakehouse Engineer to design, build, and... ..., and operationalize enterprise Data Lake/Lakehouse platforms, data products, and data... ...Apache Iceberg, Apache Hudi, and Delta Lake . Develop data pipelines and platform...8000 - 9000 SGD
...We are hiring and the details of the position are: Job title: Data Engineer (Perm role with VB, Azure DevOps, Python, Databricks, up to $9k) #IRT Office Location: Raffles Place Candidate will report to the Data and Analytics Lead Job Responsibilities: 1. Data...7500 - 9000 SGD
...Singapore government organisation looking for a Data Engineer to join their Platform team. The role... ...or business intelligence. ~ Strong SQL skills and experience with data transformation... ...equivalent. ~ Hands-on experience with BI and visualisation tools such as Power BI,...10000 - 10700 SGD
...Job Summary The Data Engineer will design, develop, and maintain scalable, reliable data pipelines on Databricks and cloud platforms, integrating diverse data sources to support analytics... ...Design, develop, and maintain ETL pipelines for centralized data storage systems...4000 - 4500 SGD
...Data engineer (Azure) Synapse and Pyspark, Python, Datawarehouse and Azure Data Explorer, Azure Devops J ob Scope • Design, review and development of Pyspark scripts. Testing, troubleshooting of data pipelines, orchestration. • Designing and developing reports...6000 - 12000 SGD
...seeking a hands-on experience in Databricks with deep technical expertise... ...optimizing Lakehouse-based data and AI solutions. In this role... ..., develop, and operationalize Delta Lakehouse architectures using... ...delivery, and mentor engineering teams in best practices across...- ...Description Bachelor's degree in Computer Science, Data Science, Software Engineering, Information Systems, or a related field; Master'... ...hands-on experience designing and implementing Azure-based data platforms with Databricks. Strong proficiency in Python (PySpark) and...
1 SGD
*Seeking for a Data Analyst with minimum 1 yearof hands-on automation/business process improvement with Python/SQL/PowerAutomate, Power BI and Power Query tools* THE COMPANY With their international and solid presence, this Commodities MNC is expanding. They are seeking...6000 - 8500 SGD
...Data Engineer – Databricks / Lakehouse Location: Alexandra Building Contract Duration: 12 Months Experience: Minimum 6 years of relevant... ...experience in Data Engineering, Databricks, Apache Spark, PySpark, Python and SQL , with exposure to modern Data Lake/Lakehouse...5000 - 7000 SGD
...We are looking for a Data Engineer to design, build, and support reliable data ingestion and transformation pipelines on AWS and Databricks. The role will work with architects, engineers, QA, and... ...Bronze, Silver, and Gold layers using SQL, Python/PySpark, and Delta Lake. Implement...- ...Singtel Group. Job Description The Data Engineer will be responsible for designing,... ...scalable and reliable data pipelines on Databricks and cloud platforms. The role requires integrating... ...What will you do? Develop and maintain ETL pipelines for centralized data storage...
6200 - 6700 SGD
...gather and validate reporting requirements.Understand data source mapping and transformation logic. Report Development... ...for financial or trading systems. Proficiency in PySpark , SQL , data transformation , and ETL concepts . Hands-on experience with reporting...6000 - 13000 SGD
...Role Overview We are seeking a skilled and experienced Databricks Data Engineer to join our data platform team. In this role, you will design... ...Lakehouse platform. You will implement best practices using Delta Lake, Apache Spark, and Unity Catalog to ensure our data infrastructure...50 SGD
...technology industry. Job Description Develop and maintain data pipelines using Azure Data bricks to help business requirements. Design and... .... Contribute to the continuous improvement of data engineering practices. The Successful Applicant A successful Azure...6500 - 8500 SGD
...Job Description The Data Engineer will be responsible for designing, developing, and maintaining... ...scalable and reliable data pipelines on Databricks and cloud platforms. The role requires... ...What will you do? • Develop and maintain ETL pipelines for centralized data storage systems...9000 - 20000 SGD
...Senior Data Lakehouse Architect Client: Bank Sector Client... ...vision, target architecture, and engineering standards for modern data platforms... ...Data, Data Architecture, Data Lake, or Lakehouse implementations.... ...and cloud platforms such as: Databricks, Snowflake, Cloudera, Azure,...- ...We are building a fast-growing Databricks practice delivering enterprise data and AI solutions across APAC. As Lead Solution Architect – Data Engineering, you will be the technical anchor of the practice... ...Unity Catalog, and downstream BI/ML enablement. Lead large-scale migrations...
6000 - 11000 SGD
...and passion first. You’re a data enthusiast who thrives on... ...technical expertise in AWS and Databricks , you design robust, scalable... ...performance data pipelines that power intelligent decisions. Curious... ...Consultant: As a Data Engineer Consultant, you’ll play a key...8000 - 15000 SGD
...ingestion framework to ingest data from various data sources for... ...pipelines from source to data lake pipelines. - Automating data... ...other stakeholders such as data engineering team, IT team, etc. -... ...• Proficient with Scala and PySpark. • Hands-on experience on Spark...7000 - 8800 SGD
...The Data Engineer will be responsible for designing, developing, and maintaining scalable and reliable data pipelines on Databricks and cloud platforms. The role requires integrating diverse data sources... ...you do? Develop and maintain ETL pipelines for centralized data...4800 - 5800 SGD
...is a global leader of end-to-end data & analytics solutions with nearly... ...a better place by leveraging the power of data. We are hiring aspiring / proven data engineers to join us. Roles and Responsibilities... ..., build, and maintain scalable ETL pipelines using Python....- ...seeking a hands-on experience in Databricks with deep technical expertise... ...optimizing Lakehouse-based data and AI solutions. In this role... ..., develop, and operationalize Delta Lakehouse architectures using... ...delivery, and mentor engineering teams in best practices across...
6500 - 8500 SGD
...We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable... ...Improvement Monitor and maintain databases and ETL platforms, including performance tuning,... .... Strong programming skills in Python SQL Shell Scripting Experience with...3340 SGD
...Data Analyst [Power BI & Excel | Up to $3,340] Job Details Contract Duration: 6 months Salary: Up to S$3,340 per month Nearest MRT... ...using data visualisation tools such as Power BI, Tableau or Databricks. Familiarity with AI tools, workflow automation platforms...9000 - 11000 SGD
...Job Summary We are looking for a Senior Data Engineer with strong experience designing and... ...scalable data platforms across Microsoft Azure and AWS ecosystems. The candidate will be... ...building high-performance data pipelines, data lakes, and real-time data ingestion frameworks...11500 - 13000 SGD
...Job Summary We are seeking a Principal Data Architect to lead the design and implementation of enterprise-scale cloud data... ...Data & AI architecture and cloud data platforms. Lead Databricks Lakehouse, Delta Lake, DLT and Unity Catalog implementations. Develop scalable...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer (SQL, Azure Databricks, PySpark, Azure Data Factory, Python, Azure DevOps, Power BI, Delta Lake, ETL). Be the first to apply!
