Data Engineer (Python, Databricks, Up to 6 months VB)
6000 - 8000 SGDFull-time
Recruit Express Pte Ltd
Data Management &Transformation
- Designing and developing new data pipelines and managing existing data pipelines that extract data from various business applications, databases, and external systems.
- Implementing data quality checks and validations within data pipelines to ensure the accuracy, consistency, and completeness of data.
- Transforming data into the desired format by applying data cleansing, aggregation, filtering, and enrichment techniques.
- Establishing the governance of data and algorithms used for analysis, analytical applications, and automated decision-making.
- Manage the logical and physical data models to capture the structure, relationships, and constraints of relevant datasets.
- Ensuring compliance with security and governance best practices
Optimization & Automation
- Implementing and maintaining continuous integrations and continuous delivery pipelines for deployments and cloud resource provisioning.
- Optimising data pipelines and data processing workflows for performance, scalability, and efficiency.
- Optimising models and algorithms for data quality, security, governance, performance and scalability needs.
- Routinely assessing processor and storage capacity across the data warehouse and extract transform & load platforms, including capacity planning and forecasting.
- Monitoring and tuning data system, identifying and resolving performance bottlenecks, issues, and implementing caching and indexing strategies to enhance query performance.
- Monitoring the platform for credit consumption and housekeeping.
- Supporting the deployment and maintenance of AI solutions in the data platform.
Collaboration
- Working with data lead and business users to manage data as a business asset.
- Guiding the business users to create and maintain reports and dashboards.
Job Requirements:
- Bachelor’s degree in computer science, data science, software engineering, information systems, or related quantitative field
- Work experience in data management disciplines, including data integration, modelling, optimization and data quality, or other areas directly relevant to data engineering responsibilities and tasks.
- Work experience in designing and implementing data architectures in Azure cloud services and Databricks .
- Strong proficiency in Python (PySpark) and SQL programming ; experience with Java or Scala is an advantage.
- Experience with relational and non-relational databases including SQL and NoSQL is a must while familiarity with legacy databases such as Oracle is preferred.
- Experience using Azure DevOps, Databricks LakeFlow Jobs for DevOps practices including version control, CI/CD and pipeline deployment.
- Experience with data catalogue tools including Unity Catalog and Microsoft Purview.
- Familiarity with BI & visualisation tools such as Power BI and Python visual packages for data analytics is preferred.
- Experience supporting AI/ML model deployment, feature engineering and production inference is preferred.
Interested applicants please send your resume to View email address on mycareersfuture.gov.sg
Venessa Goh Wee Ni
R24124686
Recruit Express Pte Ltd
EA License No: 99C4599
We regret that only shortlisted candidates will be contacted.
Vacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer (Python, Databricks, Up to 6 months VB) in Singapore vacancy
4000 - 6000 SGD
...~2 to 4 years of hands-on experience in data engineering and analytics ~ Strong skills in statistical... ...tools and programming languages such as Python, R, etc. ~ Experience with data... ...tools and software like Power BI, Looker, Databricks etc. ~ Proficiency in SQL for data...5000 - 7500 SGD
...Description: ~5 years of hands-on experience in data engineering and analytics. ~ Strong skills in... ...tools and programming languages such as Python, R, etc. ~ Experience with data... ...tools and software like Power BI, Looker, Databricks etc. ~ Proficiency in SQL for data extraction...5000 - 7500 SGD
...Establishing AI governance and guardrails in collaboration with Security, Risk, Legal and Data teams (privacy, IP, data handling, model risk). Coordinating with product, engineering and data science teams to pilot, validate, and scale AI solutions; manage delivery plans,...4500 - 5500 SGD
...InfoCepts is a global leader of end-to-end data & analytics solutions with nearly 20 years... ...We are hiring aspiring / proven data engineers to join us. Roles and Responsibilities... ...and maintain scalable ETL pipelines using Python. Extract data from various sources and...9600 - 11000 SGD
...Job Description · We are looking for an experienced Senior Data Engineer – Databricks to design, develop, and maintain scalable data pipelines on... ...such as ACID transactions and schema evolution. · Strong Python programming for data processing and automation. · Experience...6500 - 8000 SGD
...We are hiring and the details of this position are: Job title: Data Engineer (Perm role with up to 6mth VB, up to $8000 basic, Azure DevOps, Python) This role will report to Data and Analytics Lead. Job Description: Data Management & Transformation Designing...6000 - 8000 SGD
...Involve in development and system integration relevant systems with CDP / CDSW. ~ Hands-on experiences on Big Data solution and development based on Python technologies stack to design and implement secure, scalable and high-performance data processing pipelines. ~...6000 - 9000 SGD
...Strong understanding of Cloudera framework including CDP (Cloudera Data Platform) and CDSW (Cloudera Data Science Workbench) Hands-on experience in Big Data solution and development based on Python technologies stack Design and implement secure, scalable and high-performance...6500 - 8500 SGD
...Position: Senior Data Engineer/Data Lead - Databricks Location: Singapore Purpose of the Position: The Senior Data Engineer / Data Lead will be... ...platforms. Develop scalable data processing workflows using Python and PySpark for large-scale structured and semi-...8500 - 10000 SGD
...Requirements Minimum 8 years of experience in data engineering or related roles At least 2–3 years of hands-on experience with the Databricks platform Proven track record of... ...Azure, or GCP) Strong programming skills in Python, Scala, or SQL Experience with Spark...6000 - 9000 SGD
...development and maintenance of enterprise data products within our organisation's data platform... ..., we are looking for experienced data engineers to join our team who will be responsible... ...Development and Analytics Develop Python scripts in AWS Glue for data processing and...4000 SGD
...Data Analyst Supports scalable reporting, dashboard maintenance, and data preparation... ...guidance. Requirements Basic Databricks, intermediate SQL, advanced Excel, and basic... ...Education ~ Diploma or Degree in Computer Engineering, Computer Science, or a related field....7500 SGD
...Senior Data Analyst Proven ability to work across multiple markets, delivering... ...Requirements Advanced expertise in Databricks, SQL, Python, and Power BI, along with data modeling... ...degree in computer science, Data Analytics, Engineering, or a related field. Interested...5000 - 5500 SGD
...inference of generative AI models on the Databricks platform. You will work closely with cross... ...developing deep expertise in modern data and AI platforms. This role offers hands... ...Bachelor’s Degree in Computer Science, Engineering, Data, or a related field Advanced proficiency...5000 - 5900 SGD
...performance-related analysis with validation checks. • Develop dashboards/reports in Power BI or Qlik. • Support ETL processes and manage data in Snowflake. • Provide ad-hoc data pulls for various business units. Requirements • 2–4 years’ experience in BA, data...12000 - 24000 SGD
...of what's possible. As a Lead Software Engineer at JPMorganChase within the Electronic Trading... ...seek candidates with strong expertise in any of Python/KDB, and who can leverage their knowledge of AI to drive innovation in data engineering, analytics, and automation....8000 - 11000 SGD
...Role Overview Python-focused Data Engineer with strong hands-on coding skills in data-intensive systems. The role focuses on building scalable data pipelines,processing large datasets, and enabling AI/Generative AI applications through well-structured data infrastructure...6000 - 7500 SGD
...With good experience in design and built data pipeline (Fabric / Databrick) are welcome... ...operationalisation of the Microsoft Fabric / Databricks data platform. Design and implement... ...Science, Information Systems, Data Engineering, Engineering, or a related field. With...7500 - 9000 SGD
...As a Databricks SME, you will be responsible for providing expert guidance... ...design, develop, and deploy data pipelines and analytics... ...Spark. Collaborate with data engineers, data scientists, and business... ...Excellent programming skills such as Python, Scala, or SQL. Experience...37 SGD per hour
...Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot – that’s how we refer to this role at Mindrift – you’ll collaborate...40 SGD per hour
...Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot – that’s how we refer to this role at Mindrift – you’ll collaborate...7500 - 8000 SGD
...with the work actually executed Issue such further instructions and clarifications of details as and when required; and to inform Engineer for issuance of Engineer's Instruction or Engineer's clarification. Requirements: At least 5 years of relevant experience A...3000 - 4500 SGD
...Job Summary Seeking a Junior data/analytics professional responsible for analyzing banking data using SQL and Python, supporting data architecture and reporting, and collaborating with users to gather requirements and resolve issues. Mandatory Skill-set Must have...3000 - 3600 SGD
...Responsible in writing test cases, preparing and creating test data, executing and retesting test cases. Able to leverage on inhouse... .... Job Qualifications Degree in Computer Science, Engineering, or similar technical certifications. At least 2-3 years of experience...6000 - 8500 SGD
...Required: 4 Years Job Description: Data Transformation Query, clean, and transform datasets using SQL and Python on the Databricks platform. Ensure data quality and consistency... ...-quality work. Benefits: ~ Fixed Monthly Salary ~12 days AL ~14 days MC ~60...4000 - 5500 SGD
...Key responsibilities Write test cases, prepare and create test data, execute and retest test cases Leverage in-house GenAI for... ...practices across operations About you Degree in computer science, engineering, or similar technical certifications At least 2-3 years of...- ...limits of what's possible. As a Lead Software Engineer at JPMorganChase within the Electronic... ...seek candidates with strong expertise in any of Python/KDB, and who can leverage their knowledge of AI to drive innovation in data engineering, analytics, and automation. Experience...
2000 - 2200 SGD
...West area (pick up jurong east / cck / woodland) salary up to 2.2k 6 months office hour monday to friday Responsibilities: • Perform QC testing and review of QC data to support the timely release of GeneChip arrays. • Provide data trending and assist team leads...3000 - 3600 SGD
...Reconcilation Officer Duration: 6 Months Location: Changi Biz Park Salary: Up to $3,600 Responsibilities: 1. Assist in managing reconciliation system processes, including static data updates, statement data uploads, and monitoring upstream data feeds. 2. Support...7000 - 8500 SGD
...years of relevant experience required. ~ Strong proficiency in Python , with experience in FastAPI ~ Experience developing and... ...(Azure OpenAI API, HuggingFace, etc.) ~ Background in data engineering —working with large-scale unstructured text, ETL workflows ~...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer (Python, Databricks, Up to 6 months VB). Be the first to apply!
