Senior LLM Inference Performance & Evaluation Engineer
Full-time
Bitdeer Technologies Group
About Bitdeer:
Bitdeer is a world-leading technology company for Bitcoin mining and AI cloud.
Bitdeer is committed to providing comprehensive Bitcoin mining solutions for its customers. Apart from designing industry-leading ASIC chips and manufacturing mining rigs, the Group handles complex processes involved in computing across the value chain. This includes equipment procurement, transport logistics, datacenter design and construction, equipment management, and network and facility operations. Bitdeer also offers advanced cloud capabilities to customers with a high demand for artificial intelligence. Headquartered in Singapore, Bitdeer operates globally with a diversified 3 GW energy portfolio, and deploys Bitcoin mining and HPC datacenters in the United States, Bhutan, Norway, Canada, Malaysia, and Ethiopia. What you will be responsible for:
- Build benchmark pipelines for TTFT, inter-token latency, output throughput, request latency, concurrency curves, error rate, and GPU utilization.
- Create model launch gates covering OpenAI/Anthropic compatibility, streaming behavior, tool calling, reasoning output, multimodal behavior, and long-context cases.
- Maintain representative workloads using synthetic, replayed, and customer-like traffic patterns for both steady-state and burst scenarios.
- Compare model/runtime/provider options and publish clear recommendations for routing, fallback, pricing, and capacity decisions.
- Automate regression detection in CI/CD and staging so model, runtime, or configuration changes do not silently degrade quality, latency, or cost.
- Work with runtime engineers to identify bottlenecks and verify improvements; work with SRE to convert benchmark results into SLOs and alert thresholds.
How you will stand out:
- 5+ years in ML infrastructure, performance engineering, model evaluation, QA automation, or backend testing for production systems.
- Experience with LLM serving metrics such as TTFT, TPOT/ITL, request latency, token throughput, concurrency, and GPU utilization.
- Strong Python skills for benchmark/evaluation automation; Go experience is a plus for integrating with platform services.
- Familiarity with OpenAI/Anthropic APIs, vLLM/Dynamo/SGLang/Triton-style servers, and Kubernetes-based test environments.
- Able to design statistically meaningful tests and communicate tradeoffs between model quality, latency, reliability, cost, and customer experience.
- Experience building dashboards, reports, and release gates for engineering, product, and business stakeholders.
What you will experience working with us:
- A culture that values authenticity and diversity of thoughts and backgrounds;
- An inclusive and respectable environment with open workspaces and exciting start-up spirit;
- Fast-growing company with the chance to network with industrial pioneers and enthusiasts;
- Ability to contribute directly and make an impact on the future of the digital asset industry;
- Involvement in new projects, developing processes/systems;
- Personal accountability, autonomy, fast growth, and learning opportunities;
- Attractive welfare benefits and developmental opportunities such as training and mentoring.
--------------------------------------------------------------------
Bitdeer is committed to providing equal employment opportunities in accordance with country, state, and local laws. Bitdeer does not discriminate against employees or applicants based on conditions such as race, colour, gender identity and/or expression, sexual orientation, marital and/or parental status, religion, political opinion, nationality, ethnic background or social origin, social status, disability, age, indigenous status, and union.
#LI-ST1
Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the Senior LLM Inference Performance & Evaluation Engineer in Singapore vacancy
- ...in the United States, Bhutan, Norway, Canada, Malaysia, and Ethiopia. About the team We are seeking a Senior Inference Runtime Engineer to own the performance-critical serving layer of the MaaS platform. This role focuses on making self-hosted LLMs faster, cheaper, and...
4500 - 11000 SGD
...Develop and maintain AI evaluation frameworks, regression test suites and automated... ...and evaluation tools to improve the performance of AI agents and LLM-powered applications. Design evaluation... ...collaborate with cross-functional engineering teams. Requirements Bachelor...5000 - 8000 SGD
...Description As a Machine Learning Engineer specializing in Large Language... ...of data privacy, low-latency performance, and product reliability.... ...development. Rigorously evaluate and benchmark State-of-the-Art... ...maintaining high-performance LLM pipelines directly within local...12000 - 13000 SGD
...infrastructure, and AI platform engineering About Our Client Our... ...artificial intelligence, high-performance computing, and digital transformation... .... Develop AI agents and LLM-powered applications. Improve GPU training and inference performance. Design scalable...8000 - 18000 SGD
...Role Overview｜岗位概述 We are looking for a Senior AI Systems Engineer with deep experience in multi-model systems, model routing, AI evaluation, and production AI infrastructure. The... ...策略和决策标准。 Continuously improve routing performance using evaluation results, production...10000 - 18000 SGD
...models, agentic AI, and modern AI engineering. We are looking for an... ...building production-ready LLM applications, AI infrastructure... ...Responsibilities Lead and grow a high-performing Machine Learning Engineering... ...workflows covering model evaluation, experimentation, deployment,...10000 - 20000 SGD
...automation. We're looking for a Backend Engineer (AI)to build the production systems... .... You'll own backend services, inference pipelines and orchestration layers that... ...challenging engineering problems around performance, reliability and scalability Join a high...4500 - 7000 SGD
...Related Services segment is a key growth engine, delivering reliable and efficient energy... ...Key Roles and Responsibilities Support performance monitoring and optimization across power... ...Monitor and analyze plant performance data to evaluate efficiency, heat rate, availability,...14000 - 25000 SGD
...every level understand and improve their performance. From Major League Baseball pitchers to... ...-device.” You will develop and optimize inference pipelines, integrate vendor runtimes on... ...target hardware). Establish and uphold engineering standards: code quality, test strategy,...7000 - 11000 SGD
...company to hire exceptional Machine Learning Engineers across Senior, Staff, Principal and Technical Lead... ...worldwide . Work with the latest LLM technologies and solve challenging real... ...covering data, model training, evaluation, inference and production deployment....12000 - 15000 SGD
...clinical workflows. About Job Engineering Leadership: Scale, mentor,... ...of enterprise-scale LLM applications and Generative AI... ...testing, CI/CD pipelines, and inference optimization. Cross-Functional... ...Tech Adoption: Continuously evaluate, test, and integrate cutting-edge...7000 - 8000 SGD
...AI Engineer (LLM) • Configure and deploy AI agents • Design and build AI-powered workflows, automation pipelines, and agentic systems using AI-native platforms and APIs • Evaluate AI outputs, identify failure modes • Integrate AI capabilities into existing products...4000 - 10000 SGD
...for large enterprises, provides an exciting opportunity for Performance engineers to join hands with highly talented product development teams... ...Candidates with 5 or more years of experience will be considered for senior or lead roles. Education & Experience A bachelor's or...11250 - 22500 SGD
...building and owning TikTok's search engine which provides our users the... ...distribution by combining LLM/VML technologies. 3. Engineering... ...implementation and algorithm performance optimization: be responsible... ...of model training, inference and deployment, and ensure the...9000 - 12500 SGD
...our client, a famous Tech MNC We are looking for a Senior Software Engineer The role will start out as a 6-months contract (... ...TypeScript and internal developer-tooling interfaces. LLM-as-judge, multi-turn evaluation, tool/MCP evaluation, and agent-trajectory analysis....- ...outcomes. About the Role We are hiring a senior LLM/Foundation Model architect to provide... ...focuses on developing, adapting, evaluating, and preparing large language models for... ...infrastructure planning, deployment feasibility, and engineering risk management. The successful...
3400 - 8000 SGD
...for Singaporeans. In this role, you will support the Team Lead in evaluating programmes, strengthening data administrative practices, and... ...consistency, accuracy, and timeliness across divisions and for senior management · Working with internal teams to track programme impact...10000 - 12000 SGD
...We are seeking a Senior Software Engineer to own our ACS embedded-evaluation workstream. You will embed with AI product teams to build the infrastructure, automated... ...pipelines, and observability tools that ensure our LLM agents perform accurately, cost-effectively, and reliably...11250 - 22500 SGD
...Build domain-specific large language models (LLM/MLLM) for e-commerce, integrating domain... ...-tuning (PEFT) to achieve optimal model performance in the e-commerce domain. - Problem... ...training is a plus. - Model Compression and Inference Optimization: Understanding of research...1 SGD
...Models (LLMs). 2) Train, fine-tune, and evaluate deep learning models for computer vision... ...models. 3) Develop AI applications using LLM APIs, Retrieval-Augmented Generation (RAG... ...Requirements: 1) Degree in Electronic Engineering, Computer Engineering, Computer Science,...7500 - 10000 SGD
...The purpose of this role is to lead and manage the paid media performance portfolio which comprise of media channels including Paid Search... ...to deadlines and best practices. At its core, the role of the Senior Performance Manager is to plan and implement paid media campaigns...3000 - 4000 SGD
...Senior Fragrance Evaluator Working Hours: Mon–Fri, 9.30am – 6.30pm Salary: $3,000 – $4,000 Location: Tampines Job Responsibilities: Conduct market research on fragrance trends, competitors, and consumer preferences Collaborate with fragrance team and perfumers...11250 - 22500 SGD
...responsible for building and owning our search engine which provides our users the best search... ...promote model scaling up, optimize model performance and generalization ability, and explore... ...team to enhance the training and inference efficiency of the personalization link to...- ...We are seeking a highly collaborative and rigorous Senior Specialist (Assessment and Evaluation) to lead Recognition of Prior Learning (RPL), including... ...Attainment of the WSQ Advanced Certificate in Learning and Performance (ACLP). Deep Expertise in TAE: A minimum of 8-10...
6000 - 11000 SGD
...of conversion) We are looking for a highly skilled Full Stack Engineer who is passionate about building AI-powered platforms,... ...and intelligent workflow automation. Develop responsive, high-performance user interfaces with React and Next.js, including Server Components...2000 - 3000 SGD
...Overview The Company specializes in vehicle evaluation in Singapore. We uphold values of integrity,... ...exterior, interior, undercarriage, chassis, engine bay, and boot compartments to assess condition and identify issues Perform battery safety and health diagnostics on...- ...communication systems. Responsibilities: Design and implement stress tests for network infrastructures. Simulate Byzantine attacks to evaluate network security and resilience. Collaborate with a cross-functional team to enhance the communication stack. Analyze and...
- ...and regional languages. We are looking for a passionate Senior Data Scientist to help shape the future of open and... ...alignment techniques, and collaborate closely with product and engineering teams to ship safe, reliable LLM-powered features to millions of users. This role offers...
16000 - 31000 SGD
...such as Large Language Model (LLM) applications, Computer... ...Collaborate closely with Product, Engineering, and DevOps teams to productize... ...monitor online model performance, quickly iterate on production... ...issues such as overfitting, slow inference, and insufficient model accuracy...- ...innovation organisation to hire a Junior/Senior Research Engineer to build Agentic Intelligence systems... ...systems, combining Large Language Model (LLM), optimization techniques, and real-... ...tool integration, and workflows Set up evaluation, monitoring, and guardrails (cost,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior LLM Inference Performance & Evaluation Engineer. Be the first to apply!
