Entry-Level AI Agent Evaluator - Remote Freelance, Flexible Hours
25 SGD per hourPart-time
Mindrift
This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates.
At Mindrift , innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI.
What we do
The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe.
About the Role
We’re looking for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You’ll create test cases that simulate human-performed tasks and define gold-standard behavior to compare agent actions against. You’ll work to ensure each scenario is clearly defined, well-scored, and easy to execute and reuse. You’ll need a sharp analytical mindset, attention to detail, and an interest in how AI agents make decisions.
Although every project is unique, you might typically:
- Designing structured test scenarios based on real-world tasks
- Defining the golden path and acceptable agent behavior
- Annotating task steps, expected outputs, and edge cases
- Working with devs to test your scenarios and improve clarity
- Reviewing agent outputs and adapting tests accordingly
How to get started
Simply apply to this post, qualify, and get the chance to contribute to projects aligned with your skills, on your own schedule. From creating training prompts to refining model responses, you’ll help shape the future of AI while ensuring technology benefits everyone.
- You have, or are currently pursuing, a Bachelor's or Master’s degree in Computer Science, Software Engineering, Data Science / Data Analytics, Artificial Intelligence / Machine Learning, Computational Linguistics / Natural Language Processing (NLP), Information Systems or other related fields.
- Your level of English is advanced (C1) or above.
- You are ready to learn new methods, able to switch between tasks and topics quickly and sometimes work with challenging, complex guidelines.
- Our freelance role is fully remote so, you just need a laptop, internet connection, time available and enthusiasm to take on a challenge.
Why this freelance opportunity might be a great fit for you?
- Get paid for your expertise, with rates that can go up to $25/hour depending on your skills, experience, and project needs.
- Take part in a part-time, remote, freelance project that fits around your primary professional or academic commitments.
- Work on advanced AI projects and gain valuable experience that enhances your portfolio.
- Influence how future AI models understand and communicate in your field of expertise.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Entry-Level AI Agent Evaluator - Remote Freelance, Flexible Hours in Singapore vacancy
2000 - 4000 SGD
...independent sales consultant, the way property and insurance agents do. You will introduce Trelinx's AI-powered voice and messaging solutions to SME owners and... ...commission on every deal you close. You set your own hours and territory. Responsibilities Build your client...8000 - 16000 SGD
...About our client Our client is a fast-growing, well-funded AI agent company. The product takes on complex work like deep research,... ...frontier, based in Singapore. About the role You will develop evaluations grounded in product needs, user tasks and how AI models and...- ...AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project...Remote job
- ...AI Agent Power User Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Agent Power... ...to an enterprise AI training project focused on evaluating and improving AI assistants in real-world...Remote job
10000 - 15000 SGD
...Job Description: ~ Design and own the evaluation system for LLM Agents, including benchmark construction, LLM-as-Judge with human annotation, and regression... ...and experiment design. Sustained curiosity about frontier AI, strong self-drive, and the ability to collaborate closely...1100 - 1500 SGD
...About cynapse.ai cynapse.ai is a leading AI software company... ...detail-oriented and curious AI Evaluation & Quality Intern to support... ...time / 5 days a week). We are flexible with start and end dates and... ...environment with flexible hours ⸻⸻⸻⸻⸻⸻⸻⸻⸻⸻⸻⸻⸻⸻⸻ Note: Due...2500 - 4000 SGD
...Pay & Working Arrangement Pay: $2.40 per minute of video transcribed Payout: Monthly, on the 7th Hours: Flexible, 24/7 operations Arrangement: Freelance / Full-Time option Location: Kaki Bukit Air-conditioned, private working environment ✅...30 SGD per hour
...Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up BANGLA AI EVALUATION SPECIALIST Sign up now Up to $30/hr Depending on the project Bachelor's Remote Part-time Flexible hours Opportunity Overview Handshake is looking for...11000 - 16000 SGD
...is an independent, third-party AI assurance company. We build the software and run the evaluations that let enterprises and public-... ...- the overwhelming majority of agent pilots still fail before production... ...-agent) at more than a tutorial level. ~ A real grasp of how agents...4500 - 5500 SGD
...We are looking for AI Data Engineer to work on government projects within Cybersecurity domain: Exciting opportunity to work with... ...insurance) Work location: Punggol (hybrid work arrangement) Entry level candidate with AI + AWS + data engineering related internship are...3700 - 4500 SGD
Job scope: Manage and provide direct technical and application support for process analytics business . Coordinate with sales team, sub vendors Perform troubleshooting and conduct site visit Setup onsite trial and conduct review with customer. Prepare and deliver...- ...is yes, we are looking for you! As a Freelance Brand Evaluator, you will visit EV showrooms and... ...experiences across the automotive industry. Flexibility – each showroom visit takes... ...Benefits This is a freelance, project-based position Flexible working hours...
3500 - 5000 SGD
...pathways ~ Supportive Team Culture - A team that grows with you ~ Flexible work arrangement ~ Performance-based incentives (details... ...open to growth, and be part of a high-energy team, we want to meet you. Shortlisted candidates will be contacted within 24 hours....37 SGD per hour
...About the role Help train and evaluate AI agents on expert-level fluid simulation tasks. You'll take CAD geometry, set up and run simulations, build verified reference solutions, and write Python checks for the agent's results. Requirements A degree in Mechanical...- ...with AIDA To lead the next phase of our AI evolution, we’ve launched a new... ...engineering role that operates the live GenAI agents and builds the evaluation and observability that proves they are... ...keeps agents healthy, performs first-level triage and incident response, and...
2000 - 4000 SGD
...Singapore software company that builds AI-powered voice and messaging... ...Job Summary This is a freelance, full-cycle sales role. You work... ...the way property and insurance agents do. You will take SME decision-... ...-directed in managing your own hours, territory and follow-ups - Reside...1000 - 1600 SGD
...successful project execution. Job Summary Perform data entry and administrative tasks to support bookkeeping, prepare... ...information exchange and task completion Other Information Hourly wage: $14/hr Flexible working hours, typically between 9 AM and 6 PM Office...11500 - 13500 SGD
...We are seeking an experienced Gemini Enterprise Agent Engineer to design, develop, deploy, and govern enterprise AI agents using Gemini Enterprise and generative AI... ...grounding, retrieval-augmented generation (RAG), evaluation, deployment, monitoring, and governance. The successful...2000 - 4000 SGD
...Tipping Point Labs is a founder-led AI consultancy helping Singapore... ...repetitive work like data entry, documents and reporting, and build... .... Our past clients have cut hours of manual work every day and... ...clients. This is a commission-only, flexible role . You set your own hours...1800 - 2000 SGD
Job Description Sweep, mop, and vacuum Condo units Clean and sanitize sinks, microwaves and the exterior surfaces of kitchen appliances ~ Toilet washing ~ Empty all trash and recycling bins Requirements ~ Able to work independently ~ With or without experience...3500 - 5000 SGD
...individuals to join our marketing team. This entry-level position offers an opportunity to gain... ...to marketing campaign execution Flexible work arrangements Performance-based incentives... ...will be provided Shortlisted candidates will be contacted within 24 hours....- ...company for Bitcoin mining and AI cloud. Bitdeer is committed... ...for: ~ This role builds the evaluation and decision systems that make... ...will own and extend our LLM and agent evaluation pipeline, develop representative... ...behavior at the trajectory level across task success, tool use,...
2800 - 3300 SGD
...that may impact service delivery timelines or quality Perform remote troubleshooting and fault isolation during initial installation... ...collection, use, and disclosure of your personal data for the purpose of evaluating your suitability for employment opportunities and related...4000 - 5000 SGD
...Secondary School youths in academic and character education while supporting their learning, development and well-being. Up to $42 per hour Mon - Fri (only on assigned days, approximately 20 - 30 hours per week) Paya Lebar / Jurong West as assigned Jan - Nov 2027...- ...Job Application for Chinese Translator - Freelance AI Trainer Project at Meridial Back to jobs... .... On a typical day, you will evaluate and edit AI outputs, translate between Chinese... ...We offer a pay range of $6 to $65 per hour, with the exact rate determined after evaluating...
1800 - 2400 SGD
...Part Time Salary: $10.50 per hour Working Day: Monday to Friday... ...administrative duties, including data entry, document filing, scanning, and... ...in any country for purposes of evaluating suitability for employment,... ...use artificial intelligence ("AI") and machine learning...500 - 1000 SGD
...maintaining high cleanliness standards. Able to communicate effectively with team members and customers. Available to work flexible hours, including weekends when required. Candidates must be legally authorised to work in Singapore. If you enjoy creating clean and...2300 - 2700 SGD
...Support new employee onboarding and offboarding, including workstation setup and IT equipment allocation. Maintain IT asset inventory records and assist with tracking computers, laptops, and other equipment. Provide basic remote and onsite technical support to end users....6000 - 8000 SGD
...About MiAO AI MiAO AI was founded in 2025 and is headquartered in Singapore, having raised over SGD 95 million from globally renowned... ...layer that makes AI truly yours. We're building personal AI agents — an AI that knows you better on day 30 than day 1, not because it...2000 - 4000 SGD
...Conduct informal and formal assessments to evaluate and monitor children’s developmental and... ...: Degree graduate. Completed a minimum 40-hour course providing theoretical knowledge and... ...Requirement : Must be registered at the Member level with the Register of Educational...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Entry-Level AI Agent Evaluator - Remote Freelance, Flexible Hours. Be the first to apply!
