Singapore · RAG accuracy · Evidence you can audit

Know how often your RAG is wrong — and prove where every answer comes from.

QCRCE measures and improves retrieval accuracy for RAG and internal search at Singapore and Southeast Asia tech teams. We test on your own documents and real questions, report recall@k and citation accuracy, and agree pass/fail acceptance tests with you before we build.

The problem

Wrong answers cost more than slow ones

A RAG system that answers confidently from the wrong passage erodes trust fast. Most teams cannot say what share of answers are grounded in the right source.

“Show me the source” is becoming a requirement

Reviewers, risk teams and — for financial institutions — the MAS Guidelines on AI Risk Management (effective 7 October 2027) expect AI to be evaluated against measurable thresholds and documented.

English-only testing misses real users

Staff and customers in the region ask in Chinese, Malay and Bahasa. Retrieval that works in English can fail silently in other languages.

How we work

  1. 1

    Measure

    Build a gold set from your real questions (typically 50) with the source passage for each answer. Baseline recall@k and citation accuracy on your current system.

  2. 2

    Agree

    Before any build work, write down the acceptance tests together: which metrics, which thresholds, which languages. No moving goalposts.

  3. 3

    Fix & prove

    Improve chunking, embeddings, hybrid search or re-ranking, re-run the same tests, and deliver a go / no-go report with the evidence behind it.

Packages

Fixed scope, fixed price. Prices in SGD; invoiced via our Singapore business account.

Entry offer

RAG Accuracy Health Check

SGD 3,800 about 1 week

  • Gold set of 50 of your real questions, with source passages agreed with your team
  • Baseline recall@k and citation accuracy on your current RAG or search
  • Failure analysis: which questions fail, and why
  • Prioritised fix plan with expected effort
  • Optional: the same questions in Chinese / Malay / Bahasa

Full prepayment before work starts.

Package A · Pilot

RAG Pilot with Acceptance Tests

SGD 8,000 2–3 weeks

  • Acceptance tests and thresholds agreed in writing before kickoff
  • Ingest up to 50k documents (~500 MB text-like corpus)
  • Chunking + embedding pipeline, model choice documented
  • Retrieval API or notebook demo with source citations
  • Eval report: recall@k, citation accuracy, p50/p95 latency (min. 30 queries)
  • Go / no-go report, handoff doc, 60-min walkthrough, 7-day bugfix support

50% deposit before kickoff, 50% on delivery.

Package B

Vector Retrieval SDK Paid Trial

On request 2–4 weeks

  • For teams whose accuracy is in place and who now need scale
  • QCRCE Engine GPU vector retrieval SDK/API access for the trial
  • Benchmark vs an agreed baseline (e.g. FAISS / pgvector)
  • GPU vs CPU comparison on your or synthetic vectors
  • Wrap-up memo with go / no-go recommendation

Paid trial. 50% deposit before credentials are issued.

Evaluation method

What we measure

recall@k
Share of questions where a correct source passage appears in the top k results. Ground truth is labelled with your team.
Citation accuracy
Share of questions where the passage the system cites first is the right document and section — what an auditor would check.
Multilingual retrieval
The same gold questions asked in Chinese, Malay or Bahasa, scored the same way, to show whether non-English users get the same quality.
Latency p50 / p95
Supporting proof: median and tail query latency on the agreed environment. GPU retrieval (Package B) is for when scale, not accuracy, is the constraint.

How targets are set

Acceptance tests are agreed per project, before building. As an example only, a pilot might target recall@10 ≥ 0.85, citation accuracy ≥ 0.80 and p95 latency ≤ 200 ms.

These are example targets, not results from a customer project.

See it on public documents

Our public demo runs this method on MAS AI risk documents with a 32-question gold set and publishes every measured number, including the misses.

Compliance readiness

For financial institutions and their technology vendors, the MAS Guidelines on AI Risk Management (finalised 7 October 2026, effective 7 October 2027) call for evaluation against measurable thresholds, documentation that lets an independent reviewer reproduce the work, and ongoing monitoring.

Our deliverables are designed to support your evidence pack: the gold set, test results, failure analysis and run instructions can be filed with your AI inventory and review records.

QCRCE provides software and technical evaluation only. We do not provide legal, regulatory or compliance advice or certification; your compliance and legal teams decide what meets your obligations.

Funding

Some Singapore companies may be eligible for Enterprise Singapore's EDGE Grant (which replaced EDG and PSG from 30 September 2026). Eligibility and approval are decided by Enterprise Singapore, and the grant generally requires that no work or payment happens before you apply.

We are glad to provide a quotation and scope for your own application, but we cannot promise any subsidy. If you plan to apply, tell us first and we will not start or invoice until you have.

Data handling

Your data is used only to deliver the contracted package and is never used to train public models. Third-party APIs are disclosed in the SOW, with SG/SEA regions preferred. Corpora are deleted or returned within 30 days of project close.

About

QCRCE is a small Singapore software and technical consulting company focused on RAG accuracy, retrieval evaluation and vector retrieval. It is founded and run by Mark (Ma Weijia), who works directly on every engagement.

We are software and consulting only. We do not provide financial or regulated advisory services.

Company details

Legal nameQCRCE Pte. Ltd.
UEN202630091K
Address68 Circular Road #02-01
Singapore 049422
FounderMark (Ma Weijia)

Talk to us

Tell us what your RAG or search system needs to answer, and where the knowledge lives. We will reply with whether a package fits.