HomeGet in touch

Exhibit B · Malakah CitationsAI trust · LegalTechShipped

Making a legal AI show its sources, down to the article.

  1. [1]10 of 12would re-check an unsourced answer
  2. [2]1,000+legal professionals

Lawyers wouldn’t act on an AI answer they couldn’t check. I designed the system that lets every claim in Malakah’s answers open the exact article of Saudi law it came from.

Skip to the results Presentation (PDF)Full write-up

Role
Product Designer at Stixor, for Malakah. Legal chat, legislation CMS and evaluation admin.
Duration
2024 – 2026
Team
Lawyers, plus the internal content and AI team as users.
Methods
12 interviews, Pattern comparison, Arabic (RTL) + English (LTR), Internal tools
Malakah chat answering a legal question with the contract and cited source side by side

01 · Problem

An answer you can’t check is a research task.

A lawyer is accountable for every piece of advice they give. Saudi law also changes, so “the law says” is only useful if you know which version said it.

The reframe: not “make the answer more accurate”, but “make every claim cheap to check”.

Chat answer that mentions article numbers without linking to them
The starting point: article numbers, no links

02 · Approach

A citation is only as good as the three layers under it.

A source link only works if the law is stored in pieces small enough to point at, and if retrieval reliably finds the right piece.

  1. Structure the law.A legislation CMS for the content team: chapters, parts, articles, annexes and amendments.
  2. Measure retrieval.An evaluation tool for the AI team: did the right articles come back, and in what order?
  3. Show the source.Legal chat for lawyers: each claim links to its article, which opens beside the answer.

03 · Solution

Four ways to show a source.

I judged every option by one question: how much work is left for the lawyer between reading a claim and trusting it?

Each point ends with a View Law and Details link, with the law panel open beside it
Claim-level citations
  1. A link on every claim won.It opens the exact article beside the answer, with the cited text highlighted.
  2. Then, the version.A correct article in an outdated version is still wrong advice.

04 · Solution · Content

Making the law addressable.

You can only link to an article if the system knows where each article starts and ends. So the content team rebuilds each law as a tree before it’s published.

Legislation CMS preview: a nested tree of chapters, parts and articles
Legislation CMS
  1. Source priority.Tell “the law says” apart from “a guideline suggests”.
  2. A translation check next to Publish.An unchecked translation is the wrong text.

05 · Solution · Quality

Measuring whether the right article comes back.

A wrong article, shown with confidence, is worse than no citation. Teams upload test sets and compare runs by precision, recall, F1 and nDCG.

The citation a lawyer sees is the output of retrieval, so this was the most direct way to improve what they’d trust.

Evaluation admin page with a results table of F1, recall, precision and nDCG
Evaluation tool

06 · Results

The claim-to-source pattern shipped.

The source opens as a third panel next to the chat and the contract, so a lawyer can check a claim while drafting without switching tools. Malakah serves 1,000+ legal professionals.

Malakah workspace: chat answer, contract and cited source side by side
Chat, contract and source, side by side

07 · Learnings

Trust is a path, not a badge.

Next, I’d test citation density on long answers, measured by time to verify.

  1. The visible pattern depends on invisible structure.The CMS and the evaluation tool are what made the citation link true.
  2. Design for the people behind the AI too.The content and AI teams were users of this system as much as the lawyers.

Next exhibit

Permissions · LegalTechWho can see, ask and change a confidential contract.