Xiao Cui

Hi, I’m Xiao. I’m a software engineer interested in search, AI, and distributed systems. This is where I write about what I’m building, learning, and still trying to understand.

A learning journal, in public. More about me ↗

SEPTEMBER2026
MAY2026

Building Peregrine

During a trip back to China, I finally had some quiet time to write down what I want to remember from building Peregrine: a small Zig + Metal inference engine for Qwen3.5 9B q4 on Apple Silicon.

Continue reading
JANUARY2026

Exploring Recursive Language Models

I’ve been exploring Recursive Language Models (RLM), a new inference paradigm from MIT’s OASYS lab. The core idea is compelling: instead of forcing LLMs to process massive contexts in a single forward pass, give them a Python REPL and le...

Continue reading
DECEMBER2025

Building SGREP - Part Two

After shipping the first version of sgrep with ColBERT late interaction, I thought the hard work was done. The search accuracy was good - MRR of 0.70 on my test queries, significantly better than plain semantic search. But when I started...

Continue reading

Building SGREP

Recently, there was a great mrep tool published by mxbread team, helping to address the issue that LLM harnesses such as claude code, codex, amp, when doing search, spent unnecessary time to retrieve useless tokens. Here’s what mgrep claim:

Continue reading

Browse the complete archive ↗

A SMALL CORNER OF THE INTERNET.

A SHORT BREAK FROM READING

Just one more rally.

YOU 00FIRST TO FIVE00 THE SITE

Your serve. The writing can wait a minute.

Mouse or drag to move · ↑ ↓ keys on the table · Space to pause · No sound, no autoplay.