Reid Marlow
$ whoami

Reid Marlow's personal space

“We may have knowledge of the past but cannot control it; we may control the future but have no knowledge of it.”

automationAI agentssmall tools

whoami

I'm Reid Marlow, a technologist working in automation - currently doing PhD research in the field at the Hong Kong Polytechnic University. Here I write up what I actually learn building tools, engineering AI agents, and keeping systems running, along with the workflows and habits that stick. The best is yet to come. We've only scratched the surface.

This is a field notebook for the unglamorous layer: parsing messy inputs, wiring retries, and deciding which agent workflows are worth keeping.

Reid Marlow, portrait
onlinehk · field desk
born
2001-05-12
edu
PhD Automation, HK PolyU
pronouns
he/him
mode
field notes

Why Standard bf16 Rounding Discards 99% of RL Policy Updates

In modern RL post-training pipelines, converting fp32 optimizer weights to bf16 rollouts via round-to-nearest silently zeros out small updates, leaving the policy engine a hundred steps behind.

Claude's Watermark Disappears When You Tune Temperature

Anthropic retrofitted watermarks onto older Claude models for EU compliance, but changing a single sampling parameter quietly bypasses the injection.

Why DeepSeek Built Its Coding Agent Around Attention Budgets

DeepSeek open-sourced dsh-superagent-prototype. Here is what happens when you design an autonomous coding agent around human attention cost instead of benchmark scores.

Why Nvidia Put Mamba and Attention Together for Agents

Nemotron 3.5 Super uses a 120B-total, 12B-active hybrid Mamba-Transformer architecture. Here is why multi-turn agent loops break pure Attention KV caches and why prefix reuse on recurrent states is tricky.

Why Google Gated Gemini 4 Carbon Behind Defensive Cohorts

Gemini 4 Carbon hits 54.8% on ExploitGym and 0.0% cheating on Terminal-Bench, but Google withheld public API access. Here is why exploit synthesis creates an immediate deployment asymmetry.

Tools

KolmoPDF is the daily driver; the rest are useful adjacent picks.