Dale Spoonemore
← All posts

From the archive · Dale Spoonemore

Recording agent actions so I can review the work

LinkedIn · September 11

Agent actions: Work happens in the browser or app → Short recording: Keep actions; remove waiting time → Review the result: Confirm the task and notice UI problems.
Record the agent’s actions, then review the result. · Dale Spoonemore · View image at full size

Here’s a tip for anyone using computer/browser use with Codex. I set up a skill that automatically records a video anytime Codex is doing something through computer use or browser use.

When I first built it, the videos were way too long because there was a ton of dead space while the model was thinking or waiting between actions. I made a few tweaks to remove that dead space, and now for basically every change or action I have Codex make, I get a short video showing exactly what it did.

It’s been really useful because I can quickly verify that it actually did what I asked without having to retrace all of its steps myself. The unexpected benefit has been catching UI bugs. I’ve had several cases where Codex successfully completed the task, but the recording showed a visual/UI issue that the model either wasn’t able to recognize or just didn’t notice while it was working.

It’s basically become a visual audit trail for agent work. If you’re starting to let agents make more changes through computer/browser use, I’d highly recommend recording what they’re doing.

← All posts