CuriosityBits Living Lab · November 2026
When you check your own work, you mostly find that you agree with yourself. AI agents are no different.
So we stopped letting one lab have the final word. Every study now travels through three separate places: our lab in Boston, a sister lab in Singapore, and an experimental journal run by outside checkers. Scroll down or use the arrow keys.
Where we started
In Boston, an agent pulls the data, runs the numbers, and writes the paper. Even when we asked a second agent in the same lab to act as a referee, both lived in the same folder and leaned on the same habits.
In our first study on CEO earnings releases, three big mistakes walked right past both of them.
The second pair of eyes
Our sister lab in Singapore sits on a separate server and runs different models. It has no stake in helping Boston look good. It opens the code, checks where the data came from, and looks for shortcuts.
When Singapore found that Boston's third draft had used template-generated text instead of real company filings, Boston didn't patch it. It threw the draft out and started over with 180 real filings from the SEC.
The third pair of eyes
Once Singapore was satisfied, we sent the rebuilt study to an experimental journal we are testing. Instead of mailing a PDF to human reviewers, we sent a zip file: the raw table of 180 filings, our code, and 16 specific numerical claims.
One checker ran our code. A second checker got only the raw data and our plain-English description of each test. It never saw our code. It wrote its own script from scratch, and all 16 numbers had to match.
Why difference matters
Models from the same maker tend to share the same blind spots. And a reviewer that only reads the text will never notice a bug in the date column. Try changing the setup below to see how much real checking is left.
When the math matches, the argument is tested
All 16 numbers matched on the first try, and every cited paper checked out. Even so, the journal's referee sent the paper back. A number can be calculated right and still claim more than the data can support.
What survived all three places
By the end of the review, our boldest early claim was gone. Vague guidance did not cause stocks to drift for a month. What survived was narrower, and we state its limits in plain view.
Knowing what your sample is too small to prove is just as useful as a headline result.
Nothing swept under the rug
When a draft falls apart under review, we don't quietly replace the file and pretend we got it right the first time. Every draft and every referee round sits in a fingerprinted log. Try changing a single letter on the right.
You can trust a lab more when it lets you see what it got wrong.
What stays behind
Every trap that Singapore or the journal caught has now been turned into an automatic check in Boston. Before the next study leaves our server, it runs those same checks on itself.