1. Pre-Registration, Multi-Model Scoring & Publication Pipeline (SKILL-012, SKILL-013 & SKILL-014)
Before starting a study, our agent publishes a one-page plan (Study #01 Plan PDF · Study #02 Plan PDF · Study #03 Plan PDF · Study #04 Plan PDF). When a study scores text, we check how closely all four judges agree on each score:
How Well Do Our Models Agree When Scoring Text?
Agreement scores across DeepSeek, Qwen, JEV Router, and our rule-based analyzer (1.00 = perfect agreement; 0.70+ = strong agreement).
| Study & Text Score | Cases | 4-Judge Agreement (ICC) | JEV vs. DeepSeek | JEV vs. Qwen | Result |
|---|---|---|---|---|---|
| Study #01: Question Dodging | 41 | 0.98 | 0.98 | 0.98 | Strong |
| Study #01: Concrete Plan vs. Buzzwords | 41 | 0.99 | 0.98 | 0.99 | Strong |
| Study #01: Strategic Fog / Hedging | 41 | 0.98 | 0.98 | 0.98 | Strong |
| Study #01: Blame Shifting | 41 | 0.90 | 0.73 | 0.78 | Good (Subtle Call) |
| Study #02: AI Buzzword Intensity (H) | 48 | 0.99 | 0.99 | 0.99 | Strong |
| Study #02: Verified AI Revenue Receipts (V) | 48 | 0.99 | 0.99 | 0.99 | Strong |
| Study #03: HN Engineer Skepticism (S_HN) | 202 | 0.85 | 0.68 | 0.84 | Strong |
| Study #03: HN Practitioner Verification (V_HN) | 202 | 0.92 | 0.82 | 0.76 | Strong |
| Study #03: Net HN Skepticism (S − V) | 202 | 0.92 | 0.82 | 0.87 | Strong |
2. Short Field Guide: Narratives in Markets
Because the human researcher is a communication scholar rather than a finance specialist, our agents use this short checklist of core concepts from economics and communication:
- Stories Move Markets, Then Tire Out (Shiller, 2017): Viral market stories (like the AI boom) spread like epidemics—early excitement eventually turns into "show me the proof."
- Accounting Words Aren't Feelings (Loughran & McDonald, 2011): Words like risk, cost, or liability are normal business terms, not negative emotion. Agents should measure question dodging and hard numbers instead of simple positive/negative word lists.
- Account for the Day-1 News Shock (Bernard & Thomas, 1989): Stocks naturally drift after a big earnings beat or miss. Any study claiming that CEO language predicts future returns must control for the Day-1 price jump first.
- Cheap Talk vs. Hard Receipts (Crawford & Sobel, 1982): Buzzwords are free to say; actual revenue, signed contracts, and profit margins are costly to fake.
3. Open-Access Data Sources Our Agents Can Pull Anytime
Most major social platforms now charge thousands of dollars for API access. Below are free, open data sources that our agents query directly via our open-access data connector:
Public Discourse, Social Media & Attention Archives
| Data Source | What You Can Study | Access |
|---|---|---|
| Wikipedia Daily Pageviews API | Daily public attention spikes toward companies, public figures, crises, or social topics. | Free · No Key Needed |
| Hacker News (Algolia API) | Full archive (2006–present) of tech, AI, workplace, and market discussions and comments. | Free · No Key Needed |
| Bluesky Public API (AT Protocol) | Public posts, user feeds, and conversation threads across political and social topics. | Free · No Key Needed |
| Reddit Archives & Public Feeds | Historical discussions in r/wallstreetbets, r/investing, r/politics, and r/science. |
Open Archives |
| YouTube Transcripts & Telegram Archives | Closed-caption transcripts of interviews/webcasts (youtube-transcript-api) and public Telegram channels. |
Free · Open |
Financial Markets, News, Policy & Survey Repositories
| Data Source | What You Can Study | Access |
|---|---|---|
| SEC EDGAR API | Official company filings (10-K, 10-Q, 8-K), executive insider trades (Form 4), and revenue numbers. |
Free · No Key Needed |
| Yahoo Finance & St. Louis Fed (FRED) | Daily stock prices, sector indices, interest rates, inflation, and unemployment series. | Free · Direct CSV/API |
| Harvard Dataverse & Zenodo | 150,000+ published social science datasets, survey files, and replication packages. | Free · No Key Needed |
| U.S. Federal Register & GDELT News | Government regulations, presidential actions, and global news coverage across 100+ languages. | Free · No Key Needed |
| HuggingFace Datasets, OWID, GSS & ANES | Labeled text benchmarks, global country trends, and flagship public opinion surveys. | Free · Open Download |
GET /api/agent-replication · View Lab Log & Audit Reports