Field Guide & Open Data

How Our Agents Plan Studies, Score Text, and Access Public Data

Features

  • 1-Page Study Design Card: Before starting a study, our agent writes a one-page plan. The plan states what we will measure, what competing factors we will control for, and what result would prove our guess wrong.
  • Cross-Checking Text Scores: We do not trust a single AI model to score transcripts or forum posts. Instead, we compare scores across open-weight models (DeepSeek, Qwen, GLM, MiniMax) and our JEV decision model.
  • End-to-End Study Production & Publication (SKILL-014): Every study follows a six-step pipeline. It starts with a locked study plan and a powered sample (N ≥ 150–200). It ends with a public-facing story on top and academic PDFs and raw data underneath.

1. Pre-Registration, Multi-Model Scoring & Publication Pipeline (SKILL-012, SKILL-013 & SKILL-014)

Before starting a study, our agent publishes a one-page plan (Study #01 Plan PDF · Study #02 Plan PDF · Study #03 Plan PDF · Study #04 Plan PDF). When a study scores text, we check how closely all four judges agree on each score:

How Well Do Our Models Agree When Scoring Text?

Agreement scores across DeepSeek, Qwen, JEV Router, and our rule-based analyzer (1.00 = perfect agreement; 0.70+ = strong agreement).

Study & Text Score Cases 4-Judge Agreement (ICC) JEV vs. DeepSeek JEV vs. Qwen Result
Study #01: Question Dodging 41 0.98 0.98 0.98 Strong
Study #01: Concrete Plan vs. Buzzwords 41 0.99 0.98 0.99 Strong
Study #01: Strategic Fog / Hedging 41 0.98 0.98 0.98 Strong
Study #01: Blame Shifting 41 0.90 0.73 0.78 Good (Subtle Call)
Study #02: AI Buzzword Intensity (H) 48 0.99 0.99 0.99 Strong
Study #02: Verified AI Revenue Receipts (V) 48 0.99 0.99 0.99 Strong
Study #03: HN Engineer Skepticism (S_HN) 202 0.85 0.68 0.84 Strong
Study #03: HN Practitioner Verification (V_HN) 202 0.92 0.82 0.76 Strong
Study #03: Net HN Skepticism (S − V) 202 0.92 0.82 0.87 Strong

2. Short Field Guide: Narratives in Markets

Because the human researcher is a communication scholar rather than a finance specialist, our agents use this short checklist of core concepts from economics and communication:

  • Stories Move Markets, Then Tire Out (Shiller, 2017): Viral market stories (like the AI boom) spread like epidemics—early excitement eventually turns into "show me the proof."
  • Accounting Words Aren't Feelings (Loughran & McDonald, 2011): Words like risk, cost, or liability are normal business terms, not negative emotion. Agents should measure question dodging and hard numbers instead of simple positive/negative word lists.
  • Account for the Day-1 News Shock (Bernard & Thomas, 1989): Stocks naturally drift after a big earnings beat or miss. Any study claiming that CEO language predicts future returns must control for the Day-1 price jump first.
  • Cheap Talk vs. Hard Receipts (Crawford & Sobel, 1982): Buzzwords are free to say; actual revenue, signed contracts, and profit margins are costly to fake.

3. Open-Access Data Sources Our Agents Can Pull Anytime

Most major social platforms now charge thousands of dollars for API access. Below are free, open data sources that our agents query directly via our open-access data connector:

Public Discourse, Social Media & Attention Archives

Data Source What You Can Study Access
Wikipedia Daily Pageviews API Daily public attention spikes toward companies, public figures, crises, or social topics. Free · No Key Needed
Hacker News (Algolia API) Full archive (2006–present) of tech, AI, workplace, and market discussions and comments. Free · No Key Needed
Bluesky Public API (AT Protocol) Public posts, user feeds, and conversation threads across political and social topics. Free · No Key Needed
Reddit Archives & Public Feeds Historical discussions in r/wallstreetbets, r/investing, r/politics, and r/science. Open Archives
YouTube Transcripts & Telegram Archives Closed-caption transcripts of interviews/webcasts (youtube-transcript-api) and public Telegram channels. Free · Open

Financial Markets, News, Policy & Survey Repositories

Data Source What You Can Study Access
SEC EDGAR API Official company filings (10-K, 10-Q, 8-K), executive insider trades (Form 4), and revenue numbers. Free · No Key Needed
Yahoo Finance & St. Louis Fed (FRED) Daily stock prices, sector indices, interest rates, inflation, and unemployment series. Free · Direct CSV/API
Harvard Dataverse & Zenodo 150,000+ published social science datasets, survey files, and replication packages. Free · No Key Needed
U.S. Federal Register & GDELT News Government regulations, presidential actions, and global news coverage across 100+ languages. Free · No Key Needed
HuggingFace Datasets, OWID, GSS & ANES Labeled text benchmarks, global country trends, and flagship public opinion surveys. Free · Open Download
Live Replication & Data Bundles: GET /api/agent-replication · View Lab Log & Audit Reports