Negotiation Task Reader
Six-condition human-AI experiment platform with citation-grounded assistance, schema validation, parallel evidence scans, SSE streaming, model fallbacks, and revision-safe behavioral logging.
LLM evaluation and research systems.
I build data pipelines, model evaluations, experiment platforms, and human-AI interfaces.
Postdoctoral Fellow · Harvard Business School AI Institute
Ph.D. CS · Harvard
Cambridge, MA
Current systemProblem taxonomy
01Recover web evidence120 snapshots
02Extract structured problems88,336 firms
03Build human gold sets6 coders
04Optimize & evaluateF1 0.70–0.88
05Learn interpretable themes265 clusters
AWS · Python · DSPy · PyTorchversioned prompts + artifacts
88,336startups in the final LLM measurement pipeline
120Common Crawl snapshots processed from 2013–2026
331founder interviews in an ongoing validation program
10,000+participants across controlled online experiments
01 / FLAGSHIP
Problem taxonomy from 30.1M archived pages
The pipeline joins licensed company records to historical web archives, extracts structured problem statements, and evaluates the resulting measures against human labels and founder interviews.
88,336 startups, 265 problem categories
I built the data recovery, LLM measurement, annotation, evaluation, orchestration, and analysis layers. The pipeline uses Athena to reduce the Common Crawl index before fetching WARC byte ranges, then applies structured LLM extraction, human-gold evaluation, and interpretable representation learning.
Constraint: 883 GiB of archived HTML, probabilistic model outputs, and exact reproducibility across pipeline revisions.
Python · AWS Athena/S3 · WARC · OpenAI APIs · DSPy/GEPA · PyTorch · scikit-learn · statsmodels
Read the system and evaluation case study
HBS Working Paper 27-016 ↗
01IndexDomain-year targets against Common Crawl
02RecoverRanked WARC pointers, byte-range fetches, checkpoints
03MeasureSchema-constrained problem statements at temperature 0
04EvaluateGold sets, IRR, held-out F1, GEPA search
05OrganizeTop-K sparse features, stability checks, audit trail
02 / SELECTED SYSTEMS
Other systems
CareCorgi
Memory-enabled caregiving agent and realtime phone service spanning ADK function calling, Vertex AI Memory Bank, Firestore, Twilio Media Streams, audio transcoding, bounded queues, and VAD-gated barge-in.
Interview Workbench
An HBS research team uses this tool for diarized transcription, LLM paragraph segmentation, source search, and structured evidence review; it supports an ongoing 331-interview program localized for Chinese startups.
Human Annotation Tools
Research infrastructure for balanced assignment, resumable coding, and gold-set construction. More than 800 annotations across psychological frameworks feed agreement metrics and DSPy evaluation inputs.
03 / RESEARCH
2025
2024
2022
Complete publication list
Selected first-author papers
“ChatGPT, Don’t Tell Me What to Do”
Designing AI for context analysis in humanitarian frontline negotiations.
LLM chatbots for LGBTQ+ mental health support
Interviews and subreddit analysis of chatbot use for emotional support.
Not Just a Preference
A controlled experiment on reducing biased decision-making on dating websites.