Building AI Agents to Improve Job Referral Requests to Strangers

Quick Overview

The research shows that using a Retrieval-Augmented Generation (RAG) workflow, which involves an AI agent searching a database of successful referral requests before rewriting a new request, significantly boosts the success rate of getting referrals from strangers, resulting in a 37% success rate compared to a baseline of 24%.

Key Points: The study analyzed 17,000 posts from an anonymous site where tech workers requested referrals from strangers, observing a baseline success rate of 24%. The researchers implemented a Retrieval-Augmented Generation (RAG) workflow, using an LLM (like GPT-5 mini) to search for contextually similar successful posts before rewriting a new request. When the RAG workflow was applied, the success rate jumped to 37%, a massive 14% relative edge over the baseline. The AI agent was trained to judge posts based on factors like sentiment (politeness, gratitude) and clear value propositions, avoiding desperate language. The successful prompts were not complex; they were simple, like asking a peer for a favor by acknowledging their time value, rather than using complex instructions. The RAG agent successfully identified and prioritized posts that were contextually strong (e.g., relating to an applicant's current job or career stage) over weak or desperate ones. The successful rewrite preserved the human element (soul and authenticity) while removing the negative signals of desperation present in the initial weak requests.

Context: The discussion centers on a research paper by Ross Chu and Yu-Kuang at UC Berkeley, published in December 2025, which investigates how to improve the success rate of job referral requests sent to strangers on anonymous platforms. The core challenge explored is that many requests, even from qualified candidates, fail because they sound desperate or lack clear context, leading to a high rate of outright rejection or failure to secure an interview.

Detailed Analysis

The video details research by Ross Chu and Yu-Kuang from UC Berkeley, focusing on improving job referral requests sent to strangers, often from tech workers. The baseline success rate for these requests on an anonymous site was 24%, with 54% of the 17,000 analyzed posts failing entirely. The researchers introduced an AI agent using a Retrieval-Augmented Generation (RAG) workflow. This agent first searches a database of successful posts to find contextually similar examples before rewriting the new request. This method boosted the success rate to 37%. The key to success appears to be avoiding desperation and including high-status markers, clear value propositions, and a narrative framing, rather than just relying on keywords or overly complex instructions. The AI successfully filtered out requests that sounded desperate (like those mentioning needing support for three kids) and amplified requests that demonstrated reciprocity and clear signaling of the sender's standing (e.g., a senior PM at Apple). The success of the RAG approach lies in mimicking human psychological cues of confidence and reciprocity, which the AI learned by analyzing the data, ultimately solving the problem of low-quality, desperate requests that the baseline model failed to correct.