# vec2vec: Embeddings are No Longer Secret

Source: https://www.youtube.com/watch?v=QP9TxKQNIyc
Recap page: https://rapidrecap.app/video/QP9TxKQNIyc
Generated: 2026-01-16T19:03:46.049+00:00

---
## Quick Overview

The Cornell researchers demonstrated that Vec2Vec, a method using a universal latent space derived from unsupervised learning, successfully translates embeddings between different modalities (like text and images) and even different models (T5-based vs. BERT-based) with high accuracy, suggesting that semantic geometry is preserved across these transformations, which has significant implications for AI interoperability and security.

**Key Points:**
- Vec2Vec achieves successful translation between different model embeddings (T5 vs. BERT) and modalities (text vs. image) by leveraging a universal latent space.
- The method achieved near-optimal assignments, with cosine similarity scores hitting 0.92 for the T5-to-BERT translation.
- The research confirmed that the semantic geometry learned by the models is preserved, as demonstrated by the consistent closeness of related embeddings in the universal space.
- A key security finding is that the translation preserves enough semantic information to reconstruct sensitive data, such as private NREON employee records, from encoded embeddings.
- The performance of the translation model (Vec2Vec) significantly outperformed baseline methods, achieving a rank of 1 for the T5-to-BERT translation and significantly outperforming random guessing.
- The method proved effective across different domains, successfully translating embeddings between colloquial tweets and highly specialized medical records (e.g., 'alveolar periostitis').

![Screenshot at 00:26: The core idea of Vec2Vec is introduced, focusing on leveraging the universal geometry of embeddings to translate between different model dialects.](https://ss.rapidrecap.app/screens/QP9TxKQNIyc/00-00-26.jpg)

**Context:** The discussion centers on a research paper from Cornell exploring the concept of universal embedding spaces for different AI models and data modalities, specifically focusing on a technique called Vec2Vec. This method aims to create a shared geometric representation that allows different AI systems, trained on different data or architectures (like T5 or BERT), to understand each other's learned concepts without explicit cross-alignment data.

## Detailed Analysis

The video explains the Vec2Vec research from Cornell, which addresses the challenge of translating embeddings between different AI models and data types that lack direct parallel data. The core innovation is creating a shared, universal latent space where semantic relationships are preserved. The researchers trained two sets of models: one based on T5 and another on BERT. They then showed that by mapping the embeddings from one model's space into the other's using this universal structure, they could achieve highly accurate translation. For instance, translating 'Become A Member Today!' from a T5 embedding space to a BERT embedding space resulted in a cosine similarity score of 0.92, indicating near-perfect alignment. This consistency in geometric structure across different models was maintained even when translating between vastly different domains, such as casual tweets and complex medical records (like 'alveolar periostitis'). The security implication is significant: if an attacker steals embeddings derived from sensitive data (like NREON employee records), the semantic information is preserved well enough that zero-shot attribute inference or reconstruction of the original data is possible, demonstrating that embeddings are not inherently secure if a translator model is available.

### Vec2Vec Core Concept

- Embeddings are essentially vector representations of text/data; Vec2Vec finds a universal geometry to map between different model spaces (T5, BERT) without paired data.

### Performance Metrics

- T5-to-BERT translation achieved a rank of 1 and a cosine similarity of 0.92; reconstructions were nearly perfect (90% accuracy on NREON data).

### Domain Adaptability

- The method successfully transferred semantic meaning across disparate domains, including social media slang and specialized medical terminology.

### Security Implications

- The preservation of semantic geometry means that stolen, encoded embeddings (even if anonymized) can still reveal sensitive information like private records.

### Architectural Details

- The system uses input adapters (A1/A2) to map incompatible embedding spaces into the shared backbone, which is then mapped back by output adapters (B1/B2).

![Screenshot at 00:04: Illustration showing two podcasters, symbolizing the need for communication/translation between different systems.](https://ss.rapidrecap.app/screens/QP9TxKQNIyc/00-00-04.jpg)
![Screenshot at 00:24: The speaker explicitly states the core idea: an AI system that can automatically translate between different dialects, referencing the Cornell paper.](https://ss.rapidrecap.app/screens/QP9TxKQNIyc/00-00-24.jpg)
![Screenshot at 00:32: A visual representation of the shared space where embeddings from different models \(like T5 and BERT\) are plotted and shown to cluster closely.](https://ss.rapidrecap.app/screens/QP9TxKQNIyc/00-00-32.jpg)
![Screenshot at 01:51: The comparison between the T5-based model and the BERT-based model embeddings being plotted in the universal space.](https://ss.rapidrecap.app/screens/QP9TxKQNIyc/00-01-51.jpg)
![Screenshot at 08:08: The speaker discusses the security implication: if an attacker steals embeddings, the information is not truly secure.](https://ss.rapidrecap.app/screens/QP9TxKQNIyc/00-08-08.jpg)