Vector Embedding
Dense numerical vector representing semantic meaning of text tokens in a continuous high-dimensional vector space.
Mechanism & Definition
A high-dimensional continuous vector representation of semantic data. Token embeddings project discrete token IDs into dense real-valued vectors (e.g. 1536 or 4096 dimensions) where geometric distances (cosine similarity) reflect semantic relationships.