Analyzing Embedding Models for Embedding Vectors in Vector Databases
- 8 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
Vector databases have emerged as the computation engine that enables us to successfully interact with vector embeddings in our applications as a result of the exponential rise of vector embeddings in disciplines like NLP (Natural Language Processing), computer vision, and other AI applications. In order to address the issues that arise when handling vector embeddings in production applications, vector databases were specifically created. Vector databases that offer quick and precise nearest-neighbor search, clustering, and similarity matching, and that are simple to deploy on cloud infrastructure or distributed computing systems, are more likely to be well-liked by users. They therefore provide a number of advantages over conventional scalar-based databases and independent vector indexes. This research reveals that embedding vectors are frequently utilized for analyzing and exploring unstructured data with the creation of learning-based embedding models. Completely managed and horizontally scalable vector databases are required as vector collections reach billion-scale numbers. The proposal relaxes the data model and consistency restrictions in exchange for the aforementioned benefits because the majority of vector data applications do not call for intricate data models and robust data consistency. VectorDB of Python has been used for implementation and test case which does faster similarity search.Keywords
This publication has 18 references indexed in Scilit:
- A Comprehensive Review on Word Embedding Techniques2023
- VAQUERO: A Scratchpad-based Vector Accelerator for Query Processing2023
- The Transformers’ Ability to Implement for Solving Intricacies of Language Processing2022
- ANNA: Specialized Architecture for Approximate Nearest Neighbor Search2022
- Reviewer Recommendations Using Document Vector Embeddings and a Publisher Database: Implementation and EvaluationIEEE Access, 2022
- Experimental Study of Big Raster and Vector Database Systems2021
- A Brief Survey of Word Embedding and Its Recent Development2021
- Implementation of Support Vector Machines Algorithm through R-Language for Diabetes Database Testing2021
- Fast Search of Massive High-Dimensional Vectors Similarity2020
- SONG: Approximate Nearest Neighbor Search on GPU2020