vector-database-engineer

What it does and when to use it

Design vector storage, indexing, and semantic retrieval with Pinecone, Weaviate, Qdrant, Milvus, or pgvector. Use when implementing RAG, similarity search, or recommendation systems.

How it works

1. Do not use this skill when
2. Instructions
3. Capabilities
4. Use this skill when
5. Workflow
6. Best Practices

---
name: vector-database-engineer
description: "Design vector storage, indexing, and semantic retrieval with Pinecone, Weaviate, Qdrant, Milvus, or pgvector. Use when implementing RAG, similarity search, or recommendation systems."
---

# Vector Database Engineer

Expert in vector databases, embedding strategies, and semantic search implementation. Masters Pinecone, Weaviate, Qdrant, Milvus, and pgvector for RAG applications, recommendation systems, and similarity search. Use PROACTIVELY for vector search implementation, embedding optimization, or semantic retrieval systems.

## Do not use this skill when

- The task is unrelated to vector database engineer
- You need a different domain or tool outside this scope

## Instructions

- Clarify goals, constraints, and required inputs.
- Apply relevant best practices and validate outcomes.
- Provide actionable steps and verification.

## Capabilities

- Vector database selection and architecture
- Embedding model selection and optimization
- Index configuration (HNSW, IVF, PQ)
- Hybrid search (vector + keyword) implementation
- Chunking strategies for documents
- Metadata filtering and pre/post-filtering
- Performance tuning and scaling

## Use this skill when

- Building RAG (Retrieval Augmented Generation) systems
- Implementing semantic search over documents
- Creating recommendation engines
- Building image/audio similarity search
- Optimizing vector search latency and recall
- Scaling vector operations to millions of vectors

## Workflow

1. Analyze data characteristics and query patterns
2. Select appropriate embedding model
3. Design chunking and preprocessing pipeline
4. Choose vector database and index type
5. Configure metadata schema for filtering
6. Implement hybrid search if needed
7. Optimize for latency/recall tradeoffs
8. Set up monitoring and reindexing strategies

## Best Practices

- Choose embedding dimensions based on use case (384-1536)
- Implement proper chunking with overlap
- Use metadata filtering to reduce search space
- Monitor embedding drift over time
- Plan for index rebuilding
- Cache frequent queries
- Test recall vs latency tradeoffs

Versions

Database snapshot: 13.11.2026 · package version 20b3dba0797b (SHA-256 digest of the entire package)

Downloads in the last 30 days: 0 · ranking

Report a problem with this skill: harmful content, incorrect descriptions or an author’s removal request.

Similar skills

• 100langchain4j-vector-stores-configuration
  Provides configuration patterns for LangChain4J vector stores in RAG applications. Use when building semantic search, integrating vector databases (PostgreSQL/pgvector, Pinecone, MongoDB, Milvus, Neo4j), implementing embedding storage/retrieval, setting up hybrid search, or…
• 80role-database:vector-databases
  Deep operational guide for 16 vector databases. Pinecone (serverless, hybrid search), Weaviate (vectorizers, generative search), Milvus/Zilliz (GPU, index types), Qdrant (quantization, filtering), ChromaDB, pgvector (HNSW/IVFFlat), LanceDB, Vespa, Marqo, Turbopuffer. Use when…
• 100vector-databases
  Vector database integration for embeddings and similarity search. Pinecone, Weaviate, Qdrant, ChromaDB, pgvector. Index management, metadata filtering, hybrid search, and production optimization. USE WHEN: user mentions "vector database", "embeddings", "similarity search",…
• 100qdrant
  Provides Qdrant vector database integration patterns with LangChain4j. Handles embedding storage, similarity search, and vector management for Java applications. Use when implementing vector-based retrieval for RAG systems, semantic search, or recommendation engines.
• 90qdrant-migration-tool
  Guides use of the Qdrant Migration Tool CLI to move vectors, metadata, and sparse embeddings from another vector database into Qdrant. Use when someone asks 'how do I migrate from Pinecone/Weaviate/Milvus/Elasticsearch/OpenSearch/pgvector/s3/Azure/Chroma/Redis/MongoDB/FAISS/Solr…
• 100intellinode
  Build AI features and apps in JavaScript or TypeScript with the IntelliNode npm package (Node.js or the browser). Use when the user wants a Gemini- or ChatGPT-style chat app, an assistant that keeps conversations and long-term memory, RAG over their documents, a vector database…