SOLUTIONS / VECTOR MEMORY

Serverless vector memory for AI applications.

Store text chunks, compute dense 768d BGE embeddings automatically, and execute sub-50ms similarity searches. Inject retrieved context into any LLM completion without vector plumbing.

5,000 vectors & 10,000 queries included free • Sub-50ms p95 latency • REST & OpenAI SDK compatible
# 1. Ingest raw text chunk — Lumoz computes normalized 768d BGE embeddings on write
curl -X POST https://lumozai.com/api/v1/memory/store \
  -H "Authorization: Bearer $LUMOZ_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "project": "customer-knowledge-base",
    "text": "Enterprise plans guarantee 99.99% uptime and dedicated 24/7 Slack channel support.",
    "metadata": {
      "category": "sla_terms",
      "tier": "enterprise"
    }
  }'
from openai import OpenAI

# Use the standard OpenAI SDK configured with your Lumoz base_url
client = OpenAI(
    api_key=LUMOZ_API_KEY,
    base_url="https://lumozai.com/api/v1"
)

# Pass "memory" in extra_body — Lumoz retrieves relevant chunks & injects context automatically
completion = client.chat.completions.create(
    model="llama-3.3-70b-instruct",
    messages=[{"role": "user", "content": "What is our enterprise uptime SLA?"}],
    extra_body={
        "memory": {"project": "customer-knowledge-base", "top_k": 3}
    }
)

print(completion.choices[0].message.content)
// HTTP 200 OK — Sub-50ms Cosine Dot-Product Retrieval
{
  "status": "success",
  "query": "What uptime guarantee is provided for enterprise customers?",
  "latency_ms": 31.8,
  "results_count": 1,
  "results": [
    {
      "id": "mem_9a8f4c21",
      "score": 0.9412,
      "text": "Enterprise plans guarantee 99.99% uptime and dedicated 24/7 Slack channel support.",
      "metadata": {
        "category": "sla_terms",
        "tier": "enterprise"
      }
    }
  ]
}
< 50ms p95 Retrieval Latency
768 Dim Dense BGE Embeddings
100% Tenant Namespace Isolation
$0 / mo Cluster Minimums

How Lumoz Vector Memory Works

A streamlined lifecycle from unstructured text to context-augmented generative answers.

01

Ingest & Auto-Embed

Post text chunks directly to /api/v1/memory/store. Lumoz automatically computes dense, normalized 768-dimensional BGE embeddings on ingestion with no external embedding bills.

02

Sub-50ms Indexing

Vectors are persisted inside your tenant-isolated project partition. High-throughput cosine dot products paired with exact keyword fallback guarantee rapid, precise retrieval.

03

Zero-Code RAG Injection

Pass "memory": {"project": "..."} to standard chat completions. Top ranked context is automatically extracted and injected into the LLM system prompt without glue code.

Engineered for Production AI Workloads

Full vector database capabilities unified with high-throughput inference.

BGE-BASE-EN-V1.5

Automated BGE Embeddings

Stop paying for separate embedding API calls and orchestrating batch syncs. Ingest raw text; Lumoz automatically generates 768-dimensional normalized vectors in milliseconds.

MULTI-TENANT

Isolated Tenant Namespaces

Every vector project is an isolated cryptographic partition. Segment data across enterprise workspaces, team accounts, or individual end-user sessions with zero data leakage.

WIRE-COMPATIBLE

One-Line RAG Injection

Bypass complex LangChain and LlamaIndex middleware. Add "memory": {"project": "..."} to your OpenAI SDK requests, and Lumoz retrieves and injects context on the fly.

< 50MS P95

Sub-50ms Cosine Retrieval

High-throughput dot product indices calculate similarity in milliseconds. Includes hybrid exact keyword fallback so technical SKUs, error codes, and IDs are never overlooked.

$0 IDLE COST

Zero Cluster Minimums

Never pay $70 to $300/month for idle cloud pods. Accounts receive 5,000 vectors and 10,000 queries free forever with any $10 balance reload, followed by $0.05 / 1,000 operations.

70+ MODELS

Unified Model Ecosystem

One API key handles vector storage, similarity queries, and inference across 70+ generative models including Llama 3.3, Claude 3.5, FLUX image rendering, and video synthesis.

Architectural Comparison

How Lumoz compares to dedicated vector databases and self-hosted clusters.

Capability & Cost Lumoz Vector Memory Dedicated Vector DBs Self-Hosted pgvector
Setup Time 30 - 60 minutes Hours / Days (DevOps setup)
Embedding Pipeline External API required ($$$) Separate embedding microservice
Zero-Code LLM RAG Manual LangChain / Glue code Manual SQL / Glue code
Minimum Monthly Cost $70 - $120 / month pod fees $50+ / month (VM + RAM)
Multi-Tenant Partitioning Index filters or separate pods Complex RLS & Schema logic
Unified Generative LLMs Vector search only Database only

Production Engineering Patterns

What development teams build with serverless vector memory.

ENTERPRISE SUPPORT

Knowledge Bases & Helpdesk RAG

Ingest company policies, internal standard operating procedures, and product documentation. Customer support agents deliver verified factual responses with citations.

Sub-50ms lookup • Zero hallucinations
CONVERSATIONAL AI

Persistent Agent Memory

Equip conversational AI agents with long-term memory across sessions. Store user preferences, past interactions, and user-specific facts in dedicated per-user namespaces.

Per-user isolation • Multi-session state
ECOMMERCE & CATALOGS

Semantic Product Search

Upgrade rigid keyword search into natural language comprehension. Allow shoppers to search complex descriptions like "cozy minimalist desk lamp" and retrieve exact matches.

Natural language • Hybrid SKU matching

Simple, pay-as-you-grow economics.

No cluster reservations, no idle instance fees, no surprises.

$0.05 per 1,000 operations
FREE DEVELOPER TIER
5,000 Vectors & 10,000 Queries

Included free forever with any $10 account reload.

METERED SCALING
$0.05 / 1,000 Operations

Covers both vector writes and similarity search queries.

IDLE CLUSTER FEES
$0.00 / month

Pay only for the vectors stored and queries executed.

Technical Specifications FAQ

Common questions regarding embeddings, namespace partitioning, and API integration.

When you post text chunks to /api/v1/memory/store, our serverless pipeline processes the text through a normalized BGE-base-en-v1.5 neural encoder. This produces high-density 768-dimensional normalized vectors in milliseconds without requiring separate API calls or extra billing.

Each vector project is provisioned with a cryptographic tenant identifier and isolated database partition. Similarity dot products and keyword queries are strictly bound to the authenticated user ID and project namespace, preventing cross-tenant leakage.

Our /api/v1/chat/completions endpoint is 100% wire-compatible with OpenAI. By passing "memory": {"project": "your-slug", "top_k": 3} in the request payload, Lumoz intercepts the prompt, executes a sub-50ms vector search, injects the highest-scoring chunks into the context window, and streams the grounded completion back.

Your vectors never drop offline. Free developer accounts receive 5,000 stored vectors and 10,000 similarity queries included forever with any $10 balance reload. Growth beyond that scales seamlessly at just $0.05 per 1,000 operations deducted directly from your unified account balance.

Start building context-aware AI applications today.

Create your first isolated vector project in seconds. Test similarity queries immediately in your browser or connect via REST.