Visual Memory Assistant
Built an on-device multimodal inference pipeline on a Jetson Orin Nano that indexes camera frames into a FAISS vector database, so you can search them by description.
Used normalized CLIP embeddings to pick the top-k relevant frames before anything reaches the vision-language model, which keeps most of the expensive VLM inference from running at all.
Added incremental embedding and a persistent index, plus periodic sampling and deduplication to keep storage down. Covered it with a 32-test suite that mocks out the model and hardware.
- Jetson Orin Nano
- PyTorch
- CLIP
- FAISS
- Moondream2
- CUDA



