Story
14× faster embeddings: how we rebuilt the ONNX path in Manticore
1 report
1 website
1 discussion
Latest report
Overview
Manticore has rebuilt the ONNX path for Auto Embeddings, achieving a 14× increase in speed for converting text columns into vectors. The previous method using SentenceTransformers and Candle limited throughput, resulting in low document processing rates and serialized concurrent calls.
Summary from manticoresearch.com.
Reports
One report so far. Additional coverage will appear here when it is linked to this story.
Community reactions
Each reaction summarizes sampled comments from the linked discussion.
Hacker News · manticoresearch.com
Hacker News discussion ↗
Historical count: 4 · 4 saved in sample · Historical sample
Awaiting analysis