14× faster embeddings: how we rebuilt the ONNX path in Manticore
Manticore has rebuilt the ONNX path for Auto Embeddings, achieving a 14× increase in speed for converting text columns into vectors. The previous method using SentenceTransformers and Candle limited throughput, resulting in low document processing rates and serialized concurrent calls.
manticoresearch.com
14 min
12h ago
14× faster embeddings: how we rebuilt the ONNX path in Manticore
Manticore has rebuilt the ONNX path for Auto Embeddings, achieving a 14× increase in speed for converting text columns into vectors. The previous method using SentenceTransformers and Candle limited throughput, resulting in low document processing rates and serialized concurrent calls.
manticoresearch.com
14 min
12h ago
14× faster embeddings: how we rebuilt the ONNX path in Manticore
Manticore has rebuilt the ONNX path for Auto Embeddings, achieving a 14× increase in speed for converting text columns into vectors. The previous method using SentenceTransformers and Candle limited throughput, resulting in low document processing rates and serialized concurrent calls.
manticoresearch.com
14 min
12h ago
No more articles to load