onnx
Latest stories covering onnx, with summaries and links to related coverage.
1 articles · page 1 of 1
Connected topics
14× faster embeddings: how we rebuilt the ONNX path in Manticore
tool
14 min read
Manticore has rebuilt the ONNX path for Auto Embeddings, achieving a 14× increase in speed for converting text columns into vectors. The previous method using SentenceTransformers and Candle limited throughput, resulting in low document processing rates and serialized concurrent calls.