Myrtle.ai Enables Microsecond ML Inference Latencies running VOLLO on Napatech SmartNICs

Myrtle.ai, a recognized leader in accelerating machine learning inference, released support for its VOLLO® inference accelerator on the NT400D1x series of SmartNICs from Napatech.

VOLLO achieves industry-leading ML inference compute latencies, which can be less than one microsecond. This new release enables those who need the very lowest latencies possible to run inference next to the network in a SmartNIC. A wide range of models may be run on VOLLO, including LSTM, CNN, MLP, as well as Random Forests and Gradient Boosting decision trees.

Also Read: AiThority Interview with Ian Goldsmith, CAIO of Benevity

This has been developed to meet the needs of a wide range of applications including financial trading, wireless telecommunications, cyber security, network management and others, where running ML inference at the lowest possible latency confers advantages in security, safety, profit, efficiency and cost.

“We’re excited to be working with the world leader in SmartNIC sales to enable unprecedented low latencies for ML inference.” said Peter Baldwin, CEO of Myrte.ai.  “Our customers are aggressively seeking ever lower latencies and this new release will enable them to leverage the full benefit of VOLLO’s latency leadership.”

Also Read: The Autonomous Enterprise: How Agentic AI Is Orchestrating The Next Wave Of Business Transformation?

Jarrod J.S. Siket, Chief Product & Marketing Officer at Napatech was excited about the prospects.  “We recognized that the latency leader in the STAC® ML benchmarks could bring real value to our customers in the finance market as they increase their adoption of ML for auto trading.” he said.  “The VOLLO compiler is designed to make it very easy for ML developers to use our SmartNICs and this really strengthens our portfolio of products and services.”

Interested parties may now download the ML-oriented VOLLO compiler from vollo.myrtle.ai today and discover what latencies can be achieved with their models on the NT400D1x series of SmartNICs from Napatech.