OctoML announced OctoAI, the industry’s first self-optimizing compute service for AI The new platform offers developers a fully-managed cloud infrastructure designed to abstract away the complexity of building and scaling AI applications. OctoAI provides the freedom to run, tune and scale the models you choose, including off-the-shelf, open-source software (OSS) and custom models. With OctoAI, developers now have easy access to cost efficient and scalable accelerated computing, so they can focus on building high-performance cloud-based AI applications and deliver great user experiences for their customers.
Read: ChatGPT Is Much More Than A Data Prep Assistant
To help developers quickly build on the latest and greatest models, OctoAI is also introducing a library of the world’s fastest and most affordable generative AI models—powered by the platform’s model acceleration capabilities. OSS foundation model templates available at launch include Stable Diffusion 2.1, Dolly v2, Llama 65B, Whisper, FlanUL, and Vicuna.
“AI is no longer a novelty, it’s real business. But efficient compute is critical to making it viable,” said Luis Ceze, CEO, OctoML. “Every company is scrambling to build AI-powered solutions, yet the process of taking a model from development to production is incredibly complex and often requires costly, specialized talent and infrastructure. OctoAI makes models work for businesses, not the other way around. We abstract away all the complexity so developers can focus on building great applications, instead of worrying about managing infrastructure.”
Ceze added, “Our early OctoAI customers are using generative AI models like Stable Diffusion, FILM, and Flan UL to build a huge variety of applications. But they all share two things in common: first, customization is fundamental to delivering unique experiences for their customers, which is how they differentiate. Second, they require the ability to scale their services quickly, leveraging flexible hardware options from NVIDIA GPUs to specialized AI silicon like AWS Inferentia2.”
Latest Insights: Leverage Artificial Intelligence Tools to Reduce Fraud and Friction for Customers
Features and benefits of OctoAI include:
- Ease-of-use. Choose from a library of ready-to-use templates for popular open-source models to simplify deployment. Select and customize (fine-tune) models to meet specific requirements. Easily integrate with app and model development workflows.
- Efficiency. Run, tune and scale off-the-shelf, open-source software (OSS) and custom models. Automated hardware selection lets you decide on price-performance tradeoffs.
- Freedom. Upgrade to new models as they emerge. Bring your own custom models. No lock-in into the model or service.
AiThority: The 3 Building Blocks to Make AI Accessible
[To share your insights with us, please write to sghosh@martechseries.com]
Comments are closed.