CircleCI Launches Free DeepLearning.AI Short Course on Automating LLM Evaluations

New on-demand course provides developers with the first-ever framework for automating LLM evaluations so software teams can confidently release AI-powered applications

CircleCI, the leading continuous integration and continuous delivery (CI/CD) platform, announced it has published a free DeepLearning.AI short course titled Automated Testing for LLMOps. This short course is a beginner-level, hour-long learning experience that will introduce developers to practical ways AI-powered applications (apps) can be tested and shipped to production. CI/CD serves a critical role in automating LLMs, enabling continuous testing of real-time changes within the model, and helping developers build and ship AI-powered software with more visibility and confidence.

Recommended AI News: Tealium Unveils New Solutions That Deliver In-The-Moment Experiences and Faster AI Outcomes

“However, I believe we already have 90% of the tools and methodologies to be successful. CI/CD is a natural fit for testing LLM-powered applications, which is why we are excited to educate developers using DeepLearning.AI’s robust platform.”

“We’re excited about this short course because it addresses a key issue for many software teams building LLM-powered applications: how to quickly evaluate and build trust in LLM outputs,” said Andrew Ng, Founder of DeepLearning.AI. “Further, by incorporating LLM evaluations into continuous integration, developers can reduce the risk of unforeseen issues arising from the development process.”

2024 continues to solidify AI’s increasing role in software development. Software teams are shifting their focus from building custom models to working and building on top of existing ones. Therefore, it’s crucial to define best practices when implementing LLMs within applications. By applying the fundamentals of continuous integration, participants who take this short course will learn how to use automated testing techniques to model evaluations, better equipping them to deliver and maintain high-quality applications.

Recommended AI News:  Zscaler Introduces Industry’s First Zero Trust SASE, Built on Zero Trust AI

“Many software teams have a huge desire and demand to build AI into their applications, yet we don’t have a set of established practices on how to strengthen AI innovation with the hard and fast norms of software development,” said Rob Zuber, CTO at CircleCI. “However, I believe we already have 90% of the tools and methodologies to be successful. CI/CD is a natural fit for testing LLM-powered applications, which is why we are excited to educate developers using DeepLearning.AI’s robust platform.”

CircleCI is committed to being the CI/CD tool of choice for AI-powered application development, and the platform has seen strong growth in teams prioritizing AI projects. In 2023, CircleCI saw a +30% increase in AI orgs using the platform and a +108% increase in AI pipeline progression.

Recommended AI News: Varonis Accelerates Secure Adoption of Microsoft Copilot for Microsoft 365

[To share your insights with us as part of editorial or sponsored content, please write to sghosh@martechseries.com]