Lilt introduces Contextual AI Engine for Translation; Outperforms Google Translate and GPT-4 on accuracy, latency and cost

By Business Wire On Mar 31, 2023

Launches AI DataStudio — the enterprise solution for building context-specific language models

Lilt, the most advanced AI solution for enterprise translation, announced the launch of Contextual AI Engine, a new GPT-style model for verified, enterprise-grade translation that delivers superior performance to GPT-4 and Google Translate. Contextual AI Engine uses In-Context Learning (ICL) to model language for applications in legal, marketing, product, and many other enterprise use cases.

Latest AI Insights : OpenAI Announces Initial support for ChatGPT Plugins

“Fundamentally, Lilt was founded to make the internet multilingual”

ICL is enabled by context-specific data, which many enterprises lack. To solve that problem, Lilt is also introducing AI DataStudio, which empowers companies to build their own language models with an affordable, scalable solution for data creation.

The rise of AI products like ChatGPT has inspired many businesses to evaluate the efficacy of business functions that can be automated to increase scale and reach. Language services are at the top of that list.

“Worldwide consumer interest in Generative AI has inspired businesses to rapidly integrate AI into their competitive strategies. We spoke to executives whose perceptions of AI changed, seemingly overnight, from too-risky to must-have,” said Lilt CEO, Spence Green. “Since 2015, we’ve been widely recognized as the pioneer of AI-enabled language services. Today we’re releasing the next generation of our revolutionary language technology.”

Contextual AI Engine Outperforms Google Translate and GPT-4

Today, Lilt released Contextual AI Engine, which uses a unique ICL approach to achieve higher accuracy than Google Translate and GPT-4 for many enterprise contexts. When paired with human evaluators as a factuality and verification step, Contextual AI Engine offers the most affordable, scalable, and flexible approach to enterprise language applications.

The Contextual AI Engine has 5x more parameters than Lilt’s previous engine, resulting in faster, more accurate translations. However, since Lilt’s models are built for translation, they are more compact and efficient, with over 1000x fewer parameters than GPT-4, which reduces compute costs and overall energy consumption. This is beneficial for enterprises and governments that want to run the model in their own compute environments, giving them complete control and access to the data, while also minimizing compute costs.

Customers expect to interact with enterprises in their preferred language. Before Contextual AI Engine, a complete global customer experience was operationally challenging and cost-prohibitive.

“Fundamentally, Lilt was founded to make the internet multilingual,” said Lilt Co-Founder and Chief Scientist John DeNero. “Our large language models for translation further that mission, bringing together the benefits of human-level verification and data-driven AI to create an outcome that is better than either the human or machine alone could achieve.”

The development of Contextual AI Engine has been a twelve-month endeavor, requiring Lilt’s Natural Language Processing (NLP) Research team to rebuild the system architecture to support low worldwide latency for large models. The neural network used by Contextual AI Engine is both deeper and wider than previous versions, increasing the model’s capacity to create novel representations of meaning using additional non-linear transformations and then allowing for those representations to express additional details about language and make more nuanced distinctions between meanings.

AI DataStudio Opens Access to Lilt’s Leading LLMs

In-Context Learning (ICL) is most effective when training data is recent, context-specific, and verified. However, most businesses lack this data, so they struggle to deploy context-specific models. Moreover, the rise of generative AI means that it is increasingly difficult to detect AI-generated text in data supply chains.

Lilt AI DataStudio solves both of these problems with an API-first, scalable data creation architecture in more than 60 languages. It includes built-in support for fraud detection of AI-generated text, which undermines the effectiveness of ICL. AI DataStudio is the same enterprise-grade architecture that Lilt uses to create training data for its own systems, and for its most demanding government customers. AI DataStudio is available for all enterprises.

AI DataStudio and Contextual AI Engine now offer enterprises a complete solution to building and deploying large models for the most demanding enterprise language applications. The solution offers both cloud-native and self-managed options, giving businesses maximum security, control and flexibility.

Artificial Intelligence Insights: How Artificial Intelligence is Transforming Customer Service – 7 Use Cases

[To share your insights with us, please write to sghosh@martechseries.com]