Searchable.ai Releases KitanaQA

KitanaQA is a new open source library that enables machine learning and natural language processing researchers to develop more robust, trustworthy models for question answering.

Searchable.ai releases KitanaQA, a suite of innovative tools to train question-answering models to respond more reliably and accurately when they encounter noisy inputs like misspellings, incorrect grammar, and foreign words. These types of inputs can very easily render leading language models—including those developed by Google, Facebook and Microsoft—completely ineffective because even though they exhibit high accuracy on research benchmarks, these models are often brittle and unpredictable in the real world. As a result, a gap has emerged between cutting-edge research and industry use cases.

Recommended AI News: Huobi Labuan Launches in Malaysia to Provide Locals With Regulated Digital Asset Trading Services

Searchable.ai Labs is working to bridge this gap by training models that are more robust and resistant to the types of noise that occur in the wild. “Robustness is key to building trust in NLP-based technologies, and KitanaQA can help harden question answering models before they are ever deployed in production,” says Searchable.ai Chief Scientist Aaron Sisto.

In order to provide researchers with a complete set of tools to accomplish this task, KitanaQA focuses on three main features: adversarial training, data augmentation and workflow automation. Together, these techniques enable language models to generalize to noisy user queries or reference text even if they have never encountered these exact inputs before. Much of this benefit arises from the multifaceted approach to training provided by KitanaQA. While adversarial training prepares the model to produce more reliable answers in the presence of small amounts of noise, data augmentation exposes the model to more extreme types of noise at the same time, helping the model to understand the true meaning behind a user’s questions, no matter the specific instantiation.

Recommended AI News: Accenture Completes Acquisition of OpusLine

KitanaQA makes these tools accessible to the broader research community by providing automated pipelines that can be integrated with many different models and proprietary datasets. The creators point out that no model is robust to every type of user input, even with these tools on hand. In fact, some questions are simply too vague or challenging to answer and a question answering system should inform the user of this, instead of trying to answer the question incorrectly.  For many question answering applications involving PDFs, webpages or MS Office documents, KitanaQA can provide meaningful improvements to model performance and reach a level of robustness that is acceptable to critical enterprise applications.

Recommended AI News: 360factors Announces Partnership with Reg-Room LLC