John Snow Labs provides best practices for responsible AI with the release of the NLP Test Library

John Snow Labs, the healthcare AI and NLP company and developer of the Spark NLP library, is debuting NLP Test, an open-source Python software library that enables data scientists to deliver reliable, safe, and effective models.

John Snow Labs’ NLP Test Library offers a simple framework to make removing bias and securing personal information easier, according to the vendor. It does this in several ways: it is open source, lightweight, extensible, includes support of multiple libraries, and offers a comprehensive testing strategy for both models and data.

The NLP Test library can automatically generate and run more than 50 test types out-of-the-box,  covering accuracy, fairness, bias, representation, and robustness.

Multiple NLP tasks can be tested across 3 of the most popular open-source NLP libraries: Spark NLP, transformers, and spacy. The NLP Test library also provides automated data augmentation, which in some cases can automatically improve failing models, especially for issues around robustness and fairness.

“Despite their hype, many AI systems simply don’t work. It is time to set higher standards for engineering AI systems: They should work reliably, and you should be able to prove this to yourself, your customers, and your regulator,” said David Talby, CTO of John Snow Labs. “The NLP Test library provides the open-source community with a free, production-grade resource that lets data scientists apply best practices for Responsible AI, and embodies a lot of what we’ve learned over the years in delivering regulatory-grade NLP systems.”

NLP Test Library is now live and freely available. With a full development team allocated to the project, John Snow Labs is committed to improving the library with frequent releases of new test types, tasks, languages, and platforms, according to the company.

For more information about this news, visit www.johnsnowlabs.com.