IBM Working on Greater Business Use of Natural Language Processing
IBM today at an online event outlined a plan to bring to market new natural language processing (NLP) technology that will help computers better understand human communication and companies better communicate with their customers.
The company is working on commercial applications of the NLP technology developed as part of IBM Research's Project Debater, an artificial intelligence-powered system originally designed to compete against a world-class human debater in the same way that Watson did on the TV game show "Jeopardy!" The Project Debater technology is being rolled into IBM's Watson AI product line, including Watson Discover, Watson Assistant, and Watson Natural Language Understanding, IBM officials said during an online version of the IBM Innovation Preview related to artificial intelligence and NLP.
IBM's work with Project Debater involved creating a system that could listen to an opponent's argument, understand the argument, and craft a response quickly from a large corpus of data. That requires a very robust NLP engine, which IBM hopes to move into production for businesses to improve their communications with customers.
"NLP is the brains of business today,"said Rob Thomas, general manager of data and AI at IBM. For companies, the technology can promise shorter call times, reduced workloads, and increased productivity, he said.
Ruchir Puri, a chief scientist at IBM Research, said two of the biggest business uses for NLP are customer self-service and agent-assisted service through contact centers.
Additionally, the two business-critical capabilities of NLP are"discovering the right insights" and then using them to guide conversations with customers.
From a business standpoint, Project Debater will allow companies to take controversial topics, identify the pros and cons of different positions, and then help them make informed decisions, said Aya Soffer, vice president of AI technologies at IBM Research.
IBM, she added, "has a very rich agenda" for research in NLP, noting that the Project Debater work has already been ongoing for seven years.
A big part of the Debater development involves sentiment analysis, which IBM experts extol as a huge boost for businesses.
Beyond that, another key capability of NLP will involve more efficiently combing through large amounts of data, conducting research, fielding incoming communications, and ultimately improving customer service.
But before that can happen, a lot more work needs to take place in the development not just in sentiment, but also in context and language variations. Specific attention has to be given to idioms and industry- and company-specific terminology, Thomas said.
When tied into IBM's existing Watson apps, it can also make it easier for companies to pore through and derive insights from large data warehouses.
NLP technology needs to be able to understand central themes in documents, classify them into specific categories, retrieve other necessary information, and then generate summaries from the mass amounts of data, Puri said.
That will take time, according to Luke Palamara, IBM's program director of product management for AI-based NLP. Though advanced sentiment analysis is being rolled into Watson applications right now, other Project Debater innovations are still a way off. "We are just at the start of bringing [Debater] into our portfolio and integrating it with Watson," he said.