2
votes

I created a classifier in NLC after creating certain number of classes(intents) and few examples for each class. However the classifier accuracy was very poor.

When I used the same training data in Watson conversation service and tested it, the intent identification accuracy was very good.

As I understand conversation service uses NLC, then why is there such a big difference in the performance?

2

2 Answers

1
votes

Watson Conversation does not use NLC. They have two very different learning models. Conversation works better with natural language classification, while NLC with text in general.

NLC also takes longer to build it's model vs Conversation. Something that will take Conversation a few minutes, can take 30 minutes or more for NLC.

Lastly NLC uses what is called relative accuracy, while Conversation uses absolute confidence.

To explain, imagine you have two intents "Cars" + "Trains".

If you ask NLC a question, it will always tell you it is car or train, even if that question is "What is an elephant?". The confidences also added together will always add up to 100%.

Conversation on the other hand can understand that your question might not be related at all to what it is trained on. So it can tell you that an elephant is not a car, nor a train.

0
votes

The services are optimized for different use-cases, so it might happen that you get different confidence values from these.