LUIS Batch Testing for Entity is Not Working

2
votes

Referring to the batch testing document from Microsoft, I have imported the LUIS app provided from this document and import this this JSON batch file to LUIS batch testing panel and try to run the test.

The testing result of 'Intents' is as expected, however, for the 'Entities', it is expected some of the entities will pass but at the end all entities are failed: Entities Fail Screenshot

Is it a bug in LUIS or anything going wrong?

Updates: The issue above is fixed but some batch testing function are still not working

After the fix have been released, I have tried it again. I found that it works fine with no entity, simple entity and hierarchical entity. However, for List Entity and Regex Entity still not working on Microsoft sample. Entity list and entity list in batch testing in Microsoft sample are not match. Besides, in my own Luis project, the list entity is showing in the batch testing entity list but the result is strange (caption in this screen cap).

1
azureazure-language-understanding
just repro'd your steps. It does seem like a bug...pinging the LUIS dev team to verify – Zeryth
Indeed it is a bug, and has been reported. We will work towards a resolution. Thank you for bringing the matter to our attention – Zeryth
Thanks for the reply. Hope that it can be fixed asap. – Eric Chan
@ Eric, a fix was deployed over the weekend. Is everything working alright for you now? – Zeryth
@Zeryth thank you very much for fixing the issue. The original issue have been fixed but there are still some bugs in batch testing. Please kindly see the above updates. – Eric Chan

1 Answers

0
votes

By the way, if you look at the tutorial, it is stated that:

"Only the machine-learned entities are used: simple, hierarchical (parent-only), and composite entities. Do not add non-machine-learned entities because they are always found either through regular expressions, or explicit text matches"

And List Entities are not machine-learned entities.