How to test Artificial Intelligence and Machine Learning solutions?

Testing community is discussing how machine learning can find bugs and replace testers. Meanwhile the reality is more boring and not so much futuristic. Engineers are releasing machine learning and artificial intelligence services that should be tested. Based on real experience of delivering such products I want to share how different such testing is from regular solutions and what are possible problems. After my talk you’ll have a starting point to test this AI and ML magic once you are faced with it.

Code could be found here.