ARKit and 3D Object / Image Recognition

2
votes

I'm actually trying to build an app on iOS that uses augmented reality and 3D object recognition to create an animation around a specific flower pot.

I choose ARKit for its accuracy but it seems that only plane recognition is available. Is someone know a SDK that can be use with ARKit and allows image or 3D object recognition ?

I heard about Vision that can detect faces and OpenCV but I don't know if they can do the job or if they can work simultaneously with ARKit.

Any suggestions ?

Thanks in advance :)

3
iosopencv3daugmented-realityarkit
Probably you would need to train your own model to detect that flower pot. - ZdaR
And what can I use to train my own model ? - Alain Berrier
OpenCV provides support for Haar Cascades - ZdaR
Well thanks for the advice ! Do you know if it's compatible with ARkit and if i can use haar cascades detection with an ARScene ? - Alain Berrier
You would need to include OpenCV for using Haar Cascades in your project, and it will work on any given image - ZdaR

3 Answers

3
votes

Well, I am late to answer this. But I think it will help other developers. From iOS 11 onwards, Apple has introduced CoreML/Vision framework. Fantastic ML based tool to do exactly what you need. This link will be helpful to achieve this - https://dev.to/osterbergjordan/arkit--vision-an-intriguing-combination

1
votes

ARKit and OpenCV can combine together if that`s what your concern.

I don`t know if you have experience in developing OpenCV, if you do, then I suggest you to start working on integrating them, otherwise, you should use Vision directly.

I think OpenCV requires more background knowledge and experience.

Hope this helps.

1
votes

If you want to go a little higher level you could develop your app in Unity for iOS - it supports ARKit now, and you can plug in image recognition libraries like Vuforia (easy but pricey, 1c per recognition which adds up if your app is popular) or ARtoolkit (harder but free).