0
votes

Is finger tracking supported by ARKit 3? And if yes, can ARKit 3 be used in conjunction with the face detection API for the TrueDepth Camera module to sport the position of a certain finger in respect to eyes, nose and mouth? If not, is there an easy way for finger tracking using, without going as deep as using Metal APIs?

Note: by finger tracking, I mean tracking the number of fingers and/or which finger(s) is visible.

1

1 Answers

0
votes

It's possible that you can get pretty close positions for the fingers of a tracked body using ARKit 3's human body tracking feature (see Apple's Capturing Body Motion in 3D sample code), but you use ARBodyTrackingConfiguration for the human body tracking feature, and face tracking is not supported under that configuration. Also, the joints for fingers are not tracked, so while you can get their approximate location using a joint that is tracked (i.e., the wrist), ARKit won't tell you which fingers are extended or retracted.