Image via Weyo  "We just thought that [ARKit 3] is a fantastic, giant toolbox with tricks. [We wanted to see] what we [could do with] are the technology for fantastic immersive interactive experiences for children, "said Baz Palmer, the co-founder of Weyo (the game's developer), in an interview with Next Reality.
Palmer and his team benefited from the ARKit feature set for both the rear and front camera. On the rear camera, for example, children can help Cookie Monster to bake cookies. On the front camera, they can become Ernie and fit different outfits.
Image via Weyo
The multi-Face Tracking technology of ARKit 3 gives parents the opportunity to work together play with their children, with each face wearing a different character mask that the individual follows while moving within the camera image.
"Working with the Sesame brands, you have these sweet characters and you have a very clear demographics that will try to enter into it," Palmer said. "It really focuses on how we want to use the technology."
Image via Weyo
Weyo originally contained elements that also benefited from People Occlusion and Motion Capture features from ARKit 3, but according to Palmer, the team has excluded these features from the final release to keep the app lighter. However, they plan to offer these experiences later as add-ons for the app.
Because the app uses ARKit 3, it is limited to compatible iPhones and iPads, namely iPhone
X S X Max and S X the 2019 editions of the iPad Air and iPad Mini, and the latest 11-inch and 12.9-inch iPad Pro models. R
This is not the first trip from the Sesame Street Workshop to augmented reality. In 2013, the organization integrated the Vuforia AR platform into
Big Bird & # 39; s Words, an educational game that used Vuforia's computer vision to help players find words in the real world. Vuforia also supplied the AR behind a prototype AR play set.
Nevertheless, Sesame Street Yourself is the first household brand name to have taken over ARKit 3, which is important given that ARKit 2 never really caught on. The uniqueness of People Occlusion and Motion Capture is perhaps the secret ingredient to help app developers build more innovative AR experiences.
Don't miss it: NR30: 30 people from Next Reality to watch in Augmented Reality for 2019