قالب وردپرس درنا توس
Home / Tips and Tricks / Apple iOS-powered Sesame Street app turns kids into their favorite characters through the new features of ARKit 3 «Mobile AR News :: Next Reality

Apple iOS-powered Sesame Street app turns kids into their favorite characters through the new features of ARKit 3 «Mobile AR News :: Next Reality



The longest running television show for children in the United States, Sesame Street did not survive 50 years without using new technology along the way.

The newest innovation of the Sesame Street Workshop is Sesame Street Yourself, a new iOS app that uses the new features of ARKit 3.

Sesame Street Yourself is now available through the Apple App Store and uses the multi-face tracking feature from ARKit to identify users and turn them into their favorite Sesame Street characters. The ad-free app also entertains children aged 3-5 with games, singing and dancing.

Image via Weyo [19659006] "We just thought that [ARKit 3] is a fantastic, giant toolbox with tricks. [We wanted to see] what we [could do with] are the technology for fantastic immersive interactive experiences for children, "said Baz Palmer, the co-founder of Weyo (the game's developer), in an interview with Next Reality.

Palmer and his team benefited from the ARKit feature set for both the rear and front camera. On the rear camera, for example, children can help Cookie Monster to bake cookies. On the front camera, they can become Ernie and fit different outfits.

Image via Weyo

The multi-Face Tracking technology of ARKit 3 gives parents the opportunity to work together play with their children, with each face wearing a different character mask that the individual follows while moving within the camera image.

"Working with the Sesame brands, you have these sweet characters and you have a very clear demographics that will try to enter into it," Palmer said. "It really focuses on how we want to use the technology."

Image via Weyo

Weyo originally contained elements that also benefited from People Occlusion and Motion Capture features from ARKit 3, but according to Palmer, the team has excluded these features from the final release to keep the app lighter. However, they plan to offer these experiences later as add-ons for the app.

Because the app uses ARKit 3, it is limited to compatible iPhones and iPads, namely iPhone X S X S Max and X R the 2019 editions of the iPad Air and iPad Mini, and the latest 11-inch and 12.9-inch iPad Pro models.

This is not the first trip from the Sesame Street Workshop to augmented reality. In 2013, the organization integrated the Vuforia AR platform into Big Bird & # 39; s Words, an educational game that used Vuforia's computer vision to help players find words in the real world. Vuforia also supplied the AR behind a prototype AR play set.

Nevertheless, Sesame Street Yourself is the first household brand name to have taken over ARKit 3, which is important given that ARKit 2 never really caught on. The uniqueness of People Occlusion and Motion Capture is perhaps the secret ingredient to help app developers build more innovative AR experiences.

Don't miss it: NR30: 30 people from Next Reality to watch in Augmented Reality for 2019 [19659022]
Source link