Snapchat offered an early look in its upcoming on-device AI model capable of transforming the user’s environment with augmented reality (AR). The new template will eventually allow creators to turn a text prompt into a custom lens – potentially opening the door to some wild looks to try on and send to friends.
You can see what this would look like in the GIF below, which shows a person’s clothes and background morphing in real time based on the prompt “50s sci-fi movie.” Users will begin to see lenses using this new model in the coming months, while creators will be able to begin manufacturing lenses using the model by the end of this year, according to TechCrunch.
Additionally, Snapchat is launching a suite of new AI tools that could make it easier for creators to create custom augmented reality (AR) effects. Some of the tools now available with the latest Lens Studio Update include new face effects which allow creators to write a prompt or upload an image to create a custom lens that completely transforms the user’s face.
The suite also includes a feature, called immersive ML, which applies a “realistic transformation to the user’s face, body and surroundings in real time.” Other AI tools coming to Lens Studio allow lens creators to generate 3D assets based on a text or image prompt, create facial masks and textures, as well as create 3D character heads that mimic the user’s expression.