Snapchat Unveils Gen-AI Advancements For Superior AR Experience

Snapchat, owned by Snap, has unveiled a generative artificial intelligence suite as part of its new Lens Studio 5.0 release. This on-device AI model will enhance the augmented reality (AR) experience for users. Snapchat mentioned that it is showcasing Snap's real-time image model, which "can instantly bring your imagination to life in AR". By leveraging AI, Snapchat enables users to type an idea for a transformation and create vivid AR experiences in real time.

With these new AI features, Snapchat users can alter their video surroundings. The update ensures that changes match the light and colours in the video, providing a seamless experience, according to Snapchat. The new on-device AI model will use the user's text prompt to generate a custom lens.

Image Courtesy: Thought Catalog/Unsplash

Enhanced AR Experience for Creators

Snapchat is also introducing a suite of AI tools to help creators improve the AR experience. The recent update to Snapchat's developer platform, Lens Studio, includes features like new face effects and Immersive ML. New face effects allow creators to modify the user's face based on a written prompt or uploaded image, while Immersive ML transforms the face, body, and surroundings of the user in real time. Additionally, the update provides an AI assistant to assist developers in building 3D models.

Previously, Snapchat users could only make basic additions to videos. However, with this new update, special effects added to images are expected to appear more realistic.

Future Capabilities and Availability

Soon, Snapchat users will be able to generate 3D assets using text or image prompts. For instance, a 3D character head will mimic user expressions and create face masks and textures. Access to this new model will be available in the coming months for users and later in the year for creators.

Earlier this year, Snapchat launched a ChatGPT-powered AI chatbot that allows subscribers to share AI-generated snaps with friends.

The introduction of these advanced AI tools marks a significant step forward for Snapchat's AR capabilities. Users can look forward to more immersive and interactive experiences as these features roll out.