Meta Launches 3D Gen AI For Quick 3D Visuals Creation From Text
Meta, the parent company of Facebook, Instagram, WhatsApp, has unveiled a research paper on its "Meta 3D Gen AI" system. This system can generate 3D models using text prompts. Meta claims that the 3D Gen AI system can produce high-quality 3D assets with detailed textures and material maps in under a minute.
According to Meta's researchers, Meta 3D Gen is an integrated system comprising two AI-powered sub-systems: Meta 3D AssetGen and Meta 3D TextureGen. Users can input text prompts to create AI-generated 3D content like characters, props, or scenes. Additionally, users can provide an existing 3D mesh for the system to add texture.
Meta 3D Gen: How it works
The process begins with the user providing instructions for creating a 3D structure and its design elements. The first step involves the Meta 3D AssetGen system generating an initial "3D asset" based on the user's prompt. This step produces a textured 3D mesh with Physically-Based Rendering (PBR) material maps in about 30 seconds.
In the second stage, higher-quality textures and PBR maps are generated for the initial 3D asset. This step uses the Meta 3D TextureGen system and takes approximately 20 seconds. The TextureGen system can also function independently as a text-to-texture generator if provided with an existing 3D mesh and a text prompt detailing the desired texture.
Meta 3D Gen: What is it
The combined AI system leverages Physically-Based Rendering (PBR) techniques to build up high-quality 3D content from scratch. For example, if a user inputs a prompt asking for a T-rex wearing a green wool sweater, the system first creates a visual of the T-rex. It then adds the wool sweater texture and other colour details.
This innovative approach allows for rapid creation of detailed and textured 3D models, significantly reducing the time required compared to traditional methods. The ability to generate complex textures and materials quickly makes this technology particularly valuable for industries requiring high-quality visual assets.
Meta's new AI system represents a significant advancement in automated content creation, offering users an efficient way to produce intricate 3D models with minimal effort. By combining advanced rendering techniques with user-friendly interfaces, Meta aims to streamline the process of generating high-resolution digital assets.
The introduction of Meta 3D Gen highlights Meta's ongoing commitment to leveraging artificial intelligence for creative applications. As technology continues to evolve, such systems could become integral tools for designers, game developers, and other professionals in need of sophisticated visual content.
Sign in with Google