USDZ File Format: An Ultimate Guide

Apple’s USDZ format for augmented reality can be used on iPhones and iPads with iOS 12 or later. You can view USDZ files in apps like Apple News and Safari. If you find a USDZ file in these apps, make sure your device is updated to iOS 12 to see the file correctly. This allows users to easily experience AR content without needing additional apps.

What Is a USDZ File?

USDZ is a 3D file format that allows developers to exchange it between applications for convenience during creation, and also displays three-dimensional and augmented reality content on iOS devices which can be shared easily.

USDZ is a format that allows for easy viewing and sharing among iPhone and iPad users running iOS 12. What sets USDZ apart from other formats is its portability and native viewing ability, so users don’t need to download a new app every time they want to use it. Also, USDZ files can be quickly shared with fellow iOS device users. Android devices do not support USDZ yet, but have their own versions in gLTF or gLB formats.

The USDZ file format makes it simple to exchange 3D models for AR. This Adobe file format includes data for different objects and ancillary files in one place, such as mapping information, textures, rigging geometry, and more. USDZ was originally introduced at the Apple Worldwide Developers Conference (WWDC) by Pixar and Apple in 2018 to make creating top-tier 3D content easier for AR experiences.

USDZ is a format created by Pixar that stores multiple assets in one scene, which makes it easier for artists to work on the same project at the same time. You can see this used in some of Pixar’s movies like Toy Story 4 or The Incredibles 2, both of which were animated using the Hydra Engine.

Some people are afraid that USDZ may be required for assets developed elsewhere to run on iOS devices, even though it hasn’t been widely adopted yet. gLTF is currently more popular than USDZ, which can only be used with iOS.

Differences from USD File

USDZ file differ significantly from standard USD file in several key ways:

1. Portability and Sharing: USDZ files are designed for easy viewing and sharing on iOS devices without the need for additional applications. In contrast, USD files typically require specific software to view and manipulate the 3D content.
2. Compression and Encryption: A USDZ file is uncompressed and does not require encryption, allowing for quick access and rendering of the data it contains. On the other hand, a USD file can be compressed and might include encryption to protect the data.
3. Data Handling: USDZ files consolidate various elements like textures, mapping information, and rigging geometry into a single package. This makes them more efficient for AR applications on iOS devices. USD files, however, might store these elements separately, which can complicate sharing and rendering.
4. Application Compatibility: While USDZ is specifically optimized for Apple’s ecosystem, particularly iOS 12 and later, USD files are more widely used across different platforms and applications, including those in the film and animation industries.
5. Ease of Use: USDZ files are user-friendly, especially for non-technical users, as they can be easily viewed using the Quick Look feature on iOS devices. USD files require more technical expertise and specialized software to access and manipulate the 3D content.

These differences highlight the specific use cases and advantages of USDZ files in mobile and augmented reality applications, particularly within the Apple ecosystem, compared to the broader and more flexible use of USD files in professional 3D modeling and animation.

USDZ File Types

Only specific file formats, which are compatible with the USD runtime, can be included in a USDZ package. These files must support consumption via mmap, direct memory pointers, or have threadsafe access to a FILE* (such as pread-like operations). Consequently, certain 3D file formats like Alembic are not currently supported. The permitted file types include:

• USD format files such as .usda, .usdc, and .usd. Note that Apple’s current implementation of USDZ packages limits them to a single .usdc file, but this limitation is expected to be removed in upcoming OS updates. The USD format is a universal scene description developed to support the interchange of assets between different tools and applications. The native USD file is essential for maintaining the integrity and functionality of the 3D assets within the USDZ package.
• Image and texture files in formats such as .png, .jpeg (including all common extensions for JPEG), and OpenEXR are supported. These file types are crucial for adding visual details to 3D models. More details on these supported image formats can be found under Working With Image File Formats. These image files integrate seamlessly into the USDZ package, ensuring that textures and other visual elements are accurately represented.
• Audio files can also be embedded in formats such as .m4a, .mp3, and .wav, listed in order of preference. Including audio files within a USDZ package enhances the interactive experience, making the 3D content more immersive.

The USDZ file format is designed to be a versatile and comprehensive file format that consolidates various types of data into a single file. This format ensures that the 3D content can be easily shared and viewed without the need for additional software. By supporting only specific file types, the USDZ format maintains a streamlined and efficient structure, allowing for high-performance rendering and interaction on compatible devices.

Overall, the USDZ format is a robust and flexible solution for creating and sharing 3D content, leveraging the strengths of the universal scene description framework to deliver rich, detailed, and interactive experiences.

Use Cases of USDZ Format

The USDZ format, a versatile file format developed for high-performance 3D content, supports only file types compatible with the USD runtime. This includes native USD files such as .usda, .usdc, and .usd, making it a robust solution for various applications from AR to product visualization and architectural design.

Augmented Reality (AR)

With virtual reality, users can immerse themselves in a simulated world. Augmented reality goes one step further by adding digital images to the user’s real-world surroundings using a camera and device with a screen, which could be anything from another type of headset to a cell phone. One of the primary use cases for the USDZ format is creating and distributing AR content for Apple devices. The USDZ format, developed for efficiency and compactness, allows seamless streaming and real-time display of 3D content in AR applications. This makes it an essential tool for digital creators working with Apple’s ARKit framework, facilitating immersive AR experiences.

eCommerce and Product Visualization

The USDZ format is also ideal for eCommerce and product visualization. Its support for physically-based rendering (PBR) materials and textures enables the creation of highly realistic 3D representations of products. These 3D models, packaged in a USDZ file, can be easily shared and displayed on various platforms and devices, allowing customers to view and interact with detailed product models. The ability to include embedded audio further enhances the user experience by providing additional product information or context.

Architectural Visualization

he USDZ format’s support for complex scene composition, including multiple layers and a default layer file, makes it perfect for architectural visualization. Digital creators can use the USDZ package to develop detailed and accurate 3D representations of architectural designs. These models can be easily shared and viewed on various platforms and Apple devices, enabling architects, designers, and clients to explore and interact with 3D architectural models in a more immersive and intuitive manner. The format’s capability to handle only specific file types ensures that all necessary elements are integrated smoothly, providing a comprehensive view of the project.

USDZ File Format Applications

USDZ and AR can be used for the following purposes, as suggested by Geoff Stahl, Apple’s Senior Director of Software Technology Development Group, at the 2019 WWDC conference:

• ShopIQ makes it a breeze to look through items from Target, Home Depot, and Wayfair all in one place.
• The cutting-edge platform enables you to view virtual objects without having to install any software, from the convenience of your home or any other location.
• With Apple’s new iOS 12 update, you can now share USDZ files much more easily through the Mail and Message apps or the Safari web browser.
• if you integrate Quick Look with Apple Pay, your website traffic will increase.
• With Shopify’s 3D model development tools, you can make your products available in augmented reality.

USDZ Format Features

Unlike other types of zip files, USDZ files cannot be compressed and do not require encryption. Instead, they render multiple objects as one object, making them more lightweight and efficient. You can edit USDZ files by using the “unzip” command through Terminal on Mac or iOS development devices.

You can also change the file extension to .zip and extract its contents. After that, you can edit the separate files with compatible tools. According to the USDZ specification:

• The USD runtime uses a map to visualize the data.
• The data can also be accessed by pointing to the memory.
• Be sure to always keep your threads safe when accessing shared data.

USDZ was designed to be uncompressed so that programs or APIs could access the data without unpacking the files beforehand. In order to reduce file size, USDZ uses encryption. You can use plugins within a USDZ file by referencing individual files. Some developers argue that since a USDZ file starts at 64 bytes according to the specifications, it behaves essentially like a text file. Consequently, you can save any USDC or USDA file in USDZ format.

How to view a USDZ file

In order to see a USDZ file by using AR Quick Look, you need an Apple device that has iOS 12. If you’re looking at photos or icons with the Quick Look feature, there will be an AR link located in the top right-hand corner; once clicked, it will start the AR experience on your device.

AR Quick Look previews AR or 3D content on your iOS 12 device by displaying it over real-world views. With older versions of Quick Look, users could only preview certain file types such as images and documents. However, USDZ files now open effortlessly on Apple devices because AR Quick Look is part of the operating system. Also, the possible interactions are limited, but they include movement and sizing models with a basic swipe or pinching gesture. And although Android devices don’t have an analogous solution, some third-party options exist even though they’re not native to the Android OS.

How to convert a USDZ file

Since the announcement of USDZ, not much has changed in terms of ways to convert files. However, pre-compiled Python libraries from companies like Pixar have made it easier for users. You can also use programs like Xcode 10, which requires just a few lines of code to convert your media file.

USDZ Conversion Programs

Designers who make 3D models use a variety of programs to generate textures and later convert the files into USDZ format. Some more prevalent file formats used to save these models include OBJ and ABC. If you want to convert a USDZ file into gLTF format, unzip the USDZ file beforehand and tweak the texture files before exporting as a gLTF. Listed below are some programs that can be used to create entirely new 3D models or edit existing ones that can then be converted into USDZ files with Adobe Project Aero, Adobe Substance Painter, Autodesk Maya, or Quixel.

How to start creating content with USDZ

USDZ is a great choice for artists wanting to get into augmented reality, but Adobe has announced that its Creative Cloud applications will now support the file format. The desktop beta version is available now, and the mobile app is already live. Project Aero is where you can find all of Adobe’s latest progress on this front.

Conclusion

The USDZ file extension is used for compressed, 3D augmented reality assets. It was developed by Apple and Pixar, collaborating with third-party companies such as Adobe. The USDZ file format allows for easy sharing of AR content across devices and applications, making it a valuable tool for developers and designers. Overall, the USDZ file format shows excellent potential for the future of AR technology.