NVIDIA DLSS Transformer Model Enhances Image Quality on All GeForce RTX GPUs, Dominating CNN Technology

In a significant advancement for gamers and developers alike, NVIDIA has unveiled its new Transformer model alongside the much-anticipated DLSS 4. This innovative model will be compatible with all RTX graphics cards, spanning the RTX 20, 30, 40, and 50 series.

Transforming Visuals: NVIDIA’s Shift to a Transformer Model in DLSS 4

Traditionally, NVIDIA relied on Convolutional Neural Networks (CNN) to enhance image quality by adding pixels to existing frames. Despite improvements over the years, this method has reached its limitations. The introduction of the DLSS Transformer Model marks a pivotal shift, offering improved visual fidelity alongside the launch of DLSS 4.

While features such as Multi-Frame Generation are exclusive to the latest RTX 50 series GPUs, the Transformer model will extend its capabilities across previous RTX generations. Reports from NVIDIA’s official announcement and insights from Jacob Freeman confirm that models from the RTX 20, 30, 40, and 50 series will benefit from these enhancements.

NVIDIA DLSS Transformer Model Takes Over CNN, Improves Image Quality Across All GeForce RTX GPUs 1

Although the RTX 30 and 20 series will not have access to the exclusive DLSS Multi-Frame Generation, they will still experience noticeable improvements through the “Enhanced”DLSS Ray Reconstruction and DLSS Super Resolution fostered by the Transformer model. NVIDIA’s implementation utilizes a vision transformer that meticulously analyzes pixel data in each frame, accounting for the significance of individual pixels across multiple frames to deliver sharper details.

This cutting-edge technique effectively utilizes double the parameters compared to traditional CNNs, resulting in notable enhancements in gameplay visuals. Users can expect reduced ghosting and smoother edges. NVIDIA’s demonstrations highlighted performance improvements in various demanding titles. For example, in Alan Wake 2, the Transformer model proved superior to the CNN model, offering greater stability in mesh rendering and markedly less shimmering.

In high-speed scenarios, such as the depiction of fan blades, the Transformer model tackles clarity issues where CNN struggles. This results in significantly reduced ghosting, alongside improved visual clarity around moving elements like cables.

In conclusion, DLSS 4 not only enhances the performance capabilities of all RTX GPUs but also integrates NVIDIA’s advanced Transformer model to ensure robust visual stability. It is worth noting that NVIDIA also emphasizes latency reduction as a crucial component of this update, facilitated by the integrated Reflex technology.

An updated version, Reflex 2, is set to launch for RTX 50 series GPUs, promising even lower latency, with availability on earlier RTX models as well.

Source & Images