Understanding NVIDIA DLSS: An Overview of Upscaling Technology and Its Alternatives

Since its debut in February 2019, NVIDIA Deep Learning Super Sampling, commonly known as DLSS, has evolved from being a controversial development to a pivotal feature expected in most PC games. Its innovation not only reshaped gaming performance but also influenced competitors like AMD and Intel to create their own upscaling technologies. Although DLSS stands out for its use of AI-driven upscaling, recent iterations of AMD’s FidelityFX Super Resolution (FSR) and Intel’s Xe Super Sampling (XeSS) have also begun to incorporate AI hardware from modern GPUs, thus leveling the playing field.

This article aims to delve into the core concepts of NVIDIA DLSS and upscaling technologies. We’ll explore alternatives, functionalities, usage in gaming, and potential preferences among different upscalers. Whether you’re a gamer or a tech enthusiast, you’ll find answers to the pressing questions that come with these technologies.

Understanding NVIDIA DLSS: An Overview of Upscaling

NVIDIA DLSS, or Deep Learning Super Sampling, is an advanced upscaling technology launched by NVIDIA with its RTX 20 Series GPUs in 2018. This innovation marked the introduction of real-time ray tracing into PC gaming, alongside the first iteration of DLSS, powered by specialized hardware such as RT cores (for ray tracing) and Tensor cores (for AI tasks).

DLSS functions by taking a lower resolution image—such as 720p—and transforming it to higher output resolutions including 1080p, 1440p, or 4K. The effectiveness of DLSS and similar upscalers improves with higher internal resolutions prior to upscaling, ultimately enhancing visual fidelity.

While DLSS’s initial launch faced criticism for blurry images, subsequent iterations—particularly DLSS 2—garnered acclaim for their improved image quality and motion clarity, with some asserting that certain applications deliver visuals surpassing native resolution. This assertion, though debated among gaming purists, emphasizes the growing role of upscaling technologies like DLSS in modern gaming – to the point that developers now anticipate its presence and may inadvertently sideline optimization in their games.

Leading Alternatives to NVIDIA DLSS

AMD FidelityFX Super Resolution

AMD FidelityFX Super Resolution serves as AMD’s counterpart to NVIDIA DLSS, but unlike DLSS, FSR’s earlier versions (1 to 3) are vendor-neutral and function well across AMD, Intel, and NVIDIA hardware. However, with the release of FSR 4, it now requires AMD’s AI hardware for upscaling. While pre-FSR 4 versions are often deemed inferior in image quality compared to DLSS 2 and later models, they hold the advantage of being compatible with older NVIDIA GPUs that lack native support for advanced upscaling.

Intel Xe Super Sampling

Intel’s XeSS follows a similar trajectory as AMD’s FSR, emerging later in the market. Recent iterations of XeSS incorporate AI-enhanced features and frame generation. Benchmark comparisons indicate that earlier versions of XeSS may outperform AMD FSR, but distinctions between the two often depend on specific game implementations. Like FSR, XeSS gained competitiveness when it began to utilize AI acceleration from Intel’s hardware.

Apple MetalFX Upscaling

Even Apple has joined the upscaling trend with MetalFX, which supports AI-accelerated image enhancement along with frame generation across macOS and iOS devices. Although Apple was late to introduce this solution, MetalFX is robust, offering enhanced capabilities for its diverse user base.

In-Game Upscaling: Various Solutions

Many games have integrated their own upscaling options, including dynamic resolution scaling, aimed at optimizing frame rates—exemplified in titles like Doom Eternal. Unreal Engine-powered games, such as Tekken 8, utilize the exclusive Temporal Super Resolution (TSR), providing tailored visual enhancements that might not reach the same quality level achievable with DLSS 3 in “Quality Mode.”

How to Utilize NVIDIA DLSS and Other Upscalers

Activating NVIDIA DLSS or any alternative upscaling technology is a straightforward process. Simply navigate to the graphics settings of your chosen PC game, typically labeled as “Upscaling”or something similar, and select your desired option—be it DLSS, FSR, or another upscaler.

When choosing between different modes of upscaling, consider the following guidelines:

Quality Mode: Utilizes approximately 66-75% internal resolution, producing visuals that can occasionally exceed native clarity thanks to AI enhancements.
Balanced Mode: Employs about 50-58% internal resolution; generally regarded as the best compromise between performance and quality.
Performance Mode: Agrees on roughly 33% internal resolution; ideal for 4K displays or when frame rates must be prioritized.
Ultra Performance: Uses 25% internal resolution or less; recommended in extreme scenarios where frame rates are vital, albeit with potential ghosting at lower frames.

An Insight into NVIDIA DLSS Frame Generation

The introduction of DLSS 3 brought an optional feature called Frame Generation, exclusive to NVIDIA’s RTX 40 Series GPUs. Subsequent versions like DLSS 4 introduced Multi Frame Generation, preserving exclusive access to these advanced functionality for the latest GPU generations, thereby creating a market gap.

NVIDIA Frame Generation — Image Credit: NVIDIA

AMD’s FSR 3 subsequently addressed this gap by offering its own Frame Generation that operates independently of hardware. When properly configured, it is compatible with NVIDIA RTX 30 Series GPUs lacking access to native Frame Generation. Intel’s XeSS and MetalFX from Apple have similarly adopted Frame Generation capabilities.

So, what exactly is Frame Generation? It enhances the visual fluidity of games through frame interpolation, though it doesn’t increase actual gameplay smoothness. It’s often compared to the “soap opera effect”seen in televisions incorporating similar technologies. However, with GPU integration, Frame Generation tends to render results that appear convincing, effectively doubling or even tripling the smoothness of gameplay, especially on high-refresh-rate displays.

Frame Generation primarily serves to elevate the visual quality of mid-range and high-end gaming setups particularly suited for refresh rates above 360 Hz. It yields impressive results, especially on OLED displays. However, to make the most out of this feature, you should ideally maintain a baseline frame rate of at least 60 FPS.

Evaluating if NVIDIA DLSS is the Best Upscaler

In many respects, NVIDIA DLSS holds a competitive edge among upscalers, despite recent criticisms of its generative AI filters in DLSS 5, deemed by some as distorting the intended artistic vision of games.

Historically, DLSS has enjoyed a lead over alternatives, particularly prior to the AI enhancements seen in AMD FSR and Intel XeSS. However, with AI now employed across the board, the differences among the upscalers can become nuanced and harder to differentiate.

Even as a devoted NVIDIA GPU user, there might still be situations where opting for AMD FSR could be beneficial. For instance, titles like Final Fantasy XVI exclusively support Frame Generation via AMD FSR 3 or DLSS 4. However, the latter option is limited to NVIDIA’s RTX 40 Series, which can pose challenges for users with older GPUs.

Using NVIDIA DLSS or Other Upscalers Without Game Support

The answer here is a bit mixed.

For games that lack support for modern upscalers, there is limited recourse beyond frame generation injection, which may not effectively alleviate input lag as it doesn’t truly enhance performance like a genuine upscaler would. These technologies require specific in-engine integrations to function optimally, including motion vectors.

If a game does support a modern upscaler but not the desired one, it’s possible to utilize tools like OptiScaler to force a preferred upscaler in games meeting the necessary criteria for functionality. A comprehensive guide on OptiScaler would extend beyond the scope of this article, but it provides an intriguing alternative for gamers seeking customization.

Do Consoles Support NVIDIA DLSS or Other Upscalers?

Modern consoles like Sony’s PlayStation 5 and Microsoft’s Xbox Series X/S cannot utilize NVIDIA DLSS, given their reliance on AMD hardware. However, several titles have incorporated AMD’s FSR on these platforms, and the latest AI-driven PSSR on PS5 Pro stems from collaborative development between Sony and AMD for FSR 4.

Conversely, the Nintendo Switch 2 does support a tailored version of NVIDIA DLSS, aptly named “tiny”DLSS, designed with the console’s handheld capabilities in mind. This allows Nintendo’s latest device to maintain competitive image quality in contemporary gaming scenarios.

Source & Images