Asus Unveils AI Cache Boost: Enhancing AI Performance for AMD Ryzen 9000 Series

Asus unveils AI Cache Boost -- claims up to 19% faster AI workloads on Ryzen 9000 series

Asus has unveiled a new BIOS feature called AI Cache Boost, which is designed to enhance AI performance on systems equipped with AMD's Ryzen 9000 series processors. The new feature is part of a recent BIOS firmware update for Asus AMD 800 Series motherboards. It focuses on improving the efficiency of data transfers between the CPU cores, cache, and memory, which is crucial for handling extensive AI workloads. Upon enabling AI Cache Boost in the BIOS under the Extreme Tweaker tab, the system overclocks the Infinity Fabric clock (FCLK) to 2100MHz. This increase in FCLK enhances the bandwidth of data transfers within the CPU architecture, which Asus says facilitates more efficient processing of large datasets commonly associated with LLMs. As per Asus, enabling AI Cache Boost can boost performance by up to 12.75% when working with LLMs (Large Language Models). This feature is tailored for AI enthusiasts, researchers, and professionals who utilize AMD Ryzen 9000 Series processors, specifically those with AMD 3D V-Cache Technology, like the recently launched Ryzen 9 9950X3D. Asus says it is particularly beneficial for users engaged in AI workloads that involve processing massive datasets, such as training and deploying large language models. Asus has clarified that the new AI Cache Boost feature is specifically designed to enhance AI workloads, not gaming performance. While the feature can technically be enabled alongside other BIOS settings like GPU Boost, doing so may compromise overall system stability without delivering any noticeable benefit in gaming scenarios. For users focused solely on maximizing AI capabilities, Asus offers additional tuning options beyond AI Cache Boost. By activating both Game Turbo and AI Cache Boost modes, disabling simultaneous multi-threading, and deactivating one CCD (Core Complex Die) on Ryzen processors, Asus says AI performance can be pushed even further. In fact, Asus own tests on a Ryzen 9 9950X3D configured with a single eight-core chiplet showed up to a 19.4% improvement in AI tasks. As with all company-provided benchmarks, take that with a grain of salt. Asus conducted internal testing using a system equipped with ROG Crosshair X870E Hero motherboards, Nvidia RTX 5090 or 4090 GPUs, and Ryzen CPUs with AMD 3D V-Cache, showing performance uplifts in various AI benchmarks. In Geekbench AI tests, enabling AI Cache Boost resulted in improvements between 3.4% to 8%, with the Ryzen 7 9800X3D demonstrating the most significant gains. The uplift was similarly positive when tested with previous-gen RTX 4090 GPUs, showing a boost of up to 7.57%. Asus testing using the UL Procyon AI Computer Vision Benchmark the Ryzen 7 9800X3D achieved double-digit improvements of up to 12.75%. As mentioned earlier, Asus says combining AI Cache Boost with Turbo Game Mode can yield even higher gains. For example, the company says the Ryzen 9 9950X3D saw up to a 19.35% performance increase in specific AI workloads when both features were enabled. This combination is particularly beneficial for AI users whose tasks don't fully utilize the CPU's multithreading capabilities. If it works as advertised, the AI Cache Boost features could be a straightforward way for Ryzen 9000 series users to extract more performance out of their systems when working with AI-related tasks.

A new Asus BIOS tweak can boost Ryzen AI performance by 20 percent

Asus is offering AI Cache Boost as a selling point for its 800-series motherboards. A combination of AMD's 3D V-Cache, AI, and multiple cores offers enthusiasts a bold new opportunity for tweaking the performance of their PCs. But a new Asus BIOS option, Asus AI Cache Boost, takes the potential complexity out of it all, offering double-digit performance increases just by enabling the Cache Boost option. We've already discovered that you can boost the performance of a Ryzen AI Max processor by up to 60 percent just by adjusting the UMA frame buffer. The new Asus BIOS option offers a related tweak specifically for AMD Ryzen 9950X3D and 9900X3D processors. Naturally, the performance varies depending upon the type of applications being run. Using benchmarks like Geekbench and UL's Procyon benchmarks, the AI performance increase was fairly nominal: up to about 7.6 percent -- though that's all from just tweaking a BIOS setting. But when added to another Asus BIOS feature, known as Turbo Game Mode, Asus was able to dial up AI performance by almost 20 percent. Naturally, there are a few conditions, Asus said in a blog post announcing the new feature. For one, Asus is aiming the new increase at AI workloads specifically; gamers might not see the same effects on their frame rates -- but that also means you can probably just leave the AI Cache Boost option enabled, Asus said. (If your games become unstable, turn it off.) Second, you'll need an Asus AMD 800 series motherboard and a Ryzen 9000X3D series CPU. (Asus didn't specify which motherboard models.) Asus has put the new AI Cache Boost option inside the BIOS, under the "Extreme Tweaker" tab. From there, just enable AI Cache Boost, the company said. What's going on? Under the hood, Asus is overclocking the Infinity Fabric to 2,100MHz, which increases the data rates between CPU cores, cache, and memory. Turbo Game Mode adjusts how the CPU itself runs. A Ryzen 9000 processor uses two Core Complex Dies, or CCDs; Turbo Game Mode disables one in the name of efficiency. It also turns off SMT, also known as multithreading. Combining the two modes is most effective when running a game or application that runs mainly on a few CPU threads, rather than the entirety of the processor. To be fair, that's not always the right choice, which is why Asus recommends that you know what application you're running and how it will benefit. "Disabling a CCD and SMT has a significant impact on multithreaded performance, so we recommend that users only enable Turbo Game Mode when it benefits their current workflow," Asus said. You can refer back to the Asus post for the actual benchmark scores. Modern processors simply offer more opportunities for adjusting performance, whether it be on a per-core level, using AI, or tweaking power inputs. But they can be confusing, and not worth the time nor potential risk to discover what works and what doesn't. This feels like a smart addition to the hardware tweaker's toolbox.

Asus' AI Cache Boost promises to "pump up" your AMD Ryzen 9000 processor's AI performance

The tests were conducted with the three most recent AMD Ryzen 9000 processors Asus has launched a BIOS feature named AI Cache Boost which is said to increase AI workload performance on AMD's Ryzen 9000 processors by up to 19.35%. AI Cache Boost comes as part of a new BIOS firmware update for Asus' AMD 800 series motherboards which is said to "pump up the AI performance of your AMD Ryzen system" for AI apps, such as working with large language models (LLMs). Specifically, Asus has tested the two recently released AMD Ryzen 9950X3D and Ryzen 9 9900X3D processors and their optimizations benefitting "AI enthusiasts". To use the tech with a Ryzen 9000 series CPU and an Asus AMD 800 series motherboard, then, you go to the UEFI BIOS utility, head into the Extreme Tweaker tab, and then toggle AI Cache Boost to 'Enabled' and that will have it ready to handle more AI workloads. Asus claims its AI Cache Boost includes overclocking the Infinity Fabric clock to 2100 MHz, which is said to boost the total bandwidth of data transfers between the Ryzen 9000 series CPU cores, cache, and memory for working with large language models. The hardware manufacturer's tests were conducted with a ROG Crosshair X870E Hero motherboard, an RTX 5090, and 32GB DDR5 RAM as the test bench. As well as the two most recently released AM5 chips, the 9800X3D was also put through its paces in Geekbench AI with the ONNX DirectML framework as a benchmark. On average, Asus' AI Cache Boost saw around a 5% increase in Geekbench AI with its Single Precision and Half Precision scores for both the 9950X3D and 9900X3D. However, the 9800X3D saw the highest difference, of 7.93% with its Half Precision Score (comparing the default of 63365 to 68393). The claimed 12.5% performance bump was also achieved on the 9800X3D with the UL Procyon AI Computer Vision Benchmark, a sweeping improvement of 1680 compared to 1490. Based on the published benchmarks, it seems that the popular gaming CPU may benefit more than the two leading models. Asus acknowledges that it's still "early days" for the RTX 5090, so it had conducted tests with the previous-generation (but still excellent) RTX 4090 as well. It's this pairing that we see the largest boost, in tandem with the existing BIOS feature Turbo Game Boost (which allows the CPU to operate more efficiently by disabling simultaneous multithreading). By using both AI Cache Boost and Turbo Game Mode together, the AMD Ryzen 9 9950X3D saw a jump from 1426 to 1702 in the UL Procyon AI Computer Vision Benchmark. Without Turbo Game Mode, however, the difference was minimal at just 1485 (4.1%). To get the best experience, you may need both BIOS features enabled. Asus' benchmarks reveal anywhere from a slight boost to a significant uplift in AI performance on the Ryzen 9000 series, when paired with leading 90-class graphics cards for good measure. Based on the averages, it seems like the Ryzen 7 9800X3D benefits the most (barring one or two top-end exceptions). With that said, to use this feature, you'll need a specific motherboard series and also the use of Turbo Game Mode to take things further. If you're thinking of building a rig purely for AI workloads then it seems like the new BIOS feature could be a small shot in the arm to make things a little faster and easier, however, it's debatable whether around 3-6% in most tests is worth upgrading.

ASUS Embeds BIOS based AI Cache Boost for AMD Motherboards

ASUS has rolled out a new BIOS update that brings the "AI Cache Boost" feature to AMD 800 series motherboards. The update tweaks a few system settings, like fine-tuning voltage levels and pushing the Infinity Fabric clock (FCLK) up to 2100 MHz. This higher FCLK setting boosts data transfer speeds between the CPU cores, cache, and memory, which is especially useful for running large language models and other AI tasks. In tests using the UL Procyon AI computer vision benchmark, setups with AMD Ryzen processors saw improvements in performance. For example, a system with an AMD Ryzen 7 9800X3D showed a jump from 1490 to 1680, marking a 12.75% gain. Meanwhile, other Ryzen models like the 9950X3D and 9900X3D recorded improvements of around 4% when AI Cache Boost was enabled. The feature is built to focus on AI tasks, and it doesn't really affect gaming performance, so it can be left on without worries even when switching between different types of workloads. For those looking to get the most out of their setups, ASUS also offers a "Turbo Game Mode." This mode disables simultaneous multi-threading (SMT) or the extra Core Complex Die, which can further improve performance for AI tasks that don't need all the CPU cores active. Tests show that when Turbo Game Mode is added to AI Cache Boost, performance can increase by 10.8% up to 19.35%. For instance, one test with an AMD Ryzen 9 9950X3D went from a score of 1426 on the default setting to 1702 when both features were enabled. Gurus should note that while Turbo Game Mode can provide significant boosts in certain scenarios, it does come at the cost of multi-threading performance. Therefore, it's best used when your workload benefits more from higher speeds in single-threaded or AI-specific tasks. If you have an ASUS AMD 800 series motherboard paired with an AMD Ryzen 9000 series processor, you'll need to update your BIOS to access these new features. Source: asus