NVIDIA and Twitch Collaborate to Enhance Streaming Quality with AI-Powered Broadcasting
2 Sources
2 Sources
[1]
Upgrade Livestreams With Twitch Enhanced Broadcasting and the NVIDIA Encoder
Experience how NVIDIA encoders, the NVIDIA Broadcast app and the RTX-accelerated Twitch Enhanced Broadcasting upgrade streaming experiences at TwitchCon. At TwitchCon -- a global convention for the Twitch livestreaming platform -- livestreamers and content creators this week can experience the latest technologies for accelerating creative workflows and improving video quality. That includes the beta release of Twitch Enhanced Broadcasting support for HEVC when using the NVIDIA encoder. Content creators can also use the NVIDIA Broadcast app, eighth-generation NVIDIA NVENC and RTX-powered optimizations in streaming and video editing apps to enhance their productions. Plus, the September NVIDIA Studio Driver, designed to optimize creative apps, is now ready for download. Studio Drivers undergo extensive testing to ensure seamless compatibility while enhancing features, automating processes and accelerating workflows. Twitch Enhanced Broadcasting With HEVC The tradeoff between higher-resolution video quality and reliable streaming is a common issue livestreamers struggle with. Higher-quality video provides more enjoyable viewing experiences but can cause streams to buffer for viewers with lower bandwidth or older devices. Streaming lower-bitrate video allows more people to watch content seamlessly but introduces artifacts that can interfere with viewing quality. To address this issue, NVIDIA and Twitch collaborated to develop Twitch Enhanced Broadcasting. The feature adds the capability to send multiple streams -- different versions of encoded video with different resolutions or bitrates -- directly from NVIDIA GeForce RTX-equipped PCs or NVIDIA RTX workstations to deliver the highest-quality video a viewer's internet connection can handle. Twitch supports HEVC (H.265) in the Enhanced Broadcasting closed beta. With the NVIDIA encoder, Twitch streamers get 25% improved efficiency and quality over H.264. This means that video will look as if it were being streamed with 25% more bitrate -- in higher quality and with reduced artifacts or encoding errors. The feature is ideal for streaming fast-paced gameplay, enabling cleaner, sharper video with minimal lag. Because all stream versions are generated with a dedicated hardware encoder on GeForce RTX GPUs, the rest of the system's GPU and CPU are free to focus on running games more smoothly to maximize performance. Streaming is easier than ever with NVIDIA technologies. For starters, PC performance and video quality are incredibly high quality thanks to NVIDIA's dedicated encoder. And, NVIDIA GPUs include Tensor Cores that efficiently run AI. Livestreamers can use AI to enhance their hardware peripherals and devices, which is especially helpful for those who haven't had the time or resources to assemble extensive audio and video setups. NVIDIA Broadcast transforms any home office or dorm room into a home studio -- without the need to purchase specialized equipment. Its AI-powered features include Noise and Echo Removal for microphones, and Virtual Background, Auto Frame, Video Noise Removal and Eye Contact for cameras. Livestreamers can download the Broadcast app or access its effects across popular creative apps, including Corsair iCUE, Elgato Camera Hub, OBS, Streamlabs, VTube Studio and Wave Link. Spotlight the Highlights GeForce RTX GPUs make it lightning-fast to edit and enhance video footage on the most popular video editing apps, from Adobe Premiere Pro to CapCut Pro. Streamers can use AI-powered, RTX-accelerated features like Enhance Speech to remove noise and improve the quality of dialogue clips; Auto Reframe to automatically size social media videos; and Scene Edit Detection to break up long videos, like B-roll stringouts, into individual clips. NVIDIA encoders help turbocharge the export process. For those looking for extreme performance, the GeForce RTX 4070 Ti GPU and up come equipped with dual encoders that can be used in parallel to halve export times on apps like CapCut, the most widely used video editing app on TikTok. Clearer, Sharper Viewing Experiences With RTX Video NVIDIA RTX Video -- available exclusively for NVIDIA and GeForce RTX GPU owners -- can turn any online and native video into pristine 4K high dynamic range (HDR) content with two technologies: Video Super Resolution and Video HDR. RTX Video Super Resolution de-artifacts and upscales streamed video to remove errors that occur during encoding or transport, then runs an AI super-resolution effect. The result is cleaner, sharper video that's ideal for streaming on platforms like YouTube and Twitch. Many users have HDR displays, but there isn't much HDR content online. RTX Video HDR addresses this by turning any standard dynamic range (SDR) video into HDR10 quality that delivers a wider range of brights and darks and makes visuals more vibrant and colorful. This feature is especially helpful when watching dark-lit scenes in video games. RTX Video HDR requires an RTX GPU connected to an HDR10-compatible monitor or TV. For more information, see the RTX Video FAQ.
[2]
How AI is making streaming better for everybody with Twitch Enhanced Broadcasting
Twitch, the streaming Internet video service popular with gamers, already does some impressive server side transcoding to make sure that its most popular channels have multiple streams of different quality available. That means that people with different bandwidth levels can benefit accordingly. But if you're not one of its top performers then you just get a single stream. Now, thanks to a new feature called Twitch Enhanced Broadcasting, owners of a modern GeForce RTX or GTX GPUs will be able to broadcast up to three resolutions, at up to 1080p, simultaneously. Twitch Enhanced Broadcasting, which launches in Beta this month supports HEVC (H.265) encoding, NVIDIA's latest encoder that gives 25% efficiency and quality over H.264. If you're a Twitch streamer then you can sign up for the Twitch Enhanced Broadcasting beta today at twitch.tv/broadcast. There's more coming too, in the coming months Enhanced Broadcasting beta testers will be able to experiment with higher-input bit rates, up to 4K resolutions, up to 5 concurrent streams, as well as new codecs. There are also some AI Audio enhancements from NVIDIA, and while they obviously appeal to streamers, you don't need to be a Twitch streamer to take advantage of AI enhancement if you own an NVIDIA RTX GPU. Download the NVIDIA Broadcast app and you can start to use AI straight away to enhance your live streams, video chat, and voice calls. You can use the Broadcast app to apply AI effects like Noise Removal, which will remove distracting background noise while you video chat, and there's a handy room echo removal feature, too.
Share
Share
Copy Link
NVIDIA and Twitch have partnered to introduce Twitch Enhanced Broadcasting, a new feature that leverages AI to improve streaming quality while reducing bandwidth requirements.
NVIDIA and Twitch Join Forces for Improved Streaming
NVIDIA and Twitch have announced a groundbreaking collaboration that promises to revolutionize the streaming experience for both content creators and viewers. The new feature, called Twitch Enhanced Broadcasting, harnesses the power of artificial intelligence to significantly improve streaming quality while simultaneously reducing bandwidth usage
1
.AI-Powered Streaming Enhancement
At the heart of this innovation is NVIDIA's AI-powered video encoding technology. This advanced system utilizes AI to analyze and optimize video content in real-time, resulting in clearer, more detailed streams even at lower bitrates. The technology is particularly effective at handling complex scenes with rapid movements, which are common in gaming streams
2
.Bandwidth Efficiency and Quality Improvements
One of the most significant advantages of Twitch Enhanced Broadcasting is its ability to maintain high-quality streams while using less bandwidth. NVIDIA claims that streamers can achieve the same quality as a 6000kbps stream using only 3000kbps, effectively cutting bandwidth requirements in half
1
. This efficiency not only benefits streamers with limited upload speeds but also helps viewers with slower internet connections enjoy high-quality content.Hardware Requirements and Availability
To take advantage of this new feature, streamers will need an NVIDIA GeForce RTX 40 or 30 Series GPU. The technology leverages NVIDIA's latest NVENC encoder, which is capable of handling the AI-enhanced encoding process
1
. Twitch Enhanced Broadcasting is currently available to select Twitch Partners and Affiliates, with plans for broader rollout in the future.Impact on the Streaming Ecosystem
The introduction of AI-enhanced broadcasting has the potential to democratize high-quality streaming. By reducing bandwidth requirements, this technology could enable more creators to produce professional-looking streams, regardless of their internet connection speeds. For viewers, it means access to clearer, more detailed content without the need for faster internet plans
2
.Related Stories
Future Implications for Content Creation
As AI continues to evolve in the realm of content creation and distribution, we can expect to see more innovations like Twitch Enhanced Broadcasting. This technology sets a new standard for streaming quality and efficiency, potentially influencing how other platforms approach video encoding and transmission in the future.
User Experience and Feedback
Early adopters of the technology have reported positive experiences, noting improvements in stream clarity and stability. However, as with any new technology, it will be crucial to monitor user feedback and performance metrics as the feature becomes more widely available to the Twitch community
2
.References
Summarized by
Navi
Related Stories
Weekly Highlights
Weekly Highlights
Explore today's top stories
Your Daily Dose of Curated AI News
Don’t drown in AI news. We cut through the noise - filtering, ranking and summarizing the most important AI news, breakthroughs and research daily. Spend less time searching for the latest in AI and get straight to action.
