Sam Witteveen explores the capabilities of the new AMD Ryzen AI Halo, which features 128GB of unified memory. The demonstration highlights how this architecture enables local operation of large language models, image generation tools, and fine-tuning workflows, while comparing the practical benefits of unified memory against traditional workstation setups with discrete GPUs.
In this video, we look at running local AI work jobs for LLMs, images and video models, but running it on an AMD GPUs and processors.
Advanced Micro Devices unveiled new details about its next-generation AI chips, the Instinct MI400 series, that will ship next year.
The MI400 chips will be able to be assembled into a full server rack called Helios, AMD said, which will enable thousands of the chips to be tied together in a way that they can be used as one “rack-scale” system.