Hello,
I have the same Qs as previousely asked in this thread (but was not answered): https://rog-forum.asus.com/t5/hardware-build-advice/high-vram-allocation-on-ryzen-apus-for-machine-l...
I saw BIOS documentation mentioning that "UMA Frame Buffer Size Allows you to set the UMA FB Size. Configuration options: [Auto] [64M] [80M] [96M] [128M] [256M] [384M] [512M] [768M] [1G] [2G] [3G] [4G]".
It is not clear if setting to "Auto" will allow auto selection from the limited supplied list - meaning up to 4GB max, or if this will allow Windows and the iGPU / NPU drivers to dynamically allocate as much memory as will be needed - even 16GB of VRAM or more to the iGPU / NPU, from a system that has 64GB DDR5 RAM installed on.
I will be happy to get any inputs from someone that may have already done that successfully.
In addition, I will be happy to get any inputs from anyone that already tried using Whispare (using the large model) on AMD Ryzen7 8700G for transcribe an audio recording, and get the feedback about how well this works, and if the speed is reasonable (I am willing to wait up to X2 time of the recording for a good transcription using the large model).
Thanks,
Amit.
@MLMB
https://www.asus.com/motherboards-components/motherboards/prime/prime-b650m-a-wifi-ii
https://www.amd.com/en/products/processors/desktops/ryzen/8000-series/amd-ryzen-7-8700g.html
