Horizon 7 with Nvidia GRID Setup Gotchas
Been setting up POC environment for customer and this time wrong got involve with using Nvidia GRID.
Encounter some setup steps that are missing from nVidia Deployment guide.
In fact, every single setup guide uses the nVidia K1 & K2 card as a reference and those cards have EOA.
Here will share with you if you are using any of the newer cards e.g. M60, M6, M10, etc.
Here are some resources you should refer to when setting GRID on Horizon 7.x.
1. On ESXi 6.5 and above, remember to go to each ESXi server and under Configure, make sure the 2 things need to be in place:
Security Profile: X.Org Server service is started
Alternative you can run ESXi Shell or SSH with > /etc/initi.d/xorg start
-->
Graphic: Change Shared to Shared Direct for both Host and Slot
Reference
2. If you are using the new Dell Gen 14 server, there is a bug stated in the release notes, page 9.
When running nvidia-smi you will receive the following error message "“failed to initialize NVML: unknown error”
Resolution
In the System BIOS Settings, Integrated Devices, Memory Mapped I/O Base, set to 12TB (default 56TB)
Lastly checking everything is in place:
ESXi Shell or SSH:
> nvidia-smi
This will return all the GPU found on the nVidia card on the server.
>dmesg | grep -i nvidia
This will show you if the driver on ESXi is loaded properly and successfully.
Encounter some setup steps that are missing from nVidia Deployment guide.
In fact, every single setup guide uses the nVidia K1 & K2 card as a reference and those cards have EOA.
Here will share with you if you are using any of the newer cards e.g. M60, M6, M10, etc.
Here are some resources you should refer to when setting GRID on Horizon 7.x.
- Register an account on nVidia to download the vibs for ESXi and nVidia License server and Nvidia Driver for Windows OS.
- Deploying Hardware-Accelerated Graphics with Horizon 7
- GIRD Virtual GPU
I love to use this guide as a reference to what profile is available for each card type.
- Install VMware tools
- Install Horizon View Direct-Connect agent (you know why this needed later)
- Shutdown VM
- Edit VM settings, add shared PCI device, select your GRID profile
- Take a snapshot (in case you need to revert)
- Power up the VM
- Install Nvidia GRID drivers
- Reboot VM
- Use the IP and connect using Horizon Client (a bug due to Nvidia graphics driver in use, vSphere console no longer works)
1. On ESXi 6.5 and above, remember to go to each ESXi server and under Configure, make sure the 2 things need to be in place:
Security Profile: X.Org Server service is started
Alternative you can run ESXi Shell or SSH with > /etc/initi.d/xorg start
-->
Graphic: Change Shared to Shared Direct for both Host and Slot
Reference
2. If you are using the new Dell Gen 14 server, there is a bug stated in the release notes, page 9.
When running nvidia-smi you will receive the following error message "“failed to initialize NVML: unknown error”
Resolution
In the System BIOS Settings, Integrated Devices, Memory Mapped I/O Base, set to 12TB (default 56TB)
Lastly checking everything is in place:
ESXi Shell or SSH:
> nvidia-smi
This will return all the GPU found on the nVidia card on the server.
>dmesg | grep -i nvidia
This will show you if the driver on ESXi is loaded properly and successfully.
Comments