From 9e3df0bdffcb884a86f9d38ac598fcc1418b7655 Mon Sep 17 00:00:00 2001
From: PolloLoco <polloloco@mailbox.org>
Date: Mon, 10 Jul 2023 20:52:37 +0200
Subject: [PATCH] Update guide to Proxmox VE 8.0 and vGPU 16.0 drivers

---
 535.54.06.patch | Bin 0 -> 12144 bytes
 README.md       |  36 +++++++++++++++++-------------------
 2 files changed, 17 insertions(+), 19 deletions(-)
 create mode 100644 535.54.06.patch

diff --git a/535.54.06.patch b/535.54.06.patch
new file mode 100644
index 0000000000000000000000000000000000000000..2be08d760ab70a13f525c86562f38a4a59724bb8
GIT binary patch
literal 12144
zcmeHN4{#ILncuZ#P>ho`X`1upNZB@~wE=@P5U?A#(IN>}K_(_4;Diujh+Uj;vCok(
zxl0<UE7^YCYU0i$fzHkJ+FozUblQ~s0ThqHG7h#$`iGdC8!nwm32jpgmEim{7D@2^
z-rHSi*AceE<gV=up0RfKz3+YR_rC9Y-=DWzQy192L;R<@2kXVw#=s77XVb2Faob~J
zP1DYuP5!3sO@*uL>vxI`E%o(cph*lqip!41N5y6~Zd))QHt(#jL+iu!_08z27q_?6
zKiC*}RQ!5*;T`Mz_lONmEuwSTB8Rx<PM=47u%&TVeT!Ij>yld+-MVy<V_A7&MMZ_U
zXz|1KEsxaiT>Qwc#s?egaH-H57By|%*7!(W%VUKL7A%+!nad?sIGt6M3zv%v^edVI
zg`&G-!{dCc#z6*!RY%<&w#R+S0AF2oDfsg>F@FV@e2nKfVJ^3_@*g-Z5Ea^P!E?on
zcu>Z8q3xf?$H%?SQLpoyH<}P451_L_nCsy<X*9tHnmwd?j)%M_$EwR@@;eXl7Rzc|
zJfGua60{F<_*3sLlhvTzqk4-yYV{m);`QNqcjK@8C^^x4HgDb%{DsfZU!JxM+xQdn
z1pGB7c>MJamjq^c$XQ7_#uLvo4oT_frPqgp;g@aT?IG{@$v80BeFF(PnH+m&KQ3%y
zZ}c1{v<s2FXz`L^=a7b5we2DO%G-h~bg58`eRFwiokMW{CNXS_H7{RLC`ujv4SY;?
zkP%^3uhe1NAS*|CU)71=AQM;W4lF-H=i*i#{sJTyS$}DKyy89FQhBux;VJo#_-W{@
zc=2Z1m@l*+#&f*37D9VD4+9${Vk=F}kY0vt$2WV(pmd+KMY><wDu<6bAmBcIHEfOg
zlANPhskScX@zkrrTo?Dg@TH5=CTXK|x3u9dSve=lY5~RN{4IoEtnTp_RzM<Z=oDDW
z#A}z8gq->!RIT*!a)C<%xQ|33GK%ioii2lE@k;28557fC$&edHl*o+<O6HIKn6Cwu
zpZtj-@R5EQ>Xc)(<^I^daxA?%Ix0kuV(z32IzvDM?uYTjNy5Rl60Ez!-6W}NN{IV+
zxXdB$-{T?@_n&YnCGHf+)-3FBzmG=;abLjYapHF4vXr<#qMel;?r}Vp5%+mX-Q<W4
z1?@1&=n+f-+w;XXRlO|Y{s{eHIOW*CifFzk+boCss5P)&KY>WI3!>JoqOV&0roB2k
zE<~QggTE>zL=NLdQda}`8lT!GVkI(h-yx}OWw<5oO}JaJjoy6&-45KLd#e;WQi)sG
z$0(GKrz$-0@jNssr^bo<;p88wk!U6vdU7ErM3=)F2HfYN1TMJ%_nmU%mJ%v|2-^;o
z6swUEKLkp6XJT{4WRzoKpD;IsLEPrJ3%?V3uvIt5Z_3%;wF%8fxZ=@*p7HN(xz3qj
za_Jg{6&;~nJ#>$;w#{++Jb^Paz`JDiemfJeJa7~=n)nCYW%M2jsOonw<ObXh`p8(J
zO;d=Op7mf=eGQ8Y<AI%01J`Yu+PIJWmvad7bx?yQ@5?bsPF+to0yd~_&lknOy|+~c
z-!W|Yk8<OXX2Cz3ty%DS4FoJWnh4&Q+DOOyiMchfs_OodU~03EEG=~==$Z}r8uHpY
z!y>P(GbWLjX+@oEJ<6Z45ziHedVV?+B8k%t5?mSTd2=PbSt=ZQ>R$>MP?cZZwpX|9
z)ouINvTfNu?VEhtiX0bCJHCW0YF+EXaGGWZ!TW?md%jgjdoC7=vk?xS=?!1>vYW)0
z2W90IID=!wec|*0&<O1t;10s+U$FZ!cE20^f)9jx&U-mJI*}Q|B1bsgjagc2W%7iU
zZAB7+pUUbJc4tCX_nf*JjwCu1*gN{Io$%>-fv04(y%KDh4^+kqgr^h9-89nd+89p0
zgqf7LJ_^2=tVfd;nZoIpkO;Omhtn_MDzvXfPdJ_aBHC7j)1&n24kuailSc9rM7If`
ziwh^0Q?9h{9`q$=;fH$MaFS-5tX)DAldfqXWN;AJh4!bhXw1#-e}i}#PCrlYqea$<
zz;8cf)<vDEeDaKPW}Xm9f;_`Aoc{VPl;4jTKN0t>kB8GAVoa+abKxpP;&ecKCgs6#
z8^Xy$XqAQk7!;K6qbFI5DKn`b*3NK5%#$Eug_Dl2&~@2`_C|CWfG!+Ofh}NDMm6{e
zC%+5~+3tLf&l4icX!r0Z&__5O|0=MF;q-obb%c`#=IQd9O^NzI#N?Qce~mK!7|+S)
zSYwF74=10;ID>!q%y-cyME;vnb>N3ZBAPh*$S2YUiF|MuIVmGBsqLOZ7wU-ROO`I7
zb%cIJlT;`+DDluN@CjTO--rv9EdrxUGp0x)xcCUi4RSr=YT3vndImwqY%RXn7?BO|
ztOMhoPxUifX6fuk9~q^w9)?<mM98o1JB^gd2+$3Za+qQ8kynCS4F-!a@vwDb+Qqu1
z``FYpy*8q_J}hwDr$$OUuc6%E^OLtRhnC+YF_soY7)sZv57pD{E5$dTw+Lpwu?eTb
z_k+)dk1A0Y9Wn?iI$4Q}bFmB*g40pp?N*$(8#t%0K$G@-<O5xS)#?F?0%bx#$|y0o
z%+TOUXz(HH%nunen<b>D%M%o1D6|Xde3!ih1<)vK@{=>j@umBal@Eg(RWQszS1;0H
z&ET#S?{ikX&s`zjj-p(6$1ace3OC4*74A?jxOy33$dhf5efH0|L9SGuA6Nl?kPF}x
z`iG)VGr?(kw<_FHFCS(*8&$LBW@PfdU)`^HnhR|CFw!Hsrx^&&*Ci6X6?R&Zr|)Fx
zFm-CItB01i><-oZuu&#WbT~(QI<N;A8T=RO4<Yg{;C3}%PfY+NEbC%cd&y5O_|*1&
zC=pnrM2=DN7eKCztrwzgm^rl8&P%GT)Hxna1a^=yIc9Uoy{Bz{{<K<SSLGtLxmdZF
zFGOAeachfmkryK6l)=S3Av%UOx$$^0e5@S1;X^#Z*SbpN^7rK4Gd7ujRp#IDlT{8`
zb%`=rRf!`bscJ=O>s~}i(9Xa=j)Y{AZ<NrMg=>0JF4~0XQ=pv2L=VWSj1#2Wn{ma2
zx9`Bj4oti|6$P^hm`sa}OJ`G~vypW+waMF9<`JTNQ1Pl+CA!d}3tl@6NIDs*YdWxT
z+Qndt`g|q&d}Ybk5T^D06xwdTl)N+hEFE5tIZ?q=TVdxuu$0ODQPyW}gDWkWqeDjY
zoDY*cXsm{<qvxPujAqw~fW~@}ApQ#bWIu~5x%Y`V@MXhwLndj+MCYu3&*Hl`2fmY5
zd?%;EXE<)_2EI%{&gpNmcyh^W#ENHRDm;+a*#DKha^br+-;yj`i%qI|0ZTGt(I-c1
zjNEc_Sp+vtg-#=2ms?Sm=R!HP!%j@)u-WmZ?x%AZTrL56tk68UpiS5i9dK)(qx>c}
zz&b0wx@q7WyHb1zayTn9=Y^d#(6QXMLFr;aF6i*9KQeoj3V0R83Q{pZW>P_TFwJop
zj^)(>&>&+Db(eM^rg4E81Nl%dhf_2(5!TeN%*vys106hh0yYuP0V|#Z1|GAQ)9fvS
zC#!{0?BV!j_HZV^m>nOjY$nGyRYH5xiudH@@lKrAz~2SXgVWd_KJsD4C;QbOQ1w=;
zFO`}FxDW~*u>u;&1&9SAWB%75zwT1aLT>Ssv)YL{duw4Tm9idX;yNampBWytx9e>d
zuXnvIhu51_zr&xeekbBvX2rMcGvgcieDO_Xe_O10w_G0YM7<gMM?v-J3?ZxT$r6HT
z#E&Pf_@4Z0!}qKe-?RU(__CfWSA2_Gp~Z7Sn-Jd;moYx-=gj)gs&~?aZyNf2(+cv<
zTp*{;4^B+w|MVB2Qa3H>ECpShIzkAtNAqCLYW0wLPdnjr@(YY&t~*=I<>RcBZ2{CY
zr%lCNCgJK=*A{gZqXuGC+lAMaw|I&Ck_|DJc*j_Yw-^iXkhcu?slCIM$Sbs-qtOxd
zT(Cx2Ta+iMUe0-(Hq+BOGMKIBhCQmwuGSPu^vE{yEP8P_BjE6mqo`%p8*5+yq;41b
zkvV^Q1)V4eQS99*tGi2Nen^f5ZY+>{-?qtQ#S&R<E>m6T_T-`MG};3BcBL0ZUp0<R
zo9J;XwK5J8#oIi4F)m)`A5j0Lp3Yj#r}^_a_@hndpZdP0e`R~oC&^Dt1yVOFkgU@8
zXa_dP1ot6u$tu%s5;*Ah2oZYK-xp5aPs;^rC5#Cz``H0wwfdiS)aE`ly8C8&O!bGr
zcBZ^<gR6{p+mRpA8#Pn{8E9vPYG((O$AsLU&j|+;bXBWD-Qs>)8wYNphl}+6utv@3
zP<rL}=Nm6?`x-i7fOT9?-r)aa4ovGXR#RM@9@<gkGrd3r{WguB(e!LHs2Oo;ANsdj
z`EAcoti)ZaEvqXdzsZQ=U0tNIdWc3AtU4gbvGq1X#E?JB8BKUte5XgXRG1!hU6H!Z
zrgKp@;){<N9`bASc0wWyFthsLHB7I_98rjKr??(p-M<^_*Lp1aWQh&s?;|5}4E$po
z?Q(2aQ3h@MUMu^;3WL9kPB1c^3HE5#FyhBsep&5e2^8Ike}>T1T{da}y|`5>d9~(-
zK$X{doV@EA?Vl^*bxv=xK;n-}Rj;?!(KDACdj8r0yrvcJ(AU-JQETlWx>Kt0t9v@B
z(8wDe;h<cMAJ=SSMD4v^7~pFFe=~2EPAV>u5f3?jq<D6j(IItHJ7FVJ-=hY#+~{F#
z69lSJgX-EGRGLC&8a*b?$rbvEh^}zL1O+KTHh9fMg-4}9U_wlG5K>k$o~l<{)>Pw&
z>Y<Ey_FBbbF^C3Z{+#&9hz1K%a3&y!8jadS%Mw_u@Lq$DX&tF&&GxT56qH9FL1px9
z8)HL1*lAO#w#RJ2>-v=nH@@5GSLWk_4?DCoI_%_`{Yp9QkyV9$vSak%8z4Gpv3ZaR
zyD?J~1TlD_KA3)UV+;mcj9sLSU4RR>Su3!>b(a$7z@>pOB*_+NL=Vu+q2Y@HwS6gu
zU^N3?JBH#s?-!@=l5N0?6K4AK6Z$$3A3c<YdS+3AKskHuMxEVkTAzIbNKmp7g|cDa
zm#|lprdK>d<ljJo6_<h31o}{Q^jzQtd;?b0^>-XM?kDe{6TY<5kSS&@QtvKe5d@#@
zd<QH<3kxCAOhZhp+TL|zP7V@Duy1GRM`%$WXq6}IJU*mJuB3u60svjhT4^*=s=e;K
z0rN}{ePGU~;a>yzLX<LM0!f}nB+>%Y1X>CLOX9o{_=Yz?#Rl3iF!@V5Ci{Vh+U~&m
zm_313duxjrVe*}s6F*j(vkyX8ngaK0(pu0<{qW!8n>s2>CSiONpyd$QQUZgMdCS?U
zdW+C{HjV^_y`R$+r~wJ>zKMJ6*QqnvJ)kA<cnOH|(a4;fztt;9Y7)!_g=hNcJ>3Uf
zAYXYck3LZ&WluIq?Jo5cF1YG+FBiqGI$hH@U00nh+p<@k?qAmFG7rf<=lNT9x?(28
z1iqmB{$m`ok}X=~M%sX~o_S`22*Hb-Qci!2(lKA~oH7%$$U3^ZfDg_T4z4OtPV*fz
u^)_B><7wL(?eo>q)qGy?8W8d)hFNo-L2C;ZinKj3oX0xyjShRT@P7dj`d2*w

literal 0
HcmV?d00001

diff --git a/README.md b/README.md
index c47b4c5..49867fb 100644
--- a/README.md
+++ b/README.md
@@ -2,7 +2,7 @@
 
 [!["Buy Me A Coffee"](https://www.buymeacoffee.com/assets/img/custom_images/orange_img.png)](https://www.buymeacoffee.com/polloloco)
 
-This document serves as a guide to install NVIDIA vGPU host drivers on the latest Proxmox VE version, at time of writing this its pve 7.4.
+This document serves as a guide to install NVIDIA vGPU host drivers on the latest Proxmox VE version, at time of writing this its pve 8.0.
 
 You can follow this guide if you have a vGPU supported card from [this list](https://docs.nvidia.com/grid/gpus-supported-by-vgpu.html), or if you are using a consumer GPU from the GeForce series or a non-vGPU qualified Quadro GPU. There are several sections with a title similar to "Have a vGPU supported GPU? Read here" in this document, make sure to read those very carefully as this is where the instructions differ for a vGPU qualified card and a consumer card.
 
@@ -20,12 +20,11 @@ If you have GPUs from the Ampere and Ada Lovelace generation, you are out of luc
 This guide and all my tests were done on a RTX 2080 Ti which is based on the Turing architechture.
 
 ## Important notes before starting
-- This tutorial assumes you are using a clean install of Proxmox VE 7.4.
-- Do **NOT** use the opt-in 6.x linux kernel, use the standard 5.15 that proxmox has by default
+- This tutorial assumes you are using a clean install of Proxmox VE 8.0.
+- If you are using Proxmox VE 8.0, you **MUST** use 16.x drivers. Older versions only work with pve 7
 - If you tried GPU-passthrough before, you absolutely **MUST** revert all of the steps you did to set that up.
 - If you only have one GPU in your system with no iGPU, your local monitor will **NOT** give you any output anymore after the system boots up. Use SSH or a serial connection if you want terminal access to your machine.
 - Most of the steps can be applied to other linux distributions, however I'm only covering Proxmox VE here.
-- You **HAVE TO** use a supported linux kernel version. Something in the range of 5.14 up to 6.0 should work. Newer kernels like 6.1 or 6.2 do **NOT** work at this point in time.
 
 > ## Are you upgrading from a previous version of this guide?
 >
@@ -40,7 +39,7 @@ This guide and all my tests were done on a RTX 2080 Ti which is based on the Tur
 Make sure to add the community pve repo and get rid of the enterprise repo (you can skip this step if you have a valid enterprise subscription)
 
 ```bash
-echo "deb http://download.proxmox.com/debian/pve bullseye pve-no-subscription" >> /etc/apt/sources.list
+echo "deb http://download.proxmox.com/debian/pve bookworm pve-no-subscription" >> /etc/apt/sources.list
 rm /etc/apt/sources.list.d/pve-enterprise.list
 ```
 
@@ -257,15 +256,14 @@ Depending on your mainboard and cpu, the output will be different, in my output
 This repo contains patches that allow you to use vGPU on not-qualified-vGPU cards (consumer GPUs). Those patches are binary patches, which means that each patch works **ONLY** for a specific driver version.
 
 I've created patches for the following driver versions:
+- 16.0 (535.54.06) - Use this if you are on pve 8.0 (kernel 6.2)
 - 15.1 (525.85.07)
 - 15.0 (525.60.12)
 - 14.4 (510.108.03)
 - 14.3 (510.108.03)
 - 14.2 (510.85.03)
 
-You can choose which of those you want to use, but generally its recommended to use the latest, most up-to-date version (15.1 in this case).
-
-However, with the 15.0 version, some Proxmox users were experiencing issues after restarting VMs multiple times, the only way to resolve those was to reboot the whole host machine. If you are affected by this, I recommend that you downgrade to 14.4.
+You can choose which of those you want to use, but generally its recommended to use the latest, most up-to-date version (16.0 in this case).
 
 If you have a vGPU qualified GPU, you can use other versions too, because you don't need to patch the driver. However, you still have to make sure they are compatible with your proxmox version and kernel. Also I would not recommend using any older versions unless you have a very specific requirement.
 
@@ -279,11 +277,11 @@ I've created a small video tutorial to find the right driver version on the NVID
 
 ![Video Tutorial to find the right driver](downloading_driver.mp4)
 
-After downloading, extract the zip file and then copy the file called `NVIDIA-Linux-x86_64-DRIVERVERSION-vgpu-kvm.run` (where DRIVERVERSION is a string like `525.85.07`) from the `Host_Drivers` folder to your Proxmox host into the `/root/` folder using tools like FileZilla, WinSCP, scp or rsync.
+After downloading, extract the zip file and then copy the file called `NVIDIA-Linux-x86_64-DRIVERVERSION-vgpu-kvm.run` (where DRIVERVERSION is a string like `535.54.06`) from the `Host_Drivers` folder to your Proxmox host into the `/root/` folder using tools like FileZilla, WinSCP, scp or rsync.
 
-### ⚠️ From here on, I will be using the 15.1 driver, but the steps are the same for other driver versions
+### ⚠️ From here on, I will be using the 16.0 driver, but the steps are the same for other driver versions
 
-For example when I run a command like `chmod +x NVIDIA-Linux-x86_64-525.85.07-vgpu-kvm.run`, you should replace `525.85.07` with the driver version you are using (if you are using a different one). You can get the list of version numbers [here](#nvidia-driver).
+For example when I run a command like `chmod +x NVIDIA-Linux-x86_64-535.54.06-vgpu-kvm.run`, you should replace `535.54.06` with the driver version you are using (if you are using a different one). You can get the list of version numbers [here](#nvidia-driver).
 
 Every step where you potentially have to replace the version name will have this warning emoji next to it: ⚠️
 
@@ -295,8 +293,8 @@ Every step where you potentially have to replace the version name will have this
 >
 > ⚠️
 > ```bash
-> chmod +x NVIDIA-Linux-x86_64-525.85.07-vgpu-kvm.run
-> ./NVIDIA-Linux-x86_64-525.85.07-vgpu-kvm.run --dkms
+> chmod +x NVIDIA-Linux-x86_64-535.54.06-vgpu-kvm.run
+> ./NVIDIA-Linux-x86_64-535.54.06-vgpu-kvm.run --dkms
 > ```
 >
 > To finish the installation, reboot the system
@@ -312,21 +310,21 @@ Now, on the proxmox host, make the driver executable
 
 ⚠️
 ```bash
-chmod +x NVIDIA-Linux-x86_64-525.85.07-vgpu-kvm.run
+chmod +x NVIDIA-Linux-x86_64-535.54.06-vgpu-kvm.run
 ```
 
 And then patch it
 
 ⚠️
 ```bash
-./NVIDIA-Linux-x86_64-525.85.07-vgpu-kvm.run --apply-patch ~/vgpu-proxmox/525.85.07.patch
+./NVIDIA-Linux-x86_64-535.54.06-vgpu-kvm.run --apply-patch ~/vgpu-proxmox/535.54.06.patch
 ```
 That should output a lot of lines ending with
 ```
-Self-extractible archive "NVIDIA-Linux-x86_64-525.85.07-vgpu-kvm-custom.run" successfully created.
+Self-extractible archive "NVIDIA-Linux-x86_64-535.54.06-vgpu-kvm-custom.run" successfully created.
 ```
 
-You should now have a file called `NVIDIA-Linux-x86_64-525.85.07-vgpu-kvm-custom.run`, that is your patched driver.
+You should now have a file called `NVIDIA-Linux-x86_64-535.54.06-vgpu-kvm-custom.run`, that is your patched driver.
 
 ### Installing the driver
 
@@ -334,7 +332,7 @@ Now that the required patch is applied, you can install the driver
 
 ⚠️
 ```bash
-./NVIDIA-Linux-x86_64-525.85.07-vgpu-kvm-custom.run --dkms
+./NVIDIA-Linux-x86_64-535.54.06-vgpu-kvm-custom.run --dkms
 ```
 
 The installer will ask you `Would you like to register the kernel module sources with DKMS? This will allow DKMS to automatically build a new module, if you install a different kernel later.`, answer with `Yes`.
@@ -343,7 +341,7 @@ Depending on your hardware, the installation could take a minute or two.
 
 If everything went right, you will be presented with this message.
 ```
-Installation of the NVIDIA Accelerated Graphics Driver for Linux-x86_64 (version: 525.85.07) is now complete.
+Installation of the NVIDIA Accelerated Graphics Driver for Linux-x86_64 (version: 535.54.06) is now complete.
 ```
 
 Click `Ok` to exit the installer.