Epyc server GPU less
Hi guys, What about a fully populated ram at 3000mhz/6000mt/s on an Epyc 9015 (12 memory channel) ?
• Max memory bandwidth is around 576GB/s • 32GBx12 = 384GB of RAM • Max TDP 155W
I know we lose flash attn, cuda, tensor cores, Cuddnn and so on
It could compete on GPU inference space with tons of RAM for less than 6K€?