While this isn’t purely a SmartNIC-related article, it is something worthy of sharing that is #SmartNIC adjacent. Last month, after listening to Jensen from Nvidia talking about OpenClaw in his keynote, I thought it was time to begin seriously exploring AI Inference using a GPU installed in a dedicated server at home. Yes, I’m that kind of nerd, with a 22U rack in a closet in my home office, that has a dedicated 25A service, and a hard-wired GbE connection via Google Fiber. Now you’re going to laugh, this new project had to be done on a tight budget, so I repurposed an AMD EPYC Rome 16-core server with 64 GB of RAM that I already had and picked up an AMD Radeon RX 7600 with 8 GB of VRAM for $245 on eBay. As shown in the rightmost yellow column above.

Leave a Reply