Question: VRAM Requirements #2
Description
Hi, curious what the GPU requirements would be for inferencing tasks like tracking the drifting car. The model itself seems quite small, ~10gb, but I'm unsure how much vram the context uses.
{{ message }}
Hi, curious what the GPU requirements would be for inferencing tasks like tracking the drifting car. The model itself seems quite small, ~10gb, but I'm unsure how much vram the context uses.