The docs say that you can run the buf CLI with bazel run @rules_buf_toolchains//:buf but this only works on *nix where the binary is at ./buf. On Windows you need to run bazel run @rules_buf_toolchains//:buf.exe.
A common alias or renaming the binary to buf.exe on all platforms would be useful.