Current windows instructions for copying the ssh key require .ssh/authorized_keys to be present on the remote machine. If it is not present instructions from e.g. https://www.conradakunga.com/blog/copy-ssh-key-in-windows-10/ are required for so that .ssh/ and .ssh/authorized_keys are created with correct permissions.