As I found out, it is because the TTL-232R-3V3 cables VCC output is 5V. What a confusing naming!
Powering the device with 3.3V made it actually start and show up in the flasher tool. Thankfully it still works ...
Wanted to share this in case anyone else encounters this problem.