Modify url-metadata to follow redirects #34
Description
fetchAsBotStream is used to read only the HTML <head> of pages when fetching URL metadata.
This method currently ignores the response status and does not follow any redirects for the URL. Instead, we want it to follow an input number of redirects, and otherwise fail if a non-200 status is received.
See: undici Dispatcher.stream documentation (onInfo might be the best approach to this?)