I am researching this. I need suggestions.
I have a domain that I own. It is pointed to a subdomain that is my business that I do not own. The subdomain's robots.txt file controls the images I am trying to list in the Microsoft Shopping. But Microsoft Shopping wants to crawl the image URLs. The robots.txt will not allow this.
I need to use resources to have my domain carry its own robots.txt file while integrated with the subdomain. I need to avoid redirects for Microsoft.
TIA
question from:https://stackoverflow.com/questions/66067899/robots-txt-on-domain-instead-of-subdomain
