User-agent: Googlebot Disallow: /Media/Default/Pdf/ User-agent: * Allow: / Sitemap: https://metalyapi.com/robots.txt