# This robots.txt file controls crawling of URLs under https://charles-perry.com User-agent: * Allow: /content/public/ Disallow: /content/private/ Disallow: /css/ Disallow: /js/ Disallow: /fonts/