libremdb/public/robots.txt

User-agent: *
Allow: /about
Disallow: /
fix(robots.txt): disallow all robots crawl way too much 2022-06-05 13:49:29 +00:00			`User-agent: *`
feat: major rewrite the application is now rewritten in next.js. this commit also adds the ability to see trailers, did you know, more like this, etc. on title page. BREAKING CHANGE: the whole application is rewritten from scratch. 2022-09-11 14:07:24 +00:00			`Allow: /about`
fix(robots.txt): disallow all robots crawl way too much 2022-06-05 13:49:29 +00:00			`Disallow: /`