User-agent: * Disallow: /core/wp-admin/ Disallow: /core/wp-includes/ Disallow: /core/wp-content/ Disallow: /uploads/ Disallow: /node_modules/ Disallow: /plugins/ Disallow: /themes/