You need to be logged in to post in the forum - Log In
An active JCE Pro Subscription is required to post in the forum - Buy a Subscription
- Support
- Forum
- JCE Editor
- JCE Blocked by Robots.txt - Google Search Console Error
Support is currently Online
Official support hours:
Monday To Friday
From 09:00 To 17:00 Europe/London (BST)
From 09:00 To 17:00 Europe/London (BST)
We noticed on at least two websites that there is a warning when using the URL inspection tool within Google Search Console.
Specifically this is the warning shown on all pages:
Googlebot blocked by robots.txt Stylesheet https://[DOMAIN].com/plugins/system/jce/css/content.css?badb4208be409b1335b815dde676300e
Version Information:
JCE Editor (used as global editor): 2.9.29
Theme: Yootheme Pro 2.7.22
Joomla: 3.10.10
PHP: 7.4.x
Please advise why JCE resources are being blocked by robots.txt. We see that /plugins/ is blocked, but shouldn't that resource be stored elsewhere to avoid being blocked (e.g. media folder)?
Robots.txt output:
# If the Joomla site is installed within a folder
# eg http://www.example.com/joomla/ then the robots.txt file
# MUST be moved to the site root
# eg http://www.example.com/robots.txt
# AND the joomla folder name MUST be prefixed to all of the
# paths.
# eg the Disallow rule for the /administrator/ folder MUST
# be changed to read
# Disallow: /joomla/administrator/
#
# For more information about the robots.txt standard, see:
# https://www.robotstxt.org/orig.html
User-agent: *
Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /modules/
Disallow: /plugins/
Disallow: /tmp/
Specifically this is the warning shown on all pages:
Googlebot blocked by robots.txt Stylesheet https://[DOMAIN].com/plugins/system/jce/css/content.css?badb4208be409b1335b815dde676300e
Version Information:
JCE Editor (used as global editor): 2.9.29
Theme: Yootheme Pro 2.7.22
Joomla: 3.10.10
PHP: 7.4.x
Please advise why JCE resources are being blocked by robots.txt. We see that /plugins/ is blocked, but shouldn't that resource be stored elsewhere to avoid being blocked (e.g. media folder)?
Robots.txt output:
# If the Joomla site is installed within a folder
# eg http://www.example.com/joomla/ then the robots.txt file
# MUST be moved to the site root
# eg http://www.example.com/robots.txt
# AND the joomla folder name MUST be prefixed to all of the
# paths.
# eg the Disallow rule for the /administrator/ folder MUST
# be changed to read
# Disallow: /joomla/administrator/
#
# For more information about the robots.txt standard, see:
# https://www.robotstxt.org/orig.html
User-agent: *
Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /modules/
Disallow: /plugins/
Disallow: /tmp/
Please advise why JCE resources are being blocked by robots.txt. We see that /plugins/ is blocked, but shouldn't that resource be stored elsewhere to avoid being blocked (e.g. media folder)?
There is no need for the content.css file to be indexed by Google at all, as it is system file, not a displayable media file.
Just because you're not paranoid doesn't mean everybody isn't out to get you.
Please advise why JCE resources are being blocked by robots.txt. We see that /plugins/ is blocked, but shouldn't that resource be stored elsewhere to avoid being blocked (e.g. media folder)?
There is no need for the content.css file to be indexed by Google at all, as it is system file, not a displayable media file.
Just because you're not paranoid doesn't mean everybody isn't out to get you.
Thank you for the clarification. I understand that it is not required to be indexed by Google. But if Google's bot is seeing that as blocked every time and it's referenced on numerous pages, wouldn't it be better to output that file be stored in the media folder so it can be indexed? Or is it actually preferred that the file generated not be indexed.
But if Google's bot is seeing that as blocked every time and it's referenced on numerous pages, wouldn't it be better to output that file be stored in the media folder so it can be indexed? Or is it actually preferred that the file generated not be indexed.
The media folder does not contain content media, ie: media items (images, pdf, video etc.) that is displayed in articles, and the kind of stuff you want Google to index so it is searchable. The media folder generally contains system assets - javascript and css files, image icons etc. - used by Joomla and installed extensions. You don't usually want this media to be indexed as it has no search value in terms of the content of your site.
Your robots.txt file should therefore only allow access to stuff you want to be indexed, such as the contents of the images folder, eg:
User-agent: *
Disallow: /administrator/
Disallow: /api/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Just because you're not paranoid doesn't mean everybody isn't out to get you.
- Page :
- 1
There are no replies made for this post yet.
Be one of the first to reply to this post!
Be one of the first to reply to this post!