Update robots.txt in Joomla 3.4.x and improve your karma with Google and incidentally your SEO

Until Joomla version 3.3 we were used to Quit the robots.txt file in Joomla, since the configuration data that it brought by default was applicable in most websites “Without further ado”.

Suddenly new versions of Joomla 3 arrive, many users have become more aware of Joomla 3.4, and we perceive that Google expressly needs us to give your permissions bots indexing to access the contents of the / templates, / media or / images folders so that they analyze the contents to improve the SEO of the affected website.

After updating to Joomla 3.4 or more recently 3.4.1, Joomla presents us with a notice in the backend that invites us to review the post-installation messages and among them we find the notice that refers to robots.txt under the title robots.txt update.

You have post-install messages

There are important post-installation messages that require your attention. To view these messages, please click on the ‘Review Messages’ button below.

You can review the messages at any time by clicking on the ‘Post Installation Messages’ menu item in the ‘Components’ menu in the administration area. This information area will not be shown if you have it configured in ‘Hide all messages’.

How is this story arranged?

Easy!, simply edit the robots.txt.dist file and copy its contents, then rename the file robots.txt to robots.txt_old (for example) and create a new file called robots.txt, edit it and paste the content copied from robots.txt.dist and save the changes, ready!Your file is already adapted to the new demands of Google and its legion of indexing bots.

Another faster option is to edit your file robots.txt and make sure there are no lines:

Disallow: /images/ Disallow: /media/ Disallow: /templates/

How does this affect mobile devices?

When examining your website, the tests Google performs do not take into account the preview of files that are blocked by the file robots.txt which can lead to notices when you see an inaccurate view of your website to correct the problem of locked files, such as / images and / templates.

It is an apparently minor issue but it can cause your website to be considered incompatible with mobile devices.

If you additionally use modules or plugins that use their own CSS styles, you may need to remove the following lines from the robots.txt file:

Disallow: /modules/ Disallow: /plugins/

And if you use CSS and compressed JavaScript from the template compression options, you will have to remove the line from robots.txt:

Disallow: /cache/

From here it is more possible that your site will like Google, that we like it or not it is still the “big brother” of content indexing to improve positioning and SEO.

Little details are also important in Joomla and taking care of them ensures that your website is more accessible and indexable.

Member of the Websites Are Us technical team.
Coordinator of content on the Blog and YouTube.
Technical support in CyberProtector. Teacher at Websites Are Us Learning.