There are dozens of ways how we can get in touch ,whether it is phone, email, any of existing messengers, casual meeting or conference. No matter how it happened, but as a result we are getting the general description of your idea. After that we have to appoint our next meeting (and means of communication) for further discussion of the project. It would be very helpful to prepare the following materials on your part:
Robots.txt serves as one of the factors in search engine optimization, although in Magento this file is not included by default. So, let’s fix this and create the file ourselves:
# indicates that rules are defined for all bots
# should not wait too long for a page to load
# Now come the rules: restrict robots from indexing the following pages:
# These rules are supported only by major bots
These are the basic rules. Robots.txt file should be customized and changed per each project individually.