Now that you've completed the Drupal 8 Beginner class, it's time to build your first real site and start exploring Drupal's powerful modules and themes.
By default, all the URLs on your site can be crawled by Google. However, if we don't want Google to index some specific pages, you can use a robots.txt file.