Typically, the average indexation period by Yandex is 1–2 weeks.

Some blogs get indexed much faster. The posts that I publish on my blog are indexed by Yandex within two hours, or even within two minutes. But there are exceptions.

This happened with two pages “How to write texts to reach the top? ”(04/14/2011) and“ iForum 2011. What happened this year ”(04/18/2011). What's up with them? Why are they not in the index? So much time has passed.

I have already re-posted to Twitter and posted links on two other blogs and used the add form //webmaster.yandex.ru/site/add.xml.

Hello.

Please tell me what could be the reason.

Sincerely yours, Ilya.

Soon, Plato's answer came:

Hello Ilya!

The specified page has already been indexed by the robot and should appear in the search results after the next update of the search databases. Please wait a few more days.

—
Best regards, Platon Shchukin
Yandex Support
help.yandex.ru

To be honest, I was comforted by this answer. But after the update of Yandex search results, which happened on 04/29/2011, I became worried again. These pages never appeared in search results. But why? What's wrong with them? Promotion is inevitable only with indexed links. Otherwise, they are simply not taken into account, although they are posted on the page.

Google, by the way, has indexed both documents.

Well, okay, while Yandex is updating its search results bases, I bring to your attention a wonderful video about the technologies of the future, made on glass. In principle, websites, I think, will also develop in this direction. In particular, interfaces and navigation already partially look like this already now.

P.S. On April 30 I checked - the pages are already in the Yandex index. A copy of these pages was saved on 24.04.2011. Hooray!

Things don't always look good with new sites. Yandex indexes them very slowly. Yandex.Webmaster says:

Your site is not indexed by Yandex. (The site was successfully added to the indexing queue)

If the site is new and was not previously known to the robot, then after adding it to the Yandex.Webmaster service, it will start indexing and then appear in the search. This usually happens within two weeks of adding the site.

Yandex.Webmaster writes that the site is not indexed because it is new, but at the same time it can index 2 pages. That is why, for the competitions "Promotion is inevitable", competitions are held in Russian Google.

When adding a new site to Yandex.Webmaster, a message appears that the site has been added to the indexing queue. After two or three days, there are already shifts:

The site has started to be indexed. Pages should appear in the search after 1-2 updates of the search base. The search may contain pages indexed by a fast robot.

Due to the delay in the last ups, Yandex is asked questions to which it gives no less informative answers

As for the statistics of ups, it is displayed in the table.

How to speed up website indexing

And finally, a little life hack on how to speed up the indexing of the site. You just need to get a couple of fatty external links to the page you need (for example, new article on your blog). It is important that links come from trust sites and popular (thematic) groups social networks, where

Yandex Webmaster allows you to:

• add Sitemap;
• update;
• delete;
• analyze.

How to add a Sitemap to Yandex Webmaster

To add a Sitemap file to the indexing queue, you need, as always, go to the Webmaster service - webmaster.yandex.ru. Further:

1. In the section "Indexing" you will find the item " Sitemaps».
2. Add the full URL of the sitemaps, for example, https: //site/sitemap.xml.
3. Click Add.
4. Wait while Yandex Webmaster checks the file.

After adding, the file goes to the queue for processing. The robot will add it within two weeks. Each added file, including those included in the Sitemap index, is processed by the robot separately.

After downloading, opposite each sitemap, you will see one of the statuses in Yandex Webmaster:

Refresh Sitemap

When changes occur in the Sitemap, it does not need to be removed from Yandex Webmaster and added again. The search engine itself checks it from time to time for changes and errors.

If your Sitemap is not indexed, then it can be accelerated. You need to go to the "Indexing" section, then to the "Sitemap files" item. Click on the update icon opposite to the sitemap. Yandex will download the data within three days. The function can be used up to 10 times for one host.

When you use up all attempts, the next one will be available 30 days after the first one. The exact date is displayed in the Webmaster interface.

Remove Sitemap from Webmaster

In the Yandex.Webmaster interface, you can delete the files that were added on the Sitemap files page:

If a directive has been added for the Sitemap in the robots.txt file, remove it. After making changes, the information about the Sitemap will disappear from the base of the robot and Yandex.Webmaster within a few weeks.

Formats supported by Yandex Webmaster

Yandex accepts Sitemap in the following formats:

XML Sitemap Format

It is preferable to transfer to XML format since additional data can be passed in it.

Yandex supports the Sitemap protocol. Use this format if you want to report on:

• date last update pages (lastmod element);
• page change frequency (changefreq element);
• page importance (priority element) - the robot loads pages one by one, taking into account the presence and value of the coefficient from 0.0 to 1.0. Specify the ratio for those URLs that are most important for the site.

https://сайт/ssylki-v-yandex-webmaster/ 2018-06-06 monthly 0.8 ...

TXT Sitemap format

Only page addresses can be sent in this format. And that's all. Yes, sadness and sadness, you'd better use XML :)

Use this format to report only page addresses.

Https: // site / ssylki-v-yandex-webmaster / https: // site / zerkala-sajta-v-yandex-webmaster /

To transmit information about a video, specify links to XML feeds in the Sitemap (see details in the Help of the Ya.Video service).
Search does not support submitting information about images, RSS, and Atom feeds using a sitemap.

When do I need a Sitemap?

Yandex develops special algorithms by which the indexing robot learns about the site. For example, using internal and external links - moving from one page to another. Sometimes the robot can skip pages. Use a Sitemap if your site:

• a large number of pages;
• separate pages without navigation links;
• deep nesting.

How to create a file

Add Sitemap.xml to Yandex Webmaster - video

Adding a site for indexing in Rambler.

"Since June 23, 2011 Rambler-Search has been using Yandex search technologies, supplemented by its own services. You can add a site to the search engine index through the Yandex system".

Do not forget to add your site to Top100.Rambler, it will not be superfluous.

Adding a site for indexing in Mail.ru.

It is very easy to add a site, send the URL and wait, do not forget to submit a FREE application for getting into the Mail.ru directory, if approved, it will be good. Without closing the page for adding a site to the search, follow the link to add to the Mail.ru catalog and fill out the form (in this case, it will be possible to submit an application to the catalog for free).

Adding a site for indexing to the Aport.ru catalog.

To add a site, you will have to go through 5 simple steps. On the first add the site url. At the first stage, it is checked for the site's response and for the presence of the site in the catalog, if it is not, then the second step will appear. In the second step, fill in the information about the site, name, description, keywords, etc. At the third step, select a section (the sections were reminded as in the Mail.ru catalog). The fourth step is to add the site region (also reminded Mile.ru with something). The fifth step, enter the captcha (capital letters are taken into account) and check the entered data, if everything is correct, click on. You have been added, we are waiting for moderation on mailbox.

Adding a site for indexing in GOGO.ru.

As for the importance of this resource and the presence in it, I cannot say, but I can say one thing, it will not hurt, and suddenly they will come from it (in practice, this was not, but everything is changing). To add on the Internet there is a link http://gogo.ru/wmaster/add_site.html by clicking on it, I realized that this is already a search engine Mail.ru, (I left the link, just in case).

Adding a site for indexing in NIGMA.ru.

The next system is nigma.ru. On it they write that it gives an influx of people, I did not notice, but added, maybe it will be useful. Moreover, it is fast. Specify the URL, mailbox and update frequency, save and that's it.

Adding a site for indexing in TAGOO.

The search engine tagoo apparently specializes in media content, if you have it or may appear, add it. I don’t presume to judge the importance of this search engine, I don’t know it, but I added it.

Adding a site for indexing Turtle.

The system is focused on the resources of the Commonwealth of Independent States of the CIS in any language, as well as the Russian-language resources of other countries. You can add. But due to the death of its founder Dmitry Kryukov, the resource temporarily suspended its activities. As it is written on the site TEMPORARILY, then we do not remove it from accounts.

So we have reached foreign search engines.

Adding a site for indexing Yahoo (Yahoo) and Bing (Bing).

Yahoo merged her search engine with Bing and re-uploads the old URL to Bing to add was http://search.yahoo.com/info/submit.html. Add to Bing. We add and rejoice, we can also register and get the webmaster's panel, I have not registered there, but this is not an indicator. Try it for clarity.

In this manual, we will consider the issue of adding our new site for indexing to various search engines.

I decided to mention both popular search engines and those about which you may not have heard.

Site indexing in Yandex

To add a site for indexing, just enter url home page and captcha. Captcha is a few numbers that protect against automatic registrations. After you click the "add" button, there are several possible scenarios for the development of events.

1) The message "your site has been added" signals the successful addition of a resource to the queue for indexing in Yandex.
2) If the inscription "Your hosting is not responding" appears, it means that your server is down at this moment. You can try adding the site later or looking for better hosting.
3) But if a message appears that "the specified URL is prohibited from indexing" then things are bad. This indicates that sanctions have been imposed on your resource in the form of a site ban. It is quite possible that the domain you bought once had a website that received sanctions. With the help of addurl, webmasters often check sites for a ban in Yandex.

Site indexing in Google (Google)

The next most important for our site is search system Google (Google). The process of adding a site for indexing on Google is exactly the same as on Yandex. Google also has its own adurilka, which is located at: https://www.google.com/webmasters/tools/submit-url.

You also need to enter a captcha when adding. But there are two differences. If in Yandex you can simply add url without unnecessary gestures, then in Google you need to be logged in to your account. Otherwise it will not work. Accordingly, if you do not have an account there yet, you will have to create one. The second difference between Google and Yandex is the indexing speed. Google indexes sites very quickly.

Site indexing in Rambler (Rambler.ru)

Of course, Rambler is not what it used to be, as many would say, and gives very little traffic. And all the same, why should it be neglected? The process of indexing a site in Rambler is the most protracted among other domestic search engines. Yes, and his adurilka has not worked for a long time, she was at the address: robot.rambler.ru/cgi-bin/addsite.cgi

He has been using the Yandex search database for a long time. Therefore, in order to get into the Rambler.ru index, it is enough to add to Yandex.

Site indexing in Mail.ru (Mail)

The Mail.ru search engine also has a webmaster's office. Adding a site for indexing in Mail.ru occurs through the addurl form, which is located at: go.mail.ru/addurl

Moreover, like Google, in order to make an application for indexing, you need to create your own account and log into it. Otherwise it will not work. Mile has been trying to develop his own webmaster tools lately.

Above, we examined the main domestic search engines in which it is desirable for us to index our site. I will cite the following search engines more for your general SEO erudition than for specific actions.

Search engine Aport.ru (Aport)

Aport.ru was once a search engine, with its own index base and adurilka. Now a commodity search engine has been made from it, in which you can compare prices for goods and services.

Search engine Nigma.ru (Nigma)

Nigma.ru is our Russian intellectual search engine... The total volume of its traffic is about three million requests per day. Obviously, you shouldn't neglect the traffic from Nigma. You can add your site for indexing to Nigma on the page nigma.ru/index_menu.php?menu_element=add_site.

Media navigator Tagoo.ru

The Tagoo.ru system is a media search engine that searches for media data. These are music content, videos and programs. In order for your site to be indexed by the Tagoo system, you need to use the add form: tagoo.ru/ru/webmaster.php?mode=add_site.

Search engine Turtle.ru (Turtle)

The international search engine Turtle searches for the CIS countries in any language. For indexing, resources located on such domain zones like: ru, su, ua, am, az, ge, by, kz, kg, uz, md. To add a site for indexing in the turtle, you need to use the adurilka: http://www.turtle.ru/add.html. It is advisable to wait for a message about the acceptance of your site. Maybe not add, but you won't know.

Foreign search engines

If the above were domestic search engines, then below will be a list of foreign search engines.

Yahoo.com search engine (Yahu)

Bing.com search engine (Bing)

Search engine Bing belongs to Microsoft Corporation and was created to replace Live Search. Microsoft hopes that the new brainchild will be much more popular than its predecessor. If you would like to index your PS site Bing.com, you can do so at http://www.bing.com/toolbox/submit-site-url.

Ukrainian search engines

And at the end of my review, I will cite two popular search engines in Ukraine.

Ukrainian search engine Meta.ua (Meta)

For the convenience of webmasters and search engines, a special sitemap format was developed. This is a list of links to internal pages of the site, presented in XML format. This format is also supported by Yandex. In a special section of the service, you can upload a sitemap for your site. This will influence the priority of the crawling robot on some pages of your site. For example, if some pages are updated much more often than others, you should specify this information so that the Yandex robot can plan its work correctly.

Yandex indexes the main types of documents distributed on the Web. But there are restrictions on which it depends on how the document will be indexed, and whether it will be indexed at all:

• A large number of cgi parameters in a URL, a large number of duplicate subdirectories, and a too large total URL length can lead to poor document indexing.

  For indexing, the size of the document is important - documents larger than 10MB are not indexed.

  Flash indexing:

  1. * .swf files are indexed if there is a direct link to them or they are embedded in html tags object or embed;

     if flash contains useful content, the original html document can be found by the content indexed in the swf file.

IN PDF documents only text content is indexed. Text presented in the form of pictures is not indexed.

Yandex correctly indexes documents in the Open Office XML and OpenDocument formats (in particular, Microsoft documents Office and Open Office). However, it should be borne in mind that the introduction of support for new formats can take some time.

Tags are allowed and , the Yandex robot indexes the content loaded in them and allows you to find the original document by the content of the frames.

If you've overridden the server behavior for non-existent URLs, make sure the server returns a 404 error code. Upon receiving a 404 response code, the search engine will remove this document from the index. Make sure everyone required pages site gave the code 200 OK.