About us - Privacy Policy - Disclaimer - Contact us - Guest Posting

WordPress Site Me SEO Ke Liye Sahi Robots.txt File Kaise Add Kare

Namaskar Dosto, Is post me Bloglon aapko batane ja raha hai ki WordPress Site Me SEO Ke Liye Sahi Robots.txt File Kaise Add Kare, Jabki maine apni pichhli post me aapko bataya tha ki Microsoft Account Kaise Banate hai. Me kuchh dino se lagatar Social media par dekh raha tha ki jo newbies hai vo apne wordpress blog me SEO ki ek bahut badi problem se gujar rahe hai. Jiski vajah se kuchh logo ne ya to apne blog sell karne ka mood bana liya ya fir blogging ko chhodne par majboor ho gaye hai. Kyonki unhone sayad kisi newbie ke blog ko follow kiya aur usi ki post ke hisab se apne blog ke liye Robots.txt file create karke add kar di ya fir unhone robots txt generator tool ko use karke galat robots.txt file bana li hai. jo unke blog ke SEO ke liye negative impact dal rahi hai. Kuchh logo ke blog to search engine me hi index hona band ho gaye hai.

WordPress Blog Me SEO Ke Liye Sahi Robots.txt File Kaise Edit Kare

Isliye mujhe laga ki ham aise logo ke blogging career ko bacha sakte hai jinhone apne wordpress site ke SEO ke liye itni badi galti kar li hai. Isliye aaj ki yah post aise hi logo ke liye hai, To chaliye start karte hai aur sabse pahle aapko batane ki koshish karte hai ki what is robots txt file.

Robots.txt File kya hai ?

Yadi me iske bare me batana chahunga ki yah ek aisi file hoti hai jisme kuchh code likha jata hai jise search engine (Google, Yahoo, Bing, Yandex aur Ask.com etc) strictly follow karte hai. Matlab aap iske dwara apne blog ke content ko search engine me kis tarah index karwana chahte hai isme yahi decide kiya jata hai.

Ise bhi padhiye : Keyword stuffing kya hai aur isse Blog ko kaise bachaye

Robots.txt file me jo bhi command aap insert karenge use google ya other search engine ko follow karne ke liye majboor hona padta hai. Isme yadi aap chahe to apne blog ke kisi bhi post ko search engine me index hone se rok sakte hai. Chaliye thoda ise example ke through samajhne ki koshish karte hai ki akhir is file ke andar kis tarah ki coding dikhai deti hai.

WordPress website robots.txt file example –

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Sitemap:

Ye keval example hai jo sabhi wordpress blog me pre-install hoti hai. Ise edit karke ham apne blog ko aur jyada SEO friendly bana sakte hai. To chalo ise edit karne se pahle ye bhi jan lete hai ki ise edit karna kyo jaruri hota hai.

Robots.txt File Edit karna kyo jaruri hai ?

Yadi aap default robots.txt file apne wordpress site ya blog me use karenge to search engine aapke blog ke every type ke content ko index karta hai. Jaisa ki ham sab jante hai ki wordpress me hamari bahut sari aisi bhi files hoti hai jinhe hame index nahi karwana chahiye jinme se kuchh files aapke blog ki security bhi kamjor banati hai.

Yadi aapke blog me koi aisa page ya post hai jise aap use search engine se chhupana chahte hai aur chahte hai ki vo specific page ya post search engine index na kare to aapko is file ko edit karke us post ko index hone se block karni hoti hai, Vaise jyadatar bloggers Yoast SEO plugin apne wordpress site me seo ke liye use karte hai, to isse bhi kisi post ya page ko aap index hone se block kar sakte hai.

Iska sabse achha aur mainly use ye hota hai ki apne wordpress blog ki kisi bhi directory folder ya file ko aap asani se blog kar sakte hai, Jo aapke visitors ke liye kisi bhi kaam ki nahi hoti hai balki unhe kuchh black hat hacker aapki site ko hack karne me use karte hai.

Ise bhi padhiye : Long tail keywords kaise khoje keyword research guide

Vaise me aage batane wala hu ki vo kaun kaun si directory folder hai jinhe aapko apne wordpress blog ke liye search engine me index hone se kaise rok sakte hai.

Yadi aap apne blog me custom robots.txt file sahi tarike se use karte hai to aapka blog aur adhik SEO optimized ho jata hai kyonki search engine vahi content ko scan karta hai jise aapne is file ki help se allow kar rakha hai. Aur yadi jab koi user content search karta hai tab search engine aapke blog ko jaldi scan kar lega kyonki aapne faltu cheeje Disallow kar rakhi hai. Isse aapke blog ka traffic bahut achha ho jata hai. Yahi iska sabse bada profit hota hai ki aapke blog ka SEO optimization aur jyada strong ho jata hai.

To chaliye ab jante hai ki SEO ke liye itni important file ko sahi tarike se kaise edit kar sakte hai matlab how to create robots txt file for website.

WordPress blog me sahi Robots.txt File kaise banaye ?

Yadi aap apne blog me SEO Yoast plugin use kar rahe hai to is file ko create karna bahut hi simple ho jata hai. to chaliye aap hamare dwara bataye gaye steps ko carefully follow kare –

Step – 1

Apne WordPress Dashboard ko login kariye.

Step – 2

SEO par jaye aur Tools par click kijiye.

SEO yoast tools

Step – 3

Ab File editor par click kijiye.

Yoast seo file editor tools

Step – 4

1.  Edit the content of your robots.txt wale field Yadi aapke blog me default Robots.txt available hai to use niche diye gaye code se replace kar de.

Note – Sitemap {http://www.bloglon.com/sitemap.xml} ki jagah apne blog ki sitemap dale.

2.  Ab save changes to Robots.txt par click karke save kar de.

yoast seo se robots.txt file edit kare

Ab aapki robots.txt file successfully aapke wordpress blog ke database me add ho chuki hai Lekin abhi aapko aage bhi bahut kuchh karna hai. Isliye aap hame follow karte rahiye.

Ab aap soch rahe honge pata nahi aapne hamare blog ke liye kya kya search engine me allow kiya hai aur kya kya disallow kiya hai, Aise sawal kisi bhi nebie ke mind me aa sakte hai kyonki me dekh raha hu ki is samay hindi me bhut sare blog bane huye hai aur unke achhe followers bhi hai lekin mene khud kai sare aise blog ki post read ki hai to pata chala ki inhone wrong information share kar rakhi hai jisse unke follower unhe follow karne par apne blog ka RAM NAAM SATYA kar lete hai. Ab aisa vo kyo karte hai, ho sakta hai unhe us topic ke bare me deep knowledge na ho ya fir other koi reaon ho sakta hai ye to unhe hi maloom hoga ya fir God ko. Lekin Bloglon aisa kabhi nahi karta kyonki yaha aapko vahi milega jiska iske author ko deep knowledge hai.

Ise bhi padhiye : Apne blog par daily 500 unique visitors kaise prapt kare

To chaliye ham aapko technically batate hai ki hamne is robots.txt file me kya kiya hai aur kyo kiya hai uske baad aapko ham aapko batayenge ki Robots.txt file ko Search console me kaise submit karte hai.

Robots.txt file ka great SEO ke liye technical description :

User-agent: * – Isme jo User-agent hai iske dwara ham search engine ko rules follow karne ke bare me bolte hai. Aur asterisk (*) ko ham isliye likhte hai kyonki ye all search engine ko follow karne ke liye bolta hai jaise Google, Yahoo, Bing, Yandex etc.

Disallow: / – Isko ham kisi content ya folder ko search engine ko no-index karne ke liye bolte hai ya search engine is content ko index na kare isliye likhte hai. Jabki forward slash (/) ye isliye likhte hai jisse search engine ko maloom rahe ki use perticular folder ya file ko index karne se roka gaya hai.

Allow: Ise ham isliye likhte hai jisse search engine samajh sake ki use kya kya index karna hai.

Robots.txt file me kya Disallow kare ?

Jaise ki maine upar code me diya hua hai jisme blog ki kuchh database files ko disallow kiya hai jaise /wp-admin/, /cgi-bin/, /comments/feed/, /trackback/, /xmlrpc.php. In sabko maine search engine ko index nahi karne ko bola hai. Kyonki ye files ya folders kisi visitors ke liye upyogi nahi hote aur inhe disallow karna ek best SEO ka rule hai.

Ab aap soch rahe honge ki ye to every Blogger batata hai to me aapko batana chahunga ki yadi aap upar diye gaye us code ko achhe se dekhenge to aapko bahut kuchh difference najar aayega jo aksar bahut sare blogger bahut badi galti kar dete hai. Ab me aage batane ja raha hu ki Robotos.txt file me kya kya Disallow nahi karna chahiye.

Robots.txt file me kya Disallow na kare ?

Kuchh blogger aise hai jinhe abhi tak yahi nahi maloom ki Google ne jo gujre huye years me kuchh bade badlaw kiye hai, uski vajah se hame kuchh bato ko bhi jarur dhyan dena hoga otherwise aapka blog ke traffic ka pata bhi nahi chalega ki kaha gaya sara traffic.

Jo Files aur folders hame Disallow nahi karne chahiye vo ye hai –

  • /wp-includes/ – Is directory ko hame apne wordpress blog ke robots.txt file me Disallow rule set karke search engine ke liye block nahi karna chahiye kyonki ye bahut old SEO me ise Disallow kiya jata tha aur ab latest SEO ke liye ise block nahi kiya jata. Iska reason ye hai ki aaj ke samay me lagbhag sabhi blog theme me asynchronous JavaScript jise AJAX bhi kahte hai. Ise use kiya jata hai to yadi aap ise hi block kar denge to aapki site ka adhura part hi Crawl nahi hoga. Aur isse hamare blog ke SEO par negative impact padega, Matlab blog ka traffic khatm ho jayega.
  • /wp-content/plugins/ – Is directory ko bhi hame block nahi karna chahiye kyonki yadi aap ise block kar denge to search engine, JavaScript aur CSS ko scan nahi kar payega jisse aapke blog content ko render karne me use problem hogi. Kyonki Latest SEO me google aapke blog ko with JavaScript aur CSS ke crawl karta hai. Yadi aap is directory ko block kar denge to aapka blog search engine render nahi kar payega. Aur iski vajah se aapke blog ka traffic khatm ho jayega.
  • /wp-admin/ – Is directory ko bhi aap block nahi kar sakte kyonki yadi aap ise block karenge to is directory me ek admin-ajax.php naam ki link hoti hai. Yadi ise search engine me block karenge to bhi hamare blog ko index karne me problem hogi. Lekin ab aapke dimaag me ek question jarur aaya hoga ki upar diye gaye robots.txt code me to /wp-admin/ block kar diya hai aur ab bol rahe hai ki block nahi karna chahiye, to iske liye me aapko bata du ki aapko bilkul darne ki jarurat nahi hai. Yadi aap achhe se code ko dekhenge to aapko maloom chal jayega ki maine /wp-admin/ ko to block kiya hai lekin /wp-admin/admin-ajax.php ko allow kar rakha hai. jisse search engine ko blog ko render karne me koi problem nahi hogi.

Yadi aapko lagta hai ki ye information incomplete hai to aap Great SEO ke liye Yoast wordpress robots.txt post ko jarur padh sakte hai jisme aapko aur jyada technical knowledge mil sakta hai. to chaliye thoda aage badhte hai aur jante hai ki robots.txt file me apne wordpress blog ke liye kya kya allow karna chahiye.

Robots.txt file me kya Allow kare ?

Jaisa ki maine upar code me search engine ke liye allow kiya hai jaise :-

Allow: /wp-admin/admin-ajax.php – Iske baare me to aapko upar bata hi chuka hu ki yadi aap ise block kar denge to aapki site google me crawl nahi hogi.

User-agent: Mediapartners-Google*
Allow: / – Yadi aap adsense user hai to aap ise allow karke jarur rakhe nahi to aapki site par adsense ads serve nahi kiye jayenge. Isliye ise Disallow na kare. Aur yadi aap adsense use nahi karte hai to aap ise Disallow kar sakte hai. Iske bare me jyada technically jaane ke liye Robots.txt Google support page par visit kar sakte hai.

User-agent: Googlebot-Image
Allow: /wp-content/uploads/ – Ye directory isliye allow karna chahiye jisse blog ki images search engine me render ho sake. Yadi aap ise Disallow kar denge to google aapke blog ki images ko crawl nahi karega.

User-agent: Adsbot-Google
Allow: / – Ye basically adwords ke liye use hota hai jisse advertiser ke liye search engine ko render karne ke liye rule set kiya jata hai.

User-agent: Googlebot-Mobile
Allow: / – Isko isliye use kiya jata hai because jab koi mobile user content ko search karta hai to aapki site ko mobile version me crawl kiya ja sake. Yadi aapke mobile visitors hai to aapke liye ye bahut hi important hoga aur ham jante hai ki sabhi site par mobile se traffic lagbhag 50% to aata hi hai. Isliye ise allow karna bahut jaruri hota hai.

Sitemap: – Iska use to sabhi ko maloom hota hai yadi nahi maloom to me aapko batana chahunga ki sitemap me blog ka all content hota hai jaise post, page etc. To ise to hame apne blog ki robots.txt file me rakhna hi padega.

Important Note – Dhyan rahe yadi aapki sitemap ek se jyada hai to un sabhi ko bhi robots.txt file me add karna hoga. jaise post ki sitemap alag ho sakti hai aur page, category, tag etc sabhi sitemap ko usi tarah add karna hoga jis tarah maine upar diye gaye code me ek sitemap add ki hai.

Ise bhi padhiye : How to create Sitemap for your blog or website?

Ab aapne robots.txt file ki technical information ke bare me jaan liya hai, aur ab jante hai ki Robots.txt file ko search console me kaise submit karte hai.

Robots.txt file ko Google Search Console me kaise submit kare ?

Yadi aapne apne blog ke liye robots.txt file bana li hai jise me upar bata chuka hu to ab use search console me submit karne ke liye niche diye gaye steps ko follow kijiye –


Step – 1

  • Sabse pahle apne Google search console Dashboard ko login kijiye.
  • Ab apne us blog par click kijiye jiske liye ise submit karna hai.select website in search console to submit robots.txt file

Step – 2

Test robots.txt file in google search console


  1. Crawl par click kariye jo left side me menu me asani se mil jayega.
  2. Robots.txt Tester par click kariye, Kyonki ise submit karne se pahle test karna hoga ki sahi bani hai ya kuchh error hai.
  3. Ab box me upar diye gaye robots.txt code ko paste kar dijiye.
  4. Ab Test button par click kijiye.

Yadi sitemap me koi error nahi aata hai test me sab kuchh ok bata raha ho to ab ham apne blog ki robots.txt file submit kar sakte hai. Kaise karna hai iske liye next step follow kijiye –

Step – 3

Ab aapke samne ek new popup window open hogi usme Submit button par click kar dijiye.

Robots.txt file search console me submit kare

Congratulation ! ab aapke wordpress site ki robots.txt file google search console me successfully submit ho gayi hai. Ab aapka blog great SEO friendly ban chuka hai, aur ab aapka blog search engines achhe se aur kam samay me aapke content ko achhe se crawl kar payenge.

Ise bhi padhiye : WordPress Blog me Comment Policy Message add kare

Mujhe ummid hai ki aapko ab achhi tarah se maloom chal gaya hoga ki what is robots txt in seo aur WordPress Site Me SEO Ke Liye Sahi Robots.txt File Kaise Add Karte hai. Aap bhi mujhe comment ke madhyam se jarur bataye ki aap apne blog me kis tarah ki robots.txt file use karte hai good SEO ke liye. Yadi is post se related koi problem ho to aap comments ke madhyam se hamare saath jarur share kare ham aapko jaldi jawab dene ki koshish karenge. Yadi ye post aapko helpful lage to social media freinds ke saath jarur share kare.

Comments

  1. By surendra rsdp

    Reply

    • Reply

  2. By Suraj yadav

    Reply

    • Reply

  3. By rohaan

    Reply

  4. Reply

    • Reply

  5. By rohaan

    Reply

  6. By Suraj yadav

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *