Crawl google


Status
Not open for further replies.
Ditempat saya jangan itu sayur OM, Jadi jangan-jangan sama dengan sayur-sayur :39: :39: :39:
Rasanya bahasa jawa tidak 'jangan-jangan' tapi 'jangan' yang artinya 'sayur'. Tidak umum istilah 'sayur-sayur' tapi 'sayur-mayur'.

Mungkin orang sekarang beranggapan 'orang sekampung' sama artinya dengan 'orang satu kampung' dengan alasan 'se' artinya 'satu'. Sebenarnya berbeda.
 
ini saya cek robot.txt nya masih ada mas @mustafaramadhan di directory webnya ,berikut rule htaccesnya

# BEGIN All In One WP Security
#AIOWPS_BASIC_HTACCESS_RULES_START
<Files .htaccess>
order allow,deny
deny from all
</Files>
ServerSignature Off
LimitRequestBody 10240000
<Files wp-config.php>
order allow,deny
deny from all
</Files>
#AIOWPS_BASIC_HTACCESS_RULES_END
#AIOWPS_BLOCK_SPAMBOTS_START
<IfModule mod_rewrite.c>
RewriteCond %{REQUEST_METHOD} POST
RewriteCond %{REQUEST_URI} ^(.*)?wp-comments-post\.php(.*)$
RewriteCond %{HTTP_REFERER} !^http(s)?://(.*)?\.codeproject\.web\.id [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^$
RewriteRule .* http://127.0.0.1 [L]
</IfModule>
#AIOWPS_BLOCK_SPAMBOTS_END
# END All In One WP Security

# BEGIN WordPress
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /
RewriteRule ^index\.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>

# END WordPress
 
@mustafaramadhan ini mas isinya

User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content
User-agent: Mediapartners-Google
Allow: /
User-agent: Adsbot-Google
Allow: /
User-agent: Googlebot-Image
Allow: /
Allow: /wp-content
User-agent: Googlebot-Mobile
Allow: /

Mohon pencerahannya
 
Status
Not open for further replies.
Back
Top