HOME  PGsearch   MailWare   E-R-E dict 
PGsearch PostgreSQL English Russian
win
koi
mac
translit
       
 
          Help

?
, .

?
, 3-4 .

, , ?
:
  • ( )
  • ( - )

, ?
, "Robots exclusion protocol", , ,
'robots.txt', http://./robots.txt, , /cgi-bin/ , 'Offline Explorer', /private/ 
User-agent: Offline Explorer
Disallow: /cgi-bin/

User-agent: *
Disallow: /private/
'User-agent' GTSCrawler.

:
  • Javascript . javascript, URL . ' ' .
  • , www.. .. - . ( ).
  • CGI , , ( ). , , , . '' .

, ?
,