diff options
| author | wiki <wiki@parabola.nu> | 2016-05-01 07:32:37 +0100 |
|---|---|---|
| committer | wiki <wiki@parabola.nu> | 2016-05-01 07:32:37 +0100 |
| commit | b4274e0e33eafb5e9ead9d949ebf031a9fb8363b (patch) | |
| tree | c7865e0aa3114bac2e0df6131de46ad654af8c5f | |
| parent | 8c68673d8567f0534cadbbc9f92ba26396363131 (diff) | |
this robots.txt is dated 2015-05-29
| -rw-r--r-- | robots.txt | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/robots.txt b/robots.txt new file mode 100644 index 00000000..42018bd9 --- /dev/null +++ b/robots.txt @@ -0,0 +1,8 @@ +# No me indexes el historial loco +User-Agent: * +Disallow: /index.php + +# Dejar que Internet Archive indexe las páginas en bruto +User-Agent: ia_archiver +Allow: /*&action=raw + |