Unverified Commit fe1ca3ab authored by Victor Macias Castillo's avatar Victor Macias Castillo Committed by GitHub

Merge pull request #4 from Woorank/adapt-readme

Adapt Readme
parents 16d4c5e6 a7131089
......@@ -24,6 +24,10 @@ user-agent: twitterbot
disallow: /
allow: /twitter
user-agent: mozilla
disallow: /path
noindex: /path
Sitemap: http://www.example.com/sitemap.xml
```
produces following output
......@@ -40,9 +44,15 @@ produces following output
{ "rule": "disallow", "path": "/" },
{ "rule": "allow", "path": "/twitter" }
]
}, {
"agents": [ "mozilla" ],
"rules": [
{ "rule": "disallow", "path": "/path" },
{ "rule": "noindex", "path": "/path" }
]
}],
"extensions": [
{ "extension": "sitemap", "value": "http://www.example.com/sitemap.xml" }
]
}
```
\ No newline at end of file
```
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment