add sitemap.xml to reduce traffic for crowler or run your own YaCy engine
Currently we need to reguallrly crowl xhamster with external YaCy. If you will add sitemap.xml it will reduce traffic, but if you will run your onw YuCy instance it will make it even better.
1
vote
-
needit
commented
has this been done yet?