Ticket #807 (closed enhancement: wontfix)

Opened 3 years ago

Last modified 2 years ago

Handle robot traffic better

Reported by: rgrp Owned by:
Priority: awaiting triage Milestone: ckan-v1.3
Component: ckan Keywords:
Cc: Repository:
Theme:

Description

We get a lot of robot traffic. Notice that robots are visiting package edit pages. Suggest:

  • Add rel=nofollow to various links
  • Throttle some robots (not all seem to respect robots.txt)

Change History

Changed 2 years ago by dread

  • component changed from component1 to ckan

Changed 2 years ago by thejimmyg

  • status changed from new to closed
  • resolution set to wontfix

Changed 2 years ago by rgrp

wontfix as with traffic we have this is not a massive issue and these are very minor items (we can reopen later if this comes up again).

Note: See TracTickets for help on using tickets.