Ticket #807 (closed enhancement: wontfix)

Opened 3 years ago

Last modified 3 years ago

Handle robot traffic better

Reported by: rgrp Owned by:
Priority: awaiting triage Milestone: ckan-v1.3
Component: ckan Keywords:
Cc: Repository:
Theme:

Description

We get a lot of robot traffic. Notice that robots are visiting package edit pages. Suggest:

  • Add rel=nofollow to various links
  • Throttle some robots (not all seem to respect robots.txt)

Change History

comment:1 Changed 3 years ago by dread

  • Component changed from component1 to ckan

comment:2 Changed 3 years ago by thejimmyg

  • Status changed from new to closed
  • Resolution set to wontfix

comment:3 Changed 3 years ago by rgrp

wontfix as with traffic we have this is not a massive issue and these are very minor items (we can reopen later if this comes up again).

Note: See TracTickets for help on using tickets.