Ticket #728 (assigned requirement)

Opened 4 years ago

Last modified 3 years ago

CSW Harvesting shall be optimised in respect of reharvesting only records that have changed

Reported by: johnbywater Owned by: amercader
Priority: major Milestone: ckan-backlog
Component: uklii Keywords:
Cc: Repository: ckan
Theme: none

Description (last modified by thejimmyg) (diff)

Hi Will, this is important again because some CSW servers we use have over 300 documents in. Could you take a look at modifying the filter please?

Change History

comment:1 Changed 4 years ago by johnbywater

  • Description modified (diff)

comment:2 Changed 4 years ago by johnbywater

  • Description modified (diff)

comment:3 Changed 4 years ago by johnbywater

  • Owner set to johnbywater

comment:4 Changed 4 years ago by johnbywater

  • Component changed from ckan to uklii

comment:5 Changed 3 years ago by johnbywater

  • Description modified (diff)

comment:6 Changed 3 years ago by thejimmyg

  • Owner changed from johnbywater to thejimmyg
  • Priority set to minor
  • Summary changed from CSW harvesting shall be optimised in respect of reharvesting only records that have changed to Harvesting shall be optimised in respect of reharvesting only records that have changed

WAF records may always need to be re-harvested to see if they have changed. Does CSW provide any functionality that allows us to see what has changed?

comment:7 Changed 3 years ago by thejimmyg

  • Repository set to ckan
  • Description modified (diff)
  • Priority changed from minor to critical
  • Theme set to none
  • Milestone changed from ckan-v1.4 to ckan-v1.4-sprint-6
  • Owner changed from thejimmyg to wwaites

comment:8 Changed 3 years ago by wwaites

  • Status changed from new to closed
  • state set to draft
  • Resolution set to wontfix

filters not properly supported by e.g. geonetwork. so we defer.

comment:9 Changed 3 years ago by thejimmyg

  • Status changed from closed to reopened
  • Resolution wontfix deleted

comment:10 Changed 3 years ago by thejimmyg

  • Owner changed from wwaites to amercader
  • Priority changed from critical to major
  • Status changed from reopened to assigned

Actually, these are a different type of filter. We need to send a filter to only get modified documents, to save processing our end.

comment:11 Changed 3 years ago by amercader

  • Summary changed from Harvesting shall be optimised in respect of reharvesting only records that have changed to CSW Harvesting shall be optimised in respect of reharvesting only records that have changed
  • Milestone changed from ckan-v1.4-sprint-6 to ckan-v1.5

comment:12 Changed 3 years ago by thejimmyg

  • Milestone changed from ckan-v1.5 to ckan-backlog

Isn't this already completed? Putting in the backlog but I think it is already implemented. Adria, could you please update accordingly?

Note: See TracTickets for help on using tickets.