CKAN: Ticket #191: Searching by modification date

repo, theme set

dread — Wed, 18 May 2011 15:24:45 GMT

repo set to ckan
theme set to none

Will's suggestion is to have "modified_since" param, just as we have for Revision Search.

Maybe we don't need a range. 'Order by modification' should be on by default for queries with 'modified_since' param.

priority changed

dread — Wed, 18 May 2011 15:26:54 GMT

priority changed from awaiting triage to critical

Do this after refactor #1129

status changed; owner deleted

dread — Wed, 18 May 2011 15:27:15 GMT

owner rgrp deleted
status changed from new to assigned

dread — Thu, 19 May 2011 14:21:40 GMT

Maybe allow searching by package creation date too?

Suggestion from kindly: when indexing a package, have the search backend also store the metadata_modified value, to make it easy to search on it.

milestone set

dread — Mon, 24 Oct 2011 09:22:14 GMT

milestone set to ckan-backlog

dread — Thu, 01 Dec 2011 18:02:47 GMT

So you can do this sort of search:

curl http://thedatahub.org/api/action/package_search -d '{"q": "groups:lodcloud", "sort": "metadata_modified asc"}'

but it doesn't work because solr doesn't store the metadata_modified field yet.

owner set

shevski — Tue, 06 Dec 2011 11:25:46 GMT

owner set to johnglover

priority, milestone changed; cc set

thejimmyg — Tue, 06 Dec 2011 11:38:34 GMT

cc amercader added
priority changed from critical to minor
milestone changed from ckan-backlog to current-ckan-sprint-2011-12-19

John will just check that the API version 3 does support modified after the new solr schema handled by Adria is in place.

status changed; resolution set

johnglover — Mon, 12 Dec 2011 16:10:10 GMT

status changed from assigned to closed
resolution set to fixed

working in current master and 1.5.1

status changed; resolution deleted

dread — Mon, 12 Dec 2011 16:54:04 GMT

status changed from closed to reopened
resolution fixed deleted

A test for this would be great, and maybe add as an example in the search docs too?

dread — Thu, 15 Dec 2011 17:26:51 GMT

Added a fix for the problems caused by the #1546 fix. SOLR indexing was excepting for new packages (tests such as ckan/tests/functional/api/model/test_package.py:TestPackagesUnversioned.test_entity_update_indexerror failed). The problem was (somehow) related to last_modified function using a new connection causing problems for the modified_metadata in finding the revision & package table entries created during the commit.

Changeset: [release-v1.5.1c 2c595ae] and cherry picked to [origin/defect-191-modification-date f98a4b2]

dread — Thu, 15 Dec 2011 18:18:36 GMT

I put the sort syntax example in the apiv3.rst table and moved the full curl example to http://wiki.ckan.org/Searching_CKAN

I added tests for metadata_modified and prepared this branch for closure.

Changeset: [origin/defect-191-modification-date bebf7a5]

John, please review and close/merge if you think it is all ok.

johnglover — Fri, 16 Dec 2011 10:21:15 GMT

Thanks for this David. This one in particular was causing me some grief: https://github.com/okfn/ckan/commit/f98a4b2a5f5013fa4aed475bd8b3237bb7847fcc Good spot. All looks good to me.

status changed; resolution set

johnglover — Mon, 19 Dec 2011 09:37:28 GMT

status changed from reopened to closed
resolution set to fixed

dread — Thu, 23 Feb 2012 18:11:17 GMT

Went into CKAN 1.6

dread — Thu, 23 Feb 2012 18:16:23 GMT

Replying to dread:

Went into CKAN 1.6

Sorry, I meant 1.5.1