Custom Query (2152 matches)
Results (1261 - 1263 of 2152)
Ticket
|
Resolution
|
Summary
|
Owner
|
Reporter
|
#1397 |
fixed
|
[super] Resource archiving
|
kindly
|
rgrp
|
Reported by rgrp,
3 years ago.
|
Description |
We want to cache/archive data associated to a resource so it is available if the resource url disappears (and in order to support other processing we may wish to do e.g. webstorer ...)
Etherpad: http://ckan.okfnpad.org/queue (most relevant parts inlined here)
Preliminaries
- Add task_status table to store qa/archiever/webstore information that does not need to be versioned. - #1363 (and #1371 - related logic functions)
Configuration setup for daemons
Pass config through to workers i.e site_url, user, api_key.
Need to make site user account. #1408
celeryd config:
All providers of tasks will add an item to the following entry point:
[ckan.tasks]
name = ckanext.{name}.tasks:....
celeryconfig.py
from pkg_resources import iter_entry_points
for entry in iter_entry_points:
celeryimports.appen(....)
CELERY_IMPORTS = celeryimports
Work Items
- Resource change notifications in core - Make an IResourceChange and IResourceUrlChange. [1d] [0.75d] - #1383
- Generate archiving request on resource url change [0.25d][0.25d] - #1399
- Make site user account.
- Make entry point system for celery config
- Archiver daemon #891
- implement link-check function and task (point 2 from Archiver.update above) [1d] [0.5d]
- Rewrite archiver to use external storage. (decide how!)[3d][~2d]
- Write to resource and task status table.[1d][0.75d]
- [Required?] Make archived data available in WUI - #892
- Documentation - #1400
|
#1398 |
fixed
|
Automated conversion of resource data into webstore
|
kindly
|
rgrp
|
Reported by rgrp,
3 years ago.
|
Description |
- Possible sibling / requirement: #1397 (resource archiving)
- Setup test environment. 1d
- Make task to upload files to webstorer. 3d
- This includes writing back webstore_url and updated date. 0.5d
- Type guessing of file format. 1d
- Make cron to upload all un webstored resources. 0.5d
- Testing for errors by running cron 2d
- Make nice way to deploy celery 1d.
- Documentation. 1d
- Deployment. 1d
|
#1402 |
fixed
|
Migrate repository from mercurial to git
|
kindly
|
rgrp
|
Reported by rgrp,
3 years ago.
|
Description |
Plan to migrate from mercurial git
- Convert from mercurial to git
- Map named branches to normal branches
- Also, if possible map usernames for RP: rgrp <http://rufuspollock.org/> (mercurial) -> rgrp <rufus.pollock@…>
- Place at http://github.com/okfn/ckan (can delete current repo there as an out of date mirror)
Process:
- Do trial run
- Announce conversion date / time
- Require everyone to have pushed all outstanding changes at that time
- Do conversion
- Test
- Announce on list and ckan.org/
|
Note: See
TracQuery
for help on using queries.