Ticket #852 (assigned enhancement) — at Version 5

Opened 3 years ago

Last modified 3 years ago

Dataset upload and archiving (master ticket)

Reported by: wwaites Owned by: wwaites
Priority: critical Milestone: ckan-v1.5
Component: DGU Keywords:
Cc: Repository: ckan
Theme: none

Description (last modified by pudo) (diff)

3 (4) use cases: (With and without access to auth keys.)

  1. upload form on ckan (by default local system has auth key for storage)
  2. datapkg upload (client) (by default without key) (plumbing done)
  3. background job archiving downloads (by queue client)

Most important are:

  1. Upload form on ckan.net (with access to keys)
  2. API for getting credentials for upload from ckan.net api (without access to keys).

Aside: Once 2 was done we could deprecate storage.ckan.net

Sub-tickets

Required infrastructure

  • #826 - Resource 'extra' fields
  • #358 - Resources in REST API
  • #235 - Resource format normalization and detection

User upload via Web UI

  • #877 - File upload in WUI
  • #878 - Integrate file upload with workflow around package resources

User upload via CLI/datapkg

  • #853 - plumbing for credential-less rest upload
  • #879 - Storage auth API

Also related:

  • #405 - Interactive retrieval of package resources

Automated archiving using worker process

More Info

Change History

comment:1 Changed 3 years ago by wwaites

  • Description modified (diff)

comment:2 Changed 3 years ago by wwaites

  • Status changed from new to assigned

plugin documentation: ​http://packages.python.org/ckan/plugins.html

comment:3 Changed 3 years ago by rgrp

  • Priority changed from major to critical
  • Type changed from defect to enhancement
  • Description modified (diff)

comment:4 Changed 3 years ago by pudo

  • Description modified (diff)

comment:5 Changed 3 years ago by pudo

  • Description modified (diff)
  • Summary changed from Dataset upload feature (master ticket) to Dataset upload and archiving (master ticket)
Note: See TracTickets for help on using tickets.