Ticket #852 (closed enhancement: fixed)

Opened 3 years ago

Last modified 3 years ago

[super] Dataset upload and archiving

Reported by: wwaites Owned by: rgrp
Priority: critical Milestone: ckan-v1.5
Component: DGU Keywords:
Cc: Repository: ckan
Theme: none

Description (last modified by rgrp) (diff)

3 (4) use cases: (With and without access to auth keys.)

  1. upload form on ckan (by default local system has auth key for storage)
  2. datapkg upload (client) (by default without key) (plumbing done)
  3. background job archiving downloads (by queue client)

Most important are:

  1. Upload form on ckan.net (with access to keys)
  2. API for getting credentials for upload from ckan.net api (without access to keys).

Aside: Once 2 was done we could deprecate storage.ckan.net

Sub-tickets

Required infrastructure

  • #826 - Resource 'extra' fields
  • #358 - Resources in REST API
  • #235 - Resource format normalization and detection

User upload via Web UI

  • #877 - File upload in WUI
  • #878 - Integrate file upload with workflow around package resources

User upload via CLI/datapkg

  • #853 - plumbing for credential-less rest upload
  • #879 - Storage auth API

Also related:

  • #405 - Retrieval options for package resources

More Info

Change History

comment:1 Changed 3 years ago by wwaites

  • Description modified (diff)

comment:2 Changed 3 years ago by wwaites

  • Status changed from new to assigned

plugin documentation: ​http://packages.python.org/ckan/plugins.html

comment:3 Changed 3 years ago by rgrp

  • Priority changed from major to critical
  • Type changed from defect to enhancement
  • Description modified (diff)

comment:4 Changed 3 years ago by pudo

  • Description modified (diff)

comment:5 Changed 3 years ago by pudo

  • Description modified (diff)
  • Summary changed from Dataset upload feature (master ticket) to Dataset upload and archiving (master ticket)

comment:6 Changed 3 years ago by pudo

  • Description modified (diff)

comment:7 Changed 3 years ago by rgrp

  • Milestone changed from ckan-v1.3-sprint-1 to ckan-v1.3

Removing from sprint and moving to release as a master ticket.

comment:8 Changed 3 years ago by shevski

  • Repository set to ckan
  • Theme set to none
  • Summary changed from Dataset upload and archiving (master ticket) to [super] Dataset upload and archiving

comment:9 Changed 3 years ago by rgrp

  • Owner changed from wwaites to rgrp

comment:10 Changed 3 years ago by rgrp

  • Status changed from assigned to closed
  • Resolution set to fixed
  • Description modified (diff)

Moved dataset archiving into new ticket #1327 and this is therefore now done.

Note: See TracTickets for help on using tickets.