Ticket #1609 (closed enhancement: fixed)

Opened 2 years ago

Last modified 2 years ago

Celery task for ckanext-archiver to write to webstore.

Reported by: ross Owned by: ross
Priority: awaiting triage Milestone: ckan-sprint-2012-01-23
Component: ckan Keywords: storage,archiver 5d
Cc: kindly Repository: ckan
Theme: none

Description (last modified by rgrp) (diff)

From super Storage changes - #1574 - and http://ckan.okfnpad.org/newstorage we determined that ckanext-archiver should have a celery task for grabbing local file uploads and writing to webstore

Analysis

When I upload a file to CKAN:

  • End up with file in permanent storage
  • IF file is ot type ... csv,xls,xlsx,sqlite,.sql
    • End up with new db in webstore
      • Where? {username}/{resource-id}/...
        • If a single table: name it after the file name (appropriately slugified)
      • A resource *always* corresponds to a 'database' in webstore ...
      • In Data Explorer have "Sheets" tab ...
  • Resource url = /dataset/{x}/resource/{y}/link -> cached_url ...

Change History

comment:1 Changed 2 years ago by ross

from the pad:

What happens when I upload a CSV?

  • End up with file in permanent storage
  • IF file is of type ... csv,xls,xlsx,sqlite,.sql
    • End up with new db in webstore
      • Where? {username}/{resource-id}/...
        • If a single table: name it after the file name (appropriately slugified)
      • A resource *always* corresponds to a 'database' in webstore ...
      • In Data Explorer have "Sheets" tab ...
  • Resource url = /dataset/{x}/resource/{y}/link -> cached_url ...
  • Move uploaded file into permanent storage

comment:2 Changed 2 years ago by rgrp

  • Description modified (diff)

comment:3 Changed 2 years ago by rgrp

  • Description modified (diff)

Move analysis into main body of ticket.

comment:4 Changed 2 years ago by kindly

  • Keywords 5d added
  • Milestone set to current-ckan-sprint-2012-01-23

comment:5 Changed 2 years ago by rgrp

Any comment on how this related to #1398 - Automated conversion of resource data into webstore.

They seem to be exact duplicate -- but obviously #1398 was done and this wasn't.

comment:6 Changed 2 years ago by ross

  • Status changed from new to closed
  • Resolution set to fixed
Note: See TracTickets for help on using tickets.