Ticket #101 (closed enhancement: fixed)

Opened 5 years ago

Last modified 4 years ago

(Improved) Download support

Reported by: rgrp Owned by: rgrp
Priority: critical Milestone:
Component: dpm Keywords:
Cc: Repository:
Theme:

Description

  1. Given a url download from that url to disk
  2. Given a package use download url to download to disk

Once on disk should uncompress (if necessary).

Details

  • Should download either to tmp directory (defaulted in config) or a specified path on disk
  • In download would like to support as many types of target urls as possible:
    1. Single files (usually compressed filesets but could be individual files)
    2. Index pages listing files to download
    3. Revision control repositories
    4. ...

This will obviously be a significant amount of work. Suggest:

  1. Start off just supporting the first option.
  2. Have something like a plugin system to handle new target types
  3. Reuse existing work (e.g. easy_install and pip handle standard vcs such as svn, hg, git etc)

Cost: 1d

Change History

comment:1 Changed 4 years ago by rgrp

  • Status changed from new to closed
  • Resolution set to fixed

Marking as fixed as Item 1 and item 2 have now been done (at least partially), using urlgrabber. However no "distribution" support (we just assume all downloads are "payloads" and get metadata from ckan). See cset:ae89cbc898c7/datapkg cset:8448f862c588/datapkg cset:df22cd0f92a1/datapkg etc.

Note: See TracTickets for help on using tickets.