CKAN: Ticket Query

#1309: Registering new user requires immediate login

zephod — Mon, 05 Sep 2011 12:25:10 GMT

Registering a new user directs you to that user's profile page but does not log you in. There is an empty set of "Recent changes" and no ability to modify the page. Users must follow the login link in the top-right corner to continue.

Registering a new user should immediately log you in.

#787: Auth API

thejimmyg — Mon, 08 Nov 2010 10:10:35 GMT

Auth Proposal

Use case: We'd like an authenticated and authorized Drupal user to be able to edit/delete packages using the API

To do this a user would need a CKAN API key so we need some way of Drupal telling CKAN who a user is so that they can get their API key.

Proposed Implementation

A user visits the CKAN API key page to get their key. Because CKAN is at catalogue.data.gov.uk (a subdomain of the Drupal site) it can read Drupal cookies.

If there is no DRXtrArgs or DRXtrArgs2 cookie, we know the user isn't signed in so we redirect them to Drupal to sign in.

WISHLIST: It would be really nice if we could pass the URL to redirect back to Drupal so tha Druapl can send them back to the CKAN API key page

Either way, they get back to CKAN and now the cookies exist. When the first HTTP request header is sent, CKAN will read the Drupal session ID and then call a Drupal API, server to server.

TODO: Implement an API on the drupal server which accepts a Drupal session ID as an argument and returns the username and credentials, but only if the request if from the CKAN server (perhaps we specify an API key in the request)

If the session is valid CKAN will set its own auth cookie and show them the page with the API key. CKAN only considers a user signed in if both the CKAN cookie *and* Drupal session ID are present. If at any time they sign out of Drupal the Drupal session disappears so they will be signed out of CKAN too.

Now the user has an API key they can use the standard CKAN command line API tools.

The API key is the only thing the user will need to use the CKAN API. This poses a problem. What if a user is removed from Drupal but still has a CKAN API key?

Two solutions:

API keys will be set to only be valid for the length of a Drupal session so that a user will only be able to use the write API for a little time after credentials are revoked

CKAN provides an API to allow Drupal to revoke keys

Option 1. seems easier to me. If we choose this we will write a get_api_key command line tool so that Drupal user can write things like this:

datapkg list_packages --api_key get_api_key

The get_api_key function will prompt for username and password and then perform the steps necessary to get an API key.

#878: Integrate file upload with workflow around package resources

rgrp — Mon, 20 Dec 2010 18:04:29 GMT

Create/edit a package -> add a resource -> Oh, i haven't uploaded yet, 'upload here' -> /upload -> standard upload form

Do we need to create a resource out of the file after upload? Do we sync file metadata with local Resource metadata?

If yes suggests (need to ticket):

'ResourceExtras?' for extra metadata on resources
Makes 'Resource' into first class object (and make available in WUI)?

Depends

#877 (Upload in WUI) - should be part of that extension

#1108: Create a more modern theme for CKAN

pudo — Tue, 26 Apr 2011 15:13:10 GMT

CKAN looks a bit aged, it should be styled more modernly and some elements could be re-arranged:

Collect user info in top bar
re-add the logo to ckan.net
Remove tags from main menu, replace with /sitemap.xml

Inpiration:

quora.com, github.com, Google Projects, Google Refine, etc.

CKAN.net or CKAN general theme?

To be decided. Suggest we start with ckan.net specific and then backwards integrate (?). Existing ckan.net theme repo:

https://bitbucket.org/okfn/ckan-ckan.net

#1276: Apply weighting to search fields in solr

johnglover — Mon, 15 Aug 2011 13:19:13 GMT

For example:

name and title should have a higher weight than the notes field

#1277: Use solr query parser for search instead of ckan query parser

johnglover — Mon, 15 Aug 2011 13:20:46 GMT

See http://ckan.okfnpad.org/search for details/discussion

#1291: Add activity and activity detail tables.

kindly — Thu, 25 Aug 2011 10:19:32 GMT

Add tables described in http://ckan.okfnpad.org/notifications

#1293: Rename Package to Dataset throughout WUI, API

rgrp — Sat, 27 Aug 2011 00:41:40 GMT

Changes

All templates
[DONE] Routing: /package/ -> /dataset/ (including API)
[DONE] Tests: self.app.get('/dataset/...') rather than package ...
- One test to check redirect works?
Docs

Leave

Stay with Package in code e.g. stay with 'PackageController?'
- also leave stuff like pkg = .... (gradual migration)
Leave extensions

Notes

Package -> Dataset
Data Package -> Dataset
respect capitalization

#1295: Simplify package create form

rgrp — Sat, 27 Aug 2011 00:46:54 GMT

Sub ticket of #1294

Initial screen just title, name, description (notes), license (and tags?).
State that you can add data and more information on next screen. This takes you to Package 'view' where you can then do more stuff.
- Flash some instructions? e.g. that resources are missing?
Name slug should by default look uneditable (cf wordpress way to do the slug)

#1296: Improved resource adding/editing on dataset/page page

rgrp — Sat, 27 Aug 2011 00:48:13 GMT

Subticket of #1294.

Nice way to edit all resource attributes
Nice way to add new resources
- Including file upload (cf #878).
  - Cf work in ckanjs (this can be a straight integration).

#1297: In-place preview of edited description markdown on edit dataset form

rgrp — Sat, 27 Aug 2011 00:49:43 GMT

Subticket of #1294.

Can integrate from working system on ckanjs.

#1301: Give access to extensions from the old formalchemy controllers

amercader — Thu, 01 Sep 2011 13:14:48 GMT

This was removed during the auth refactoring, but it's needed in the old controllers

#1303: User can not login again if he has edited his profile

amercader — Thu, 01 Sep 2011 15:04:32 GMT

Only happens if the user does not update the password. Most probably introduced during #1229.

#1304: Show more descriptive error messages when sending emails

amercader — Thu, 01 Sep 2011 16:06:46 GMT

Sending emails is failing in some cases, and the error message just says 'Could not send reset link'.

#1307: Implement captcha for signup

rgrp — Sun, 04 Sep 2011 16:31:00 GMT

Major issue with spam signup on thedatahub.org
Suggest using recaptcha

Est cost: 1d

#1310: API GET of a revision that has been approved causes exception

dread — Mon, 05 Sep 2011 15:01:39 GMT

e.g. this particular revision on ckan.net: http://ckan.net/api/rest/revision/9601fbcb-03a7-4ebc-981d-5aa16df4852c (most others have not been approved) Causes 500 error.

#1324: Add extra fields to resource table

kindly — Fri, 09 Sep 2011 14:36:16 GMT

add extra fields to resource as outlined in

http://wiki.ckan.net/Domain_Model/Resource

Specifically (all unicode strings except for those noted):

name: a name for this resource (could be used in a ckan url)
type: the type of the resource. One of: file | api | service | listing
mimetype: standard mimetype (e.g. for zipped csv would be application/zip)
mimetype_inner: mimetype of innermost object (so for example would be text/csv)
size: [integer] size of the resource (content length) in bytes. Usually only relevant for resources of type file.
last_modified: [datetime] the date when this resource's data was last modified (NB: not the date when the metadata was modified).
cache_url: url for cache of object in ckan storage
cache_last_updated: [datetime] timestamp when cached version was created
webstore_url:
webstore_last_updated: [datetime] timestamp when webstore was last updated

#1325: python 2.5 incompatibilities

dread — Fri, 09 Sep 2011 15:00:52 GMT

We claim to support Python 2.5 (useful for Lenny), yet a few problems have crept in:

'with' statement requires from __future__ import with_statement
import json from ckan.lib.helpers, rather than directly, since it copes with reverting to simplejson, used in python 2.5.