,rgrp
1077,Move to simpler vdm system,ckan,,ckan-backlog,enhancement,kindly,new,2011-04-08T23:14:24Z,2012-06-18T15:45:45Z,"== Option 1: 'Changeset' Model ==
See ticket:1135 for vdm ticket. This would involve a) moving to changeset in vdm b) doing the migration in ckan to support this.
Have developed a new ""changeset"" based model for revisioning in vdm.
=== Implementation ===
* The main challenge with this change is schema and data migration
Every revisioned object has a revision_id and revision attribute.
Approximate algorithm:
{{{
Revision -> Changeset
for revtype in [PackageRevision, ...]:
for pkgrev in package_revision:
changeset = lookupchangeset(package_revision)
ChangeObject(cset, (table, id), dictize(pkgrev))
}}}
Question:
* does pkg include tags attributes or not? or we have to dictize, pkgrev, pkg2tagrev, and tag. Probably the latter.
== Option 2: Simplify Revision Object Model ==
Just use a simpler vdm, see ticket:1136 (move to !SessionExtension) and ticket:1137 (remove need for statefulness in vdm).
== Discussion ==
Advantage of Option 1 versus 2:
* Easier support for pending state and similar behaviour
* No need to introduce new tables (and hence migrations) when making something revisioned (or not).
=== Disadvantages ===
* Migration is required
* More difficult to query revision history.
* Could be addressed by having !ChangeObject have separate cols for table name and id but would likely be more difficult.
* Performance (?)
* Have one big !ChangeObject table to query when looking at changed objects rather than many revision tables.
* Not sure this is a biggie as even with Revision model biggest revision object tables are probably on the order of the !ChangeObject table
== Conclusion ==
Implement Option 2 and leave Option 1 for present.
Option 1 includes Option 2 so it seems that that is required in either case (so we may as well with Option 2).
Option 1 requires significant effort (esp migration) so leave for present and then review the situation at some later date.",rgrp
3001,Multilingual plugin crashes CKAN on add dataset when some languages are default,ckan,,ckan 2.0,defect,,new,2012-10-18T16:50:48Z,2012-10-18T16:50:48Z,"Enable the multilingual plugins:
ckan.plugins = stats synchronous_search multilingual_dataset multilingual_group multilingual_tag
and set your default language to one not supported by the multilingual plugin, e.g.
ckan.locale_default = cs_CZ
now run CKAN and try to add a dataset:
File '/home/seanh/Projects/ckan171/ckan/ckanext/multilingual/plugin.py', line 141 in before_index
text_field_items['text_' + default_lang].extend(all_terms)
KeyError: 'text_cs_CZ'
It doesn't matter what language you are viewing the site in in your browser, the default language setting in the ini file determines whether it crashed or not.
A number of supported languages are defined at the top of ckanext/multilingual/plugin.py. I think if the default language is not one of these it crashes.
I think this affects all versions of CKAN since the multilingual plugin was added so at least 1.7, 1.8 and 2.0",seanh
2763,Multilingual tests failing,ckan,,ckan-v1.8.1,defect,,new,2012-07-26T11:56:59Z,2012-10-15T12:24:24Z,"test_multilingual_plugin.TestDatasetTermTranslation.test_dataset_index_translation, test_multilingual_plugin.TestDatasetTermTranslation.test_group_read_translation both failing for me on master",seanh
1287,NAVL validation errors - Junk fields should be listed explicitly,ckan,,ckan-backlog,enhancement,thejimmyg,assigned,2011-08-24T16:25:02Z,2012-03-05T23:34:19Z,"When you create a package, but specify a key that is not allowed (e.g. 'relationships') then you get error message:
{{{
{""__junk"": [""The input field __junk was not expected.""]}
}}}
It should mention the actual key which is not expected. e.g.
{{{
{""relationships"": [""The input field 'relationships' was not expected.""]}
}}}
Kindly said that James' version of NAVL was better in this respect, so this might be best solved by moving to that.",dread
2796,Need a datahub one-pager,ckan,,,enhancement,mark.wainwright,new,2012-08-02T16:28:36Z,2012-08-16T15:04:55Z,"A one-pager explaining what the datahub is and with howto/examples for new users. This would make it much easier to explain the value in using the datahub for storing data.
",ross
2830,Need method to undelete groups,ckan,,demo phase 4,enhancement,toby,new,2012-08-09T10:50:08Z,2012-08-09T21:22:21Z,need controller action and front-end method,toby
1466,Need to support https login for multiple instances as part of the CKAN package install,ckan,,ckan-backlog,enhancement,,new,2011-11-15T16:52:58Z,2012-02-06T11:51:02Z,,thejimmyg
2948,Negative range breaks datastore backend,ckan,,,enhancement,,new,2012-10-01T14:30:54Z,2012-10-01T14:31:05Z,Recline allows negative ranges. The backend returns an error 500 for that which breaks the recline preview.,dominik
2957,New datastore on postgres prior to 9.0,ckan,,,task,,new,2012-10-03T19:23:34Z,2012-10-03T19:23:34Z,The ``GRANT SELECT ON ALL`` and ``ALTER DEFAULT PRIVILEGES`` are not available in Postgres prior to version 9.0. ,dominik
2732,New file upload functionality,ckan,,ckan-backlog,enhancement,,assigned,2012-07-23T15:53:09Z,2012-09-03T09:07:50Z,"We should simplify upload and storage of files, initially only to local storage with archiver eventually being fixed to archive data externally. WIP pad is http://ckan.okfnpad.org/uploads
'''Simplifying uploads'''
Currently uploads are too painful/difficult/fiddly to use and/or configure. We want to simplify uploads so that they are done directly to the CKAN server, without support for remote services (S3 etc) and/or the dependencies it introduces.
We want to fix:
* File uploads themselves
* Storage of uploaded files
* Notification of the upload to other components
'''File uploads'''
Things file upload should do:
* Allow sysadmin to disable
* Allow auth'ed users to upload
* Store whatever they send on disk, and store DB entry linking the file to the person
* When creating the resource, the user should be able to choose from all of the files
they have uploaded but not yet associated with a resource. This will allow for bulk
upload and then a delayed association. Whenver a user creates a resource they
either upload a file now, or see previously uploaded files.
{{{
Can we do the upload asynchronously and then associate the
uploaded key with the resource before the save ? What happens
if the user tries to submit before asymc upload finishes ? Should
we delay them?
}}}
The upload workflow should look like...
1. File upload should be a straightforward file upload with normal auth checks and normal processing of the posted data.
2.
a. When called via ajax then the ID of the newly created file should be returned,
b. When called via WUI then it should also be given the url to redirect to after the file upload has been handled - the id will be passed as a query param.
3. The resource save should check whether it has a file id and in that case updates the file object to point to the resource.
This should enable:
* Separate file upload into a user's temporary store, either individually or as a batch.
* Creating resources and simply choosing from previously uploaded, unassigned files
* Adding files/data to a resource after the fact.
'''File storage'''
File storage should be local to the CKAN install, and not a remote service. Any archiving to remove storage providers should be outside of the main request.
File storage should:
* allow moving data, a sysadmin should be able to move the storage root and change configuration and have the system continue running (i.e. don't store absolute paths).
* provide maintainability, it should be easy to determine which old files are not associated with resources and thus can be cleaned up.
* allow for collection of information (i.e. estimate of storate space used)
* check whether there is enough space and handling the conequences cleanly
* ensure files to be written only underneath its own root folder, checks should be made after any path generation that the file begins with the location of the file storage.
* Have a configurable maximum accepted blob size during upload.
* Should store what meta-data was provided with the upload, such as mimetype.
Somewhere in the DB we should store ...
||'''Column'''||'''Notes'''||
||id||An identifier||
||owner||The owning user, who uploaded the file||
||path||The path (from the 'storage root') to the file||
||size||The size in bytes of the file on disk||
||mimetype||The mimetype of the file, as provided by the uploader||
||upload_date||When the data was uploaded||
||resource||The ID of the resource it belongs to. A unidirectional relationship.||
||archived_url||The URL where this file has been archived||
Generating paths should try and separate the files, perhaps based on username of the owner, or some other mechanism to avoid a single folder full of files.
'''Notifications'''
We need to make sure that it is possible to notify other components within the system that an upload has taken place, or at least make it easy for them to be notified. The primary use case for this is to notify the component that will translate/upload certain formats to the data store.
We could do this based on the post-upload update to the file model (i.e. when we record the total received size of the file).
",ross
3023,New methods on IPackageController to provide access to the data_dict,ckan,,,enhancement,amercader,new,2012-11-22T17:00:57Z,2012-11-22T17:00:57Z,Extension hooking into the edit and create methods of the IPackageController interface receive the package object. This may not include all the fields that came from the form. The new extension points will pass the validated data_dict so extensions can have access to it,amercader
3003,New pg databases should be created with UTF8 encoding rather than system default,ckan,,ckan-v1.8,enhancement,,new,2012-10-19T09:33:19Z,2012-10-19T09:33:19Z,"Just to track @tauberer patch on Github.
Probably going to 1.8.1",amercader
3017,New stable branch for the demo server,ckan,,ckan 2.0,enhancement,johnglover,new,2012-11-13T15:04:48Z,2012-11-13T15:04:48Z,,johnglover
2531,New state option: archived / deprecated,ckan,,ckan-backlog,enhancement,,new,2012-06-15T08:59:47Z,2012-06-15T14:30:49Z,"Deleted means things will get purged at some point.
Archived means they stay around but get hidden from search results and a big warning notice gets displayed saying this is archived / deprecated.
@richard cyganiak ...",rgrp
140,News section on front page,ckan,,ckan-backlog,enhancement,,new,2009-10-07T08:02:21Z,2010-02-08T10:32:39Z,"Have a news section (suggest as a sidebar item).
News section will link to latest 3/4 blog posts on CKAN from blog.okfn.org.
Details:
* Suggest pulling via rss or similar.
* Will want to cache this ...
Cost: 4h?",rgrp
2857,no UI to follow another user although option on dashboard,ckan,,demo phase 4,defect,toby,new,2012-08-15T16:59:43Z,2012-08-16T08:51:37Z,"e.g. second option in left hand sidebar is follow another user' http://s031.okserver.org:2375/user/dashboard but if you click on that and then any user, there's no follow button
to me the dashboard user stuff is highly unfinished and probably should not be included unless someone is very keen for it",shevski
2854,no way to see which dataset an app is related to on /apps page,ckan,,demo phase 5,enhancement,,new,2012-08-15T16:38:48Z,2012-08-15T16:38:48Z,e.g. from http://s031.okserver.org:2375/apps?page=1 you cannot edit a related item as an admin or view what dataset the item is related to,shevski
2863,non-admin users can edit other's draft datasets,ckan,,demo phase 4,defect,toby,new,2012-08-16T10:54:39Z,2012-08-17T11:05:02Z,edit button shows up for daniel lewis for http://s031.okserver.org:2375/dataset/ff ,shevski
2635,Non-destructive SOLR reindex,ckan,,,enhancement,,new,2012-07-09T10:23:14Z,2012-07-09T10:23:14Z,"You can't run the search-index reindex on a live server because it will give us bad results for 2 to 3 hours while it runs. Can there be an option that doesn't delete the entire index at the start?
Instead it could just delete any items that don't exist any more, then delete them and regenerate them one by one. So the total number of datasets doesn't change much.",dread
2483,Non-local resources should not have Download links,ckan,,ckan-v1.9,enhancement,,new,2012-05-31T12:52:14Z,2012-06-15T14:37:23Z,"At present, a resource which is just a URL link to an external resource has a 'Download' button on the resource page. This gives the misleading impression that the resource is stored locally.
This is related to another small UI issue: I think the URL of a resource should be much more prominent, not buried in the 'Additional Information' table.
Suggested fix:
* Put the URL prominently at the top of the resource page (above the preview) (and make it link to the resource)
* Disable the Download button unless the resource is stored locally.
",markw
2768,normalise excel to xls,ckan,,demo phase 5,enhancement,toby,new,2012-07-26T16:16:22Z,2012-08-07T15:01:03Z,so that data proxy works,shevski
2416,Normalise resource/data types,ckan,,demo phase 5,enhancement,toby,accepted,2012-05-23T17:09:06Z,2012-07-18T13:23:22Z,"Currently we have far too many types that are essentially the same format. The new demo theme is using icons for common types. So we need to normalise the common formats into pretty strings. e.g. application/json, JSON, .json and json all should be output as “json”
See the following Basecamp thread for UI examples and discussion.
https://okfn.basecamphq.com/projects/9558659-demo-ckan-front-end/posts/61906351/comments#comment_179681056",aron.carroll
1244,Notes field carriage-returns converted to CRLF,ckan,,,enhancement,,assigned,2011-07-26T14:10:56Z,2012-06-20T11:20:53Z,"When you edit a package in the web form, if the notes field had {{{\n}}} as the End Of Line symbol, it gets lost when you preview or save the package, and the notes field is displayed all on one line.
This can be seen when editing annakarenina (as created by 'paster create-test-data'). The diff shows for example:
{{{
- Some test notes
+ Some test notes
? +
}}}
but it would more clearly be shown as:
{{{
- Some test notes\n
+ Some test notes
? ++
}}}
This is a significant problem with DGU, since a lot comes in via the API.
It's not clear what we should do about it. We could standardise on \n or \r\n when the form submission comes in. Do different browsers on different platforms do different things with EOLs?
== Analysis ==
Displaying the package: the Markdown processor respects both EOLs when displaying the field, putting each line in a tag.
Creating the package edit form: placed into .
Browser displaying package edit form: displays \n and \r\n as EOL. But \n\n gets compressed to one EOL. But on submission, both are returned as \r\n.
Receiving the edited package: Somewhere along the line the EOL gets converted to \n\n.
",dread
2548,Object ownership for groups/package,ckan,,datahub-july,enhancement,kindly,assigned,2012-06-18T11:02:11Z,2012-06-26T10:28:59Z,"
== Requirements ==
We need to be able to easily determine who the owner of a dataset or group is. Datasets and Groups should have an Owner, who may change over time but is a specific user within the CKAN instance. It should be easy for CKAN components to determine the user and for the initial version we should ignore the can of worms labelled 'ownership transfer'.
At this point migration is likely to be the biggest issue, and would suggest that it is acceptable that the last user to edit a dataset be set as the current owner.
More tickets should arise as a result of this work where we may be able to optimise some queries to use the new feature.
== Interface ==
None
== User Stories ==
None
== Tasks ==
[ ] Analysis/Clarification
[ ] Tests
[ ] Migration
[ ] Code/Schema changes
[ ] Documentation
== Estimates ==
",ross
2547,ODS Initial data sets,ckan,,opendatasuite 2,enhancement,shevski,assigned,2012-06-18T10:55:06Z,2012-06-26T10:13:34Z,"
== Requirements ==
The ODS demo site will need data adding, initially as fixtures but it would also be useful if we started evaluating datasets that we can ship with ODS installations (at least in the UK) from places such as DGU and ONS.
May wish to create a ticket for making sure the datasets within the system are reset every X hours. Perhaps.
== Interface ==
None
== User Stories ==
* As a new system administrator for an ODS instance, I don't want to have a site devoid of any data. Geographically relevant datasets would be welcomed.
* As a bizdev person I would like to be able to demonstrate how ODS works with real datasets.
== Tasks ==
[ ] Identify relevant sources for datasets
[ ] Pick datasets
[ ] Set them up for import
== Estimates ==
",ross
2546,ODS Managing homepage content,ckan,,ckan-backlog,requirement,,assigned,2012-06-18T10:54:02Z,2012-09-03T09:10:37Z,"
== Requirements ==
Require the ability for users to control some level of content that is visible on the home page of their ODS installation. This may be through RSS/Atom feeds (see #2234) or another mechanism but should result in admins being able to change blocks of text on their homepage.
This should not be configuration, but accessible through WUI.
== Interface ==
None
== User Stories ==
* As a system administrator I want to have control over content displayed on the front page beyond featured/popular items.
* As a system administrator I don't want to manage content through having to write an extension.
== Tasks ==
[ ] Analysis
== Estimates ==
",ross
2619,Omit private datasets from public activity streams,ckan,,ckan-v1.9,enhancement,seanh,assigned,2012-06-28T11:49:00Z,2012-10-29T17:18:57Z,"Activities about private datasets should not appear in public activity streams.
I don't think you want to actually purge the activities from the db, because you might still want them to appear in private activity streams.
I do think that when a dataset goes private all its past activity should go private, because I imagine that users are going to want to hide everything about the dataset and not have any past activities 'leaking out'
I don't think you want to consider whether the dataset was private when the activity happened, rather if a dataset is private now then all its past activities are private (and the simplest thing would be to say that if a dataset is public now then all its past activities become public as well, but is that a privacy concern?)
The easiest way to implement this is going to be by modifying the *_activity_list() action functions in get.py, after they pull their activity lists out of the db they should pass them through a function that filters out stuff about private datasets.
An activity about a private dataset is one whose object_type is 'dataset' and whose object_id matches the id of a private dataset. You should also check the object_type and object_id of all of the activity object's activity detail objects, if any of those match a private dataset then mark the whole activity as private.
Currently all activity streams are public so should have all private datasets filtered out from them, except for the dashboard activity stream which is private to the individual user. In this case private datasets that the user has permission to see should not be filtered.",seanh
1424,Openness notice should be clearer,ckan,,ckan-backlog,enhancement,,new,2011-10-26T16:54:49Z,2011-10-26T16:54:49Z,"ckan-discuss discussion suggests changes to the 'openness' indicator
( http://lists.okfn.org/pipermail/ckan-discuss/2011-October/001786.html )
Dataset view page:
* If there is an explicit but non-OKD compliant license, such as CC-BY-NC, then this should be stated explicitly, perhaps: “This dataset is Not Open. License: Creative Commons Attribution Noncommerical. This is not an open license as it does not meet the Open Knowledge Definition.”
* If the license is marked as “Other::License Not Specified”, then this should be stated explicitly, perhaps:
“This dataset is Not Open. It is published without an explicit license, the publisher reserves all rights to the dataset.”
* 3. If the license field was left empty by the contributor of the Data Hub record, then again this should be stated explicitly, perhaps: “This dataset is Not Open. The license of this dataset is unknown or unspecified. Start an enquiry on IsItOpenData »
* There is a bug so that non-open licenses doesn't have an openness notice.
* If downloadable resources are not available, this should not affect 'openness' - check this has been removed.",dread
1644,Order default dataset page by most downloaded resources on thedatahub,ckan,,ckan-backlog,enhancement,,new,2012-01-12T18:39:02Z,2012-01-12T18:39:02Z,"Instead of alphabetically as we do currently, alternatively by most viewed datasets
for http://thedatahub.org/dataset",shevski
2917,Organization admins can delete themselves,ckan,,ckan 2.0,enhancement,johnmartin,new,2012-09-12T12:10:43Z,2012-09-12T13:13:56Z,Organization administrators can delete themselves from the user management pages. We should disable this on the front-end as well as the back-end.,ross
2970,Organization and group member links use id not name,ckan,,ckan 2.0,defect,,new,2012-10-15T10:22:11Z,2012-10-15T10:22:11Z,e.g. it the 'Members' button links to /organization/members/0a44... instead of /organization/members/foobar,seanh
2967,Organization members edit page reloads after demoting self,ckan,,ckan 2.0,defect,,new,2012-10-15T10:17:07Z,2012-10-15T10:17:07Z,"Edit an organizations members page and demote yourself from organization admin, after saving the members edit page reloads even though you are no longer an admin and should no longer be able to access this page.",seanh
2846,Organizations allows you to set an organization as the parent organization of itself,ckan,,ckan-v1.8.1,defect,,new,2012-08-13T12:22:16Z,2012-10-15T12:24:04Z,that doesn't make any sense,seanh
2939,Orgs are groups,ckan,,,enhancement,toby,new,2012-09-25T09:07:14Z,2012-09-25T09:07:14Z,holder for ticket number,toby
301,Package discussion pages,ckan,,,enhancement,,assigned,2010-04-26T16:57:13Z,2012-06-25T13:47:35Z,"A package discussion page is like a wikipedia discussion page: an editable free text page for people to have discussion/post comments about a given package.
It provides a way for people to make suggestions about a package without needing access to main package.",rgrp
812,Package edit form only allows three extra fields,ckan,,ckan-backlog,defect,,new,2010-11-17T11:56:50Z,2011-07-20T15:48:37Z,"= Rationale =
The package edit form is restricted to three extra fields. To enter more than three fields, one has to save the package and hit edit again (or hit preview).
= Implementation =
A mechanism similar to the one for resources (where you can add lines as you go) would solve this. So, have a button that adds more extra field rows via JS. (Extra fields don't need up/down buttons that the Resource table has)
Nice to have: a blank field is added when you tab from the last filled-in field in the table.",cygri
1288,Package edit/creation can't include 'relationships' field,ckan,,ckan-backlog,defect,,new,2011-08-24T16:34:55Z,2012-06-15T15:28:18Z,"When you create or edit a package (via the API), you aren't able to specify the relationships it has. (If you do you get 409 {{{ {""__junk"": [""The input field __junk was not expected.""]} }}})
The normal way to create relationships is via /api/rest/relationships/ and this works. But when you GET a package, the dictionary lists all relationship details. So this bug creates a problem for editing a package that has relationships - you want to GET it, make any edits and then PUT it back. The work-around is to delete the 'relationships' key from the dict before you PUT it back.
== Options ==
Ideally, CKAN would read the 'relationships' key and make the necessary changes. This is a chunk of work.
Another good option is to allow an unchanged 'relationships' value, but barf it is edited. This is also a chunk of work.
A bad option would be to just ignore the 'relationships' value, since users will get frustrated changing this value and wonder why it never saves, not understanding it is different to all the rest, without error message.
A final option is to get rid of relationships altogether.",dread
1355,Package extras property does not include the newly created ones,ckan,,ckan-backlog,defect,,new,2011-09-26T10:48:46Z,2012-06-15T15:27:36Z,"The extras in the package object sent to the extensions after editing (https://bitbucket.org/okfn/ckan/src/01efd5649c10/ckan/logic/action/update.py#cl-226) do not include the newly added.
",amercader
253,Package relationships,ckan,,ckan-backlog,enhancement,,assigned,2010-02-22T16:05:21Z,2012-06-15T15:38:46Z,"= Overview =
Functionality to formally associate packages. We see a need for specific parent-child, inheriting or dependency relations. Not only should this help navigation between packages in the web interface, but it also provides a mechanism to automatically pull dependencies when downloading a data package, in a similar manner as we see in software package management.
= Examples =
1. There are 27 packages in data.gov.uk to do with the Data4NR's Health Poverty Index. There is currently no common link between these, unless you search for 'HPI' (which also brings up House Price Index), or look under tag 'health' (which also has 600 other results). There should be a link on each HPI package page to navigate to the other 'sibling' HPI packages, and to a 'root' package that has info about the set. This could be partially achieved using the existing tag or group concepts, but a more explicit/official/obvious marking of their relationship could be beneficial.
2. In ckan.net is freedict, a collection of translation dictionaries. You could make each dictionary a child package and use this system. But it would probably be better to make each dictionary a different resource in the same package. (There are other ideas to denote a resource as the data making up a 'portion' of package, or a 'whole' of the package, to help people downloading datasets in the software package style.)
3. OSM has had some Naptan data imported (bus stops), with special permission - i.e. a more liberal license. It would be useful to show this link on both OSM and Naptan packages in CKAN: OSM 'derives from' Naptan with a comment about the license change. I'm not sure this is useful to an automatic download or use of these datasets, but may aid exploration on the CKAN website and understanding the provenance of the bus stop data on it.
4. IPCC collection of data linked / mirrored. Not sure if there are useful relationships here?
5. Dracos gets postbox locations from crowd sourcing and OSM. We could say Dracos 'derives from' OSM.
See more examples discussed here: http://trac.ckan.org/ticket/253
= Implementation =
This is split into four tickets:
* Model: ticket:254
* Read in WUI: ticket:255
* Edit in WUI: ticket:256
* API: ticket:257
No need for write access to be provided API for the moment.
This ticket also encompasses ticket:169 (Package derivations) and ticket:176 (Package dependencies).",dread
256,Package relationships - 3. Edit in WUI,ckan,,ckan-backlog,requirement,,assigned,2010-02-23T12:36:01Z,2012-06-15T15:38:34Z,"WUI:
* Editable as part of package or separately? (e.g. like authz)
* Do we normalize to only one type name of the pair?
* Do we allow create of relationship from both ends (e.g. only from dependency to dependent or either way?)
",dread
2573,package_search does not allow solr's per-field facet parameters,ckan,,ckan-future,enhancement,,new,2012-06-19T13:27:19Z,2012-06-25T14:05:01Z,"Solr allows its facet parameters to be specified on a per-field basis, eg. `facet.limit` applies to ''all'' facet fields, but solr allows it to be overriden for a specific field, eg. `facet.tags.limit`.
We don't support this at the moment because we have a whitelist of valid solr query parameters that we accept. See `ckan.lib.search.query.VALID_SOLR_PARAMETERS`.",icmurray
285,Paginate list of packages on tag read page,ckan,,,enhancement,,assigned,2010-04-07T18:23:26Z,2012-06-25T13:45:23Z,"Is this worth doing? On hmg.ckan.net start to have a lot of packages with a given tag ...
",rgrp
1317,password reset - improve user search,ckan,,ckan-backlog,defect,,assigned,2011-09-07T17:12:19Z,2012-06-20T11:20:21Z,"In password reset, it gets confused if you have two similar users. This is because with the string the user provides, it searches several fields, not just name but also fullname and email address, allowing you to search for these. But only name is unique.
Specific problem:
Ira searches for ""Irina"" then it finds both:
{{{}}}
(I think)
Maybe need to choose which field it searches?",dread
2745,Password reset returns an exception if the key parameter is missing,ckan,,ckan-v1.9,defect,,new,2012-07-24T16:05:31Z,2012-07-24T16:05:31Z,"Instead of showing a notice, the password reset page throws an exception if the key parameter is missing:
{{{
Module ckan.controllers.user:329 in perform_reset
c.reset_key = request.params.get('key')
if not mailer.verify_reset_link(user_obj, c.reset_key):
h.flash_error(_('Invalid reset key. Please try again.'))
abort(403)
if not mailer.verify_reset_link(user_obj, c.reset_key):
Module ckan.lib.mailer:100 in verify_reset_link
if not user.reset_key or len(user.reset_key) < 5:
return False
return key.strip() == user.reset_key
return key.strip() == user.reset_key
AttributeError: 'NoneType' object has no attribute 'strip'
}}}
Apart from the obvious fix of checking for the 'key' parameter, it seems like is quite common to get these reset urls without the key parameter, so I suspect some email clients might strip the query params when building the links. We could avoid this problem by making the key part of the url instead of a param:
http://thedatahub.org/en/user/reset/3086e91c-fe09-4a98-92e1-19de67a9ac9d/b4c2d03fa8
instead of:
http://thedatahub.org/en/user/reset/3086e91c-fe09-4a98-92e1-19de67a9ac9d?key=b4c2d03fa8
",amercader
2951,Paster command for building css from less,ckan,,ckan 2.0,enhancement,,new,2012-10-01T19:12:20Z,2012-10-02T10:50:30Z,"With the latest template, css and js changes in 2.0, there are a number of things that need preparation prior to a production deployment. One of these is:
- the less files should be compiled to css (main.css, not just main.debug.css)
This ticket is to provide a paster command which will compile the .less into the main.css file. The idea of the paster command is that it will be run by developers, and they will check in the resulting .css files. It will also provide a convenient mechanism for production scenarios with node.js installed on the production server, as they will be able to compile the .less there as well.
## Background
The .css files that need to be served are built using `less`. The css files that are generated *are* checked-in to the repo; but they are a build artifact. So the general workflow is:
- commit changes to the less files
- build the main.css file and commit
This paster command slots into the above workflow for convenience.
## Notes
- doc/frontend-development.rst
- bin/less
to run this paster command, `Node` will be required. So that dependency should be checked.
## The paster command
This is the proposed behaviour of the paster command:
- ensure `custom.less` does not exist
- for each colour in{fuchsia,green,maroon,red}:
- generate a `custom.less` file for $colour. There's a paster command that does this already: `paster color .
- generate the `css` from the `less` files. ie - the equivelant of running `bin/less --production`.
- this will generate a `main.css` file, which should be renamed to `$color.css`.
- ensure `custom.less` does not exist
- generate the `css` from the `less` files. This will create a `main.css` with the default colour scheme.
- call the paster command that minifies css and js files. (This command does not exist yet, see #2950)",icmurray
2395,paster db clean/init don't work when spatial extension enabled,ckan,,ckan-backlog,defect,,new,2012-05-16T09:16:33Z,2012-06-15T14:41:53Z,"If you have a spatial enabled database then if you don't disable the spatial extension in the CKAN config temporarily then you get errors when you run paster db clean and paster db init.
Can't you just modify the clean and init functions to run without extensions enabled?
The wider problem is that extensions do their own inits every time you do load_environment, which seems crazy and inefficient to me, since this occurs every time a request comes into CKAN. But that is another problem/ticket.",dread
2945,Pdf preview does not load in IE,ckan,,,enhancement,,new,2012-10-01T11:27:49Z,2012-10-01T11:27:49Z,The pdf preview does not load in IE 9.,dominik
3010,Pin images don't appear in data explorer,ckan,,ckan 2.0,enhancement,,new,2012-10-31T17:45:06Z,2012-10-31T17:45:06Z,"When minified files are in use (set debug = false in ini file) the pin images for points don't show up in the data explorer map view when viewing a resource with geolocation data.
set debug = true will fix the problem by using unminified files instead but also turns on a bunch of debug stuff you wouldn't want on a production site.
middleware.py, around line 73, is where the decision to turn minified files on or off based on the debug setting is made. This can be hacked on a production site to run with unminified files but otherwise run on production mode thereby getting around the issue with the pins. But that doesn't fix the underlying bug.",seanh
1535,Plump for auth header of: X-CKAN-API-KEY,ckan,,ckan-backlog,enhancement,,new,2011-12-07T17:31:22Z,2012-06-15T15:26:59Z,"When using the API, the apikey needs to be supplied in a header called 'Authorization'. Because some proxys / deployments use this header for other things, a configurable header was provided as an alternative, with default ""X-CKAN-API-KEY"".
Rufus suggests having *one* way for this.
a) making this not configurable any more
b) making X-CKAN-API-KEY the default
(keep Authorization allowed, but not documented, for backwards compatibility)",dread
2976,Polish group and organization member pages,ckan,,ckan 2.0,enhancement,,new,2012-10-15T10:41:49Z,2012-10-15T10:41:49Z,"From Toby: A little polish to the member pages and probably a little hardening of
the controller and logic actions",seanh
2995,"Popovers for resources, groups, organizations, tags...",ckan,,ckan 2.0,enhancement,,new,2012-10-17T14:27:21Z,2012-10-17T14:27:21Z,"If you hover the mouse over a dataset or user in an activity stream, you now get a popover with some info about that dataset or user and a follow/unfollow button.
It would be nice to add similar popovers for other types of object in CKAN, e.g. resources, groups, organizations, tags...",seanh
2766,prevent draft datasets making it to activity stream,ckan,,demo phase 4,enhancement,seanh,assigned,2012-07-26T16:06:35Z,2012-08-09T20:13:13Z,"The new ckan creates datasets as part of a 3 phase process. To allow for this partially created datasets can have a state that is 'draft' or 'draft-complete'. These datasets should not be seen as active by the activity stream.
If we click 'add dataset' and then complete the first phase of adding a dataset then we end up having a activity stream created. When we add a resource in the next phase (add data) again an activity stream item xxx added resource to dataset is created
We do not want these adding. Essentially if a dataset has a state.startswith('draft') then we want the activity stream to ignore all actions involving it.
finally when the state is changed form state.startswith('draft') to state=='active' we want a xxx has created dataset ... to be added to the stream.
The best way to do this would be to branch from 2375-demo-theme-stable and get it to work there.
Let me know if you need any help with this ticket or a better explanation of the problem.",shevski
2851,Preview of PDF tries to connect to datastore,ckan,,,enhancement,,new,2012-08-15T12:12:46Z,2012-08-15T12:12:46Z,"e.g. http://datahub.io/dataset/ccc-gistemp/resource/80ebdbd6-d91b-4fef-9db4-d3dfbd7e868e
CKAN attempts to render the PDF as a datastore tabular date even though the mimetype of the PDF is correctly specified.",ross
2961,Preview plugin endpoint,ckan,,ckan 2.0,enhancement,dominik,assigned,2012-10-08T11:39:27Z,2012-10-18T16:33:10Z,"Users could write ckan extensions that offer previews for a certain datatype.
Advantages:
- We can say that you can add your own previews
- Every preview would have to define it's own dependencies
- External development (community creates new extensions?)
Questions to answer:
- Specification of the interface
- Precedence of previews for the same data types
- Plugins only define the datatype that they are responsible for or do we call a function that returns whether the extension is responsible.
As far as I can see, this should be fairly easy to implement by following these instructions: http://docs.ckan.org/en/latest/writing-extensions.html#writing-a-plugin-interface",dominik
2960,Private datasets are not private,ckan,,ckan-backlog,task,,new,2012-10-08T11:04:15Z,2012-10-08T11:04:15Z,At the moment everyone can read all resources. There is no support for hiding resources that are in private datasets.,dominik
1429,Provide DOIs for datasets in a CKAN instance,ckan,,ckan-backlog,enhancement,rgrp,new,2011-10-30T12:21:45Z,2011-10-30T12:21:45Z,"DOI = digital object identifier = http://www.doi.org/
As a Publisher I want a DOI for my dataset so that it can be cited by and linked to by others in a standard and easy way.
== Details ==
* Probably implement as extension rather than core",rgrp
2590,Publisher dashboard,ckan,,ckan-backlog,enhancement,shevski,assigned,2012-06-25T10:03:37Z,2012-09-03T09:10:16Z,"Need proper user stories but ...
Publisher admins/editors may need a more useful group read page showing things like:
* The current search
* Recent activity
* People within the group
* Followers
* Others?
",ross
1198,Publisher hierarchy,ckan,,ckan-backlog,enhancement,,new,2011-06-23T09:16:32Z,2012-06-15T15:30:00Z,"'Publisher' entities in the model. They are hierarchical.
'User-Publisher' connections with one or more roles (e.g. drafter, moderator).
Authorization settings can control who can set what values in a 'published by' type field.
Publishers and User-Publishers available to read in the API.
Future tickets will provide:
* API to write Publishers and User-Publishers
* UI to edit Publishers and User-Publishers
(This feature deprecates authorization groups)",dread
1558,Publisher Tools,ckan,,ckan-future,enhancement,David Raznik,new,2011-12-19T10:46:13Z,2011-12-19T10:46:13Z,Summarise final set of requirements for this and finish development and test. Estimated 10 working days. ,jilly mathews
1589,QA - Give 5 star rating to datasets with link metadata,ckan,,ckan-backlog,enhancement,johnglover,new,2011-12-21T15:16:40Z,2012-01-02T03:31:35Z,"Super: #1594
From Richard Cyganiak on the CKAN Discuss list:
Regarding the fifth star (is the dataset linked to others?). This cannot be automatically determined just by looking at the format. It either requires inspection of the actual data, or information about links in the metadata. As you're probably aware, we've established conventions for recording information on data links in CKAN [1], as part of the work of the lodcloud group on the Data Hub. Link information is captured for hundreds of datasets. I would claim that we have the majority of four-star datasets covered there, and hence you can determine if they should get the fifth star by checking for the presence of a links:xxx field.",johnglover
1588,QA - Give SPARQL endpoints a 4 star rating,ckan,,ckan-backlog,enhancement,johnglover,new,2011-12-21T15:13:25Z,2012-01-02T03:32:58Z,"Super: #1594
From Richard Cyganiak on the CKAN Discuss list:
Besides considering the media type of resources, it would also make sense to check for the presence of a SPARQL endpoint. SPARQL endpoints are recorded for more than 300 datasets on the Data Hub using the pseudo-type ""api/sparql"". A few more are recorded with the format ""SPARQL"". I suggest that datasets with such resources should also be considered for the fourth star.",johnglover
2895,QA pages (e.g. broken resource links) are not paginated,ckan,,,enhancement,,new,2012-08-28T17:38:05Z,2012-08-28T17:38:05Z,And as a result timeout on e.g. the datahub ...,rgrp
1584,QA report improvements - 2.5d,ckan,,ckan-backlog,enhancement,johnglover,new,2011-12-21T09:23:53Z,2012-06-06T11:26:15Z,"Super: #1594
* qa/{username}
* qa/{groupname}
* paginate QA results
* search / filter QA results
* ~~list organisation report by default, but can disable via config option~~ (done)
* UX tidy up of report pages - hide border if no sidebar, etc",johnglover
250,RDF link in Atom feed,ckan,,ckan-v1.9,enhancement,icmurray,assigned,2010-02-18T15:41:35Z,2012-06-25T13:37:10Z,Add link to RDF representation of a package in our Atom feed.,dread
1406,Re-enable RSS subscriptions,ckan,,ckan-backlog,enhancement,,new,2011-10-17T14:22:07Z,2011-11-10T13:01:28Z,"RSS 'subscribe' buttons appeared in many places on the site but were not very helpful. They took (confused) users pointed to the raw feed code, and Google Reader could not understand the feed. Safari, however, could interpret it correctly.
Their presentation needs to be clear and consistent; the RSS feed really needs testing in a variety of readers; and we need to decide exactly which items should get a feed. (Package updates? Groups?)",zephod
765,Read-only mode - API usage,ckan,,ckan-backlog,enhancement,,assigned,2010-10-26T11:18:17Z,2012-05-28T11:55:23Z,"All writes to the API are captured and you are returned an error explaining the reason.
Possible errors:
* 503 temporary maintenance
* 403 forbidden (if server if permanently read-only)",dread
763,Read-only mode - Setup,ckan,,ckan-future,enhancement,,assigned,2010-10-26T11:11:46Z,2012-05-28T11:56:44Z,"Admin configures entering read-only mode in one of two places:
* CKAN config file (e.g. ckan.ini)
* environment variable from Apache config
Once enabled, no writes can occur to the database (including user ratings and other usage stats).",dread
3011,Recline fixes and updates for CKAN 2.0,ckan,,ckan 2.0,enhancement,johnglover,new,2012-11-07T11:40:55Z,2012-11-07T11:40:55Z,Fixes and updates to Recline / Datapreview for CKAN 2.0.,johnglover
2944,Recline preview does not work in Opera,ckan,,,enhancement,,new,2012-10-01T11:26:42Z,2012-10-01T11:26:42Z,Opera cannot show a recline preview. I shows 0 records.,dominik
2947,Redirect to the resource page from /resource/{res-id},ckan,,,enhancement,,new,2012-10-01T13:15:25Z,2012-10-01T13:15:25Z,"Use story:
As a user of the datasore I want to be able to put the resource id without the dataset name in a url and see the resource page.
Proposed redirect:
/resource/{res-id} -> dataset/foo-bar/resource/{res-id}",dominik
2427,Reduce cruft installed into CKAN's virtualenv due to Pylons,ckan,,ckan-v1.9,enhancement,kindly,new,2012-05-25T11:48:27Z,2012-07-02T22:32:03Z,,seanh
2949,Reenable Data API button on the new theme,ckan,,,defect,amercader,new,2012-10-01T16:04:24Z,2012-10-01T16:04:24Z,The checks to show or not the button need to be updated for the latest datastore version,amercader
1815,Reenable Sparql endpoint on publicdata.eu,pdeu,,ckan-future,task,amercader,new,2012-02-20T17:08:43Z,2012-05-28T11:30:41Z,"Estimate: ?
The 4store Sparql endpoint has been down for a long time.
It needs to be reenabled and we need to check that the necessary informtion is pushed when creating /editing a dataset.",amercader
1278,Refactor authorized_query calls,ckan,,ckan-backlog,enhancement,,new,2011-08-15T13:32:57Z,2011-08-15T13:32:57Z,"There are some functions that still use the Auhtorizer().authorized_query method:
{{{
./ckan/controllers/authorization_group.py:24: query = ckan.authz.Authorizer().authorized_query(c.user, model.AuthorizationGroup)
./ckan/lib/base.py:237: groups = ckan.authz.Authorizer.authorized_query(c.user, model.Group,
./ckan/lib/search/sql.py:55: q = authz.Authorizer().authorized_query(username, model.Group)
./ckan/lib/search/sql.py:118: q = authz.Authorizer().authorized_query(self.options.get('username'), model.Package)
./ckan/logic/action/get.py:154: query = Authorizer().authorized_query(user, model.Group, model.Action.EDIT)
./ckan/tests/test_authz.py:158: q = self.authorizer.authorized_query(self.notadmin.name, model.Package)
./ckan/tests/test_authz.py:353: q = self.authorizer.authorized_query(self.notmember.name, model.Package)
./ckan/tests/test_authz.py:357: q = self.authorizer.authorized_query(self.member.name, model.Package)
./ckan/tests/functional/test_authorization_group.py:44: group_count = Authorizer.authorized_query(u'russianfan', model.AuthorizationGroup).count()
}}}",amercader
1596,Refactor authz roles,ckan,,ckan-future,enhancement,,new,2011-12-22T10:31:28Z,2012-05-28T11:36:59Z,"Suggestions from rgrp:
* Get rid of Roles, and replace them with direct assignment of actions, even though there are many actions, and extensions can add arbitrary ones.
* Debatable whether we should cut the number of actions to correspond to the three roles defined by the base system.
* Have a method of finding roles (or, in future, actions) relevant to a given protection object (e.g. FILE-UPLOAD(ER) not relevant to Packages)
(This ticket is split off from #1065)",dread
2915,Refactor form_to_db_schema_options(),ckan,,ckan 2.0,refactor,,new,2012-09-12T10:37:49Z,2012-09-12T10:59:48Z,"Having two methods form_to_db_schema(self) and form_to_db_schema_options(self, options) seems unnecessary, why not just have form_to_db_schema(self, options=None)?
Fixing this might break existing extensions although I don't think any are using form_to_db_schema_options() so it should be okay.
The same thing goes for db_to_form_schema_options().
Also why are we passing a dict 'options' that always contains the same three keys 'api', 'context' and 'type'? Why not three params api=None, contenxt=None, type=None?",seanh
1403,Refactor groups index page,ckan,,ckan-backlog,enhancement,zephod,new,2011-10-17T10:31:52Z,2011-10-17T10:32:46Z,"Groups are listed alphabetically with paging - not an ideal user experience. We would like to list groups in order of 'popularity': The number of datasets they contain.
Following this chain of thought, then, it would be nice to rearrange the groups table by clicking on column headers and having it sort by that column.
Furthermore, then, we'd like to implement a full-fledged groups search feature (if this is at all feasible).
The forthcoming groups refactor will probably have some bearing on this task.
",zephod
2983,Refactor lib/base.py to remove circular import issues,ckan,,ckan 2.0,refactor,,new,2012-10-15T10:47:24Z,2012-10-15T10:47:24Z,"From Toby: c) refactor lib/base.py to remove the circular import issues (render
functions to lib/render.py - would fix much of that)
",seanh
2310,Refactor the search-query construction in feeds.py,ckan,,ckan-backlog,enhancement,icmurray,new,2012-04-16T16:01:31Z,2012-05-16T09:09:46Z,"The feeds controller, used to construct atom feeds, duplicates code found in the package controller's search action (in order to construct the custom feed).
Refactor this to remove duplication.",icmurray
1598,Reinstate Ratings,ckan,,ckan-backlog,enhancement,,new,2011-12-29T16:52:04Z,2012-01-02T03:26:58Z,"Ratings were disabled approximately a year ago because:
* Unclear purpose and UX. What did ratings tell you? How useful were they?
* Spamming (esp by bots: you could submit an anonymous rating via a GET request which caused problems)
Both problems are solvable and it would be nice to have this feature reinstated.
* Purpose: can make this more purposable by limiting to logged in users (or at least distinguishing logged in from non-logged in users)
* Even better we could allow ratings to be made public (I'm interested in what someone else I respect finds important)
* Spamming: limit to logged in users and / or use AJAX over an API to submit ...",rgrp
1684,Remove all config from ckanext-archiver,ckan,,ckan-backlog,enhancement,,assigned,2012-01-19T14:37:01Z,2012-09-03T11:00:37Z,"ckanext-archiver currently has a settings file (and a default) and it should be passed in all relevant information from the context.
Remove all settings (ARCHIVE_DIR and MAX_CONTENT_LENGTH and others) and pass them in from CKAN.",ross
2987,Remove all direct calls to logic action and auth functions,ckan,,ckan 2.0,refactor,,new,2012-10-15T10:51:27Z,2012-10-15T10:51:27Z,From Toby,seanh
2972,Remove any imports of authz.py and delete file,ckan,,ckan 2.0,enhancement,,new,2012-10-15T10:37:22Z,2012-10-15T10:37:22Z,it is no longer used,seanh
2981,Remove config from jinja templates,ckan,,ckan 2.0,refactor,,new,2012-10-15T10:46:00Z,2012-10-15T10:46:00Z,"From Toby: remove the config from jinja2 templates get all such stuff via g. (before 2.0)
",seanh
2603,Remove deprecated 'fields' parameter from resource_search,ckan,,ckan-v1.9,refactor,icmurray,new,2012-06-26T17:10:01Z,2012-06-26T17:10:01Z,"The fields parameter of resource_search was deprecated when fixing #2438. It can be removed in release 1.9, and the action tidied up as a result.",icmurray
1260,Remove duplicate functions from _util.html,ckan,,ckan-backlog,enhancement,,new,2011-08-03T10:17:32Z,2011-08-15T09:44:59Z,"There seems to be both a list view for dictized and non dictized data structures for all entities in _util.html at the moment. Probably in the back of someone's mind already, but cleanup here would be nice. ",pudo
2919,Remove IController from docs,ckan,,ckan-v1.8,defect,,new,2012-09-12T14:47:33Z,2012-09-12T14:47:33Z,Still in docs but seems gone from code,seanh
2929,Remove is_fallback() from I*Form extension interfaces?,ckan,,ckan 2.0,enhancement,,new,2012-09-13T16:09:57Z,2012-09-13T16:09:57Z,"If a plugin wants to take over the default package type for example, it can return ['dataset'] from its package_types() method. I don't see how there can be a package type that is not the default 'package' and is not returned by the package_types() method of a plugin, because the URLs for such a package type would not be mapped. Am I missing something or is is_fallback() not needed?
Same for IGroupForm and IOrganizationForm",seanh
1137,Remove need for statefulness in vdm,vdm,,,enhancement,kindly,assigned,2011-05-12T14:47:08Z,2012-06-25T13:46:14Z,"Statefulness, especially statefulness for relation (esp m2m) is cause of most of the complexity in vdm. It is ''required'' because, atm, revision objects have FKs to continuity objects.
This ticket proposes the following changes:
NB: this could be limited just to case of join tables (leaving state stuff on other tables)
* Remove FKs from revision to continuity (or allow for them to be nullable).
* We could just limit this to m2m stuff
* Delete of an object leads to:
* Deletion of continuity object
* Adding an entry in revision table with state set to deleted (we retain state on revision table)
If this is done we will no longer need to worry about filtering on state on relationships as join table will only contain ""active"" relationships.
If we do this on all tables we remove need for any state awareness in client (e.g. no need to filter tables on active state).
The only disadvantage of this change is that undeletion becomes more problematic (we have to recreate some continuity objects).",rgrp
2881,Remove or improve 'Domain Model' docs page,ckan,,ckan-v1.8.1,defect,,new,2012-08-21T09:05:17Z,2012-08-22T09:00:56Z,"http://docs.ckan.org/en/ckan-1.8/domain-model.html
Currently not very useful. Also these pages:
http://docs.ckan.org/en/latest/domain-model-dataset.html
http://docs.ckan.org/en/latest/domain-model-resource.html
http://docs.ckan.org/en/latest/domain-model-task-status.html
This just seems very incomplete to me (surely there is more to the domain model the dataset, resource and task status?) and very likely to not get updated as changes are mode to the code. Would anyone seriously refer to this rather than just looking at the source code?
If we want to have something along these lines in the docs, I suggest adding docstrings to packages, modules, classes and methods and then using autodoc to pull them into sphinx.",seanh
1286,Remove remaining formalchemy stuff,ckan,,ckan-backlog,enhancement,,new,2011-08-23T16:29:56Z,2012-07-16T11:00:20Z,"Stuff I've spotted:
* forms/*
* template/group/edit_form.html
* template/package/edit_form.html
This can go once new DGU form is in.",rgrp
2621,Remove the deprecated 'fields' parameter from tag_search and tag_autocomplete,ckan,,ckan-v1.9,refactor,icmurray,new,2012-06-28T16:22:49Z,2012-06-28T16:22:49Z,"This was deprecated in 1.8 as it wasn't accessible via GET requests due to being a dict. See #2439
In a future release of CKAN (probably 1.9) it can be removed.
Internal uses of it were removed in #2439, but there are tests that still use it.",icmurray
2925,Remove trans mangle paster command?,ckan,,ckan 2.0,defect,,new,2012-09-13T10:06:08Z,2012-09-13T10:06:08Z,"- Is `trans mangle` really necessary? If you upload a pot file to
Transifex, it can generate a po file for you with 100% strings
translated into a fictional pseudo language where everything is really
long strings of unicode characters. I found this worked well for
coverage testing, and also tests handling of unicode and long strings
all over the place.",seanh
2882,Remove User Stories Overview from docs?,ckan,,ckan-v1.8.1,defect,,new,2012-08-21T09:18:43Z,2012-08-21T09:18:43Z,"Why is this here? Is it up to date? Is anyone keeping it up to date? Does this belong in some sort of CKAN planning or roadmap document rather than in the documentation?
http://docs.ckan.org/en/latest/user-stories.html",seanh
1785,Replace 'Revisions' page with site-wide activity stream,ckan,,ckan-v1.9,enhancement,seanh,accepted,2012-02-07T16:34:18Z,2012-06-26T15:25:12Z,Replace the /revision page with a /activity page showing a site-wide activity stream of all activities in the site. Or perhaps the site-wide activity stream can go somewhere on the front page of the site instead?,seanh
1778,Replace classmethod's with module-level functions,ckan,,ckan-future,enhancement,seanh,assigned,2012-02-06T15:53:34Z,2012-06-25T11:29:03Z,"In many places we have @classmethods where simple module-level functions would do (and would be more idiomatic in Python), e.g. the {{{get()}}} classmethods in the model/ classes.
Doing it with module functions lets us type module.function() instead of module.Class.method().
In many cases we're importing classes directly with {{{from module import Class}}} and then doing {{{Class.method()}}}, but {{{from module import foo}}} is bad style: http://docs.python.org/dev/howto/doanddont.html",seanh
2301,Replace old-style string formatting with format() method (at least in strings marked for translation),ckan,,ckan-future,enhancement,seanh,new,2012-04-16T12:27:44Z,2012-06-25T14:50:12Z,"Some strings in CKAN are passed to gettext with more than one %s in them, this is no good as translators may need to change the order of substituted words.
Strings should not use the old style % substitution, they should use the new format method in Python 2.6+, e.g.:
'This {food} is {adjective}.'.format(food='spam', adjective='absolutely horrible')
http://docs.python.org/release/2.6.8/tutorial/inputoutput.html#fancier-output-formatting
We should probably only change strings that are marked for translation and that contain multiple %s, don't want to make too much work or cause too many strings to change and need to be re-translated.",seanh
1668,repoze version discrepency,ckan,,ckan-backlog,defect,,new,2012-01-17T12:02:26Z,2012-01-17T12:02:26Z,"There's a discrepency in repoze.who versions between the source and package installs:
* repoze.who - package 1.0.18 vs source 1.0.19
* repoze.who-friendlyform - package 1.0b3 vs source 1.0.8
We get a test failure [1] with the 1.0b3 version (from the ubuntu 10.04 python-repoze.who-plugins package). But we've not noticed any problems on s057 instances (br, no, ie etc) which have the package versions of repoze.who.
The reason the package install uses the earlier packaged versions rather than the ones we'd like is that repoze uses all sorts of horrendous import hacks, making it too difficult to put into our 'ckan-conflict' source package.
James suggests we 'do something horrible like dynamically patch repoze on CKAN import'.
[1] http://buildbot.okfn.org/builders/builder-ckan/builds/1371/steps/shell/logs/stdio
ERROR: ckan.tests.functional.test_user.TestUserController.test_user_create_unicode",dread
2979,Requesting membership to groups and organizations,ckan,,ckan 2.0,enhancement,,new,2012-10-15T10:44:04Z,2012-10-15T10:44:04Z,"From Toby: The requesting membership user stories and implementation remain needed
",seanh
2554,Research Virtuoso cartridges,ckan,,ckan-backlog,enhancement,,assigned,2012-06-18T13:37:25Z,2012-09-03T11:07:13Z,"Look into writing a cartridge for importing CKAN data into a Virtuoso quadstore
http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtSponger#How Does It Work?",ross
2823,resource additional info title order,ckan,,demo phase 5,enhancement,toby,new,2012-08-09T09:32:53Z,2012-08-09T09:32:53Z,"Order the items so that none user fields are first from ticket #2707
",toby
2822,Resource additional info titles format/i18n,ckan,,demo phase 4,enhancement,toby,new,2012-08-09T09:30:20Z,2012-08-09T20:26:25Z,"the title for additional info should be translated
capitalised etc",toby
235,Resource format normalization and detection,ckan,,ckan-v1.9,enhancement,tobes,assigned,2010-01-18T15:13:24Z,2012-06-25T12:33:44Z,"Try to gather proper MIME information for all package resources in CKAN. This is a shared ticket with dcat-tools (https://bitbucket.org/pudo/dcat-tools), i.e. opendatasearch.org. This can then also be used by ckanrdf, the CKAN RDF conversion service.
Sub-tasks:
* Create a Google Spreadsheet with two Worksheets: ""MIME-Mappings"", i.e. ""CSV"" -> ""text/csv"" and ""Name mappings"", i.e. ""text/csv"" -> ""Comma-Separated Spreadsheet"".
* Collect and map surface forms from all CKANs
* Access this via Swiss and apply, store as a PackageResource extra field pending #826 (Resource extras).
* Add heuristics for format auto-detections:
* Map well-known file extensions
* Recognize obvious magic (Zip, Tar)
* Peek into Zipfile/Tarfiles
* Define a convention for generic data types (many CKAN packages have only ""Spreadsheet"" defined, either detect specific type or set MIME to */tabular-data or similar)
* See also: #816 (Autocomplete for the resource format field)",dread
2247,Resource preview glitch in some browsers,ckan,,ckan-backlog,enhancement,,new,2012-03-20T12:30:14Z,2012-03-20T12:30:14Z,"From Ira:
Preview for google spreadsheets are not displaying correctly for me in Firefox v.10.0.02, fine in Chrome.
http://i.imgur.com/KJaqz.png",zephod
2896,resource_create crashes on ValidationErrors with KeyError: 'resources',ckan,,ckan-v1.8.1,defect,,new,2012-08-29T16:29:14Z,2012-08-29T16:29:14Z,"ckan/logic/action/create.py:resource_create():
try:
pkg_dict = _get_action('package_update')(context, pkg_dict)
except ValidationError, e:
errors = e.error_dict['resources'][-1]
raise ValidationError(errors)
This assumes that package_update always returns an error dict with 'resources' in it. This assumption doesn't hold.",seanh
818,Rethinking the author and maintainer fields,ckan,,ckan-backlog,requirement,,new,2010-11-17T14:18:44Z,2012-06-15T15:37:01Z,"The semantics of the Author and Maintainer fields are really unclear at the moment. This leads to very inconsistent usage. Also, perhaps Name and Email are not the only fields that are needed for a contact.
Here is a table that shows the current usage of these fields in CKAN:
http://richard.cyganiak.de/2010/ckan/ckan-ppl.html
We note several problems:
* Author and Maintainer are often the same
* Author and Maintainer are often used interchangeably
* People really want to specify URLs for the contacts and stick them into random places because there is no field for it
* Multiple comma-separated names in a single field
I'm not sure what to do about this, but a redesign is necessary in my opinion.
Some ideas:
* Remove the maintainer field?
* Make really clear that Author doesn't refer to the metadata on CKAN, but to the original data
* Add an “author URL” field?",cygri
84,Revert support on versioned objects,vdm,,ckan-future,enhancement,kindly,assigned,2009-07-23T08:59:03Z,2012-06-25T12:13:05Z,"Basic revert in the classic wiki form is already support by purging a Revision. However may wish to support:
1. Cases where multiple objects changed in a revision but only want to revert 1 (low priority)
2. Want to revert but have reversion as a new revision of that object.
Seems low priority at present.
Cost: ?",rgrp
2862,Revised revised groups description,ckan,,demo phase 4,enhancement,toby,new,2012-08-16T10:52:02Z,2012-08-16T11:04:32Z,"Revised text for 'What are groups?' box at demo.ckan.org/group (after discussion with IB re #2812):
What are groups?
Groups allow you to group users and data together so that they are easier to manage. Group owners can assign roles and authorisations, giving each project or department control of its own data publishing.
Users can browse or facet by groups, which could be an organisation (for example, the Department of Health) or topic (e.g. Transport, Health), making it easier to find the data they are looking for.",markw
2928,Run CKAN tests with example_i*form extensions enabled,ckan,,ckan 2.0,enhancement,,new,2012-09-13T16:05:34Z,2012-09-13T16:05:34Z,"Before releasing CKAN 2.0 we need to run all the CKAN tests with a modified test-core.ini with the example_idatasetform, example_igroupform and example_iorganizationform plugins enabled. If any tests fail, fix the bugs. This needs to be done for each release so add it to the release process.",seanh
2962,Search across multiple ckan instances,ckan,,ckan-backlog,enhancement,,new,2012-10-08T22:50:22Z,2012-10-08T22:50:22Z,"Could be done by:
- using the solr distributed search
- difficult set up
- merging result sets from apis
- make sure that results can be merged properly (score, facets, ...)",dominik
924,Search box has no search button,ckan,,ckan-backlog,enhancement,,new,2011-01-24T11:12:13Z,2011-12-06T11:20:36Z,"The search box at the top-right of CKAN's page doesn't have a 'go' button. I feel that a larger percentage of users expect a 'go' or 'search' button on the right-hand side of the box to press to start searching. Techies tend to know the keyboard shortcut of pressing 'carriage-return' but it might be better to follow standard practise on this.
Examples with 'search' button: Internet Explorer, Firefox, Google, Amazon, trac
Examples without: ?",dread
350,Search engine optimisation,ckan,,ckan-backlog,enhancement,,reopened,2010-06-15T09:35:41Z,2012-06-15T15:38:10Z,"Need to research what can easily be done to improve CKAN packages in the search rankings.
Comments from Glen Barnes:
We've been pretty successful at SEO without even really trying (see http://www.google.co.nz/search?client=safari&rls=en&q=auckland+google+transit+feed&ie=UTF-8&oe=UTF-8&redir_esc=&ei=dsYSTOzJLs2eceuZiI8I as an example). This to me is key. If we are to make data available it has to be findable which is the main reason for a catalogue. There are probably things we should be doing on CKAN like using slugged urls (http://www.ckan.net/package/ascoe -> http://www.ckan.net/package/ascoe/atmospheric-chemistry-studies-in-the-oceanic-environment), setting the H1 tag correctly (""Atmospheric Chemistry Studies in the Oceanic Environment"" on the example above). Some basic SEO 101 on page optimisations.
",dread
1366,Search inside extra fields,ckan,,ckan-future,defect,,assigned,2011-09-29T10:09:52Z,2012-05-28T12:05:07Z,"SOLR search doesn't support searching for part of an extra field, but it does for other fields.
i.e. title=""One Two Three"" matches q=one AND q=title:one
and geographic_coverage=""England Scotland"" matches q=England BUT NOT q=geographic_coverage:England
This problem emerged when we went to SOLR in #1275 (CKAN 1.5a). Tests were skipped.
This is could be a problem for DGU and maybe elsewhere.
",dread
2331,Search should AND terms not OR terms,ckan,,ckan-sprint-2012-05-29,defect,kindly,reopened,2012-04-28T18:24:45Z,2012-12-25T22:25:44Z,"Appears current default search in CKAN ORs terms rather than ANDing them (i.e. adding more terms increasing number of items found rather than reducing it).
Not sure when this crept in or if it has been there for a long time.",rgrp
2729,searching for tags:[tag] works but tag:[tag] doesn't,ckan,,ckan-backlog,enhancement,kindly,new,2012-07-22T09:58:29Z,2012-07-22T09:59:36Z,"which is confusing since you can only search for one tag like this at a time. I.e.
tags:economics,cvs or tags:economics, csv or tags:economics+CSV doesn't work for example; therefore tag:economics, should also work!
http://s031.okserver.org:2375/dataset?q=tags%3Aeconomics&sort=relevance+asc",shevski
1201,seperate out logic in atom feeds to logic layer.,ckan,,ckan-backlog,enhancement,,new,2011-06-24T15:21:32Z,2011-07-08T11:24:57Z,Simplify the logic in the atom feed an make all feeds use logic layer to return lists.,kindly
277,Set some config options / settings in WUI (extension),ckan,,ckan-backlog,enhancement,zephod,assigned,2010-03-22T16:21:01Z,2011-10-10T11:45:21Z,"== Use case ==
As a ckan administrator I want to easily change options about the CKAN install.
== Implementation ==
=== Settings to be in DB ===
Suggested:
{{{
## Title of site (using in several places including templates and tag
ckan.site_title = CKAN
## Logo image to use (replaces site_title string on front page if defined)
ckan.site_logo = http://assets.okfn.org/p/ckan/img/ckan_logo_box.png
## Site tagline / description (used on front page)
ckan.site_description =
## Used in creating some absolute urls (such as rss feeds, css files) and
## dump filenames
ckan.site_url =
## Favicon (default is the CKAN software favicon)
ckan.favicon = http://assets.okfn.org/p/ckan/img/ckan.ico
## An 'id' for the site (using, for example, when creating entries in a common search index)
## If not specified derived from the site_url
# ckan.site_id = ckan.net
## API url to use (e.g. in AJAX callbacks)
## Enable if the API is at a different domain
# ckan.api_url = http://www.ckan.net
## html content to be inserted just before