__group__ ticket summary component milestone type created _description_ _changetime _reporter 2686 enabling datastore & data API breaks recline ckan ckan-backlog defect 2012-07-17T09:06:51Z "First I noticed that the gold prices dataset preview was not displaying & has data API enabled Secondly I tried enabling datastore for http://datahub.io/dataset/adur_district_spending/resource/281dffa6-ea9b-4446-be41-05dced06591f and after I saved the preview no longer worked. Unticking the datastore & data api checkbox brought it back Is this a known issue?" 2012-09-03T09:08:20Z shevski 1832 dataset purge API ckan ckan-backlog enhancement 2012-02-24T10:02:25Z "Purging datasets (deleting them fully, not just changing the state to 'deleted') is important for users testing dataset creation over the API on a test CKAN instance. Without this, they need to resort to more difficult methods such as: * cleaning and reloading the database * setting the test datasets to state 'deleted' and also appending a suffix '_00' and incrementing the number until there is no clash of names. Requested for NHSIC. == Implementation == * This could slot into the Action API. * Of course we would need to ensure the user's had been given the specific right to purge. * I suggest we log the full details of the dataset being purged." 2012-06-15T15:21:46Z dread 1366 Search inside extra fields ckan ckan-future defect 2011-09-29T10:09:52Z "SOLR search doesn't support searching for part of an extra field, but it does for other fields. i.e. title=""One Two Three"" matches q=one AND q=title:one and geographic_coverage=""England Scotland"" matches q=England BUT NOT q=geographic_coverage:England This problem emerged when we went to SOLR in #1275 (CKAN 1.5a). Tests were skipped. This is could be a problem for DGU and maybe elsewhere. " 2012-05-28T12:05:07Z dread 1661 Wrong Routes version installed by CKAN package ckan ckan-backlog defect 2012-01-16T12:47:41Z "Jaakko Louhio reported that the wrong Routes version got installed during CKAN's package install. He is using Ubuntu 10.04 and he believes it install Routes 1.12.3 instead of what we use which is 1.11." 2012-06-15T15:25:49Z dread 1244 Notes field carriage-returns converted to CRLF ckan enhancement 2011-07-26T14:10:56Z "When you edit a package in the web form, if the notes field had {{{\n}}} as the End Of Line symbol, it gets lost when you preview or save the package, and the notes field is displayed all on one line. This can be seen when editing annakarenina (as created by 'paster create-test-data'). The diff shows for example: {{{ - Some test notes + Some test notes ? + }}} but it would more clearly be shown as: {{{ - Some test notes\n + Some test notes ? ++ }}} This is a significant problem with DGU, since a lot comes in via the API. It's not clear what we should do about it. We could standardise on \n or \r\n when the form submission comes in. Do different browsers on different platforms do different things with EOLs? == Analysis == Displaying the package: the Markdown processor respects both EOLs when displaying the field, putting each line in a

tag. Creating the package edit form: placed into . Browser displaying package edit form: displays \n and \r\n as EOL. But \n\n gets compressed to one EOL. But on submission, both are returned as \r\n. Receiving the edited package: Somewhere along the line the EOL gets converted to \n\n. " 2012-06-20T11:20:53Z dread 1322 Action API improvements ckan enhancement 2011-09-08T09:39:09Z "Focusing on improving Action API as the v3 API: * have an optional parameter of the data_dict called ""options"". Options would contain items that would get passed into the context. e.g. {{{{""options"" : {""ref_package_by"": ""id""}}. }}} * instead of using API version to change the way packages are referenced, use the ref_package_by. * All package_show, group_show etc. to accept an object 'name' as an alternative to object 'id'. * Action API is v3 of api, replacement for v1 & v2. Default for most urls is still v1, but if url is /api/action then default to v3. Next steps: * Add search API (package, resource, * Add Util API * Clarify JSONP still applies * Add doc strings, clarifying parameters" 2012-06-20T11:18:08Z dread 1460 Improve extensions documentation ckan enhancement 2011-11-12T16:15:23Z "Current extensions documentation needs some work: http://docs.ckan.org/en/latest/plugins.html * Queue extension section may now be out of date (?) * Think about how it integrates with https://github.com/okfn/ckanext-example (especially tutorial and example extension) * Document all plugin points (auto-extract from CKAN source??)" 2012-06-20T11:16:41Z rgrp 1489 Updating example theme/extension ckan ckan-backlog enhancement 2011-11-24T12:32:00Z "ckanext-example needs updating for CKAN 1.5: * theme changes * new forms About: 'ckanext-exampletheme' was created in Spring 2011 as an example CKAN extension that showed how to customise the look & operation of CKAN. This moved to github and renamed 'ckanext-example'. " 2011-12-19T10:59:44Z dread 256 Package relationships - 3. Edit in WUI ckan ckan-backlog requirement 2010-02-23T12:36:01Z "WUI: * Editable as part of package or separately? (e.g. like authz) * Do we normalize to only one type name of the pair? * Do we allow create of relationship from both ends (e.g. only from dependency to dependent or either way?) " 2012-06-15T15:38:34Z dread 1328 Unicode & paster commands ckan defect 2011-09-12T10:25:10Z "A possible bug in CKAN when I tried deleting users using ""paster --plugin=ckan user delete"" command. To reproduce the bug do the following: 1. Create a user with an ID (which in my case was a user's full name) that contains non-unicode caracters like Norwegian ""æ"", ""ø"", or ""å"". 2. Make sure that you can see something like the example below: (pyenv) rm@mycomputer:$ paster --plugin=ckan user Users: name=Rustæm 3. Then try deleting the user with following command: (pyenv) rm@mycomputer:$ paster --plugin=ckan user delete ""Rustæm"" You should now get a python encoding error. I know that this is quite rare case, but in our case it caused some trouble. Could you guys have a look at this bug? CKAN ver. 1.3.3." 2012-06-20T11:17:45Z minspamboks@… 1509 Mis-dated old revisions of datasets ckan defect 2011-12-05T13:06:38Z "e.g. http://thedatahub.org/dataset/osm%402011-07-12T12%3A16%3A47.590358 gives: {{{ This is the current revision of this dataset, as edited at 2011-07-12 12:16. }}} but it should say the date 2011-07-12 (which is the data being displayed). The problem is looking at PackageRevision, when it might be a tag or extra." 2012-06-20T11:13:34Z dread 763 Read-only mode - Setup ckan ckan-future enhancement 2010-10-26T11:11:46Z "Admin configures entering read-only mode in one of two places: * CKAN config file (e.g. ckan.ini) * environment variable from Apache config Once enabled, no writes can occur to the database (including user ratings and other usage stats)." 2012-05-28T11:56:44Z dread 948 Highlight (to a sysadmin) which packages are deleted ckan ckan-future enhancement 2011-02-02T11:32:49Z "When a customer logs in as a sysadmin then he/she see all packages, including deleted and pending ones. These are hidden to the average user, but the sysadmin has no idea of this until he clicks on the package and sees at the bottom 'state: deleted'. It should be more obvious than that on the search view - an icon, message or crossed-out name to packages are deleted." 2012-05-28T11:58:00Z dread 1285 Errors cause emails ckan ckan-future enhancement 2011-08-23T16:29:04Z "Currently a sysadmin gets an email when an exception is not caught. But there are occasions when we DO want to catch an exception so we can fail nicely for the user, but the sysadmin STILL gets an email to know to fix something. e.g. if there is an exception when search indexes a package. You want to catch the exception and still run any other notify calls. " 2012-05-28T11:55:51Z dread 1314 ckanclient search - generator improvements ckan ckan-backlog enhancement 2011-09-07T11:36:50Z "Apparently the search generator always makes two requests, even if you don't want to see the search results, which might be slow. Can this be optimised? Maybe we should also provide a second search function that doesn't use the generator - the original simple search function (that leaves the user to deal with limit & offset)." 2012-06-20T11:20:33Z dread 2348 Java client library for CKAN ckan ckan-future enhancement 2012-05-01T13:46:20Z "Start a Java library for interacting with the CKAN Action API. Currently requires support for Groups, Tags, Resources, and Search. An example app would be very useful." 2012-09-03T11:00:24Z ross 1317 password reset - improve user search ckan ckan-backlog defect 2011-09-07T17:12:19Z "In password reset, it gets confused if you have two similar users. This is because with the string the user provides, it searches several fields, not just name but also fullname and email address, allowing you to search for these. But only name is unique. Specific problem: Ira searches for ""Irina"" then it finds both: {{{}}} (I think) Maybe need to choose which field it searches?" 2012-06-20T11:20:21Z dread 2197 Storage Metadata API: add/update not working with local file storage (Pairtree) ckan ckan-backlog defect 2012-02-28T09:29:37Z "If OFS is configured with Pairtree to use a local file storage, all POST requests to add/update metadata ( /api/storage/metadata/{label} ) will fail. This is due to the use of [https://github.com/okfn/ofs/blob/master/ofs/remote/botostore.py BotoOFS] specific ''private'' methods in [https://github.com/okfn/ckan/blob/master/ckan/controllers/storage.py StorageAPIController.set_metadata()], eg: self.ofs.'''_require_bucket'''(bucket), self.ofs.'''_get_key'''(b, label), self.ofs.'''_update_key_metadata'''(k, metadata) ... those methods can't be found in [https://github.com/okfn/ofs/blob/master/ofs/local/pairtreestore.py POTFS] and this causes errors. The API should use only [https://github.com/okfn/ofs/blob/master/ofs/base.py OFSInterface] methods, or should conditionally make calls based off the actual type of ''self.ofs''. ''PS: I did set ""ckan"" as ""Component"" in the ticket because storage has been integrated back into the core in CKAN 1.6''" 2012-09-03T08:48:48Z zydio 2607 'Upload a file' appears on resource form when storage not enabled ckan ckan-backlog defect 2012-06-27T13:30:08Z "if the user tries to upload a file they will get ""Failed to get credentials for storage upload. Upload cannot proceed"" Maybe add a test for it this time, this bug has appeared and reappeared before" 2012-09-03T09:09:43Z seanh 253 Package relationships ckan ckan-backlog enhancement 2010-02-22T16:05:21Z "= Overview = Functionality to formally associate packages. We see a need for specific parent-child, inheriting or dependency relations. Not only should this help navigation between packages in the web interface, but it also provides a mechanism to automatically pull dependencies when downloading a data package, in a similar manner as we see in software package management. = Examples = 1. There are 27 packages in data.gov.uk to do with the Data4NR's Health Poverty Index. There is currently no common link between these, unless you search for 'HPI' (which also brings up House Price Index), or look under tag 'health' (which also has 600 other results). There should be a link on each HPI package page to navigate to the other 'sibling' HPI packages, and to a 'root' package that has info about the set. This could be partially achieved using the existing tag or group concepts, but a more explicit/official/obvious marking of their relationship could be beneficial. 2. In ckan.net is freedict, a collection of translation dictionaries. You could make each dictionary a child package and use this system. But it would probably be better to make each dictionary a different resource in the same package. (There are other ideas to denote a resource as the data making up a 'portion' of package, or a 'whole' of the package, to help people downloading datasets in the software package style.) 3. OSM has had some Naptan data imported (bus stops), with special permission - i.e. a more liberal license. It would be useful to show this link on both OSM and Naptan packages in CKAN: OSM 'derives from' Naptan with a comment about the license change. I'm not sure this is useful to an automatic download or use of these datasets, but may aid exploration on the CKAN website and understanding the provenance of the bus stop data on it. 4. IPCC collection of data linked / mirrored. Not sure if there are useful relationships here? 5. Dracos gets postbox locations from crowd sourcing and OSM. We could say Dracos 'derives from' OSM. See more examples discussed here: http://trac.ckan.org/ticket/253 = Implementation = This is split into four tickets: * Model: ticket:254 * Read in WUI: ticket:255 * Edit in WUI: ticket:256 * API: ticket:257 No need for write access to be provided API for the moment. This ticket also encompasses ticket:169 (Package derivations) and ticket:176 (Package dependencies)." 2012-06-15T15:38:46Z dread 285 Paginate list of packages on tag read page ckan enhancement 2010-04-07T18:23:26Z "Is this worth doing? On hmg.ckan.net start to have a lot of packages with a given tag ... " 2012-06-25T13:45:23Z rgrp 301 Package discussion pages ckan enhancement 2010-04-26T16:57:13Z "A package discussion page is like a wikipedia discussion page: an editable free text page for people to have discussion/post comments about a given package. It provides a way for people to make suggestions about a package without needing access to main package." 2012-06-25T13:47:35Z rgrp 765 Read-only mode - API usage ckan ckan-backlog enhancement 2010-10-26T11:18:17Z "All writes to the API are captured and you are returned an error explaining the reason. Possible errors: * 503 temporary maintenance * 403 forbidden (if server if permanently read-only)" 2012-05-28T11:55:23Z dread 909 DCat importer for CKAN lod2 ckan-backlog enhancement 2011-01-17T12:05:58Z "Write an importer that supports most well known variants of DCat in importing the data as CKAN packages. In particular, the following sources should be supported: * CKANrdf generated exports * opengov.se RDF (not really DCat) * Sunlight Nationdatacatalog as harvested by dcat-tools. " 2012-09-03T10:53:22Z pudo 1130 First time users ckan enhancement 2011-05-09T10:59:21Z Send users to FAQ first time on CKAN 2012-06-25T14:11:54Z lucychambers 1550 Allow simple auth via the API ckan ckan-backlog enhancement 2011-12-16T15:29:29Z It should be possible to pass userid/username and api key and obtain a response from CKAN for external services that use CKAN auth. Those services shouldn't be talking to the DB directly. 2012-09-03T11:00:55Z ross 1684 Remove all config from ckanext-archiver ckan ckan-backlog enhancement 2012-01-19T14:37:01Z "ckanext-archiver currently has a settings file (and a default) and it should be passed in all relevant information from the context. Remove all settings (ARCHIVE_DIR and MAX_CONTENT_LENGTH and others) and pass them in from CKAN." 2012-09-03T11:00:37Z ross 1749 Allow creating activity details through API ckan ckan-future enhancement 2012-02-05T18:10:06Z Currently the activity_create() logic action function only lets you create top-level activity stream items, and not their related activity details. It should handle activity details via nested dicts. 2012-05-28T14:05:33Z seanh 1831 Login with email address ckan ckan-backlog enhancement 2012-02-24T08:58:26Z "Users should be able to log in using either their username, or their email address, both of which are unique. Will require a change to UsernamePasswordAuthenticator in ckan.lib.authenticator.py and possible a useful User.by_email in the user model if it doesn't already exist." 2012-09-03T11:08:24Z ross 2234 Write a CKAN extension for pulling items from RSS/Atom feeds into CKAN templates ckan ckan-future enhancement 2012-03-16T12:59:15Z "You configure the extension with some RSS and/or Atom feeds, it automatically reads items from these feeds and makes them available in the template context, you write a custom template to e.g. display 'news' items from a Wordpress blog on your front page. This extension might be simpler and less fragile than ckanext-wordpresser, and also more generally useful. Details - Mark Pilgrim's Universal Feed Parser might be useful for reading the feeds - Feed items should probably be cached somewhere Suggested - The news item 'widget' should be wrapped in a known class so that it can be styled easily regardless of the format of any HTML entry. - For non-HTML formatted items (Atom should tell you the content type of the entry) maybe we should have a template for rendering each item along with any enclosures that it might reference - Caching is pretty crucial and should probably obey the ttl of the feed. " 2012-09-03T10:52:47Z seanh 2284 Local queries/views/viz in Related stuff. ckan ckan-backlog enhancement 2012-04-12T08:18:20Z "From #2204 not sure how much we have thought through using this for storing queries / views / visualizations coming from our data viewer. In particular, wonder if this necessitates some kind of support for arbitrary json data ... ### Comments In the simplest form, right now all I need to store is store the url to the resource plus hashbang config for recline. That would be super easy ... " 2012-09-03T10:51:53Z ross 2329 Add back in RSS/Atom links on relevant pages ckan ckan 2.0 enhancement 2012-04-26T12:15:40Z E.g. on dataset page, on revision page, on user page and on search results. 2012-09-03T09:24:31Z rgrp 2378 Extract metadata directly from resources that contain it. ckan ckan-future enhancement 2012-05-10T11:58:08Z "Some files that might be uploaded as resources on a dataset, such as some image formats, already contain metadata. For example some jpeg files might contain Exif ( http://en.wikipedia.org/wiki/Exchangeable_image_file_format ) data. [ ] Obtain list of embedded metadata 'standards' [ ] Where the metadata is available it should be added as extra fields on the resource that is uploaded. [ ] HTML? [ ] Image formats (exif/gif etc) [ ] PDF [ ] Eventually consider ... [ ] MS Office documents " 2012-09-03T10:59:45Z ross 2404 Auto-screenshot for related items ckan ckan-future enhancement 2012-05-21T06:55:47Z "As a User I want an image generated for my related item automatically so that I do not have to take picture myself and upload it somewhere Implementation: (?) Use phantomjs or something like http://snapito.com/ Investigate for 1.8, will be needed for TDH Oct." 2012-09-03T10:52:06Z rgrp 2513 Dataproxy should not default to utf8 ckan ckan-backlog enhancement 2012-06-13T08:23:40Z "Unless explicitly told by the source web server the dataproxy should not assume that the content it has can be encoded as UTF-8. Even though the chars from 128 - 255 overlap an attempt to decode some byte array as utf8 will fail whenever a latin1 char whose bitpattern has the MSB set. This will mean that the UTF8Recoder can be more rigid in its acceptance of data, Postel aside." 2012-09-03T10:54:06Z ross 2535 SSL certificate for DataHub + https by default ckan enhancement 2012-06-15T11:00:27Z "DataHub is increasingly used and we should ensure it uses ssl as part of general security. See also #1446 (Need to support https login for multiple instances as part of the CKAN package install)" 2012-09-03T08:48:02Z rgrp 2552 Controlling access to features ckan ckan-future enhancement 2012-06-18T11:26:10Z "== Requirements == To provide a freemium service it is necessary to be able to provide differing __levels__ of functionality based on the '''type''' of user (see #2550). These levels can be specific to the data hub but may require overriding functionality from core to provide these checks. Initial implementation should focus on limiting access to datastore disk space. == Interface == These changes are currently only for the data hub and should be kept as much as possible within the data hub extension. == User Stories == * As a system component I want to find out if the current user has access to a feature (i.e. storage) and if so to what extent (xMb, xGb or unlimited). * As a system administrator I don't expect to need to manage the levels of users '''or''' the features that this applies to. == Tasks == [ ] Clarification of requirements/analysis [ ] Tests [ ] Code [ ] Model [ ] API [ ] UI [ ] Documentation == Estimates == " 2012-09-03T10:52:24Z ross 2554 Research Virtuoso cartridges ckan ckan-backlog enhancement 2012-06-18T13:37:25Z "Look into writing a cartridge for importing CKAN data into a Virtuoso quadstore http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtSponger#How Does It Work?" 2012-09-03T11:07:13Z ross 2654 UI support for ordering groups on group_read page ckan ckan 2.0 enhancement 2012-07-10T18:11:31Z "The group_index page has no support in WUI for ordering the groups displayed. Should allow sorting by name Add support for this for datahub now, and discuss for new 1.9 UI" 2012-09-03T08:49:16Z ross 2732 New file upload functionality ckan ckan-backlog enhancement 2012-07-23T15:53:09Z "We should simplify upload and storage of files, initially only to local storage with archiver eventually being fixed to archive data externally. WIP pad is http://ckan.okfnpad.org/uploads '''Simplifying uploads''' Currently uploads are too painful/difficult/fiddly to use and/or configure. We want to simplify uploads so that they are done directly to the CKAN server, without support for remote services (S3 etc) and/or the dependencies it introduces. We want to fix: * File uploads themselves * Storage of uploaded files * Notification of the upload to other components '''File uploads''' Things file upload should do: * Allow sysadmin to disable * Allow auth'ed users to upload * Store whatever they send on disk, and store DB entry linking the file to the person * When creating the resource, the user should be able to choose from all of the files they have uploaded but not yet associated with a resource. This will allow for bulk upload and then a delayed association. Whenver a user creates a resource they either upload a file now, or see previously uploaded files. {{{ Can we do the upload asynchronously and then associate the uploaded key with the resource before the save ? What happens if the user tries to submit before asymc upload finishes ? Should we delay them? }}} The upload workflow should look like... 1. File upload should be a straightforward file upload with normal auth checks and normal processing of the posted data. 2. a. When called via ajax then the ID of the newly created file should be returned, b. When called via WUI then it should also be given the url to redirect to after the file upload has been handled - the id will be passed as a query param. 3. The resource save should check whether it has a file id and in that case updates the file object to point to the resource. This should enable: * Separate file upload into a user's temporary store, either individually or as a batch. * Creating resources and simply choosing from previously uploaded, unassigned files * Adding files/data to a resource after the fact. '''File storage''' File storage should be local to the CKAN install, and not a remote service. Any archiving to remove storage providers should be outside of the main request. File storage should: * allow moving data, a sysadmin should be able to move the storage root and change configuration and have the system continue running (i.e. don't store absolute paths). * provide maintainability, it should be easy to determine which old files are not associated with resources and thus can be cleaned up. * allow for collection of information (i.e. estimate of storate space used) * check whether there is enough space and handling the conequences cleanly * ensure files to be written only underneath its own root folder, checks should be made after any path generation that the file begins with the location of the file storage. * Have a configurable maximum accepted blob size during upload. * Should store what meta-data was provided with the upload, such as mimetype. Somewhere in the DB we should store ... ||'''Column'''||'''Notes'''|| ||id||An identifier|| ||owner||The owning user, who uploaded the file|| ||path||The path (from the 'storage root') to the file|| ||size||The size in bytes of the file on disk|| ||mimetype||The mimetype of the file, as provided by the uploader|| ||upload_date||When the data was uploaded|| ||resource||The ID of the resource it belongs to. A unidirectional relationship.|| ||archived_url||The URL where this file has been archived|| Generating paths should try and separate the files, perhaps based on username of the owner, or some other mechanism to avoid a single folder full of files. '''Notifications''' We need to make sure that it is possible to notify other components within the system that an upload has taken place, or at least make it easy for them to be notified. The primary use case for this is to notify the component that will translate/upload certain formats to the data store. We could do this based on the post-upload update to the file model (i.e. when we record the total received size of the file). " 2012-09-03T09:07:50Z ross 2546 ODS Managing homepage content ckan ckan-backlog requirement 2012-06-18T10:54:02Z " == Requirements == Require the ability for users to control some level of content that is visible on the home page of their ODS installation. This may be through RSS/Atom feeds (see #2234) or another mechanism but should result in admins being able to change blocks of text on their homepage. This should not be configuration, but accessible through WUI. == Interface == None == User Stories == * As a system administrator I want to have control over content displayed on the front page beyond featured/popular items. * As a system administrator I don't want to manage content through having to write an extension. == Tasks == [ ] Analysis == Estimates == " 2012-09-03T09:10:37Z ross amercader 728 CSW Harvesting shall be optimised in respect of reharvesting only records that have changed uklii ckan-backlog requirement 2010-10-21T15:35:40Z Hi Will, this is important again because some CSW servers we use have over 300 documents in. Could you take a look at modifying the filter please? 2011-07-08T11:33:04Z johnbywater amercader 794 Investigate reconciling UKLP Publisher and Provider with DGU uklii ckan-backlog requirement 2010-11-08T14:50:11Z "This needs more analysis, but the GEMINI2 attribute ""metadata point of contact"" must be reconciled with the registered publisher (or agent). This might also be used to filter records harvested from a CSW source, but filtering also needs more analysis, as does distinction between agent and provider." 2011-07-20T16:33:01Z johnbywater dominik 2961 Preview plugin endpoint ckan ckan 2.0 enhancement 2012-10-08T11:39:27Z "Users could write ckan extensions that offer previews for a certain datatype. Advantages: - We can say that you can add your own previews - Every preview would have to define it's own dependencies - External development (community creates new extensions?) Questions to answer: - Specification of the interface - Precedence of previews for the same data types - Plugins only define the datatype that they are responsible for or do we call a function that returns whether the extension is responsible. As far as I can see, this should be fairly easy to implement by following these instructions: http://docs.ckan.org/en/latest/writing-extensions.html#writing-a-plugin-interface" 2012-10-18T16:33:10Z dominik icmurray 2405 Improvements to data viewer embed ckan ckan-v1.9 defect 2012-05-21T06:59:25Z " * Decent powered by icon for the Embed for the DataHub? (make this text customizable and allow html ...) * Current icon and text looks really bad * Embed link uses uuid rather than dataset name (this goes to perma-url question ...) * Data viewer embed url includes all the resource info (not needed -- just url and backend info ...) * Embed extension urls do not respect original domain but instead use site_url (I'm guessing). E.g. datahub.io domain ends up with links to embed on thedatahub.org " 2012-06-25T14:53:01Z rgrp icmurray 250 RDF link in Atom feed ckan ckan-v1.9 enhancement 2010-02-18T15:41:35Z Add link to RDF representation of a package in our Atom feed. 2012-06-25T13:37:10Z dread icmurray 2550 User types ckan datahub-july enhancement 2012-06-18T11:06:30Z "== Requirements == In the data hub plugin we require the ability to differentiate users between those that have paid for a service, and those that haven't. The distinction isn't boolean as there may be levels of service for paid users, so it may be that we need a 'type' of user where there are various grades of 'paid' which are likely to be strings (specific to the data hub). == Required interface == Once changes have been made to the user schema, for a given user we want to be able to: * determine if they have a paid or a free account, and * get a string name of the type of paid account. Care should be taken to ensure that the 'paid' status of the user cannot be set through the API and only by the datahub plugin. == User Stories == User stories related to the management, setting and changing of a user's payment level, as well as historical information on payments should be done as part of the work that includes actually allowing purchases. For now it is adequate that we can manually control these things through paster commands. Payments types should be linear as I don't believe for this type of service a pick-and-mix modular model would work well. Organizations will inherit the payment level of their owner, so currently there is no requirement for it to affect organizations at all. * As a sysadmin I would like to be able to use a paster command to manually set a user's payment level, or remove it entirely. * As a sysadmin I would like to be able to run a paster command to view a list of users who have a payment plan, grouped by the plan that they have. * As a sysadmin I would like to be able to use the API to change the payment status of a specific user through user_create and user_update. This shouldn't be available to anybody else. * As a user, and only if I have one, I'd like to see my current payment level on my user profile page. == Tasks == [x] Tests [x] Plugin based migration [x] Code [x] Model [x] API [x] Documentation == Estimates == " 2012-09-03T10:51:37Z ross johnglover 1062 Data preview encoding error ckan ckan-backlog defect 2011-03-29T10:55:43Z "The preview of ""Species Misc Turtle Download"" at http://ckan.net/package/taxonconcept results in the following error: Unable to Preview - Had an error from dataproxy: Data Transformation Error (Data transformation failed. Reason: 'utf8' codec can't decode byte 0x8b in position 1: unexpected code byte " 2011-07-27T13:35:31Z sebbacon johnglover 1393 Don't skip search tests ckan ckan-backlog enhancement 2011-10-13T11:30:53Z Now we don't use postgres search, all the tests involving search now don't need to be skipped when running on sqlite. Should help coders spot earlier if these tests break. 2011-11-01T13:19:50Z dread johnmartin 2641 Adapt spatial widgets to new theme ckan demo phase 5 enhancement 2012-07-09T15:02:27Z Dataset extent map and spatial filter need to adapted to the new theme, as they are not showing up now 2012-11-11T18:34:14Z amercader johnmartin 2446 Create demo dataset history/comparison page ckan demo phase 4 enhancement 2012-05-28T13:12:18Z "This is a low priority for the demo site. Discussion: https://okfn.basecamphq.com/projects/9558659-demo-ckan-front-end/posts/62414120/comments Implementation: http://s031.okserver.org:2375/dataset/history/adur_district_spending" 2012-11-11T18:33:39Z aron.carroll johnmartin 2451 Create demo user list page ckan demo phase 5 enhancement 2012-05-28T13:20:13Z "Discussion: https://okfn.basecamphq.com/projects/9558659-demo-ckan-front-end/posts/62268474/comments Implementation: http://s031.okserver.org:2375/user" 2012-11-11T18:35:02Z aron.carroll johnmartin 2457 Create demo tags list page ckan demo phase 4 enhancement 2012-05-28T13:28:55Z "This includes the tag page as well for now. Discussion: https://okfn.basecamphq.com/projects/9558659-demo-ckan-front-end/posts/62998445/comments Implementation: http://s031.okserver.org:2375/en/tag" 2012-11-11T18:34:38Z aron.carroll johnmartin 2785 Allow resources to be re-ordered ckan demo phase 5 enhancement 2012-08-01T10:22:03Z "Not sure where this functionality should be added, possibly in one of the sidebar widgets when editing a resource? Ira, what are your thoughts?" 2012-08-29T10:25:16Z aron.carroll johnmartin 2697 create dataset validation ckan demo phase 5 enhancement 2012-07-18T14:00:35Z Includes: missing fields, existing field checks (i.e. whether a name/dataset already exists with that name) during input (i.e. no need to submit form to check) 2012-08-29T10:25:25Z shevski kindly 1136 Move to SessionExtension in vdm vdm enhancement 2011-05-12T14:34:15Z When vdm was created there was no !SessionExtension so we use !MapperExtension for doing revisioning. Now that SessionExtension exists we should use it. We can also follow the existing SQLAlchemy recipe: 2012-06-25T14:03:00Z rgrp kindly 1447 disk space leakage ckan ckan-backlog defect 2011-11-07T11:54:03Z "Periodically we see some CKAN servers fall over because they run out of disk space. We need to find out if there is a common cause and fix it. One problem in the past has been file handles running out when creating lots of tiny files in the data directory. Another problem has been several enourmous backups being created every day - pdeu on eu25." 2012-06-26T16:15:30Z dread kindly 1135 Changeset model for vdm vdm enhancement 2011-05-12T14:19:46Z "Move to Changeset model for vdm. A changeset model is like an Audit-Log model in which we just record Changesets with Change-Objects rather than have Revision-Objects for each Object that is revisioned. This change would also incorporate significant simplication of vdm." 2012-06-25T13:51:07Z rgrp kindly 1137 Remove need for statefulness in vdm vdm enhancement 2011-05-12T14:47:08Z "Statefulness, especially statefulness for relation (esp m2m) is cause of most of the complexity in vdm. It is ''required'' because, atm, revision objects have FKs to continuity objects. This ticket proposes the following changes: NB: this could be limited just to case of join tables (leaving state stuff on other tables) * Remove FKs from revision to continuity (or allow for them to be nullable). * We could just limit this to m2m stuff * Delete of an object leads to: * Deletion of continuity object * Adding an entry in revision table with state set to deleted (we retain state on revision table) If this is done we will no longer need to worry about filtering on state on relationships as join table will only contain ""active"" relationships. If we do this on all tables we remove need for any state awareness in client (e.g. no need to filter tables on active state). The only disadvantage of this change is that undeletion becomes more problematic (we have to recreate some continuity objects)." 2012-06-25T13:46:14Z rgrp kindly 1689 List deleted datasets in API ckan enhancement 2012-01-20T12:23:34Z "The admin extension allows deleted datasets to be viewed, but there is no equivalent in the API. The package_list API call filters to just 'state=active' datasets. 'state' could be a parameter on the package_list call * Easy to call and implement * But getting permissions right for the different state values may not be easy - maybe a separate logic function is better? " 2012-06-20T11:00:40Z dread kindly 2294 Unauthorized action on Data API gets 302 rather than 401 or similar ckan ckan-v1.9 defect 2012-04-14T19:35:04Z "Well known issue that 401 *in API* end up with 302 redirect to login page (which makes no sense and is very confusing for clients). Fix this by ensuring that error messsages on API get passed through correctly. Minor because affect is annoying but not terminal" 2012-06-25T11:33:23Z rgrp kindly 2674 Data preview not loading on s031 ckan demo phase 5 defect 2012-07-16T10:38:22Z "Not loading for all resources as far as I can tell; e.g. http://s031.okserver.org:2375/dataset/afghanistan-election-data/resource/f6331f99-51f6-44d9-95b9-b20f3b74f360 Fine on demo.ckan.org" 2012-08-07T14:22:04Z shevski kindly 84 Revert support on versioned objects vdm ckan-future enhancement 2009-07-23T08:59:03Z "Basic revert in the classic wiki form is already support by purging a Revision. However may wish to support: 1. Cases where multiple objects changed in a revision but only want to revert 1 (low priority) 2. Want to revert but have reversion as a new revision of that object. Seems low priority at present. Cost: ?" 2012-06-25T12:13:05Z rgrp kindly 2203 Data Viewer support for PDF ckan ckan-v1.9 enhancement 2012-03-04T11:24:53Z " * Boot viewer for format/mimetype: application/pdf, application/x-pdf, application/acrobat, applications/vnd.pdf, text/pdf, text/x-pdf * propose we use pdf.js - https://github.com/mozilla/pdf.js * We could also try iframing for browsers with native support but this seems more complex" 2012-09-25T10:29:21Z rgrp kindly 979 Edit Resource extras in the API ckan ckan-backlog enhancement 2011-02-11T13:09:37Z Follows on from #826. We can now edit resource extras in the WUI (to some extent - see #978 for remaining issues) and we can view resource extras in the API, but we can't yet edit them in the API. 2011-09-05T11:30:44Z dread kindly 1240 [super] API v4 ckan ckan-backlog enhancement 2011-07-24T16:41:00Z "(Just creating this ticket as somewhere to keep notes) * Decide on REST api versus action API * Do we want to support both? * Tidying * Unify on /api/v{version num}/... structure (do we want a default option that points to current default? e.g. /api/default/ ...) * extras merged into normal field list in package * Get rid of /rest/ so just have api/v1/package * Get rid of separation of search api from 'rest' api * Propose that GET on REST index is search e.g. /package/?q=... * This is also resolves issue whereby GET at root returns whole package set (a *bad* idea) as this would now become the matchall search query (with a default limit on items returned) * Resource read/write in API (separate from package) * Does this need authorization work? * user/account API - read/write * Remove autocomplete -- can just use search * Do not worry about backwards compat as should only be used in our js (if others using it too bad!) " 2012-01-02T03:01:52Z rgrp kindly 1255 Drupal consistancy checks. ckan ckan-backlog enhancement 2011-08-01T17:32:48Z Make a robust way to make sure the drupal database is consistent with the ckan data. 2011-08-15T09:20:54Z kindly kindly 1652 How we intergrate with Drupal Multiligual? ckan ckan-backlog enhancement 2012-01-16T10:31:34Z " * Analysis of how/where we can integrate with Drupal Multilingual * Is it likely to access CKAN via /en/data/... or /data/en/... (not sure, probably former) and we need to make sure that it ends up at /en/... * Check with Ian for other issues. " 2012-06-20T10:18:55Z ross kindly 2334 Improved data import ckan ckan-v1.9 enhancement 2012-04-28T22:21:02Z "Placeholder for thinking about this ... * Allow users to configure info for CSV import (e.g. separators, quotes etc)" 2012-06-25T11:42:18Z rgrp kindly 2473 Make datstorer store field ordering in _meta field ckan ckan-v1.9 enhancement 2012-05-29T12:11:32Z Recline views should have a default table order, being the same as the csv that was imported. 2012-06-25T15:07:51Z kindly kindly 2548 Object ownership for groups/package ckan datahub-july enhancement 2012-06-18T11:02:11Z " == Requirements == We need to be able to easily determine who the owner of a dataset or group is. Datasets and Groups should have an Owner, who may change over time but is a specific user within the CKAN instance. It should be easy for CKAN components to determine the user and for the initial version we should ignore the can of worms labelled 'ownership transfer'. At this point migration is likely to be the biggest issue, and would suggest that it is acceptable that the last user to edit a dataset be set as the current owner. More tickets should arise as a result of this work where we may be able to optimise some queries to use the new feature. == Interface == None == User Stories == None == Tasks == [ ] Analysis/Clarification [ ] Tests [ ] Migration [ ] Code/Schema changes [ ] Documentation == Estimates == " 2012-06-26T10:28:59Z ross kindly 2877 Bugs with datastore v2 ckan enhancement 2012-08-18T00:33:22Z "In progress 1. ~~[major] q does not seem to work reliably. e.g. using the setup from this gist https://gist.github.com/1930806 and doing a ?q=DE yields no results (does not work with ""q=de"" either)~~ * ~~q=second does work ...~~ 1. [major] q does not work with 2 values (see below) 2. Query on search with limit 0 results in total of 0 (should either be null or correct total). Queries with other limits yield correct total AFAICT * Also weird fact that limit is returned but as as as string - should it not be an integer 3. Types on fields: could these not be canonical and as per recline (or is it important to allow exact sql types ...) === Multiple query values === Try a query such as: ""second UK"" and you will get 500 error: http://localhost:5000/api/3/action/datastore_search?resource_id=4f1299ab-a100-4e5f-ba81-e6d234a2f3bd&q=second%20UK {{{ ProgrammingError: (ProgrammingError) syntax error in tsquery: ""second UK"" 'select ""_id"", ""id"", ""date"", ""x"", ""y"", ""z"", ""country"", ""title"", ""lat"", ""lon"", count(*) over() as ""_full_count""\n from ""4f1299ab-a100-4e5f-ba81-e6d234a2f3bd"" where _full_text @@ to_tsquery(%s) limit 100 offset 0' (u'second UK',) }}} === Suggestions === Filter support: should think in more detail about this (may want to follow recline style) Simple filters in query parameters would be nice too ..." 2012-08-30T09:53:15Z rgrp mark.wainwright 1171 Citation instructions on dataset and resource view pages ckan ckan 2.0 enhancement 2011-06-01T09:33:19Z "Some sort of citation helper. Something small on the dataset and resource page that would show how to cite. wwaites: Some related thoughts on this from opb: http://homepages.inf.ed.ac.uk/opb/papers/ssdbm2006.pdf timclicks: I'm looking at Dataverse for the first time[0]. It seems very popular in the social sciences. I noticed that there is a recommended citation for each dataset. For example, [1] is has this one: ""Targeted Input Programme (TIP) 2000-01"", http://hdl.handle.net/1902.1/SSC-MWI-TIP2000-01-M1 V1 [Version]"" == Implementation == Add a small box at bottom of dataset / resource page (or in sidebar on dataset page) with title ""Cite this"" with contents like: %title. %author. Retrieved %date. %site_title. For resource: %title = %dataset_title. %resource_name. Could also add export to ref managers (e.g. to bibtex) but that is for later." 2012-09-11T10:18:25Z dread rgrp 1458 Support previewing kml files in data viewer ckan ckan-future enhancement 2011-11-10T14:48:08Z "Super ticket: #1151 (viewing geo data) E.g. preview of http://thedatahub.org/dataset/louisvillecrime should bring up a map" 2012-06-25T14:02:12Z rgrp rgrp 1571 [super] Issues Extension ckan ckan-backlog enhancement 2011-12-19T11:30:25Z """Proper"" issues extension. * Etherpad: http://ckan.okfnpad.org/issues * Code: https://github.com/okfn/ckanext-issues Overview * This would be an extension and improvement of existing todo extension - #842 (https://github.com/okfn/ckanext-issues) * Current extension does work but lacks polish * Should we polish or do significant improvements? * Functionality - see etherpad == Steps == * ~~(Rename todo(s) -> issue(s) in existing extension)~~" 2012-03-04T12:13:03Z jilly mathews rgrp 2874 Clean up bin directory ckan enhancement 2012-08-17T08:01:48Z Full of obsolete material 2012-08-17T08:01:55Z rgrp seanh 2766 prevent draft datasets making it to activity stream ckan demo phase 4 enhancement 2012-07-26T16:06:35Z "The new ckan creates datasets as part of a 3 phase process. To allow for this partially created datasets can have a state that is 'draft' or 'draft-complete'. These datasets should not be seen as active by the activity stream. If we click 'add dataset' and then complete the first phase of adding a dataset then we end up having a activity stream created. When we add a resource in the next phase (add data) again an activity stream item xxx added resource to dataset is created We do not want these adding. Essentially if a dataset has a state.startswith('draft') then we want the activity stream to ignore all actions involving it. finally when the state is changed form state.startswith('draft') to state=='active' we want a xxx has created dataset ... to be added to the stream. The best way to do this would be to branch from 2375-demo-theme-stable and get it to work there. Let me know if you need any help with this ticket or a better explanation of the problem." 2012-08-09T20:13:13Z shevski seanh 2818 Improve related item schema ckan demo phase 4 defect 2012-08-09T09:22:56Z "Problem: When creating a related item (e.g. a Visualisation), if you don't put in a URL it succeeds, but on the related items and apps pages it renders it as a link to the same page. Expected: Always require a URL and it should only submit if one is added" 2012-08-29T09:15:18Z danieljohnlewis seanh 2335 Unicode characters don't work in CKAN ini files ckan ckan-v1.9 defect 2012-04-30T12:42:06Z You get a UnicodeDecodeError, looks like it tries to decode the ini file as ascii. This is a problem because someone might try to set their site description to something with an umlaut in it, for example. 2012-06-25T11:43:55Z seanh seanh 2520 Document undocumented config options ckan ckan-v1.9 defect 2012-06-13T11:52:48Z "There are 21 undocumented config options in CKAN, some of which are not mentioned in the config file template either: ckan.admin.name ckan.admin.email ckan.default.group_type ckan.page_cache_enabled ckan.cache_enabled ckan.cache_expires ckan.extra_resource_fields ckan.extra_resource_group_fields ckan.storage.key_prefix ckan.storage.max_content_length ckan.feeds.authority_name * ckan.feeds.date * ckan.feeds.author_name * ckan.feeds.author_link * ckan.mail_from ckan.gravatar_default * ckan.plugins ckan.api_url ckan.auth.profile ckan.datastore.enabled ckan.tracking_enabled There are also some options that are in the default deployment.ini even though they're deprecated: ckan.async_notifier carrot_messaging_library ckan.build_search_index_synchronously See email to ckan-dev from David Read: http://lists.okfn.org/pipermail/ckan-dev/2012-June/002447.html It'd be best if the docs could be automatically pulled from the source into sphinx using autodoc, see #1358" 2012-06-25T11:48:28Z seanh seanh 3029 JSONP parameter scuppers Search in API ckan defect 2012-12-11T15:00:35Z "{{{http://datahub.io/api/2/search/package?jsonp=jsonpcallback&q=canada}}} returns {{{ {""count"": 0, ""results"": []} }}} I believe this worked in CKAN 1.4 or 1.5, but it is broken on 1.7.1, 1.8 and whatever demo.ckan.org is running. I suspect the jsonpcallback parameter is getting sent to SOLR. This bug prevents using javascript on another site to search CKAN (although hopefully the action API would work)." 2012-12-11T16:37:04Z dread seanh 1778 Replace classmethod's with module-level functions ckan ckan-future enhancement 2012-02-06T15:53:34Z "In many places we have @classmethods where simple module-level functions would do (and would be more idiomatic in Python), e.g. the {{{get()}}} classmethods in the model/ classes. Doing it with module functions lets us type module.function() instead of module.Class.method(). In many cases we're importing classes directly with {{{from module import Class}}} and then doing {{{Class.method()}}}, but {{{from module import foo}}} is bad style: http://docs.python.org/dev/howto/doanddont.html" 2012-06-25T11:29:03Z seanh seanh 2337 Sort out ini file confusion in docs ckan ckan-v1.9 enhancement 2012-04-30T14:57:56Z "For example if you follow the source install instructions then you have development.ini, then when you go onto Post-Installation Setup it talks about std.ini. People don't realise that these files are the same. Either fix the docs or fix CKAN to use same ini file names in package and source installs/" 2012-06-25T11:43:20Z seanh seanh 2370 Add examples of all config settings in default config file ckan ckan-v1.9 enhancement 2012-05-03T10:50:37Z The default config file should contains examples (maybe commented out) for all config variables. Makes it easier to edit the config. For example openid_enabled is not in there. 2012-06-25T11:44:22Z seanh seanh 2619 Omit private datasets from public activity streams ckan ckan-v1.9 enhancement 2012-06-28T11:49:00Z "Activities about private datasets should not appear in public activity streams. I don't think you want to actually purge the activities from the db, because you might still want them to appear in private activity streams. I do think that when a dataset goes private all its past activity should go private, because I imagine that users are going to want to hide everything about the dataset and not have any past activities 'leaking out' I don't think you want to consider whether the dataset was private when the activity happened, rather if a dataset is private now then all its past activities are private (and the simplest thing would be to say that if a dataset is public now then all its past activities become public as well, but is that a privacy concern?) The easiest way to implement this is going to be by modifying the *_activity_list() action functions in get.py, after they pull their activity lists out of the db they should pass them through a function that filters out stuff about private datasets. An activity about a private dataset is one whose object_type is 'dataset' and whose object_id matches the id of a private dataset. You should also check the object_type and object_id of all of the activity object's activity detail objects, if any of those match a private dataset then mark the whole activity as private. Currently all activity streams are public so should have all private datasets filtered out from them, except for the dashboard activity stream which is private to the individual user. In this case private datasets that the user has permission to see should not be filtered." 2012-10-29T17:18:57Z seanh shevski 2644 user dashboard for demo theme ckan demo phase 5 enhancement 2012-07-10T09:00:21Z "we now have a user dashboard that needs theming not sure if we need sam to look at it http://localhost:5000/user/dashboard" 2012-08-06T12:23:56Z toby shevski 2547 ODS Initial data sets ckan opendatasuite 2 enhancement 2012-06-18T10:55:06Z " == Requirements == The ODS demo site will need data adding, initially as fixtures but it would also be useful if we started evaluating datasets that we can ship with ODS installations (at least in the UK) from places such as DGU and ONS. May wish to create a ticket for making sure the datasets within the system are reset every X hours. Perhaps. == Interface == None == User Stories == * As a new system administrator for an ODS instance, I don't want to have a site devoid of any data. Geographically relevant datasets would be welcomed. * As a bizdev person I would like to be able to demonstrate how ODS works with real datasets. == Tasks == [ ] Identify relevant sources for datasets [ ] Pick datasets [ ] Set them up for import == Estimates == " 2012-06-26T10:13:34Z ross shevski 2590 Publisher dashboard ckan ckan-backlog enhancement 2012-06-25T10:03:37Z "Need proper user stories but ... Publisher admins/editors may need a more useful group read page showing things like: * The current search * Recent activity * People within the group * Followers * Others? " 2012-09-03T09:10:16Z ross shevski 2699 workflow for associating datasets with groups ckan demo phase 5 enhancement 2012-07-18T14:02:56Z "needs review & speccing out e.g. datasets created by a user who belongs to a certain publisher (group) get auto added to this group" 2012-08-09T10:12:13Z shevski shevski 2702 Future Javascript wishlist for demo ckan demo phase 5 enhancement 2012-07-18T14:07:55Z "tooltip on popular datasets with number of views facets to update automatically creating a dataset without reloading page between steps hover on licences information autocomplete on search terms group filtering social share buttons in lightboxes dataset counts on homepage" 2012-08-06T12:26:24Z shevski shevski 2814 Demo: upload file behaves oddly ckan enhancement 2012-08-08T10:06:00Z "3. Uploading a file behaves counter-intuitively (I would suggest wrongly). When adding a new resource by uploading a file, I select a file called say create-group.png. I expect the following to happen: * the pathname of that file is filled in the box; * nothing is actually uploaded till I hit 'add' (confirming that I've got the right file etc). Instead of this, * the file is immediately and, seemingly, irrevocably uploaded; * the box is filled with a mysterious URL (https://commondatastorage.googleapis.com/ckan-demo ...) * the mysterious URL is so long I can't even see the final element, which is my file name. " 2012-09-03T11:06:21Z markw shevski 2956 Allow for resource editing in CKAN 2.0 ckan ckan 2.0 enhancement 2012-10-03T15:11:40Z On the edit dataset page... there needs to be a way for users to be able to see all the resources associated to the dataset and edit them individually. 2012-10-04T10:27:22Z johnmartin thejimmyg 1041 Start Using the CKAN Wiki for Tutorial-style documentation ckan ckan-backlog enhancement 2011-03-16T14:11:55Z "For example, I will document the following: * A specific guide on using mercurial when working with our branching and merging policy * DONE - http://wiki.ckan.net/Becoming_a_CKAN_Developer * Policy document on how we use tickets, plan sprints and make releases * DONE - http://wiki.ckan.net/Becoming_a_CKAN_Developer * How to package software as .deb file for project deployment I'd love if someone else would write: * An authorisation tutorial covering the core model, the command line tools and examples of every possible way of using the system * A HOWTO guide with screenshots for adding a package " 2011-08-03T11:52:47Z thejimmyg thejimmyg 1168 Test system for deb packaging ckan ckan-backlog enhancement 2011-05-26T20:33:14Z "Get buildbot to: * build the deb packages * install them into a fresh virtual machine * run smoke tests on the installed ckan" 2012-03-05T23:33:43Z dread thejimmyg 143 Most active users listed on homepage ckan ckan-backlog enhancement 2009-10-08T13:59:33Z Display league of users' recent activity on homepage. 2011-08-03T11:53:01Z dread thejimmyg 1287 NAVL validation errors - Junk fields should be listed explicitly ckan ckan-backlog enhancement 2011-08-24T16:25:02Z "When you create a package, but specify a key that is not allowed (e.g. 'relationships') then you get error message: {{{ {""__junk"": [""The input field __junk was not expected.""]} }}} It should mention the actual key which is not expected. e.g. {{{ {""relationships"": [""The input field 'relationships' was not expected.""]} }}} Kindly said that James' version of NAVL was better in this respect, so this might be best solved by moving to that." 2012-03-05T23:34:19Z dread tobes 235 Resource format normalization and detection ckan ckan-v1.9 enhancement 2010-01-18T15:13:24Z "Try to gather proper MIME information for all package resources in CKAN. This is a shared ticket with dcat-tools (https://bitbucket.org/pudo/dcat-tools), i.e. opendatasearch.org. This can then also be used by ckanrdf, the CKAN RDF conversion service. Sub-tasks: * Create a Google Spreadsheet with two Worksheets: ""MIME-Mappings"", i.e. ""CSV"" -> ""text/csv"" and ""Name mappings"", i.e. ""text/csv"" -> ""Comma-Separated Spreadsheet"". * Collect and map surface forms from all CKANs * Access this via Swiss and apply, store as a PackageResource extra field pending #826 (Resource extras). * Add heuristics for format auto-detections: * Map well-known file extensions * Recognize obvious magic (Zip, Tar) * Peek into Zipfile/Tarfiles * Define a convention for generic data types (many CKAN packages have only ""Spreadsheet"" defined, either detect specific type or set MIME to */tabular-data or similar) * See also: #816 (Autocomplete for the resource format field)" 2012-06-25T12:33:44Z dread tobes 1069 Stub datasets (request for datasets) ckan enhancement 2011-04-01T14:08:39Z "Idea is to have stubs for datasets that someone wants but don't yet exist (or haven't been discovered) in the way one has stub pages on a wiki. We could do this within the existing model by a slight 'abuse' - create a dataset and mark it with a special tag e.g. todo.does-not-yet-exist or similar ... (Just as we have datasets listed that exist but aren't available ...) Alternative would be to have a request for datasets subsystem. I prefer the stub dataset model because it's simpler, provides a simple workflow (as a dataset is found or comes into existence), and the package page provides a natural space in which to accumulate information about what is wanted and what exists. == Implementation == * Agree a new dedicated tag. e.g. todo.does-not-exist == Related == * This ticket has clear links to http://getthedata.org/" 2012-06-25T13:50:15Z rgrp toby 2461 Create demo revisions page ckan demo phase 4 enhancement 2012-05-28T13:34:15Z "I believe this is to be merged in with site activity. Discussion: https://okfn.basecamphq.com/projects/9558659-demo-ckan-front-end/posts Implementation: http://s031.okserver.org:2375/en/revision" 2012-08-09T20:23:58Z aron.carroll toby 2698 markdown preview ckan demo phase 4 enhancement 2012-07-18T14:01:25Z for description / other fields with markdown support 2012-08-09T20:14:12Z shevski toby 2873 ckanext-qa: dataset summary incorrect ckan demo phase 4 defect 2012-08-16T14:13:49Z " For example see: http://s031.okserver.org:2375/qa/dataset/five_stars Which has: Example dataset as a score of: 4 After examination of the dataset ( http://s031.okserver.org:2375/dataset/example-dataset ) it is made up of a CSV and an HTML file. " 2012-08-17T12:58:03Z danieljohnlewis toby 2735 Dataset order on user page ckan demo phase 5 enhancement 2012-07-23T17:01:17Z "I think the datasets on user pages http://s031.okserver.org:2375/user/me should be ordered by latest updated (with most recent at the top) instead of in alphabetical order. What do you think?" 2012-08-07T14:20:45Z shevski zephod 2412 More than one resource invalidatiing breaks dataset edit form ckan ckan-sprint-2012-06-25 defect 2012-05-22T20:05:48Z "When attempting to add more than one resource at once, if more than one resource invalidates, this results in a js error, leaving the form in an inconsistent state. Repro: 1. Go to /dataset/new 2. Add a new resource. Fill in one of the fields with an invalid value. eg - last_modified, or size... 3. Add another resource, doing the same thing: make one of the fields invalid. 4. Try to save the dataset. 5. The entered resource information will be lost, and a js error ""Uncaught Error: Can't add the same model to a set twice,: backbone.js:586"" will be thrown." 2012-05-28T11:07:14Z icmurray zephod 277 Set some config options / settings in WUI (extension) ckan ckan-backlog enhancement 2010-03-22T16:21:01Z "== Use case == As a ckan administrator I want to easily change options about the CKAN install. == Implementation == === Settings to be in DB === Suggested: {{{ ## Title of site (using in several places including templates and tag ckan.site_title = CKAN ## Logo image to use (replaces site_title string on front page if defined) ckan.site_logo = http://assets.okfn.org/p/ckan/img/ckan_logo_box.png ## Site tagline / description (used on front page) ckan.site_description = ## Used in creating some absolute urls (such as rss feeds, css files) and ## dump filenames ckan.site_url = ## Favicon (default is the CKAN software favicon) ckan.favicon = http://assets.okfn.org/p/ckan/img/ckan.ico ## An 'id' for the site (using, for example, when creating entries in a common search index) ## If not specified derived from the site_url # ckan.site_id = ckan.net ## API url to use (e.g. in AJAX callbacks) ## Enable if the API is at a different domain # ckan.api_url = http://www.ckan.net ## html content to be inserted just before </body> tag (e.g. google analytics code) ## NB: can use html e.g. <strong>blah</strong> ## NB: can have multiline strings just indent following lines # ckan.template_footer_end = }}} NB: these will still need to be stored somewhere for loading on initialization. do this in db init function ... === Settings / Options / KeyValues Table === Columns: * [namespace]: ? only if KeyValues (for settings this would then always be settings) * key * label * value (json) * type (e.g. date and to specify in advance what type should be) * description * tags: ?? (for grouping ...) === Loading settings from DB === Do this in ckan/config/environment.py === WUI === * /ckan-admin/settings * Show label, plus description plus text field == Depends == * Would be part of ckan-admin section and hence build on ticket:833 (Administrative dashboard) " 2011-10-10T11:45:21Z dread zephod 1358 Generate configuration documentation automatically from the deployment_ini_tmpl file ckan ckan-backlog enhancement 2011-09-26T22:32:30Z "At the moment documentation of config options is duplicated between source (deployment_ini_tmpl in ckan/config which is used to generate user ini file) and the docs. Suggest we write a script that automatedly generates reference documentation for the config from the source. May be obsoleted by #277 (some config in db)" 2011-10-10T14:43:43Z rgrp zephod 1507 Minor fixes to dataset add on Group edit form - 0.5d ckan ckan-backlog enhancement 2011-12-05T12:33:49Z "Group edit dataset add form needs some work * Dataset name is not cleared when you add * No way to remove item from list of datasets to be added if I make a mistake * (2nd Apr 2012) It now seems that option to add multiple datasets at once has disappeared (perhaps during the CSS/HTML refactor ...) " 2012-05-28T11:40:20Z rgrp