CKAN: Ticket Query

#2198: API documentation is missing Storage Metadata API info

zydio — Tue, 28 Feb 2012 09:35:43 GMT

Now that ckanext-storage is back into the core (v1.6), CKAN documentation should probably contain info on Storate Metadata API.

#34: Page Not Found - returns with 200 rather than 404 as it should

zool — Wed, 08 Nov 2006 18:02:41 GMT

#1309: Registering new user requires immediate login

zephod — Mon, 05 Sep 2011 12:25:10 GMT

Registering a new user directs you to that user's profile page but does not log you in. There is an empty set of "Recent changes" and no ability to modify the page. Users must follow the login link in the top-right corner to continue.

Registering a new user should immediately log you in.

#1348: UX polishing (dataset create/view/edit experience)

zephod — Fri, 16 Sep 2011 10:53:30 GMT

Tweaking UIs and polishing the work done in #1294.

## Edit Page ##

[Done; cset:49e0b059b6f5] Hide upload if storage not enabled
[Done; cset:81ff13b42dad] Make 'Add resource' links on edit page clearer and more button-like.
[Done; cset:03904fc50cbf] Move edit form tabs to the left
[Done; cset:fde26b87d6ce] API placeholder text should not link to a CSV file
[Done] We used to autocomplete the format field - restore this functionality
- Works on live. My local db has an empty 'resource_revision' table; maybe 'paster create-test-data' should insert something here?
[Done; cset:1aab499d73db] Summary should contain 'name' (or, if unavailable, use description. Long term: description is to be deprecated)
[Done] Remove/move instructions where possible (a lot could just be placeholder text on the elements) (other stuff could only show on hover)
- NB: reveal_instructions.js already disabled on edit page
- [RP] have now done this on create -- think we can leave on edit
[Done; cset:755b1a622199] We have broken 'error' reporting for resource issues. Either need to move that into error summary or somehow not destroy it when we rewrite table on page load ...
[Done; cset:7ad090cb7855] Add slideDown to Resource expanded view
[Done; cset:d3595143e506] Need ability to delete resources
- No thought yet given to uploaded resources. Long term re-think probable.
[Done; cset:2430a68a59fc] Empty resource table to resemble view page ("no resources" text)

## General ##

[Done; cset:cc0ad47293e5] Highlight the package tab I'm on (view/edit/history)
- More generally, the presence of the #minornavigation bar is very inconsistent throughout the site.
[Done; cset:d5babc3629cf] Remove 'license' filtered search from backend
[Done] Move script stuff to footer of page

#1349: Template tidying

zephod — Fri, 16 Sep 2011 11:03:45 GMT

Various things in templates can be tidied up after work has finished on #1294:

remove styling in page in group/index.html (put in css main)
- ditto for package/search.html
- ditto for home/index.html
Forms.css - to merge into style.css; remove explicit imports elsewhere
- @import at the top of style.css @import url(forms.css)
Make a note: Success/failure controllers clash CSS with success/failure flash banners

#1350: i18n of new javascript

zephod — Fri, 16 Sep 2011 11:29:36 GMT

New js code running produced in the work following #1294 contains various string literals, and needs proper internationalisation.

See files:

application.js
templates.js

Furthermore, efforts can be made to tidy up strings as described in #1329.

#1351: Tidy edit-user form; strip preview functionality

zephod — Tue, 20 Sep 2011 16:05:53 GMT

The template for editing a user's profile seems to output the same form twice in one page. Furthermore, the page is made needlessly complex by the preview functionality. The neat inline preview used in package will make this page a lot neater.

Fix the duplicate form
Strip the preview functionality from the front-end, replacing it with js editor
Strip the preview functionality from the back-end and test

#1368: UX polishing and bugfixes

zephod — Fri, 30 Sep 2011 14:12:40 GMT

From Ira: PDF of bugs and suggestions is attached.

This ticket is included in release v1.5. Post-v1.5 UX improvements are collected in #1404.

DONE ?

[dataset/edit]: Deletions are confirmed with a dialog box
[dataset/edit]: Long URLs break the edit resources tab. Show name (& 'no name') with a pencil icon.
[dataset/edit]: Rearrange the delete resources mechanism;
- Use a little minus icon on the far left, followed by a pencil icon for editing.
- The 'delete resource' button can become 'hide'
- Deletions are confirmed with a dialog box
[dataset/edit]: Rearrange the 'you have unsaved changes' warning;
- Delete the little green plus sign on the right;
- Try a flash banner instead (more general purpose & beautiful)
[dataset/edit]: Try a pencil icon (+'hide' button) rather than the +/- buttons which look a bit like you're adding a dataset.
[dataset/view]: Subscribe button (& subscribe to history) doesn't work as expected. Modal dialog carrying instructions?
[dataset/view]: Drop the 'add to a group>>' and 'add tag>>'. Needs inline tag-adder.
[markdown editor]: Tab colours confuse the user. Inactive button appears to be greyed out.
[dataset/edit]: The upload file UI mutates and breaks across lines; make it a little more rigid. Verify at different zoom levels.
[groups/add]: Hide unimportant fields
[navigation] Add 3D bevel (@see github) to current tab highlight.
[dataset/create and groups/create]: Slug generator can be tidied. Default: Not editable. @see http://groupspaces.com/a/group/
[groups/view]: Show description and owner. To match dataset section.
[groups/authz]: Tidy to match admin/authz (pretty buttons & spacing). Add navigation bar.
[groups]: Entire section to use pretty buttons please.
[about]: Get the about page working on test.ckan.org. (Works locally and on live).

WONTFIX ?

~~[dataset/edit]: Make 'tags' a top level form section; it is too important to go below the fold.~~ (wontfix)
~~[groups]: Clicking a column heading should sort by that column. Default should be 'size', not 'name'.~~ (ticket #1403)
~~([groups]: (Investigate) Is it easy to implement a little search-groups feature?)~~ (ticket #1403)
~~[*/authz]: Add tooltips to explain column headers. (Not required if mechanism is about to be refactored...)~~ (wontfix: we need to rethink this mechanism; authorization refactor is coming)
~~[general]: 'Authorization' refactor to 'Permissions' on nav-bars.~~ (wontfix, further discussion. authorization might be less techy...)
~~[search]: (Investigate) Can we quickly & easily reintegrate the faceted search-by-license but present it in the sidebar like the other facets?~~ (wontfix: high cost and maintenance overhead; need compelling user story)

#1369: Remove showdown.js from the page download

zephod — Fri, 30 Sep 2011 14:21:56 GMT

ckan.js can be rearchitected to avoid instantiating showdown.js in the root namespace. That way, layout_base.html doesn't need to import the script (because we don't use the showdown-dependant parts of ckan.js).

#1377: Ckan admin repair

zephod — Mon, 10 Oct 2011 09:46:58 GMT

Integrating ckanext-admin into core has thrown up a number of problems:

Look & feel does not match the rest of the site
Tests are not passing
On the trash page, clicking 'undelete' triggers a purge
Using the purge functionality is dangerous; deleting and purging the latest revision will corrupt a dataset (& several corrupt datasets have been found on thedatahub.org)
Trash page can contain nested form tags in certain cases (breaking test harness & form redirection)

#1378: New to TheDataHub? - StackOverflow style banner

zephod — Mon, 10 Oct 2011 11:48:49 GMT

Implement a banner across the top of the screen giving newbies a link to the about page, and making them feel welcome. See stackoverflow for reference?

#1379: Markdown conversion of linked references broken

zephod — Mon, 10 Oct 2011 11:55:19 GMT

eg. http://thedatahub.org/dataset/us-gov-tarp

[This Paper][my-paper] is very interesting.

[my-paper]: http://somelink.com/paper

Write a test to check this markdown feature works - if not, use external markdown lib rather than webhelpers.markdown. Probably need to add markdown lib to list of requirements.

#1380: Making customizing CSS easier

zephod — Mon, 10 Oct 2011 16:25:56 GMT

While integrating the new theme and making a large number of UX tweaks, I've allowed the CSS file to bloat out of control with some very specific rules and subtle hacks, as well as a couple of clearfix <div> objects in the markup which isn't really good practice.

In general we want a logical CSS structure which is as easy to modify as possible. You should not find yourself being overwritten by highly specific rules all the time!

Actions

Clean up css
Add a config option ckan.template_head_end - arbitrary string inserted at end of <head> tag so you can add custom css etc (may also want to update theming docs to reflect possibility of using this)
(While we're at it): Add ckan.template_footer_end config option to deployment.ini_template. (This already exists, we just haven't told anybody)
The /users index page isn't linked anywhere. Clean it up and link it in the footer next to Groups etc.
package/new, package/edit, group/new and group/edit all include their forms differently. Use h.literal in all cases.
Fix the padding on minornavigation.

Background

David Read sent me the following as background:

basic theming is described here: http://docs.ckan.org/en/latest/theming.html

Deep customisation of the templates is done by creating an extension, with this as a template: https://bitbucket.org/okfn/ckanext-exampletheme/overview

That's what Augusto and the Brazilians have done http://alpha.dados.gov.br/dados/ and their code is here: hg clone http://dev.dados.gov.br/codigo/dev/tema-ckan <snip> Another thing of interest was us becoming compatible with Wordpress themes last December. Richard Pope worked with Rufus on this. I believe the base theme is 'twentyten' and I'm guessing that one would swap that css file with another to change theme, but I don't know. I don't know if this feature has been dropped since then. http://lists.okfn.org/pipermail/ckan-dev/2010-December/000073.html

Dave

#1404: Search Page UI improvements

zephod — Mon, 17 Oct 2011 10:36:58 GMT

[Refactored] :: Follows on from #1506 UX changes.

Declutter the sidebar. No yellow box.
Facets to go on the left, rather than the right. More logical flow.
Did you know you can search by author? Probably not. Find a nice way of presenting extended search options.
Make Datasets in the search page look more like Datasets on the groups pages (ie. like awesome sexy search results).
- Update that look-and-feel to include the new resource icons created in #1506

#1409: Add Gravatars to user profiles

zephod — Fri, 21 Oct 2011 12:39:33 GMT

Since we now require email addresses, it's sensible to request users' gravatars to add a little flavour to their user profile (and, potentially, other places eg. comments threads?)

[Reopened: Additional] Use gravatars in the HTML generated by helpers.py to create lists of users. Eg. on user/list and dataset/history.

#1410: Add Gravatars to user profiles

zephod — Fri, 21 Oct 2011 12:39:34 GMT

Since we now require email addresses, it's sensible to request users' gravatars to add a little flavour to their user profile (and, potentially, other places eg. comments threads?)

#1482: Minor JS bugs

zephod — Tue, 22 Nov 2011 19:44:51 GMT

Three JS bugs have appeared:

The slug editor is not updating the text field again. [Fixed; commit:fadda17383]

The View Dataset page will stop executing javascript if there are no resources. [Fixed; commit:e54b089f6e]

The Add-Dataset and Add-Group URL editor shows the wrong URL for datasets and groups. Broken in this commit:

https://github.com/okfn/ckan/commit/5a01e67 by 'map.explicit=true'. JohnG: Can you look into this? [Fixed; commit:88e88380f6]

#1517: Accessing resource view sometimes auto-downloads the resource

zephod — Mon, 05 Dec 2011 18:27:27 GMT

Clicking any of the links to a resource page in the dataset viewer seems to load the page and immediately start downloading the resource file.

For example, being here: http://test.ckan.net/dataset/europeana-lod and clicking on any of the links to the first resource.

#1528: Gravatar next to My Account link on all pages

zephod — Tue, 06 Dec 2011 18:58:51 GMT

Rather than the anonymous 'user' icon in the top-right corner, we could display your gravatar on all pages when you are logged in.

This was suggested by Richard Cyganiak: http://lists.okfn.org/pipermail/ckan-discuss/2011-November/001825.html

#1788: IE7 compatibility problems

zephod — Thu, 09 Feb 2012 14:54:10 GMT

From Antonia Acuno, via Ira:

It appears that the current layout for the datahub does not work in IE7, which would mean a problem for us as most gov uses it and is one of those we have to support...any views?

Tested in several gov departments computers, so a common enough issue.

http://imgur.com/ip4xa

From Rufus: We haven't officially supported IE7 so far but can put engineering effort into this if absolutely needed. I note that IE 7 is now 3y out of date and is likely a security risk. Obviously this is something to ask Antonio about.

#2221: Tests are broken for some of us: NotAPairTreeStoreException

zephod — Fri, 09 Mar 2012 18:46:21 GMT

Since my last pull I'm getting a strange new error which is presumably to do with my local config or assumptions about the storage extension.

Test output here: https://gist.github.com/2007985

#2222: Tests are broken for some of us: NotAPairTreeStoreException

zephod — Fri, 09 Mar 2012 18:46:23 GMT

Since my last pull I'm getting a strange new error which is presumably to do with my local config or assumptions about the storage extension.

Test output here: https://gist.github.com/2007985

#2286: Upgrade to boostrap v2.0.2

zephod — Thu, 12 Apr 2012 17:30:18 GMT

I minified bootstrap and apparently downgraded the version. This breaks things in Recline, and creates weird discrepancies (DGU uses 2.0.2 and had some problems importing HTML from TheDataHub? core, for example.)

Switch to the latest minifed CSS + JS
QA-sweep the site, especially dataset/edit

#318: Insufficient validation of resource URIs

wwaites — Wed, 19 May 2010 20:58:43 GMT

The CKAN instance on data.gov.uk serves invalid URIs out of its API.

For example the following can be found,

http://uk.sitestat.com/homeoffice/rds/s?rds.hosb0509tabsxls&ns_type=pdf&ns_url=[http://www.homeoffice.gov.uk/rds/pdfs09/hosb0509tabs.xls]

In this URI, the : and / characters after the ? in the query part are invalid according to section 3.4 of RFC2396

Also URIs are not stripped of whitespace at the end.

This causes problems when other software with a more correct interpretation of what a valid URI is attempts to consume data from CKAN. In this instance the Talis triplestore complains about such URIs.

"Be liberal in what you accept and conservative in what you send" would seem apt.

Actions

Validation of urls as part of form entry or data loading
- Need to consider situation where this should happen out-of-band (i.e. we allow load even with invalid data and then flag bad dates in separate validation process). In general doubtful that we should do this here because url invalidity is such a big deal
This code should support analysis of existing data so we can go through existing database and find invalid urls
- Also useful to have this so we can do out of band validation

#433: Data package metadata in the Egg

wwaites — Tue, 17 Aug 2010 20:57:40 GMT

Still not sure if we shouldn't use the existing setuptools machinery to manage this -- there is already a way to get at the metadata. In any event, I've just made an addition to datapkg that makes it possible to put datapkg_sources as a dictionary in your package's setup.py. Afterwards it is possible to pull the metadata out of the egg. Of course this could easily be changed to save the information in whatever form, indeed if you pass it a string instead of a dictionary it will just write whatever you gave it into the datapkg_sources.spec. The point is, I think that the egg is a good place to stuff this information.

For non-python users, it is always possible to simply put up the datapkg_sources.spec somewhere on the web so they can directly retrieve the data files.

From the docstring::

    This is the implementation for an [egg_info.writers] entrypoint.
    Datapkg adds an argument to setuptools's setup() function called
    datapkg_sources. The argument should be a dictionary of the form:
    .. code-block:: python
        setup(
            ...,
            datapkg_sources = {
                "cra2009" : "http://www.hm-treasury.gov.uk/d/cra_2009_db.csv"
            }
        )
    The result of this is that there will be a file in the egg called
    datapkg_sources.spec that looks like this::
        [sources]
        cra2009=http://www.hm-treasury.gov.uk/d/cra_2009_db.csv
    How do you get at this data? Simple::
    .. code-block:: python
        import pkg_resources
        dist = pkg_resources.get_distribution("ukgov_treasury_cra")
        spec = dist.get_metadata("datapkg_sources.spec")
    and 'spec' will be the contents of the file as a string.

#537: Caching and Performance improvement

wwaites — Mon, 30 Aug 2010 16:06:02 GMT

There are several places where performance is unacceptably slow. Even in places where it is not, the system could still be more responsive for read requests.

Introducing caching has to be done carefully and should be done in a standards compliant manner.

General strategy

Where possible, cache output within the pylons app (beaker).
Facilitate external caching in an end-user's web browser or a caching proxy
Slightly stale data is not necessarily much of a problem so allow the output to be cached for a relatively short period (e.g. 5-15 minutes).
When cache expiry has been reached, a request will be made to the server. The server should check if its internally cached data is still valid, and serve that, otherwise regenerate the data.

Tasks

These tasks should be broken into sub-tickets:

caching of parts of templates that are expensive to render (package list, tag list, group list)
caching of entire output using beaker particularly for API read operations.
need to perform a check to see if the cache should be invalidated by checking if anything in the output would have changed -- i.e. checking timestamps on package modifications. this is a natural place to introduce the ETag which will help browsers and web caches.
cache infrastructure front end - varnish, squid, etc. To do this right, the controllers need to set the cache control headers appropriately (max-age, must-revalidate). This is a good resource: http://www.mnot.net/cache_docs/#CACHE-CONTROL
- Deploy varnish on a host dedicated to this purpose for research. This will be useful for other sites as well
- Do not configure varnish to ignore cache control headers or otherwise behave in a non HTTP/1.1 compliant manner

Future Work

Investigate ckanclient library maintaining a local cache as a web browser would
Investigate using a CDN like Google Storage or Amazon for serving cached data.

#576: CKAN Requires Old Version of SQLAlchemy

wwaites — Fri, 10 Sep 2010 17:59:33 GMT

Requires 0.4. 0.5 is a maintenance branch, 0.6 is current.

VDM appears to work correctly (all the tests pass) with 0.5. CKAN does not -- requires more investigation to determine exactly why.

It would actually be nice to be able to run with 0.6 or 0.5, though 0.6 will require some changes to VDM as well

#693: Support ETag in cache decorator

wwaites — Mon, 11 Oct 2010 21:04:11 GMT

... and make cache-control header optional

#843: user list ui for group curation

wwaites — Sat, 04 Dec 2010 17:37:25 GMT

perhaps we should show the openid as well to distinguish between users with the same name.

perhaps on account creation, the user should be redirected to their personal details page to encourage them to fill in a human readable name.

also the list is much too long. can we make it work some other way? javascript is an option, but must be careful to fail gracefully when the browser does not support it.

#844: bad mail config ckan.net/ckan.org

wwaites — Sun, 05 Dec 2010 13:45:53 GMT

ckan.net and ckan.org have no mx record and no listener on port 25. yet they send out mail. this means, when messages it sends bounce for whatever reason, the bounce messages stay in the queue on the remote mail server until they expire. for example:

B30E6D9F       2873 Sat Dec  4 14:05:40  MAILER-DAEMON
(delivery temporarily suspended: connect to ckan.net[46.51.189.76]:25: Operation timed out)
                                         no-reply@ckan.net

both these domains should have an mx record pointing to mail.okfn.org and mail.okfn.org should be configured to handle these addresses correctly, e.g. by sending them to /dev/null

#851: Link Checking

wwaites — Tue, 07 Dec 2010 11:54:20 GMT

revisit link checker from http://knowledgeforge.net/ckan/ckanext/file/tip/ckanext/link_checker.py

revisit ollyc's parallel work

look at how this gets used in practice (maybe deprecate in favour of curate tool (suitably wrapped to hide details from the user)

#852: [super] Dataset upload and archiving

wwaites — Tue, 07 Dec 2010 11:56:33 GMT

3 (4) use cases: (With and without access to auth keys.)

upload form on ckan (by default local system has auth key for storage)
datapkg upload (client) (by default without key) (plumbing done)
background job archiving downloads (by queue client)

Most important are:

Upload form on ckan.net (with access to keys)
API for getting credentials for upload from ckan.net api (without access to keys).

Aside: Once 2 was done we could deprecate storage.ckan.net

Sub-tickets

Required infrastructure

#826 - Resource 'extra' fields
#358 - Resources in REST API
#235 - Resource format normalization and detection

User upload via Web UI

#877 - File upload in WUI
#878 - Integrate file upload with workflow around package resources

User upload via CLI/datapkg

#853 - plumbing for credential-less rest upload
#879 - Storage auth API

Also related:

#405 - Retrieval options for package resources

More Info

Upload/storage discussion: http://ckan.okfnpad.org/storage
- For api to generate upload key (for e.g. datapkg usage) suggest locating at ckan.net/api/utils/

#853: Client upload to storage without having primary storage keys

wwaites — Tue, 07 Dec 2010 11:57:43 GMT

Reverse engineer boto and work out how to get headers to support upload to google storage without holding api keys.

This would lead to an extension to OFS.

This analysis should inform (and go hand-in-hand) with the implementation of ticket:879 (Storage Auth API in CKAN).

master ticket #852

#860: full text indexing for semantic.ckan.net

wwaites — Tue, 07 Dec 2010 12:47:09 GMT

...

#861: unicode errors creating rdf output

wwaites — Tue, 07 Dec 2010 12:48:45 GMT

http://bitbucket.org/ww/ckanrdf/changeset/63b60d3a253d

#862: deploy rdf on catalogue.data.gov.uk

wwaites — Tue, 07 Dec 2010 12:50:37 GMT

handle various dgu extras, configure apache for autonegotiation, etc.

#883: uklii harvesting refactor

wwaites — Sat, 25 Dec 2010 11:48:33 GMT

master ticket

#884 implement harvest job delete command for an easier life
#885 move csw code into dedicated ckanext plugin
#886 move forms api into dgu extension module
#887 move harvesting code to use generic harvesting module

#884: harvest job delete operation

wwaites — Sat, 25 Dec 2010 11:50:00 GMT

implement paster subcommand to delete harvest jobs

#885: reimplement csw module to use owslib

wwaites — Sat, 25 Dec 2010 11:54:59 GMT

#886: move uklii forms api to dgu module

wwaites — Sat, 25 Dec 2010 11:55:45 GMT

doesn't belong in ckan core

#887: move harvesting to generic module

wwaites — Sat, 25 Dec 2010 11:56:55 GMT

in concert with pudo's work on harvesting different types of documents. should also make it possible to consume, e.g. dcat

#894: harvest from http://locationmetadataeditor.data.gov.uk/geonetwork/srv/csw

wwaites — Wed, 05 Jan 2011 18:57:56 GMT

#1084: ckan.net RDF links changed

wwaites — Tue, 12 Apr 2011 13:58:37 GMT

need to make some changes for the links to semantic.ckan.net. it should use http://semantic.ckan.net/record/<package_id> now

append .rdf, .ttl, .nt, .dot, .json (even .html for an ugly table) to taste (or just leave off the suffix and let content negotiation take care of it)

the base url is changed, but it now uses id not name.

see for example:

#1087: version and contact info api call

wwaites — Tue, 12 Apr 2011 17:22:24 GMT

a simple api call that returns data like this:

{ "version": ckan_software_version,
  "contact": { "name": "Some Admin", "mbox": "admin@exmaple.org" },
  "description": "Site Description",
  "url": "http://canonical.name.ckan.net/"

#1088: content-type autonegotiation is wonky

wwaites — Tue, 12 Apr 2011 17:44:21 GMT

in ckan/controllers/package.py around line 130 it does some strange things...

perhaps replace with https://github.com/wwaites/autoneg

and handle redirection of these content types:

application/rdf+xml
application/turtle
text/plain
text/x-graphviz

#1803: clean up routes

toby — Fri, 17 Feb 2012 12:58:17 GMT

#1805: Error pages do not translate

toby — Fri, 17 Feb 2012 14:33:36 GMT

eg 404 page

create a 404 error via a bad url - translation links go to /document/error not the actual bad url

#1806: make drop down language selector

toby — Mon, 20 Feb 2012 12:36:33 GMT

language chooser should look like the ec one

#2220: make ckan cacheable

toby — Thu, 08 Mar 2012 17:44:03 GMT

need to sort cookies etc

should work with nginx and varnish

#2227: Tests are slow and broken

toby — Mon, 12 Mar 2012 12:49:30 GMT

not all tests run and they take too long :(

#2253: CMAP [super]

toby — Wed, 21 Mar 2012 14:45:33 GMT

Somewhere for CMAP stuff not in other tickets

need to create some general tickets

template changes
general demo server setup

#2254: better hooks for templates

toby — Wed, 21 Mar 2012 14:48:53 GMT

TD look at issues and then email ckan-dev

meeting notes from 21-3-2012 general ideas non specific

Problem:

We want to remove the Transformer usage due to performance and its close tie to genshi
Want a standard way for core code and extensions to put code into the templates where *templates request it* (templates control insertion rather than extensions ...)
Stacking versus overwriting on entry points
- Relationship to h.requires('jquery', version) - http://codex.wordpress.org/Function_Reference/wp_enqueue_script

Options:

placeholders or helper methods
{{user _info}} {{sub_menu}} is this equivalent to <span class="insert-user-info"></span>
- [xyz arguments] -> h.load_snippet('xyz', ...)
${h.snipit()}

#2256: remove TDH from core

toby — Fri, 23 Mar 2012 14:33:19 GMT

make core independent of TDH and make core as minimal app

#2311: disqus - improvements

toby — Mon, 16 Apr 2012 17:54:13 GMT

get working on TDH

look at removing stream filters

#2355: [super] make extensions cleaner

toby — Tue, 01 May 2012 15:10:51 GMT

Do an analysis of why upgrades are problematic
What can we do better
Decide what to implement

#2371: fanstatic integration

toby — Thu, 03 May 2012 12:00:11 GMT

aims

allow templates to specify needed css/js

allow split js files to be bundled (including plugin supplied if possible - stage 2)

serve minified in production/ non-minified in dev

possibly look at doing the minification via paster - maybe as different ticket

#2420: @depreciated decorator

toby — Thu, 24 May 2012 11:15:44 GMT

create a depreciated decorator to wrap functions we intend to remove

logs a warning maybe check that 'depreciated' is included in the docstring too

#2421: demo-theme pills break in dataset search

toby — Thu, 24 May 2012 13:13:16 GMT

if pills cross onto 2 lines they split which they shouldn't to see just add some tags/formats till it breaks

#2482: related items dataset page 500 error

toby — Thu, 31 May 2012 12:48:44 GMT

#2484: move follower functionality into helper functions

toby — Fri, 01 Jun 2012 10:49:30 GMT

#2496: get debug fixed in demo branch

toby — Thu, 07 Jun 2012 11:15:09 GMT

stacktrace

#2497: abort loses language settings

toby — Thu, 07 Jun 2012 11:17:35 GMT

if not logged in then go to add dataset url the language is lost

check if this is a ckan 1.7 issue

#2498: on loggin redirect to requested page

toby — Thu, 07 Jun 2012 11:18:49 GMT

#2511: header logo should be link to /

toby — Tue, 12 Jun 2012 15:11:20 GMT

#2522: view user gatavar not sqaure

toby — Wed, 13 Jun 2012 16:29:14 GMT

the user pic should be square on the user read page

#2523: New package metadata form needs creating

toby — Wed, 13 Jun 2012 16:32:56 GMT

http://localhost:5000/dataset/new_metadata/dataset

Controller : package Action : new_metadata

template package/snippets/package_metadata_form.html

#2532: show activity steam for user no js

toby — Fri, 15 Jun 2012 09:55:58 GMT

We should allow the user activity stream to be accessible with no js by passing a param or something. Need to agree how we hide/show basically agree what classes we use.

This should be a generalised solution that we can use in other places as needed.

I think this just needs discussion

#2536: cleanup activity streams

toby — Fri, 15 Jun 2012 13:02:03 GMT

#2553: Create a get snippet api action

toby — Mon, 18 Jun 2012 11:56:53 GMT

just passes template name

?template_name=...

#2571: implement logic.action.create.resource_create()

toby — Tue, 19 Jun 2012 10:37:39 GMT

This function is incomplete

If you want I can do this but I need guidance over how to do this properly. ie would I go through lib.dictization.model_save.package_resource_list_save() which looks wrong to me as I'd need the package. resource_dict_save() seems better but to be honest the total lack of docstrings etc makes me feel ill.

#2574: look at package states

toby — Tue, 19 Jun 2012 14:22:51 GMT

we want to be able to add new datasets but not have them indexed or seem by people

is the vdm.state the place to do this

#2576: resource side box in dataset resource view broken

toby — Wed, 20 Jun 2012 13:44:17 GMT

assuming you have datahub data

http://localhost:5000/en/dataset/2008_facility_ghg_emissions_by_province_territory/resource/28650645-8878-4826-9405-f20b9dfa4c12

also the breadcrumb becomes overly long too

#2578: demo theme breaks the tests

toby — Thu, 21 Jun 2012 11:08:44 GMT

The demo branch fails huge numbers of tests.

many are going to be template based - these need to be sorted - ideally we need to get them to work with legacy/new templates but see how we go on that one

anyhow this is not a priority whilst we are branched but needs resolving before we merge into master

#2580: create resource validation

toby — Thu, 21 Jun 2012 13:26:48 GMT

david I've got the add resource working but it is happy to add empty resources which implies that it isn't doing validation correctly.

I'm not sure what the validation rules are so hard to test this - I'm coming through as an api call

let me know if i can help

#2581: allow state = 'draft'

toby — Thu, 21 Jun 2012 14:01:38 GMT

pass some stuff through the context

#2584: edit profile needs new theme

toby — Fri, 22 Jun 2012 10:12:05 GMT

http://localhost:5000/user/edit/<my user name>

#2586: edit dataset - tags broken

toby — Fri, 22 Jun 2012 10:40:30 GMT

tags is list not string

#2587: author/maintainer not shown if email missing

toby — Fri, 22 Jun 2012 12:50:50 GMT

is this the expected behaviour seems crap to me, should we just see the author but just no link

#2588: search index for new package

toby — Fri, 22 Jun 2012 13:52:25 GMT

when package is added it does not seem to get indexed

#2589: users can view draft datasets

toby — Fri, 22 Jun 2012 13:53:14 GMT

need to add some logic for this

#2591: postgres unicode problems postgres v9.1.4

toby — Mon, 25 Jun 2012 12:36:16 GMT

sqlalchemy fails on postgres 9.1.4 when unicode is returned

see http://docs.sqlalchemy.org/en/rel_0_7/dialects/postgresql.html

#2598: stages css broken in FF

toby — Tue, 26 Jun 2012 10:55:02 GMT

I see X where none should be

#2606: make fanstatic use full path

toby — Wed, 27 Jun 2012 11:19:45 GMT

ckan/main not main

#2614: improve the documentation around less/node

toby — Wed, 27 Jun 2012 16:52:08 GMT

needs to move to a better home

better ubuntu install instructions plus test they work

apt-get install nodejs

integrate with paster

#2618: allow nested js resources

toby — Thu, 28 Jun 2012 10:07:43 GMT

#2626: ff render issue in edit dataset

toby — Thu, 05 Jul 2012 14:43:39 GMT

http://localhost:5000/dataset/edit/2010-nigeria-budget

the edit url button appears too high up

#2632: check allowed helpers exist

toby — Mon, 09 Jul 2012 09:56:51 GMT

in lib helpers make sure the allowed function lists functions exist or throw an error.

#2633: for dev always look for templates

toby — Mon, 09 Jul 2012 10:00:58 GMT

so we find newly created templates

#2634: change log - helper function limited in 1.8

toby — Mon, 09 Jul 2012 10:04:08 GMT

make sure documented

#2638: add a get from request param helper function

toby — Mon, 09 Jul 2012 14:36:37 GMT

#2646: delete dataset

toby — Tue, 10 Jul 2012 11:41:06 GMT

make it so

#2647: api bullshit button

toby — Tue, 10 Jul 2012 11:42:10 GMT

make it as a snippet calling thing like aron would love

#2652: get qa working with the demo

toby — Tue, 10 Jul 2012 16:21:55 GMT

#2661: delete dataset/group javascript confirm

toby — Wed, 11 Jul 2012 13:13:15 GMT

in 2375-demo-theme-development

templates/package/confirm_delete.html needs to be made to look nice note some writing in black

delete button needs nice home on dataset/edit

you can add js support add ?confirm=yes to url on dataset button to force delete

Please note delete is not yet implemented - but will be in the next few hours

#2664: tags with : cause crazy error message on add dataset in demo

toby — Wed, 11 Jul 2012 14:55:03 GMT

#2665: add dataset stages need to be form buttonable

toby — Wed, 11 Jul 2012 16:26:11 GMT

the stages snippet needs to be inside <form> so I can make some links buttons - eg stage 1 -> stage 2 I want to save the dataset not just move to add resource

if you can just move it within the form html leaving everything else the same - I can then add buttons and pass back for styling

#2666: templates/package/resource_edit.html

toby — Thu, 12 Jul 2012 09:12:53 GMT

There is a new template for editing resources outside of the add dataset logic

this is the template it just throws some crap onto the page at the moment - we need to create a form - the form will end up with the usual data/edit stuff but for now you can use the resource to populate the form and I can then change it to use data - I just want to know which fields we'll have

templates/package/resource_edit.html

when done reassign to me and I'll get it functioning

#2667: edit resource needs form

toby — Fri, 13 Jul 2012 09:01:43 GMT

I thought I'd made this ticket before but can't find it. When we have a fully created dataset we need to be able to edit the resources.

template: package/resource_edit.html

when you've made a form reassign to me and I'll get it working

#2669: style [Draft]

toby — Fri, 13 Jul 2012 10:08:30 GMT

I've added [Draft] to partial completed datasets in the package list and read commit 6a8e74d0

templates/snippets/package_list.html

templates/package/read.html

do you want to style them in some way?

#2671: fix allow_partial_update

toby — Fri, 13 Jul 2012 12:46:58 GMT

need to be able to delete stuff explicitly