ticket PosixTime author newvalue 2502 1339407123000000 toby "{% snippet 'template_name', var=value, var2=value ... %} {% url_for(controller='foo', action='bar', ...) %} let me know if you want these changed eg remove need for () in url_for merged into demo branch they are just available in jinja templates no need to do anything special Let me know any problems or if you need some others added " 2445 1338375577000000 ross Yup. Will look at this Thurs when I'm back in. 366 1299845781000000 pudo You're right, that's done! 1358 1317748211000000 dread You're gonna have massive config files if you do this! Might well be worth it though. 1088 1302630624000000 wwaites "you use the negotiate function in autoneg.py with a cfg dictionary like this, {{{ cfg = { ""mime_types"": [ (""application/xhtml+xml"", [""html""]), (""text/html"", [""html""], (""application/rdf+xml"", [""rdf"", ""owl""]), (""application/turtle"", [""ttl""]), (""text/plain"", [""nt""]), (""text/x-graphviz"", [""dot""]), ] for content_type, exts in negotiate(cfg, accept_header): if ""html"" in exts: render page normally else: redirect to semantic.ckan.net } }}}" 1430 1320444567000000 pudo You probably know this by know but the solrconfig.xml for both points to /var/lib/solr/data (line 71). 1001 1301307814000000 dread You mentioned writing tests? Also the CSRF question from James hasn't been addressed. 2440 1339430956000000 toby "you may want to look at your css as the dataset is generated by the package_list snippet I've made all packages popular for now" 1104 1303744486000000 rgrp "You haven't done paster search-index rebuild I think. If you haven't the search index will not have been built (Create Test Data code creates data without indexing it). This could be considered a bug of Create Test Data but I'm not sure -- if you think so re-open this ticket and change description." 1123 1307795508000000 rgrp You can't get small amazon instances as 64 bit and many people's own machines are 32 bit. How costly is packaging no-arch exactly (it must be more than a simple 'switch' in the build if you are saying this is costly :-) ) 2769 1343328989000000 ross You can view this at http://test.ckan.org/apps to get an idea of how simple the form is. Have also moved the templates out of the package folder into their own now. 183 1290604779000000 dread You can see the top rated packages in the stats box. Actually not very useful at the moment - not much rating is going on. 963 1298284252000000 thejimmyg "You can now get CKAN from the repository http://apt-alpha.ckan.org/debian " 2676 1342512315000000 shevski Yes. Not as important as getting functional bits of JS working, this is a pretty 'nice to have' that I think will bring value. 1132 1307352675000000 dread "Yes, these are apparently search-related and so are skipped when testing under sqlite. See README.rst for more info. Compare with this: {{{ $ nosetests --ckan --with-pylons=test-core.ini ckan/tests/functional/test_authz.py ............................................ ---------------------------------------------------------------------- Ran 44 tests in 69.287s OK }}}" 1393 1318508765000000 johnglover "Yes, there are a few of these problems with SQLite which is why the tests are being skipped currently. I'm not exactly sure of the reason, it seems that it sometimes drops tables from memory, but we haven't found a solution. Myself and David Raznick were going to spend some time looking at it but haven't had a chance yet. " 651 1311171097000000 dread Yes, John fixed this. Changing to fixed. 1001 1300367555000000 thejimmyg Yes, I think the two should be consolidated, but as was noted elsewhere (I think) we don't want the API to ever be authenticated via a cookie, otherwise we open ourselves to CSRF attacks. Instead we could support the API key as a query parameter as an alternative to via the HTTP header if it is hard to set an HTTP header in JS libraries? 906 1328782087000000 amercader Yes, I don't think there will be any problem, and we won't need to create a new version of the schema as the change is backwards compatible. 1154 1314192324000000 dread Yes, forcing a retry may be possible, although I guess on these occasions you'd be looking at rolling back the creation of the package object too, which is not really in the spirit of the notifications system at present. This is why we had the queue for solr for occasions like this - is it here no longer? 161 1256114485000000 dread Yes, deleted tags are still listed and associated with a package. 2234 1337239588000000 ross Yes, definitely need a replacement for wordpresser and sooner rather than later. Doing some experimental noodling to work out an estimate. 1069 1310133794000000 thejimmyg Yes, and this will be more important in thedatahub.org 662 1288628902000000 dread "Yes we all agree this needs fixing it. I'm tempted by John's 'permissive' suggestion of ignoring these 'read-only' values, but to avoid confusion we should except with a 400 error if the user has changed these values. Read only fields: 'id', 'relationships', 'ratings_average', 'ratings_count', 'ckan_url' Use cases for changes between GET package, PUT package: 1. package unchanged - 200 OK 2. user changes id, ckan_url, relationships, ratings_* expecting that value to change - 400 error. 3. just license changes (but not license_id) - 400 error 4. both license and license_id change in step - 200 OK Does that sound reasonable John and Will?" 1167 1306856992000000 sebbacon "Yes to all the above. Further question: which extensions should be installed as standard? I would argue: * ckanext-stats * ckanext-googleanalytics * ckanext-disqus * ckanext-solr (implies installing a running solr, too...) * ckanext-follower * ckanext-admin Note that googleanalytics and disqus both require user accounts set up at the corresponding service. Not sure how we would handle this in the instance setup. " 1447 1330082808000000 dread Yes please Nils! 2497 1339085489000000 toby yes is ckan 1.7 issue 998 1298372171000000 dread Yes I agree - either of those sounds good. I think I've always used 'db init' in preference anyway. 2836 1344852009000000 aron.carroll "Yeah you can pass an html block into a macro like so: https://github.com/okfn/ckan/blob/2375-demo-theme-development/ckan/templates/package/snippets/resource_form.html#L44-48 What do you think? If it's useful I'll document it." 2595 1342086346000000 toby yadda, yadda, yadda - this should all be done any bugs are new tickets 1084 1303894555000000 dread ww you did this didn't you? Perhaps you could update us with the branch/changeset it was in and close this ticket please. 133 1273253977000000 dread "WUI and REST interfaces recently updated. You can't read, list or search for packages or groups not-authorised for. The only remaining view of a non-authorised group is that the group is named when viewing a package using all_fields option in REST interface. But no details of other packages in the group are given." 2575 1340188954000000 toby wtf I never added that I did write in an hour ago f****g trac 1001 1300704249000000 pudo Wrote a WDMMG version of this yesterday: https://bitbucket.org/okfn/wdmmg/changeset/398ce0eb3901#chg-wdmmg/lib/authenticator.py 1279 1314303732000000 rgrp Wow, that's a pretty big omission. authz groups are important and are used. I think we should discuss this in next planning meeting. 1065 1302033244000000 dread "Wow, lots of solutions here, and not enough evidence of the problems encountered / difficult use cases. I have tried here to extract what John and Seb might be suggesting is difficult with our current http://en.wikipedia.org/wiki/Role-based_access_control system. 1. (Seb) It seems crazy to change the User-Object-Roles for every single package to 'lockdown' a CKAN instance. Instead of using Roles 'reader' & 'editor' we start using Roles 'logged_in_user' and 'anon_user'. Then, with only changing a couple of lines of the Role-Action table for these Roles, you can give or remove permissions to edit / create packages, groups etc. 2. (John) Actions are being added all the time by migrations and extensions. I'm not sure what the problem is here - can someone explain? The separation of Users and the new Actions by adding the Role 'join' means the migration/extension can add existing Users with the new Actions. For example when we added the 'Group' protection object, logged in users could previously create groups, so it is natural to add this action to the 'editor' role. If you get rid of Roles, as John suggests, then you end up having to add as many Rights objects as users. And you might end up trying to infer new Rights on the basis of old Rights, rather than a role, which would be more natural. (Is the only reason to denormalise the UOR and RA tables the sake of ease of understanding? I would think we can explain the concept better now...!) 3. (John) This Group Hierarchy description sounds a bit like earlier incarnations of the DGU requirements. ""or any of his groups group-children (but not user-children)"" I'm not sure I understand the user-children bit, and I'm wary of any difficult-to-grasp concept. This modelling seems to take the UserGroup/User hierarchy model and use that as a hard-coded interpretation of the Authorized permission. In contrast, in DGU Evan split the Organisation Hierarchy model from the Authorization model. Each User has explicit permissions for each Organisation he is allowed to add/edit packages for. This helps for these two use cases we have to contend with: when a user is an admin for unrelated branches of the Organisation hierarchy, and when an Organisation is actually in two branches of the Organisation hierarchy. It also seems more generally flexible. " 2642 1344243797000000 shevski Would like to have this for next week for a demo if possible 1245 1311864530000000 annapowellsmith "Would be nice to list some extensions somewhere on this site (features page perhaps). Along the lines of: http://docs.ckan.org/extensions.html#finding-extensions It wasn't until I wrote this list that I realised just how many extensions there were, and what it said about the CKAN community that there were so many... So I think it would be a good sales point. " 1374 1317895709000000 dread Would be nice also to print the default language first in the list. 2678 1342512234000000 shevski Worth checking with Ross on this 2819 1344545479000000 toby "works in dev branch for /apps http://localhost:5000/dataset/1-kmwaterfractionfromnationaltopographicdatabasemapscanada/related" 2817 1344544901000000 toby "works in dev branch - may not be on s031 yet also please include urls in bug reports if possible - thanks" 2623 1341232433000000 seanh Works if you remember to enable publisher_auth (the Authorization button never appears, Join is always there, can Edit the org and add users that way) 2488 1339412538000000 johnglover "Works for me on 1.7.1. Perhaps floapps was using older groups (of type 'group' instead of 'organization') and/or didn't add a user to the group?" 1133 1324057072000000 dread "Works for me - change occurs successfully. {{{ (pyenv-ckan)dread@dread-laptop:~/gitroot/ckan$ paster rights add russianfan admin warandpeace /home/dread/gitroot/pyenv-ckan/lib/python2.6/site-packages/pylons/templating.py:610: UserWarning: Unbuilt egg for setuptools [unknown version] (/usr/lib/python2.6/dist-packages) Engine = entry_point.load() User russianfan -> is admin on -> Package warandpeace (pyenv-ckan)dread@dread-laptop:~/gitroot/ckan$ paster rights /home/dread/gitroot/pyenv-ckan/lib/python2.6/site-packages/pylons/templating.py:610: UserWarning: Unbuilt egg for setuptools [unknown version] (/usr/lib/python2.6/dist-packages) Engine = entry_point.load() 22 results User visitor -> is editor on -> Package annakarenina User logged_in -> is editor on -> Package annakarenina User testsysadmin -> is admin on -> System system User logged_in -> is editor on -> System system User visitor -> is reader on -> Group david User annafan -> is admin on -> Package annakarenina AuthorizationGroup anauthzgroup -> is reader on -> Package warandpeace User visitor -> is editor on -> Package warandpeace AuthorizationGroup anauthzgroup -> is editor on -> Group david User logged_in -> is editor on -> Package warandpeace User logged_in -> is reader on -> Group david User visitor -> is reader on -> Group roger User logged_in -> is reader on -> Group roger User russianfan -> is admin on -> Package warandpeace User visitor -> is admin on -> Package warandpeace AuthorizationGroup anotherauthzgroup -> is editor on -> AuthorizationGroup anauthzgroup User russianfan -> is admin on -> Group roger User russianfan -> is admin on -> Group david AuthorizationGroup anauthzgroup -> is admin on -> AuthorizationGroup anotherauthzgroup User visitor -> is anon_editor on -> System system User visitor -> is admin on -> Group roger AuthorizationGroup anauthzgroup -> is editor on -> System system }}} Tests would be nice, but it currently works, is only for admins and is therefore not as high priority as other other tests, such as front-end js." 2502 1339493182000000 aron.carroll "Works beautifully. Be great if we could remove the parens around url_for and add an extra one for h.nav_link but I think call it link_for instead. {{{ {% url_for controller='foo', action='bar', ... %} {% link_for controller='foo', action='bar', class='btn', icon='plus'... %} }}}" 1583 1327422386000000 zephod "Working on this on branch feature-1583-qa. https://github.com/okfn/ckan/tree/feature-1583-qa Design work is done, it needs integrating with the live API. That's all in the QA extension. Suggest all my work should be moved into the ckanext-qa extension and plugged into the API available there. Shouldnt have developed this in core after all." 1236 1311351476000000 dread Working on it on branch enh-1236-view-package-revision 191 1323706210000000 johnglover working in current master and 1.5.1 1683 1326975613000000 dread "Workaround done in branch defect-1683-search-order - SOLR is asked for one extra result which it then discards. Merged to master, aimed for release 1.5.2. When we upgrade SOLR from 1.4 then we can remove this workaround" 1003 1298490126000000 rgrp Work so far in http://bitbucket.org/rgrp/ckanjs 1135 1305210134000000 rgrp "Work on this is largely complete in changeset branch: https://bitbucket.org/okfn/vdm/src/changeset/ Overview docs: https://bitbucket.org/okfn/vdm/src/changeset/doc/changeset.rst" 2345 1336492725000000 seanh Work on this has started in branch feature-2345-action-api-autodocs 1630 1327313971000000 rgrp Work done so far 0.25d. Estimate completion by end of day. 1091 1323102767000000 rgrp wontfix plus we now requires usernames see #1386 1520 1323279697000000 rgrp wontfix in favour of #1534 (a proper fix) 1519 1324317373000000 rgrp "wontfix for present. * stats should go into core see #1576 * but analytics is more complex and requires more thought. Not really sure what integration buys us right now (though understand from a deployment / client perspective these together in some way so may be worth revisiting in future)" 92 1297344859000000 rgrp wontfix at the moment as we have the separate RDF service and RDFa is probably not the best option as always a bit incomplete. 205 1297068450000000 rgrp "wontfix as: 1. Easier to just to an import from google docs for which we have several importer examples in ckanclient 2. (More important) importing is something that is quite bespoke (changes for each cirumstance). As a result pre-written importers tend to be very fragile and it is not a good use of time to try and some customizable WUI one when you can just write a custom importer in code (code is much more flexible than whatever we can write!) " 807 1297075372000000 rgrp wontfix as with traffic we have this is not a massive issue and these are very minor items (we can reopen later if this comes up again). 1174 1307615200000000 pudo "wontfix as thejimmyg wants to turn REST API into RPC API and this doesn't fit in. Not an excellent plan in my idea but this is to be discussed elsewhere. " 944 1298571917000000 pudo Won't work on this for now - IATI is now running against plain CKAN but this is not deployed. We will continue work on this once IATI requests more functionality and shelf it for now. 99 1297081088000000 rgrp Won't fix as we are not using sqlalchemy any longer. 526 1340626152000000 icmurray Won't fix as it's 20 months old, and no feedback on whether it's still relevant or not. 2980 1350560137000000 seanh Won't do unless required by a specific client 293 1271940083000000 johnbywater "With the metastable revision of CKAN, the package resource data structure in ckanclient scripts must have all four keys set in the Resource-Dict. Setting 'hash' in the resource data cures this issues with ""metastable"". The ""bad"" code was: resources.append((res['url'], res['format'], res['description'], res['hash'])) KeyError: 'hash' This code was adjusted in revision 40c4fe04038d, to default unspecified resource attributes to the empty string. It was changed further in subsequent revisions, to use parameters of the Package.add_resource method to default unspecified values. However, the API doc doesn't mention the resource hash, although it is required, but I just fixed that in the source (in revision 0f20bfb45d13). http://knowledgeforge.net/ckan/doc/ckan/api.html " 1451 1322568784000000 dread With the cron job setup, maybe this is best left as an extension. The core CKAN was designed to be mean and lean. 1594 1328000053000000 rgrp With #1583 done this is lower priority so deferring into next major milestone. 789 1294248289000000 thejimmyg Will, this means that we just get given a URL to harvest from and we need to determine whether it is a CSW or a WAF. Can you look at this please? The code may already do it, I'm not sure. 449 1294411301000000 thejimmyg Will, if this is something you are interested in do you want to kick it off. Otherwise maybe close the ticket? 191 1305732285000000 dread "Will's suggestion is to have ""modified_since"" param, just as we have for Revision Search. Maybe we don't need a range. 'Order by modification' should be on by default for queries with 'modified_since' param." 429 1285757274000000 dread Will Waites fixed this a couple of weeks ago 509 1285757116000000 dread Will Waites did this a couple of weeks agoWill Waites did this a couple of weeks ago 496 1299164106000000 thejimmyg Will has implemented this now and OS have confirmed their export to GeoNetwork works. 1194 1317053688000000 dread Will go into ckan 1.5. 2302 1335516537000000 ross Will eventually want to allow customisation of different CSS but designs are currently under review/change. 1400 1329746131000000 johnglover Will document and update wiki this sprint then ping Mark about a blog post. 1508 1323168583000000 shevski Will deploy ext-spatial, need to build geo-search for DGU for searching for UKLP datasets - will discuss at next meeting 2346 1338205553000000 johnglover Will create a separate ticket for 'organization' to 'publisher' renaming, the rest are done. 764 1310133334000000 shevski will be done as part of #1094 2734 1343121017000000 shevski "Wierd. It always breaks for me. Maybe we go through this on skype. I just did it with a non-admin account. Steps: 1. Create new dataset. Name whatever, resource it a link (I use http://trac.ckan.org/ticket/2734) e.g. http://s031.okserver.org:2375/dataset/format-error-test 2. Once you've *finished* the dataset creation process you are on the main dataset page. Click on the resource you added. 3. Click on ""edit"" 4. Change resource field to ""html,"" for example and click on ""update resource"" 5. Error shows, clicking on ""update resource"" doesn't do anything. How about I do it and you watch via screen share?" 1613 1325866393000000 rgrp Why is this a problem. It is a very minor annoyance. I'd strongly vote for deferring and, if necessary at all, integrating with #1506 (UX improvements). 2900 1346335788000000 seanh Why does this only happen on user profile pages and not dataset search page or group read page? Looks like maybe only user profile page uses the package_list.html snippet 489 1294414420000000 thejimmyg Which RDF service? Why does it need model events? Will, any ideas or shall I close it? Thanks. 2432 1338325120000000 shevski "Where do new tickets go to await triaging? Is priority set by whoever creates the ticket? Does this get revised? Will we have a field for dev time estimate or where will this go?" 476 1294411741000000 thejimmyg Where did this requirement come from? Setting to wontfix for the timebeing. Feel free to re-open if there is a clear use case for this. 2322 1339749795000000 rgrp When will this go live? Will this be in v1.7.1? 1401 1326460993000000 dread "When javascript calls other scripts, it misses the mount-point prefix. e.g. application.js has hard-coded URL /api/2/util/is_slug_valid The URL prefix is stored in request.environ['SCRIPT_NAME'] so perhaps this value should be put in the HTML somewhere for the javascript to get at?" 1109 1305123852000000 dread What's the status? 1141 1318862183000000 dread What's the status of this now? The ckanext-moderatededits README still says you need a branch of ckan. Can you say which version of CKAN is required instead? I say we close this if ajax call is now in a better place in the API. (I expect it is now, with the logic layer). 954 1300447466000000 thejimmyg "What would also be really nice is a `help` key in the response which was always returned unless a query parameter of `?help=False` was sent. The help text could explain what the response meant but more importantly would show examples of other calls you can make with the IDs returned such that the whole API is discoverable without anyone ever needing to read any docs! It also means the API documentation is more likely to be up to date since it will be obvious to developers when it isn't. With help=False, the JSON can have all whitespace stripped too for production use. I also think there should be no distinction between GET and POST so that people can easily link to API calls if they want to." 466 1294411633000000 thejimmyg What was the original requirement? What's wrong with the current HTTP header name? Can we not mark this as wontfix for now and re-open if needed? 1177 1307360643000000 rgrp What revision of the CKAN code are you using (do hg id to get revision if installing from source). Have you modified the package template in any way? Have you restarted apache after upgrading? 1792 1332872069000000 dread "What is the changeset for this? There is evidence of a branch ""enhancement-1792-api-logic"" but perhaps this name got fast-forwarded out through a bad merge? Is this merged into 1.6.1 release?" 2781 1343907075000000 aron.carroll "What do you mean by ""hiding behind that black rectangle""? Just tried it locally with the text ""Welcome to the CKAN demo Try out standard CKAN functionality in a sandbox environment. Search for datasets directly from the homepage or by navigating to the Datasets search page where you can facet by tags, groups and format."" and it renders okay…" 2254 1332343198000000 toby "What do we want to be able to do? what do we use the stream stuff for at the moment? la la la" 1409 1319306802000000 rgrp What do we do for people without email addresses (no gravatar or a standard anonymous one?) 816 1312192499000000 rgrp "What about idea of 'model' refactor for resource, specifically to have: * format: human created format string with possible nesting e.g. zip:csv * kind: file | api | example | service * mimetype: standard mimetype (e.g. for zipped csv would be application/zip) * mimetype-inner: mimetype of innermost object (so for example would be text/csv) See http://lists.okfn.org/pipermail/ckan-discuss/2011-April/001139.html" 1378 1324047835000000 dread Went into release 1.5.1 1695 1330085001000000 dread Went into CKAN release 1.6 1396 1330086237000000 dread "Went into CKAN 1.6 " 1413 1330020486000000 dread "Went into CKAN 1.6 " 191 1330020677000000 dread Went into CKAN 1.6 1425 1330085282000000 dread Went into CKAN 1.6 1491 1330020630000000 dread went into CKAN 1.6 1528 1330020444000000 dread Went into CKAN 1.6 1536 1330020599000000 dread Went into CKAN 1.6 1547 1330084379000000 dread Went into CKAN 1.6 1630 1330085600000000 dread Went into CKAN 1.6 1493 1324474360000000 dread Went into CKAN 1.5.1. 1502 1324480415000000 dread Went into CKAN 1.5.1. 1586 1324480384000000 dread Went into CKAN 1.5.1 1236 1330019788000000 dread Went into CKAN 1.4.3 340 1328807317000000 dread Went into CKAN 1.0.2? 1456 1324472178000000 dread Went into 1.5.1 release 1141 1318862773000000 johnglover Well, it runs on datacatalogs.org with the current default so CKAN 1.5, but it needs quite a bit of updating to work with all of the new 1.5 UI changes, and as it has been a low priority for quite a while I haven't scheduled time to work on it. Really I would need to spend a few days on it to tidy it up for standard 1.5. 982 1297518386000000 anonymous Well we could transfer all the dependencies and version numbers to a config file for the fabfile, but we don't achieve much. 2660 1342090301000000 toby well not master but 2375-demo-theme-development which is good as 1718 1328093772000000 rgrp WEll known issue. Just needs an upgrade in jquery to 1.7. 1551 1346662048000000 ross Webstore appears to hav been deprecated in favour of datastore. 2601 1340960128000000 ross We've taken steps to make sure that users can't add datasets without a group, and can't remove a dataset from a group (without deleting it). Will submit patch to restrict adding without group. 2434 1341234522000000 seanh "We've moved to AWS hosting with docs generated by Jenkins instead, see: http://trac.okfn.org/ticket/1254 There are still two issues to resolve: 1. Automatically updating the symlink so that docs.ckan.org always redirects to the latest stable version 2. Finding somewhere to put links to all the other versions" 466 1282921608000000 dread We've agreed that we need another header for this, although it's not clear that it needs to be configurable. We could just accept Authorization OR the new one. 1022 1299512991000000 pudo "We're now using fileConfig to configure the logger API from the worker config file and this enables us to use SMTPHandler to send out error messages on queue processing failures. Marking as fixed. " 1594 1338203215000000 johnglover We're not using super tickets any more so closing this, most of the smaller tickets are still open however. 1723 1328533040000000 seanh We're not going to update the existing tag and package classes (as long as they don't break), going to add our own functional tests in a new file instead. 904 1299840539000000 rgrp We're already now into improving the docs and ticket:927 is now reasonably detailed. 985 1303118298000000 thejimmyg We'd like CKAN to CKAN harvesting this week if possible. 691 1294413010000000 thejimmyg We'd also fold up continuous series in search results behind newest sample package. So closing #749. 691 1294413993000000 thejimmyg "We'd also discuss package relationships ideas with JF so closing #444. " 963 1297850773000000 thejimmyg We will also remove all the different pip files as part of this fixing #982 at the same time. 662 1299755259000000 dread We want this fixed for CLG customer (DGU), so have put in a quick fix into branch 3.1.2 cset:0010a709edf0 (and merged to default) as a stopgap whilst new forms are on their way. 2251 1332776926000000 toby "we want resource show downloaded/viewed on resources show on the dataset total/recent" 318 1296482049000000 wwaites We still require form validation to check URIs. They are not free-form strings. This is not the same as 852 or necessarily included in it. 489 1294416189000000 wwaites "We still do need something like this. Right now the rdf generation is a cron job that crawls the API. Really we want two things: * only generate RDF for those packages that have changed * enable multiple client/worker processes, potentially run by third parties, to generate different parts of the RDF description. For example, it is reasonable that we generate the DCat representation ourselves, however the voiD authors (DCat is generic, voiD is about RDF datasets in particular) want to generate the voiD-specific annotations themselves and contribute it back to augment the catalogue. Another example: group curators may also want to annotate packages in their group with group-specific metadata. Yet another example: checks on the coherence, availability, quality, openness, etc. of a package should be done from time to time or when a package changes, which can result in further annotations (see the curate tool). Because of the ""third party"" aspect we cannot do this with the internal package representation and the rabbit queue. Most likely it is feasible to do this by looking at the revisions in the API to get all changes since the last time a script was run in which case most likely the answer is, yes, there is nothing to do here and the ticket can be closed." 1037 1303117000000000 thejimmyg "We spent last week integrating the new harvesting architecture and testing the code but there are still some areas that need looking at * The source type and label should be part of the plugin, not named in DGU. * Need warnings if a document changes but its date doesn't -> do we have these? * I noticed there are some tests in DGU, should these perhaps be in ckanext-harvest? * If active is False, the job should not be put on the queue * Log if the wrong type of URL is entered as an error the user can see * Deny if the source is already registered * Overwrite all extras, not just merge new ones. * During the import stage use iswms.py to add an extra during import if it is a WMS so that we can add a link to the WMS later https://gist.github.com/900878 * Can errors/warnings be logged in the import stage? Do all fetched documents get passed to import in one go? " 1321 1319558004000000 dread "We should not cache if there are flash messages to show (otherwise they get queued up for the next non-cached page view). Fixed in cset:945e2a6ce74f for release 1.5" 2699 1342788074000000 toby We should look at this next weekish 1608 1325586861000000 ross "We should consider some admin dashboard hooks for data such as total file storage usage+count " 1468 1322591997000000 dread "We originally talked about a command-line interface for deleting packages. I've done this here: #1499. Note: you can update the search index from a paster shell, simply by doing this before running your commands that edit packages: {{{ from ckan import plugins plugins.load('synchronous_search') }}} " 1383 1319405579000000 kindly We only added the Iresourceurlchange interface as we made the IDomainObjectModification include the Package. 803 1314031451000000 dread We now use nose to test migrations instead. 736 1304937755000000 thejimmyg "We now check WMS links. The CSW link checking could be more robust. New proposal is: Check that a URL with a / is treated the same way as one without. Treated as the same if same port, scheme, domain and path (ie query string and fragment are ignored, port is normalised away)" 346 1296477510000000 dread "We no longer use the ""Gdu"" SoS doc." 796 1291640040000000 rgrp We no longer have an alpha page due to refactor of search and usage of search for list view (see ticket:847 and subtickets). 2698 1343914688000000 aron.carroll "We need an api endpoint that can render a markdown string on submission. * Client posts a string of text to the endpoint. * Server responds with a 200, text/html response containing the rendered markdown. * Server returns a 400 and empty body if the content is not valid markdown. * Server returns a 500 and empty body if something else crashes. Alternatively for better error handling we could use a JSON transport. * Client posts a blob of json containing a ""content"" key with the markdown string. * Server returns a 200 (application/json) and blob of json with a ""content"" key with the rendered markdown. * Server returns a 400 (application/json) and blob of json with a ""error"" key containing a useful message for the user. * Server returns a 500 (application/json) and blob of json with a ""error"" key containing a useful message for the user. " 2739 1343135348000000 toby we need all the help text - moving to phase 3 754 1294408726000000 thejimmyg "We may not need to do any filtering in practice but if we did, the implementation would have these stages: * Add filter attribute to harvest source entity * Add filter field to harvest source form * Construct and send filtered CSW GetRecords request Thus these tickets can now be marked as duplicated: #755 #756 #759." 427 1294407533000000 thejimmyg We may need an updated form of the license service to support UKLP. 1118 1311174062000000 thejimmyg "We haven't ever come across this. Perhaps if you could provide an example we can re-open it. Cheers, James " 2251 1333535572000000 toby "we have various options on tracking unique users seems the sane approach. * unique daily view - needed for nice graphing * unique total views * total unique daily views - higher numbers and feels more right - easier to calculate if original data is lost/or archived for now will collect all and then decide which to use for display as gives us flexibility if needed display ------- why is group listing of datasets inconsistent with main search (TDH at least)? should we make these consistent? group listing allows downloading of resource without tracking (this should be fixed) if we make listings uniform do we want the download links or not? I don't like the term download when it is just a link (maybe that's just me - what would be better?)" 934 1323171047000000 thejimmyg We have other ways of solving this problem now rather than a key value store for plugins. Marking as invalid. 1615 1325774573000000 rgrp We have done several successful deploys behind a proxy server on apache. Any details of what didn't work? Worth adding details here: http://wiki.ckan.org/Deployment ? 1661 1338206091000000 ross We have another ticket for upgrading dependencies. 377 1338206330000000 ross We have another ticket for fixing the API 1246 1311863583000000 dread "We have an unresolved issue with the display of the 'open data' icon that showed up when we upgraded ckan.net to the latest beta last week, but I didn't realise the search page http://ckan.net/package was showing all packages as open (the revision page and package pages seem fine). Last week when I upgraded from 1.4.1 to 1.4.2beta, there was an exception thrown when loading the home page. The exception was in doing the isopen call. It was solved by making some code changes directly on the ckan.net server to make it an attribute query instead of function call. It was strange because this behaviour didn't occur on my machine and all the tests passed. Here are the manual patches on ckan.net (the application.js change is unrelated, by someone else): {{{ diff -r adf254b7c507 ckan/public/scripts/application.js --- a/ckan/public/scripts/application.js Sat Jul 23 18:16:15 2011 +0100 +++ b/ckan/public/scripts/application.js Thu Jul 28 14:10:23 2011 +0000 @@ -2,6 +2,7 @@ $(document).ready(function () { CKAN.Utils.setupUserAutocomplete($('input.autocomplete-user')); CKAN.Utils.setupAuthzGroupAutocomplete($('input.autocomplete-authzgroup')); + // $('.resource-url').parent( }); }(jQuery)); diff -r adf254b7c507 ckan/templates/_util.html --- a/ckan/templates/_util.html Sat Jul 23 18:16:15 2011 +0100 +++ b/ckan/templates/_util.html Thu Jul 28 14:10:23 2011 +0000 @@ -43,7 +43,7 @@ standard package listing -->