Ticket #1128 (closed task: fixed)

Opened 3 years ago

Last modified 3 years ago

Upload Scotland gov data

Reported by: dread Owned by: dread
Priority: major Milestone: ckan-sprint-2011-10-28
Component: ckan Keywords:
Cc: Repository: ckan
Theme: none

Description

Upload to ckan.net: ​https://sites.google.com/site/scotlandsdata/

Attachments

scotland-2010-10-18.csv​ (10.1 KB) - added by dread 3 years ago.
Data with title column added in manually

Change History

comment:1 Changed 3 years ago by dread

  • Milestone changed from ckan-v1.4-sprint-7 to ckan-v1.5-sprint-1

comment:2 Changed 3 years ago by dread

  • Milestone changed from ckan-v1.5-sprint-1 to ckan-v1.5-sprint-2

comment:3 Changed 3 years ago by dread

  • Milestone changed from ckan-v1.5-sprint-2 to ckan-v1.5-sprint-3

comment:4 Changed 3 years ago by dread

  • Milestone changed from ckan-v1.5-sprint-3 to ckan-v1.5

comment:5 Changed 3 years ago by shevski

  • Milestone changed from ckan-v1.5 to ckan-current-sprint

comment:6 Changed 3 years ago by dread

  • Status changed from new to closed
  • Resolution set to fixed

Loader in ckanext/bin/loadscotland.py. Done upload to ckan.net: 

(pyenv-ckanext)dread@dread-laptop:~/hgroot/ckanext$ scotland_loader -k xyz -H http://ckan.net/api /home/dread/ckan-local/data/scotland-2010-10-18.csv
/home/dread/hgroot/pyenv-ckanext/lib/python2.6/site-packages/pylons/templating.py:610: UserWarning: Unbuilt egg for setuptools [unknown version] (/usr/lib/python2.6/dist-packages)
  Engine = entry_point.load()
No handlers could be found for logger "vdm"
2011-07-13 15:29:17,983 INFO  [ckanext.importlib.loader] Loading scottish_neighbourhood_statistics
2011-07-13 15:29:20,109 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:22,089 INFO  [ckanext.importlib.loader] Loading traveline_scotland
2011-07-13 15:29:24,579 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:27,045 INFO  [ckanext.importlib.loader] Loading sqa_qualifications
2011-07-13 15:29:30,869 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:32,561 INFO  [ckanext.importlib.loader] Loading scotxed
2011-07-13 15:29:34,017 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:35,286 INFO  [ckanext.importlib.loader] Loading iscjis_vocabularies
2011-07-13 15:29:36,592 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:37,782 INFO  [ckanext.importlib.loader] Loading ecare_multi-agency_store_data_model_and_vocabulary
2011-07-13 15:29:39,043 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:40,267 INFO  [ckanext.importlib.loader] Loading digital_archive_scottish_archive_network
2011-07-13 15:29:41,690 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:43,727 INFO  [ckanext.importlib.loader] Loading the_scottish_register_of_tartans
2011-07-13 15:29:45,159 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:46,816 INFO  [ckanext.importlib.loader] Loading scotlands_images
2011-07-13 15:29:48,563 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:49,983 INFO  [ckanext.importlib.loader] Loading national_library_of_scotland
2011-07-13 15:29:51,709 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:53,122 INFO  [ckanext.importlib.loader] Loading scottish_government_statistics
2011-07-13 15:29:55,857 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:29:57,118 INFO  [ckanext.importlib.loader] Loading scotbis
2011-07-13 15:29:58,883 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:00,264 INFO  [ckanext.importlib.loader] Loading historic_scotland
2011-07-13 15:30:02,086 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:03,609 INFO  [ckanext.importlib.loader] Loading scheduled_monuments_in_scotland
2011-07-13 15:30:05,057 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:06,987 INFO  [ckanext.importlib.loader] Loading scotlands_house_prices_service_consumer_information
2011-07-13 15:30:08,687 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:09,932 INFO  [ckanext.importlib.loader] Loading air_quality_in_scotland
2011-07-13 15:30:11,278 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:12,637 INFO  [ckanext.importlib.loader] Loading river_and_coastal_flooding_updates_for_scotland
2011-07-13 15:30:13,940 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:15,637 INFO  [ckanext.importlib.loader] Loading public_contracts_scotland
2011-07-13 15:30:17,280 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:18,666 INFO  [ckanext.importlib.loader] Loading scottish_government_consultations
2011-07-13 15:30:20,673 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:22,234 INFO  [ckanext.importlib.loader] Loading scottish_public_health_observatory
2011-07-13 15:30:24,025 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:26,297 INFO  [ckanext.importlib.loader] Loading scotlands_information_landscape
2011-07-13 15:30:28,308 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:29,758 INFO  [ckanext.importlib.loader] Loading isd_scotland
2011-07-13 15:30:31,847 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:33,074 INFO  [ckanext.importlib.loader] Loading scotlandspeople
2011-07-13 15:30:34,541 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:35,754 INFO  [ckanext.importlib.loader] Loading general_register_office_for_scotland_statistics
2011-07-13 15:30:37,273 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:39,330 INFO  [ckanext.importlib.loader] Loading baseline_scotland_-_groundwater_chemistry_data
2011-07-13 15:30:40,716 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:41,919 INFO  [ckanext.importlib.loader] Loading the_centre_for_the_study_of_retailing_in_scotland_data_sets
2011-07-13 15:30:43,275 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:44,515 INFO  [ckanext.importlib.loader] Loading growing_up_in_scotland
2011-07-13 15:30:46,215 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:47,582 INFO  [ckanext.importlib.loader] Loading scottish_parliament_msp_allowances
2011-07-13 15:30:49,580 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:51,272 INFO  [ckanext.importlib.loader] Loading scottish_government_ministerial_hospitality
2011-07-13 15:30:53,764 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:55,642 INFO  [ckanext.importlib.loader] Loading scottish_government_expenditure_over_25000
2011-07-13 15:30:58,012 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:30:59,674 INFO  [ckanext.importlib.loader] Loading scottish_local_government_financial_statistics
2011-07-13 15:31:01,869 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:31:03,382 INFO  [ckanext.importlib.loader] Loading scottish_government_disclosure_of_high_earners
2011-07-13 15:31:07,086 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:31:11,493 INFO  [ckanext.importlib.loader] Loading scotlands_places
2011-07-13 15:31:14,452 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:31:31,743 INFO  [ckanext.importlib.loader] Loading scottish_national_heritage_facts
2011-07-13 15:31:36,223 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:31:37,830 INFO  [ckanext.importlib.loader] Loading scottish_natural_spaces
2011-07-13 15:31:40,245 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:31:41,764 INFO  [ckanext.importlib.loader] Loading scotland_national_address_gazetteer
2011-07-13 15:31:43,810 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:31:45,069 INFO  [ckanext.importlib.loader] Loading scottish_environment_protection_agency
2011-07-13 15:31:47,975 INFO  [ckanext.importlib.loader] ...creating package
2011-07-13 15:31:49,525 INFO  [ckanext.importlib.loader] Loading traffic_scotland
2011-07-13 15:31:52,396 INFO  [ckanext.importlib.loader] ...creating package

Changed 3 years ago by dread

Data with title column added in manually

comment:7 Changed 3 years ago by dread

Note, I added a title column and made one or two minor corrections that I spotted - see attached CSV for the result.

Note: See TracTickets for help on using tickets.