http://localhost/ticket/1144 <p> DSPL, the Dataset Publishing Language, is being promoted by Google for its "Google Public Data Explorer" system. It is an XML format with metadata. </p> <p> The format is described on the <a class="ext-link" href="http://code.google.com/apis/publicdata/docs/developer_guide.html"><span class="icon">​</span>developer docs ofthe Google Code site</a>. </p> <p> Google provides a <a class="ext-link" href="http://code.google.com/apis/publicdata/docs/dsplgen.html"><span class="icon">​</span>Python script which reads CSV data and generates DSPL</a> </p> <p> Sample from <a class="ext-link" href="http://code.google.com/apis/publicdata/docs/dspl_sample.html"><span class="icon">​</span>http://code.google.com/apis/publicdata/docs/dspl_sample.html</a>: </p> <div class="code"><pre> <span class="cp">&lt;?xml version="1.0" encoding="UTF-8"?&gt;</span> <span class="nt">&lt;dspl</span> <span class="na">xmlns=</span><span class="s">"http://schemas.google.com/dspl/2010"</span> <span class="na">xmlns:geo=</span><span class="s">"http://www.google.com/publicdata/dataset/google/geo"</span> <span class="na">xmlns:geo_usa=</span><span class="s">"http://www.google.com/publicdata/dataset/google/geo/us"</span> <span class="na">xmlns:time=</span><span class="s">"http://www.google.com/publicdata/dataset/google/time"</span> <span class="na">xmlns:quantity=</span><span class="s">"http://www.google.com/publicdata/dataset/google/quantity"</span> <span class="na">xmlns:entity=</span><span class="s">"http://www.google.com/publicdata/dataset/google/entity"</span><span class="nt">&gt;</span> <span class="nt">&lt;import</span> <span class="na">namespace=</span><span class="s">"http://www.google.com/publicdata/dataset/google/time"</span><span class="nt">/&gt;</span> <span class="nt">&lt;import</span> <span class="na">namespace=</span><span class="s">"http://www.google.com/publicdata/dataset/google/quantity"</span><span class="nt">/&gt;</span> <span class="nt">&lt;import</span> <span class="na">namespace=</span><span class="s">"http://www.google.com/publicdata/dataset/google/entity"</span><span class="nt">/&gt;</span> <span class="nt">&lt;import</span> <span class="na">namespace=</span><span class="s">"http://www.google.com/publicdata/dataset/google/geo"</span><span class="nt">/&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;</span> <span class="nt">&lt;value&gt;</span>My statistics<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/name&gt;</span> <span class="nt">&lt;description&gt;</span> <span class="nt">&lt;value&gt;</span>Some very interesting statistics about countries<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/description&gt;</span> <span class="nt">&lt;url&gt;</span> <span class="nt">&lt;value&gt;</span>http://www.stats-bureau.com/mystats/info.html<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/url&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;provider&gt;</span> <span class="nt">&lt;name&gt;</span> <span class="nt">&lt;value&gt;</span>Bureau of Statistics<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/name&gt;</span> <span class="nt">&lt;url&gt;</span> <span class="nt">&lt;value&gt;</span>http://www.stats-bureau.com<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/url&gt;</span> <span class="nt">&lt;/provider&gt;</span> <span class="nt">&lt;topics&gt;</span> <span class="nt">&lt;topic</span> <span class="na">id=</span><span class="s">"geography"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;&lt;value&gt;</span>Geography<span class="nt">&lt;/value&gt;&lt;/name&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;/topic&gt;</span> <span class="nt">&lt;topic</span> <span class="na">id=</span><span class="s">"social_indicators"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;&lt;value&gt;</span>Social indicators<span class="nt">&lt;/value&gt;&lt;/name&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;topic</span> <span class="na">id=</span><span class="s">"population_indicators"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;&lt;value&gt;</span>Population indicators<span class="nt">&lt;/value&gt;&lt;/name&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;/topic&gt;</span> <span class="nt">&lt;topic</span> <span class="na">id=</span><span class="s">"poverty_and_income"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;&lt;value&gt;</span>Poverty <span class="err">&amp;</span> income<span class="nt">&lt;/value&gt;&lt;/name&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;/topic&gt;</span> <span class="nt">&lt;topic</span> <span class="na">id=</span><span class="s">"health"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;&lt;value&gt;</span>Health<span class="nt">&lt;/value&gt;&lt;/name&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;/topic&gt;</span> <span class="nt">&lt;/topic&gt;</span> <span class="nt">&lt;/topics&gt;</span> <span class="nt">&lt;concepts&gt;</span> <span class="c">&lt;!-- As noted in the tutorial, this concept should extend quantity:amount.--&gt;</span> <span class="nt">&lt;concept</span> <span class="na">id=</span><span class="s">"population"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;</span> <span class="nt">&lt;value&gt;</span>Population<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/name&gt;</span> <span class="nt">&lt;description&gt;</span> <span class="nt">&lt;value&gt;</span>Size of the resident population.<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/description&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;topic</span> <span class="na">ref=</span><span class="s">"population_indicators"</span><span class="nt">/&gt;</span> <span class="nt">&lt;type</span> <span class="na">ref=</span><span class="s">"integer"</span><span class="nt">/&gt;</span> <span class="nt">&lt;/concept&gt;</span> <span class="c">&lt;!-- This country concept is defined for educational purposes only. A country concept exists in the Google geo dataset. See: http://code.google.com/apis/publicdata/docs/canonical/geo.html --&gt;</span> <span class="nt">&lt;concept</span> <span class="na">id=</span><span class="s">"country"</span> <span class="na">extends=</span><span class="s">"geo:location"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;</span> <span class="nt">&lt;value&gt;</span>Country<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/name&gt;</span> <span class="nt">&lt;description&gt;</span> <span class="nt">&lt;value&gt;</span>My list of countries<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/description&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;type</span> <span class="na">ref=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;property</span> <span class="na">id=</span><span class="s">"name"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;&lt;value</span> <span class="na">xml:lang=</span><span class="s">"en"</span><span class="nt">&gt;</span>Country name<span class="nt">&lt;/value&gt;&lt;/name&gt;</span> <span class="nt">&lt;description&gt;</span> <span class="nt">&lt;value</span> <span class="na">xml:lang=</span><span class="s">"en"</span><span class="nt">&gt;</span>The official name of the country<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/description&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;type</span> <span class="na">ref=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;/property&gt;</span> <span class="nt">&lt;table</span> <span class="na">ref=</span><span class="s">"countries_table"</span><span class="nt">/&gt;</span> <span class="nt">&lt;/concept&gt;</span> <span class="c">&lt;!-- This US state concept is defined for educational purposes only. A US state concept exists in the Google geo US dataset. See: http://code.google.com/apis/publicdata/docs/canonical/geo.us.html --&gt;</span> <span class="nt">&lt;concept</span> <span class="na">id=</span><span class="s">"state"</span> <span class="na">extends=</span><span class="s">"geo:location"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;</span> <span class="nt">&lt;value&gt;</span>State<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/name&gt;</span> <span class="nt">&lt;description&gt;</span> <span class="nt">&lt;value&gt;</span>US states<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/description&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;type</span> <span class="na">ref=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;property</span> <span class="na">concept=</span><span class="s">"country"</span> <span class="na">isParent=</span><span class="s">"true"</span><span class="nt">/&gt;</span> <span class="nt">&lt;table</span> <span class="na">ref=</span><span class="s">"states_table"</span><span class="nt">/&gt;</span> <span class="nt">&lt;/concept&gt;</span> <span class="nt">&lt;concept</span> <span class="na">id=</span><span class="s">"gender"</span> <span class="na">extends=</span><span class="s">"entity:entity"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;</span> <span class="nt">&lt;value&gt;</span>Gender<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/name&gt;</span> <span class="nt">&lt;description&gt;</span> <span class="nt">&lt;value&gt;</span>Gender, Male or Female<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/description&gt;</span> <span class="nt">&lt;pluralName&gt;&lt;value&gt;</span>Genders<span class="nt">&lt;/value&gt;&lt;/pluralName&gt;</span> <span class="nt">&lt;totalName&gt;&lt;value&gt;</span>Both genders<span class="nt">&lt;/value&gt;&lt;/totalName&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;type</span> <span class="na">ref=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;table</span> <span class="na">ref=</span><span class="s">"genders_table"</span><span class="nt">/&gt;</span> <span class="nt">&lt;/concept&gt;</span> <span class="nt">&lt;concept</span> <span class="na">id=</span><span class="s">"unemployment_rate"</span> <span class="na">extends=</span><span class="s">"quantity:rate"</span><span class="nt">&gt;</span> <span class="nt">&lt;info&gt;</span> <span class="nt">&lt;name&gt;</span> <span class="nt">&lt;value&gt;</span>unemployment rate<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/name&gt;</span> <span class="nt">&lt;description&gt;</span> <span class="nt">&lt;value&gt;</span>The percent of the labor force that is unemployed, not seasonally adjusted.<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/description&gt;</span> <span class="nt">&lt;url&gt;&lt;value&gt;</span>http://www.bls.gov/cps/cps_htgm.htm<span class="nt">&lt;/value&gt;&lt;/url&gt;</span> <span class="nt">&lt;/info&gt;</span> <span class="nt">&lt;topic</span> <span class="na">ref=</span><span class="s">"social_indicators"</span><span class="nt">/&gt;</span> <span class="nt">&lt;type</span> <span class="na">ref=</span><span class="s">"float"</span><span class="nt">/&gt;</span> <span class="nt">&lt;attribute</span> <span class="na">id=</span><span class="s">"is_percentage"</span><span class="nt">&gt;</span> <span class="nt">&lt;type</span> <span class="na">ref=</span><span class="s">"boolean"</span><span class="nt">/&gt;</span> <span class="nt">&lt;value&gt;</span>true<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/attribute&gt;</span> <span class="nt">&lt;/concept&gt;</span> <span class="nt">&lt;/concepts&gt;</span> <span class="nt">&lt;slices&gt;</span> <span class="nt">&lt;slice</span> <span class="na">id=</span><span class="s">"countries_slice"</span><span class="nt">&gt;</span> <span class="nt">&lt;dimension</span> <span class="na">concept=</span><span class="s">"country"</span><span class="nt">/&gt;</span> <span class="nt">&lt;dimension</span> <span class="na">concept=</span><span class="s">"time:year"</span><span class="nt">/&gt;</span> <span class="nt">&lt;metric</span> <span class="na">concept=</span><span class="s">"population"</span><span class="nt">/&gt;</span> <span class="nt">&lt;table</span> <span class="na">ref=</span><span class="s">"countries_slice_table"</span><span class="nt">/&gt;</span> <span class="nt">&lt;/slice&gt;</span> <span class="nt">&lt;slice</span> <span class="na">id=</span><span class="s">"states_slice"</span><span class="nt">&gt;</span> <span class="nt">&lt;dimension</span> <span class="na">concept=</span><span class="s">"state"</span><span class="nt">/&gt;</span> <span class="nt">&lt;dimension</span> <span class="na">concept=</span><span class="s">"time:year"</span><span class="nt">/&gt;</span> <span class="nt">&lt;metric</span> <span class="na">concept=</span><span class="s">"population"</span><span class="nt">/&gt;</span> <span class="nt">&lt;metric</span> <span class="na">concept=</span><span class="s">"unemployment_rate"</span><span class="nt">/&gt;</span> <span class="nt">&lt;table</span> <span class="na">ref=</span><span class="s">"states_slice_table"</span><span class="nt">/&gt;</span> <span class="nt">&lt;/slice&gt;</span> <span class="nt">&lt;slice</span> <span class="na">id=</span><span class="s">"countries_gender_slice"</span><span class="nt">&gt;</span> <span class="nt">&lt;dimension</span> <span class="na">concept=</span><span class="s">"country"</span><span class="nt">/&gt;</span> <span class="nt">&lt;dimension</span> <span class="na">concept=</span><span class="s">"gender"</span><span class="nt">/&gt;</span> <span class="nt">&lt;dimension</span> <span class="na">concept=</span><span class="s">"time:year"</span><span class="nt">/&gt;</span> <span class="nt">&lt;metric</span> <span class="na">concept=</span><span class="s">"population"</span><span class="nt">/&gt;</span> <span class="nt">&lt;table</span> <span class="na">ref=</span><span class="s">"countries_gender_slice_table"</span><span class="nt">/&gt;</span> <span class="nt">&lt;/slice&gt;</span> <span class="nt">&lt;/slices&gt;</span> <span class="nt">&lt;tables&gt;</span> <span class="nt">&lt;table</span> <span class="na">id=</span><span class="s">"countries_table"</span><span class="nt">&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"country"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"name"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"latitude"</span> <span class="na">type=</span><span class="s">"float"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"longitude"</span> <span class="na">type=</span><span class="s">"float"</span><span class="nt">/&gt;</span> <span class="nt">&lt;data&gt;</span> <span class="nt">&lt;file</span> <span class="na">format=</span><span class="s">"csv"</span> <span class="na">encoding=</span><span class="s">"utf-8"</span><span class="nt">&gt;</span>countries.csv<span class="nt">&lt;/file&gt;</span> <span class="nt">&lt;/data&gt;</span> <span class="nt">&lt;/table&gt;</span> <span class="nt">&lt;table</span> <span class="na">id=</span><span class="s">"countries_slice_table"</span><span class="nt">&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"country"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"year"</span> <span class="na">type=</span><span class="s">"date"</span> <span class="na">format=</span><span class="s">"yyyy"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"population"</span> <span class="na">type=</span><span class="s">"integer"</span><span class="nt">/&gt;</span> <span class="nt">&lt;data&gt;</span> <span class="nt">&lt;file</span> <span class="na">format=</span><span class="s">"csv"</span> <span class="na">encoding=</span><span class="s">"utf-8"</span><span class="nt">&gt;</span>country_slice.csv<span class="nt">&lt;/file&gt;</span> <span class="nt">&lt;/data&gt;</span> <span class="nt">&lt;/table&gt;</span> <span class="nt">&lt;table</span> <span class="na">id=</span><span class="s">"states_table"</span><span class="nt">&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"state"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"name"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"country"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">&gt;</span> <span class="nt">&lt;value&gt;</span>US<span class="nt">&lt;/value&gt;</span> <span class="nt">&lt;/column&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"latitude"</span> <span class="na">type=</span><span class="s">"float"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"longitude"</span> <span class="na">type=</span><span class="s">"float"</span><span class="nt">/&gt;</span> <span class="nt">&lt;data&gt;</span> <span class="nt">&lt;file</span> <span class="na">format=</span><span class="s">"csv"</span> <span class="na">encoding=</span><span class="s">"utf-8"</span><span class="nt">&gt;</span>states.csv<span class="nt">&lt;/file&gt;</span> <span class="nt">&lt;/data&gt;</span> <span class="nt">&lt;/table&gt;</span> <span class="nt">&lt;table</span> <span class="na">id=</span><span class="s">"states_slice_table"</span><span class="nt">&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"state"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"year"</span> <span class="na">type=</span><span class="s">"date"</span> <span class="na">format=</span><span class="s">"yyyy"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"population"</span> <span class="na">type=</span><span class="s">"integer"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"unemployment_rate"</span> <span class="na">type=</span><span class="s">"float"</span><span class="nt">/&gt;</span> <span class="nt">&lt;data&gt;</span> <span class="nt">&lt;file</span> <span class="na">format=</span><span class="s">"csv"</span> <span class="na">encoding=</span><span class="s">"utf-8"</span><span class="nt">&gt;</span>state_slice.csv<span class="nt">&lt;/file&gt;</span> <span class="nt">&lt;/data&gt;</span> <span class="nt">&lt;/table&gt;</span> <span class="nt">&lt;table</span> <span class="na">id=</span><span class="s">"genders_table"</span><span class="nt">&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"gender"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"name"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;data&gt;</span> <span class="nt">&lt;file</span> <span class="na">format=</span><span class="s">"csv"</span> <span class="na">encoding=</span><span class="s">"utf-8"</span><span class="nt">&gt;</span>genders.csv<span class="nt">&lt;/file&gt;</span> <span class="nt">&lt;/data&gt;</span> <span class="nt">&lt;/table&gt;</span> <span class="nt">&lt;table</span> <span class="na">id=</span><span class="s">"countries_gender_slice_table"</span><span class="nt">&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"country"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"gender"</span> <span class="na">type=</span><span class="s">"string"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"year"</span> <span class="na">type=</span><span class="s">"date"</span> <span class="na">format=</span><span class="s">"yyyy"</span><span class="nt">/&gt;</span> <span class="nt">&lt;column</span> <span class="na">id=</span><span class="s">"population"</span> <span class="na">type=</span><span class="s">"integer"</span><span class="nt">/&gt;</span> <span class="nt">&lt;data&gt;</span> <span class="nt">&lt;file</span> <span class="na">format=</span><span class="s">"csv"</span> <span class="na">encoding=</span><span class="s">"utf-8"</span><span class="nt">&gt;</span>gender_country_slice.csv<span class="nt">&lt;/file&gt;</span> <span class="nt">&lt;/data&gt;</span> <span class="nt">&lt;/table&gt;</span> <span class="nt">&lt;/tables&gt;</span> <span class="nt">&lt;/dspl&gt;</span> </pre></div> en-us http://assets.okfn.org/p/ckan/img/ckan_logo_shortname.png http://localhost/ticket/1144 Trac 0.12.3 seanh Fri, 15 Jun 2012 15:35:17 GMT http://localhost/ticket/1144#comment:1 http://localhost/ticket/1144#comment:1 <ul> <li><strong>milestone</strong> set to <em>ckan-backlog</em> </li> </ul> Ticket