-
Notifications
You must be signed in to change notification settings - Fork 156
[Zurich] Update Zurich_Population and Zurich_Population_Number_Of_Company_Workplace_Employees #2199
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Changes from all commits
14dcd68
cbbe5a0
ca1cfd4
8a027f3
23e7eb8
260a4a5
50747a5
3d3fc4f
7130dee
317d173
0e54f71
9e8a214
45032b4
811b2df
ec457dd
89f006a
06869ba
322dc76
6adfc0d
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,14 +1,14 @@ | ||
| parameter,value | ||
| url,https://www.stadt-zuerich.ch/content/dam/web/de/politik-verwaltung/statistik-und-daten/linked-open-data/datacommons/bev_3240_wiki.csv | ||
| url,https://data.stadt-zuerich.ch/dataset/bev_bestand_jahr_quartier_od3240 | ||
| description, | ||
| place_type,Country | ||
| place_type,City | ||
| #places_within, | ||
| start_date, | ||
| end_date, | ||
| release_frequency, | ||
| process, | ||
| comments, | ||
| output_columns,"observationAbout,observationDate,value,variableMeasured,unit" | ||
| output_columns,"observationAbout,observationDate,value,variableMeasured" | ||
| header_rows,1 | ||
| #input_rows,10 | ||
| #Import_Name,Zurich_Population | ||
| reconcile_nodes,False | ||
| output_counters,bev_3240_wiki/counters/zurich_population_bev_3240_wiki_counters.csv |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,37 @@ | ||
| key,prop,val,p1,v1 | ||
| StichtagDatJahr,observationDate,{Number},, | ||
| AnzBestWir,value,{Number},populationType,Person | ||
| wikiId,observationAbout,wikidataId/{Data},, | ||
| key,prop,val,p1,v1 | ||
| StichtagDatJahr,observationDate,{Number},, | ||
| AnzBestWir,value,{Number},populationType,Person | ||
| QuarLang:Rathaus,observationAbout,wikidataId/Q692511,, | ||
| QuarLang:Hochschulen,observationAbout,wikidataId/Q39240,, | ||
| QuarLang:Lindenhof,observationAbout,wikidataId/Q10987378,, | ||
| QuarLang:City,observationAbout,wikidataId/Q1093831,, | ||
| QuarLang:Wollishofen,observationAbout,wikidataId/Q642353,, | ||
| QuarLang:Leimbach,observationAbout,wikidataId/Q691367,, | ||
| QuarLang:Enge,observationAbout,wikidataId/Q648218,, | ||
| QuarLang:Alt-Wiedikon,observationAbout,wikidataId/Q433012,, | ||
| QuarLang:Friesenberg,observationAbout,wikidataId/Q693357,, | ||
| QuarLang:Sihlfeld,observationAbout,wikidataId/Q370104,, | ||
| QuarLang:Werd,observationAbout,wikidataId/Q531899,, | ||
| QuarLang:Langstrasse,observationAbout,wikidataId/Q1805410,, | ||
| QuarLang:Hard,observationAbout,wikidataId/Q870084,, | ||
| QuarLang:Gewerbeschule,observationAbout,wikidataId/Q693413,, | ||
| QuarLang:Escher Wyss,observationAbout,wikidataId/Q687052,, | ||
| QuarLang:Unterstrass,observationAbout,wikidataId/Q656446,, | ||
| QuarLang:Oberstrass,observationAbout,wikidataId/Q693483,, | ||
| QuarLang:Fluntern,observationAbout,wikidataId/Q693269,, | ||
| QuarLang:Hottingen,observationAbout,wikidataId/Q693454,, | ||
| QuarLang:Hirslanden,observationAbout,wikidataId/Q476940,, | ||
| QuarLang:Witikon,observationAbout,wikidataId/Q392079,, | ||
| QuarLang:Seefeld,observationAbout,wikidataId/Q692773,, | ||
| QuarLang:Mühlebach,observationAbout,wikidataId/Q693397,, | ||
| QuarLang:Weinegg,observationAbout,wikidataId/Q693321,, | ||
| QuarLang:Albisrieden,observationAbout,wikidataId/Q80797,, | ||
| QuarLang:Altstetten,observationAbout,wikidataId/Q445711,, | ||
| QuarLang:Höngg,observationAbout,wikidataId/Q455496,, | ||
| QuarLang:Wipkingen,observationAbout,wikidataId/Q678030,, | ||
| QuarLang:Affoltern,observationAbout,wikidataId/Q382903,, | ||
| QuarLang:Oerlikon,observationAbout,wikidataId/Q167179,, | ||
| QuarLang:Seebach,observationAbout,wikidataId/Q276792,, | ||
| QuarLang:Saatlen,observationAbout,wikidataId/Q652455,, | ||
| QuarLang:Schwamendingen-Mitte,observationAbout,wikidataId/Q692728,, | ||
| QuarLang:Hirzenbach,observationAbout,wikidataId/Q693374,, |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,25 +1,6 @@ | ||
| StichtagDatJahr,AnzBestWir,wikiId | ||
| 2023,3343,Q692511 | ||
| 2022,3330,Q692511 | ||
| 2021,3275,Q692511 | ||
| 2020,3317,Q692511 | ||
| 2019,3307,Q692511 | ||
| 2018,3267,Q692511 | ||
| 2017,3266,Q692511 | ||
| 2016,3226,Q692511 | ||
| 2015,3197,Q692511 | ||
| 2014,3236,Q692511 | ||
| 2013,3194,Q692511 | ||
| 2012,3164,Q692511 | ||
| 2011,3140,Q692511 | ||
| 2010,3099,Q692511 | ||
| 2009,3110,Q692511 | ||
| 2008,3051,Q692511 | ||
| 2007,3079,Q692511 | ||
| 2006,3097,Q692511 | ||
| 2005,3081,Q692511 | ||
| 2004,3115,Q692511 | ||
| 2003,3149,Q692511 | ||
| 2002,3128,Q692511 | ||
| 2001,3103,Q692511 | ||
| 2000,3109,Q692511 | ||
| StichtagDatJahr,QuarSort,QuarLang,AnzBestWir | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Lets keep no more than 5 records in all test files. Please try to minimise data as much as possible
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Done in commit 811b2dfa. Trimmed all test input CSV files ( |
||
| 2025,11,Rathaus,3252 | ||
| 2024,11,Rathaus,3260 | ||
| 2023,11,Rathaus,3343 | ||
| 2022,11,Rathaus,3330 | ||
| 2021,11,Rathaus,3275 | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,25 +1,6 @@ | ||
| observationAbout,observationDate,value,variableMeasured,unit | ||
| wikidataId/Q692511,2023,3343,dcid:Count_Person, | ||
| wikidataId/Q692511,2022,3330,dcid:Count_Person, | ||
| wikidataId/Q692511,2021,3275,dcid:Count_Person, | ||
| wikidataId/Q692511,2020,3317,dcid:Count_Person, | ||
| wikidataId/Q692511,2019,3307,dcid:Count_Person, | ||
| wikidataId/Q692511,2018,3267,dcid:Count_Person, | ||
| wikidataId/Q692511,2017,3266,dcid:Count_Person, | ||
| wikidataId/Q692511,2016,3226,dcid:Count_Person, | ||
| wikidataId/Q692511,2015,3197,dcid:Count_Person, | ||
| wikidataId/Q692511,2014,3236,dcid:Count_Person, | ||
| wikidataId/Q692511,2013,3194,dcid:Count_Person, | ||
| wikidataId/Q692511,2012,3164,dcid:Count_Person, | ||
| wikidataId/Q692511,2011,3140,dcid:Count_Person, | ||
| wikidataId/Q692511,2010,3099,dcid:Count_Person, | ||
| wikidataId/Q692511,2009,3110,dcid:Count_Person, | ||
| wikidataId/Q692511,2008,3051,dcid:Count_Person, | ||
| wikidataId/Q692511,2007,3079,dcid:Count_Person, | ||
| wikidataId/Q692511,2006,3097,dcid:Count_Person, | ||
| wikidataId/Q692511,2005,3081,dcid:Count_Person, | ||
| wikidataId/Q692511,2004,3115,dcid:Count_Person, | ||
| wikidataId/Q692511,2003,3149,dcid:Count_Person, | ||
| wikidataId/Q692511,2002,3128,dcid:Count_Person, | ||
| wikidataId/Q692511,2001,3103,dcid:Count_Person, | ||
| wikidataId/Q692511,2000,3109,dcid:Count_Person, | ||
| observationAbout,observationDate,value,variableMeasured | ||
| wikidataId/Q692511,2025,3252,dcid:Count_Person | ||
| wikidataId/Q692511,2024,3260,dcid:Count_Person | ||
| wikidataId/Q692511,2023,3343,dcid:Count_Person | ||
| wikidataId/Q692511,2022,3330,dcid:Count_Person | ||
| wikidataId/Q692511,2021,3275,dcid:Count_Person |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,7 +1,6 @@ | ||
| Node: E:bev_3240_wiki_output->E0 | ||
| observationAbout: C:bev_3240_wiki_output->observationAbout | ||
| observationDate: C:bev_3240_wiki_output->observationDate | ||
| value: C:bev_3240_wiki_output->value | ||
| variableMeasured: C:bev_3240_wiki_output->variableMeasured | ||
| unit: C:bev_3240_wiki_output->unit | ||
| Node: E:zurich_population_bev_3240_wiki_output->E0 | ||
| observationAbout: C:zurich_population_bev_3240_wiki_output->observationAbout | ||
| observationDate: C:zurich_population_bev_3240_wiki_output->observationDate | ||
| value: C:zurich_population_bev_3240_wiki_output->value | ||
| variableMeasured: C:zurich_population_bev_3240_wiki_output->variableMeasured | ||
| typeOf: dcs:StatVarObservation |
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,28 @@ | ||
| { | ||
| "schema_version": "1.0", | ||
| "rules": [ | ||
| { | ||
| "rule_id": "check_deleted_records_percent", | ||
| "description": "Checks that the percentage of deleted points is within the threshold.", | ||
| "validator": "DELETED_RECORDS_PERCENT", | ||
| "params": { | ||
| "threshold": 0.1 | ||
| } | ||
| }, | ||
| { | ||
| "rule_id": "check_max_date_consistent", | ||
| "description": "Checks if the MaxDate is the same for all StatVars.", | ||
| "validator": "MAX_DATE_CONSISTENT", | ||
| "params": {} | ||
| }, | ||
| { | ||
| "rule_id": "check_max_date_freshness", | ||
| "description": "Verifies that MaxDate meets the expected freshness threshold for the dataset.", | ||
| "validator": "SQL_VALIDATOR", | ||
| "params": { | ||
| "query": "SELECT MAX(MaxDate) >= '2025' AS is_fresh, COUNT(*) AS row_cnt FROM stats", | ||
| "condition": "is_fresh = TRUE AND row_cnt > 0" | ||
| } | ||
| } | ||
| ] | ||
| } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please add the logic and explanation for roll ups
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Done in commit 811b2dfa. Added detailed rollup logic and explanation to Section 3 (
Preprocessing Steps) ofstatvar_imports/zurich/README.mdcovering total row filtering (RechtsformSort == 0andBetriebsgrSort == 0), unknown region exclusion (RaumSort990/999), and numeric coercion of confidential markers ('K').