drj11 / canada-temperature-data

Canada Temperature


Data and metadata for Environment Canada Weather Stations.

The schema is just about designed so that any monthly meteorological variable (max temps, mean temps, precipitation) can be recorded. For the current scraper, monthly means of daily mean min and max temperatures are stored (the source CSV files record many more variables). Pay attention to flags, some data is estimated.

SCHEMA BEING REVISED

In the swdata table the unique key is (id,element,year).
element is, for data: ‘tmeanM’ daily mean temperature averaged over the month; ‘tminM’ daily minimum temperature; ‘tmaxM’ daily maximum temperature.
element is, for flags: ‘tmeanMflag’, ‘tminMflag’, ‘tmaxMflag’ are flags for the corresponding data value. These flags are copied from Environment Canada. Seem to be:
“[Empty]”,“No Data Available”
“M”,“Missing”
“E”,“Estimated”
“B”,“More Than One Occurrence and Estimated”
“I”,“The value displayed is based on incomplete data”
“S”,“More than One Occurrence”
“T”,“Trace”

id is a GHCN style 11 character identifier for the station (derived from the identifers that Environment Canada uses). Note: contains non-digits.
year specifies the year.

Each row contains data for 12 months, columns M01 through to M12.

I use this to analyse temperature changes in the arctic zone, using ccc-gistemp: see this blog post.

Forked from ScraperWiki

Contributors drj11

This scraper has not yet been run

Data

Downloaded 3 times by korolyovk dubej00 MikeRalphson

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (0 Bytes) Use the API

rows 10 / 791414

M11 M10 element M06 M07 M04 M05 M03 year M12 id M08 M09 M01 M02
-9.50
tmeanM
1959
-8.10
CAE4014145_
tmeanMflag
1959
CAE4014145_
-6.70
5.30
tmeanM
14.60
19.50
1.60
11.20
-12.50
1960
-13.60
CAE4014145_
17.90
12.50
-20.50
-15.90
tmeanMflag
1960
CAE4014145_
-6.10
5.00
tmeanM
17.50
18.90
1.00
10.20
-4.80
1961
-19.50
CAE4014145_
20.20
9.30
-16.40
-12.00
tmeanMflag
1961
CAE4014145_
-1.40
6.50
tmeanM
17.10
16.40
2.00
9.30
-9.70
1962
-12.70
CAE4014145_
17.20
10.00
-18.80
-20.10
tmeanMflag
1962
CAE4014145_
-4.40
10.60
tmeanM
15.40
19.40
3.60
9.00
-5.90
1963
-15.40
CAE4014145_
18.00
13.20
-20.40
-15.80
tmeanMflag
1963
CAE4014145_

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (0 Bytes) Use the API

rows 10 / 18025

id element monthmin monthmax yearmin yearmax monthcount
CAE4014145_
tmeanM
1959-11
2007-11
1959
2007
481
CAE4014145_
tminM
1959-11
2007-11
1959
2007
481
CAE4014145_
tmaxM
1959-11
2007-11
1959
2007
482
CAE1178339_
tmeanM
1914-01
1975-04
1914
1975
707
CAE1178339_
tminM
1914-01
1975-04
1914
1975
708
CAE1178339_
tmaxM
1914-01
1975-04
1914
1975
709
CAE6045572_
tmeanM
1954-06
1957-06
1954
1957
17
CAE6045572_
tminM
1954-06
1957-06
1954
1957
17
CAE6045572_
tmaxM
1954-05
1957-06
1954
1957
18
CAE1012040_
tmeanM
1949-04
2007-02
1949
2007
687

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (0 Bytes) Use the API

rows 10 / 8231

id Station Name WMO Identifier Latitude Longitude touched webid source Province Elevation Climate Identifier TC Identifier element session rowmin rowmax clocked clockedsave
CAE4014145_
LANGENBURG
50.90
-101.72
2011-09-16T17:54:10.238
2941
SASKATCHEWAN
516.60
4014145
meta
1959-01
2007-11
0.14000000000000012
0.050000000000000266
CAE1178339_
VALEMOUNT
52.82
-119.25
2011-09-16T17:54:10.238
1380
BRITISH COLUMBIA
797.10
1178339
meta
1914-01
1975-12
0.1800000000000006
0.0600000000000005
CAE6045572_
NAKINA FORESTRY
50.18
-86.70
2011-09-16T17:54:10.238
4030
ONTARIO
320.60
6045572
meta
1929-01
1959-12
0.04999999999999982
0.009999999999999787
CAE1012040_
COWICHAN LAKE FORESTRY
48.82
-124.13
2011-09-16T17:54:10.238
37
BRITISH COLUMBIA
176.80
1012040
meta
1949-01
2007-02
0.17999999999999972
0.05999999999999961
CAE5041425_
KELWOOD
50.62
-99.47
2011-09-16T17:54:10.238
3807
MANITOBA
352.00
5041425
meta
1959-01
1993-12
0.05999999999999872
0.009999999999999787
CAE2402684_
LONGSTAFF BLUFF
71091
68.90
-75.14
2011-09-16T17:54:10.238
1764
NUNAVUT
160.80
2402684
WLX
meta
1958-01
2007-09
0.1399999999999988
0.049999999999998934
CAE1010235_
ALBERT HEAD
48.40
-123.48
2011-09-16T17:54:10.238
15
BRITISH COLUMBIA
17.00
1010235
meta
1971-01
1995-04
0.040000000000000924
0.009999999999999787
CAE2502501_
ULUKHAKTOK A
70.76
-117.81
2011-09-16T17:54:10.238
1789
NORTHWEST TERRITORIES
35.70
2502501
YHI
meta
1979-01
2007-11
0.09999999999999964
0.040000000000000924
CAE30506GN_
BIGHORN DAM
52.32
-116.33
2011-09-16T17:54:10.238
2365
ALBERTA
1341.00
30506GN
meta
1969-01
2007-11
0.129999999999999
0.07000000000000028
CAE8203570_
MILL VILLAGE
44.18
-64.67
2011-09-16T17:54:10.238
6412
NOVA SCOTIA
15.20
8203570
meta
1973-01
1993-12
0.08000000000000007
0.02999999999999936

To download data sign in with GitHub

Download table (as CSV) Download SQLite database (0 Bytes) Use the API

rows 10 / 4159919

id element year month v f
CAE4014145_
tmeanM
1960
1
-20.50
CAE4014145_
tmeanM
1961
1
-16.40
CAE4014145_
tmeanM
1962
1
-18.80
CAE4014145_
tmeanM
1963
1
-20.40
CAE4014145_
tmeanM
1964
1
-14.70
CAE4014145_
tmeanM
1965
1
-22.00
CAE4014145_
tmeanM
1966
1
-27.70
CAE4014145_
tmeanM
1967
1
-17.80
E
CAE4014145_
tmeanM
1968
1
-18.90
CAE4014145_
tmeanM
1969
1
-24.50

Statistics

Total run time: less than 5 seconds

Total cpu time used: less than 5 seconds

Total disk space used: 37.4 KB

History

Scraper code

Python

canada-temperature-data / scraper.py