Hockey is very small in the big cities in Sweden correct, and generally only popular in the northern small cities. But what you wrote is not true for Finland.
"Very Small"??? It may be small to certain etnical groups that tends to be growing by the day in Sweden. But I would say that hockey was pretty big in Swedens second largest city last season...
Ice Hockey is by a large margin (to the third place) the second most viewed team sport, and while of course it is kind of a small town sport in many places, there is of course plenty of hockey fans in bigger town and cities. Stockholm got Djurgården and AIK, Göteborg Frölunda, Malmö got Redhawks, Linköping got LHC, Jönköping got HV71, Örebro got well Örebro, Karlstad got Färjestad, Gävle got Brynäs...
20 largest cities/Towns (per 2010):
1 Stockholm Hockey clubs: Djurgården SHL, AIK allsvenskan
2 Göteborg Frölunda SHL
3 Malmö Redhawks SHL, Pantern Allsvenskan
4 Uppsala Almtuna Allsvenskan (They kind of have no interest in sports in general...except I guess for Caps and binge drinking)
5 Västerås VIK Allsvenskan
6 Örebro Örebro Hockey SHL
7 Linköping LHC SHL
8 Helsingborg ????????? not much to speak about...
9 Jönköping HV71 SHL
10 Norrköping Vita Hästen Allsvenskan
11 Lund See Uppsala
12 Umeå Björklöven Allsvenskan
13 Gävle Brynäs SHL
14 Borås Typical Soccer Town...they got some lower level club, but...
15 Eskilstuna Not a hockey town.
16 Södertälje SSK Allsvenskan
17 Karlstad Färjestad SHL
18 Täby A Stockholm suburb
19 Växjö Växjö Lakers SHL
20 Halmstad Hammers...in some low level division...
...plus Sundsvall/Timrå that doesnt qualify for the biggest 20 Towns (in 2010 ), as actual city limits population, but together have a pretty (for Swedish standards) populated municipalies got the Allsvenskan club Timrå, which have had several years in the SHL too.