fosho. Another factor is, I believe, the Eskimos have done a terrible job in the last 20 years of attracting the younger fan. They didn't need to in my (and your) day because there wasn't much NFL on TV (in my case, out in rural Alberta, there was none!!). So we were, naturally, CFL and Eskimo fans.
You go to games in the bottom section, and security is telling to sit down, be quiet. They discourage a party atmosphere. they have catered to the 1960s season ticket holders.
When I was in my 20s, me and my buddies went to almost every game (probably the same for you and others over 40). It was a social event (heck, it was a good place hook up!!). None of my nephews, nor my daughter, ever go to games.
In short, the Esks, and the CFL in general, have lost a generation.