myhockeyrankings Archives

The following is a post I wrote almost four years ago about MyHockeyRankings on an old blog I used to publish. Most of it is still highly relevant after all this time. I have added a few additional new thoughts at the end of the post. This is the second post rounding out the benefits and drawbacks of MyHockeyRankings – you can read Part I here.

While MyHockeyRankings (MHR) has many benefits, I’ve seen and heard enough parents use the site in a manner for which it was not intended. Instead of being used for good, it can be used for evil to the detriment of player development and their game.

Let’s get the most obvious one out of the way first…

Focusing on your team ranking

Coaching games to maintain or improve your team’s rank/rating goes against the original intent of the site. By putting a focus on ‘goal differential’ over playing games to your team’s fullest capability is essentially poor sportsmanship. One example is not pulling your goalie late in a close game to minimize the risk to lowering your rating even more. Another one is to keep/only play your best players late in the 3^rd period even when the outcome is clear. Going into a game knowing the EGD and playing to match or exceed that difference should not be on the mind of any coach before or during a game.

2. Using MHR rating or ranking as the measurement of team success

Like in business, a team cannot just look at a single metric to see determine the how well it is performing. Usually you’ll need 2 or 3 attributes to get the full picture of how an organization is performing. Things like player development, win/loss record during league or tournament play, and learning to compete are much more important than any single rating metric.

3. Playing for a highly ranked vs middle-of-the-pack team

Coaching certainly plays a role in the development and success of a team. However, the size of the pool of players in an area and the multi-year commitment to player development of a club or region is really the biggest factor in how good a team is. This is why regions like Toronto, Boston and Minnesota have so many strong teams. They have both robust club programs to develop players from Mites to Midget as well as a deep group of players in their programs to choose from. Thus, as a parent, it really shouldn’t matter if your child’s team is highly ranked, what matters is that they continue to develop on a path to help them be the best hockey player they can be.

There are also several weaknesses to the actual algorithm using only goal differential for team ratings. Here are a few of them:

4. Lack of uniformity in game format and duration

Not all games are created equal. While USA Hockey tries to standardize games across divisions, the reality is that a large portion of games that are included in the rankings do not follow those guidelines. These can include games from tournaments, exhibition and pre-season game. The attributes that are not consistent across games can include game time, how regulation ties are handled (e.g. overtime vs. shootout vs. no extra time). Last year, we were at a tournament with 90 second penalties while the total game was only 75% of a real game. This season our pre-season games were two twenty minute running-time games. There is no way to normalize scores based on the running time of a game.

5. Games scheduled between teams with Expected Goal Differential (EGD) great than 7

Per the original MHR manifesto, only scheduling games between teams that will be competitive makes perfect sense. However, in some regions having division where there is a large discrepancy between the top and bottom teams may occur. Since MHR max goal differential per game is 7, I have seen several times where the lower rated team’s rating went up even though they lost by 10 goals, since the teams ratings difference was 8 or 9 goals heading into the game. I would recommend changing the algorithm to not include games between teams that have a 7 or more goal differential.

It is my experience that the MHR rating should be taken with a grain of salt and statistically there is probably some reasonably standard deviation between 0.50 and 0.75 rating points. Once again though if you are using the site for its intended purpose, then it shouldn’t matter what the actual rating is for your team. Furthermore, the natural standard deviation makes the rating even more meaningless. Here are some additional factors that contribute to the standard deviation:

6. Tired teams

Most tier teams regularly play 4 to 6 games in a weekend. While fatigue is something all the teams need to deal with, when the key metric for MHR is goal differential, it is very likely that final scores between two identical team will not be the same at the end of a 6 game weekend as they would have been on the first day. I have been surprised on many occasions when I expected to see a blow-out between two teams, but it was clear that the higher rated team couldn’t maintain the same level of play for 3 full periods in their final game.

7. Backup goalie dynamic

Ratings are a weighted average of both goalies. But on many teams there can be a big gap between the top goalie and the second goalie. On others, there may be only one goalie. One season, one my kid’s teams had a goal differential rating of about 1.5 difference between the two goalies. In this situation, wins vs. losses is a much better indicator of the team’s success instead of goal differential.

7. Asymmetric Actual Goal Differential

In my experience the EGD vs actual goal differential appears asymmetric when the EGD is about 4 or more. Usually this happened when team from different division play each other (i.e. when the higher ranked team has played most of their games against higher ranked teams and the lower ranked team traditionally plays lower ranked teams). So, the rating don’t reflect an apples-to-apples set of teams they have played and when the two teams play, the higher rated team can significantly exceed the EGD.

I am sure there are several other factors I have missed that contribute to the rating not being as precise as possible.

So how should you look at the ratings?

As mentioned above, take it with a grain of salt and don’t focus on the specific number, but more the peer group you are grouped with to see how your team is doing relative to others. In addition, don’t be concerned about any number rating or ranking, focus instead on player and team development because at the end of the day that is what youth hockey is all about.

2023 Update #1 – last year both my kids played several games against Canadian teams and it seemed that the cross-border ratings weren’t as accurate as within the U.S. Specifically, the Canadian teams were consistently better than their ratings. Am not 100% sure why, but am assuming that the algorithm had insufficient cross-border game data to normalize (calibrate) the true ratings across the two geographies.

2023 Update #2 – There are many reasons I’ve seen that some games should not be included in the MHR calculation. I have even heard both teams agree not to post scores from ‘exhibition’ games to MHR. The most obvious one is where a team needs to play a USA Hockey district qualifying game against a team that is more than 7 goals below them in MHR. Clearly the only reason to play the game is to check a box. However, USA Hockey does use MHR as a way to select at-large invitations to Nationals (playoffs). While probably having negligible impact, these types of games should probably not be included in the MHR calculation.

The following is a post I wrote almost four years ago about MyHockeyRankings on an old blog I used to publish. Most of it is still highly relevant after all this time. I have added some additional new thoughts at the end of the post.

I spend a lot of time on the MyHockeyRankings (MHR) website. I don’t use the site because I care about the rankings of my kids’ teams, but I do see the rankings, so I am aware of what they are. However, there are many more valuable reasons to use the site that I find really insightful that I wanted to share. I will also put together my thoughts on what the watchouts and drawbacks are for MyHockeyRanks in a separate post.

To start, let’s remind you of why MyHockeyRankings was created and how it is intended to be used. As stated explicitly on their About Us page, the site was set-up to help with scheduling competitive games between clubs. Using a pretty simple algorithm based on goal differential, a rating is created for each team. The difference in ratings between two teams is their expected goal differential (EGD) between the two teams if they were to play each other (subtracting the lower rating from the higher rating). This methodology is used to normalize quality of opponent and calibrate one team versus another. I won’t go into the statistical analysis of the legitimacy of EGD, but the goal differential is only an expected value, and thus there will be a lot of variation in actual game scores. If the EGD is small, then if the two teams would play each other, then it likely would be a competitive game. If the goal differential is large (for me 4 or 5 goals is a significantly large gap) then it likely would not be a competitive game and it may not make sense for the two teams to play in the first place. This is especially helpful if there is a large tournament and the organizers are trying to group teams into competitive divisions or for leagues to draw the line between A, BB and B levels. There is a lot more detail to how and why, but that is the gist of the ratings. Well, now that each team has a rating, it is only natural to rank them. This is where much of the controversy starts with the MHR site, but we’ll discuss the use of rankings separately.

Schedule, Scores and LiveBarn

I track about 10 different teams at various clubs, levels and age groups and I find it much easier to see the schedule and scores in one single location thanks to MyHockeyRankings than going to each individual team’s website or leagues site to find the schedule and/or score. If I want to dive into a particular game then I might go elsewhere, but being able to see which of those teams has/had games in a particular weekend is very helpful. As a bonus, having the LiveBarn icon next to a game (especially if one of the teams is playing at an away tournament) it lets me know that I could watch the game if I wanted to. This feature was remarkably helpful for watching games for a prep school team that we are considering for my daughter. Without the MyHockeyRankings/LiveBarn partnership, I might never have been able to see several of the school’s games.

2. Scouting and Researching

When heading to a tournament it is highly likely that most of the teams we will play we won’t have ever seen or played before. We have used the MHR ratings to help decide which goalie to start in which games. If on the first day of a tourney we have two games and one team is clearly rated higher than the other on MyHockeyRanking, then the coach usually has some insightful information on who to start in each game. For a playoff game one coach asked me to download the most recent games of the team they will be playing, thanks to MHR I was able to see exactly when and where to find the game on LiveBarn. Finally, as mentioned above, being able to find games from potential prep schools for my daughter and watch their play has allowed me to research potential future schools/teams for her to play on based on the quality of their teams, including the LiveBarn video identification.

3. AA vs. AAA?

I care about my kids’ hockey development not the number of letters they have for their level of play. Since there really is no standard of what is AA vs AAA (which is a topic for another post), MyHockeyRankings also helps to compare AA vs AAA teams in an apples-to-apples manner. For example, I have one of my kids playing on a AA team this season that is rated slightly higher than the AAA team in our area. This is not a surprise, and while having a higher rating doesn’t really matter, there is a big difference between the two teams. The AAA struggles to compete and loses most of their games and their players are usually chasing the puck. Instead, nearly all the AA games my kids team plays are competitive and the players are developing a lot more both on defense and offense, especially when the games are close. While MHR didn’t really play a role in the decision on which team my child would play on, the ratings have provided validation that they are playing at the right level for their development even though it has one less ‘A’.

4. Scheduling Games

As mentioned at the start, this is the original intent of the MyHockeyRankings. Last season our team played about 30 games. Which is fine, but a few more would have been nice.

Since there weren’t any local teams that were available in the Spring, we looked to find a few teams that were 5 hours away for weekend exhibition games against 3 or 4 teams. Well, of course I used MHR to find the teams which would be most comparable to our team to reach out to (even though they were a level lower by letter). Once again, this is exactly the intended use of MHR, to help schedule and ensure competitive games.

5. Triangulation Between Levels

My daughter plays on a youth (boys) team and at some point she will switch to playing with the girls. One of the challenges is for me to compare her current level of play with the boys to the girls of her age. However, thanks to MyHockeyRanking and using their methodology, I can triangulate her team’s ratings to other girls teams. Since the local girls team plays enough games in the boys division, I can determine their equivalent boys rating and see the difference to my daughter’s team. It provides an additional piece of data to inform our decision on the where and when she should play in the future. I have used the same methodology to compare between levels between teams from Squirt to Peewee, from Peewee to Bantam and Bantam to Midget. For example, how does a Peewee AA team compare to a Bantam B team? Thanks to MHR I am able to figure out the answer to this question.

6. How are you trending? Last 10 Game Ratings

Figuring out if your team is trending up or down during the season is a pretty important insight. Almost all teams improve throughout the year, but how is your team improving relative to others. Thanks to MHR you can see if the last 10 games are accretive or dilutive to your rating. Also, with the help of a basic spreadsheet you take any time period and figure it out for yourself. As a data geek, I like the ability to analyze this kind of stuff.

Finally, as I admitted at the start, I am aware of the rankings for my kids’ teams. The ranking usually doesn’t vary too much from the start of the season to the end of the season, so once it has been established, not much point paying too close attention to it. But knowing where the team ranks on a national and state/regional level is good to know as a parent. It basically helps me set realistic expectations for where my kids are in their development and what goals to help them set for the coming year.

These are the benefits I have found from using MyHockeyRankings and when used properly it has provided helpful insights for several important decisions for my kids’ hockey development. However, while I have used site for ‘good’, it is pretty easy to use the site in the wrong way. My next post will discuss the watch-outs and using the site in a manner that goes against its original intent.

2023 Update #1: Another strength of MHR has been having USA Hockey use the rankings for at-large invitations to National playoffs. This way the best teams will still participate even if they didn’t win their district championship.

2023 Update #2: I have also used the Women’s College Hockey ratings as part of the college recruiting process. It’s been helpful to see how each of the conferences really compare to each other in terms of level of play. As an example, it shows how competitive the WCHA conference is, and that finishing 6th in that conference would be first or second in a different conference. You could be playing for a Top 10 team in the country and still not make the NCAA tournament. The NCAA might want to change it’s pairwise calculation (which I don’t really understand) and just use MHR for their at-large tournament selections.