It seems to have been broken (again) at around 10.2 or so.

If more currencies up to 5 were already being tracked previously, they may remain. Though untracking them and choosing another does not work and only 1 can be actively set to be tracked.

A great feature and hoping it can be fixed!