Nobody was cleaning up the size group. Pointed out in https://bugzilla.gnome.org/show_bug.cgi?id=645966