Remove router weight upcast for DSv2-related models (#47970)