I disagree. People can be attached to gender in the abstract, not just physical expressions of it. The reason people get gender euphoria from wearing eg dresses is because dresses are associated with femininity culturally. If femininity was not a known concept, people wouldn’t feel that way about dresses.
1- Why exactly would it be a problem if some people were not euphoric about wearing dresses? Why would this be more of a loss than, say, not being euphoric about spinning cloth all day? Not being euphoric about eating vegan sandwiches? Not being euphoric about putting on the vaseline that says FOR MEN on the cover?
There is no shortage of pointlessly gendered things that most people, trans or not, simply don't feel that strongly about and that's okay. They can still do those things if they want but don't need them.
Society does not actually need to gender stuff like this.
2- These binary roles and gendered associations tend to put gender nonconforming and non-binary trans people in the worst position. Not all trans women want to wear dresses or shrink themselves into these roles, which few people completely fit in the first place. This is punished.
Someone in the notes said that gender is more than a straitjacket, but I feel that's only potentially true if you're talking about gender as an identity in your mind rather than talking about the social system that currently exists in real life, which is coercive, hierarchical, and arbitrary.
3- Crucially, it's all made up constructs that have already changed a lot over time. As I said in the notes, "being a man" and "being a woman" already don't mean the same things they used to mean and (at least in some parts of the world) the roles that still exist are less strict than they used to be. This is a good thing that results in more freedom for everyone, not just cis women.
These constructs are likely to break down even further as transition medicine advances and becomes more normalized, which is one of the big reasons why religious conservatives see trans people (and not ostensibly "gender critical" TERFs) as such a threat to their preferred social structures to the point that the supposedly "progressive" pope was comparing "gender ideology" (euphemism for trans people, among other things) to nuclear weapons in between covering up sexual abuse cases.