+90% of the time spent in WithStyles is actually spent in JSS, there very few we can do about it on Material-UI side.
From
Although, there is a possible speed up that doesn't include re-writing you JS CSS styling approach, which is switching to makeStyles instead of withStyles
Can be found out here