They aren't going to give up their majority.
If the rest of the caucus are embarrassed, they need to figure out a way to isolate them. This happens all the time at the state level, in Texas, Speakers have been elected for years with Democratic votes. That will be happening in Ohio this upcoming year, Pennsylvania will have a coalition government, Alaska, etc.