What if we non-idealists, realists (or whatever) thought to ourselves not 'idealism, what an absurdity!' but rather 'idealism, what an achievement!'?
What if we took idealism to be not a flawed 'position' to be bombarded but rather an outdated, outmoded achievement ill-suited to the present and its problems?
To acknowledge something as an achievement -- even a glorious achievement -- by no means obliges anything like heartfelt subscription to that thing. However, such an acknowledgement does preclude the naive denunciation that would declare, perhaps subtextually: 'what idiots! who could believe such a thing?!'
Their problems are not yours -- so, why denounce their solutions as absurd? Rejoice in not sharing their problems!
'Ah, but their stupidity is my problem -- how can I live well in a world containing deceived minds?!'
That absurdity is our problem.