Can you still do some prn work if you take the desk job? In my opinion, you should work while you can now to earn what you can now, and take the experience while there are opportunities. Later, you can get the desk job, but for more money, since you’re more experienced. Also, there are opportunities in research/real world evidence/device manufacturers/ software companies outside the healthcare systems for experienced clinicians like yourself (even fully remote ones).
Maybe this current role isn’t perfect for you, but it started you wondering, and that’s good.
Why not both? There are a fair bit of positions that allow a certain degree of patient sided work. And of course there is always Freelance/Locum work in most countries.
I have switched to a full off-patient role a long time ago and since the beginning of Covid I have worked mostly remotely. But I am still working as a Freelancer for a few shifts per month, depending on my workload.
And I like this model a lot.