It seems to be staying in place pretty well for now, which suggests that there's not too much force being applied to the pin.
It's so tiny - I can't see a mechanical fix being successful without complete disassembly, which would be painful and even then I can see issues with the nylon possibly breaking. I'm leaning towards glue- I'll investigate the above suggestions further and report back if/when I make progress. Thanks all for the tips.