The fact that some people struggle with "rue" doesn't prove it's inherently hard — it just shows that pronunciation can vary widely, and without a universal standard, it's hard to say what "proper" pronunciation even is.