There is no correlation between the axle safts rustiness or diameter and CV joint wear.
The wear occurs on the balls and cages within the boot. Pretty much like everyone else has said, if it has a good boot and is smooth while rotating(no clicks, etc.) it's fine.
They don't last forever and can wear out even with a sound boot but not often.