I think the differences in what X-Men are and what they stand for is well taken, and probably correct.
For what it's worth though, Xavier is very explicitly shown as being extremely wealthy from the very beginning, having inherited family wealth very much in the old school comic tradition of...