did you ever had any M Leica? Maybe for start you buy some cheaper M body like for example classic M6 - and see is this for you?
On the other side: I have M6 and M3, and reason why I have got myself a Leica is because I can afford it, I wanted to get best 35mm tool for street, and because life is too short for compromises .
First I got M6, but since I use 50mm most of the time - M3 was next logical choice because it has more accurate frames lines and bigger viewfinder.
I like M3 more than M6.