If you have a viewfinder camera (no rangefinder), then you probably would be OK.
I don't think that I would take an expensive camera while skiing. Or any bulky metal camera, which might break several ribs if you were to fall on it.
I think the Olympus XA is a good choice. Either that, or a compact P&S.