So you would need a camera that either maintains its spatial relationship to the object being scanned, or a camera that could continuously measure, update and adjust. When I was working in metrology, I did a lot of 2D stuff just like this, taking images and building wireframe in CAD from the images. I found that contrast is needed, and also being able to adjust the light so edges were defined properly. Things as simple as a chamfered hole caused all sorts of errors in the model, because the edges would not maintain the same reflectivity all the way around.
This is not a small task you are trying to undertake, good luck!