Can you give more info on how the camera movement is (FPS, Free form, etc)? I assume you want the camera to always look at the center of the world and when the user moves left of right the camera would rotate around the world y-axis. is that rite?
Also you dont need to change the Ortho size to zoom in and out..