Hello Ahmet.
Sorry to hear that you had problems with Maya. That high res render thing kept me away from it for a long time. The only solution I found myself on a professional work was doing all lighting by my self with simulating radiosity with lots of point lights and rendering the scene out with Maya Software Render. It was a night scene and worked fine on me - rendered the scene with 4500 pixels.
here you can see my result with that method - http://www.keremgogus.com/webgallery/gallery2/pages/templeofisis.html
Jeremy Engleman explained that method much better on his Lighting A Hallway tutorial - http://gnomonology.com/tutorial/82 -
Also you can try that mel command - I saw that on Maya 6 Killer Tips of Eric Hanson. It’s about rendering larger than 8K in Maya. Maybe it helps;
Render -x 10000 -y 5000 -xl 0 -xr 5000 -yl 0 -yh 5000 -p filename.mb
legend:
-x and -y: desired render resolution.
-xl: set x sub-region left pixel boundary of the final image
-xr: set x sub-region right pixel boundary of the final image
-yl: set y sub-region low pixel boundary of the final image
-yh: set y sub-region high pixel boundary of the final image
Also if you were tried to rendering current frame in very high resolution it may not work. You may try Batch Render.
Hope these helps & good luck