I have never used RPG Maker. Will images at a lower resolution not help?
I'm relatively new to it myself, so not sure, I currently consider myself lucky if upon loading the image it's visible at all in the tileset...