Thanks for the replys so far. I have checked all connections to starter and battery, and all are tight. Now another thing it does when it act's up like this is all the idiot lights will flicker when turning key to accessory. Nothing more frustrating to me than a wiring issue!
edit: also banged on solenoid, no luck for me.