I know it's not easy after you've been out of school for a few years. I didn't go until 5 years after I graduated, and I forgot so much! I had to go back and take a remedial algebra class before I could take college algebra, and I had trig and calculus in high school.
Good luck with it. I'm doing good so far (3.7 gpa), so it can be done. I had a 4.0 during the first year but I got tired of working so hard on studies while attempting to pay bills.