Ugh, saying that he is in his thirties and is too young to have sexual issues is so ignorant. There is this feeling in the world that the average guy just needs to see a woman and boom, erection and let's get it on, and it's perpetuated by ignorance. If you don't know if it's too early or if Aspies have issues maybe you should get your learning on. Blaming doesn't help, and neither does pressure, for anyone no matter their gender. Not every male just wakes up in the morning ready to bang the first thing that walks by. There are some for which that's a sole focus. You married a guy that seems to be very intelligent and has a disorder that makes him connect differently, sometimes because such people are lost in their own head.
I am definitely somewhere on the spectrum myself. ADHD with maybe some Aspie, a dash of OCD, and formerly very anxiety ridden. My mind just goes and goes. Sex is more important to some than others. If he's not holding out because of spite, maybe he has a problem that falls into that for better or for worse, in sickness and in health, category. Maybe you two need some marriage counseling. Maybe you need individual therapy for each of you. You definitely need to spend time trying to understand one another. There's nothing wrong with being ignorant as long as your goal isn't to stay there. Just as there's nothing wrong with him being sexually dysfunctional as long as his goal isn't to stay there. Sex and intimacy go hand in hand. Intimacy isn't just having sex, it is how you relate to and understand one another. Often sex in long term relationships is great for a couple of years and then there's a switch over from erotic sex to intimate sex, and this culture doesn't promote the latter. Sex is portrayed as something automatic that should just be a natural reaction to a stimulus. It doesn't work that way forever.
I know you feel rejected, been there done that myself, but what I learned is that it wasn't all about me and my needs. I am still learning, and that part was about me. I didn't understand where my wife was coming from, and ultimately I didn't understand myself either. Don't look to blame. Look to find common ground and intimacy based in deep understanding of how you and your partner work.