I would essentially say the same thing since I think the meaning is essentially the same.
They are not the same thing.
I think to have a lack of belief in something, you need to know of that thing.
Before you were aware of the magical unicorns made of meteorite teapots living in my dog's butt, did you have or lack a belief in them?