This beginning without a cause being a problem thing is silly.
Beginnings are simply Endings of something else.
This is not a new concept and is part and parcel of hindu thought in which there is a trinity of gods, including Brahma the creator and Shiva the destroyer (as well as Vishnu the preserver).
This Trinity expresses the idea that beginnings are simply the new expression of endings. They are part and parcel of each other.
Needing a Causer is very Western thought.