If it's true that everything that begins to exist has a cause, and the universe began to exist, the universe must have a cause. That cause cannot be material, because matter came into existence with the universe. It must be immaterial. The only things that are immaterial are abstract objects (like numbers), which are causally effete; or a personal consciousness.
So this cause necessarily has to exist separate from the universe (time and space), because those things came into existence with the universe.
Now, either we make the illogical statement that is worse than magic that says everything can come from nothing (which contradicts all logic for centuries), or the universe is eternal, which has been debunked, as Alexander Vilenkin, Professor of Physics and Director of the Institute of Cosmology at Tufts University, says:
It is said that an argument is what convinces reasonable men and a proof is what it takes to convince even an unreasonable man. With the proof now in place, cosmologists can no longer hide behind the possibility of a past-eternal universe. There is no escape, they have to face the problem of a cosmic beginning (Many Worlds in One [New York: Hill and Wang, 2006], p.176).The only logical conclusion is the universe has a personal cause. Unless you're okay with relying on magic and not the science antitheists love so much.
I don't think logic is on the side of the antitheist.