You are thinking of the universe in far to human centered terms to appreciate what I'm saying. This excess non-universal matter comes from the constant big bangs that are going on all over the place. Not all the matter in the big bang's ejection is used in a universe. Some of it is thrown so far out that it can't coalesce into a universe and floats in the space between universes until it coalesces into another cosmic receptacle.