Now try feeding, clothing and employing them, not to mention supplying them with heat, potable water and electricity, carrying away their waste and effluent, telecoms, educational institutions and libraries, consumer products, warehouses, courthouses, prisons, factories, medical support, roads and railways, airports, etc.
Some "wasteful spaces" like public parks, museums and preserved wilderness would be nice, too - or are you suggesting it would be quite acceptable to end up in the Caves of Steel?
Even if it were the case that the planet has more than enough room for everybody, you cannot hold your position indefinitely - you demand constant population growth, but the planet's surface area has remained constant for billions of years. You don't even need primary school mathematics to know that, if overpopulation isn't a problem now, it will be eventually. Unless, of course, you're deranged enough to believe god will simply end the world before that happens, conveniently bypassing any sense of social obligation.