Population momentum will keep us growing for a bit, just because there are so many young people alive right now, many of whom will want to have at least one or two kids. We will see population drops only later, as the population grows older. Assuming it happens, it'll be long after I'm gone.