Why should the apparent absence of life (or intelligent life) be a clear-flag to move in and take over?

Also, do we know far enough? I’m not sure we do.