Gravities with higher derivative terms were known to be renormalizable in general, but they suffer from having ghost massive graviton modes in the spectrum. By adding a cosmological constant, we find that there exist critical points in the parameter space such that the ghost modes are replaced by log modes, which can be truncated out by the boundary condition. We discuss various properties of the theory, including  thermodynamics and stability of black holes.