Cartoon title from the 80's?

Question

It has a baby that swings its bottle by the nipple and a character that says coo coo.

they are some type of super hero.

We believe this is from the early 80's

Answer 1

It might have been Fantastic Max, which had a baby as the main character.  The show ran in the late 80s, though.

Answer 2

It sounds a lot like the Mighty Heroes, but it premiered in 1966.  I suppose it could have been re-aired in the 1980s has I remember seeing them and I was born in 1974.