Smaller vertical space between repeated environments

I have a new environment that is defined with addvspace at the beginning and end. This works fine if it is surrounded by text. Now, I want this space to be smaller (smallskipamount) between these environments if they follow one another directly. In other words I want the space to be smaller between the environments than it is between the environments and the text. How can this be achieved?

\documentclass{article}

\usepackage{blindtext}

\newenvironment{env}

\begin{document}
\blindtext

\begin{env}
Bla bla bla.
\end{env}

\blindtext

\begin{env}
Bla bla bla.
\end{env}

\begin{env}
Bla bla bla.
\end{env}

\blindtext

\end{document}


\newenvironment{env}

The \penalty0 is inserted before \addvspace in order to \addvspace works in the case of vskip correction.