If the only reason for using align is to have elements aligned across columns, then an array environment would be an easier way to manage your situation. The column specification when using an array is straight-forward, and allows you to modify the width between columns very easily. Include the array package that provides the column separator specification @{} (as well as a host of other functionality). Here's an example:
\documentclass{article}
\usepackage{array}% http://ctan.org/pkg/array
\begin{document}
Regular array with centered columns:
\[\begin{array}{ccccc}
1&2&3&4&4\\
& & &2&4
\end{array}\]
Varied spacing between columns:
\[\begin{array}{c@{\hspace{2em}}c@{\hspace{2pt}}c@{\hspace{2ex}}c@{\hspace{2bp}}c}
1&2&3&4&4\\
& & &2&4
\end{array}\]
Varied column alignment:
\[\begin{array}{ccclr}
111&222&333&444&444\\
& & & 2&4
\end{array}\]
\end{document}

If you want to remove the intercolumn spacing completely, use @{}.
array? – Werner Oct 9 '11 at 18:07array? – Sebastian Oct 9 '11 at 18:12