So you are taking the word of people who ARE terrorists and associated with terrorists over everybody else WHO WAS there?
Its not as if the US military watched him do terrorist activities. Its an accusation, one which apparently didn't hold up since they released him. So is he a terrorist or not? Either the US government is scooping up people who aren't terrorists and holding them for years with no trial, or they are releasing people who are terrorists. Take your choice.