Not at all. It is saying, "I am not ruling out the possibility, but since there is no evidence . . . I am skeptical" There is nothing wrong with that position and it is more honest than saying there definitely is or definitely is not a God. Also, many agnostics might even believe in a higher power but that it is not the Christian God or the Muslim God, or whatever god someone else may believe in. Also, many agnostics do not believe in any of the "organized religions" since they were made up by ancient men who were ignorant of the world around them. They attributed such things as volcanoes, hurricanes, tornadoes and other such events to "works of God" or "the gods are angry, time to sacrifice a virgin or a sheep."