No, infitiny is not the definiton of a point.
Math.com Glossary
point
A location in a plane or in space, having no dimensions.
So if it has no dimensions, how does it exist? And yet the definition of a line is an infinite series of points between two points--a figure with length but no width or height. How can you add something with no dimension and get something with dimension?
It must be faith, right?
Infinity can very well fit into a point, or be the point. The universe, although not infinite, fit into a point. The point is moot however since your analogy completely fails in the first place.
Let's get back to Faith however. Jumping out a window and believing you will not hit the ground really hard is faith. Believing in God is not Faith. When one knows God one believes. When one studies about God one is working towards believing. Faith is skipping the studying, whether it be Book or rock, and goes straight to believing.