Kilbourne Hole is a maar volcano, which is a volcanic crater created when groundwater and magma trigger an explosion of steam and gas to create a large, relatively shallow crater. Oftentimes these craters later become lakes. The crater is over a mile wide in all directions and many tens of thousands of years old, though its exact age is unknown.
Hunt's Hole, which is two miles south of here, is a smaller example of the same phenomenon.