As the population increased in the Village of Cassville, Catholic were encouraged to build a church. On July 27, 1857 Bishop John Henri of Milwaukee contracted with Nelson Dewey and Garrit Denniston to purchase six lots on which the present church and rectory stand. A fair-sized brick church was erected by the close of 1857. It stood facing Dewey St. directly in front of the parish rectory and it was the first and only church of any denomination in Cassville until 1875. 
In 1883, the rural St. Mary Settlement Church located four miles to the northeast of Cassville closed and its members began attending Mass at St. Charles. The existing church was too small and planning began for a new church. In the fall of 1888, foundations were laid for the 50' x 100' structure. The present church was completed in April 1889 and it was dedicated in November 1889 and cost $13,393.00 to build. The church is German Gothic style with a 137' steeple and a seating capacity of 450 people.
Twenty-two stain-glass window were installed soon after the church was built and modern lights were installed in the 1940's. The church was renovated and redecorated in 2020.