Though the original Gartner's Bakery is no longer standing, the building Joseph Gartner built in 1905 to house his flourishing business still exists today. Gartner came to St. Charles from Germany around 1890. Soon after his arrival he established a restaurant and bakery. The original building, which stood on the northwest corner of Main and Second Streets (where Old Kent Bank is located now) also housed a "picture gallery" and a dentist's office on the upper level.

In 1905, Joseph moved his business to the south side of west Main Street where he built a two story brick commercial structure. During the early years of the business, Gartner's became popular among local citizens due to its 5 cent dish of ice cream and 25 cent Sunday chicken dinner. Joseph's son, Karl, became involved in the family business during the early 1900s, changing the name of the establishment to J.W. Gartner and Son. By 1893, Joseph's brother, John, had opened a store of his own on east Main Street. John remained in business until the mid-1930s, while Joe's establishment survived until around 1960.

Following the closing of Gartner's the building housed a restaurant, bus depot, cab company, and the Grossklag Realty Company. Most recently, the late Victorian building has served as the location of the Southwest Trading Company.