The interest increased till February, 1886, when the board of directors of the Holcombe Mission consented that the superintendent should open a regular kindergarten for every day in the week except Saturday. More money was raised and a trained kindergarten teacher from Cincinnati was employed. In June, 1886, the school closed with sixty little children in attendance and four young ladies training for kindergarten teachers. Arrangements were made for the following year and several hundred dollars pledged. In September, 1887, the kindergarten was re-opened with Miss Bryan, of Chicago, as teacher of training class and superintendent of the school. In the following October a large and enthusiastic meeting was held in the Warren Memorial church and the Free Kindergarten Association was formally organized. In February, 1888, a second free kindergarten was opened in another part of the city. The year's work closed in June, 1888, five young ladies graduating as kindergarten teachers. The number of children enrolled for the year was one hundred. The kindergarten, it will be noticed, is thus distinct from the industrial school.
In 1885, another department still was added to meet a want which had been developed in the progress of the work. The great number of broken-down men and tramps that came to Mr. Holcombe for food and help of one sort or another made it impossible for him to give them lodging in the mission rooms or board in his own family. And it encouraged indolence in unworthy men to feed and lodge them as a mere charity. And yet, if anything was to be done for their souls, they had for a time to be cared for. Mr. Holcombe conceived the idea, therefore, of establishing some sort of a place in connection with his work, where these men might earn their food and lodging by the sweat of their brows and at the same time be brought under the powerful religious influences of the Mission.
The result was the establishment of the "Wayfarers' Rest." Mayor Reed and Chief of Police Whallen gave Mr. Holcombe a police station building free of rent and Mr. J. T. Burghard gave the money to furnish it with bunks, stove, cooking utensils, facilities for bathing, etc., and it became at once an established feature, and a very admirable one, of the Union Gospel Mission.