Then in 1896, the Vicar purchased a mission room in Ystrad Terrace, which was vacated by the Welsh Calvinistic Methodists who were themselves moving to new premises on Tyisaf Road. This building became the Mission Church of St Mark's, Gelli, and Captain J.R. Davies of the Church Army was placed in charge.
In 1900, Canon Lewis had plans drawn up for extending this mission room into a church. He subsequently abandoned these plans, as he wanted a larger church than these would make possible, one that could accommodate 350 people.
Later in 1903, Canon Lewis purchased the end house in Union Street (which was put into use as a Sunday School and to hold church meetings) with the intention of building a church on the site of the mission room and the house. A legal problem meant that the existing leases on these two sites had to be surrendered and a license for building a church on the sites had to be obtained. Canon Lewis requested the help of the Crawshay Bailey Estate in making these arrangements. However, the Trustees of The Estate first had to be satisfied of the need for a new church in the area and the ability of Canon Lewis to acquire the financial means to build and maintain the building. As such, it was not until July 1905 a license for 99 years was granted. Jacob Ress again prepared plans for the new church and tenders for the new building were advertised in the press. Quotations for the building were received ranging between £1,342 and £2,172. However, Canon Lewis's plans once again were beset by setbacks. Donations were not as high as he had hoped with at least one possible donor wondering about the need for another church in the district already served by St David's and St Peter's. Additionally, his application for a grant from the Incorporated Society for promoting the Enlargement and Repairing of Churches and Chapels, was rejected in May 1905 because of the terms of the lease on the church. His application to the Bailey estate to purchase the freehold of the land being turned down, he finally accepted that he would have to settle for a smaller and cheaper alternative to his hoped for church. Again, the plans were abandoned and new plans drawn up for the enlargement and extension of the existing mission room. A tender of £310 from Messrs' Blacker Brothers, Cardiff, was accepted, with the eventual cost rising to £360. When the work was finally completed, the congregation returned from their temporary home in the schools in Dorothy Street to their new church, which had a capacity of 120. Later in 1920, St Mark's joined with St David's, Ton Pentre, to form a single parish. St Mark's eventually closed in 1987.