Greenway Christian Fellowship, Bishop's Lydeard, and Fountainhead Christian Fellowship, Taunton, merged in 1992 and adopted the name Thomas Street Christian Fellowship because their main meeting place was in Thomas Street.
In 1997 the church moved to a new meeting place in the old Marshalsea House near the River Tone (where the Tesco supermarket now stands) and changed its name to Riverside Church.
In 2001, after seeing great favour and financial provision, the church purchased the old telephone exchange in Hamilton Road and kept the name Riverside Church, the name now carrying a spiritual rather than literal significance. For five years, from 2002 until 2007, the church operated an indoor skateboard park, Dreamfields, as a facility for young people of the area.
In 2010 the ground floor hall, formerly the skate park, was renovated and became the main meeting hall for the church. This was done with the help of a grant from Viridor Credits in order to provide a multi-purpose facility that could be used by the local community. The building (known as The Exchange) is now also used by many community groups and some other churches for their meetings.