Twice winner of the Melody Maker Music Polls, Smith spent the early 1960s playing with the Tony Lee Trio, before becoming Scott Walker's musical director and accompanying The Walker Brothers on their Japan tour in 1968. Returning to the UK, he recorded a solo album, Fall Out (1968), which was produced by Scott Walker, and backed by UK jazz musicians of the day such as Kenny Wheeler, Les Condon, Ronnie Ross, Ronnie Stephenson, Gordon Beck, Ron Mathewson, Chris Karan, and Ray Warleigh. Smith went on to join the U.S. soul singer J.J. Jackson's Greatest Little Soul Band in the Land, with whom he recorded two LPs: The Greatest Little Soul Band in the Land (1969) and J.J. Jackson's Dilemma (1970).
Smith went on to record four albums with If's original line-up, as well as touring the U.S. and Europe extensively. Following If's demise, he had a brief spell in another British band, ZZebra, also with Dave Quincy. Best songs include Fibonacci's number and Forgotten Roads.
- If (1970)
- If 2 (1970)
- If 3 (1971)
- If 4 (1972)
- Waterfall (1972)
- Forgotten Roads: The Best of IF (1995)
- Europe '72 (Live) (released 1997)
- The Greatest Little Soul Band in the Land (1969) with J. J. Jackson
- J.J. Jackson's Dilemma (1970) with J. J. Jackson
- To Seek a New Home (1970) - Brother Jack McDuff
- Don't Get Around Much Anymore – Live at Bullerbyn - Rolf Ericson
- British Jazz Artists Vol. 2 - Terry Smith with the Tony Lee Trio (1977)