Historical remains are things that have been found from an earlier period of history, usually buried in the ground, for example parts of buildings and pieces of pottery.
You can use remain in expressions such as the fact remains that or the question remains whether to introduce and emphasize something that you want to talk about.