Wondering a bit what you mean by ''solid'' ones!
With polarized caps main thing is to stay at or better than the old cap's rated op voltage, plus of course value - altho as larger electrolytics are more smoothing than time constant a slight increase in value may not matter IMO. And, as xavier reminds us - care with polarity when replacing.
Non polarized, if any there and these anyways not so prone to fail - try and use same type .... polycarbonate or other.
Final thought - while electrolytics can and do fail - maybe due to insulation breakdown inside - there are occasions IMO where failure may have been brought about by a failure elsewhere - so, well worth very detailed inspection to look for PCB track fusings/high temp signs - and mini resistors etc.
