Two late goals from Albion substitutes Iain Diack and Jim Coulter gave them a 4-2 win away at Queen's Park and took them to the top of the table.
Rovers' Jered Stirling knocked in a penalty double in the sixth and 26th minutes, but bottom-of-the-table Queen's battled back in the second half.
Stewart Jack in the 57th minute and Steven Moffat with an 81st-minute penalty levelled things up for the home side.
But the visitors again displayed their scoring powers when Diack in the 82nd minute and Coulter in injury time provided the icing on Albion's cake.
- REPORTS - Third Division
