Yes, removing the back can alter the sound, that's why most guitar amps have an opening at the back. But I noticed no difference when testing the speaker with and without the back.
In fact I was careful to place the speaker face up under the roof grill with the metal chassis of the loco forming a box around the back of the speaker which DID improve the sound.