OK, something constructive...
Properly done, converting to 44.1/16 will be more like the original 96/24 file than the MP3. Just the file size difference alone is a good tipoff. This would be different if MP3 were lossless, but it isn't.
Try both, and see what you hear... er, I mean, hear what you hear.