Yeah you need the bow from Forest Temple to get the map in Fire Temple so you're clearly expected to do Forest first but that's the only thing and it's obviously optional.not even that, if you go past it then once you pass the moving fire wall you can just climb over the cage and jump down.