He wouldn't have been able to safely make it back home before the FBI raids his house.
his house arrest ended and they had enough time to fit the tunnel into a van before it happened
So the answer is, same reason everyone else wasn't. The movie was crowded and people need to stop trying to treat movies like real life or movies would be boring as fuck.
But they didn't know that. Last they heard he was on house arrest and they didn't exactly have time to see if that was still true.
World coming to an end and they're worried about house arrest?
Literally only the Guardians and Thor knew what the true scope was. Maybe Strange and Wong too but they don't know Scott. No one else knew. To them it was another invasion.
Even if just another invasion, you would want everyone.
Cap knew and Widow... wasn't Falcon there as well?
And they would waste time flying out to Ant-Man and Hawkeye why if they know they're in immediate danger at all times?