Jeffries reported via CBS.The House has to return eventually. If there's going to be a deal to end the shutdown the House would have to vote on it.
https://www.cbsnews.com/live-updates/government-shutdown-third-day-trump-senate-house/
The Speaker of the House can indefinitely delay swearing in.