Anthony Scaramucci believes it was Gisele who stopped Tom Brady from joining the Patriots on their Super Bowl trip to Donald Trump's White House ... strongly insinuating the supermodel didn't want Tom around Ivanka Trump.
The Mooch -- Trump's former White House communications director -- guest hosted "TMZ Live" Monday -- when we asked straight-up about the alleged rift between the POTUS and the GOAT.
A.S. says he didn't have direct knowledge of the situation -- but strongly suggested Gisele shut Brady down .