Normally that would make sense, but here we are dealing with the establishment NFL notwithstanding the likely lockout next season Earl. They are rich and can afford to dream for the sake of expansion.
Goodell has talked openly repeatedly, whether wish list or just plain media propaganda, about ADDING teams in LA and in London England. We can laugh on the latter one perhaps, but the view of the common fan will have no bearing on any such decisions to be made for sake of those places.
In my opinion the real question is not IF teams will be playing in either place sometime 2015 or later, but rather will the NFL keep it's tidy 32-team structure and merely have two teams move from their markets or expand to 34.
Though there has been plenty of talk and reason for the Vikings, Bills, and Jaguars to move, but the NFL overall is reluctant and might end up subsidising also those teams on at least a short-term basis due to "regional" strategy.
The only team with no real strong cause in my opinion is Jacksonville, but they might be saved on the basis that merely the league will not have an odd-numbered total number of teams. Or perhaps if London does not work out despite all those wishes from New York (do they realise they will be competing in great part with also the global and wealthy English Premiere League?!), indeed this would be the easiest team to just shift to LA.
Goodell has commented that without a team in MN, there is a huge tract of land that remains without NFL access with the next nearest markets Kansas City and Green Bay.
Also with regard to Buffalo, the fact that also many Canadian fans attend those games with Canada a growth market too is of strategic importance as well. The folks attending those games without the Bills there would be left with Pittsburgh as the nearest market, and that's not going to happen one way or the other IMHO.