What about attestations of validity?
1. Download 1000 known public signing keys from 1000 key institutions (Bitstamp, Circle, government of Switzerland, Microsoft, Coinbase, Wikileaks, ACLU, Bank of Japan, FEE, /r/btc, ViaBTC mining pool, Edward Snowden himself, Tesla Motors, Coindesk.com, McDonald's, EFF, Citibank, etc.) in advance.
2. It becomes common practice for every institution to attest to certain facts about the latest blocks every second of the day with a new message automatically signed with their institutional keys on the website and through an API.
3. As an SPV node, if any single one of those messages claim any oddity, disagree on the state of the chain, or are not renewing every second with proper signing, you are alerted that you could be subject to a man-in-the-middle attack.
Essentially this is hybrid PoW+"ask a friend" but it crucially seems to relax the network requirement from "you must run a full node" to the much looser situation of "there must be plenty of nodes," which is what the big block position argues for.
As a practical matter, barring coders with a lot of time and ability, everyone already trusts Github+bitcoin.org (or +bitcoinunlimited.info) not to both be compromised when they download their full node client. An additional check on reddit and BCT and here and Slack, and then waiting a few weeks in case news of a compromise comes out, is the best protection anyone is realistically going to get even if they run the holy grail of verification: a full Bitcoin node.
If there is an attack scenario still possible here, I'd like to hear it. It seems like you'd have to infiltrate every one of those institutions and people, and do it all at once. If sufficiently distributed geographically, jurisdictionally, and culturally, that seems well nigh impossible.
Now it's worth noting why such a system alone wouldn't work: everyone would only have everyone else to verify the system with, and there would be no final word to anchor it. Again this is what "plenty of nodes" accomplishes. It seems there is no need for everyone to run a node, even if we don't have full cryptographic fraud proofs.