{"id":3409,"date":"2017-08-25T11:42:40","date_gmt":"2017-08-25T16:42:40","guid":{"rendered":"https:\/\/scottaaronson.blog\/?p=3409"},"modified":"2021-10-12T17:45:45","modified_gmt":"2021-10-12T22:45:45","slug":"https-kurtz-eclipse-charlottesville-blum-p-vs-np","status":"publish","type":"post","link":"https:\/\/scottaaronson.blog\/?p=3409","title":{"rendered":"HTTPS \/ Kurtz \/ eclipse \/ Charlottesville \/ Blum \/ P vs. NP"},"content":{"rendered":"<p>This post has a grab bag of topics, unified only by the fact that I can no longer put off blogging about them. So if something doesn&#8217;t interest you, just scroll down till you find something that does.<\/p>\n<hr>\n<p>Great news, everyone: following&nbsp;a few&nbsp;reader complaints about the matter, the scottaaronson.com domain now supports <a href=\"https:\/\/en.wikipedia.org\/wiki\/HTTPS#History\">https<\/a>&#8212;and even&nbsp;automatically redirects to it! I&#8217;m so proud that <i>Shtetl-Optimized<\/i> has finally entered the technological universe&nbsp;of 1994. Thanks so much to heroic reader Martin Dehnel-Wild for setting this up for me.<\/p>\n<p><span style=\"color: #ff0000;\"><b>Update 26\/08\/2017:<\/b><\/span>&nbsp;Comments should now be working again;&nbsp;comments are now coming through to the moderated view in the blog&#8217;s control panel, so if they don&#8217;t show up immediately it might just be awaiting&nbsp;moderation. Thanks for your patience.<\/p>\n<hr>\n<p>Last&nbsp;weekend, I was in Columbia, South Carolina, for a workshop to honor the 60th birthday of <a href=\"http:\/\/people.cs.uchicago.edu\/~stuart\/\">Stuart Kurtz<\/a>, theoretical computer scientist at the University of Chicago. &nbsp;I gave a talk about how work Kurtz was involved in from the 1990s&#8212;for example, on defining the complexity class <a href=\"https:\/\/complexityzoo.uwaterloo.ca\/Complexity_Zoo:G#gapp\">GapP<\/a>, and constructing oracles that satisfy conflicting requirements simultaneously&#8212;plays a major&nbsp;role in modern research&nbsp;on quantum computational supremacy: as an&nbsp;example, my <a href=\"http:\/\/www.scottaaronson.com\/papers\/quantumsupre.pdf\">recent paper with Lijie Chen<\/a>. &nbsp;(Except, what a terrible week to be discussing the paths to&nbsp;supremacy! &nbsp;I promise there are no tiki torches involved, only much weaker photon sources.)<\/p>\n<p>Coincidentally, I don&#8217;t know if you read anything about this&nbsp;on social media, but there was this total solar eclipse that passed right over Columbia at the end of&nbsp;the conference.<\/p>\n<p>I&#8217;d always wondered why some people travel to remote corners&nbsp;of the earth to catch these. &nbsp;So the sky gets dark for two minutes, and then it gets light again, in a way that&#8217;s been completely understood and predictable for centuries?<\/p>\n<p>Having seen it, I can now tell you the deal, if you missed it&nbsp;and prefer to read about it here rather than&nbsp;10<sup>500<\/sup> other places online. &nbsp;At risk of stating the obvious: it&#8217;s not the dark sky; it&#8217;s the sun&#8217;s corona visible around the moon. &nbsp;Ironically, it&#8217;s only when the sun&#8217;s blotted out that you can actually <em>look<\/em> at the sun, at all the weird stuff going on around its disk.<\/p>\n<p>OK, but totality is &#8220;only&#8221; to eclipses as orgasms are to sex. &nbsp;There&#8217;s also the whole social experience of standing around outside with friends for an hour as the moon gradually takes a bigger bite out of the sun, staring up from time to time with eclipse-glasses to check its&nbsp;progress&#8212;and then everyone breaking into applause as the sky finally goes mostly dark, and you can look at&nbsp;the corona with the naked eye. &nbsp;And then, if you like, standing around for <em>another<\/em> hour as the moon gradually exits&nbsp;the other way. &nbsp;(If you&#8217;re outside the path of totality, this standing around and checking with eclipse-glasses is the <em>whole<\/em> experience.)<\/p>\n<p>One cool thing is that, a little&nbsp;before and after totality, shadows on the ground have little crescents in them, as if the eclipse is imprinting its &#8220;logo&#8221; all over&nbsp;the earth.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium\" src=\"https:\/\/scottaaronson.blog\/shadows-sm.jpg\" width=\"806\" height=\"605\"><\/p>\n<p>For me, the biggest lesson the eclipse drove home was&nbsp;the <a href=\"https:\/\/physics.stackexchange.com\/questions\/262813\/why-does-the-sun-have-to-be-nearly-fully-covered-to-notice-any-darkening-in-an-e\/262818\">logarithmic nature of perceived brightness<\/a>&nbsp;(see also <a href=\"http:\/\/slatestarcodex.com\/2017\/08\/21\/partial-credit\/\">Scott Alexander&#8217;s story<\/a>). &nbsp;Like, the sun can be more than 90% occluded,&nbsp;and yet it&#8217;s barely a shade darker outside. &nbsp;And you can <em>still<\/em> only look up&nbsp;with glasses so dark that they blot out everything <em>except<\/em>&nbsp;the sliver of sun, which still looks pretty much like the normal sun if you catch it out of the corner of your unaided eye. &nbsp;Only during totality, and a few minutes before and after, is the darkening obvious.<\/p>\n<hr>\n<p>Another topic at the workshop, unsurprisingly, was the ongoing darkening of the United States. &nbsp;If it wasn&#8217;t obvious from my blog&#8217;s name, and if saying so explicitly will make any difference for anything, let the record state:<\/p>\n<p><strong><em>Shtetl-Optimized<\/em> condemns Nazis, as well as anyone&nbsp;who knowingly marches with Nazis or defends them as &#8220;fine people.&#8221;<\/strong><\/p>\n<p>For a&nbsp;year, this blog has consistently described&nbsp;the now-president&nbsp;as a thug, liar, traitor, bully, sexual predator, madman, racist, and fraud, and has urged decent people everywhere to fight&nbsp;him by every peaceful and legal means available. &nbsp;But if there&#8217;s some form of condemnation that I accidentally missed, then after&nbsp;Charlottesville, and Trump&#8217;s unhinged quasi-defenses of violent neo-Nazis, and defenses of his previous defenses, etc.&#8212;please consider <em>Shtetl-Optimized<\/em> to have condemned Trump that way also.<\/p>\n<p>At least Charlottesville seems to have set&nbsp;local decisionmakers on an unstoppable course&nbsp;toward removing the country&#8217;s remaining Confederate statues&#8212;something&nbsp;<a href=\"https:\/\/scottaaronson.blog\/?p=3285\">I strongly supported&nbsp;back in May<\/a>, before it had become the fully thermonuclear issue that it is now. &nbsp;In an overnight operation, UT Austin <a href=\"https:\/\/www.nytimes.com\/2017\/08\/21\/us\/texas-austin-confederate-statues.html\">has taken down&nbsp;its statues<\/a> of Robert E. Lee, Albert Johnston, John Reagan, and Stephen Hogg. &nbsp;(I confess, the <i>postmaster general<\/i> of the Confederacy wouldn&#8217;t have been my #1 priority for removal. &nbsp;And, genuine question: what did Texas governor <a href=\"https:\/\/en.wikipedia.org\/wiki\/Jim_Hogg\">Stephen Hogg<\/a> do that was so awful for his time, besides naming his daughter <a href=\"https:\/\/en.wikipedia.org\/wiki\/Ima_Hogg\">Ima Hogg<\/a>?)<\/p>\n<hr>\n<p>A final thing to talk about&#8212;yeah, we can&#8217;t avoid it&#8212;is&nbsp;<a href=\"https:\/\/arxiv.org\/abs\/1708.03486\">Norbert Blum&#8217;s claimed proof of P\u2260NP<\/a>. &nbsp;I suppose I should be gratified that, after my last post, there were commenters who said, &#8220;OK, but enough about gender politics&#8212;what about P vs. NP?&#8221; &nbsp;Here&#8217;s what I wrote on Tuesday the 15th:<\/p>\n<p style=\"padding-left: 30px;\">To everyone who keeps asking me about the \u201cnew\u201d P\u2260NP proof: I\u2019d again bet $200,000 that the paper&nbsp;won\u2019t stand, except that the last time&nbsp;I tried that, it didn\u2019t achieve its purpose, which was to get people to stop asking me about it. So: please stop asking, and if the thing hasn\u2019t been refuted by the end of the week, you can come back and tell me I was a closed-minded fool.<\/p>\n<p>Many people misunderstood me to be saying that I&#8217;d <a href=\"https:\/\/scottaaronson.blog\/?p=456\">again<\/a> bet $200,000, even though the sentence said the exact opposite. &nbsp;Maybe I should&#8217;ve said: <em>I&#8217;m searching in vain for the right way to teach the nerd world to get less excited about these claims, to have the same reaction that the experts do, which is &#8216;oh boy, not another one&#8217;&#8212;which doesn&#8217;t mean that you know the error, or even that there is an error, but just means that you know the history.<\/em><\/p>\n<p>Speaking of which, some friends and I recently had an awesome idea. &nbsp;Just today, I registered the domain name <strong>haspvsnpbeensolved.com<\/strong>. &nbsp;I&#8217;d like to set this up with a form that lets you&nbsp;type in&nbsp;the URL of a paper claiming to resolve the P vs. NP problem. &nbsp;The site will then take 30 seconds or so to process the paper&#8212;with a status bar, progress updates, etc.&#8212;before finally rendering a verdict about the paper&#8217;s correctness. &nbsp;Do&nbsp;any readers volunteer to help me create this? &nbsp;Don&#8217;t worry, I&#8217;ll supply the secret algorithm to decide correctness, and will personally vouch for that algorithm for as long as the site remains live.<\/p>\n<p>I have nothing bad&nbsp;to say about Norbert Blum, who made important&nbsp;contributions including the <a href=\"http:\/\/scidok.sulb.uni-saarland.de\/volltexte\/2011\/4065\/pdf\/fb14_1982_13ocr.pdf\">3n circuit size lower bound<\/a> for an explicit Boolean function&#8212;something that stood until very recently as the world record&#8212;and whose P\u2260NP&nbsp;paper was lucidly written, passing many of the <a href=\"https:\/\/scottaaronson.blog\/?p=458\">most obvious checks<\/a>. &nbsp;And I received a bit of&nbsp;criticism for my &#8220;dismissive&#8221; stance. &nbsp;<em>Apparently<\/em>, some right-wing former string theorist who I no longer&nbsp;read, whose name rhymes with Mubos Lotl, even accused me of being a conformist left-wing ideologue, driven to ignore Blum&#8217;s proof by an irrational conviction that any P\u2260NP proof will necessarily be so difficult that it will need&nbsp;to &#8220;await the Second Coming of Christ.&#8221; &nbsp;Luca Trevisan&#8217;s <a href=\"https:\/\/lucatrevisan.wordpress.com\/2017\/08\/15\/on-norbert-blums-claimed-proof-that-p-does-not-equal-np\/#comment-20470\">reaction<\/a> to that is worth quoting:<\/p>\n<p style=\"padding-left: 30px;\">I agree with [Mubos Lotl] that the second coming of Jesus Christ is not a necessary condition for a correct proof that P is different from NP. I am keeping an open mind as to whether it is a sufficient condition.<\/p>\n<p>On reflection, though, Mubos has a point: all of us, including me, should keep an open mind. &nbsp;Maybe P\u2260NP (or P=NP!) is vastly&nbsp;easier to prove than most experts&nbsp;think, and is susceptible to a &#8220;fool&#8217;s mate.&#8221;<\/p>\n<p>That being the case,&nbsp;it&#8217;s only intellectual&nbsp;honesty that compels me to report&nbsp;that, by about Friday of last week&#8212;i.e., exactly&nbsp;on my predicted schedule&#8212;a clear consensus had developed among experts that Blum&#8217;s&nbsp;P\u2260NP&nbsp;proof was irreparably flawed, and the consensus has stood since that time.<\/p>\n<p>I&#8217;ve often wished that, even just for&nbsp;an hour&nbsp;or two, I could be free from this terrifying burden that I&#8217;ve carried around&nbsp;since childhood: the burden of having the right&nbsp;instincts&nbsp;about virtually&nbsp;everything. &nbsp;Trust me, this &#8220;gift&#8221; is a lot less useful than it sounds, especially when reality&nbsp;so often <a href=\"https:\/\/scottaaronson.blog\/?p=3376\">contradicts<\/a> what&#8217;s popular or expedient to say.<\/p>\n<p>The background to Blum&#8217;s attempt, the counterexample that shows the proof has to fail&nbsp;<em>somewhere<\/em>, and the specifics of what appears&nbsp;to go wrong have already been covered at length elsewhere: see especially <a href=\"https:\/\/lucatrevisan.wordpress.com\/2017\/08\/15\/on-norbert-blums-claimed-proof-that-p-does-not-equal-np\/\">Luca&#8217;s post<\/a>, <a href=\"https:\/\/rjlipton.wordpress.com\/2017\/08\/17\/on-the-edge-of-eclipses-and-pnp\/\">Dick Lipton&#8217;s post<\/a>, <a href=\"https:\/\/johncarlosbaez.wordpress.com\/2017\/08\/15\/norbert-blum-on-p-versus-np\/\">John Baez&#8217;s post<\/a>, and the <a href=\"https:\/\/cstheory.stackexchange.com\/questions\/38803\/is-norbert-blums-2017-proof-that-p-ne-np-correct\">CS Theory StackExchange thread<\/a>.<\/p>\n<p>Very briefly, though: Blum claims to generalize some of the most celebrated complexity results&nbsp;of the 1980s&#8212;namely, superpolynomial lower bounds on the sizes of&nbsp;<em>monotone <\/em>circuits, which consist entirely of Boolean AND and OR gates&#8212;so that they also work for <em>general<\/em> (non-monotone) circuits, consisting of AND, OR, and NOT gates. &nbsp;Everyone agrees that, if this succeeded, it would imply&nbsp;P\u2260NP.<\/p>\n<p>Alas, another big discovery from the 1980s was that there are monotone Boolean functions (like Perfect Matching) that require superpolynomial-size monotone circuits, even though they have polynomial-size non-monotone&nbsp;circuits. &nbsp;Why is that such a bummer? &nbsp;Because it means our techniques for proving monotone circuit lower bounds can&#8217;t possibly work in as much generality as one might&#8217;ve&nbsp;na\u00efvely hoped: if they did, they&#8217;d imply&nbsp;not merely&nbsp;that P doesn&#8217;t contain NP, but also that P doesn&#8217;t contain itself.<\/p>\n<p>Blum was aware of all this, and gave arguments as to why his approach evades the Matching counterexample. &nbsp;The trouble is, there&#8217;s <em>another<\/em> counterexample, which Blum doesn&#8217;t address, called <a href=\"https:\/\/en.wikipedia.org\/wiki\/Tardos_function\">Tardos&#8217;s function<\/a>. &nbsp;This is a weird creature: it&#8217;s obtained by starting with a graph invariant called the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Lov%C3%A1sz_number\">Lov\u00e1sz theta function<\/a>, then looking at a polynomial-time approximation scheme for the theta function, and finally rounding the output of that PTAS to get a monotone function. &nbsp;But whatever: in <a href=\"http:\/\/www.cs.cornell.edu\/~eva\/Gap.Between.Monotone.NonMonotone.Circuit.Complexity.is.Exponential.pdf\">constructing this function<\/a>, Tardos achieved her goal, which was to produce a monotone function that <em>all<\/em> known lower bound techniques for monotone circuits work perfectly fine for, but which is nevertheless in P (i.e., has polynomial-size non-monotone circuits). &nbsp;In particular, if Blum&#8217;s proof worked, then it would also work for Tardos&#8217;s function, and that gives us&nbsp;a contradiction.<\/p>\n<p>Of course, this&nbsp;merely tells us that Blum&#8217;s proof must <em>have<\/em>&nbsp;one or more mistakes; it doesn&#8217;t pinpoint where they are. &nbsp;But the latter question has now been addressed as well. &nbsp;On CS StackExchange, an anonymous commenter who goes variously by &#8220;idolvon&#8221; and &#8220;vloodin&#8221; provides a <a href=\"https:\/\/cstheory.stackexchange.com\/a\/38836\/45696\">detailed analysis<\/a> of the proof of Blum&#8217;s crucial Theorem 6. &nbsp;I haven&#8217;t gone through every step myself, and there might be more to say about the matter than &#8220;vloodin&#8221; has, but several experts&nbsp;who are at once smarter, more knowledgeable, more cautious, and more publicity-shy than me have confirmed for me that vloodin correctly identified the erroneous region.<\/p>\n<p>To those who wonder what gave me the confidence to call this immediately, without working through the details: besides the Cassandra-like burden that I was born with, I can explain&nbsp;something that might be helpful. &nbsp;When Razborov achieved&nbsp;his superpolynomial monotone lower bounds in the 1980s, there was a brief surge&nbsp;of excitement: how far away could a P\u2260NP proof possibly be? &nbsp;But then people, including Razborov himself, understood much more deeply what was going on&#8212;an understanding that was reflected in the theorems they proved, but also wasn&#8217;t&nbsp;completely captured by those theorems.<\/p>\n<p>What was going on was this: monotone circuits are an interesting and nontrivial computational model. &nbsp;Indeed for certain Boolean functions, such as the&nbsp;<a href=\"http:\/\/epubs.siam.org\/doi\/abs\/10.1137\/0215037\">&#8220;slice functions,&#8221;<\/a> they&#8217;re every bit as powerful as general circuits. &nbsp;However, <em>insofar as it&#8217;s possible to prove superpolynomial lower bounds on monotone circuit size<\/em>, it&#8217;s possible only because monotone circuits are ridiculously less expressive&nbsp;than general Boolean circuits <em>for the problems in question<\/em>. &nbsp;E.g., it&#8217;s possible only because monotone circuits aren&#8217;t expressing pseudorandom functions, and therefore aren&#8217;t engaging the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Natural_proof\">natural proofs barrier<\/a> or most of the other terrifying beasts that we&#8217;re up against.<\/p>\n<p>So what can we say about the prospect that a minor tweak to the monotone circuit lower bound techniques from the 1980s would yield P\u2260NP? &nbsp;If, like Mubos Lotl, you took&nbsp;the view that discrete math and theory of computation are just a mess of disconnected, random statements, then such a prospect would seem as likely to you as not. &nbsp;But if you&#8217;re armed with the understanding&nbsp;above, then this possibility is a lot like the possibility that the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Faster-than-light_neutrino_anomaly\">OPERA experiment discovered superluminal neutrinos<\/a>: no, not a logical impossibility, but something that&#8217;s safe to bet against at 10,000:1 odds.<\/p>\n<p>During the discussion of Deolalikar&#8217;s earlier&nbsp;P\u2260NP&nbsp;claim, I once compared betting against a&nbsp;proof that all sorts of people are calling &#8220;formidable,&#8221; &#8220;solid,&#8221; etc., to <a href=\"https:\/\/www.youtube.com\/watch?v=i2GdY1OlDpA\">standing in front of a huge&nbsp;pendulum<\/a>&#8212;behind the furthest point that it reached the last time&#8212;even as it swings toward&nbsp;your face. &nbsp;Just as&nbsp;certain physics teachers&nbsp;stake their lives on the conservation of energy, so I&#8217;m willing to stake my academic reputation, again and again, on the conservation of circuit-lower-bound&nbsp;difficulty. &nbsp;And here I am, alive&nbsp;to tell the tale.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This post has a grab bag of topics, unified only by the fact that I can no longer put off blogging about them. So if something doesn&#8217;t interest you, just scroll down till you find something that does. Great news, everyone: following&nbsp;a few&nbsp;reader complaints about the matter, the scottaaronson.com domain now supports https&#8212;and even&nbsp;automatically redirects [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"_wpas_customize_per_network":false},"categories":[10,31,5,3],"tags":[],"class_list":["post-3409","post","type-post","status-publish","format-standard","hentry","category-adventures-in-meatspace","category-announcements","category-complexity","category-procrastination"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/posts\/3409","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3409"}],"version-history":[{"count":6,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/posts\/3409\/revisions"}],"predecessor-version":[{"id":5939,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/posts\/3409\/revisions\/5939"}],"wp:attachment":[{"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3409"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3409"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3409"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}