{"id":9030,"date":"2025-08-04T21:19:36","date_gmt":"2025-08-05T02:19:36","guid":{"rendered":"https:\/\/scottaaronson.blog\/?p=9030"},"modified":"2025-08-05T15:13:29","modified_gmt":"2025-08-05T20:13:29","slug":"chatgpt-and-the-meaning-of-life-guest-post-by-harvey-lederman","status":"publish","type":"post","link":"https:\/\/scottaaronson.blog\/?p=9030","title":{"rendered":"ChatGPT and the Meaning of Life: Guest Post by Harvey Lederman"},"content":{"rendered":"<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img decoding=\"async\" src=\"https:\/\/www.scottaaronson.com\/harvey.jpg\" alt=\"\"\/><\/figure>\n<\/div>\n\n\n<p class=\"wp-block-paragraph\"><strong>Scott Aaronson&#8217;s Brief Foreword:<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/www.harveylederman.com\/\">Harvey Lederman<\/a> is a distinguished analytic philosopher who moved from Princeton to UT Austin a few years ago. Since his arrival, he&#8217;s become one of my best friends among the UT professoriate.  He&#8217;s my favorite kind of philosopher, the kind who sees scientists as partners in discovering the truth, and also has a great sense of humor.  He and I are both involved in UT&#8217;s new <a href=\"https:\/\/sites.utexas.edu\/ahoi\/\">AI and Human Objectives Initiative (AHOI)<\/a>, which is supported by Open Philanthropy.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The other day, Harvey emailed me an eloquent meditation he wrote on what will be the meaning of life if AI doesn&#8217;t kill us all, but &#8220;merely&#8221; does everything we do better than we do it.  While the question is of course now extremely familiar to me, Harvey&#8217;s erudition&#8212;bringing to bear everything from speculative fiction to the history of polar exploration&#8212;somehow brought the stakes home for me in a new way.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Harvey mentioned that he&#8217;d sent his essay to major magazines but hadn&#8217;t had success.  So I said, why not a <em>Shtetl-Optimized<\/em> guest post?  Harvey replied&#8212;what might be the highest praise this blog has ever received&#8212;well, that would be even<em> better<\/em> than the national magazine, as it would reach more relevant people.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And so without further ado, I present to you&#8230;<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>ChatGPT and the Meaning of Life, by Harvey Lederman<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For the last two and a half years, since the release of ChatGPT, I\u2019ve been suffering from fits of dread. It\u2019s not every minute, or even every day, but maybe once a week, I\u2019m hit by it\u2014slackjawed, staring into the middle distance\u2014frozen by the prospect that someday, maybe pretty soon, everyone will lose their job.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At first, I thought these slackjawed fits were just a phase, a passing thing. I\u2019m a philosophy professor; staring into the middle distance isn\u2019t exactly an unknown disease among my kind. But as the years have begun to pass, and the fits have not, I\u2019ve begun to wonder if there\u2019s something deeper to my dread. Does the coming automation of work foretell, as my fits seem to say, an irreparable loss of value in human life?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The titans of artificial intelligence tell us that there\u2019s nothing to fear. Dario Amodei, CEO of Anthropic, the maker of Claude, <a href=\"https:\/\/www.darioamodei.com\/essay\/machines-of-loving-grace#5-work-and-meaning\">sug<\/a><a href=\"https:\/\/www.darioamodei.com\/essay\/machines-of-loving-grace#5-work-and-meaning\">gests that<\/a>: \u201chistorical hunter-gatherer societies might have imagined that life is meaningless without hunting,\u201d and \u201cthat our well-fed technological society is devoid of purpose.\u201d But of course, we don\u2019t see our lives that way. Sam Altman, the CEO of OpenAI, <a href=\"https:\/\/blog.samaltman.com\/\">sounds so similar, the text could have been written by ChatGPT<\/a>. Even if the jobs of the future will look as \u201cfake\u201d to us as ours do to \u201ca subsistence farmer\u201d, Altman has \u201cno doubt they will feel incredibly important and satisfying to the people doing them.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Alongside these optimists, there are plenty of pessimists who, like me, are filled with dread. <a href=\"https:\/\/www.wsj.com\/tech\/ai\/pope-leo-ai-tech-771cca48\">Pope Leo XIV<\/a> has decried the threats AI poses to \u201chuman dignity, labor and justice\u201d. Bill Gates <a href=\"https:\/\/www.gatesnotes.com\/Homo-Deus\">has writ<\/a><a href=\"https:\/\/www.gatesnotes.com\/Homo-Deus\">ten about his fear<\/a>, that \u201cif we solved big problems like hunger and disease, and the world kept getting more peaceful: What purpose would humans have then?\u201d And Douglas Hofstadter, the computer scientist and author of <em>G\u00f6del, Escher, Bach<\/em>, has <a href=\"https:\/\/www.reddit.com\/r\/slatestarcodex\/comments\/14pqxb8\/douglas_hofstadter_is_terrified_and_depressed\/\">spoken eloquently of<\/a> his terror and depression at \u201can oncoming tsunami that is going to catch all of humanity off guard.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Who should we believe? The optimists with their bright visions of a world without work, or the pessimists who fear the end of a key source of meaning in human life?<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\">I was brought up, maybe like you, to value hard work and achievement. In our house, scientists were heroes, and discoveries grand prizes of life. I was a diligent, obedient kid, and eagerly imbibed what I was taught. I came to feel that one way a person\u2019s life could go well was to make a discovery, to figure something out.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I had the sense already then that geographical discovery was played out. I loved the heroes of the great Polar Age, but I saw them\u2014especially Roald Amundsen and Robert Falcon Scott\u2014as the last of their kind. In December 1911, Amundsen reached the South Pole using skis and dogsleds. Scott reached it a month later, in January 1912, after ditching the motorized sleds he\u2019d hoped would help, and man-hauling the rest of the way. As the black dot of Amundsen\u2019s flag came into view on the ice, Scott was devastated to reach this <a href=\"https:\/\/www.gutenberg.org\/cache\/epub\/11579\/pg11579.txt\">\u201cawful place\u201d, \u201cwithout the reward of priority\u201d<\/a>. He would never make it back.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Scott\u2019s motors failed him, but they spelled the end of the great Polar Age. Even Amundsen took to motors on his return: in 1924, he made a failed attempt for the North Pole in a plane, and, in 1926, he successfully flew over it, in a dirigible. Already by then, the skis and dogsleds of the decade before were outdated heroics of a bygone world.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We may be living now in a similar twilight age for human exploration in the realm of ideas. Akshay Venkatesh, whose discoveries earned him the 2018 Fields Medal, mathematics\u2019 highest honor, <a href=\"https:\/\/www.math.ias.edu\/~akshay\/research\/IASEssay.pdf\">has written that<\/a>, the \u201cmechanization of our cognitive processes will alter our understanding of what mathematics is\u201d. Terry Tao, a 2006 Fields Medalist, expects that in just two years <a href=\"https:\/\/www.scientificamerican.com\/article\/ai-will-become-mathematicians-co-pilot\/\">AI will be a copilot for<\/a> <a href=\"https:\/\/www.scientificamerican.com\/article\/ai-will-become-mathematicians-co-pilot\/\">working mathematicians<\/a>. He envisions a future where thousands of theorems are proven all at once by mechanized minds.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Now, I don\u2019t know any more than the next person where our current technology is headed, or how fast. The core of my dread isn\u2019t based on the idea that human redundancy will come in two years rather than twenty, or, for that matter, two hundred. It\u2019s a more abstract dread, if that\u2019s a thing, dread about what it would mean for human values, or anyway my values, if automation \u201csucceeds\u201d: if all mathematics\u2014and, indeed all work\u2014is done by motor, not by human hands and brains.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A world like that wouldn\u2019t be good news for my childhood dreams. Venkatesh and Tao, like Amundsen and Scott, live meaningful lives, lives of purpose. But worthwhile discoveries like theirs are a scarce resource. A territory, once seen, can\u2019t be seen first again. If mechanized minds consume all the empty space on the intellectual map, lives dedicated to discovery won\u2019t be lives that humans can lead.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The right kind of pessimist sees here an important argument for dread. If discovery is valuable in its own right, the loss of discovery could be an irreparable loss for humankind.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A part of me would like this to be true. But over these last strange years, I\u2019ve come to think it\u2019s not. What matters, I now think, isn\u2019t being the <em>first <\/em>to figure something out, but the consequences of the discovery: the joy the discoverer gets, the understanding itself, or the real life problem their knowledge solves. Alexander Fleming discovered penicillin, and through that work saved thousands, perhaps millions of lives. But if it were to emerge, in the annals of an outlandish future, that an alien discovered penicillin thousands of years before Fleming did, we wouldn\u2019t think that Fleming\u2019s life was worse, just because he wasn\u2019t <em>first<\/em>. He eliminated great suffering from human life; the alien discoverer, if they\u2019re out there, did not. So, I\u2019ve come to see, it\u2019s not discoveries themselves that matter. It\u2019s what they bring about.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\">But the advance of automation would mean the end of much more than human discovery. It could mean the end of all necessary work. Already in 1920, the Czech playwright Karel Capek asked what a world like that would mean for the values in human life. In the first act of <em>R.U.R.<\/em>\u2014the play which introduced the modern use of the word \u201crobot\u201d\u2014Capek has Henry Domin, the manager of Rossum\u2019s Universal Robots (the R.U.R. of the title), offer his corporation\u2019s utopian pitch. \u201cIn ten years\u201d, he says, their robots will \u201cproduce so much corn, so much cloth, so much everything\u201d that \u201cThere will be no poverty.\u201d \u201cEverybody will be free from worry and liberated from the degradation of labor.\u201d The company\u2019s engineer, Alquist, isn\u2019t convinced. Alquist (who, incidentally, ten years later, will be the only human living, when the robots have killed the rest) retorts that \u201cThere was something good in service and something great in humility\u201d, \u201csome kind of virtue in toil and weariness\u201d.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Service\u2014work that meets others\u2019 significant needs and wants\u2014 is, unlike discovery, clearly good in and of itself. However we work\u2014 as nurses, doctors, teachers, therapists, ministers, lawyers, bankers, or, really, anything at all\u2014working to meet others\u2019 needs makes our own lives go well. But, as Capek saw, all such work could disappear. In a \u201cpost-instrumental\u201d world, where people are comparatively useless and the bots meet all our important needs, there would be no needed work for us to do, no suffering to eliminate, no diseases to cure. Could the end of such work be a better reason for dread?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The hardline pessimists say that it is. They say that the end all needed work would not only be a loss of <em>some <\/em>value to humanity, as everyone should agree. For them it would be a loss to humanity <em>on balance<\/em>, an overall loss, that couldn\u2019t be compensated in another way.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I feel a lot of pull to this pessimistic thought. But once again, I\u2019ve come to think it\u2019s wrong. For one thing, pessimists often overlook just how bad most work actually is. In May 2021, Luo Huazhang, a 31 year-old ex-factory worker in Sichuan wrote a viral post, entitled \u201c<a href=\"https:\/\/chi.st\/bugs\/tang-ping\">Lying Flat is Justice<\/a>\u201d. Luo had searched at length for a job that, unlike his factory job, would allow him time for himself, but <a href=\"https:\/\/www.nytimes.com\/2021\/07\/03\/world\/asia\/china-slackers-tangping.html\">he couldn\u2019t find one<\/a>. So he quit, biked to Tibet and back, and commenced his lifestyle of <em>lying flat<\/em>, doing what he pleased, reading philosophy, contemplating the world. The idea struck a chord with overworked young Chinese, who, it emerged, did not find \u201csomething great\u201d in their \u201chumility\u201d. The movement inspired memes, selfies flat on one\u2019s back, and <a href=\"https:\/\/www.youtube.com\/watch?v=corZx0a1yRU&amp;ab_channel=%E5%BC%A0%E4%B8%8D%E4%B8%89\">even an anthem<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That same year, as the Great Resignation in the United States took off, the subreddit r\/antiwork played to similar discontent. Started in 2013, under the motto \u201cUnemployment for all, not only the rich!\u201d, the forum went viral in 2021, starting with a screenshot of a quitting worker\u2019s texts to his supervisor (\u201cNo thanks. Have a good life\u201d), and culminating in labor-actions, <a href=\"https:\/\/www.washingtonpost.com\/technology\/2021\/12\/16\/reddit-kellogg-strike-antiwork\/\">first supporting striking workers<\/a> <a href=\"https:\/\/www.washingtonpost.com\/technology\/2021\/12\/16\/reddit-kellogg-strike-antiwork\/\">at Kelloggs by spamming their job application site<\/a>, and then attempting to <a href=\"https:\/\/www.nytimes.com\/2022\/02\/15\/magazine\/antiwork-reddit.html\">support a similar strike at McDonald\u2019s<\/a>. It wasn\u2019t just young Chinese who hated their jobs.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In <em>Automation and Utopia: Human Flourishing in a World without Work<\/em>, the Irish lawyer and philosopher John Danaher imagines an antiwork techno-utopia, with plenty of room for lying flat. As Danaher puts it: \u201cWork is bad for most people most of the time.\u201d\u201cWe should do what we can to hasten the obsolescence of humans in the arena of work.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The young Karl Marx would have seen both Domin\u2019s and Danaher\u2019s utopias as a catastrophe for human life. <a href=\"https:\/\/www.marxists.org\/archive\/marx\/works\/1844\/james-mill\/\">In his notebooks from<\/a> <a href=\"https:\/\/www.marxists.org\/archive\/marx\/works\/1844\/james-mill\/\">1844<\/a>, Marx describes an ornate and almost epic process, where, by meeting the needs of others through production, we come to recognize the other in ourselves, and through that recognition, come at last to self-consciousness, the full actualization of our human nature. The end of needed work, for the Marx of these notes, would be the impossibility of fully realizing our nature, the end, in a way, of humanity itself.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But such pessimistic lamentations have come to seem to me no more than misplaced machismo. Sure, Marx\u2019s and my culture, the ethos of <em>our <\/em>post-industrial professional class, might make <em>us <\/em>regret a world without work. But we shouldn\u2019t confuse the way two philosophers were brought up with the fundamental values of human life. What stranger narcissism could there be than bemoaning the end of others\u2019 suffering, disease, and need, just because it deprives <em>you <\/em>of the chance to be a hero?<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\">The first summer after the release of ChatGPT\u2014the first summer of my fits of dread\u2014I stayed with my in-laws in Val Camonica, a valley in the Italian alps. The houses in their village, Sellero, are empty and getting emptier; the people on the streets are old and getting older. The kids that are left\u2014my wife\u2019s elementary school class had, even then, a full complement of four\u2014often leave for better lives. But my in-laws are connected to this place, to the houses and streets where they grew up. They see the changes too, of course. On the mountains above, the Adamello, Italy\u2019s largest glacier, is retreating faster every year. But while the shows on Netflix change, the same mushrooms appear in the summer, and the same chestnuts are collected in the fall.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Walking in the mountains of Val Camonica that summer, I tried to find parallels for my sense of impending loss. I thought about William Shanks, a British mathematician who calculated <em>\u03c0 <\/em>to 707 digits by hand in 1873 (he made a mistake at 527; almost 200 digits were wrong). He later spent years of his life, literally years, on a table of the <a href=\"https:\/\/www.numberphile.com\/videos\/the-reciprocals-of-primes\">reciprocals of the primes up to one-hundred and ten<\/a> <a href=\"https:\/\/www.numberphile.com\/videos\/the-reciprocals-of-primes\">thousand<\/a>, calculating in the morning by hand, and checking it over in the afternoon. That was his life\u2019s work. Just sixty years after his death, though, already in the 1940s, the table on which his precious mornings were spent, the few mornings he had on this earth, could be made by a machine in a day.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I feel sad thinking about Shanks, but I don\u2019t feel grief for the loss of calculation by hand. The invention of the typewriter, and the death of handwritten notes seemed closer to the loss I imagined we might feel. Handwriting was once a part of your style, a part of who you were. With its decline some artistry, a deep and personal form of expression, may be lost. When the bots help with everything we write, couldn\u2019t we too lose our style and voice?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But more than anything I thought of what I saw around me: the slow death of the dialects of Val Camonica and the culture they express. Chestnuts were at one time so important for nutrition here, that in the village of Paspardo, a street lined with chestnut trees is called \u201cbread street\u201d (\u201cVia del Pane\u201d). The hyper-local dialects of the valley, outgrowths sometimes of a single family\u2019s inside jokes, have words for all the phases of the chestnut. There\u2019s a porridge made from chestnut flour that, in Sellero goes by \u2018skelt\u2019, but is \u2018pult\u2019 in Paspardo, a cousin of \u2018migole\u2019 in Malonno, just a few villages away. Boiled, chestnuts are <em>tetighe<\/em>; dried on a <em>grat<\/em>, <em>biline <\/em>or <em>bascocc<\/em>, which, seasoned and boiled become <em>broalade<\/em>. The dialects don\u2019t just record what people eat and ate; they recall how they lived, what they saw, and where they went. Behind Sellero, every hundred-yard stretch of the walk up to the cabins where the cows were taken to graze in summer, has its own name. Aiva Codaola. Quarsanac. Coran. Spi. Ruc.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But the young people don\u2019t speak the dialect anymore. They go up to the cabins by car, too fast to name the places along the way. They can\u2019t remember a time when the cows were taken up to graze. Some even buy chestnuts in the store.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Grief, you don\u2019t need me to tell you, is a complicated beast. You can grieve for something even when you know that, on balance, it\u2019s good that it\u2019s gone. The death of these dialects, of the stories told on summer nights in the mountains with the cows, is a loss reasonably grieved. But you don\u2019t hear the kids wishing more people would be forced to stay or speak this funny-sounding tongue. You don\u2019t even hear the old folks wishing they could go back fifty years\u2014in those days it wasn\u2019t so easy to be sure of a meal. For many, it\u2019s better this way, not the best it could be, but still better, even as they grieve what they stand to lose and what they\u2019ve already lost.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The grief I feel, imagining a world without needed work, seems closest to this kind of loss. A future without work could be much better than ours, overall. But, living in that world, or watching as our old ways passed away, we might still reasonably grieve the loss of the work that once was part of who we were.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\">In the last chapter of Edith Wharton\u2019s <em>Age of Innocence<\/em>, Newland Archer contemplates a world that has changed dramatically since, thirty years earlier, before these new fangled telephones and five-day trans-Atlantic ships, he renounced the love of his life. Awaiting a meeting that his free-minded son Dallas has organized with Ellen Olenska, the woman Newland once loved, he wonders whether his son, and this whole new age, can really love the way he did and does. How could their hearts beat like his, when they\u2019re always so sure of getting what they want?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There have always been things to grieve about getting old. But modern technology has given us new ways of coming to be out of date. A generation born in 1910 did their laundry in Sellero\u2019s public fountains. They watched their grandkids grow up with washing machines at home. As kids, my in-laws worked with their families to dry the hay by hand. They now know, abstractly, that it can all be done by machine. Alongside newfound health and ease, these changes brought, as well, a mix of bitterness and grief: grief for the loss of gossip at the fountains or picnics while bringing in the hay; and also bitterness, because the kids these days just have no idea how easy they have it now.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As I look forward to the glories that, if the world doesn\u2019t end, my grandkids might enjoy, I too feel prospective bitterness and prospective grief. There\u2019s grief, in advance, for what we now have that they\u2019ll have lost: the formal manners of my grandparents they\u2019ll never know, the cars they\u2019ll never learn to drive, and the glaciers that will be long gone before they\u2019re born. But I also feel bitter about what we\u2019ve been through that they won\u2019t have to endure: small things like folding the laundry, standing in security lines or taking out the trash, but big ones too\u2014the diseases which will take our loved ones that they\u2019ll know how to cure.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">All this is a normal part of getting old in the modern world. But the changes we see could be much faster and grander in scale. Amodei of Anthropic <a href=\"https:\/\/www.darioamodei.com\/essay\/machines-of-loving-grace\">speculates<\/a> that a century of technological change could be compressed into the next decade, or less. Perhaps it\u2019s just hype, but\u2014what if it\u2019s not? It\u2019s one thing for a person to adjust, over a full life, to the washing machine, the dishwasher, the air-conditioner, one by one. It\u2019s another, in five years, to experience the progress of a century. Will I see a day when childbirth is a thing of the past? What about sleep? Will our \u2018descendants\u2019 have bodies at all?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And this round of automation could also lead to unemployment unlike any our grandparents saw. Worse, those of us working now might be especially vulnerable to this loss. Our culture, or anyway mine\u2014professional America of the early 21st century\u2014has apotheosized work, turning it into a central part of who we are. Where others have a sense of place\u2014their particular mountains and trees\u2014we\u2019ve come to locate ourselves with professional attainment, with particular degrees and jobs. For us, <a href=\"https:\/\/www.theatlantic.com\/ideas\/archive\/2019\/02\/religion-workism-making-americans-miserable\/583441\/\">\u2018workists\u2019 that so<\/a> <a href=\"https:\/\/www.theatlantic.com\/ideas\/archive\/2019\/02\/religion-workism-making-americans-miserable\/583441\/\">many of us have become<\/a>, technological displacement wouldn\u2019t just be the loss of our jobs. It would be the loss of a central way we have of making sense of our lives.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">None of this will be a problem for the new generation, for our kids. They\u2019ll know how to live in a world that could be\u2014if things go well\u2014far better overall. But I don\u2019t know if I\u2019d be able to adapt. Intellectual argument, however strong, is weak against the habits of years. I fear they\u2019d look at me, stuck in my old ways, with the same uncomprehending look that Dallas Archer gives his dad, when Newland announces that he won\u2019t go see Ellen Olenska, the love of his life, after all. \u201cSay\u201d, as Newland tries to explain to his dumbfounded son, \u201cthat I\u2019m old fashioned, that\u2019s enough.\u201d<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\">And yet, the core of my dread is not about aging out of work before my time. I feel closest to Douglas Hofstadter, the author of <em><em>G\u00f6del<\/em>, Escher, Bach<\/em>. His dread, like mine, isn\u2019t only about the loss of work today, or the possibility that we\u2019ll be killed off by the bots. He fears that even a gentle superintelligence will be \u201cas incomprehensible to us as we are to cockroaches.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Today, I feel part of our grand human projects\u2014the advancement of knowledge, the creation of art, the effort to make the world a better place. I\u2019m not in any way a star player on the team. My own work is off in a little backwater of human thought. And I can\u2019t understand all the details of the big moves by the real stars. But even so, I understand enough of our collective work to feel, in some small way, part of our joint effort. All that will change. If I were to be transported to the brilliant future of the bots, I wouldn\u2019t understand them or their work enough to feel part of the grand projects of their day. Their work would have become, to me, as alien as ours is to a roach.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\">But I\u2019m still persuaded that the hardline pessimists are wrong. Work is far from the most important value in our lives. A post-instrumental world could be full of much more important goods\u2014 from rich love of family and friends, to new undreamt of works of art\u2014which would more than compensate the loss of value from the loss of our work.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Of course, even the values that do persist may be transformed in almost unrecognizable ways. In <em>Deep Utopia: Life and Meaning in a Solved World<\/em>, the futurist and philosopher Nick Bostrom imagines how things might look. In one of the most memorable sections of the book\u2014right up there with an epistolary novella about the exploits of Pignolius the pig (no joke!)\u2014Bostrom says that even child-rearing may be something that we, if we love our children, would come to forego. In a truly post-instrumental world, a robot intelligence could do better for your child, not only in teaching the child to read, but also in showing unbreakable patience and care. If you\u2019ll snap at your kid, when the robot would not, it would only be selfishness for you to get in the way.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It\u2019s a hard question whether Bostrom is right. At least some of the work of care isn\u2019t like eliminating suffering or ending mortal disease. The needs or wants are small-scale stuff, and the value we get from helping each other might well outweigh the fact that we\u2019d do it worse than a robot could.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But even supposing Bostrom <em>is <\/em>right about his version of things, and we wouldn\u2019t express our love by changing diapers, we could still love each other. And together with our loved ones and friends, we\u2019d have great wonders to enjoy. Wharton has Newland Archer wonder at five-day transatlantic ships. But what about five day journeys to Mars? These days, it\u2019s a big deal if you see the view from Everest with your own eyes. But Olympus Mons on Mars is more than twice as tall.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And it\u2019s not just geographical tourism that could have a far expanded range. There\u2019d be new journeys of the spirit as well. No humans would be among the great writers or sculptors of the day, but the fabulous works of art a superintelligence could make could help to fill our lives. Really, for almost any aesthetic value you now enjoy\u2014sentimental or austere, minute or magnificent, meaningful or jocular\u2014the bots would do it much better than we have ever done.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Humans could still have meaningful projects, too. In 1976, about a decade before any of Altman, Amodei or even I were born, the Canadian philosopher Bernhard Suits argued that \u201cvoluntary attempts to overcome unnecessary obstacles\u201d could give people a sense of purpose in a post-instrumental world. Suits calls these \u201cgames\u201d, but the name is misleading; I prefer \u201cartificial projects\u201d. The projects include things we would call games like chess, checkers and bridge, but also things we wouldn\u2019t think of as games at all, like Amundsen\u2019s and Scott\u2019s exploits to the Pole. Whatever we call them, Suits\u2014who\u2019s followed here explicitly by Danaher, the antiwork utopian and, implicitly, by Altman and Amodei\u2014is surely right: even as things are now, we get a lot of value from projects we choose, whether or not they meet a need. We learn to play a piece on the piano, train to run a marathon, or even fly to Antartica to <a href=\"https:\/\/antarctic-logistics.com\/trip\/ski-last-degree\/\">\u201cski the last degree\u201d<\/a> to the Pole. Why couldn\u2019t projects like these become the backbone of purpose in our lives?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And we could have one <em>real <\/em>purpose, beyond the artificial ones, as well. There is at least one job that no machine can take away: the work of self-fashioning, the task of becoming and being ourselves. There\u2019s an aesthetic accomplishment in creating your character, an artistry of choice and chance in making yourself who you are. This personal style includes not just wardrobe or tattoos, not just your choice of silverware or car, but your whole way of being, your brand of patience, modesty, humor, rage, hobbies and tastes. Creating this work of art could give some of us something more to live for.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\">Would a world like that leave any space for human intellectual achievement, the stuff of my childhood dreams? The Buddhist Pali Canon says that <a href=\"https:\/\/www.buddhanet.net\/e-learning\/buddhism\/dp20\/\">\u201cAll conditioned things are impermanent\u2014when<\/a> <a href=\"https:\/\/www.buddhanet.net\/e-learning\/buddhism\/dp20\/\">one sees this with wisdom, one turns away from suffering.\u201d<\/a> Apparently, in this text, the intellectual achievement of understanding gives us a path out of suffering. To arrive at this goal, you don\u2019t have to be the first to plant your flag on what you\u2019ve understood; you just have to get there.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A secular version of this idea might hold, more simply, that some knowledge or understanding is good in itself. Maybe understanding the mechanics of penicillin matters mainly because of what it enabled Fleming and others to do. But understanding truths about the nature of our existence, or even mathematics, could be different. That sort of understanding plausibly is good in its own right, even if someone or something has gotten there first.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/youtu.be\/vYCT7cw0ycw?t=2880\">Venkatesh the Fields Medalist seems to suggest something like<\/a> <a href=\"https:\/\/youtu.be\/vYCT7cw0ycw?t=2880\">this for the future of math<\/a>. Perhaps we\u2019ll change our understanding of the discipline, so that it\u2019s not about getting the answers, but instead about human understanding, the artistry of it perhaps, or the miracle of the special kind of certainty that proof provides.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Philosophy, my subject, might seem an even more promising place for this idea. For some, philosophy is a \u201cway of life\u201d. The aim isn\u2019t necessarily an answer, but constant self-examination for its own sake. If that\u2019s the point, then in the new world of lying flat, there could be a lot of philosophy to do.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I don\u2019t myself accept this way of seeing things. For me, philosophy aims at the truth as much as physics does. But I of course agree that there are some truths that it\u2019s good for us to understand, whether or not we get there first. And there could be other parts of philosophy that survive for us, as well. We need to weigh the arguments for ourselves, and make up our own minds, even if the work of finding new arguments comes to belong to a machine.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I\u2019m willing to believe, and even hope that future people will pursue knowledge and understanding in this way. But I don\u2019t find, here, much consolation for my personal grief. I was trained to <em>produce <\/em>knowledge, not merely to acquire it. In the hours when I\u2019m not teaching or preparing to teach, my job is to <em>discover <\/em>the truth. The values I imbibed\u2014and I told you I was an obedient kid\u2014held that the prize goes for priority.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thinking of this world where all we learn is what the bots have discovered first, I feel sympathy with Lee Sedol, the champion Go player who retired after his defeat by Google\u2019s AlphaZero in 2016. For him, losing to AI <a href=\"https:\/\/www.nytimes.com\/2024\/07\/10\/world\/asia\/lee-saedol-go-ai.html\">\u201cin a sense, meant my entire world was collapsing\u201d<\/a>. \u201cEven if I become the number one, there is an entity that cannot be defeated.\u201d Right or wrong, I would feel the same about my work, in a world with an automated philosophical champ.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But Sedol and I are likely just out of date models, with values that a future culture will rightly revise. It\u2019s been more than twenty years since Garry Kasparov lost to IBM\u2019s Deep Blue, but chess has never been more popular. And this doesn\u2019t seem some new-fangled twist of the internet age. I know of no human who quit the high-jump after the invention of mechanical flight. The Greeks sprinted in their Olympics, though they had, long before, domesticated the horse. Maybe we too will come to value the sport of understanding with our own brains.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Frankenstein<\/em>, Mary Shelley\u2019s 1818 classic of the creations-kill-creator genre, begins with an expedition to the North Pole. Robert Walton hopes to put himself in the annals of science and claim the Pole for England, when he comes upon Victor Frankenstein, floating in the Arctic Sea. It\u2019s only once Frankenstein warms up, that we get into the story everyone knows. Victor hopes he can persuade Walton to turn around, by describing how his own quest for knowledge and glory went south.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Frankenstein <\/em>doesn\u2019t offer Walton an alternative way of life, a guide for living without grand goals. And I doubt Walton would have been any more personally consoled by the glories of a post-instrumental future than I am. I ended up a philosopher, but I was raised by parents who, maybe like yours, hoped for doctors or lawyers. They saw our purpose in answering real needs, in, as they\u2019d say, contributing to society. Lives devoted to families and friends, fantastic art and games could fill a wondrous future, a world far better than it has ever been. But those aren\u2019t lives that Walton or I, or our parents for that matter, would know how to be proud of. It\u2019s just not the way we were brought up.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For the moment, of course, we\u2019re not exactly short on things to do. The world is full of grisly suffering, sickness, starvation, violence, and need. <em>Frankenstein <\/em>is often remembered with the moral that thirst for knowledge brings ruination, that scientific curiosity killed the cat. But Victor Frankenstein makes a lot of mistakes other than making his monster. His revulsion at his creation persistently prevents him, almost inexplicably, from feeling the love or just plain empathy that any father should. On top of all we have to do to help each other, we have a lot of work to do, in engineering as much as empathy, if we hope to avoid Frankenstein\u2019s fate.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But even with these tasks before us, my fits of dread are here to stay. I know that the post-instrumental world could be a much better place. But its coming means the death of my culture, the end of my way of life. My fear and grief about this loss won\u2019t disappear because of some choice consolatory words. But I know how to relish the twilight too. I feel lucky to live in a time where people have something to do, and the exploits around me seem more poignant, and more beautiful, in the dusk. We may be some of the last to enjoy this brief spell, before all exploration, all discovery, is done by fully automated sleds.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Scott Aaronson&#8217;s Brief Foreword: Harvey Lederman is a distinguished analytic philosopher who moved from Princeton to UT Austin a few years ago. Since his arrival, he&#8217;s become one of my best friends among the UT professoriate. He&#8217;s my favorite kind of philosopher, the kind who sees scientists as partners in discovering the truth, and also [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"advanced_seo_description":"","jetpack_seo_html_title":"","jetpack_seo_noindex":false,"jetpack_seo_schema_type":"","_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"{title}\n\n{excerpt}\n\n{url}","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"_wpas_customize_per_network":false,"jetpack_post_was_ever_published":false},"categories":[12,8],"tags":[],"class_list":["post-9030","post","type-post","status-publish","format-standard","hentry","category-metaphysical-spouting","category-the-fate-of-humanity"],"jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/posts\/9030","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=9030"}],"version-history":[{"count":2,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/posts\/9030\/revisions"}],"predecessor-version":[{"id":9040,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=\/wp\/v2\/posts\/9030\/revisions\/9040"}],"wp:attachment":[{"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=9030"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=9030"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scottaaronson.blog\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=9030"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}