Discussion about this post

User's avatar
Karen Thies's avatar

Thank you. I’m now thinking about AI writing in a whole new way: it’s just a fancy sentence organizer and grammar checker. The ideas, thought and decision making behind it are yours or mine — just as they have always been when, eg, a ghostwriter compiled and organized John Kennedy’s ideas in Profiles in Courage, or Malcolm X’s Autobiography.

stopthe's avatar

There is one serious contradiction here. You rightly claim that LLMs are the product of massive amounts of stolen data. And that massive data reflects the recorded thoughts of an unknown large percent of human history.The LLM is completely dependent on that data. Without it,it does not exist. That must mean that the frontier labs existence relies on the greatest intellectual heist in history. A theft of astronomical proportions.

In the world of crime a theft transmits in part to the receiver of what has been stolen. The most culpable is the person who knowingly receives the stolen property. This would mean that, if not in a literal sense)that all the users of LLMs are committing a crime downstream from the unprecedented crime committed by frontier labs. Of course when a crime is so widely and easily committed we tend to absolve everyone.

However, there are other troubling things about your analysis. Using LLMs is not the same as using ghost writer in the normative sense. First a ghost writer agrees to be anonymous and gets paid for it. Second it is almost always detected if not immediately then posthumously. There were always doubts about PT #109. And speechwriting is a particular job that is compensated and the public is aware that it is part of the entire political machine. The speechwriters are usually known and the collaboration is expected.

The use of the Autobiography Malcolm X is a strange choice. Alex Haley’s writing was known to be integral to the success of that book. Furthermore their relation was printed cover of the book-as told to Haley by Malcom X. So the book was not an example of ghost writing but more a way of reporting that became popular in the period: In Cold Blood by Truman Capote fit the the type. Today we recognize the film versions as documentaries or docudramas. All have clear authors and use various points of view.

I fervently oppose LLM detectors as well as LLM watermarks and do so especially due to the consequences of their imperfections- as you point out.

It is the process of shaping LLMs as well as imperfections or mistakes produced by LLMs that I also think are worth considering. If indiscriminate writers use them to help them write in domains they in which they are not already accomplished, they risk of transmitting false information goes up .The argument against this is that it happens anyway, without LLMs. Sloppy, ambitious people are to blame not the tool. However, it is precisely the time saving, the ease that opens the door to an increase in transmissions that are false. LLMs provide instant access to knowledge that a writer is has need of but is not familiar with.This is especially true in polemical writing.

It is true that improved arrangements of written knowledge have tended to increase accessibility.

The invention of the printed book was one of the most important dispersal technologies. The spread of libraries of increasing size greatly extending access.

Eventually came the internet and accessibility seemed miraculous. Of course you could copy and paste documents and word processing eased the job of moving sections of your writing and corrected the spelling and eventually suggested words. All of these technological developments did not significantly change our views of authorship. It was easy to surf new domains however it still required some reading to make sense of this unfamiliar information. It was encyclopedic at whole new speed.

The trend in knowledge transmission follows most other technological development. It satisfies desires, increases production and efficiency. Ai as tool does all of them. It does seem true that increased dispersion of the written word has increased our understanding of our world. It created new domains of practice, increased inventions and so on.

Of course we are increasingly aware of the trade offs, despoiling the environment, use of massively destructive weapons and global climate change. Some see that the use of AI will empower the feedback loop between the downside effects and perceived positive developments.

Since what underlies all of this development at increasing speed is capitalism . Without the accumulation of capital in the corporations, it would be unlikely to unfold in this way. And it seems now incontestable that vast amounts of capital accumulated in the hands of private elites degrades our democratic institutions.

This brings us to some more existential questions.

What are we willing to trade for AI?

Further degradation of our environment!

A narrowing of access as well as decreasing the power of our constitutional legitimized enfranchisement ?

The increase of AI weaponry?

The increase of internal AI surveillance?

The unknowable prospect of AI produced superhuman intelligence?

It is true that some these threats were on the horizon and almost no one,even the most critical,could resist use of the internet. That buy in produced the most powerful corporations in history.

LLM use we can only rationally conclude, feeds the entire system -not just more data-but the buy in financially feeds their corrupt exclusive forms of development and marketing and in turn accelerates the side effects listed above.

9 more comments...

No posts

Ready for more?