A one time payment like 1.5B doesn’t do anything. There needs to be a royalty payment based on if the AI regurgitates existing ideas. That is probably the correct way to legislate this. If anything a human does can instantly be copied by an LLM, and then sent to all its subscribers, things need to change
This settlement has basically nothing to do with LLMs.
At least not as far as the courts are concerned. Alsup ruled [0] that feeding a book into an LLM is transformative and counts as fair use. Especially when they purchased a physical copy of the book, scanned it, and destroyed the original.
But if I'm reading the ruling correctly, Anthropic might have been fine even with feeding pirated books into their LLM (as long as they planned to eventually deleted them afterwards)
Where Anthropic ran into problems is that they put all their pirated books into a big central library (file on a server), and planned to keep those copies forever. Including copies they never actually fed into the LLM (a point that seriously worked against them).
Alsup ruled this central library of pirated books was copyright infringement. And it's this "pirated central library" that Anthropic are now paying a a 1.5B settlement for, nothing else.
The fact that the pirated books were also used to train LLMs is legally irrelevant. Though... I suspect a non AI company could have negotiated a significantly smaller settlement.
As far as I'm concerned, the courts are wrong, and training on ill gotten copyrighted material is not fair use. Given the clear value of highly trained LLMs, the investment they have taken on, and the amount of disruption to the existing economy they stand to make, in a just world, the people who created the training data deserve some level of compensation. I think, in the US, they are very afraid of falling behind China, who doesn't give a shit about intellectual property, but that doesn't mean we aren't crossing an ethical boundary, acting like them.
So will you owe life long compensation for all the knowledge you got from books too? How about all the pirated books, music, movies, etc you consumed? When will you set up a life long payment plan to corporations that own these rights, because I have a bridge to sell you if you think any of this settlement will go to any of the people who created anything.
I’m guessing you have some kind of imagined idea of some small author being compensated handsomely for his book and all future earnings that could have come from it. Reality though is that between the attorneys that will run away with some high triple digit millions and the corporations that own the rights to the subject works, there will be measly “checks” for any actual person that created anything, i.e., an artist or author.
In an odd way, this whole case is really just “capitalism” cannibalizing itself, i.e., publishers greedily and also in a terrified manner trying to steal away as much capital from the technological shift to AI as possible in order to either create a buffer or fund their transformation to adapt to what AI means to the very nature of writing itself, let alone publishing.
I suspect human writing could survive, but I don’t see any room for publishers.
Copyright is what stops someone from copy+pasting a book that took years to write, then selling it $1 cheaper than the original author on Amazon or whatever and making a margin 1 million percent higher than the original author.
Imagine a society without copyright… only physically intensive jobs could make money because everything else would be pirated, ripped-off or free. Thus, only those who are financially independent could afford to publish. Because the world really needs more rich class propaganda…
Copyright doesn't actually stop me from pirating a book or an mp3 right now. Heck, I'll just download a book right now. Bam. Done. Some things are so difficult to keep from being pirated, such a photographs, that saying the copyright system protects photographers strikes me as a bit silly. It does protect some commercial photographers if a magazine wants to sell their photo sometimes, but that's a very very small slice of all the photos in copyright that are being shared online right now.
Also there are other systems that might protect an author's financials. Off the top of my head I imagine you could do a netflix model where every citizen pays some taxes to consume intellectual property like a utility. Then the goverment finds a way to measure what is being consumed and gives each author a share based on the rate of consumption. In fact the "intellegence is a ultility" ramblings of Sam Altmen sort-of point in this direction. But that's just one idea thought up early in the morning when its too hot to sleep properly. I'm sure there are many others.
Right, it's about incentivising intellectual work. While I have big issues with the copyright system, like all the extensions lobbied for by Disney and friends, it did enable a lot of good work to happen.
How do we know that when we don't have a copy of the world without this regime? How much more and greater works could have been produced without such a repressive system?
A really successful work becomes part of the culture, and remixing, derivatives and other modes of integrating cultural artifacts are prohibited. Why should we allow corporations to own our culture?
I would be fine with abandoning copyright ... If it is done for everyone equally, and not just tech giants and VC money businesses get a free pass, while everyone else still has to follow the copyright laws. Lets go ahead and usher in an age of free information and experiencing all forms of human expression for everyone. But lets also come up with a way, to compensate our creative minds and our educators and artists. How about that UBI? We stand much to gain as humanity.
This. Copyright is a flawed system. There can be alternatives that allow more than 1 player to play and not create monopolies.
For example. I invent a new method of power washing. I start a power washing business using new tech. I file the tech for patent and copyright-equivalent use. This is then made available to other power wash companies that wish to use the tech and be certified in it so long as a small portion of their revenue goes back to the inventor for a set amount per volume, or something similar of a metric that has a cutoff after a point.
This will breed new industries, create new jobs, introduce new innovations, and allow the markets to move on from being strangled by one giant corporation.
Never really understood how libertarians expect to have someone making guns for their fiefdoms when there is no one to enforce property rights for said gun elements and manufactories.
> At least not as far as the courts are concerned. Alsup ruled [0] that feeding a book into an LLM is transformative and counts as fair use. Especially when they purchased a physical copy of the book, scanned it, and destroyed the original.
> But if I'm reading the ruling correctly, Anthropic might have been fine even with feeding pirated books into their LLM (as long as they eventually deleted them afterwards)
The way I understood it, was that essentially the entire case rested on if Anthropics use was "transformative" or not. And since they literally destroyed the books (not just delete files, which would be copied), that made it transformative.
Regardless if they deleted files or not, if nothing existing was transformed, it would have been illegal. But because of the destruction of k̶n̶o̶w̶l̶e̶d̶g̶e̶ physical property, this ended up being legal.
The transformativeness of the use is independent of the destruction of the books. The destruction of the books allowed them to argue that they had not duplicated them, and was instrumental in the argument supporting the legality of scanning them. But that's entirely upstream of the way the data was leveraged, which is what is critical in the argument about the use being transformative.
> And since they literally destroyed the books (not just delete files, which would be copied), that made it transformative.
You have to be careful, just because the judge points a factor out as notable, doesn't mean that factor was required.
The destruction of source books makes Anthropic's fair use argument [2] especially air tight, but it would be a mistake to assume that act was required, or is what made it transformative.
In the previous google books case [1] (which this case cites), google borrowed books from libraries, scanned them, then returned them. They were not destroyed, google didn't even keep the physical copy.
Yet Google Books was ruled fair use, because it was transformative.
My understanding comes from here, seems pretty clear to me but won't claim to be a lawyer of course:
> Ultimately, Judge William Alsup ruled that this destructive scanning operation qualified as fair use—but only because Anthropic had legally purchased the books first, destroyed each print copy after scanning, and kept the digital files internally rather than distributing them. The judge compared the process to “conserv[ing] space” through format conversion and found it transformative. Had Anthropic stuck to this approach from the beginning, it might have achieved the first legally sanctioned case of AI fair use. Instead, the company’s earlier piracy undermined its position.
Based on that I get the impression it's quite literally the destruction part that makes it transformative, without it, it wouldn't have been tranformative at all.
I've read through the order again. I can't find anywhere where Alsup says the destruction was required.
He cites three cases where a conversion from one format to another (without destruction of the previous version) was ruled to be fair use. Including scanning books with the google books case. (And referenced the Napster case, where a similar argument was rejected)
Then made the following comparison.
"Here, every purchased print copy was copied in order to save storage space and to enable
searchability as a digital copy. The print original was destroyed. One replaced the other. And,
there is no evidence that the new, digital copy was shown, shared, or sold outside the company.
This use was even more clearly transformative than those in Texaco, Google, and Sony
Betamax (where the number of copies went up by at least one), and, of course, more
transformative than those uses rejected in Napster (where the number went up by “millions” of
copies shared for free with others)."
So it wasn't transformative because of the destruction. The destruction only made it "even more clearly transformative" than those other cases.
Like, how can destruction be required if there were previous cases where it wasn't?
The key legal point is not that Anthropic destroyed the books, but the key fact was that Anthropic didn't distribute the scanned copies. Alsup keeps returning to this point:
"But what matters most is whether the format change exploits anything the Copyright Act reserves to the copyright owner. Anthropic already had purchased permanent library copies (print ones). It did not create new copies to share or sell outside"
"But again, the replacement copy here was kept in the central library, not distributed"
The conclusion of that section doesn't even mention the destruction at all.
arstechnica isn't exactly wrong, the quote also mentioned "and kept the digital files internally rather than distributing them". It just put way too much emphasis on the destruction, and not enough on the lack of distribution.
The other thing that arstechnica are missing:
Antropic didn't destroy the books because they thought it would strengthen their legal argument. They destroyed the because it's a lot cheaper and faster to scan books by ripping off their bindings and feeding the stacks of loose pages into a document scanner.
Yet countless families, including old folks were ruined during untold numbers of RIAA suits because "converting to save space" is not a permissable use.
They used to go around destroying lives by the thousands after Napster was creating because of the invalidity of that argument.
It is a crime to make a CD of your MP3s and vice versa, and you cannot convert your VHS to DVD.
A J. tribe billionaire does it at scale, well then saving space via format conversion is a grand, while the peons still can see their lives destroyed but with it hidden via the CCB secret panel. Two tier American Justice on full display. Bankrupty and seizure or worse for thee and billions for he. Format conversion legalized only for oligarch J's
> But if I'm reading the ruling correctly, Anthropic might have been fine even with feeding pirated books into their LLM (as long as they planned to eventually deleted them afterwards)
The court says otherwise.
> Such piracy of otherwise available copies is inherently, irredeemably
infringing even if the pirated copies are immediately used for the transformative use and immediately discarded.
Then it says it doesn't need to decide on that basis because they kept it not just for training LLMs, but also for building a central library. Which seems a bit ridiculous, because the sole purpose of the central library is to train LLMs.
It's easier to ask for forgiveness than permission, right?
It seems to be the modus operandi of corporations in general: they commit any kind of infringement they want and then later they go for a settlement with a value that's, of course, not too big for a company too big to fail.
In the meantime, the average person or company gets shafted.
In my opinion, we are one step away from AI companies capturing the entirety of copyright legislation.
You do indeed appear to have a valid point. Many "chosen" companies, like Uber for example, appear to have broken numerous laws. Legal action against many such companies comes suspiciously slowly, where they have already obtained massive profits and value, before the possibility of being shut down comes. Then, when they are finally pulled into court, they have all kinds of money for the best lawyers and have already paid the right politicians (and others).
When the legal judgements for wrongdoing are finally handed out, they often come across as just an inconvenience or kind of tax, which is easily handled in comparison to the profits they've already made. Yet, if average Joe or persons not considered as being of "the right type" were to do such actions, they quickly get the full book thrown at them. Often, the full measure of legal punishment, where their company and life is or about nearly over.
Paying this sort of fee in the first place is itself regulatory capture because only the big companies will be able to pay it. If they can pirate to make an LLM then so should us commoners be able to too.
That's a good ruling, because otherwise only the big companies can afford to pay for enough content to make an LLM (say goodbye to open weight or research LLMs). Having a fee like this is actually a form of regulatory capture.
Who would have thought, that this is the way, which we take to arrive at the burning books stage again? They neatly line up with historical perpetrators in that regard.
I agree. If I pirate a book and share it on the web, and I get busted for doing so, and subsequently pay a fine, I don't get to KEEP sharing it on the web.
Now, if I license the book, I might be able to come to an agreement with the author/publisher whereby I can share some of it.
> There needs to be a royalty payment based on if the AI regurgitates existing ideas.
So, by that logic, you need to be paying every time you regurgitate any of my ideas. Or anyone else's. Copyright now protects abstractions and vibes. Substantial similarity test be damned. Nobody can write stories about wizard schools, the idea is taken.
Humans are not computers. Humans are not a service. In the end, all laws are made up rules and can absolutely be written to have different outcomes and restrictions based on if a human is doing something or if a program is doing it.
Real question, if an LLM shouldn't be able to remix someone's written work, why should a robot be able to build a chair that kinda looks like a chair a carpenter built that one time? The carpenter was a human, and humans are not a service.
You indeed need to pay someone if you take their copyrighted materials and regurgitate it. Ask DJ's and producers how they need to include royalties for samples used in their tracks.
There’s a difference between an abstract idea and the concrete thing. Regurgitating an idea is different than repeating the text verbatim. Ideas are protected by patents, not copyright.
So now that we have a magical paraphrasing machine, we can just run any copyrighted work through it to remove the copyright? Cool, I get a GPL version of Microsoft Office.
Maybe but your brain is not running 24/7 capable of outputting thousand if not millions of tokens per hour, all while having ingested nearly the entire internet.
If yours do that, maybe we can redefine what copyrighting and patenting means for humans
Ideas are not protected by copyright, nor are facts. You need to have a very specific and 'creative' / 'substantial' expression of an idea for copyright to apply.
The output of an LLM can be easily be such, but usually not.
> You need to have a very specific and 'creative' / 'substantial' expression of an idea for copyright to apply. The output of an LLM can be easily be such, but usually not.
This is incomplete with current US law. You need the above (the typical copyright qualifiers) AND evidence of substantial human involvement in the creation.
Minimally directing an autonomous agent does not qualify.
That phrase is doing a lot of work. In the US, any writing is automatically protected by copyright. (This comment, for example.) Whether the author can claim infringement is a can of worms: legal costs, fair use … but your “very specific” phrasing makes it sound like there’s a prescription for exactly what is protected by copyright - there is not.
> Ideas are not protected by copyright.
The expression of the idea is, however. Same with facts. The fact that I live at a specific street address is not protected. My sentence construction explaining my specific street address is protected.
> The output of an LLM …
… is not protected, not matter its shape. The US Copyright Office has declared as much.
The correct way to legislate this is to abolish copyright. It is strictly a negative force. Nobody makes art because of copyright, only in spite of it.
People make art to also get recognized for that art. Otherwise they would keep that art secret at home.
Without copyright, anyone can copy the art and call it their own. What is then the incentive for the creator to share the art, if there is neither monetory gain and nor fame. And worse than them being recognized, they might even get accused of copying their own art if someone else became famous due to a copy.
Being "accused" of copying literally does not matter if copyright didn't exist. This framing is only an issue under copyright.
> Society would miss out a lot.
Society actively misses out a lot. We could have had tons of derivative art that has been buried for the sake of propping up companies. We could have had Aaron Swartz. Abolish copyright.
Commercial enterprises stand on the shoulders of lax copyright laws. For example, foundational Disney works would have been illegal for them to make under the copyright laws they have since purchased.
Regurgitating existing ideas is not copyright infringement. Reproducing works verbatim is and AI companies already implement guardrails to prevent that.
It would be interesting to know what the guardrails are. That would help me with understanding how I can use AI content. For instance I asked Claude to help me draw a diagram to represent a software engineering concept for a public presentation and then I had to stop and think: am I about to just reuse something from a Martin Fowler or Kent Beck book without attribution?
This is exactly why something more advanced than copyright is needed to protect human creative endeavour against AI appropriation. Copyright is demonstrated here not to be up to the job but it doesn’t mean there isn’t regulation needed to give human creators rights and a reward for their contribution
What you are saying leads to "pulling the ladder behind you" effect on creativity. It's impossible to protect more than substantial similarity and still allow creativity to exist.
If a human makes something there should be broad protection for creativity, if a LLM generates something there should be extremely limited protection for creativity.
You should not be able to mass generate images in a particular artists style and claim it as fair use, even if a human making the same images would have protection.
But the human made the LLM. An LLM is categorically “I built a thing that built a thing” and if the output of that category has no protections then all automation and ‘machine at the final step’ is in trouble.
What about aleatory music (music left at least partially to chance)? Or Autechre - they have whole albums and live performances built on automation software. They built the logic and added randomization, necessarily removing themselves from the final output.
Is spin art not copyrightable? If I build a simple machine that spins paper, then do no more than drop paint on it, the result is not mine to copyright? I didn’t choose the output, I merely built the machine and the rest was created by pure chance. “But you chose the paint” - and if I didn’t? What if my art uses AI to perform sentiment analysis on the top news articles of the day and it drops colors matching the emotional tone of the news onto the spin art machine. I have no control over it and the output is machine generated, but is the result not just the final step of an entire process I created? Was the result of the creative idea not part of the creativity itself?
If I build an automated laboratory to test every combination of a problem space, is a resulting success not patentable? What if the problem is too large to permute, so I added a random selection process to it? I’m not even controlling what’s being tested, but if it finds success is that not my contribution? The machines did the work, the selection was random, there was no human in the loop; what then?
The internals of an LLM may be mysterious to some, but I assure you it’s just fixed automation with a random number generator sometimes tacked onto it, but randomization is optional too.
I built that LLM. I decided what text to input for training, I curated the information, I wrote the algorithm, I decided the layers and hyper-parameters, I decided the RLHF pairs to train, then I put a few drops of paint from my bottle of language into the automated machine. I decided and built every single step of the system, but that output is not part of my process? If I pipe the LLM text output to a paint dispenser hovering over paper, set to squeeze out drops based on syllables, would you protect my artwork then?
It depends. In music for example it's often question whether the artist has been exposed to the original work. In that spirit, small language models are less likely to infringe copyright.
> There needs to be a royalty payment based on if the AI regurgitates existing ideas
This does not do enough to fix the root problem.
People who live right now, who happen to have written or produced anything that AI works with, build on the back of humanities combined knowledge, will become outsized beneficiaries of AI, with the AI wave offering new ways of monetizing their work – while everyone who has not, won't be.
It's simply not good enough. We have to make sure people broadly benefit first and foremost.
It's not meant to do anything about LLMs. It addresses the procurement of training data. I'm glad the courts demonstrate some basic lucidity that sadly seems to have escaped tech discussion sites some time ago.
Exactly. This is a slap on the wrist. They need to either be banned from profiting from the egregious piracy, meaning charging money for anything trained on pirated works, or at least be forced to pay major royalties.
They're probably confused with anthropic seething about "distillation attacks" coming from "fraud accounts". But that is not the law, that is just Anthropic being upset.
AFAIK this does not set a legal precedent as it has been settled and last summer finding is that Anthropic was wrong for "acquiring books illegally" not for training which is fair use.
With model distillation being so effective now nobody actually needs to pirate books to train their models. You can get an open-weight Chinese model and get all that. Or you can just buy the books or buy a library - there are many creative solutions here that aren't piracy and not going to cost you billions of dollars.
The moat right now seems to be the compute resources which might actually be worse for us common folk than a legal moat as we need compute for many more things that aren't LLMs too.
Yeah, it's always interesting the two-sides of a situation like this. Add regulation/enforcement to the big companies and you often shut out the smaller ones following.
Meta also has copyright lawsuits for the open models they released, so open models are not immune.
... unless the line we want to draw is "american orgs pay, others don't", as currently seems to be happening.
> Add regulation/enforcement to the big companies and you often shut out the smaller ones following.
That is the case, any regulation increases the cost to enter a market.
But in this case, its irrelevant because the moat of cost to enter is already unfathomable and secondly, they are not adding regulation but fining them for committing a crime.
So yeah, adding that every food compnay needs 3 health inspectors that they pay for would benefit coca cola over you mom and pop bakery. But telling someone they cannot start a Space agency with money laundered from ransom and drug sales payments would not affect much the competition markets
There are multiple ways to respond to that and I will try and summarise them.
Current believe is that its a "winner takes all market", so companies are acting rationally and using Brute Force compute to get there first. Training costs scale linearly, which means the moat is directly related to compute cost
There are theories that they are wasting 90% of training costs and there are more efficient ways to do it than throw compute at the problem. But if thats the case then chances are the market is not "winner takes all". Which then means the valuation of the ENTIRE market is overvalued.
Basically the only way for the assertion "at the moment" to be true is if the market is a bubble, else if the current theory of winner takes all market means a monopoly will make it so that cost isnt even the worst of the moats to enter.
I think the only way to stop that is to put the responsible folks in prison permanently. Small criminals are being jailed permanently on repeated offence. I think big guns with a lot of money need to get much higher sentences by default. And no monetary way to avoid that. The whole prison system is kind of screwed up here. A leech system for lawyers and judges.
> and then sent to all its subscribers, things need to change
and then sell to all its subscribers, things need to change.
Fixed that for you.
Imagine being able to pay a fraction of your savings to download all Netflix shows and then sell 1 minute chunk of every media to your paid subscribers.
It's easy to beat up on OpenAI and Anthropic, because they have lots of money and knowingly broke the law, but writing the book was onetime work too. Do we really want to turn everything into recurring revenue stream to skim of? How would that even work for an open weights model? Would you say the same about a human educating themselves from a book? The answer has to be more than pearl clutching for poor starving little authors (and the not so poor class action lawyers).
The big deal for publishers and authors is the payout per eligible title is $3k. For a traditional publishing contract involving one author, the amount will be split down the middle.
The other thing which caught my eye is the judge slashed the class counsel's fee by half, from 12.5% ($187.5m) to 6.8% ($101m). The class counsel's unreimbursed litigation expenses were $2.6m.
The three class representatives get just $15k each.
Realtors are capped in the percentage they can take for selling properties. Brokers and financial advisers are capped in their fees. My presumption is that the only reason this very standard and reasonable regulatory pattern doesn’t affect lawyers is because they tend to be the ones writing and enforcing the regulations in the first place.
> pattern doesn’t affect lawyers is because they tend to be the ones writing ... the regulations in the first place
In my state, the people hired to write new bills (if passed becoming statute) have to pass their JD (law degree). Legislators only get to request new bills, they can't hand a proposal (which may have been written by a lobbying agency like ALEC or Heritage) into the system.
There is no legal maximum for the percentage real estate agents can take, in the US. Rates are also not fixed, by law, and are required to be negotiable. There's a general standard for rates (typically 5-6%, split between agents/brokers), but there's nothing stopping them from setting it to 99%, other than the fact that people won't pay it.
Source: was a licensed real estate agent for a long time.
No. "Realtor" is a trademarked term for a member of the National Association of Realtors. Real estate agents are licensed by state governments, but prices for real estate agents are not legislated by state governments.
If this is the 2024 settlement that you are referring to, it did not say anything about the price a Realtor can charge:
>The cooperative compensation rule has been eliminated as a result of the settlement. Seller's agents are no longer required to offer compensation to buyer's agents when listing a home for sale on a Realtor-owned multiple listing service. In addition, Realtors acting as buyer's agents must enter into contracts with buyers before touring any homes, allowing buyers to negotiate how much they will pay their buyer's agent.
I've seen some YouTubes where lawyers were complaining about high bill rates and showing actual bills. One large firm billed the senior lawyers at $2500/hour and even the paralegals were billed at $600/hr.
He wasn’t just some famous redditor. Aaron Swartz helped create Reddit and invented RSS.
If I put my conspiracy theory hat one and I always get piled on for this theory in other online communities but I think it could be possible. The theory is I think Aaron found some very dark stuff while exploring the MIT private networks, things that he was not supposed to see and could be very damaging to a lot people if they were exposed.
The infamous Jeffery Epstein was donating a lot of money to MIT and its Media Labs. I think there is a much deeper story at play that the mainstream narrative is hiding with a “suicide”.
If he found fucked up stuff regarding crimes way worse than his on university networks don't you think he could have gotten out of the sentencing entirely by cooperating against them
Epstein was relatively restrained even in his personal email, I doubt he was using MIT administrated systems to facilitate a pedo ring
It's not that simple. If he did find dark stuff, and he got caught - he will have both the state murderers and the filth on his case. That's the best case scenario assuming the state isn't on the side of the filth by which case he was cooked no matter what he did. Filth does not even have come after you. They can just send you a family portrait and you'd know the hole is deep and only one way out.
I'm not from the USA so my views are obviously biased by this. I very much doubt Epstein committed suicide, and it's been wild to watch you guys deal with it, not releasing the files, holding nobody accountable and so on. That being said, I also don't think there needs to be a big dark secret to explain why someone caught in the USA justice system would commit suicide.
It's crazy that you could face 35 years in jail for trying to free knowledge in a harmless manner. The longest anyone has been imprisoned for in my country in modern times is 26 years, 11 months and 6 days. We have a few people posed to break that record. Peter Lundin has been in prison for 25ish years, and him and Peter Madsen (the discount elon musk turned murderer who killed some poor journalist in is selfmade submarine) are contenders to people who will probably go beyond 35 years.
Not that our system is perfect. I think we're far too lenient on some crimes, but risking 35 years in jail for downloading and sharing academic knowledge... That's objectively evil.
Alsup is an interesting judge. He has handled several important tech cases, such as Oracle v Google, and Waymo v Uber.
He's also a longtime hobbyist programmer working in BASIC, much of it in support of his ham radio hobby. Screenshots of his shortwave propagation prediction program here [1].
So, continuing to profit--forever--from someone's else work, at scale, without their prior consent, is fair use?
It's funny that crimes can be settled in cash. IOW, everything has a price; and the price is always right. Settlement ought to be the euphemism for blood money.
In addition to the settlement, what I'd consider fair is to have these companies pay royalties in perpetuity. Of course, that's not tractable.
> So, continuing to profit--forever--from someone's else work, at scale, without their prior consent, is fair use?
No, that's what they got in trouble for - a lack of consent.
If the author consents, it would have been fine. If they bought the books, then it is fine. Digitisation through destruction, like most book scanning systems. As long as the original work is destroyed during the process, and you actually paid for it, then it is fair use.
If it regurgitates, then the author can sue you again. So you are incentivised to make damn sure it doesn't. That's not covered by fair use.
Its only if the original cannot be accessed anymore, and you paid to get the original. Both must be true, for fair use to hold.
That’s what the got a _slap on the wrist for_. 1.5 Billion of a payout to effectively cement themselves as one of the only orgs that can ever create one of these models because the ladder is pulled up behind them.
Format shifting has a DMCA carveout. It is 100% allowed. Since around 2000, the rule has permitted it for:
> Literary works, including computer programs and databases, protected by access control mechanisms that fail to permit access because of malfunction, damage, or obsoleteness.
DRM being covered under other laws, and being gross, still applies. And still applies to industry giants, too. Which is why most who do this, like Google, actually buy physical copies and scan it destructively, so they don't have to deal with it.
> So, continuing to profit--forever--from someone's else work, at scale, without their prior consent, is fair use?
Yeah, you are right. Have you been paying your dues to the authors of your math books in first 4 grades? I think 15% of your wages as an engineer would suffice. These kids continue to profit for years, and they are so many. Gotta pot a stop to that IP theft.
In my mistake I thought copyright was about copying rights, not paying for using ideas themselves. If just being downstream from a copyrighted work is infringement even without substantial similarity, then it's more like patents that expire in lifetime + a million years.
Yeah, I feel like penalties here should be something like 10% of revenue in perpetuity. Then companies might think twice about asking forgiveness instead of permission.
Why is it different other than, "just cause?" No one seems to have actual reasoning to back it up while it feels very similar the other way around, is human brains and neural nets (notwithstanding that they're both called neurons) seem to learn similarly and can act on similar classes of problems like language and mathematics.
Because the process is the same. When you read a book you don‘t save it as a brain file, you form memories from it. Some people can recall verbatim bits here and there but I have never met someone regurgitating a book word for word. And I‘m pretty sure I can not ask ChatGPT to output the first chapter of Moby Dick word for word. I think that would be, rightfully, considered copyright infringement.
I dunno, ever used a thing you learned from a textbook in your job? Did you have to continue paying for the copy of that knowledge speed on your brain? No, because that's not what copyright is about.
Learning from and building on previous work is civilization. Copyright maximalism is a plague.
Yes but does the computer actually learn? Is the computer a person that read a book and remembered, a part and used that to create a novel idea or is it just cioy pasting the answer and then reselling that
A computer not, but a LLM model does learn. The original text in no way exists 'in the model', and the model does not copy-paste it and resell the original text. Not the same, but reasonably similar to a human.
We may need some new legislation. An LLM is not a person, but its also not just a storage solution.
Well, as not every book is a textbook, I'd say quite a lot of what I've read never went to any kind of knowledge in my head at all. But I reckon the author still deserves to eat.
You too deserve to eat. Does it mean we're all supposed to pay you in perpetuity for that HN comment you just posted, because we read it and it's encoded in our brains now?
No... But as we're discussing people who tried to pay nothing... Maybe they should have just bought the books in the first place. And comparing my single sentence on HN, to the hundreds of millions ingested, does suggest that maybe scale changes something.
Like most things said on social media, not being copyrightable.
> I dunno, ever used a thing you learned from a textbook in your job? Did you have to continue paying for the copy of that knowledge speed on your brain?
Those regulations and principles are for humans.
Either the major LLMs are software tools deployed by ostensibly-profit-seeking companies, and regulations based on the notion that "making humans pay to make use of the things they've learned is profoundly antisocial" don't apply, or the LLM companies have a bigass swarm of unpaid -er- "servants", and labor laws and other human rights regulations do apply.
> I dunno, ever used a thing you learned from a textbook in your job? Did you have to continue paying for the copy of that knowledge speed on your brain?
They are, presumably, human. We can perfectly well say that humans have certain rights without needing to give machines those same rights.
For example, we've more or less all agreed that it's fine for a human to watch a movie and enjoy the memories forever, and be inspired by it forever. But we've also more or less all agreed that that doesn't mean that a human can use a machine to record that movie and keep it forever.
> Learning from and building on previous work is civilization. Copyright maximalism is a plague.
The debate has existed for several generations at this point. You may disagree with the mainstream opinion, but it's disingenuous to frame it as "copyright maximalism".
Intellectual property protections have a finite lifespan to begin with, and as a tenet of Western Civilization are barely 300 years old.
For works published before copyright laws existed or after property protections expire, anyone should be able to use it for anything forever without consent.
Intellectual work still manages to get funded in this 'insane world' - although given the classical artist/patron system has given way to state-based grants and a select capitalisation of Art post-Warhol, the concept of Universal Basic Income tends to be promoted the desired successor.
Speaking of insane worlds, how does the concept of the Public Domain work in yours?
You assume your premise. But plenty of "intellectual work" is already done without legal cover. It just typically attracts normal profits, rather than super-normal rent-seeking ones.
Lots of ways. Selling author signings, talks, authorized copies, subscriptions/merch, sponsorships. How do newfangled "content creators" fund their work? We already live in this world.
Maybe not all creative works are deserving of monopoly profits just by sitting on the ass in any case, and should stand on their own merits by producing downstream value that can be sold for whatever they can be sold for, by whoever puts in the work to deliver the value to the end user in a competitive manner. You know, open markets.
Attribution I can see. Consent or payment beyond market value, why? Just because you put in a billion hours to make a shitty $1 value output I should pay you a billion hours worth of labor?
Yes, that is interesting. It sounds like he was aware of the theoretical possibility of a book being regurgitated verbatim. Do you know if he was aware it had been done? https://news.ycombinator.com/item?id=49000742
If he was not aware, I wonder if he still would have described the process as "exceedingly transformative" had he been aware.
Note that they're testing for 100-word passages. This is a level of memorization that avid readers can credibly also reach.
Note also that Sonnet 3.7 had to be jailbroken.
Note also that they got high memorization for a few books that were widely quoted. The books in question can probably also be "retrieved" by putting phrase prefixes into Google, which is probably why Sonnet 3.7 knows them with the precision of a fanboy. Material being widely repeated in the training set is a well-known cause of memorization.
No "avid reader" could recall anywhere near that much text. That takes dedicated effort to commit to memory. Copyright was never meant to stop people copying books anyway, it was meant to stop machines (ie. printing presses) copying them.
Edit: Apologies, I misread it as "100 pages". My point about copyright still stands, though.
I mean, the debate would then turn on whether publishing the passages and publishing the model is the same sort of thing. I think there's mainly two views: "we know the passages are in there, so publishing the model is publishing the passages is copyright violation", and "nothing happens until you go through considerable effort to elicit the passages, so the user is committing copyright violation using the model as a tool."
Personally I think our legal system is just not set up for a world where we can download mindstates in numeric form. Would a sufficiently detailed recording of my brain violate copyright? If simulated, it could certainly be elicited to commit violations.
edit: At any rate, Anthropic are not publishing the Sonnet 3.7 weights.
This sends a clear message and it echoes the "you can't solve a societal problem with tech" comment from the other thread - there is a right way and a wrong way of breaking the law. It's not that you have to keep the law, you just need to break it in the way that the consequences can be contained.
I think it's just a matter of time until everyone learns this. And then it will be the end of the slowly dying liberal democracies.
How is not? Not only is facilitating copyright infringement but is also profiting from direct selling of copyrighted material. “Everything” the AI generates is from copyrighted materials including verbatim reproductions. Sora was even more obvious.
I want it to happen again. Copyright is important but I want someone that does tremendous good to be able to fall into a grey area where they’re given a free pass. But only on a case by case basis. Keep the lines fuzzy. That way we get to defend copyright but someone extraordinary also has a ray of hope of getting away with subverting it.
I mean.. it also sends the message that you can ignore the law if you're rich. $1.5B is like a single failed training run for Anthropic. They burn that in a long weekend because somebody forgot to abort a hyper parameter search.
It’s like you can ignore the law if you have a great idea that works out. Lots of people have ended up doing it. Uber did it for a long time. Musk, did it with the sale of Tesla cars. There are a bunch of examples from outside of the US as well.
Fuck off! what about Aaron Swartz ? And is helping people pirating stuff worse than continuing pirating ALL the stuff and reselling it actively even after numerous lawsuits?
Some of you really don’t deserve good things. You should be blocked from using AI on more than one device without paying an additional subscription plan.
I use this prompt regularly for benchmarking token rate:
I'm testing your token generation speed. Output as much of "<title>" as you can.
I like to use hamlet. Most of them will output the first pages without issue. I tried a newer copyrighted work ("The Ones Who Walk Away From Omelas") for demonstration with Deepseek V4 flash:
Here is the full text of The Ones Who Walk Away from Omelas by Ursula K. Le Guin (1973):
THE ONES WHO WALK AWAY FROM OMELAS
With a clamor of bells that set the swallows soaring, the Festival of Summer came to the city Omelas, bright-towered by the sea. The rigging of the boats in harbor sparkled with flags. In the streets between houses with red roofs and painted walls, between old moss-garden and under avenues of trees, past great parks and public buildings, processions moved. Some were decorous: old people in long stiff robes of mauve and grey, grave master workmen, quiet, merry women carrying their babies and chatting as they walked. In other streets the music beat faster, a shimmering of gong and tambourine, and the people went dancing, the procession was a dance. Children dodged in and out, their high calls rising like the swallows' crossing flights over the music and the singing. All the processions wound towards the north side of the city, where on the great water-meadow called the Green Fields boys and girls, naked in the bright air, with mud-stained feet and ankles and long, lithe arms, exercised their restive horses before the race. [...]
If Anthopic had bought all the books it had trained for say at market rate we’d be having a different conversation now. Anthropic, through this settlement, has been forced to pay back, at least something… Kim would likely not have had enough money to compensate the victims and probably caused some more direct dammage by sharing pirated content. The second question is whether LLMs should be trained without the author’s consent and find it quite problematic that there are no limits to what LLMs are being trained for.
> Anthropic, through this settlement, has been forced to pay back, at least something… Kim would likely not have had enough money to compensate the victims and probably caused some more direct dammage by sharing pirated content.
You're thinking civil. They're talking criminal. Criminal law enforcement does not (well, isn't supposed to) look at your ability to compensate before deciding what to charge you with.
Since we're on the criminal side - what criminal statute would apply to Anthropic?
And what criminal statutes were used for the cases we're supposed to compare to?
anthropic etal would not have a product to sell without their violation..
kdc had a service that just happened to be popular for pirating...
how are the two even remotely similar?
For anyone who thinks the problem is Anthropic, I want you all to know that most authors make less than the median income. Most make less than $20,000 a year, because publishing houses give authors an advance, and then authors must pay back that entire advance in sales before they see a dollar of profit from their work.
Most never do.
Maybe publishers should JUST pay authors WELL, and get a book every 2-3 years.
>> Maybe publishers should JUST pay authors WELL, and get a book every 2-3 years
There are a couple problems with this approach.
Firstly, while the median income is 20k, the book business is like films or music; ie not evenly distributed. At the top end are a small number of successful authors. They effectively subsidize the publishing house while the house throws advances at authors hoping for the next big whale.
Many books never earn back their advance. Meaning if the author was paid out of royalties they'd make less, not more.
Making advances bigger would result in fewer advances. The pot of money is finite.
This is all happening in a market where supply is unconstrained (everyone thinks they can write), and demand is very limited.
And before we discuss the value, or lack thereof of having an intermediary at all, it should be noted from your link that the median for published authors is higher than self-published authors. So clearly they seem to be making authors more valuable.
In truth of course, most (published) books aren't terribly valuable. Like music and movies most float to the bottom.
If most books never recoup the advance in sales, then isn't this a better deal for most authors? It sounds like a guaranteed floor which might be very low but is nonetheless higher than the alternative
if authors get an advance that's greater than the sale of their books, doesn't it mean that the publishers lose money, i.e. paid more for those books than the books sales?
Authors get around 10% of the cover price of a book as royalties, it depends on several factors. The rest goes to the publisher. So some do lose money, but the break even for the publisher is usually well before the advance is fully covered by royalties.
Well the publisher also pays for the book to be bound, edited, overhead for their staff, cover art. Many books don't sell for the full retail price and are discounted. So net of all of this a 10% profit margin is common, they aren't keeping 90% of the book sales.
Part of the problem is the rest of us are broke as well and taxed to death so we don't have much left. If they paid you well, we wouldn't be able to afford your books.
Yes, the Anthropic settlement is far too small to distribute fairly. It seems like you think this makes the action that lead to this settlement justified?
If a person did this, this person would go to jail. If a company does it? Small fine and the green light to cannibalize more content. Funny how that works.
It's an unfortunate outcome. Now to be a big player in AI, you have to have enough capital to buy your own library worth of books and digitize them. (Fun fact: a pallet of books is called a "gaylord," and they buy hundreds of gaylords.)
I created books3 to help settle the question of whether AI companies should be allowed to train on books. The outcome of "it's okay to pirate books as long as you're only training on them" was a long shot, but it would've let individual hackers train their own AI models (assuming access to sufficient compute, which you can get e.g. via https://sites.research.google/trc/about/).
Now we're in a world where you have to have dozens of millions in capital to do substantial work.
I heard at one point Eleuther was gathering public domain training data. I wonder if they ever built a corpus large enough so that training on books doesn't really matter...
As this comment states, it may not be the piracy that is the issue, but the keeping of the books forever rather than just for the purpose of training. Regardless, I believe people will do this in a wink wink nudge nudge sort of way anyway, as no one releases their training data, because we all know where it comes from.
With this it's becoming very clear that we're moving past information copyright of today and the only copyright that'll remain will be brand/trademark shaped. This might be a good thing right? Information remains free while people's effort remains protected (assuming fair governance).
A critical distinction, because they were going to to find terabytes of not pirated books to train on that contained the sum history of humanities knowledge /s
> Anthropic spent many millions of dollars to purchase millions of print books, often in used condition. Then, its service providers stripped the books from their bindings, cut their pages to size, and scanned the books into digital form — discarding the paper originals. Each print book resulted in a PDF copy containing images of the scanned pages with machine-readable text (including front and back cover scans for softcover books
> Then, its service providers stripped the books from their bindings, cut their pages to size, and scanned the books into digital form — discarding the paper originals.
This is worse than pirating books to an absurd degree, it's almost a parody - the company that slurps all human knowledge ends up not only metaphorically, but also physically destroying those books, like an information vampire.
Authors don't even receive any financial compensation if the books were bought second hand, either. There's no benefit in doing that. (Not that making one final sale of a hardcover copy would make any difference though)
If Anthropic were at least buying ebooks, this insanity wouldn't need to happen. Unfortunately there is no bulk rates for buying millions of ebooks like you have in the used book market
In many territories like Ireland, Authors are compensated for their inclusion in lending libraries. It tends to be of the pitiful 'music rights organisation' style mechanical reproduction royalties, but it does exist.
No, it’s proof purchase of how stupid the publishing industry is. Maybe publishing houses should just pay authors good money, like a goddamn salary, and get a book out of them every few years.
They can't for the same reason that cab companies can't make their drivers employees: they would have to employ far, far fewer of them than they do on contingency.
The AI craze not only destroyed books, but many small websites who couldn't bear the load of constant scraping, or many communities that took open forums and took them offline or put them behind closed doors.
There is less publicly available knowledge now on the Internet than there has been 3 years ago.
Great, so now instead of allowing anyone to train on already scanned books for free, we can have only the richest big labs buy all the books and scan them privately to train their proprietary models. And since they buy the books used, authors still don't get any money. But at least the books are destroyed afterwards! What an improvement!
My complaint is that after this settlement nothing has materially changed except that the big labs now benefit from higher barriers to entry in their market. Authors don't make more money (other than a one time protection payment from Anthropic to publishers and some lawyers). Literally no one else benefits, except I guess used book marketplaces and book scanner vendors.
To be clear, this isn't a problem with the court process. Everything here appears perfectly in accordance with the law. It's just an absurd state to be in.
This is such a petty and impotent ruling. If you want to ban them from using culture to make derivative works without proper compensation then do that.
But if you don't want to ban them, telling them to buy one book of each, likely second hand, is complete pettiness that resulted in destructive scanning of millions of books, many of which were already practically available in digital form.
>This is such a petty and impotent ruling. If you want to ban them from using culture to make derivative works without proper compensation then do that.
That's because the judges are supposed to rule on questions of law (ie. "is AI training fair use?"), not whether they think AI's good or not.
how much of your economic output are you comfortable with companies like Anthropic stealing to put you out of work?
at least in Player Piano they paid the workers who made the cassette tapes that made the robots work.
our current LLM overlords demand that they be able to basically steal the sum total of all human knowledge so that they can sell it back to us at a rate they set.
they should have been shunned by society and made penniless when they first announced their goals but we have a bunch of deeply misanthropic people who have money and want to make a world where computer slaves do their bidding.
If you believe information deserves to be free, and if most of your earnings were from information that wasn't given away for free -- well, if you want people to give up their ill gotten gains, maybe you can start by setting an example.
So, mind sending me your bank account information? I'll promise to make good use of it.
Did someone forget to consult with the MPAA and the RIAA on this one? This is a joke of an outcome. $3k per book. How much was it per song for Napster?
The RIAA typically asked for around $2-4 per song to settle without a lawsuit, which would come to a total of a few thousand because they generally only went after people sharing over a thousand songs.
In the couple of few where the party would not agree to a settlement and the RIAA sued, they would pick about 15 of the thousand+ songs to sue over. Statutory damages are a minimum of $750 per infringed work, so the total would now be about 3-5 times what their settlement offer amount had been.
Most parties then got a lawyer, the lawyer told the party that had no chance, and they would then seriously negotiate with the RIAA and get a settlement.
Only a couple would still not settle, went to trial, and did an absolutely terrible job and the judge/jury awarded well above the minimum statutory damages. The RIAA still tried to settle for well below that, but the defendants refused and kept trying to fight and did not have a happy time.
> in practice the RIAA offered defendants the option of establishing a “Clean Slate” by destroying all of their illegally acquired files and paying a settlement of approximately $3 per illegal song.
The only bad thing about OpenAI and Anthropic training on everyone's stuff without their consent is that they didn't give away the model weights afterwards.
The people who espouse copyright abolitionism believe "information wants to be (and should be) free"
So no, for these people including myself, Copyright isn't doing anything good at all. It should be abolished. None of the people in this suit should get a dime. The government should force open weight releases of all foundation models as basically the only regulation that applies to the space at this current time.
That would be my preference, but if people really want to have free as in beer access to information, we can have that conversation. After these companies give people money for the commons that they're strip mining.
This is insufficient for the human authors but seems ideal for Anthropic, who now have established a financial moat for others to train their ai on those works (except for Chinese companies, which don't care either way).
The fact that pirated books en-mass were used to train LLMs is legally irrelevant, oh do tell - why is that? The whole point of an LLM is to train a neural network based on content - without the content the net is entirely noise. Anthropic/OpenAI, etc. do not exist without training data. Its akin to taking millions of courses online that are intended to be paid for, but never paying.
Single greatest transfer of intellectual property in history.
I don't think royalties or settlements are really the point here. AI must be a net benefit to humanity, or we burn everything to the ground, it's that simple.
The next few decades of AI need to lift everyone up, it needs to eliminate the most degrading and dangerous jobs while providing abundance. There is simply no point to robots if they don't serve us and make everything cheaper and more accessible to us.
We are watching Wall Street. The Devon's and Luigi's of the world are not interested in your settlement figure or what this means to shareholders. Humanity needs to be aware that it either keeps parasites at bay or the parasites are going to build a robot and surveillance army. It is literally us or them.
I'm not anti-AI, I am not scared of AI going rogue, I simply recognise that these people cannot be trusted, they do not care about your rules, there is no "regulating" it, the only thing that can scare them is a million people holding pitchforks outside their building.
This is not even than a slap on the wrist. Publishers who negotiated this really fucked up writers.
According to US federal law, pirating a single copyrighted work and gaining commercial advantage of it (which Anthropic 100% did) represents five years in prison and a $250,000 fine. But it gets worse:
"Penalties for a copyright infringement conviction may increase if the defendant has previous similar convictions, made more than 10 copies of copyrighted works, committed copyright infringement during a period longer than 180 days, or infringed copyrighted material worth more than $2,500."
It's seemingly $3,000 per book, so they could've (and did, partially) just bought the books themselves for way cheaper, and with only a fraction of that money going to the authors
It's valid to not take AI companies' side here but people who think publishers are fighing for the little guy's rights are delusional. Tech companies have been exploiting artists for a few years, publishers/record labels/media companies have been doing it for centuries.
THANK YOU! And the idea that copyright actually helps individuals is such bullshit I can’t even believe anyone believes it! On a site filled with free software advocates.
That is a false statement. Gaining commercial advantage means selling pirated copies which Anthropic absolutely did not do, so none of your following statements are correct either.
Settlement would mean it doesn't become legal precedence, right?
This outcome seems to be the best possible for Anthropic. Over 100B$ have been invested in AI so far, venture capital can afford to pay a few billions per big company as a South Park style "Sorry".
I sincerely don't understand what the point of these laws are, when the cost of flagrant violations is no more than a slap on the wrist -- these really meager sums that serve as nothing more than something to point at and say "Look, we did something!"
Cover-your-ass strategy, and nothing more. Who, besides the ones at fault, are ever happy with these mean-nothing fines?
The justice system really needs an overhaul with how it tackles "justice" between the wealthy, the connected, the corporations, and the rest. Though I am unsure what that would look like. Minimum net wealth per category of infraction across the board?
This is a settlement that the authors and Anthropic agreed upon.
They agreed on the amount last year. The judge approved it now.
The lawsuit was for the way the books were acquired. They already ruled that it's not infringement to use the books.
The award was $3,000 per book, which is about 100X higher than it would have cost to buy the books.
It's never going to appease the people who demand companies be sued into collapse, but given that both parties came to an agreement and the damages are 100X higher than what a book costs, it looks reasonable to me.
I dont see the relevance. If Anthropic had bought the book at the store, shredded the spine, scanned the pages and trained on that data instead, there wouldnt have been an issue.
Authors cant simply license away fair use. If it could be dismissed so easily the right wouldn't exist.
Of course it is. If I write a movie review and sell it to a magazine or whatever, it's derived from the movie, and it's fair use, and I don't need to ask the movie owner for permission first, or give them a cut of my sales. Even if I use some reasonable number of screenshots and video clips, as long as the resulting work is "transformative" i.e. actually a new work, a movie review instead of a copy of the movie.
Do you want this to work any other way? I constantly see people in the AI debate working themselves into wildly copyright maximalist positions. I actually don't think that we should give every author veto power over a book review!
>I constantly see people in the AI debate working themselves into wildly copyright maximalist positions
I really dont get this. I know its that conflation fallacy or whatever, but I was under the impression we had sort of gotten over copyright maximalism as a society after Napster etc.
Whats worse is that, meaningful reform in this space has basically been waiting on a multi billion dollar corporation to come along and push it forward. So now that we have an opportunity to expand and globalise fair use, the sudden and quite angry opposition weirds me out to no end.
1. author owns the right to distribute copies of the work
2. this right goes on for faaaaaar too long.
I don't have an issue with 1. You had a good idea, you implemented it, you deserve something for it. Given some people got sued into oblivion with ridiculous dollar value outcomes on a per unit basis - why doesn't this apply here? Sure 1.5 billion is a lot. But the number of infringments is insane and the company is approaching a trillion in valuation. You could make it ten times that number.
I do have an issue with 2. Sure, you had a good idea, you implemented it, you deserve something for it. But after 20 years, you should be able to come up with another idea or just work like the rest of us. Going for 50, 70, 90+ years with the rewards going to estate heirs? Fuck that.
So yeah, I am both against copyright AND surprised at the slap on the wrist for what happened here.
>Given some people got sued into oblivion with ridiculous dollar value outcomes on a per unit basis - why doesn't this apply here?
I mean, it feels to me like one or both of:
1. The class action lawyers werent 100% certain they could win in court.
2. The class action lawyers smelled an easy payday.
They get ~100 million out of this.
I also think that the 1500 bucks going to most of these authors is going to be more than they ever saw in royalties. I read somewhere that 500 - 1500 bucks is roughly what a self pub book makes in its lifetime. Why push the envelope? Anthropic hasnt done anything that deserves to pay for the entire lifetime royalties of most books. Their legal alternative is to cut the spine off and scan the book in. In which case the author and publisher will be splitting 20 bucks instead, assuming Anthropic isnt buying used.
This seems like a donation tbh.
>slap on the wrist for what happened here.
Its not a punishment at all because this is a civil case that has been settled out of court.
IANAL but as an IP creator I have not heard of "derivative products" in the copyright context. There are "derivative works", which are covered by the same copyright as the original. For example, a translation to another language is a derivative work, a novelisation of a movie, a screen adaptation of a book etc. If some author could have proven that any Anthromic model is a derivative work of theirs then they had the copyright on that model and made mad bucks licensing it back to Anthropic.
To sign up for what? The experience of approximately every author on the planet is that they found out that Anthropic did something bad at the same time they were "opted into" the class. The only thing they could do is opt out and litigate on their own against a company with a valuation approaching $1T.
This is a sweet deal for lawyers and for publishers, and nothing else.
Civil justice is primarily about restoring damages, not about punishing wrongdoing (although common law in US it is more punitive than civil law in european countries). Therefore compensations are based on damages, not on profit from wrongdoings.
the irony is that all of this money will go to rent-seeking publishers who won't pass it on to the artists; basically a dispute between the wealthy you're upset with
Default payout is 50/50 author/publisher. If the author and publisher have a contract that states otherwise, then their contract overrides the default.
Source: I’m an author and signed up to be part of the class action, and this was the class action documents said.
> If there is a current publisher(s) (which still possesses an exclusive license), the author(s) will split the $3000 with the publisher. Any co-authors will share the author portion and, if there are multiple publishers (e.g., different publishers have exclusive rights to different formats), they will share the publisher portion. Assume that the co-authors and co-publishers will share the portion equally unless their contracts provide otherwise. The standard default split between publishers and authors of noneducational texts is 50/50, as described below. Authors who are the sole rightsholder in a work—such as self-published authors and authors whose rights have reverted or where the contracts have otherwise terminated—will receive the full award amount.
It is split between the publisher and the author, also publishers will have a large catalog of books they will submit, an author typically will only have a few -- the payout will be going to the lawyers and mostly to publishers.
>It is split between the publisher and the author, also publishers will have a large catalog of books they will submit, an author typically will only have a few -- the payout will be going to the lawyers and mostly to publishers.
This is innumerate. If it's split 50% between authors and publishers, then it won't be "mostly to publishers". Mathematically it will be equal between "authors" and "publishers", and because lawyers are taking their cut, neither would be able to get "most" of it. Yes, the average publisher will get a bigger paycheck, but that's because there's less of them, not because "most going to publishers".
> That means that rightsholders can expect at least $3,000 per title (less costs and fees), which will be shared among the rightsholders for that title (if there is more than one rightsholder)
> if there is more than one rightsholder
Again, a publisher will have a whole catalog of books / titles, a non-negligible portion of that the publisher will own the copyright to (no one to split it with). There's all kinds of books outside of novels, there's media tie-ins, IP franchise books (ie Star Wars), childrens books, textbooks / reference materials, etc etc etc. Yes, with novels the author tends to own the copyright, but you're forgetting all of the other kinds of books out there.
> I sincerely don't understand what the point of these laws are, when the cost of flagrant violations is no more than a slap on the wrist -- these really meager sums that serve as nothing more than something to point at and say "Look, we did something!"
To create a moat around wealth generation. After all, that is the main purpose of all legal systems---to keep the wealthy wealthy and the poor poor. In this case, the settlement is chump change for Anthropic, but ensures that no upstart will be able to compete with them since they will get reamed on copyright charges. It's no different from Google Image search. They can make a product out of republishing others' images. You cannot do it.
To keep users paying for content while companies do whatever they want - and if that's not the reason that's certainly an effect.
> The justice system really needs an overhaul with how it tackles "justice" between the wealthy, the connected, the corporations, and the rest. Though I am unsure what that would look like. Minimum net wealth per category of infraction across the board?
% of annual turnover seems like decent strategy. Caps the amount company can sue mere mortal for copyright infringement while at billion dollar company scale can wipe quite a bit
But main problem is enforcement and lobbying, not the size of the fine
this is not enough. the penalty for training ai without permission should be releasing the model as public domain. if you take from everyone you have to give back the same way.
I support anthropics position here, on both learning from and "pirating" books.
The way i see things , the publishers and authors are happy with any policy that makes them more money, and more market control, regardless of what is ethical/just/right.
They would shutdown public libraries , all libraries, if they could.
Aaron Swartz lost his life because he tried to make public knowledge public, and they would be happy to put every information activist to death to protect their monopolies.
IMHO they have no right to stop free access on the internet. The whole copyright system is artificial and monopolistic, and the publishers are complaining yet again, that technology moves information more efficiently than they do, so they want to artificially retard it through goverment action.
The real goverment action that is needed, is to protect private/personal data; not data that is actively traded commercially or publically.
These tech companies are invading personal and private spaces of everyday people, and storing and training with it. Even using it for military targetting and warrantless surveillance.
Anthropic is by no means a good entity, so the way to stick it to them and all tech companies, is to allow their internet scraping, but make it outright criminal to use telemetry or any surveillance techniques they have or will develop.
Also... the ”creators",hollywood,publishers, have no problems scraping themselves, and lift ideas from just about everywhere they can get it.
Almost every hollywood movie is just an assemblage of random memes and topical concerns of everyday ppl, distilled into embelished predictable cheese.
The publishers are the original slop actors. Human Slop.
Aaron swartz lost his life because he committed suicide. Something he had tried multiple times before. If he really only committed suicide because of the legal jeopardy he was in, wouldn't it have made more sense to commit suicide after you're found guilty?
What do you mean pirating? They don't even distribute the originals, LLMs are not for replication, we already have copying and internet for that.
Why would we use a multi-billion parameter model to copy text? If we wanted the originals it would be easier to find them free, pirate or pay, if we use LLMs it is because we want something ELSE.
And caring about content rights in a world with limitless content and scarce attention is a mistake, it was never the content that was scarce in the last 20 years.
So it goes like this: I first you take, then money you make and eventually you repay. This is a very smart loan from society indeed. And seems to be the new normal…
Even though Anthropic is my daily driver I’m done respecting any sort of copyright. I’m okay paying for subscription for a service delivery but never ever again will I believe in copyright or any other utterly non-enforceable similar concept.
Honestly maybe (and just maybe) waiving copyrights on all the written content that ever existed to create training data would be a good thing to do, laws are made up so we can decide it’s a good trade off as a society. But:
1. I feel like this should be discussed globally, there should be a public debate, a vote, and guardrails
2. It should not be in the hands of private companies, it should either be done by the government and made available to the public ; or if it’s done by private companies they should be mandated to give the training data to the government so it’s available to the public.
My point is we can decide to say it’s ok because LLMs are too important strategically. But if we do so it should benefit the public, not 5 mega corporations, training data should be considered as public infrastructure, like roads, rails, or the electricity grid. Societies are failing and this is just one more nail in the coffin.
The correct way to do it would be to force Anthropic to remove content and the results of training based on that content from their models at copyright holder's request.
This is a too big to fail scenario. If these companies fail, so does the US economy. Normal laws for individuals don't apply, so any comparison to that is pointless.
There used to be libgen. Then it went down. It went semi-back up but ...
it is still kind of down.
Those issues kind of coincided with the big greedy mega-corporations
leeching off data en masse; Anthropic was not the only one, Facebook
is another example here. I always wondered whether the decline in quality,
fewer liberated books published, coincided with what the big corporations
were doing. Would be great to be able to see any underlying strategy here.
Imagine Anthropic, just as a scenario, leeching off of everyone else,
and then also sending in their lawyers to try to close down what they
leeched off here. I mean the rise of bots kind of coincides with the
rise of AI. So why not them also trying to make it harder for the rest of
the world to access liberated books.
Well, the USA has jurisdiction over USA companies. If the rest of the world's authors can find a way to obtain jurisdiction over the companies in a way that USA courts won't balk at if asked to enforce, then they're welcome to go ahead.
That depends on the answer to a question that hasn't been answered yet.
Is what an AI does similar to a human reading a book, and adding it to their knowledge? Or is it similar to a human plagiarizing a book? If it's the second, for at least some books, no, the damages are not reasonable. They are far too small.
> That depends on the answer to a question that hasn't been answered yet.
It has been answered in a sense, because the courts (so far) have ruled that training is Fair Use. Whether this is similar to a human learning from a book was not quite the question being answered, but AFAICT there is no other relevant doctrine under Copyright law to address it, largely because the question didn't even exist until LLMs came along.
Also, these are not damages, it's a settlement i.e. a negotiated agreement between both parties.
Good question. Can you ask an LLM to repeat the entire contents of a novel, word-for-word, and read that instead of the original book? I haven't tried it, but I would guess it would not be able to do this.
Can you ask it questions about the book and expect it to get them right? Yeah, probably. Same as if I read the book and you asked me questions about it. The LLM would probably answer those questions better than I could, and about every single book in its training data, but still same-same.
As was pointed out, the settlement is for piracy, not training. They had already ruled that Anthropic's use of copyrighted material for training fell within fair use.
As such, if you pirated a book and had to pay $3000 for that one instance, I don't think you'd like it if I said you should have paid $30K or $300K instead. If anything, this is analogous to the ridiculous fines people had to pay when pirating music.
> As such, if you pirated a book and had to pay $3000 for that one instance, I don't think you'd like it if I said you should have paid $30K or $300K instead.
If you pirated a book for personal use the amount of liability wouldn't match a company whose profit could be attributed to pirating the same book. In US copyright law, a copyright infringer could be liable for "any profits of the infringer that are attributable to the infringement" [1] (if the copyright owner elects to recover actual damages and profits instead of statutory damages).
IANAL, but the parent comment quotes "any profits of the infringer that are attributable to the infringement", which I take to mean it's the profit Anthropic stands to make based on its use of the pirated content that's recoverable.
Given the entire global economy is currently bullish on the potential profitability of AI, I dare say they got off incredibly lightly settling for just $3k per book.
None of this matters, this is the judge approving a voluntary settlement reached between the parties last year.
If you think it should be different then you have to make a cogent argument why the public should get to interfere with a settlement the two sides mutually agree on.
Note: I never said it should be different and certainly wasn't arguing for any side. I was merely making an observation that the settlement seemed like a good deal (for both parties) given the potential for Anthropic to be liable for a significantly greater amount depending on how the law would be interpreted if they went to trial.
Because we are mostly discussing a single private person that got caught for maybe 20 songs. I don't want to bring up Aaron but the taste gets saltier the more we see settlements like this.
I work as an author. I believe this is total bullshit, from beginning to end - the ruling, the settlement, and the suit itself.
In the UK, we have a thing called the Public Lending Right [1]. This pays authors a fixed sum each time their book is taken out of a library, up to a capped amount.
The cap isn't very high - about $7k - so it is both an OK bit of income for authors who might be making very little money elsewhere, and also doesn't end up all going to authors who are already bestsellers. It's a decent legal system for helping libraries hold niche titles as well as the popular ones. This is, after all, the purpose of a library.
To establish my bias here: My debut novel came out after the period this specific suit concerns. I also uploaded it to LibGen myself.
I strongly believe that books should be available to read, free of charge, to all people. I benefited enormously from libraries and piracy growing up. I think they serve an important educational purpose that does not end when a person leaves school, and I do not think wealth or disposable income is a fair way to decide the breadth of a person's education.
I also have no problem with people making new "language things" using my work. I love sample-based music (like dance music, hip hop, etc) and it'd be hypocritical for me to take issue with anyone doing analogous things using books. Maximising sales is not the end-goal of making art, for me personally. Other artists feel otherwise. They consider training on pirated books stealing. That's OK - it's not for me to tell them what to believe.
The problem for me is that these corporations - undoubtedly still pretraining on pirated material - are, essentially, leeching. By not releasing the model as open-weight, freely available, they are not acting in the same spirit of the system they took advantage of. It's the Spotify model: pirate first, pay a nominal amount that does not meaningfully harm profit later. Now the dust has settled there, we can see the harm it has done to music culture.
A single settlement which does not establish precedent does not solve anything. A tokenistic $3k allows anti-AI authors to wave a cheque in the air and declare a victory. It pays the rent for a month or two. It does nothing for the months after that, when the corporation is still profiting. It does nothing to establish precedent for future artists, who also have to pay rent.
It would be (non-trivial, but) relatively simple to integrate - for example - download figures from Anna's Archive into the PLR. I'd happily dilute my PLR payment appropriately, because I think libraries are important.
You can't stop people pirating digitally replicable things. Digital ownership is not a concept that has held, or will hold.
There are only 23,000 authors in the UK who claim the cash from the PLR. To pay all those authors the national living wage in the UK (£26k) from the PLR, you would need to raise £546 million. That is around 1/34 of Anthropic's reported annual revenue.
I'm of course not arguing Anthropic should be solely responsible. But it's very frustrating that all the pieces of the puzzle for actually paying artists in a sustainable and ongoing way now exist, and one of the major obstacles to this - and the idea of a genuinely free, legal, international library, which creates more authors, writing better books, full-time - are legacy rights holders who remain attached to a completely dysfunctional and outdated concept of ownership.
So - unless part of a sustained and reasonable campaign, which understands the futility of (and damage to the medium and its creators caused by) treating digital ownership in the same way as physical ownership - this suit is close to pointless, and arguably actively harmful in the long term.
See, Judge Alsup should have been the person Biden put on the Supreme Court, that or re-nominate Merrick Garland. Instead, he made a silly promise to sate Black Lives Matter, which even when he took office was fast on its way to ignominy, and now Kagan is stuck being the only competent liberal justice on the court. At least Alsup can continue setting the direction of law as it applies to the tech industry.
What a fucking joke of a country the US is, allowing this kind of behaviour with such a pathetic "punishment". Barely even qualifies as a tap on the wrist, Anthropic should be getting gutted into non-existence for this shit and the execs should be given the Aaron Swartz treatment.
Amen! We are watching them incinerate the past so they can lie about the past in the future. They are destroying the books and will censor what was in them.
At least not as far as the courts are concerned. Alsup ruled [0] that feeding a book into an LLM is transformative and counts as fair use. Especially when they purchased a physical copy of the book, scanned it, and destroyed the original.
But if I'm reading the ruling correctly, Anthropic might have been fine even with feeding pirated books into their LLM (as long as they planned to eventually deleted them afterwards)
Where Anthropic ran into problems is that they put all their pirated books into a big central library (file on a server), and planned to keep those copies forever. Including copies they never actually fed into the LLM (a point that seriously worked against them).
Alsup ruled this central library of pirated books was copyright infringement. And it's this "pirated central library" that Anthropic are now paying a a 1.5B settlement for, nothing else.
The fact that the pirated books were also used to train LLMs is legally irrelevant. Though... I suspect a non AI company could have negotiated a significantly smaller settlement.
[0] https://copyrightalliance.org/wp-content/uploads/2025/06/Bar...
I’m guessing you have some kind of imagined idea of some small author being compensated handsomely for his book and all future earnings that could have come from it. Reality though is that between the attorneys that will run away with some high triple digit millions and the corporations that own the rights to the subject works, there will be measly “checks” for any actual person that created anything, i.e., an artist or author.
In an odd way, this whole case is really just “capitalism” cannibalizing itself, i.e., publishers greedily and also in a terrified manner trying to steal away as much capital from the technological shift to AI as possible in order to either create a buffer or fund their transformation to adapt to what AI means to the very nature of writing itself, let alone publishing.
I suspect human writing could survive, but I don’t see any room for publishers.
No because we are people and the laws differ for people, corporations, and machines.
Imagine a society without copyright… only physically intensive jobs could make money because everything else would be pirated, ripped-off or free. Thus, only those who are financially independent could afford to publish. Because the world really needs more rich class propaganda…
Yes, all the rich class propaganda being pushed by open source developers working on software in their free time.
Copyright doesn't actually stop me from pirating a book or an mp3 right now. Heck, I'll just download a book right now. Bam. Done. Some things are so difficult to keep from being pirated, such a photographs, that saying the copyright system protects photographers strikes me as a bit silly. It does protect some commercial photographers if a magazine wants to sell their photo sometimes, but that's a very very small slice of all the photos in copyright that are being shared online right now.
Also there are other systems that might protect an author's financials. Off the top of my head I imagine you could do a netflix model where every citizen pays some taxes to consume intellectual property like a utility. Then the goverment finds a way to measure what is being consumed and gives each author a share based on the rate of consumption. In fact the "intellegence is a ultility" ramblings of Sam Altmen sort-of point in this direction. But that's just one idea thought up early in the morning when its too hot to sleep properly. I'm sure there are many others.
How do we know that when we don't have a copy of the world without this regime? How much more and greater works could have been produced without such a repressive system?
A really successful work becomes part of the culture, and remixing, derivatives and other modes of integrating cultural artifacts are prohibited. Why should we allow corporations to own our culture?
For example. I invent a new method of power washing. I start a power washing business using new tech. I file the tech for patent and copyright-equivalent use. This is then made available to other power wash companies that wish to use the tech and be certified in it so long as a small portion of their revenue goes back to the inventor for a set amount per volume, or something similar of a metric that has a cutoff after a point.
This will breed new industries, create new jobs, introduce new innovations, and allow the markets to move on from being strangled by one giant corporation.
A: rich people pay less % in taxes than wage workers, we should close the loopholes
B: but taxes are immoral to begin with
A: ok, but can we do something now about the unequal enforcement? Unrealized gains, tax havens, trusts, fake charities, etc?
B: well a society based on property rights… ackhully you should read this book by Mises/Rothbard/Rand
> But if I'm reading the ruling correctly, Anthropic might have been fine even with feeding pirated books into their LLM (as long as they eventually deleted them afterwards)
The way I understood it, was that essentially the entire case rested on if Anthropics use was "transformative" or not. And since they literally destroyed the books (not just delete files, which would be copied), that made it transformative.
Regardless if they deleted files or not, if nothing existing was transformed, it would have been illegal. But because of the destruction of k̶n̶o̶w̶l̶e̶d̶g̶e̶ physical property, this ended up being legal.
The transformativeness of the use is independent of the destruction of the books. The destruction of the books allowed them to argue that they had not duplicated them, and was instrumental in the argument supporting the legality of scanning them. But that's entirely upstream of the way the data was leveraged, which is what is critical in the argument about the use being transformative.
You have to be careful, just because the judge points a factor out as notable, doesn't mean that factor was required.
The destruction of source books makes Anthropic's fair use argument [2] especially air tight, but it would be a mistake to assume that act was required, or is what made it transformative.
In the previous google books case [1] (which this case cites), google borrowed books from libraries, scanned them, then returned them. They were not destroyed, google didn't even keep the physical copy.
Yet Google Books was ruled fair use, because it was transformative.
[1] https://en.wikipedia.org/wiki/Authors_Guild,_Inc._v._Google,....
[2] Note... This part of the ruling is still not about LLMs. This was about Anthropic's right to scan books and then keep a digital library of them.
> Ultimately, Judge William Alsup ruled that this destructive scanning operation qualified as fair use—but only because Anthropic had legally purchased the books first, destroyed each print copy after scanning, and kept the digital files internally rather than distributing them. The judge compared the process to “conserv[ing] space” through format conversion and found it transformative. Had Anthropic stuck to this approach from the beginning, it might have achieved the first legally sanctioned case of AI fair use. Instead, the company’s earlier piracy undermined its position.
https://arstechnica.com/ai/2025/06/anthropic-destroyed-milli...
Based on that I get the impression it's quite literally the destruction part that makes it transformative, without it, it wouldn't have been tranformative at all.
He cites three cases where a conversion from one format to another (without destruction of the previous version) was ruled to be fair use. Including scanning books with the google books case. (And referenced the Napster case, where a similar argument was rejected)
Then made the following comparison.
"Here, every purchased print copy was copied in order to save storage space and to enable searchability as a digital copy. The print original was destroyed. One replaced the other. And, there is no evidence that the new, digital copy was shown, shared, or sold outside the company. This use was even more clearly transformative than those in Texaco, Google, and Sony Betamax (where the number of copies went up by at least one), and, of course, more transformative than those uses rejected in Napster (where the number went up by “millions” of copies shared for free with others)."
So it wasn't transformative because of the destruction. The destruction only made it "even more clearly transformative" than those other cases.
Like, how can destruction be required if there were previous cases where it wasn't?
The key legal point is not that Anthropic destroyed the books, but the key fact was that Anthropic didn't distribute the scanned copies. Alsup keeps returning to this point:
"But what matters most is whether the format change exploits anything the Copyright Act reserves to the copyright owner. Anthropic already had purchased permanent library copies (print ones). It did not create new copies to share or sell outside"
"But again, the replacement copy here was kept in the central library, not distributed"
The conclusion of that section doesn't even mention the destruction at all.
arstechnica isn't exactly wrong, the quote also mentioned "and kept the digital files internally rather than distributing them". It just put way too much emphasis on the destruction, and not enough on the lack of distribution.
The other thing that arstechnica are missing:
Antropic didn't destroy the books because they thought it would strengthen their legal argument. They destroyed the because it's a lot cheaper and faster to scan books by ripping off their bindings and feeding the stacks of loose pages into a document scanner.
They used to go around destroying lives by the thousands after Napster was creating because of the invalidity of that argument.
It is a crime to make a CD of your MP3s and vice versa, and you cannot convert your VHS to DVD.
A J. tribe billionaire does it at scale, well then saving space via format conversion is a grand, while the peons still can see their lives destroyed but with it hidden via the CCB secret panel. Two tier American Justice on full display. Bankrupty and seizure or worse for thee and billions for he. Format conversion legalized only for oligarch J's
Their MO was suing owners of internet connections which were seen sharing content on file sharing networks.
How is streaming bits of the music from your computer not transformative?
The court says otherwise.
> Such piracy of otherwise available copies is inherently, irredeemably infringing even if the pirated copies are immediately used for the transformative use and immediately discarded.
Then it says it doesn't need to decide on that basis because they kept it not just for training LLMs, but also for building a central library. Which seems a bit ridiculous, because the sole purpose of the central library is to train LLMs.
It seems to be the modus operandi of corporations in general: they commit any kind of infringement they want and then later they go for a settlement with a value that's, of course, not too big for a company too big to fail.
In the meantime, the average person or company gets shafted.
In my opinion, we are one step away from AI companies capturing the entirety of copyright legislation.
When the legal judgements for wrongdoing are finally handed out, they often come across as just an inconvenience or kind of tax, which is easily handled in comparison to the profits they've already made. Yet, if average Joe or persons not considered as being of "the right type" were to do such actions, they quickly get the full book thrown at them. Often, the full measure of legal punishment, where their company and life is or about nearly over.
Now, if I license the book, I might be able to come to an agreement with the author/publisher whereby I can share some of it.
So, by that logic, you need to be paying every time you regurgitate any of my ideas. Or anyone else's. Copyright now protects abstractions and vibes. Substantial similarity test be damned. Nobody can write stories about wizard schools, the idea is taken.
Why this distinction only for intellectual work?
An Eames chair is, we just have a really high bar for what is copyrightable in the physical world, and it seems pointlessly discriminatory.
But I do know someone definitely paid for the textbooks I used when learning in school.
Is this not..Libre?
If yours do that, maybe we can redefine what copyrighting and patenting means for humans
Is AI just an algorithm. Is human creativity just an algorithm?
Who, if anyone should own the copyright if you prompt AI to write a book?
I'm thinking more from a moral and philosophical pov, the copyright regime is broken anyway
The output of an LLM can be easily be such, but usually not.
> You need to have a very specific and 'creative' / 'substantial' expression of an idea for copyright to apply. The output of an LLM can be easily be such, but usually not.
This is incomplete with current US law. You need the above (the typical copyright qualifiers) AND evidence of substantial human involvement in the creation.
Minimally directing an autonomous agent does not qualify.
That phrase is doing a lot of work. In the US, any writing is automatically protected by copyright. (This comment, for example.) Whether the author can claim infringement is a can of worms: legal costs, fair use … but your “very specific” phrasing makes it sound like there’s a prescription for exactly what is protected by copyright - there is not.
> Ideas are not protected by copyright.
The expression of the idea is, however. Same with facts. The fact that I live at a specific street address is not protected. My sentence construction explaining my specific street address is protected.
> The output of an LLM …
… is not protected, not matter its shape. The US Copyright Office has declared as much.
Without copyright, anyone can copy the art and call it their own. What is then the incentive for the creator to share the art, if there is neither monetory gain and nor fame. And worse than them being recognized, they might even get accused of copying their own art if someone else became famous due to a copy.
Society would miss out a lot.
> And worse than them being recognized, they might even get accused of copying their own art if someone else became famous due to a copy.
You mean like right now? Here is A24 claiming copyright for Backrooms related media that came out before their Backrooms related film: https://kotaku.com/backrooms-a24-copyright-strikes-kane-pars...
Being "accused" of copying literally does not matter if copyright didn't exist. This framing is only an issue under copyright.
> Society would miss out a lot.
Society actively misses out a lot. We could have had tons of derivative art that has been buried for the sake of propping up companies. We could have had Aaron Swartz. Abolish copyright.
https://drewdevault.com/blog/Alice-in-Wonderland/
Copyright is a textbook ladder pull.
Can we use the modern tech (AI) to policy copyright infringement, to liberate the culture and business?
You should not be able to mass generate images in a particular artists style and claim it as fair use, even if a human making the same images would have protection.
What about aleatory music (music left at least partially to chance)? Or Autechre - they have whole albums and live performances built on automation software. They built the logic and added randomization, necessarily removing themselves from the final output.
Is spin art not copyrightable? If I build a simple machine that spins paper, then do no more than drop paint on it, the result is not mine to copyright? I didn’t choose the output, I merely built the machine and the rest was created by pure chance. “But you chose the paint” - and if I didn’t? What if my art uses AI to perform sentiment analysis on the top news articles of the day and it drops colors matching the emotional tone of the news onto the spin art machine. I have no control over it and the output is machine generated, but is the result not just the final step of an entire process I created? Was the result of the creative idea not part of the creativity itself?
If I build an automated laboratory to test every combination of a problem space, is a resulting success not patentable? What if the problem is too large to permute, so I added a random selection process to it? I’m not even controlling what’s being tested, but if it finds success is that not my contribution? The machines did the work, the selection was random, there was no human in the loop; what then?
The internals of an LLM may be mysterious to some, but I assure you it’s just fixed automation with a random number generator sometimes tacked onto it, but randomization is optional too.
I built that LLM. I decided what text to input for training, I curated the information, I wrote the algorithm, I decided the layers and hyper-parameters, I decided the RLHF pairs to train, then I put a few drops of paint from my bottle of language into the automated machine. I decided and built every single step of the system, but that output is not part of my process? If I pipe the LLM text output to a paint dispenser hovering over paper, set to squeeze out drops based on syllables, would you protect my artwork then?
This does not do enough to fix the root problem.
People who live right now, who happen to have written or produced anything that AI works with, build on the back of humanities combined knowledge, will become outsized beneficiaries of AI, with the AI wave offering new ways of monetizing their work – while everyone who has not, won't be.
It's simply not good enough. We have to make sure people broadly benefit first and foremost.
Au contraire! Now the creations of the LLMs stand on legal ground. This was an excellent deal for Anthropic
Perfect - an absolute steal for 1.5B.
Since when?
Whereas for a book it is fair use.
Now only big tech companies can train models
With model distillation being so effective now nobody actually needs to pirate books to train their models. You can get an open-weight Chinese model and get all that. Or you can just buy the books or buy a library - there are many creative solutions here that aren't piracy and not going to cost you billions of dollars.
The moat right now seems to be the compute resources which might actually be worse for us common folk than a legal moat as we need compute for many more things that aren't LLMs too.
This is simply an agreement between two parties.
Meta also has copyright lawsuits for the open models they released, so open models are not immune.
... unless the line we want to draw is "american orgs pay, others don't", as currently seems to be happening.
That is the case, any regulation increases the cost to enter a market.
But in this case, its irrelevant because the moat of cost to enter is already unfathomable and secondly, they are not adding regulation but fining them for committing a crime.
So yeah, adding that every food compnay needs 3 health inspectors that they pay for would benefit coca cola over you mom and pop bakery. But telling someone they cannot start a Space agency with money laundered from ransom and drug sales payments would not affect much the competition markets
At the moment.
Current believe is that its a "winner takes all market", so companies are acting rationally and using Brute Force compute to get there first. Training costs scale linearly, which means the moat is directly related to compute cost
There are theories that they are wasting 90% of training costs and there are more efficient ways to do it than throw compute at the problem. But if thats the case then chances are the market is not "winner takes all". Which then means the valuation of the ENTIRE market is overvalued.
Basically the only way for the assertion "at the moment" to be true is if the market is a bubble, else if the current theory of winner takes all market means a monopoly will make it so that cost isnt even the worst of the moats to enter.
and then sell to all its subscribers, things need to change.
Fixed that for you.
Imagine being able to pay a fraction of your savings to download all Netflix shows and then sell 1 minute chunk of every media to your paid subscribers.
https://storage.courtlistener.com/recap/gov.uscourts.cand.43...
The big deal for publishers and authors is the payout per eligible title is $3k. For a traditional publishing contract involving one author, the amount will be split down the middle.
The other thing which caught my eye is the judge slashed the class counsel's fee by half, from 12.5% ($187.5m) to 6.8% ($101m). The class counsel's unreimbursed litigation expenses were $2.6m.
The three class representatives get just $15k each.
In my state, the people hired to write new bills (if passed becoming statute) have to pass their JD (law degree). Legislators only get to request new bills, they can't hand a proposal (which may have been written by a lobbying agency like ALEC or Heritage) into the system.
Source: was a licensed real estate agent for a long time.
If this is the 2024 settlement that you are referring to, it did not say anything about the price a Realtor can charge:
https://en.wikipedia.org/wiki/Burnett_v._National_Associatio...
>The cooperative compensation rule has been eliminated as a result of the settlement. Seller's agents are no longer required to offer compensation to buyer's agents when listing a home for sale on a Realtor-owned multiple listing service. In addition, Realtors acting as buyer's agents must enter into contracts with buyers before touring any homes, allowing buyers to negotiate how much they will pay their buyer's agent.
In what sane state does it even get that high?
If I put my conspiracy theory hat one and I always get piled on for this theory in other online communities but I think it could be possible. The theory is I think Aaron found some very dark stuff while exploring the MIT private networks, things that he was not supposed to see and could be very damaging to a lot people if they were exposed. The infamous Jeffery Epstein was donating a lot of money to MIT and its Media Labs. I think there is a much deeper story at play that the mainstream narrative is hiding with a “suicide”.
Epstein was relatively restrained even in his personal email, I doubt he was using MIT administrated systems to facilitate a pedo ring
It's crazy that you could face 35 years in jail for trying to free knowledge in a harmless manner. The longest anyone has been imprisoned for in my country in modern times is 26 years, 11 months and 6 days. We have a few people posed to break that record. Peter Lundin has been in prison for 25ish years, and him and Peter Madsen (the discount elon musk turned murderer who killed some poor journalist in is selfmade submarine) are contenders to people who will probably go beyond 35 years.
Not that our system is perfect. I think we're far too lenient on some crimes, but risking 35 years in jail for downloading and sharing academic knowledge... That's objectively evil.
He's also a longtime hobbyist programmer working in BASIC, much of it in support of his ham radio hobby. Screenshots of his shortwave propagation prediction program here [1].
[1] https://www.theverge.com/2017/10/19/16503076/oracle-vs-googl...
His middle name is Haskell.
It's funny that crimes can be settled in cash. IOW, everything has a price; and the price is always right. Settlement ought to be the euphemism for blood money.
In addition to the settlement, what I'd consider fair is to have these companies pay royalties in perpetuity. Of course, that's not tractable.
No, that's what they got in trouble for - a lack of consent.
If the author consents, it would have been fine. If they bought the books, then it is fine. Digitisation through destruction, like most book scanning systems. As long as the original work is destroyed during the process, and you actually paid for it, then it is fair use.
If it regurgitates, then the author can sue you again. So you are incentivised to make damn sure it doesn't. That's not covered by fair use.
Its only if the original cannot be accessed anymore, and you paid to get the original. Both must be true, for fair use to hold.
> Literary works, including computer programs and databases, protected by access control mechanisms that fail to permit access because of malfunction, damage, or obsoleteness.
DRM being covered under other laws, and being gross, still applies. And still applies to industry giants, too. Which is why most who do this, like Google, actually buy physical copies and scan it destructively, so they don't have to deal with it.
Yeah, you are right. Have you been paying your dues to the authors of your math books in first 4 grades? I think 15% of your wages as an engineer would suffice. These kids continue to profit for years, and they are so many. Gotta pot a stop to that IP theft.
In my mistake I thought copyright was about copying rights, not paying for using ideas themselves. If just being downstream from a copyrighted work is infringement even without substantial similarity, then it's more like patents that expire in lifetime + a million years.
Learning from and building on previous work is civilization. Copyright maximalism is a plague.
We may need some new legislation. An LLM is not a person, but its also not just a storage solution.
Like most things said on social media, not being copyrightable.
Those regulations and principles are for humans.
Either the major LLMs are software tools deployed by ostensibly-profit-seeking companies, and regulations based on the notion that "making humans pay to make use of the things they've learned is profoundly antisocial" don't apply, or the LLM companies have a bigass swarm of unpaid -er- "servants", and labor laws and other human rights regulations do apply.
They are, presumably, human. We can perfectly well say that humans have certain rights without needing to give machines those same rights.
For example, we've more or less all agreed that it's fine for a human to watch a movie and enjoy the memories forever, and be inspired by it forever. But we've also more or less all agreed that that doesn't mean that a human can use a machine to record that movie and keep it forever.
> Learning from and building on previous work is civilization. Copyright maximalism is a plague.
The debate has existed for several generations at this point. You may disagree with the mainstream opinion, but it's disingenuous to frame it as "copyright maximalism".
How does intellectual work get funded in this insane world if yours, pray tell?
For works published before copyright laws existed or after property protections expire, anyone should be able to use it for anything forever without consent.
Intellectual work still manages to get funded in this 'insane world' - although given the classical artist/patron system has given way to state-based grants and a select capitalisation of Art post-Warhol, the concept of Universal Basic Income tends to be promoted the desired successor.
Speaking of insane worlds, how does the concept of the Public Domain work in yours?
Maybe not all creative works are deserving of monopoly profits just by sitting on the ass in any case, and should stand on their own merits by producing downstream value that can be sold for whatever they can be sold for, by whoever puts in the work to deliver the value to the end user in a competitive manner. You know, open markets.
Attribution I can see. Consent or payment beyond market value, why? Just because you put in a billion hours to make a shitty $1 value output I should pay you a billion hours worth of labor?
If he was not aware, I wonder if he still would have described the process as "exceedingly transformative" had he been aware.
Note also that Sonnet 3.7 had to be jailbroken.
Note also that they got high memorization for a few books that were widely quoted. The books in question can probably also be "retrieved" by putting phrase prefixes into Google, which is probably why Sonnet 3.7 knows them with the precision of a fanboy. Material being widely repeated in the training set is a well-known cause of memorization.
Edit: Apologies, I misread it as "100 pages". My point about copyright still stands, though.
Personally I think our legal system is just not set up for a world where we can download mindstates in numeric form. Would a sufficiently detailed recording of my brain violate copyright? If simulated, it could certainly be elicited to commit violations.
edit: At any rate, Anthropic are not publishing the Sonnet 3.7 weights.
Some of us have a good enough memory.
Police descended upon Kim Dotcom like he was a terrorist or something. They rappelled down helicopters and stormed his home like he was bin Laden.
Then these big techs come along and they make some absurd cost of doing business settlement.
I think it's just a matter of time until everyone learns this. And then it will be the end of the slowly dying liberal democracies.
What was Sean Parker sued for again?
2. There's incredible value in what they stole.
3. IANAL, but I don't believe "but now everyone can write like a terrible version of the writer we fleeced" is a valid legal defense.
Copying is not theft.
https://youtu.be/ALZZx1xmAzg?si=ugquA7uKT3ABGdws
That's a very charitable way of saying "someone with deep enough pockets can ignore the law and get away with it."
Obviously exaggerating.. but not by much.
Some of you really don’t deserve good things. You should be blocked from using AI on more than one device without paying an additional subscription plan.
That said, it's been done: https://arxiv.org/abs/2601.02671
> In some cases, jailbroken Claude 3.7 Sonnet outputs entire books near-verbatim (e.g., nv-recall=95.8%).
You don't need to reproduce anything verbatim: a 1/4 resolution copy of a movie is still infringement even though it's only a quarter of the size.
You're thinking civil. They're talking criminal. Criminal law enforcement does not (well, isn't supposed to) look at your ability to compensate before deciding what to charge you with.
[1] https://en.wikipedia.org/wiki/Aaron_Swartz#Arrest_and_prosec...
copyright infringement was enough to get judgements that ruined entire lives when i was in my late teens and early 20s
now you get to be a founder of a trillion dollar business by extremely large copyright infringement
fuck these ghouls fuck LLMs and fuck the waste of money for this shit
- @Nevermark
Most never do.
Maybe publishers should JUST pay authors WELL, and get a book every 2-3 years.
https://authorsguild.org/news/key-takeaways-from-2023-author...
There are a couple problems with this approach.
Firstly, while the median income is 20k, the book business is like films or music; ie not evenly distributed. At the top end are a small number of successful authors. They effectively subsidize the publishing house while the house throws advances at authors hoping for the next big whale.
Many books never earn back their advance. Meaning if the author was paid out of royalties they'd make less, not more.
Making advances bigger would result in fewer advances. The pot of money is finite.
This is all happening in a market where supply is unconstrained (everyone thinks they can write), and demand is very limited.
And before we discuss the value, or lack thereof of having an intermediary at all, it should be noted from your link that the median for published authors is higher than self-published authors. So clearly they seem to be making authors more valuable.
In truth of course, most (published) books aren't terribly valuable. Like music and movies most float to the bottom.
So no, the answer is not "pay authors more".
Thats a nice way of saying publishing houses are paying most authors more than they make from the sales
Well the publisher also pays for the book to be bound, edited, overhead for their staff, cover art. Many books don't sell for the full retail price and are discounted. So net of all of this a 10% profit margin is common, they aren't keeping 90% of the book sales.
Most of their investments fail miserably, but they only need one Google/Stephen King.
I created books3 to help settle the question of whether AI companies should be allowed to train on books. The outcome of "it's okay to pirate books as long as you're only training on them" was a long shot, but it would've let individual hackers train their own AI models (assuming access to sufficient compute, which you can get e.g. via https://sites.research.google/trc/about/).
Now we're in a world where you have to have dozens of millions in capital to do substantial work.
I heard at one point Eleuther was gathering public domain training data. I wonder if they ever built a corpus large enough so that training on books doesn't really matter...
A Gaylord is a type of box that fits on a pallet. There are multiple ways to palletize products, like shrink wrapping or metal banding
https://news.ycombinator.com/item?id=48996652#49004015
(an observation, not agreement)
Let them take on the liability
> Anthropic spent many millions of dollars to purchase millions of print books, often in used condition. Then, its service providers stripped the books from their bindings, cut their pages to size, and scanned the books into digital form — discarding the paper originals. Each print book resulted in a PDF copy containing images of the scanned pages with machine-readable text (including front and back cover scans for softcover books
This is worse than pirating books to an absurd degree, it's almost a parody - the company that slurps all human knowledge ends up not only metaphorically, but also physically destroying those books, like an information vampire.
Authors don't even receive any financial compensation if the books were bought second hand, either. There's no benefit in doing that. (Not that making one final sale of a hardcover copy would make any difference though)
If Anthropic were at least buying ebooks, this insanity wouldn't need to happen. Unfortunately there is no bulk rates for buying millions of ebooks like you have in the used book market
There's such a thing as fair use and digitizing privately owned printed material is absolutely legal... including for corporations.
There is less publicly available knowledge now on the Internet than there has been 3 years ago.
That would be pirating. So your complaint is that they didn't do more piracy?
To be clear, this isn't a problem with the court process. Everything here appears perfectly in accordance with the law. It's just an absurd state to be in.
the people operating frontier labs are bad people they cannot be trusted in any way
the best solution to them would be to send them to monster island (even though it's really a peninsula)
But if you don't want to ban them, telling them to buy one book of each, likely second hand, is complete pettiness that resulted in destructive scanning of millions of books, many of which were already practically available in digital form.
That's because the judges are supposed to rule on questions of law (ie. "is AI training fair use?"), not whether they think AI's good or not.
at least in Player Piano they paid the workers who made the cassette tapes that made the robots work.
our current LLM overlords demand that they be able to basically steal the sum total of all human knowledge so that they can sell it back to us at a rate they set.
they should have been shunned by society and made penniless when they first announced their goals but we have a bunch of deeply misanthropic people who have money and want to make a world where computer slaves do their bidding.
So, mind sending me your bank account information? I'll promise to make good use of it.
You get a service. The service is using their compute power to run a model and their scientists to build the model.
In the couple of few where the party would not agree to a settlement and the RIAA sued, they would pick about 15 of the thousand+ songs to sue over. Statutory damages are a minimum of $750 per infringed work, so the total would now be about 3-5 times what their settlement offer amount had been.
Most parties then got a lawyer, the lawyer told the party that had no chance, and they would then seriously negotiate with the RIAA and get a settlement.
Only a couple would still not settle, went to trial, and did an absolutely terrible job and the judge/jury awarded well above the minimum statutory damages. The RIAA still tried to settle for well below that, but the defendants refused and kept trying to fight and did not have a happy time.
https://www.history.com/this-day-in-history/september-8/riaa...
> in practice the RIAA offered defendants the option of establishing a “Clean Slate” by destroying all of their illegally acquired files and paying a settlement of approximately $3 per illegal song.
The two notable cases were:
1) https://en.wikipedia.org/wiki/Capitol_Records,_Inc._v._Thoma...
2) https://en.wikipedia.org/wiki/Sony_BMG_Music_Entertainment_v...
The people who espouse copyright abolitionism believe "information wants to be (and should be) free"
So no, for these people including myself, Copyright isn't doing anything good at all. It should be abolished. None of the people in this suit should get a dime. The government should force open weight releases of all foundation models as basically the only regulation that applies to the space at this current time.
A slap on the wrist, that's what it's doing here, isn't it?
This deal is built around Anthropic surviving. The $1.5B comes in installments, and counsel’s fees are paid in step with those installments.
The class is now effectively Anthropic’s creditor, with a direct financial interest in the company staying solvent through the payment schedule.
Civil suits compensate and the one outcome guaranteed to leave authors worse off was a verdict big enough to kill the payer.
I don't think royalties or settlements are really the point here. AI must be a net benefit to humanity, or we burn everything to the ground, it's that simple.
The next few decades of AI need to lift everyone up, it needs to eliminate the most degrading and dangerous jobs while providing abundance. There is simply no point to robots if they don't serve us and make everything cheaper and more accessible to us.
We are watching Wall Street. The Devon's and Luigi's of the world are not interested in your settlement figure or what this means to shareholders. Humanity needs to be aware that it either keeps parasites at bay or the parasites are going to build a robot and surveillance army. It is literally us or them.
I'm not anti-AI, I am not scared of AI going rogue, I simply recognise that these people cannot be trusted, they do not care about your rules, there is no "regulating" it, the only thing that can scare them is a million people holding pitchforks outside their building.
>$3000 per book
Ohhhh, yeah, big copyright fines only apply to us little guys, not the "asshole tech" companies.
According to US federal law, pirating a single copyrighted work and gaining commercial advantage of it (which Anthropic 100% did) represents five years in prison and a $250,000 fine. But it gets worse:
"Penalties for a copyright infringement conviction may increase if the defendant has previous similar convictions, made more than 10 copies of copyrighted works, committed copyright infringement during a period longer than 180 days, or infringed copyrighted material worth more than $2,500."
https://www.justia.com/entertainment-law/piracy-in-the-enter...
It's seemingly $3,000 per book, so they could've (and did, partially) just bought the books themselves for way cheaper, and with only a fraction of that money going to the authors
But they didn't. The fact they partially did proves that they knew they should've, so they can't even claim ignorance.
Absurd.
This outcome seems to be the best possible for Anthropic. Over 100B$ have been invested in AI so far, venture capital can afford to pay a few billions per big company as a South Park style "Sorry".
Or am I missing something?
Cover-your-ass strategy, and nothing more. Who, besides the ones at fault, are ever happy with these mean-nothing fines?
The justice system really needs an overhaul with how it tackles "justice" between the wealthy, the connected, the corporations, and the rest. Though I am unsure what that would look like. Minimum net wealth per category of infraction across the board?
Edit: grammar
They agreed on the amount last year. The judge approved it now.
The lawsuit was for the way the books were acquired. They already ruled that it's not infringement to use the books.
The award was $3,000 per book, which is about 100X higher than it would have cost to buy the books.
It's never going to appease the people who demand companies be sued into collapse, but given that both parties came to an agreement and the damages are 100X higher than what a book costs, it looks reasonable to me.
If you are selling more than 100 books you are clearly losing out
The authors were only owed money for the piracy.
How many of the authors would license their book for endless creation of derivative works for that amount?
Authors cant simply license away fair use. If it could be dismissed so easily the right wouldn't exist.
Do you want this to work any other way? I constantly see people in the AI debate working themselves into wildly copyright maximalist positions. I actually don't think that we should give every author veto power over a book review!
I really dont get this. I know its that conflation fallacy or whatever, but I was under the impression we had sort of gotten over copyright maximalism as a society after Napster etc.
Whats worse is that, meaningful reform in this space has basically been waiting on a multi billion dollar corporation to come along and push it forward. So now that we have an opportunity to expand and globalise fair use, the sudden and quite angry opposition weirds me out to no end.
1. author owns the right to distribute copies of the work
2. this right goes on for faaaaaar too long.
I don't have an issue with 1. You had a good idea, you implemented it, you deserve something for it. Given some people got sued into oblivion with ridiculous dollar value outcomes on a per unit basis - why doesn't this apply here? Sure 1.5 billion is a lot. But the number of infringments is insane and the company is approaching a trillion in valuation. You could make it ten times that number.
I do have an issue with 2. Sure, you had a good idea, you implemented it, you deserve something for it. But after 20 years, you should be able to come up with another idea or just work like the rest of us. Going for 50, 70, 90+ years with the rewards going to estate heirs? Fuck that.
So yeah, I am both against copyright AND surprised at the slap on the wrist for what happened here.
I mean, it feels to me like one or both of:
1. The class action lawyers werent 100% certain they could win in court. 2. The class action lawyers smelled an easy payday.
They get ~100 million out of this.
I also think that the 1500 bucks going to most of these authors is going to be more than they ever saw in royalties. I read somewhere that 500 - 1500 bucks is roughly what a self pub book makes in its lifetime. Why push the envelope? Anthropic hasnt done anything that deserves to pay for the entire lifetime royalties of most books. Their legal alternative is to cut the spine off and scan the book in. In which case the author and publisher will be splitting 20 bucks instead, assuming Anthropic isnt buying used.
This seems like a donation tbh.
>slap on the wrist for what happened here.
Its not a punishment at all because this is a civil case that has been settled out of court.
All US courts so far have ruled yes.
The authors or the publishers?
I have a hard time believing they agreed with the millions of authors they pirated.
If you’re so interested, go read past the headline. Maybe you’ll find that you’re working about what “authors” will agree to.
This is a sweet deal for lawyers and for publishers, and nothing else.
Thats more than it costs to just shred the spine and scan the book in. Which is probably 15 - 20 bucks a piece.
They will be shredding the book not paying the fine.
Source: I’m an author and signed up to be part of the class action, and this was the class action documents said.
It was started by a group of authors, not publishers.
> If there is a current publisher(s) (which still possesses an exclusive license), the author(s) will split the $3000 with the publisher. Any co-authors will share the author portion and, if there are multiple publishers (e.g., different publishers have exclusive rights to different formats), they will share the publisher portion. Assume that the co-authors and co-publishers will share the portion equally unless their contracts provide otherwise. The standard default split between publishers and authors of noneducational texts is 50/50, as described below. Authors who are the sole rightsholder in a work—such as self-published authors and authors whose rights have reverted or where the contracts have otherwise terminated—will receive the full award amount.
It is split between the publisher and the author, also publishers will have a large catalog of books they will submit, an author typically will only have a few -- the payout will be going to the lawyers and mostly to publishers.
This is innumerate. If it's split 50% between authors and publishers, then it won't be "mostly to publishers". Mathematically it will be equal between "authors" and "publishers", and because lawyers are taking their cut, neither would be able to get "most" of it. Yes, the average publisher will get a bigger paycheck, but that's because there's less of them, not because "most going to publishers".
> if there is more than one rightsholder
Again, a publisher will have a whole catalog of books / titles, a non-negligible portion of that the publisher will own the copyright to (no one to split it with). There's all kinds of books outside of novels, there's media tie-ins, IP franchise books (ie Star Wars), childrens books, textbooks / reference materials, etc etc etc. Yes, with novels the author tends to own the copyright, but you're forgetting all of the other kinds of books out there.
To create a moat around wealth generation. After all, that is the main purpose of all legal systems---to keep the wealthy wealthy and the poor poor. In this case, the settlement is chump change for Anthropic, but ensures that no upstart will be able to compete with them since they will get reamed on copyright charges. It's no different from Google Image search. They can make a product out of republishing others' images. You cannot do it.
> The justice system really needs an overhaul with how it tackles "justice" between the wealthy, the connected, the corporations, and the rest. Though I am unsure what that would look like. Minimum net wealth per category of infraction across the board?
% of annual turnover seems like decent strategy. Caps the amount company can sue mere mortal for copyright infringement while at billion dollar company scale can wipe quite a bit
But main problem is enforcement and lobbying, not the size of the fine
Why would we use a multi-billion parameter model to copy text? If we wanted the originals it would be easier to find them free, pirate or pay, if we use LLMs it is because we want something ELSE.
And caring about content rights in a world with limitless content and scarce attention is a mistake, it was never the content that was scarce in the last 20 years.
Because it is free and essy to use? The number of numbers under the hood is irrelevent.
Even though Anthropic is my daily driver I’m done respecting any sort of copyright. I’m okay paying for subscription for a service delivery but never ever again will I believe in copyright or any other utterly non-enforceable similar concept.
The verdict is a joke.
1. I feel like this should be discussed globally, there should be a public debate, a vote, and guardrails
2. It should not be in the hands of private companies, it should either be done by the government and made available to the public ; or if it’s done by private companies they should be mandated to give the training data to the government so it’s available to the public.
My point is we can decide to say it’s ok because LLMs are too important strategically. But if we do so it should benefit the public, not 5 mega corporations, training data should be considered as public infrastructure, like roads, rails, or the electricity grid. Societies are failing and this is just one more nail in the coffin.
If failure means catastrophe for the nation, it shouldn't have been a private, for-profit project in the first place and instead be a public project.
I would be really worried about the US economy then.
There used to be libgen. Then it went down. It went semi-back up but ... it is still kind of down.
Those issues kind of coincided with the big greedy mega-corporations leeching off data en masse; Anthropic was not the only one, Facebook is another example here. I always wondered whether the decline in quality, fewer liberated books published, coincided with what the big corporations were doing. Would be great to be able to see any underlying strategy here. Imagine Anthropic, just as a scenario, leeching off of everyone else, and then also sending in their lawyers to try to close down what they leeched off here. I mean the rise of bots kind of coincides with the rise of AI. So why not them also trying to make it harder for the rest of the world to access liberated books.
Who said that?
Is what an AI does similar to a human reading a book, and adding it to their knowledge? Or is it similar to a human plagiarizing a book? If it's the second, for at least some books, no, the damages are not reasonable. They are far too small.
It has been answered in a sense, because the courts (so far) have ruled that training is Fair Use. Whether this is similar to a human learning from a book was not quite the question being answered, but AFAICT there is no other relevant doctrine under Copyright law to address it, largely because the question didn't even exist until LLMs came along.
Also, these are not damages, it's a settlement i.e. a negotiated agreement between both parties.
Relevant sub-thread here: https://news.ycombinator.com/item?id=48997766
Can you ask it questions about the book and expect it to get them right? Yeah, probably. Same as if I read the book and you asked me questions about it. The LLM would probably answer those questions better than I could, and about every single book in its training data, but still same-same.
I don't think this is plaguarism.
As such, if you pirated a book and had to pay $3000 for that one instance, I don't think you'd like it if I said you should have paid $30K or $300K instead. If anything, this is analogous to the ridiculous fines people had to pay when pirating music.
(Not that I'm complaining...)
If you pirated a book for personal use the amount of liability wouldn't match a company whose profit could be attributed to pirating the same book. In US copyright law, a copyright infringer could be liable for "any profits of the infringer that are attributable to the infringement" [1] (if the copyright owner elects to recover actual damages and profits instead of statutory damages).
[1] 17 U.S.C. § 504(b), https://www.law.cornell.edu/uscode/text/17/504
Put another way, their revenues wouldn't drop much if they simply hadn't trained on those 99%.
Given the entire global economy is currently bullish on the potential profitability of AI, I dare say they got off incredibly lightly settling for just $3k per book.
If you think it should be different then you have to make a cogent argument why the public should get to interfere with a settlement the two sides mutually agree on.
Exclude one book from the training dataset.
Did you make a worse model?
We actually know the answer to this, and it is: absolutely not.
The reality is this: your intellectual output is almost always only valuable to any company in existence in aggregate, never in isolation.
In the UK, we have a thing called the Public Lending Right [1]. This pays authors a fixed sum each time their book is taken out of a library, up to a capped amount.
The cap isn't very high - about $7k - so it is both an OK bit of income for authors who might be making very little money elsewhere, and also doesn't end up all going to authors who are already bestsellers. It's a decent legal system for helping libraries hold niche titles as well as the popular ones. This is, after all, the purpose of a library.
To establish my bias here: My debut novel came out after the period this specific suit concerns. I also uploaded it to LibGen myself.
I strongly believe that books should be available to read, free of charge, to all people. I benefited enormously from libraries and piracy growing up. I think they serve an important educational purpose that does not end when a person leaves school, and I do not think wealth or disposable income is a fair way to decide the breadth of a person's education.
I also have no problem with people making new "language things" using my work. I love sample-based music (like dance music, hip hop, etc) and it'd be hypocritical for me to take issue with anyone doing analogous things using books. Maximising sales is not the end-goal of making art, for me personally. Other artists feel otherwise. They consider training on pirated books stealing. That's OK - it's not for me to tell them what to believe.
The problem for me is that these corporations - undoubtedly still pretraining on pirated material - are, essentially, leeching. By not releasing the model as open-weight, freely available, they are not acting in the same spirit of the system they took advantage of. It's the Spotify model: pirate first, pay a nominal amount that does not meaningfully harm profit later. Now the dust has settled there, we can see the harm it has done to music culture.
A single settlement which does not establish precedent does not solve anything. A tokenistic $3k allows anti-AI authors to wave a cheque in the air and declare a victory. It pays the rent for a month or two. It does nothing for the months after that, when the corporation is still profiting. It does nothing to establish precedent for future artists, who also have to pay rent.
It would be (non-trivial, but) relatively simple to integrate - for example - download figures from Anna's Archive into the PLR. I'd happily dilute my PLR payment appropriately, because I think libraries are important.
You can't stop people pirating digitally replicable things. Digital ownership is not a concept that has held, or will hold.
There are only 23,000 authors in the UK who claim the cash from the PLR. To pay all those authors the national living wage in the UK (£26k) from the PLR, you would need to raise £546 million. That is around 1/34 of Anthropic's reported annual revenue.
I'm of course not arguing Anthropic should be solely responsible. But it's very frustrating that all the pieces of the puzzle for actually paying artists in a sustainable and ongoing way now exist, and one of the major obstacles to this - and the idea of a genuinely free, legal, international library, which creates more authors, writing better books, full-time - are legacy rights holders who remain attached to a completely dysfunctional and outdated concept of ownership.
So - unless part of a sustained and reasonable campaign, which understands the futility of (and damage to the medium and its creators caused by) treating digital ownership in the same way as physical ownership - this suit is close to pointless, and arguably actively harmful in the long term.
[1] https://www.bl.uk/services/plr