I did a cursory search on this, and couldn’t find anything, however, is there or could there be an llm trained only on text or data which is in the public domain or is otherwise openly licensed?
I did a cursory search on this, and couldn’t find anything, however, is there or could there be an llm trained only on text or data which is in the public domain or is otherwise openly licensed?
Yes, but while you would vet it by “what complies with laws”, large companies use the “what can we getaway with” metric. And if the only penalty is a fine, they will just consider that cost of doing business, and do it anyway.
True, but as per the anthropic settlement linked in another comment, the penalties are pretty significant. 1.5B is a pretty reasonable fine against a 59B profit. Copyright still has some pretty significant teeth.
Its not like its antitrust law /j
How is a single digit percentage of profit a penalty?
It would need to be >100% to dissuade imho
It could always be higher, but what percentage would you actually be happy with? Most civil fines are well under a percent, they are definitely a penalty.
The way I look at it, nvidias nemotron division isnt bring in anything close to $1.5B by itself. If they get hit with $1.5B fine for copyright infringement, the nemotron division takes a huge loss, which the rest of the company has to pick up the tab for. That isn’t going to make investors happy, and they would be out for blood. It would impact earns and may cause actual damage to their valuation. (Whether its enough is unknown, the market makes no fucking sense at the best of times). If I lost 1% of my companies profit I’d lose my job. Its enough of a deterrent that the people involved should be paying attention.
On the other hand, Anthropic is playing with magical funny money, so $1.5B really doesnt matter at all to them. And they don’t answer to investors, because they think they’re build god…
For a business, something costing them a single digit percentage of profit is just the cost of doing business.
They should lose double digit or more profits as a company plus individuals, starting at the top, should be penalized financially and/or with jail time depending on the offense. Yes, I mean mean some penalties should eat into future profits as well.