Stack Overflow signed a deal with OpenAI, announced Monday. Two things to think about: 1. Contributors aren't getting compensated for the value of their contributions. I'm not making a moral or legal point, just a practical one. It kinda sucks creating other people's value for free when they flaunt it. At least with open source generally, you're sorta insulated from the monetization by anonymity of reuse. At the same time, any community that doesn't ban you is always going to be a cool hang if you're a halfway interesting contributor or person. 2. People worry about LLM generated content feeding the LLMs and making the LLMs regress. Don't worry about that. It won't happen. There is a different problem. LLM makers won't let their LLMs regress on metrics that matter (no matter how bullshitty the metrics). They will have to spend more time and money filtering their training data sets as they become less human and more generated. That actually sounds like an activity OpenAI can saddle SO with. "We'll pay you for ongoing use of your data so long as your data improves." The fun part is that it will take time and GPU money in "pre-training" to prove that iterations are improving. In short, LLMs won't regress. They will get more expensive. Qualified training data will cost more. This is a critical business insight in this space, and is probably very different than whatever narrative you've bought into. If you need this kind of insight across your business, I am available to help you, from consultant and projects to full time. Message me. H/T Axel C., who is really good at LinkedIn and will probably end up monetized without compensation if he isn't already. #WrittenByMe
Brad Hutchings first off, you're too kind and I genuinely appreciate it, I'm just learning from others who actually know what they are doing 🙌 This SO situation has parallels with Reddit, where unlike in the case of FT where journalists are paid a wage to produce quality articles; ascribing value to posts, let alone helping contributors to get paid, don't appear to be at the top of the agenda. What will be the long term implications for such platforms that are striking deals today? Will users gladly keep contributing?
So, #openai needed quality code answers to feed their data models. And they went for #stackoverflow. I am impressed.
This continued process of mining user data is going to make it harder and harder for many people to trust online platforms unless their AI training policy is clear
The next GitHubcopilotlitigation.com waiting to happen I guess
When the APP is free YOU are the product !
Proactive Solutionist, On a Quest for Knowledge | Technology | Innovation | Security | Robotics | IoT | Optics | CGI | Sci-Fi | Video-Games | 3D-Animation | Quanta | Gravity |
10moThis will likely shut down SO altogether, which is a shame for its userbase. Most users will likely shift to gpt or copilot rather than directly from the horse, which will have a devastating impact on its usefulness moving forward. This will dry up user contributions, leaving only mangled answers from the future's past. Reddit never had any value to me, and it bummed me out just to see it in any search results.