from Hacker News

Stackoverflow is investing into baking GenAI

by rounakdatta on 6/20/23, 2:41 PM with 103 comments

• by ryandrake on 6/20/23, 3:51 PM

  I feel like GenAI has become the next "blockchain". Wall Street (or someone else!) is setting some weird expectation for every company to somehow say "we're doing something with GenAI." Doesn't matter what it is they're doing with it, they just have to say the magic word in a press release or blog post.

  Apparently, "we're using AI" is a better story than "we're making great products, regardless of the underlying tech."

• by fabian2k on 6/20/23, 4:35 PM

  Take a look at the answers on this post if you want to know how their most recent genAI experiment went:

  https://meta.stackoverflow.com/questions/425162/we-are-seeki...

  In short, it was a complete disaster. They create a tool to provide formatting suggestions on your new questions by piping the entire question into ChatGPT (or one of the comparable services). The internal prompt was figured out within minutes. And there are plenty of examples of this tool messing up questions entirely. And even when it doesn't destroy the questions, it still edits far too much minor and irrelevant stuff.

  I don't understand how this experiment could make it this far, they actually put it into a live test on the site. So a part of the new users asking questions got this tool in this broken state. And the way this failed was entirely predictable when you just pipe content into genAI.

• by weinzierl on 6/20/23, 5:22 PM

  Can someone ELI5 for me what GenAI is? I've never heard of them and their website is just the usual content-free buzzword salad:

  artificial intelligence - what else, sigh!

  transformative - you bet

  business AND consumer - so basically everyone, why tell at all?

  various industries - everyone again

  pioneering - yeah, what else

  vertically integrated - sure, I was just waiting for that

  AI solution - oh, who would have thought?

  AI-powered!- you are saying!

  I've literally not even finished the second sentence on the page and this rambling abomination goes on and on and on...

  EDIT

  For reference the first two sentences:

  "GenAI, our mission is to harness the power of artificial intelligence to create transformative tools that benefit businesses and consumers across various industries. GenAI is a pioneering artificial intelligence company focused on developing a vertically integrated AI solutions business through its proprietary MAI Cloud™ database, with the development and commercialization of AI-powered tools and solutions for businesses and consumers across multiple industries."

  EDIT

  After reading other comments I think GenAI is a generic term (like blockchain) referring to Generative AI. In my defense the OP is not enlightening in this regard at all, so I just googled the term and the company website of genai-solutions.com was the first result. Nothing in the OP says that Stackoverflow is working with this specific company, however, that was just my (likely erroneous) assumption.

• by OldManRyan on 6/20/23, 3:47 PM

  Me: Hey AI how do I do this using X?

  AI: Why would you ever want to do that using X? You should do Y.

  Me: Well I need to do it using X because of these reasons.

  AI: ...That's dumb. You should just do Y.

• by ulrikhansen54 on 6/20/23, 3:47 PM

  Their traffic is rumoured to be down 25-30% after ChatGPT was released, so good to see that they are doing something to keep the community alive in the new era of GenAI.

• by NobodyNada on 6/20/23, 3:55 PM

  They tried A/B testing the “question formatting assistant” on the production site a few days ago. The results were…not great, and they had to quickly shut off the experiment: https://meta.stackoverflow.com/questions/425162/we-are-seeki...

• by madsbuch on 6/20/23, 3:30 PM

  As writing, all comments seems to be quite negative. I think this is awesome and definitely something that can unlock a lot for me.

  I problem I often encounter when using stack overflow is that questions are answered ina a very narrow way that doesn't really fit me. So I need to bounce between 3-4 answers that are related to get the right solution.

  I would guess this solution could do this for me, provided that I provide anough context is my problem prompt.

• by supriyo-biswas on 6/20/23, 3:29 PM

  SO could go on all in using the 100k context length of Anthropic Claude, feed in the documentation of a library or product, and have it generate questions and answers, and post them on Stack Overflow to fake activity now that everyone I know participates on it in a read-only fashion.

• by nomilk on 6/20/23, 3:31 PM

  The projects listed [1] seem a bit mundane at first, but I prefer that to the opposite, where companies shoehorn GPT into places where it just irritates users.

  [1] Title generation, Formatting assistant, Sentiment analysis, Identifying duplicate questions

• by csjh on 6/20/23, 3:25 PM

  Duplicate question closing will now be instant if your question has an embedding that's remotely close to another question

• by rounakdatta on 6/20/23, 4:11 PM

  Just like wealth redistribution and inequality, I'm seeing this migration of "programming discussion" moving from open forums like SO to closed systems (guarded silos of GH Copilot, ChatGPT, Phind and others). We are preferring to ask the nitpicks in their chatbox instead of as a public comment on Stackoverflow.

• by stabbles on 6/20/23, 3:38 PM

  In a way SO is the perfect platform for human feedback in reinforcement learning

• by symbolicAGI on 6/20/23, 2:46 PM

  The Stackoverflow research initiatives per generative AI are very good examples of what some enterprises can do to improve user-input text context on websites and applications.

  1. Adapt user text to a standard format. 2. Correct spelling and grammar mistakes. 3. Detect inconsistencies during the input process.

• by theptip on 6/20/23, 5:37 PM

  Embedding search in a chat UI over all the SO content (with valid citations) would be the obvious feature I’d build if I were them.

  “Me: How do I do X? SO: here are a few highly voted answers … Me: not quite, what if to foobar is like this? SO: In that case this is probably the answer: … Me: Upvote answer (giving RLHF to the system to help with future training)”

  ChatGPT is great at answering code questions but if you are on SO you want to engage with the community, upvote the answer, or comment etc.

• by malfist on 6/20/23, 3:23 PM

  Whatever happened with the moderator strike over the AI? This seems like a great way to cheapen the brand.

• by lopkeny12ko on 6/20/23, 3:56 PM

  Is this why ChatGPT answers are banned on SO? Because it would compete with their own upcoming business?

• by skilled on 6/20/23, 3:12 PM

  And before long it's going to be, "Let AI write an answer to a question and you only need to edit it!".