from Hacker News

Enterprises are getting stuck in AI pilot hell, say Chatterbox Labs execs

by dijksterhuis on 6/9/25, 5:43 AM with 62 comments

by neepi on 6/9/25, 7:21 AM
One of my former contract outfits is there right now. Two failed projects so far, one of which impacted customers so badly that they ended up in trade press. The other one wrote off 5% of revenue with nothing to show.
No you can't solve everything with a chatbot because your CEO needs an AI proposition or he's going to look silly down the golf course with all the other CEOs that aren't talking about how theirs are failing...
by matt3210 on 6/9/25, 8:14 AM
Who in their right mind would intentionally deploy non-deterministic, unreviewable and unprovable software to critical systems?
by calebkaiser on 6/9/25, 10:15 AM
Before getting too invested in any conclusions drawn from this piece, it's important to recognize this is mostly PR from Chatterbox.
From the Chatterbox site:
> Our patented AIMI platform independently validates your AI models & data, generating quantitative AI risk metrics at scale.
The article's subtitle:
> Security, not model performance, is what's stalling adoption
by bsenftner on 6/9/25, 11:56 AM
Chatterbox's PR money is being well spent. This article squarely places them in the center of that trillion dollar revenue stream. Marketing dollars very well spent.
by sbarre on 6/9/25, 12:30 PM
AI and vibe coding lets you get that rough prototype up and running so much faster than before, and so creates that illusion of momentum and completeness more than ever.
How many people here have been subjected to that "looks good, put it in production!" directive after showing off a quick POC for something? And then you have to explain how far away from being production-ready things are, etc...
There's a reason wireframing tools intentionally use messy lines, and why most UX people know better than to put brand colours in wireframes.
by nyarlathotep_ on 6/9/25, 4:03 PM
Was on a few of these as a consultant, all major F500 companies. Most recent was a few months ago.
Every instance was some variation of RAG chat/langgraph thing. On multiple occasions, I heard "I don't see what value this has over ChatGPT", except they now had 5-6 figure cloud bills with it.
Technical users really weren't thrilled with it (i.e they wanted usable insights from their data (something best served by a db query), but ended up with LLM copypasta of internal docs) and seemed to expect significant functionality and utility on top of "regular" LLM use.
Stakeholders constantly complained (rightfully so) about issues with inaccuracy in responses, or "why is this presented in this fashion", resulting in hours of the data team folks coming up with new prompts and crossing fingers.
by bowsamic on 6/9/25, 12:56 PM
Slavoj Zizek says that the true terrifying situation is when the leaders act and know they no longer need to justify their actions. I am currently in this fight with our upper management. I ask why this push for AI, what it will do for our product, why are we making huge cuts on the scope of the project to rebrand as an AI project? All I receive is a bad confused response. Of course it’s just none of my business, they are the leaders
by kevin_thibedeau on 6/9/25, 12:38 PM
They've got to finish their blockchain deployment first. Then It'll all go smoothly.
by lofaszvanitt on 6/9/25, 12:36 PM
LLMs should be trained on CEOs and middle management and of course politicians. Society would be very grateful.
by gsky on 6/9/25, 11:52 AM
I have been using AI models to build 2 projects atm. Yes it's not perfect (30% wrong) but it solves problems so quickly and cheaply so I continue to use it going forward.
As a software engineer I want everything to be perfect but not as an entrepreneur.
by Garlef on 6/9/25, 9:05 AM
Doesn't this mean: There's room for disruption/land grab?
If the big corporations can't move fast enough and 100 startups gamble on getting there, eventually one of them will be successful.