by jbcranshaw on 1/18/23, 8:14 PM with 100 comments
by impalallama on 1/18/23, 9:57 PM
The funny thing is I had tried just pasting in code and saying "find the bug" and it wasn't helpful at all, but when I posted in a portion and asked it to explain what the code was doing I was able to work backwards and solve the issue.
Its nice anecdote where the AI felt additive instead of existentially destructive which has been a overbearing anxiety for me this last month.
by mlfia on 1/18/23, 11:15 PM
Iterate a few more versions from here, so that the models are stronger at producing the correct structured data, and the impact on every office job will be profound.
I.e. instead of training a generative model on text from the internet, train it on every single excel file, sql database, word document and email your company stores. Then query this model asking it to generate Report X showing Y and Z.
When you step back and consider it, 99% of office jobs are about producing structured data from unstructured data sources. The implications of this are being hugely underestimated.
by smoldesu on 1/18/23, 9:20 PM
I largely agree with this article, but I feel like you have to be careful with these general predictions. Many technologies have purported themselves to be this "business lubricant" tech (ever since the spreadsheet), but the actual number of novel spreadsheet applications remains small. It feels like the same can be said for generative AI, too. Almost every day I feel the need to explain that "generation" and "abstract thought" are distinct concepts, because conflating the two leads to so much misconception around AI. Stable Diffusion has no concept of artistic significance, just art. Similarly, ChatGPT can only predict what happens next, which doesn't bestow it heuristic thought. Our collective awe-struck-ness has left us vulnerable to the fact that AI generation is, generally speaking, hollow and indirect.
AI will certainly change the future, and along with it the future of work, but we've all heard idyllic interpretations of benign tech before. Framing the topic around content rather than capability is a good start, but you easily get lost in the weeds again when you start claiming it will change everything.
by d_burfoot on 1/18/23, 9:35 PM
They key to the power of GPT3 is that it has billions of parameters, AND those parameters are well-justified because it was trained on billions of documents. So the term should be something like "gigaparam AI" or something like that. Maybe GIGAI as a parallel to GOFAI. If you could somehow build a gigaparam discrimative model, you would get better performance on the task it was trained on than GPT3.
by hooande on 1/18/23, 11:42 PM
I do not think that the world is changing because of large language models. That seems to be a controversial opinion so I won't get into it here. But these are powerful new tools, no question. The way I work has changed and I'm very glad to have ChatGPT.
I do believe that in the coming years knowing how to use ChatGPT or similar products will be as important as knowing how to use Google is now. People that know how to leverage LLMs going forward will simply have an advantage over those who don't. It won't be long before it isn't optional for executives and knowledge workers. This will be a big change for many people. But we adapted to Google in the early 2000s and people will adapt to this as well.
by ChildOfChaos on 1/19/23, 12:02 AM
by zabzonk on 1/18/23, 9:19 PM
or wildly inaccurate, particularly in fields such as programming
by RyanShook on 1/18/23, 10:46 PM
by 29athrowaway on 1/18/23, 9:48 PM
by k__ on 1/18/23, 9:58 PM
I wouldn't let it write a whole article, but it can really save time at research. Just needs a bit of fact checking in the end.
by commitpizza on 1/18/23, 10:38 PM
I mean, it does give good completions sometimes but the time saved isn't that great imho. Maybe chatgpt is better but it feels like AI still have some way to go to actually be so useful you would be less sucessful without it.
by d4rkp4ttern on 1/19/23, 12:35 PM
Maybe something like this exists? Please no DEVONThink suggestions :)
by revskill on 1/18/23, 11:48 PM
by kylehotchkiss on 1/18/23, 11:18 PM
by devinprater on 1/19/23, 7:24 AM
by a13o on 1/18/23, 10:56 PM
Trained AIs are in something like the early digital streaming days where there was only one provider in town, so that provider aggregated All The Content. Over the next decade we would see the content owners claw their content back from Netflix, and onto competitor platforms -- which takes us to where we are today. Netflix's third party content has dwindled and forced them to focus on creating their own first party content which can not be clawed away.
When these generative AIs start to produce income, it will be at the expense of the artists whose art was in the training dataset nonconsensually. This triggers the same content clawback we saw in digital streaming. Training datasets will be heavily scrutinized and monetized because the algorithms powering generative AIs aren't actually carrying much water. What is DALL-E without its dataset? Content is King.