from Hacker News

The barriers to AI engineering are crumbling fast

by lewq on 11/14/24, 2:56 PM with 187 comments

• by mark_l_watson on 11/14/24, 4:44 PM

  After just spending 15 minutes trying to get something useful accomplished, anything useful at all, with latest beta Apple Intelligence with a M1 iPad Pro (16G RAM), this article appealed to me!

  I have been running the 32B parameters qwen2.5-coder model on my 32G M2 Mac and and it is a huge help with coding.

  The llama3.3-vision model does a great job processing screen shots. Small models like smollm2:latest can process a lot of text locally, very fast.

  Open source front ends like Open WebUI are improving rapidly.

  All the tools are lining up for do it yourself local AI.

  The only commercial vendor right now that I think is doing a fairly good job at an integrated AI workflow is Google. Last month I had all my email directed to my gmail account, and the Gemini Advanced web app did a really good job integrating email, calendar, and google docs. Job well done. That said, I am back to using ProtonMail and trying to build local AIs for my workflows.

  I am writing a book on the topic of local, personal, and private AIs.

• by JSDevOps on 11/14/24, 3:05 PM

  Is anyone instantly suspicious when they introduce themselves these days an "AI Developer"

• by PreInternet01 on 11/14/24, 4:31 PM

  "after years of working in DevOps, MLOps, and now GenAI"

  You truly know how to align yourself with hype cycles?

• by JohnFen on 11/14/24, 5:12 PM

  I don't want to be an "AI engineer" in the way the article means. There's nothing about that sort of job that I find interesting or exciting.

  I hope there will still be room for devs in the future.

• by croes on 11/14/24, 3:13 PM

  Is that really AI engineering or Software engineering with AI?

  If a model goes sideways how do you fix that? Could you find and fix flaws in the base model?

• by sourcepluck on 11/14/24, 4:23 PM

  I feel like I see this comment fairly often these days, but nonetheless, perhaps we need to keep making it - the AI generated image there is so poor, and so off-putting. Does anyone like them? I am turned off whenever I see someone has used one on a post, with very few exceptions.

  Is it just me? Why are people using them? I feel like objectively they look like fake garbage, but obviously that must be my subjective biases, because people keep using them.

• by hpen on 11/14/24, 3:23 PM

  Does AI engineer == API Engineer?

• by ein0p on 11/14/24, 5:11 PM

  An AI engineer with some experience today can easily pull down 700K-1M TC a year at a bigtech. They must be unaware that the "barriers are coming down fast". In reality it's a full time job to just _keep up with research_. And another full time job to try and do something meaningful with it. So yeah, you can all be AI engineers, but don't expect an easy ride.

• by lastdong on 11/14/24, 11:00 PM

  Large Language Models (LLMs) don’t fully grasp logic or mathematics, do they? They generate lines of code that appear to fit together well, which is effective for simple scripts. However, when it comes to larger or more complex languages or projects, they (in my experience) often fall short.

• by sincerecook on 11/14/24, 4:23 PM

  The only remaining question being, why would you want to?

• by amelius on 11/14/24, 3:05 PM

  Soon enough we'll have AI that is just integrated into the OS.

  So individual apps don't need to do anything to have AI.

• by fullstackchris on 11/14/24, 7:53 PM

  I still don't see how AI replaces the understanding of what a server is, what DNS is, what HTTP is, or what...

  I could go on and on.

  Copy paste is great until you literally dont know where you are copy and pasting

• by pjmlp on 11/14/24, 3:31 PM

  Assuming an Engineer degree to start with.

• by gabrieledarrigo on 11/14/24, 8:17 PM

  Just...boring.

• by cess11 on 11/14/24, 7:35 PM

  I mean, sure, anyone can cobble together Ollama and a wrapper API and an adjusted system prompt, or go serious with Bumblebee on the BEAM.

  But that's akin to web devs of old that stitched up some cruft in Perl or PHP and got their databases wiped by someone entering a SQL username. Yes, it kind of works under ideal conditions, but can you fix it when it breaks? Can you hedge against all or most relevant risks?

  Probably not. Don't put it your toys into production, and don't tell other people you're a professional at it until you know how to fix and hedge and can be transparent about it with the people giving you money.

• by taco_emoji on 11/14/24, 4:02 PM

  We can all be janitors too, so what?

• by sharemywin on 11/14/24, 3:03 PM

  looks interesting I'll have to check it out.