from Hacker News

Ask HN: Best Cloud GPU Platform?

by catasaurus on 12/11/23, 12:14 AM with 7 comments

Many options exist, but I have been annoyed with how finicky some can be. All I need is a well-priced cloud GPU platform, with a good command-line utility like fly.io

Would be cool if I could just use said tool to say send a Python file, and include something like a poetry pyproject.toml to set up the environment + info about what type of server I want it to run on (GPU, etc), and just have it run the file on their servers and send the output back to the command line tool + have cloud storage that the programs can output files too (like model weights).

  • by latchkey on 12/11/23, 1:21 AM

    As someone in the process of building a bare metal GPU CSP (cloud service provider), this is interesting and I'm listening.

    Thing is though, what you're asking for is really something you can build yourself. Rent a bare metal server full of GPUs and do whatever you want.

    You're the first person I've heard ask for something like this. Most people ask for fewer APIs and want to be closer to bare metal. They want more control over things, not less.

    Can you explain what you mean by finicky?