Using own PC but GPU from Labda with SSH?

Technical Help
4

Check out the dstack open-source project. It allows you to run any LLM in any cloud (incl. Lambda) either using the CLI or Python API.

There are many examples on the website.

Disclaimer: I’m the core developer at dstack.