From the course: Responsible Generative AI and Local LLMs

Unlock this course with a free trial

Join today to access over 23,300 courses taught by industry experts.

Exploring remote development on AWS

Exploring remote development on AWS

From the course: Responsible Generative AI and Local LLMs

Start my 1-month free trial Buy for my team

Exploring remote development on AWS

"

- [Instructor] Let's take a look at a Rust and Hugging Face Candle asynchronous development workflow. How would that look? First up, you have an EC2 G5 instance here. What's great about that is it has the power to do modern GPU inference and you can actually use spot instances as well to save money. But in development, what you can do is actually use an instance you stop and start, and you can connect to that instance via Visual Studio Code Remote, which is a great way to develop. Really just install the plugin, you're ready to go, and your laptop can have access to that. So what it means is that you can start developing code into a cloud-based environment that's very powerful and you can use it and pay for what you use versus buying, let's say a $40,000 GPU. Now, in terms of production, here's where things get interesting. You could also be co-developing with EFS. So the mount point could sit onto your development box, but that same mount point could also be used for production. You…

Inhalt