How to Set Up Llama Agentic System with Llama 3.1 8B in Ollama
The llama agentic system allows you to use Meta’s llama stack to build apps with agentic workflow. They’ve continued to refine the repo in the last few weeks. I’ll walk you through setting it up on your own computer with what is available today.
My personal computer isn’t good enough for this demo so I set it up on AWS EC2 compute running a marketplace machine image (Galaxys Deep Learning Base GPU AMI (Ubuntu 20.04)) using a g4dn.xlarge machine with 4 CPUs and 1 GPU.
Not a Medium member? Click here to read the full story for free.
Get API Keys
I’m only going to be testing with brave search in the example. But if you get the hang of this and you can integrate your own tools, then you’ll need more API keys for your work.
Brave Search
I will need a Brave Search API key to run some of the example workflows in the repo. Go to https://brave.com/search/api/ , create an account and set up a free subscription. They will require a credit card even for the free subscription. Grab your API key once set up is complete.
