ABOUT THIS EPISODE
👨🏽🚀 Welcome to Episode 05 of "Tech Beats unplugged"
This time, we tried something completely crazy – we're letting the AI hosts take over! That's right 😎. We're flipping the script and giving the AI the mic to guide us through the fascinating world of local LLMs. but that's not all as this episode is actually inspired by my recent talk at Oracle Cloud World in Vegas. The topic? You guessed it: Local LLMs in the cloud.
🌟 We’re so excited to share our latest tech Beats show with you🧡!
We hope you'll enjoy it!!!
Topics discussed:
- (00:00) Introduction
- (01:00) Why OpenAI Might Not Be Your BFF?
- (02:40) Local/Open LLMs to the Rescue!
- (03:38) What's Quantization!
- (04:30) Where to find these Open LLMs?
- (05:02) Inference Engines (Ollama)!
- (05:50) What's a modelfile!
- (06:40) What about deploying local AI to the cloud?(OKE/managed kubernetes)
- (07:30) From zero to cloud deployment Hero
- (08:28) What's Next (LLM ethic benchmark)
- (09:55) Outro.
Show Notes
- My local LLM GitRepo: Ollama_lab
- Helm leaderboard for model safety: Sandford Helm model leaderboard
- My talks in Oracle cloud world 2024: OCW2024LLM
English
United States
TRANSCRIPT 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
SEARCH PAST EPISODES
Search past episodes of Tech Beats Unplugged.
OTHER EPISODES IN THIS PODCAST
👨🏽🚀 Welcome to Episode 03 of "Tech Beats unplugged"
This time, we have been incredibly honored and fortunate to host one of the most prolific speakers, storyteller, and thought leader of his generation. He was kind enough to bless us with his presence for an exclusive interview filled…
👨🏽🚀 Welcome to Episode 04 of "Tech Beats unplugged"
This time, we dared to tackle the big, yet exciting topic which is "𝐍𝐞𝐭𝐰𝐨𝐫𝐤𝐢𝐧𝐠 𝐢𝐧 𝐭𝐡𝐞 𝐜𝐥𝐨𝐮𝐝", and to help us with this challenge we summoned our expert and networking GURU "Jose Moreno" all the way from Munich Ger…
👨🏽🚀 Welcome to Episode 02 of "Tech Beats unplugged"
After part 1 where we covered the Fundamentals of Linux distributions ,The RHEL DownStream/UpStream story
,who were the Freeloaders, Redhat's shenanigans behind the whole Open Source drama.
This time , we'll explore how, the op…
👨🏽🚀 Welcome to the first Episode of "Tech Beats unplugged" Today's session is all about the thrilling "Open Source Debate - Part One." Joining us as a special guest is Erik Benner, the VP of Enterprise Transformation at Mythics .
Erik brings a wealth of experience to our disc…
Disclaimer: The podcast and artwork embedded on this page are from Cloud Dude, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.
EDIT
Thank you for helping to keep the podcast database up to date.
