ABOUT THIS EPISODE
Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.
You can connect with all the people on this podcast on LinkedIn at:
- Mark Campbell https://www.linkedin.com/in/mark-campbell-76846b194/
- Dimitri Saradakis https://www.linkedin.com/in/dimitri-saridakis-32a087139/
- Rob O'Connor https://www.linkedin.com/in/robertoconnorirl/
Here are links to some of the tools referenced in the podcast:
- Red Hat OpenShift AI https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-ai
- LMStudio https://lmstudio.ai/
- Ollama https://ollama.ai/
- HuggingFace https://huggingface.co/
English
United States
TRANSCRIPT 🔗
Are you the producer of this podcast?
Add a podcast transcript
Need Audio-to-Text?
Transcribe with Listen411 in Just 60 Seconds
SEARCH PAST EPISODES
Search past episodes of The Machine: A computer science education podcast.
OTHER EPISODES IN THIS PODCAST
Two colleagues at SETU from the School of Engineering, David Alarco and Natalie Romanyatova, joined Rob in the podcast studio to discuss additive manufacturing (3D printing), how it dovetails with computing and how it's changing the way "stuff" is made. They have a new course starting bout it too. …
Don't know your q-bits from your bytes? This is the podcast for you! Quantum Computing is one of the next-gen technologies that can truly usher in a new era in computing. Quantum Communications has the potential to provide a truly secure infrastructure for communications across small or vast distan…
Hazel Farrell and Pete Windle are academics at SETU who have been playing with ChatGPT (and other AI tools) to see how they can be used in the classroom to assist teaching and learning. They both take an open approach towards the technologies, rather than shutting down conversation. They sat down w…
Red Hat are the world's largest open source software company. Senior Engineers at Red Hat - Brendan O'Farrell and Leigh Griffin - joined SETU lecturers Rob O'Connor and Amanda Freeman-Gater to chat about Red Hat Academy, an online portal that provides free resources for students of computer science…
Can we detect an excess of carbon in a field using equipment that already in place? Rob spoke with SETU academic Bernard Butler and his graduate student Thakshilla Wedage about their work in VistaMilk and using the physical properties of wireless signals to predict atmospheric conditions in a farmi…
Disclaimer: The podcast and artwork embedded on this page are from Rob O'Connor, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.
EDIT
Thank you for helping to keep the podcast database up to date.