Exploring Dark Data and AI's Influence: A Deep Dive with Data Science Expert Walter Shields

1,199 followers

July 10, 2023

In this episode, I talked to Walter Shields, an influential data science expert and passionate teacher. Walter shares his journey in the field, the rising role of Artificial Intelligence, the concept of 'Dark Data', and the evolving landscape of technology in media. His unique insights provide listeners with an enriching perspective on the current state and future direction of data, AI, and media.

Walter delved into his personal background (00:59) and the series of events that led him to immerse himself in the world of data and databases. As he found his feet in this new field, he discovered a strong passion for teaching and sharing his newly acquired knowledge, which manifested in a Meetup group (02:38). The surprising success of his Meetup group drew a large audience, affirming his belief in the widespread interest in data learning (07:29).

"Those meetups, I got to tell you, they opened my eyes and it's a critical component to really get out in that space and meet others"

He expressed his deep-seated desire to make learning about data accessible and interesting. Walter placed a strong emphasis on the qualities of a good teacher, particularly the ability to approach topics from various perspectives (14:49). As he shared his journey, he shed light on his fascination with SQL and its limitless possibilities (16:27).

Explore the transformative impact of AI and data in advertising and media as we talk with Danny Ma, Principal AI Engineer at Lumos, who shares his expertise in data science and its applications in the industry.

Get a Notification

Walter explored the profound effect of AI on the data realm starting at 17:15. He discussed the industry's evolution from traditional data analytics to more advanced data science techniques, highlighting the importance of domain expertise (20:30).

"Data science allowed us to now stop looking backward and start looking forward"

Addressing the surge in data volume and its related challenges (21:41), Walter turned to the transformative potential of AI in hiring processes (23:25). He contemplated AI's capacity to eliminate biases, thereby fostering diversity in the workplace (24:58).

• The Future in Tech Page
• Episode Newsletter/Show Notes
• Episode Guide
• YouTube Playlist
• Podcast Feed - Audio Only

The dialogue moved to the interplay of technology and media at 29:39. We reflected on how technology has revolutionized news and radio, touching on the democratization of media and the role of younger generations (31:57).

" It's not what the invention is, it's what it's being used for. Who is actually using it and for what? "

He pointed out that technology's impact goes beyond media consumption, creating opportunities for innovative content creation and distribution (34:06). Amid advancements, Walter emphasized the need for accountability and a comprehensive AI education (28:25).

Walter introduced the concept of dark data, marking a new phase in data exploration (39:13).

"It's like tapping into these sources that were just piled upon logs and so forth, unstructured data, to some extent, archived data, things like that."

With AI's continued development, he suggested that the data science field would undergo significant transformations (44:28). Beyond data, Walter discussed AI's impact on life-changing scenarios, its reach into social media, and its role in sentiment analysis (47:49). He further highlighted AI's significance in tailoring marketing campaigns and its relevancy across diverse industries (52:11).

Episode Links

• Importance of Data Scientists in AI era
• Survey: AI's Role in Company Interviews
• Public Perception and Fears about AI
• Dark Data: Next Step in Data Analytics
• Overview of Walter Shields' Courses
• AI's Precision in Detecting Lung Cancer

• 01:00: Walter Shield's Background and Journey
• 02:38: Falling into Data and Working with Databases
• 04:06: Finding Passion for Teaching and Opening a Meetup Group
• 05:22: The Value of Meetups and Making Connections
• 06:33: Acknowledging Global Audience
• 07:29: The Surprising Success of the Meetup Group
• 08:55: Passion for Simplifying Data Learning
• 09:57: The Learning and Teaching Component
• 13:48: Importance of being a good teacher
• 14:51: Approaching topics from different perspectives
• 16:29: The power and creativity of SQL
• 17:17: AI's impact on the world of data
• 18:57: Evolution of data analytics to data science
• 20:30: Leveraging domain expertise in data science
• 21:41: The increasing amount of data and its challenges
• 23:25: Integrating AI in the interview process
• 24:58: AI's role in removing biases in hiring
• 27:25: The importance of educating about AI
• 29:38: The opportunity to educate
• 30:39: Impact of technology on news and radio
• 31:57: The democratization of media
• 32:33: The younger generation's relationship with technology
• 34:06: Technology creating more opportunities
• 34:51: The future of technology and global connections
• 35:57: Balancing accountability and technological advancement
• 37:15: The evolution of editing and AI tools
• 38:09: Encouraging exploration and closing generational gaps
• 39:31: The progression of data exploration and dark data
• 43:08: Introduction to Dark Data
• 44:09: AI's Impact on Data Science
• 46:29: AI's Role in Life-Changing Scenarios
• 47:51: AI's Influence on Social Media
• 49:20: Importance of Sentiment Analysis
• 50:51: AI's Role in Tailoring Marketing Campaigns
• 53:22: AI's Relevance in Various Industries
• 54:18: Walter Shields Data Academy Overview
• 55:46: Benefits of Live Cohort Classes
• 57:07: Explore WSDA News and Skill Dojo
• 57:55: Introduction and gratitude
• 58:42: Ways to access more information about the show
• 59:43: Preview of future episode with Jack Ma