# Data Pipeline

人気のポッドキャストエピソード
更新しました:

DOP 333: The Hidden Problems Behind Every Data Pipeline

#333: Pete Hunt, CEO of Dagster and early React team member, explores the evolution from Facebook's early React development through trust and safety infrastructure at Twitter, to building modern data orchestration tools. The conversation reveals how similar infrastructure problems plague every indu…

Data Pipeline Testing: The 3 Levels Most Teams Miss

This story was originally published on HackerNoon at: https://hackernoon.com/data-pipeline-testing-the-3-levels-most-teams-miss. Dashboards don’t represent actual state, models degrade unnoticed, and incidents show up as “weird numbers” instead of errors. Check more storie…

Enterprise Data Pipeline Revolution: Suresh Palli's Metadata-Driven Automation Success

This story was originally published on HackerNoon at: https://hackernoon.com/enterprise-data-pipeline-revolution-suresh-pallis-metadata-driven-automation-success. Suresh Palli revolutionized enterprise data pipelines with metadata-driven automation, cutting dev time 40% and boosting sc…

175: Leveraging Alteryx in your Data Pipeline – Revisit

To kick off the New Year, we wanted to re-visit our most popular episode of 2024! In this revisit episode of Alter Everything, we talked to Wayne McClure, a senior solutions architect at Nielsen, about using Alteryx strategically within a tech stack. We discussed the comprehensive benefits of Alter…

164: I built an entire data pipeline in 30 minutes using only AI (no code required)

Try Keboola 👉 https://www.keboola.com/mcp?utm_campaign=FY25_Q2_RoW_Marketing_Events_Webinar_Keboola_MCP_Server_Launch_June&utm_source=Youtube&utm_medium=Avery Today, we'll create an entire data pipeline from scratch without writing a single line of code! Using Keboola MCP server and ClaudeAI, we’ll…

Perspectives on the AI Data Pipeline with Solidigm - Six Five Webcast: Infrastructure Matters

On this episode of the Six Five Webcast - Infrastructure Matters, host Camberley Bates is joined by Solidigm's Rita Wouhaybi, Ph.D., AI Fellow for Solidigm, for a conversation on the intricacies and future directions of AI data pipelines. Their  discussion covers: The evolution and current st…

Seamlessly Migrate Your On-Premise Data Pipeline to Azure with These Key Steps

This story was originally published on HackerNoon at: https://hackernoon.com/seamlessly-migrate-your-on-premise-data-pipeline-to-azure-with-these-key-steps. Scaling AI/ML Data Needs: Migrating On-Premise Data Engineering Workloads to Azure Cloud Check more stories related …

153: Leveraging Alteryx in your Data Pipeline

Are you leveraging the full power of your current tech stack? Allow us to put your worries to rest as we are joined by Nielsen Senior Solutions Architect, Wayne McClure. From using Alteryx as a tool in orchestration to best practices for complex deployments, Wayne shares his knowledge with us about…

How Jacopo Tagliabue is Cutting Data Pipeline Latency with Fast Functions

What if your data pipeline could run 10x faster without the overhead? Jacopo Tagliabue, CTO of Bauplan and NYU adjunct professor, is pushing the boundaries of data infrastructure with lightweight DAGs, Apache Arrow, and a radically different take on functions as a service. In this episode, he break…

🏇🏽 AI Data Pipeline Race: Snowflake, Databricks, Cosmos DB

The source is an in-depth investigation from datapro.news, dated September 17, 2025, concerning the fierce competition among Snowflake, Databricks, and Microsoft Cosmos DB to dominate the market for AI-powered data pipelines. The article outlines three distinct philosophical approaches: Snowflake’s…