technologyApr 11, 20241:06:25pending

Data Platform Innovation: Navigating Challenges and Building a Unified Experience - ML 147

About this episode

Nick Schrock is the Founder of Dagster Labs. He is also the Creator of Dagster and the Co-creator of GraphQL. They delve into the world of data engineering, software development, and ML orchestration. In today's episode, they explore the challenges and intricacies of standardizing data movement, handling data access in various systems, and migrating data across different platforms. They share insights on the importance of building a system that spans multiple data platforms, the decision-making process behind tool development, and the impact of lineage in managing and migrating data. Join them as they uncover the complexities of open-source projects, API evolution, and the future of data engineering.

Sponsors

Socials

LinkedIn: Nick Schrock

Become a supporter of this podcast: https://www.spreaker.com/podcast/adventures-in-machine-learning--6102041/support.

Get every episode summarized

Each time Adventures in Machine Learning publishes, we email you a written briefing from the transcript — the topics, who appeared, and any specific claims, with the ad reads skipped.

Email me new episodes

Free for 3 shows. No card needed.

Hosts & guests

CCharles M WoodHost

No transcript yet

This episode has not been transcribed. Request it and it moves to the front of the queue.

More episodes

Data Platform Innovation: Navigating Challenges and Building a Unified Experience - ML 147

About this episode

Get every episode summarized

Hosts & guests

More from Adventures in Machine Learning

Why Authenticity Beats Algorithms: The New Rules of Digital Marketing - ML 185

Integrating Business Needs and Technical Skills in Effective Model Serving Deplo...

Navigating Common Pitfalls in Data Science: Lessons from Pierpaolo Hipolito - ML...

Cows, Camels, and the Human Brain - ML 182