In the rapidly changing data tooling landscape of 2023, organizations struggle to meet existing commitments and next-gen projects have an estimated failure rate as high as 85%. This session will explore the origin of these challenges (spoiler: outdated anti-patterns from 20th-century industry) and the adjustments you can make to solve these issues.
Their approach utilizes the Ibis, Substrait, and Arrow software stack, providing a complete solution for real-time streaming data processing, with Ibis providing high-level APIs for data processing and analysis, Substrait providing a framework for machine learning, and Apache Arrow providing a high-performance data representation for both.
Balaji Raghunathan, with over 20 years of experience, discusses how stakeholders can transition from data planning to implementation, emphasizing the importance of cloud-based architectures and microservices in modern data strategies.
Collection
[
|
...
]