SPRUCE it up! Open Source GreenOps at scale
GreenOps adoption is stalled by missing data from cloud providers. SPRUCE is an open-source, scalable platform built on Apache Spark that enriches cloud usage reports with open models to quantify carbon impact, build insights, and help teams reduce both emissions and cloud spend.
The Failures That Don’t Crash: MLOps for AI Agents
This talk takes four reliability patterns from distributed systems and shows what they look like inside an agent architecture. How to shadow-test an agent. Why your circuit breakers need confidence thresholds. What an eval harness looks like when your system is non-deterministic. And why human oversight degrades faster than anyone admits.
Beyond the Hype: When Apache Flink Solves Real Problems
When does Apache Flink solve real problems versus add complexity? Explore use cases where Flink becomes essential such as fraud detection, CDC, real-time analytics versus when batch or Kafka Streams suffice. Compare stream engines (Flink, Spark) with platforms (Kafka, Pulsar) to confidently decide when streaming delivers value.
Correctness Too Cheap To Meter: Formal Verification and LLMs
Formal methods are powerful tools to verify software systems’ correctness and reliability. However, manually writing system specs is time-consuming and hard to maintain. LLMs can help with this burden.
We’ll share new research into tools to automate formal methods workflows and learnings from how LLMs currently perform.
Event-driven Agents with Complex Event Processing in Flink
Event-driven Agents calling LLMs can be combined with Pattern Recognition and Anomaly Detection in Apache Flink in smart ways to increase cost efficiency, avoid hallucinations and enforce predictable, deterministic behavior. Specifically in a business process context, this architecture provides opportunities for continuous real-time process mining.
How Apache Iceberg Enables Multi-Engine Data Platforms
the session will cover operational best practices, including metadata management, file sizing, compaction strategies, and performance tuning at scale. Attendees will leave with practical guidance for designing &operating open, flexible, multi-engine data architectures built on Apache Iceberg, enabling faster analytics, lower operational flexibility
How to Tell If Your Agent Used the Right Stuff
Many so-called “agent failures” are actually context failures in disguise. In this session, we’ll explore how to tell whether your agent truly saw and used the right context, using techniques like tracing and attribution, golden datasets for context-aware evaluation, and targeted probes to test retrieval quality.
Apache Spark Declarative Pipelines in Action
Learn Spark 4.1’s brand-new Declarative Pipelines, a paradigm shift replacing imperative code with simple declarations. We’ll build a real-time data pipeline together, processing streaming ADS-B flight data from tens of thousands of aircraft overhead.
Keeping data private in real-time pipelines
Real-time data is awesome… until you realize it’s leaking names, emails, and locations. In this talk, you’ll learn how to keep streaming data private, from simple masking to tricks that beat re-identification. All with live demos and some juicy real-world stories.