AI Dynamics

Global AI News Aggregator

About

State Rebalancing Reduces Streaming Latency in Databricks

The goal: lower latency How we’re doing it: state rebalancing for Structured Streaming Available on DBR 11.1+, state rebalancing allows for increased cluster utilization and reduces overall micro-batch latency. See how https://
dbricks.co/3SNatxX

→ View original post on X — @databricks