Data Engineering
Databricks Runtime Introduces NEAREST BY: Native SQL Vector Search at Scale
Databricks brings batch vector search into SQL with NEAREST BY, a fused Photon GEMM operator and IVF indexes stored in liquid-clustered Delta tables, reducing the need for separate vector-serving infrastructure in large-scale analytical workloads.