Moreover, Databricks Assistant can ease related tasks such as optimizing an existing Python script a company’s data scientists use for analytics projects.

The new product, which lowers the bar for workers to access the data on top of these custom AI models, represents another step in Databricks’ quest to carve out a niche in the fast-moving AI arena.

Inference stage: ADF invokes Databricks notebooks through the REST API, passing parameters like script paths and data locations. Databricks auto-scaling clusters optimize performance for large jobs.

Through this new integration with Databricks, Immuta abstracts and orchestrates the complexities of managing data security so that joint customers can focus on getting value from their data faster.