The OpenAI connector is now available in Lakeflow Connect in Beta. Workspace admins can control access to this feature from the Previews page. The connector uses the OpenAI Organization Admin API to ingest organization administration data, such as users, projects, API keys, usage, costs, and audit logs, from OpenAI into Databricks. Authentication uses an OpenAI Admin API key. See OpenAI connector.
The web terminal in notebooks connected to serverless GPU compute (AI Runtime) is now in Public Preview. Use it to run shell commands, monitor GPU usage with nvidia-smi, install libraries, and manage files directly on the compute. This requires serverless GPU environment version 5 or above. See Run shell commands in Databricks web terminal.
Chat sharing (GA): Sharing an individual Genie Agent conversation is now generally available. See Share a conversation. Download visualizations on Private Link (Beta): You can now download visualization results through the Genie Conversation API on Private Link workspaces in supported regions. See Retrieve visualization results (Beta). File upload fix: Fixed a bug where the option to upload CSV an…
Dashboard relationships from imported BI files: When you import a Power BI or Tableau file with Genie Code, migration tooling now creates dashboard relationships where it detects them in the source file. See Import BI files using Genie Code. Customize date picker quick-select options with Genie Code: You can now ask Genie Code for dashboard authoring to customize the quick-select options in a date…
Run a scheduled task on demand: When you author a scheduled task, you can now select Run now to run it immediately. See Scheduled tasks. Rename a conversation: You can now rename a conversation by clicking its title in the chat header and editing it inline. Enter a workspace URL when signing in to the Genie mobile app: You can now enter your workspace URL manually when you sign in to the Genie mob…
Automatic upgrades begin rolling out row tracking and Checkpoint V2 to existing Unity Catalog managed tables, not just new tables. This rollout is gradual, so these features will be available to different customers at different times. Automatic upgrades turn on a feature only after the observation window verifies that every client accessing a table supports it. To track which features are availabl…
Registering Python user-defined table functions (UDTFs) in Unity Catalog is now generally available in Databricks Runtime 18. A Unity Catalog Python UDTF is a governed function that returns a table, invoked in the FROM clause of a SQL statement to return multiple rows and columns. Unity Catalog Python UDTFs run on serverless compute, classic compute with standard access mode, and SQL warehouses. S…
You can now write and run Python unit tests for your Spark Declarative Pipelines on Lakeflow transformation logic directly in the Lakeflow Pipelines Editor. Validate Python and SQL transformations against mock data using catalog-table redirection, including Auto CDC, streaming tables, expectations, and append flows. Test edge cases and iterate using mock inputs for supported table-identifier opera…
Dedicated group clusters will be available by default for workspaces with the compliance security profile enabled in September 2026. You can assign a compute resource to a group using the Dedicated access mode, letting group members share compute while securely running languages and workloads not supported by standard access mode, such as Databricks Runtime for ML, RDD APIs, and R. When a user con…
Lakebase adds AI-assisted troubleshooting: database issues and early warnings are surfaced to you with Insights, and you can then investigate and fix them conversationally with Genie. Both draw on database telemetry captured to Unity Catalog. See AI-assisted troubleshooting.
New maintenance updates are available for supported Databricks Runtime versions. These updates include bug fixes, security patches, and performance improvements. For details, see: Databricks Runtime 18 LTS Databricks Runtime 18.2 Databricks Runtime 18.1 Databricks Runtime 17.3 LTS Databricks Runtime 16.4 LTS Databricks Runtime 15.4 LTS Databricks Runtime 14.3 LTS Databricks Runtime 13.3 LTS
The system.tags.governed_tags system table is in Beta. This table contains a record for each governed tag key in your account, including customer-created and system-generated tags. Use it to programmatically determine which tags in your account are governed. See Governed tags system table reference.
The Lakeflow Designer Summer Release adds new operators, expands the Output and Join operators, and improves the canvas editing experience. The following updates are now available: Prepare operator: Use the new Prepare operator for common data-cleansing tasks, including changing text case and data types, replacing values, and applying formulas. See Prepare. Enter Data operator: Manually create tab…
Lakebase now surfaces database issues and early warnings with Insights, and lets you investigate and fix them conversationally with Genie, using telemetry captured to Unity Catalog. See AI-assisted troubleshooting.
Databricks Model Serving now supports Anthropic Claude Opus 5 as a Databricks-hosted model. To access this model, use: Foundation Model APIs pay-per-token Query reasoning models Query vision models
Git CLI commands in Git folders are now in Public Preview. Git folders that you create from the UI automatically get Git CLI access when your workspace is eligible, so you can run standard Git commands such as git stash, interactive rebase, pre-commit hooks, Git submodules, and Large File Storage (LFS) directly from a Databricks terminal. Workspace admins can control access to this feature from th…
Beginning September 2026, public S3 links for downloading the Simba JDBC Driver (Legacy) will be disabled. After this date, scripts or processes that use direct public links to download the driver will no longer function. In addition, downloading from the JDBC archive page will require signing in to Databricks. To continue using automated downloads, migrate to the Databricks JDBC Driver before Sep…
A C++ SDK for the Zerobus Ingest connector in Lakeflow Connect is now available in Beta. The SDK provides a high-throughput gRPC client for ingesting records directly into Unity Catalog Delta tables, with support for JSON and Protocol Buffers. See Use the Zerobus Ingest connector.
Databricks Runtime 19 is now generally available (GA). For lifecycle details, see Databricks Runtime support lifecycles. Behavioral changes Arrow-optimized Python UDFs enabled by default: Regular Python UDFs now use Arrow-based serialization by default. This can change type-coercion behavior for some UDFs compared to previous releases. To restore the previous behavior, set spark.databricks.executi…
You can now schedule Genie Code to run a prompt on a recurring schedule. Each run executes your prompt as a full Genie Code session and produces a continuable Genie chat with the results, so you can turn recurring analysis into an unattended background task. Create a scheduled task by asking Genie Code in chat or by filling in the create form manually. For more information, see Genie Code schedule…
With the general availability of Databricks Runtime 19, Databricks Runtime 18 and Databricks Runtime 18 for Machine Learning have transitioned to long-term support (LTS). LTS versions receive three years of stability and security fixes. For release notes, see Databricks Runtime 18 LTS and Databricks Runtime 18 LTS for Machine Learning. For lifecycle details, see Databricks Runtime support lifecycl…
Databricks Runtime 19 and Databricks Runtime 19 for Machine Learning are now generally available (GA), powered by Apache Spark 4.2.0. For release notes, see Databricks Runtime 19 and Databricks Runtime 19 for Machine Learning.
Higher character limit for uploaded PDFs: The maximum number of characters per uploaded PDF has been raised from 4,000 to 15,000. See PDF files. Agent mode APIs (Beta): Agent mode APIs for Genie Agents are now available in Beta. See Agent mode APIs in Genie Agents. Analyze files in Unity Catalog volumes (Beta): A Genie Agent can now analyze files stored in Unity Catalog volumes, such as PDFs, slid…
Import BI files (Public Preview): Importing Power BI and Tableau reports as AI/BI dashboards with Genie Code is in Public Preview. See Import BI files using Genie Code. Image widget: You can now add a dedicated image widget to a dashboard. See Image widgets. Multi-select filter improvements: Multi-select filter improvements: Multi-select filter stays open: Multi-select filter drop-downs now stay o…
Lakeflow Designer now supports all compliance security profile standards supported by Databricks and is available by default for workspaces with the compliance security profile enabled. For a full list of supported compliance standards, see Compliance security profile. See Lakeflow Designer.
You can now create an S3 external location using automated setup, the recommended method for connecting an S3 bucket to Databricks. Automated setup uses AWS IAM temporary delegation to configure your external location and provision all required resources, including the IAM role, storage credential, and external location. It also provides built-in approval workflows for users who need AWS admin aut…
Priority pay-per-token, also referred to as priority mode, for Foundation Model APIs pay-per-token is generally available for partner models. Priority mode is for latency-sensitive, real-time applications that need more consistent availability under load. See Priority pay-per-token for Foundation Model APIs for model availability.
Governance Hub is in Beta. Governance Hub is a centralized, account-level UI in the account console for monitoring governance across your Databricks account. It provides a unified view of data health and coverage, AI usage and spend, and cost drivers, with prioritized insights and recommendations. All views respect existing permissions. Account admins can enable Governance Hub from the account con…
Role-based access control (RBAC) is now in Public Preview. RBAC lets users assume a role in Databricks using only that role's permissions for the duration of the session instead of their own accumulated permissions. This enables exclusive access. Users must actively assume a role to reach sensitive data, which prevents them from accessing it as their own identity and from mixing data across use ca…
Variant is now generally available. Variant is a flexible data type for semi-structured data that delivers structured-like query performance through Variant shredding, which is also generally available. Use Variant to ingest semi-structured data from streaming sources (Kinesis, Event Hub), REST APIs, and schemaless databases, while maintaining high-performance query access. Starting with Databrick…