A smaller Tinybird Local image
The Tinybird Local image is about a third smaller to download and uses less memory when idle.
The Tinybird Local image is about a third smaller to download and uses less memory when idle.
Streamlit nightly 1.66.2.dev20261103
You can now add AI Function tasks to your Databricks jobs to run ai_parse_document, ai_extract, or ai_classify on the files in a volume or the rows of a table, without writing SQL. Each run processes only the inputs that are new or changed since the previous run and writes the results to a Unity Catalog table that later tasks can read. This feature is in Beta. See AI Function tasks for jobs.
The AI Connector Agent is now generally available.Read our AI Connector Agent documentation.
We have added the following new tables: COMPANY_NOTE_HISTORY CONTACT_MERGE CONVERSATION_EXTERNAL_REFERENCE CONVERSATION_MONITOR_EVALUATION CONVERSATION_SCORECARD DATA_CONNECTOR DATA_CONNECTOR_EXECUTION SIDE_CONVERSATION_PART We have added the following new columns: Table Columns ARTICLE_HISTORY ai_chatbot_availability, ai_copilot_availability, ai_sales_agent_availability, body_markdown, created_by…
Change In BigQuery Studio, the left pane has been updated with new tab names. The Classic Explorer tab has been renamed to the Data tab, and the Repository tab has been renamed to the Source control tab. The Data tab now includes the Add data button and focuses on data hierarchies. These changes are generally available (GA).
Streamlit nightly 1.66.2.dev20261102
You can now run read queries on tables protected by row filters, column masks, and attribute-based access control (ABAC) policies with Lakehouse//RT. See Fine-grained access control.
We have made the following changes to improve incremental syncs for the COMMIT table: We now maintain a separate sync cursor for each repository, which reduces unnecessary re-fetching of historical commits. We now send the cursor to Azure DevOps in 24-hour UTC format with an explicit Z timezone designator. Previously, the cursor used a 12-hour format without a timezone, which could cause Fivetran…
We have added a new column, purchase_order_number, to the ORDERS table.
We have added a new field, TikTok API rate limit tier, to the connection setup form. The field lets you match the connector's request rate to the rate limit tier TikTok has approved for your developer app (Basic, Advanced, Premium, or Ultimate), so that your syncs can run faster if your app has a higher tier.The field defaults to Basic, so existing connections continue to sync at the same rate. Se…
You can now run a Lakeflow Job when one or more upstream jobs complete, including across workspaces attached to the same Unity Catalog metastore. Configure dependencies on the downstream job. See Trigger jobs when upstream jobs complete.
When you write to Lakebase from Structured Streaming, you can use merge strategies to control how upserts update individual columns. Keep the first or last value, ignore nulls, or select values by an ordering column. Merge strategies require Databricks Runtime 19 and above. See Merge strategies for upserts.
The managed Okta connector is now available in Beta in Databricks Lakeflow Connect. Workspace admins can enable Lakeflow Connect for Okta on the Previews page. Use the connector to ingest identity and access data from Okta into Databricks, including users, groups, group memberships, app integrations, devices, policies, and administrator roles. The connector uses SSWS API token authentication and s…
For CHANNEL_MEMBER, we now sync members from all channels to the existing table. Previously, we synced only members from channels where the app is installed.
We have fixed an issue that incorrectly deleted records in the TAX_RATE_DETAIL table when either the sales or purchase tax rate list associated with a tax code was empty. By default, we will re-sync the TAX_CODE and TAX_RATE_DETAIL tables to restore these records. This re-sync counts toward free Monthly Active Rows (MAR). We are gradually rolling out this enhancement to all existing connections.
We have deprecated the Retain All Snapshots option for the Snapshot Retention Period setting in the destination setup form. You can no longer select it for new destinations, and you can't switch an existing destination to it in the setup form or with the REST API. If your destination already uses Retain All Snapshots, you don't need to do anything. Otherwise, select another retention period.We are…
Fivetran Connector SDK We now support deferred truncate for Connector SDK connections. Refer to deferred truncate for more details.fivetran-connector-sdk PyPI package We have released version 3.1.0 of the fivetran-connector-sdk PyPI package. This release includes the following updates: Added support for deferred truncate, which marks a table's existing rows as deleted only after the sync completes…
Redesigned MotherDuck UI: The MotherDuck UI has a new look and feel. Home opens with an Agent Chat prompt and a setup tile, while the updated sidebar groups Recents, Favorites, and Attached Databases. Every page also has Support chat in the top right to enable users to get help from our Support team. Introducing Agent Chat: Start an Agent Chat from the prompt box on Home and tell the agent what yo…
Feature You can now monitor the performance, adoption, latency, and costs of your data agents and their conversations by using Google Cloud Observability in BigQuery. This feature is generally available (GA). Feature The Data Engineering Agent now supports BigQuery AI, ML, and object functions and statements in generated Dataform SQLX pipelines and agent instruction files. This feature is generall…
Streamlit nightly 1.66.2.dev20261101
The Update a Connection endpoint now accepts the destination_schema_names parameter. Previously, the endpoint ignored this parameter, so you could change the setting only in the dashboard.You can set destination_schema_names to FIVETRAN_NAMING or SOURCE_NAMING only before the connection's initial sync. After the initial sync starts, you can only send the value that's already set. Attempting to cha…
Simba JDBC Driver (Legacy) 2.8.7 updates jackson-core, jackson-databind, and jackson-datatype-jsr310 to 2.21.8. Download it from the JDBC drivers archive under All JDBC Driver Versions (Simba).
Ingesting into tables backed by default storage with Zerobus Ingest in Lakeflow Connect is now generally available. See Create or identify the target table.
A schema can now hold up to 1,000 Unity Catalog secrets, and a metastore up to 10,000, up from 100 and 1,000. The limits apply to Databricks-managed secrets and secrets backed by AWS Secrets Manager. BROWSE on a catalog now applies to Unity Catalog secrets, so users can discover secrets and their metadata without being able to read the values or reference the secrets in code. See Privileges for Un…
New features and improvements ALTER SHARE ADD/ALTER VIEW now accepts WITH HISTORY and WITHOUT HISTORY; existing history defaults are unchanged. Library and environment updates Updated Python libraries: pytz from 2025.2 to 2026.5 tzdata from 2026.2 to 2026.5
We have added a new toggle, Disable Effective Date Filtering, to the connection setup form to support the extraction of historical data without applying any filters for an effective date. You must set the toggle to ON if you want to disable Oracle BICC effective date filtering and include records outside Oracle's default effective date range across all datastores in the connection.{% note %} This…
Analyze files in Unity Catalog volumes (Public Preview): A Genie Agent can now analyze unstructured files stored in Unity Catalog volumes, such as PDFs, slide decks, and images, and answer with citations that point to the source page. Workspace admins can control access from the Previews page. See Analyze files in volumes with a Genie Agent.
Streamlit nightly 1.66.2.dev20261031
Beginning November 1, 2026, Unity Gateway budgets include spend from task-specific AI Functions such as ai_parse_document, ai_extract, and ai_classify across batch and real-time execution paths. See Manage budgets for Unity Gateway.