Data & Analytics

2,048 items RSS
D
Databricks Data & Analytics

AI Function tasks for jobs (Beta)

You can now add AI Function tasks to your Databricks jobs to run ai_parse_document, ai_extract, or ai_classify on the files in a volume or the rows of a table, without writing SQL. Each run processes only the inputs that are new or changed since the previous run and writes the results to a Unity Catalog table that later tasks can read. This feature is in Beta. See AI Function tasks for jobs.

F
Fivetran Data & Analytics

AI Connector Agent

The AI Connector Agent is now generally available.Read our AI Connector Agent documentation.

F
Fivetran Data & Analytics

Intercom

We have added the following new tables: COMPANY_NOTE_HISTORY CONTACT_MERGE CONVERSATION_EXTERNAL_REFERENCE CONVERSATION_MONITOR_EVALUATION CONVERSATION_SCORECARD DATA_CONNECTOR DATA_CONNECTOR_EXECUTION SIDE_CONVERSATION_PART We have added the following new columns: Table Columns ARTICLE_HISTORY ai_chatbot_availability, ai_copilot_availability, ai_sales_agent_availability, body_markdown, created_by…

G
Google BigQuery Release Notes Data & Analytics

November 03, 2026

Change In BigQuery Studio, the left pane has been updated with new tab names. The Classic Explorer tab has been renamed to the Data tab, and the Repository tab has been renamed to the Source control tab. The Data tab now includes the Add data button and focuses on data hierarchies. These changes are generally available (GA).

F
Fivetran Data & Analytics

Azure DevOps

We have made the following changes to improve incremental syncs for the COMMIT table: We now maintain a separate sync cursor for each repository, which reduces unnecessary re-fetching of historical commits. We now send the cursor to Azure DevOps in 24-hour UTC format with an explicit Z timezone designator. Previously, the cursor used a 12-hour format without a timezone, which could cause Fivetran…

F
Fivetran Data & Analytics

commercetools

We have added a new column, purchase_order_number, to the ORDERS table.

F
Fivetran Data & Analytics

TikTok Organic

We have added a new field, TikTok API rate limit tier, to the connection setup form. The field lets you match the connector's request rate to the rate limit tier TikTok has approved for your developer app (Basic, Advanced, Premium, or Ultimate), so that your syncs can run faster if your app has a higher tier.The field defaults to Basic, so existing connections continue to sync at the same rate. Se…

D
Databricks Data & Analytics

Trigger Lakeflow Jobs when upstream jobs complete (Beta)

You can now run a Lakeflow Job when one or more upstream jobs complete, including across workspaces attached to the same Unity Catalog metastore. Configure dependencies on the downstream job. See Trigger jobs when upstream jobs complete.

D
Databricks Data & Analytics

Control Lakebase sink upserts with merge strategies

When you write to Lakebase from Structured Streaming, you can use merge strategies to control how upserts update individual columns. Keep the first or last value, ignore nulls, or select values by an ordering column. Merge strategies require Databricks Runtime 19 and above. See Merge strategies for upserts.

D
Databricks Data & Analytics

Okta connector is available in Beta

The managed Okta connector is now available in Beta in Databricks Lakeflow Connect. Workspace admins can enable Lakeflow Connect for Okta on the Previews page. Use the connector to ingest identity and access data from Okta into Databricks, including users, groups, group memberships, app integrations, devices, policies, and administrator roles. The connector uses SSWS API token authentication and s…

F
Fivetran Data & Analytics

Slack

For CHANNEL_MEMBER, we now sync members from all channels to the existing table. Previously, we synced only members from channels where the app is installed.

F
Fivetran Data & Analytics

QuickBooks

We have fixed an issue that incorrectly deleted records in the TAX_RATE_DETAIL table when either the sales or purchase tax rate list associated with a tax code was empty. By default, we will re-sync the TAX_CODE and TAX_RATE_DETAIL tables to restore these records. This re-sync counts toward free Monthly Active Rows (MAR). We are gradually rolling out this enhancement to all existing connections.

F
Fivetran Data & Analytics

Managed Data Lake Service

We have deprecated the Retain All Snapshots option for the Snapshot Retention Period setting in the destination setup form. You can no longer select it for new destinations, and you can't switch an existing destination to it in the setup form or with the REST API. If your destination already uses Retain All Snapshots, you don't need to do anything. Otherwise, select another retention period.We are…

F
Fivetran Data & Analytics

Release Notes

Fivetran Connector SDK We now support deferred truncate for Connector SDK connections. Refer to deferred truncate for more details.fivetran-connector-sdk PyPI package We have released version 3.1.0 of the fivetran-connector-sdk PyPI package. This release includes the following updates: Added support for deferred truncate, which marks a table's existing rows as deleted only after the sync completes…

M
MotherDuck Release Notes Data & Analytics

Redesigned MotherDuck UI: The MotherDuck UI has a new look and feel. Home opens with an Ag

Redesigned MotherDuck UI: The MotherDuck UI has a new look and feel. Home opens with an Agent Chat prompt and a setup tile, while the updated sidebar groups Recents, Favorites, and Attached Databases. Every page also has Support chat in the top right to enable users to get help from our Support team. Introducing Agent Chat: Start an Agent Chat from the prompt box on Home and tell the agent what yo…

G
Google BigQuery Release Notes Data & Analytics

November 02, 2026

Feature You can now monitor the performance, adoption, latency, and costs of your data agents and their conversations by using Google Cloud Observability in BigQuery. This feature is generally available (GA). Feature The Data Engineering Agent now supports BigQuery AI, ML, and object functions and statements in generated Dataform SQLX pipelines and agent instruction files. This feature is generall…

F
Fivetran Data & Analytics

Modify Destination Schema Names Before the Initial Sync

The Update a Connection endpoint now accepts the destination_schema_names parameter. Previously, the endpoint ignored this parameter, so you could change the setting only in the dashboard.You can set destination_schema_names to FIVETRAN_NAMING or SOURCE_NAMING only before the connection's initial sync. After the initial sync starts, you can only send the value that's already set. Attempting to cha…

D
Databricks Data & Analytics v2.8.7

Simba JDBC Driver (Legacy) 2.8.7 is available

Simba JDBC Driver (Legacy) 2.8.7 updates jackson-core, jackson-databind, and jackson-datatype-jsr310 to 2.21.8. Download it from the JDBC drivers archive under All JDBC Driver Versions (Simba).

D
Databricks Data & Analytics

Higher limits and BROWSE support for Unity Catalog secrets

A schema can now hold up to 1,000 Unity Catalog secrets, and a metastore up to 10,000, up from 100 and 1,000. The limits apply to Databricks-managed secrets and secrets backed by AWS Secrets Manager. BROWSE on a catalog now applies to Unity Catalog secrets, so users can discover secrets and their metadata without being able to read the values or reference the secrets in code. See Privileges for Un…

D
Databricks Data & Analytics

Databricks Runtime 19: November 2, 2026

New features and improvements ALTER SHARE ADD/ALTER VIEW now accepts WITH HISTORY and WITHOUT HISTORY; existing history defaults are unchanged. Library and environment updates Updated Python libraries: pytz from 2025.2 to 2026.5 tzdata from 2026.2 to 2026.5

F
Fivetran Data & Analytics

Oracle Fusion Cloud Applications

We have added a new toggle, Disable Effective Date Filtering, to the connection setup form to support the extraction of historical data without applying any filters for an effective date. You must set the toggle to ON if you want to disable Oracle BICC effective date filtering and include records outside Oracle's default effective date range across all datastores in the connection.{% note %} This…

D
Databricks Data & Analytics

Genie Agents enhancements

Analyze files in Unity Catalog volumes (Public Preview): A Genie Agent can now analyze unstructured files stored in Unity Catalog volumes, such as PDFs, slide decks, and images, and answer with citations that point to the source page. Workspace admins can control access from the Previews page. See Analyze files in volumes with a Genie Agent.