---
title: "Apache Spark by Databricks | AIDeveloper44"
url: https://aideveloper44.com/product/apache-spark-6af2514100b52922e16de992
description: "Apache Spark 4.3 brings stateful streaming with millisecond-scale latency, history-preserving Auto CDC, and faster data and AI development."
lang: en
---

← all releases (https://aideveloper44.com/releases)

Databricks · Nov 9, 2026 · v4.3 · open source

# Apache Spark

Apache Spark 4.3 is a major update to the open-source unified analytics engine, now available in Databricks Runtime 19. It introduces stateful processing in Real-Time Mode for sub-150ms latency, history-preserving SCD Type 2 support for Auto CDC, and Project Feather for optimized small-data performance.

Apache Spark Data Engineering Real-time Streaming Open Source

visit website: https://spark.apache.org/

docs ↗: https://spark.apache.org/docs/latest/
github ↗: https://github.com/apache/spark

overview

key features

- 01 Stateful Real-Time Mode with sub-150ms P99 latency
- 02 SCD Type 2 support in Auto CDC for automated history tracking
- 03 Project Feather for reduced execution overhead on small datasets
- 04 Expanded Spark Connect observability and JDBC integration
- 05 New SQL features including VARIANT transformations and JSON_TABLE

related products browse all → (https://aideveloper44.com/releases)

Pinneaple open source Pinneaple is an open-source Physics AI toolkit designed for Physics-Informed Neural Networks (PINNs), scientific machine learning, geometry processing, solvers, and reproducible training pipelines. It aims to provide a comprehensive suite for researchers and practitioners in the field of computational physics.: https://aideveloper44.com/product/pinneaple-697d306ee24deaba7e414d22

## Structured data

```json
[
  {
    "@context": "https://schema.org",
    "@type": [
      "WebSite",
      "NewsArticle"
    ],
    "name": "AIDeveloper44",
    "url": "https://aideveloper44.com",
    "isAccessibleForFree": true,
    "isPartOf": {
      "productID": "CAowsfXgCw:openaccess",
      "@type": [
        "Product"
      ]
    }
  },
  {
    "@context": "https://schema.org",
    "@type": "Organization",
    "name": "AIDeveloper44",
    "url": "https://aideveloper44.com",
    "logo": "https://qtrypzzcjebvfcihiynt.supabase.co/storage/v1/object/public/base44-prod/public/696b2bd107af20deac4cc200/9f77c0b91_a-digital-illustration-of-a-white-llama-_j4dyH5xoRnKf_3rtw-mvEQ_OdqL2BrSTtKHjJAuhTp_zg.png"
  },
  {
    "@context": "https://schema.org",
    "@type": "BreadcrumbList",
    "itemListElement": [
      {
        "@type": "ListItem",
        "position": 1,
        "name": "Home",
        "item": "https://aideveloper44.com/"
      },
      {
        "@type": "ListItem",
        "position": 2,
        "name": "product",
        "item": "https://aideveloper44.com/product"
      },
      {
        "@type": "ListItem",
        "position": 3,
        "name": "Product Detail",
        "item": "https://aideveloper44.com/product/apache-spark-6af2514100b52922e16de992"
      }
    ]
  },
  {
    "@context": "https://schema.org",
    "@type": "SoftwareApplication",
    "name": "Apache Spark",
    "description": "Apache Spark 4.3 is a major update to the open-source unified analytics engine, now available in Databricks Runtime 19. It introduces stateful processing in Real-Time Mode for sub-150ms latency, history-preserving SCD Type 2 support for Auto CDC, and Project Feather for optimized small-data performance.",
    "provider": {
      "@type": "Organization",
      "name": "Databricks"
    },
    "offers": {
      "@type": "Offer",
      "price": "Open-source software (with version 4.3 now available in Databricks Runtime 19)"
    }
  },
  {
    "@context": "https://schema.org",
    "@type": "Organization",
    "name": "AINews.sh",
    "alternateName": "AI News",
    "url": "https://ai-dev-pulse-ac4cc200.base44.app",
    "logo": "https://ai-dev-pulse-ac4cc200.base44.app/logo.png",
    "description": "Developer-focused AI product releases, reviews, and news. Your source for the latest AI tools, open-source models, and platform updates.",
    "foundingDate": "2026",
    "slogan": "Stay ahead with AI product intelligence",
    "sameAs": [],
    "knowsAbout": [
      "Artificial Intelligence",
      "Machine Learning",
      "Large Language Models",
      "AI Tools",
      "Open Source AI",
      "AI Frameworks",
      "Developer Tools"
    ]
  }
]
```