Merge master into feat/18479-kafka-streams-runner-skeleton - #39791

Closed

junaiddshaukat wants to merge 744 commits into

apache:feat/18479-kafka-streams-runner-skeletonfrom

junaiddshaukat:feat/ks-sync-master

This pull request is big! We're only showing the most recent 250 commits

Commits on Jul 20, 2026

Bump github.com/fsouza/fake-gcs-server from 1.52.3 to 1.55.1 in /sdks (#39385)
dependabot[bot]
authored
d150fd0
Set persist-credentials true
Amar3tto
committed
45d1dac
Merge pull request #39388 from apache/fix-credentials
Amar3tto
authored
4b3fff3
Add --add-opens test JVM args for HCatalog and Dataflow worker tests (#39351)
aIbrahiim
authored
78261e7
Support ACKNOWLEDGE_MODE for JmsIO (#39253)
Abacn
authored
39c60f0
[Java] Cache DoFn invoker constructors per instance (#39310)

lofifnc
and
codex
authored
023ca6d
add language filtering for codeql (#39327)
derrickaw
authored
804b127
[KafkaIO] Remove build support for Kafka clients before 3.9.2 (#39284)
sjvanrossum
authored
ec397ce

Commits on Jul 21, 2026

Bump protobufjs from 8.6.0 to 8.6.6 in /sdks/typescript (#39394)
dependabot[bot]
authored
0df7069
Bump pillow (#39396)
dependabot[bot]
authored
f4b13a0
Bump actions/checkout from 4 to 7 (#39399)
dependabot[bot]
authored
f802944
Bump pillow (#39395)
dependabot[bot]
authored
7735b39
Add Beam YAML support for DebeziumIO
Amar3tto
committed
621a78c
fix GCP_PATH expansion (#39400)
aIbrahiim
authored
ab36569
Fix CdapIO dependency (#39393)
Abacn
authored
dca1253
Fix a memory leak in the failed instruction id cache. (#39405)
tvalentyn
authored
7bc2fb4
Update CHANGES.md to document a memory growth issue. (#39407)
tvalentyn
authored
5b441f2
Merge pull request #39111: Fix OpenSearch username/password env fallback in examples
kennknowles
authored
c54595b
Merge pull request #39270 from apache/icerbergio-benchmark
Amar3tto
authored
eccd9b7
Increase CI timeouts for Python 3.14 multiarch container jobs (#39401)
aIbrahiim
authored
9baa19a
Fix gRPC stream observer leak on ProcessBundleHandler shutdown (#39390)

Abacn
and
gemini-code-assist[bot]
authored
0c151d8
add Apache third party allow list check and doc (#39392)
derrickaw
authored
414b48a
[Gemini] Add Java GeminiModelHandler class (#39245)
jrmccluskey
authored
83fcb2f
Add metric for Kafka offset commit failures (#38889)

authored
55e1ecb

Commits on Jul 22, 2026

Commits on Jul 23, 2026

Commits on Jul 24, 2026

Commits on Jul 25, 2026

update tour of beam workflow go version (#39486)
derrickaw
authored
72d7ae3

Commits on Jul 27, 2026

Commits on Jul 28, 2026

Bump torch (#39512)
dependabot[bot]
authored
dec8d23
OTEL in kafka. (#39151)
stankiewicz
authored
4160995
Bump golang.org/x/oauth2 from 0.7.0 to 0.27.0 in /playground/backend (#39524)
dependabot[bot]
authored
ec93d37
sdks/java: re-enable nullness checks in WithKeys (#39506)
kennknowles
authored
ad1e278
[Solace] Close the HTTP response content stream in BrokerResponse (#39404)
PDGGK
authored
9ae08d5
Avoid output inside try-catch in Java IO (#39124)

Aryankn29
and
gemini-code-assist[bot]
authored
9c82e05
Fix flaky AsyncWrapper reset_state test on Python 3.14 (#39521)
bvolpato
authored
dd463fa
Bump github.com/moby/moby/client from 0.5.0 to 0.5.1 in /sdks (#39517)
dependabot[bot]
authored
2eb3323
Bump github.com/aws/smithy-go from 1.27.4 to 1.27.5 in /sdks (#39519)
dependabot[bot]
authored
905ade4
Bump actions/stale from 10 to 11 (#39520)
dependabot[bot]
authored
cae3e17
Refactoring
Amar3tto
committed
2541fc7
Fix python formatter
Amar3tto
committed
315ed95
Bump scikit-learn (#39525)
dependabot[bot]
authored
f456c02
[Gemini] Fix pyrefly check bad-typed-dict-key (#39415)
jrmccluskey
authored
39c0dde
Add registerSqlOperator() to BeamSqlEnv for custom SQL operators (#39432)
damccorm
authored
2434619
OTEL in pubsub (#39150)
stankiewicz
authored
f258e3e
Add the directory with staged files to sys.path and document the usage (#39434)
tvalentyn
authored
55fde07
Replace non-PEP 585 types in watch.py (#39527)
jrmccluskey
authored
fc0d989
Update ruff and pyrefly dependencies (#39531)
jrmccluskey
authored
f20da8a
[Java IO] Add ArrowFlight IO connector (#37904)
bvolpato
authored
8473d90
Support JmsIO SchemaTransform and cross-lang (#39437)
Abacn
authored
2ee432b

Commits on Jul 29, 2026

Commits on Jul 30, 2026

Bump cloud.google.com/go/spanner from 1.93.0 to 1.94.0 in /sdks (#39550)
dependabot[bot]
authored
2c735b6
Bump github.com/aws/aws-sdk-go-v2/config in /sdks (#39551)
dependabot[bot]
authored
c6e0f5b
Remove primaryKeyColumns options
Amar3tto
committed
b85646b
Bump github.com/aws/aws-sdk-go-v2/service/s3 in /sdks (#39554)
dependabot[bot]
authored
2fd6af9
Fix spotless
Amar3tto
committed
5178343
Bump github.com/aws/aws-sdk-go-v2/feature/s3/manager in /sdks (#39553)
dependabot[bot]
authored
61fad4f
Set envs
Amar3tto
committed
bc991d9
Provide a better error when beam plugin was supplied but wasn't staged. (#39440)
tvalentyn
authored
525780e
Updates the Delta Lake source to support reading bounded change data (#39426)
chamikaramj
authored
f65e0e0
Fix module-level side effects and global random seeding in univariate ML anomaly tests (#39462)
Abacn
authored
4f93483
Merge pull request #39558 from apache/fix-auditkeys
Amar3tto
authored
8a7c972
Merge pull request #39457 from apache/debezium-io-yaml
Amar3tto
authored
0de9a67
Bump docker/login-action from 4.5.2 to 4.6.0 (#39552)
dependabot[bot]
authored
b9e4e2f
Preserve partitioning on temp FILE_LOADS tables (#38833)
PRADDZY
authored
f7d8d7c
fix AddFilesIT filter for BigLake (#39533)
aIbrahiim
authored
141804a
Enhance Python Timestamp to be precision-variable up to nanos, and map it to Timestamp logical type (#39537)

ahmedabu98
and
Ahmed Abualsaud
authored
f5feab8
Buffer BufferedLogger by newline to avoid log splitting (#39288)
shunping
authored
7b9380b
Fix DataflowOutputCounter calculation for ValueInEmptyWindows (#39487)
shunping
authored
03db1a0
[IcebergIO] Upgrade Iceberg dependency to 1.11.0 (#39559)

peterphitran
and
Abacn
authored
b8d77b8

Commits on Jul 31, 2026

Commits on Aug 1, 2026

update containers (#39575)
ahmedabu98
authored
5196676

Commits on Aug 3, 2026

Fix flaky FileIOTest.testMatchWatchForNewFiles test under CI filesystems (#38047)
bvolpato
authored
e4779cf
Bump google.golang.org/grpc from 1.82.1 to 1.83.0 in /sdks (#39585)
dependabot[bot]
authored
7f96ee4
Bump github/codeql-action from 4.37.3 to 4.37.4 (#39586)
dependabot[bot]
authored
93af678
Support core dump analysis with pystack and gdb. (#39484)
tvalentyn
authored
8b4c675
Bump github.com/nats-io/nats-server/v2 from 2.14.3 to 2.14.4 in /sdks (#39584)
dependabot[bot]
authored
a72451d
[Docs] Update Flink version references on the Flink runner page (#39212)
Eliaaazzz
authored
3a02af8
Fix dataframe CSV tests on Windows (#39563)
Guflly
authored
539b048
Support array-valued schema options in Python (#39583)
bvolpato
authored
4d3e1f0
Feat: new cleaning rule to orphaned subscriptions (#39538)
HansMarcus01
authored
f073408
[Docs] Add CHANGES entries for Python UnboundedSource and Watch (#39579)

authored
db57e4a
Fix internal test failure after #39487 (#39591)
shunping
authored
a6b3399
Add query_output_schema to ReadFromBigQuery for BEAM_ROW + query support (#39160)

nikitagrover19
and
Nikita Grover
authored
52f6e46
[DebeziumIO] Upgrade to Debezium 3.5.2.Final (#39569)
tkaymak
authored
f3e12fe
[Python] Bound Watch state with a timestamp cursor (#39090)
Eliaaazzz
authored
82c6ee4
Redistribute - trace propagation (#39590)
stankiewicz
authored
789e1d1
update containers (#39596)
ahmedabu98
authored
83821eb
remove gsutil usage (#39448)
derrickaw
authored
a89b9f7
[Iceberg CDC] Add Changelog readers and update resolver (#38837)

ahmedabu98
and
Ahmed Abualsaud
authored
c4b4bda

Commits on Aug 4, 2026

Commits on Aug 5, 2026

Bump zizmorcore/zizmor-action from 0.6.1 to 0.6.2 (#39604)
dependabot[bot]
authored
14c61d1
Adds the Delta Lake CDC read transforms to the Managed I/O API (#39599)
chamikaramj
authored
86ca053
mention otel in changes (#39618)
stankiewicz
authored
aa7f74c
Support sharded coder for Prism runner cross-lang (#39623)
Abacn
authored
1508227
Fix Dataflow ValueProvider serialization (#39614)
bvolpato
authored
c2c910a
Deflake JmsIO tests (#39571)
Abacn
authored
a0f3518
[Docs] Add a contributor guide for running Python on a local Flink cluster (#39580)
Eliaaazzz
authored
16f471e
fix PostCommit Python Dependency
aIbrahiim
committed
7ec43af
Merge pull request #39637 from aIbrahiim/fix-postcommit-pydep-pyarrow
Amar3tto
authored
7712ac6
fix(dataframe): claim remaining restriction range on empty/header-only CSV reads (#39581)
ManvithPanyam
authored
48c9e1f
[Iceberg CDC] Finish wiring CDC source together and add external API (#39600)

ahmedabu98
and
Ahmed Abualsaud
authored
c60b021
Updates CHANGES.md to include Delta Lake CDC
chamikaramj
committed
cb75d1b
Merge pull request #39644 from chamikaramj/update_change_log
Amar3tto
authored
8a5d5d2
add Timestamp.MICROS for iceberg timestamptz (#39592)
aIbrahiim
authored
e793e8a
Add google-api-python-client to Python 3.14 container (#39640)
Abacn
authored
e2ae447

Commits on Aug 6, 2026

add aws hadoop to DeltaIO (#39617)
derrickaw
authored
8bf709c
[Dataflow Streaming] Remove finalizeCommits from processWork (#39648)
arunpandianp
authored
02ff297
Update CHANGES.md for new release
Amar3tto
committed
71a7efe
Moving to 2.77.0-SNAPSHOT on master branch.

Amar3tto
authored and
Amar3tto
committed
cc822c0
Bump github/codeql-action from 4.37.4 to 4.37.5 (#39651)
dependabot[bot]
authored
92de1e4
[Dataflow Streaming] Remove redundant onKeyTransition call (#39652)
arunpandianp
authored
eea1e03
Fix Python 3.14 Container Build, Streamline Installation (#39659)
jrmccluskey
authored
c7a8f93

Commits on Aug 7, 2026

Commits on Aug 8, 2026

fix ensurepip bundled pip cleanup for Python 3.12+ containers (#39683)
aIbrahiim
authored
559d22c

Commits on Aug 10, 2026

Commits on Aug 11, 2026

Commits on Aug 12, 2026

Commits on Aug 13, 2026

[IcebergIO] Serialize using json partition (#39705)
ahmedabu98
authored
369409e

Commits on Aug 14, 2026

Commits on Aug 15, 2026

Commits on Aug 17, 2026