Skip to content

docs(integration): s3fs, SFTPGo, Alluxio, Docker Registry, SeaTunnel, AutoMQ, Paimon, Hive, DolphinScheduler, Databend guides - #169

Merged
majinghe merged 1 commit into
rustfs:mainfrom
majinghe:docs/batch8-integrations
Oct 8, 2026
Merged

majinghe merged 1 commit into
rustfs:mainfrom
majinghe:docs/batch8-integrations

Conversation

@majinghe

@majinghe majinghe commented Oct 8, 2026

Copy link
Copy Markdown
Collaborator

Summary

Ten new RustFS integration guides in all five locales (en/zh/de/fr/ja), each verified end-to-end against RustFS v2.3.1 on a live test host:

  • storage/s3fs.md — s3fs v1.93 FUSE mount: mount/unmount, write, persistence across remount, and S3-side object verification.
  • storage/sftpgo.md — SFTPGo 2.7.6 with a per-user S3 backend: web admin setup, S3 user creation (force_path_style + KMS-style access_secret), SFTP upload, object verification.
  • storage/alluxio.md — Alluxio 2.9.4 master+worker: mount a RustFS bucket as UFS with full alluxio.underfs.s3.* option keys, cached read and write-through verified.
  • registry/docker-registry.md — distribution registry:2 with the S3 driver: push alpine image, layers/manifests stored as objects in the bucket, pull-back verified.
  • big-data/seatunnel.md — SeaTunnel 2.3.12 S3File sink: FakeSource batch job writing JSON to RustFS; dual credential options documented.
  • big-data/automq.md — AutoMQ 1.3.0 KRaft single node with S3 log buckets on RustFS: topic create, produce/consume round-trip, log stream objects in bucket.
  • big-data/paimon.md — Paimon 1.2.0 on Spark 3.5.6: catalog over s3://warehouse, primary-key table create/insert/select, warehouse layout in bucket.
  • big-data/hive.md — Hive 4.0.1 (metastore + hiveserver2): S3A conf in three layers, external table on s3a://, LOAD DATA + SELECT verified.
  • big-data/dolphinscheduler.md — DolphinScheduler 3.2.1 standalone: resource center switched to S3, resource file uploaded via API, object verified.
  • database/databend.md — Databend v1.2.925: meta+query on host binaries, storage.s3 backend, database/table create + insert + select, Parquet files in bucket.

Category indexes, meta.json, and the integration landing page are updated in all locales.

Notes — two products skipped with reasons

  • Argo Workflows (4.1.4 / 3.6.4): the controller and workflow execution work, but artifact upload to RustFS fails in the wait container with SDK error 'Endpoint url cannot have fully qualified paths' — Argo's artifactRepository.s3 has no path-style knob for the S3-compatible (IP) endpoint, and both SDK v1 (3.6.4) and v2 (4.1.4) reject the endpoint client-side. Controller, CRDs, and workflow execution were fully exercised; only the artifact store step is blocked.
  • StarRocks (3.3.5 shared-data): requires long-running FE + BE java processes (2-4G heap each) which repeatedly destabilized the 4-core test VM; not a RustFS incompatibility — the S3 shared-data config was prepared per StarRocks docs.

Validation

  • audit-locales.mjs — clean on new files after fixing zh inline-code/URL-context issues (conf → text fence language also fixed a build break).
  • npm run docs:check — OK.
  • npm run build — OK.
  • All ten integrations verified end-to-end against live RustFS v2.3.1 before documentation.

…nel, AutoMQ, Paimon, Hive, DolphinScheduler, and Databend guides

- New guides (en/zh/de/fr/ja): storage/s3fs, storage/sftpgo, storage/alluxio,
  registry/docker-registry, big-data/seatunnel, big-data/automq,
  big-data/paimon, big-data/hive, big-data/dolphinscheduler,
  database/databend
- Update database, big-data, storage, and registry category indexes,
  meta.json navigation, and landing page bullets in all locales
- Add verified screenshots (zh shots in zh docs, EN shots elsewhere)
- Argo Workflows and StarRocks evaluated: skipped with documented reasons
@vercel

vercel Bot commented Oct 8, 2026

Copy link
Copy Markdown

@majinghe is attempting to deploy a commit to the overtrue's projects Team on Vercel.

A member of the Team first needs to authorize it.

@majinghe
majinghe merged commit 8814682 into rustfs:main Oct 8, 2026
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant