Repositories list

• hadoop-connectors

  Public
  Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.

  Java

  •

  Apache License 2.0

  •261261 forks•289289 stars•5050 issues•5858 pull requests•Updated Apr 20, 2026Apr 20, 2026

• flink-bigquery-connector

  Public
  BigQuery connector for Apache Flink

  Java

  •

  Apache License 2.0

  •2626 forks•3838 stars•1111 issues•55 pull requests•Updated Apr 15, 2026Apr 15, 2026

• dataproc-jupyter-plugin

  Public
  TypeScript

  •

  Apache License 2.0

  •1818 forks•99 stars•77 issues•3939 pull requests•Updated Apr 14, 2026Apr 14, 2026

• spark-bigquery-connector

  Public
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

  Java

  •

  Apache License 2.0

  •226226 forks•421421 stars•4040 issues•1111 pull requests•Updated Apr 12, 2026Apr 12, 2026

• gcs-jupyter-plugin

  Public
  Python

  •

  Apache License 2.0

  •44 forks•00 stars•00 issues•1010 pull requests•Updated Apr 8, 2026Apr 8, 2026

• spark-spanner-connector

  Public
  Cloud Spanner Connector for Apache Spark

  Java

  •

  Apache License 2.0

  •2222 forks•1818 stars•22 issues•55 pull requests•Updated Apr 8, 2026Apr 8, 2026

• dataproc-spark-connect-python

  Public
  Python

  •

  Apache License 2.0

  •1414 forks•77 stars•11 issue•88 pull requests•Updated Apr 7, 2026Apr 7, 2026

• custom-images

  Public
  Tools for creating Dataproc custom images

  Python

  •

  Apache License 2.0

  •6767 forks•3535 stars•66 issues•55 pull requests•Updated Mar 26, 2026Mar 26, 2026

• spark-bigtable-connector

  Public
  Scala

  •

  Apache License 2.0

  •1717 forks•66 stars•1313 issues•77 pull requests•Updated Mar 17, 2026Mar 17, 2026

• initialization-actions

  Public
  Run in all nodes of your cluster before the cluster starts - lets you customize your cluster

  Shell

  •

  Apache License 2.0

  •516516 forks•598598 stars•7979 issues•4949 pull requests•Updated Mar 17, 2026Mar 17, 2026

• cloud-dataproc

  Public
  Cloud Dataproc: Samples and Utils

  Jupyter Notebook

  •

  Apache License 2.0

  •132132 forks•205205 stars•22 issues•99 pull requests•Updated Mar 17, 2026Mar 17, 2026

• hive-bigquery-connector

  Public
  A library enabling BigQuery as Hive storage handler

  Java

  •

  Apache License 2.0

  •1818 forks•1010 stars•1414 issues•1212 pull requests•Updated Mar 11, 2026Mar 11, 2026

• dataproc-ml-python

  Public
  Library to simplify running distributed ML workloads with Apache Spark

  Python

  •

  Apache License 2.0

  •22 forks•77 stars•11 issue•00 pull requests•Updated Jan 28, 2026Jan 28, 2026

• hive-bigquery-storage-handler

  Public archive
  Hive Storage Handler for interoperability between BigQuery and Apache Hive

  Java

  •

  Apache License 2.0

  •1010 forks•1919 stars•66 issues•55 pull requests•Updated Jan 29, 2025Jan 29, 2025

• .allstar

  Public archive
  22 forks•11 star•00 issues•00 pull requests•Updated Dec 6, 2022Dec 6, 2022

• .github

  Public archive
  00 forks•11 star•00 issues•00 pull requests•Updated Oct 26, 2022Oct 26, 2022

• jupyterhub-dataprocspawner

  Public archive
  Python

  •

  Apache License 2.0

  •99 forks•1414 stars•55 issues•22 pull requests•Updated May 27, 2022May 27, 2022

• dataprocmagic

  Public archive
  Python

  •

  Apache License 2.0

  •44 forks•33 stars•00 issues•11 pull request•Updated Sep 11, 2020Sep 11, 2020

• dataproc-jdbc-connector

  Public archive
  Java

  •

  Apache License 2.0

  •77 forks•33 stars•77 issues•00 pull requests•Updated Sep 10, 2020Sep 10, 2020

• bdutil

  Public archive
  [DEPRECATED] Script used to manage Hadoop and Spark instances on Google Compute Engine

  Shell

  •

  Apache License 2.0

  •9090 forks•109109 stars•2626 issues•66 pull requests•Updated Nov 15, 2019Nov 15, 2019