Skip to content

rmax/dask-avro

Repository files navigation

Dask-Avro

Documentation Status Coverage Status Code Quality Status Requirements Status

Avro reader for Dask.

Features

This projects provides an Avro format reader for Dask. Provides a convenient function to read one or more Avro files and partition them arbitrarily.

Quickstart

Usage:

import dask.bag
import dask_avro

delayeds = dask_avro.read_avro("data-*.avro", blocksize=2**26)
data = dask.bag.from_delayed(delayeds)

Credits

This package was created with Cookiecutter and the rmax/cookiecutter-pypackage project template.