Contributing

Last updated 6 months ago

Components

Pull requests generally edit one of the following components at a time.

Compiler

  • Serializes tabular data to Apache Parquet

  • Transforms and parses files

  • builds packages locally

  • pushes packages to the registry

  • pulls packages from the registry

Technologies:

  • Python

  • pandas

  • PyArrow

Registry

  • Manages permissions

  • Stores package fragments in blob storage

  • Stores package meta-data

  • De-duplicates repeated data fragments

Technologies:

  • Python

  • Flask

  • SQLAlchemy

  • Postgres

Catalog

  • Displays package meta-data in HTML

Technologies:

  • JavaScript (ES6+)

  • node

  • React

  • Redux

  • Sagas

TODO

  • Add more detailed diagrams

Slack

License

Quilt is open source under the Apache License, Version 2.0..

Code of Conduct

Contributors must adhere to the Code of Conduct.