quilt
Search…
Contributing

Components

Pull requests generally edit one of the following components at a time.

Compiler

  • Serializes tabular data to Apache Parquet
  • Transforms and parses files
  • builds packages locally
  • pushes packages to the registry
  • pulls packages from the registry
Technologies:
  • Python
  • pandas
  • PyArrow

Registry

  • Manages permissions
  • Stores package fragments in blob storage
  • Stores package meta-data
  • De-duplicates repeated data fragments
Technologies:
  • Python
  • Flask
  • SQLAlchemy
  • Postgres

Catalog

  • Displays package meta-data in HTML
Technologies:
  • JavaScript (ES6+)
  • node
  • React
  • Redux
  • Sagas

TODO

  • Add more detailed diagrams

Slack

License

Quilt is open source under the Apache License, Version 2.0..

Code of Conduct

Contributors must adhere to the Code of Conduct.
Last modified 2yr ago