Technology

Data Storage

• Storage each dataset / schema in an Apache Avro File.
• Generate a schema file, schema.json. [This is just for reader easy; Avro Tools handle the reading of the files].
• Store the datasets in a gzip file in linux.
• ...

References

• Jekyll
• A Guide to Akamai-Linode
• DNS - Namecheap
• Domain Name Service (DNS)
• NGINX
• Apache Airflow
• PyFilesystem
• DuckDB
• Gzip