Contributed Talk - Splinter EScience

Thursday, 15 September 2022, 16:45   (SFG 1040 / virtual eScience)

Building a DevOp environment - behind the scenes of a Daiquiri powered archives

Anastasia Galkin
Leibniz Institute for Astrophysics Potsdam (AIP)

At Leibniz Institute for Astrophysics Potsdam (AIP) we host, curate, and publish terabytes of astrophysical data using the Daiquiri framework. Dedicated web applications allow scientists from all around the world to run SQL queries and get their desired data in reasonable time. In last years, not only Daiquiri has gained many features, but we have re-designed the development, test and deployment proccess. Daiquiri is a python based framework that requires a complex setup - a reverse proxy that delivers static files, a Python webserver, task, queues and concurrency manager, an application database and the data database . The setup also includes a content repository, the files are in Markdown file format. We have build a docker-composed environment dq-dev to simplify the development process and proceeded to successfully use dq-dev also for the production instances.