It's all about the db - our journey between databases to accommodate 100k events per second
Language: English
The presentation was given on 2024.09.16 at PyCon Israel 2024 - Conference.
We built a python application that ingests 100k events per second. This lecture will share our lessons learned using different dbs for this job.
Our python based system needs to handle more than 100k events per second. During the last two years we have tried, failed and evolved using multiple databases such as nosql, timeseries db and OLAP columnar dbs. This lecture will share the lessons learned for running such a system in a production environment