In today’s world, we generate and process a vast amount of data every day, and it’s becoming increasingly challenging to manage it all efficiently. Future-proof data architectures that can handle large volumes of data are essential for businesses and organizations. In this blog post, I would like to highlight how…

✍️ Intro Data labeling is a crucial aspect of machine learning that involves annotating raw data to create labeled datasets that can be used to train models. However, the process of labeling large volumes of data can be time-consuming and error-prone. Fortunately, there are several tools and technologies available that…

Scala is an incredibly flexible programming language that enabled Software Engineers to build powerful and easily extensible applications in various domains. Since a large chunk of Apache Spark is written in Scala, it’s also pretty natural to write Spark applications in Scala language to utilize its typing system fully. Although…

⏰ Borrowing time Python is an extremely flexible language. And when I say extremely I sometimes mean it with a little grain of salt. It allows you to write absolutely untyped code without any worries. For instance, when you would like to quickly parse an API response and simply extract…

MLOps is a hot topic nowadays. Whilst the importance and business value of it is well described in various papers, e.g. [1], [2], there seems to be a lack of hands-on examples with explanations on how this could be done. In this series of blogposts I’m going to demonstrate an…

While working with Python notebooks and projects in a long-term scope, Data and ML engineers come to the idea of using best software development practices in terms of storing and versioning code artifacts. One such practice is to organize common, widely re-used code blocks into packages, and store these packages…

The closer your data product is getting to the production, the bigger is the importance of properly collecting and analysing logs. Logs help both during debugging in-depth issues and analysing the behaviour of your application. For general Python applications the classical choice would be to use the built-in logging library…

Intro Modern data platforms store and collect an incredible amount of both useful data and metadata. However, even knowing the metadata itself might be not useful for the end-users who don’t have enough experience with classical components of a relation-based data model. One of the challenges is not only the…

Cобирательство документов Закончив с выбором компании, и получив финальный документ с оффером, оставался “всего-то” последний шаг — собрать все документы на визу, и собственно получить ее. На практике собрать документы достаточно несложно (я намеренно не буду приводить здесь список, лучше всегда сверяться с официальным сайтом немецкого посольства). В очередной раз…