Description
Goal: Independent conception, implementation and operation of data processing pipelines for the provision and preparation of mass data. Ensuring data quality and data availability.
Services & responsibilities:
§ Monitoring and ensuring data quality, data availability and processing performance
§ Provision of interfaces for data exchange
§ Conception, implementation and testing of scalable data processing architectures
§ Conception, implementation and testing of ETL processes in coordination with data scientists and business analysts
§ Close coordination with front-end, back-end engineers, product managers and analysts
§ Application and provision of machine learning and statistical methods for evaluating and predicting patterns in the data
§ Continuous coordination and proactive communication with data protection functions
§ Evaluation and analysis of data sets of various complexity and the development and optimization of the data processing infrastructure based on them
§ Development of solution options in order to get from the actual to the target state as well as evaluation and presentation of the solution options
Company
Related postings
Nearform
Senior Data EngineerGermany and 1 otherAtari
Senior Data EngineerMünster, GermanyNew Era Technology
Senior Data EngineerMalaysiaBlack Duck
Senior Data EngineerBelfast, UK