You will play a major role in developing the cloud-based architecture to analyze and process data according to the needs of our clients. Some tasks you’ll be working on:
- Setting up data platform technologies which manage and secure the flow of structured and unstructured data from multiple sources;
- Building jobs to move data from various sources to Azure Data Lake Storage, also across different layers on Azure;
- As Azure (and services offered) is a fast-changing world, you learn and adapt to new tools and services in the Azure ecosystem;
- Create and maintain an optimal data pipeline architecture;
- Create reusable, maintainable, scalable (vertical, horizontal) integrations/services using a cutting-edge hybrid cloud infrastructure;
- Deploy models in production, as well as maintain a continuous integration pipeline, including monitoring and optimization of the system’s performance and cost;
- Get, ingest, transform, validate, and clean up data to meet functional/non-functional business requirements.