Job descriptionYour Mission:We are looking for a highly qualified Senior Data Engineer to join our team! This professional will be involved in the development and management of critical components of a data platform.The opportunity is for an international project, working with a multicultural team! Therefore, fluent English is a mandatory prerequisite to participate in the selection process.Main responsibilitiesResponsibilities:In this role, you will be crucial in the development and management of critical components of a data platform, including Data APIs (REST APIs), Apache Airflow, and data engineering artifacts such as ingestion and curation pipelines. This position requires strong proficiency in Python, Apache Airflow, REST APIs, KEDA, Azure DevOps, and Azure cloud services.Challenges of the role: Develop new data projects and maintain Airflow + KEDA instances with no downtime. Participate in a global project with interactions with people from different countries, mainly: England, India, South Africa, Brazil, and Chile.Requirements and skillsMandatory Technical SkillsSolid experience in the Python programming language.Strong experience with Airflow with KEDA (Kubernetes Event Driven Autoscaling).Extensive experience with Apache Airflow and its deployments on Azure Kubernetes Service.Broad experience in developing with Apache Airflow, such as Dynamic DAGs and Airflow REST APIs.Hands-on experience with Python frameworks like FastAPI or Flask and deploying REST APIs on Azure App Service.Solid understanding of software engineering development practices, including version control, testing, and continuous integration/deployment (CI/CD) with proven experience using Azure DevOps.Proven experience with essential data engineering concepts and principles.Proficiency in designing and implementing reusable and scalable data engineering pipelines and codebases.Solid experience in designing batch and streaming data architectures using Azure cloud platform services.Effective problem-solving skills and the ability to resolve complex data engineering issues.Commitment to continuous learning and staying updated on industry trends and best practices in data engineering.Strong communication and collaboration skills with proficiency in English. Ability to work effectively in a team, providing training and documenting processes.Expected Behavioral SkillsAnalytical abilityData orientationProblem-solvingExcellent communication skillsInterpersonal relationshipsTeamworkCollaborationProactivityDynamismAdditional informationAdvantages of Working with Us:Anywhere office culture: We enjoy the freedom to work with autonomy, flexibility, and trust.Psychological support: For the care of our mental health.Certification AssistanceFIAP: Undergraduate and postgraduate - 10% OFF on undergraduate courses and 20% OFF on MBA, POSTECH, and SHIFT courses, both in-person and online.
#J-18808-Ljbffr