If you received this vacancy from our recruiters — read our Privacy Notice.ClientDataArt's client is the foremost airline in South America, offering the widest selection of destinations, flight frequencies, and aircraft fleet options. The client's network covers domestic routes across five key South American markets, as well as Europe, the USA, and the Caribbean.Join a great company, not merely an individual project.Project overviewThe Advanced Analytics management team is a transformational team whose objective is to generate measurable value that lasts over time across all areas of the company. To achieve this, custom data products are created based on analytical models, mostly from ML but being able to use a broader spectrum of techniques; either by delivering new analytical capabilities to the areas we work with or by directly interacting with their systems.The development of the products and the associated change management is carried out using Agile methodologies (development) that incorporate the scientific method and LEAN tools (change management). To ensure the correct execution of our products, we work with an MLOps environment.Position overviewThe role of the Data Engineer is essential for our client's Advanced Analytics team. It is them who allow us to feed our Data Products with data at different stages of the life cycle of their construction. It can be from an ungoverned source, so there is no certainty will be sufficient to generate the desired analytics value, or fully governed sources that already belong to the company's Data Lake. The intake to the Data Products can be in batches or streamed in. This is a role with great technical responsibility! You should feel comfortable working in a terminal shell in order to implement a scalable, usable, functional and decoupled solution. You will need to work closely with Data Scientists and ML Engineers to automate the various tasks in robust and resilient data pipelines. Data Engineers are essentially creators, their natural habitat is data, and that is where they perform to their limit, always working as a team, with a great collaborative spirit.ResponsibilitiesCollection of large volumes and varied data setsWork directly with the team of Data Scientists and ML Engineers creating robust and resilient data pipelines that allow feeding the Data ProductsCollection of interactions with real ML models for their subsequent retrainingCollaborate in the design, implementation, and production of the necessary parts for the ingestion of data into our Data LakePromote a technical culture promoting data products with MLOps best practicesWork directly with the team that supports the operation of the Data Products, to generate innovative ideas and solutions that improve their production processesDefine data models that unite disparate data across the organizationDesign, implement, and maintain ETL pipelinesDesign, develop, and continuously test solutions based on the dataRequirementsAt least 2 years of experience in work environments as a Software Engineer or Data EngineerSolid experience with PythonExperience working in UNIX environmentsExperience with GCP, especially in data servicesExcellent analytical skills related to working with unstructured data sets, and advanced knowledge of SQL, including query optimizationExperience working with at least one CloudStrong understanding of data structuresExperience using CI/CD pipelinesExperience working with DockerUnderstanding of the complete lifecycle of Machine Learning modelsAdvanced oral and written EnglishExperience in the construction and optimization of data pipelines, message queues, and big architectures and highly scalable dataExcellent communication skills and collaborative work experienceKnowledge of SpanishNice to haveTerraform experienceExperience in building scalable APIsExperience configuring and optimizing CI/CD pipelinesStream processing experienceAbility to visualize possible improvements, problems, and solutions for architectures
#J-18808-Ljbffr