Data Engineer Web Scraping

Detalhes da Vaga

Before you apply, please get familiar with Luxoft Luxoft locations: https://career.luxoft.com/locations/ Logeek Magazine: https://career.luxoft.com/logeek-magazine/ Luxoft Alumni Club: https://career.luxoft.com/alumni/ Mandatory Skills • SQL • Python • Linux • Containerization(Docker, Kubernetes) • Good communication skills • AWS • Strong on Dev ops side of things(K8s, Docker, Jenkins) Project Description Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics Responsibilities Web scraping using scripts/APIs/Tools Help build and maintain greenfield data platform running on Snowflake and AWS Understand the existing pipelines and enhance pipelines for the new requirements. Onboarding new data providers Data migration projects


Salário Nominal: A acordar

Fonte: Adzuna_Ppc

Função de trabalho:

Requisitos

Artificial Intelligence Engineer - Remote - Latin America

FullStack is the fastest-growing software consultancy in the Americas. We help organizations like Uber, GoDaddy, MGM, Siemens, and Stanford University build ...


Fullstack Labs Inc. - Brasil

Publicado 8 days ago

Desenvolvedor Java Full Stack Pleno

Job description A área de "Desenvolvimento" é responsável pelo desenvolvimento de softwares de gestão incríveis. Seus principais objetivos são desenvolver s...


Nomus - Brasil

Publicado 8 days ago

Vue.Js Tech Lead - Remote Work

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innov...


Bairesdev - Brasil

Publicado 8 days ago

Service Request Management Analyst (3837)

Job description Service Request Management Analyst | Fluent English | International Project Come work for a large global financial and insurance products co...


Keep Simple - Brasil

Publicado 8 days ago

Built at: 2024-11-24T21:33:25.349Z