Data Engineer Web Scraping

Before you apply, please get familiar with LuxoftLuxoft locations:Logeek Magazine:Luxoft Alumni Club:
Mandatory Skills
• SQL• Python• Linux• Containerization(Docker, Kubernetes)• Good communication skills• AWS• Strong on Dev ops side of things(K8s, Docker, Jenkins)
Project Description
Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics
Responsibilities
Web scraping using scripts/APIs/ToolsHelp build and maintain greenfield data platform running on Snowflake and AWSUnderstand the existing pipelines and enhance pipelines for the new requirements.Onboarding new data providersData migration projects