Senior Data Engineer

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics.ResponsibilitiesWeb scraping using scripts/APIs/ToolsHelp build and maintain greenfield data platform running on Snowflake and AWSUnderstand the existing pipelines and enhance pipelines for the new requirementsOnboarding new data providersData migration projectsSkillsMust have:Streamlit ExpertiseSQLPythonAWSStrong on Dev ops side of things (K8s, Docker, Jenkins)Languages: English B2 Upper Intermediate
#J-18808-Ljbffr