Data Engineer For Market Data Projects (With Streamlit Expertise)

Project DescriptionDevelop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics.ResponsibilitiesWeb scraping using scripts/APIs/Tools.Help build and maintain greenfield data platform running on Snowflake and AWS.Understand the existing pipelines and enhance pipelines for the new requirements.Onboarding new data providers.Data migration projects.SkillsMust Have:SQLPythonLinuxContainerization (Docker, Kubernetes)Good communication skillsAWSStrong on DevOps side of things (K8s, Docker, Jenkins)Nice to Have:Market Data Projects/ Capital markets experience.Snowflake is a big plus.Airflow.
#J-18808-Ljbffr