Data Engineer For Market Data Projects (With Streamlit Expertise) (Remote Brazil)

Project Description:
Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping.
Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics.
Responsibilities:

Web scraping using scripts / APIs / Tools.
Help build and maintain greenfield data platform running on Snowflake and AWS.
Understand the existing pipelines and enhance pipelines for the new requirements.
Onboarding new data providers.
Data migration projects.

Mandatory Skills Description:

Python
Linux
Containerization (Docker, Kubernetes)
Good communication skills
Strong on DevOps side of things (K8s, Docker, Jenkins)

Nice-to-Have Skills Description:

Market Data Projects / Capital markets experience.
Snowflake is a big plus.
Airflow

Languages:
English: B2 Upper Intermediate
#J-18808-Ljbffr