Data Engineer For Market Data Projects (With Streamlit Expertise) (Remote Brazil)

Project Description:

Develop a scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping.
Make data available to systematic & fundamental PMs and enterprise functions: Ops, Risk, Trading, and Compliance.
Develop internal data products and analytics.

Responsibilities:

Web scraping using scripts / APIs / Tools

Help build and maintain a greenfield data platform running on Snowflake and AWS

Understand the existing pipelines and enhance them for new requirements

Onboard new data providers

Execute data migration projects

Mandatory Skills:

Python

Linux

Containerization (Docker, Kubernetes)

Good communication skills

Strong DevOps skills (K8s, Docker, Jenkins)

Nice-to-Have Skills:

Market Data Projects / Capital markets experience

Snowflake experience is a big plus

Airflow

Languages:

English:

B2 Upper Intermediate

#J-18808-Ljbffr