Paradise Media
is an affiliate marketing company at the forefront of digital marketing, dedicated to empowering consumers to make informed choices when it comes to products and services using strategic and innovative digital marketing campaigns.
With a strong commitment to transparency, consumer empowerment, and performance-driven marketing,
Paradise Media
aligns advertisers and affiliates to provide consumers with information to make the best choices for their needs.
About the role
The Senior Python Developer at Paradise Media will lead efforts in social media data scraping and automation, managing large volumes of data (big data) from various platforms.
The role requires strong expertise in web automation to extract data efficiently and ensure quality.
The developer will implement scalable data processing solutions using SQL and NoSQL systems, while leveraging AWS-based infrastructure to serve the data.
Additionally, the developer needs to have an understanding of LLM customizations for decision making and content generation.
This position plays a crucial role in driving business insights through optimized data handling and automation processes.
This role can be 100% remote worldwide.
Develop and maintain web scraping scripts using Python to collect data from social media platforms and websites in an efficient and scalable manner.
Build and maintain data-driven web applications with Django, ensuring optimal performance, data consistency, and scalability across different data sources.
Simulate HTTP requests and parse HTML outputs to extract and process necessary data.
Ensure data quality, accuracy, and consistency across different data sources by implementing validation processes.
Develop and implement solutions utilizing LLMs, such as Retrieval-Augmented Generation (RAG) and embeddings, to analyze Social media content and assist in drafting engaging social media posts.
Set up and manage CI/CD pipelines and infrastructure on AWS using Terraform to automate deployment and scaling.
Implement and manage asynchronous, high-load data processing systems using AWS services like SQS, Lambda, and Docker to handle large volumes of social media data.
Troubleshoot and resolve issues related to scraping scripts and data extraction processes to ensure continuous and accurate data collection.
Optimize scraping scripts for performance and resource efficiency, ensuring minimal latency and maximum scalability.
Stay informed about the latest advancements in web scraping techniques, tools, and best practices to continuously improve processes.
Document code and processes clearly for future reference and team knowledge sharing, ensuring easy onboarding and collaboration.
Requirements:
Proven experience as a Python Developer with a focus on developing web applications, back-end APIs, web scraping, and data extraction.
Strong proficiency in Python, specifically Python Frameworks like FastAPI, Django and libraries such as BeautifulSoup, Scrapy, and Selenium.
Nice-to-have: Experience with LLMs (e.g., RAG, embeddings) for content analysis and generation.
Understanding of RESTful APIs and experience integrating with third-party APIs.
Knowledge of data processing and storage solutions, including databases (e.g., SQL, NoSQL).
Experience with AWS and setting up infrastructure from scratch, including CI/CD pipelines and using Terraform.
Proficiency in setting up and managing high load asynchronous data processing systems using SQS, Lambda Functions, and Docker.
Strong experience with Django for building data-driven applications.
Strong problem-solving skills and attention to detail.
Excellent communication skills and ability to work collaboratively in a remote team environment.
Proactive attitude with a focus on achieving results and understanding business needs.
Open to new ideas and willing to engage in discussions about decisions.
We offer a competitive salary, and the opportunity to work with a talented and passionate team in a fast-paced, dynamic environment.
#J-18808-Ljbffr