Overview: Our client is seeking a Senior Backend Developer to join their growing team. The ideal candidate will be responsible for building and optimizing a scalable data ingestion system, playing a key role in database architecture, performance tuning, and integration with third-party data sources. This position requires a strong background in big data, API development, and system scalability. Job Description: Design, develop, and optimize a data ingestion system to handle large-scale time-series data. Work with both SQL and NoSQL databases, including MongoDB and PostgreSQL, and recommend solutions for massive time-series data storage. Implement and manage REST APIs, and integrate with web sockets to stream data from third-party partners. Collaborate closely with the CTO and CEO on system architecture, design, and performance optimization. Ensure the data ingestion system meets performance requirements, including real-time processing and efficient data storage and retrieval. Secure data-in-transit and data-at-rest, with a focus on maintaining user privacy. Work within an AWS environment, utilizing tools such as Fargate, CloudFormation CDK, and other microservice architecture solutions. Participate in iterative development, with clear milestones aimed at delivering the initial data ingestion system within 12 weeks Requirements: 5 years of experience in backend development, with a focus on scalable, high-performance systems. Proficiency in Node.js and experience with both SQL and NoSQL databases. Strong understanding of microservice architectures and AWS cloud services. Experience with performance tuning for large-scale data systems, particularly in the context of time-series data. Familiarity with message queues such as Kafka, and experience in developing and managing REST APIs. Knowledge of user privacy principles, and experience in securing data-in-transit and data-at-rest. Familiarity with agile development practices and tools such as Jira and Confluence. Proficiency in version control systems, particularly GitHub. Strong problem-solving skills and the ability to work independently in a remote environment. Preferred Skills: Experience with containerization tools such as Docker or Kubernetes. Knowledge of data processing frameworks like Apache Spark or Flink. Familiarity with API security mechanisms, including OAuth and JWT. Experience with serverless architectures, particularly AWS Lambda. Understanding of event-driven architectures and tools such as AWS EventBridge or SNS/SQS. Experience with big data solutions and data warehousing. Knowledge of integrating data systems with large language models (LLMs). We Offer: Full-Time: 30-40 hours per week. Hourly rate: $20 - $25 per hour If you are a talented and enthusiastic Back End Developer looking to work on exciting projects and contribute to the success of a data brokering company, we invite you to apply for this position. Join our team and help us create cutting-edge software solutions that make a real impact. If you have a GitHub or Portfolio, please included in your resume or send directly to us Thank you We look forward to receiving your applications
