As a Data Engineer, you will actively participate in designing, building, and maintaining scalable data pipelines, microservices, and cloud-based data systems in an agile development environment, with a focus on performance, reliability, and data quality.
What You Will Do:

• Design, build, and optimize data pipelines and microservices using Python for real-time and batch processing
• Develop cloud-based data ingestion solutions using AWS services (Kinesis, S3, DynamoDB, EventBridge, etc.)
• Build and maintain data integration workflows for source data pipelines aligned to CI Autonomy
• Translate business requirements into reliable data workflows, mappings, and system designs
• Implement automated testing and validation to ensure data integrity across distributed systems
• Monitor and troubleshoot pipelines using tools like CloudWatch to maintain reliability

What You Will Have:

• Decision Making and Critical Thinking: Ability to analyze issues in distributed data systems and deliver scalable solutions
• Effective Communication: Ability to document data flows, mappings, and system behavior clearly for cross-team use
• Software Development: Experience building backend systems and pipelines using Python, Java, and modern frameworks
• Software Development Life Cycle: Experience delivering solutions in an agile environment
• Software Integration Engineering: Experience integrating APIs, streaming platforms, and databases
• Software Product Design/Architecture: Ability to design scalable, event-driven data systems
• Software Product Technical Knowledge: Strong understanding of AWS services and data engineering tools
• Software Product Testing: Experience implementing testing strategies to ensure data quality and system reliability

Top Candidates Will Have:

• Bachelor’s degree in Computer Science, Computer Engineering, or related field
• 2+ years development experience on modern, large scale, complex data platforms
• 3+ years developing and deploying Java or Python solutions to a production environment
• Experience building high-throughput, scalable data pipelines
• Strong hands-on experience with AWS data services (Kinesis, S3, DynamoDB, EventBridge, etc.)
• Proficiency in SQL, including data quality and validation practices
• Proficiency in deploying software using CI/CD tools such as Azure DevOps, Jira, Jenkins, etc.
• Experience developing microservices that support real-time data ingestion
• Experience developing software applications using relational and noSQL databases
• Ability to ensure data integrity across distributed and streaming systems
• Experience with API development and secure integrations (OAuth 2.0)
• Proven experience with monitoring, testing, and automation in large-scale data environments

• Are you interested in this position?

   

  Apply by clicking on the “Apply Now” button below!

   

  #AlbionarcJobs#FintechJobs

  #AsiaJobs#MiddleEastCareers

  #TechTalent#FintechRecruitment

  #FinanceOpportunities#