Senior Engineer, Python & AWS

Job Title: Senior Engineer, Python & AWS
Location: Cardiff Bay, Wales
Salary: Competitive depending on experience
Department: Architecture
Reports To: System and Product Architect Director

About Opportunity:

This opportunity is to join a team of highly technically skilled engineers, who are redesigning Creditsafe data platform with high throughput and scalability as primary goal. The data delivery platform is being built upon AWS redshift and S3 cloud storage. The platform expected to manage over billion objects along with daily increment of more than 10 million objects while handling addition, deletion and correction of our data and indexes in auditable manner. Our data processing application is entirely based on Python and designed to efficiently transform incoming raw data volume into API consumable schema. Team is also building high available and low latency APIs to enable our clients with faster data delivery.

What you will be doing

• You will actively contribute to the codebase and participate in peer reviews.
• Design and build metadata driven, event based distributed data processing platform using technologies such as Python, Airflow, Redshift, DynamoDB, AWS Glue, S3.
• As an experienced Engineer, you will play a critical role in the design, development, and deployment of our business-critical system.
• You will be building and scaling Creditsafe APIs to securely support over 1000 transactions per seconds using serverless technologies.
• Execute practices such as continuous integration and test-driven development to enable the rapid delivery of working code.
• Understanding company & domain data to make recommendations to improve existing product.

What are we looking for?

• Demonstrate ability to write clean & efficient code and knit it together with cloud environment for best performance.
• You have solid development experience within a commercial environment creating production grade APIs and data pipelines in python.
• You are looking to grow your skills through daily technical challenges and enjoy problem solving, whiteboarding in collaboration with team.
• You have excellent communication skills, and ability to explain your views clearly to the team and are open to understanding theirs.
• Have a proven track record to draw from a deep and broad technical expertise to mentor engineers, complete hands-on technical work, and provide leadership on complex technology issues.
• Share your ideas collaboratively via wikis, discussions boards, etc and share any decisions made, for the benefit of others.

Our Technology Stack: Python, Linux, Airflow, AWS DynamoDB, S3, Glue, Athena, Redshift, lambda, API Gateway, Terraform, CI/CD