System Engineer
Job Title: System Engineer
Location: ,
THE TEAM
This opportunity is to join a team of highly technically skilled engineers, who are redesigning Creditsafe data platform with high throughput and scalability as primary goal. The data delivery platform is being built upon AWS redshift and S3 cloud storage. The platform expected to manage over billion objects along with daily increment of more than 10 million objects while handling addition, deletion and correction of our data and indexes in auditable manner. Our data processing application is entirely based on Python and designed to efficiently transform incoming raw data volume into API consumable schema. The team is also building high available and low latency APIs to enable our clients with faster data delivery.
This opportunity is to join a team of highly technically skilled engineers, who are redesigning Creditsafe data platform with high throughput and scalability as primary goal. The data delivery platform is being built upon AWS redshift and S3 cloud storage. The platform expected to manage over billion objects along with daily increment of more than 10 million objects while handling addition, deletion and correction of our data and indexes in auditable manner. Our data processing application is entirely based on Python and designed to efficiently transform incoming raw data volume into API consumable schema. The team is also building high available and low latency APIs to enable our clients with faster data delivery.
JOB PROFILE
Join us to take the above project of redesigning the Creditsafe platform into the cloud space. You will be expected to work with technologies such as Python, Airflow, Redshift, DynamoDB, AWS Glue, S3.
Join us to take the above project of redesigning the Creditsafe platform into the cloud space. You will be expected to work with technologies such as Python, Airflow, Redshift, DynamoDB, AWS Glue, S3.
KEY DUTIES AND RESPONSIBILITIES
You will actively contribute to the codebase and participate in peer reviews.
Design and build metadata driven, event based distributed data processing platform using technologies such as Python, Airflow, Redshift, DynamoDB, AWS Glue, S3.
As an experienced Engineer, you will play a critical role in the design, development, and deployment of our business-critical system.
You will be building and scaling Creditsafe APIs to securely support over 1000 transactions per second using server less technologies.
Execute practices such as continuous integration and test-driven development to enable the rapid delivery of working code.
Understanding company & domain data to make recommendations to improve existing product.
The responsibilities detailed above are not exhaustive and you may be requested to take on additional responsibilities deemed as reasonable by their direct line manager.
SKILLS AND QUALIFICATIONS
Demonstrate ability to write clean & efficient code and knit it together with cloud environment for best performance.
Proven experience of development within a commercial environment creating production grade APIs and data pipelines in python.
You are looking to grow your skills through daily technical challenges and enjoy problem solving and whiteboarding in collaboration with a team.
You have excellent communication skills, and the ability to explain your views clearly to the team and are open to understanding theirs.
Have a proven track record to draw from a deep and broad technical expertise to mentor engineers, complete hands-on technical work, and provide leadership on complex technology issues.
Share your ideas collaboratively via wikis, discussions boards, etc and share any decisions made, for the benefit of others.
Demonstrate ability to write clean & efficient code and knit it together with cloud environment for best performance.
Proven experience of development within a commercial environment creating production grade APIs and data pipelines in python.
You are looking to grow your skills through daily technical challenges and enjoy problem solving and whiteboarding in collaboration with a team.
You have excellent communication skills, and the ability to explain your views clearly to the team and are open to understanding theirs.
Have a proven track record to draw from a deep and broad technical expertise to mentor engineers, complete hands-on technical work, and provide leadership on complex technology issues.
Share your ideas collaboratively via wikis, discussions boards, etc and share any decisions made, for the benefit of others.