Lyrics has been copied to clipboard!
Job Purpose
We are looking for a Senior Software Engineer to join our Data Engineering team. This team is responsible for building the scalable resilient data platform used by various IMT data products. We build complex data pipelines and infrastructures which cater to analytics and data science use cases. While working on these projects you will hold responsibility for full life-cycle management, including requirements analysis, technical design, implementation, testing, documentation, deployment to production, and post-production ownership.
Responsibilities
Develop high quality data processing infrastructure and scalable services that are capable of ingesting and transforming data at huge scale coming from many different sources on schedule
Turn ideas and concepts into carefully designed and well-authored quality code
Articulate the interdependencies and the impact of the design choices
Develop solutions on platform-based approach
Collaborate with QA, product management, engineering, UX to achieve well groomed, predictable results
Believe in Teamwork and work in close collaboration with Senior/Staff Engineers
Fluidly adapt to changes and new requirements
Proven ability to deliver working solutions on time
Strong analytical thinking to tackle challenging engineering problems
Great energy and enthusiasm with a positive, collaborative working style, clear communication and writing skills
Knowledge and Experience
Experience in object-oriented design and development with Java language
Experience with a variety of data stores for unstructured and columnar data as well as traditional database systems, for example, MySQL, DynamoDB, Postgres
Experience with Docker based Containerization
Experience in data pipeline using various data streams like Confluent Kafka, AWS Kinesis etc.
Experience in distributed storage using S3, HDFS
Experience in handling and processing data in json and parquet file format
Experience in Infrastructure as Code using Cloud formation or Terraform and deployment using shell script in Jenkins Job
Experience with Kafka Connectors and various data stores and data sink connectors
Experience building Spring Boot REST Framework based micro services in a distributed architecture
Experience with Open-Source products and components
Experience with working in DevOps environment – “you build it, you run it, you own it”
BE/BTech or ME/MTech in Computer Science
5+ years of building Enterprise Software Products
