Muffakham Jah College of Engineering and Technology
Work Experience
A
Amazon
Software Development Engineer
Austin, TX, US
July 2021 - present
company
Amazon
title
Software Development Engineer
overview
- Amazon S3 Source - Amazon OpenSearch Ingestion
- Designed and developed an S3 source plugin for Amazon OpenSearch Ingestion to ingest Observability data from Amazon S3 which is used by 55% of OpenSearch Ingestion customers
- Integrated with Amazon Simple Queue Service (SQS), ensuring timely event processing upon S3 object creation
- Enhanced Amazon S3 source with Amazon DynamoDB, distributing work between multiple Amazon OpenSearch
- Ingestion nodes with auto scaling
- Peer Forwarder - Amazon OpenSearch Ingestion
- Developed Peer Forwarder, an HTTP service responsible for peer forwarding 10M+ events per hour efficiently
- Integrated Peer Forwarder with AWS Cloud Map for service discovery allowing Amazon OpenSearch Ingestion to dynamically find and communicate with other nodes enhancing the scalability
- Impleted Mutual TLS (mTLS) enabling secure communication between nodes
- GeoIP Plugin - Amazon OpenSearch Ingestion
- Spearheaded the design and development of the GeoIP processor, an Amazon OpenSearch Ingestion processor, to enrich observability data with geographical information based on IPv4 or IPv6 addresses
- Formulated strategies for optimal performance by asynchronously switching databases without effecting the throughput and ingestion rate
- Designed and implemented a service to keep the GeoIP databases up to date in Amazon S3 bucket by using
- Amazon EventBridge and AWS Lambda along with Amazon CloudFront CDN for better latency