Site Reliability Engineer

Job Description

• Maintain open source-based application monitoring infrastructure. Enhance, optimize, and migrate to new solutions if required.

• Support application teams to migrate to latest OpenShift versions, perform deployment of stateful/stateless apps, and troubleshoot issues in Kubernetes/OpenShift platforms.
• Work with application developers to implement application instrumentation libraries and frameworks.
• Maintain metrics data store using TSDBs like Prometheus. Perform administration and tuning like cardinality optimization, resource optimization.
• Maintain distributing tracing infrastructure like Otel, Jaeger, Zipkin, etc. Perform administrative functions and tuning like sampling strategy. Troubleshoot distributed tracing in microservices.
• Perform production support activities of enterprise logging platforms like ELK stack, Grafana Loki, etc. Work on Index Lifecycle management in Elastic search.
• Implementing alerting infrastructure, integrate with PagerDuty, MS teams and any other software which needs alert-based mitigation/action. Assist application support team to define alerting rules for enterprise business apps.
• Deploy and do administration of visualization tools like Grafana/Elastic. Create dashboarding templates which can be reused, Implement RBAC for the entire userbase.
• Educate and implement observability culture in dev community. Assist them identifying golden signals, defining SLI, SLO for enterprise applications, calculate error budgets, MTTD, and MTTR.
• Troubleshoot the infra issues in the observability infrastructure in Linux VMs and Kubernetes PODs, Setup and secure reverse proxies, secure all application endpoints with TLS, enable MFA, LDAPS, OAuth based on requirement.
• Configure CI/CD pipeline for all the monitoring infrastructure and services. Modify and extend existing pipeline to cater multiple environments/regions.

The person should have hands-on on below key technologies

• Elasticsearch/Kibana Cluster Management, Search Optimization
• Prometheus/Grafana
• OpenTelemetry
• Linux OS troubleshooting
• Kubernetes deployments, CI/CD pipelines
• Good understanding of SRE practices

Working Hours

Mon to Fri 9 to 6PM

Sometimes need to support deployment on weekends, and will be given comp off.

EA Number: 11C4879