Senior Site Reliability Engineer, Infrastructure Foundations

SummaryThe Wikimedia Foundation is looking for a Senior Site Reliability Engineer to support and develop the platform serving the world’s favorite encyclopedia, Wikipedia, to millions of people around the globe. Wikimedia’s Site Reliability Engineering (SRE) team is principally responsible for ensuring our global top-10 website and its underlying infrastructure is healthy and developing further in support of Wikimedia’s mission: to help everyone share in the sum of all knowledge.The SRE team at Wikimedia is a globally distributed and diverse team of engineers with a drive to explore, experiment, and embrace new technologies. We work in the open by publishing all of our documentation, code, and configuration as open source, and all our production systems are powered by open source software. We invite you to go through our documentation and code -- no login required.If you find what we do interesting, if you are up to the challenge of improving the reliability and delivery of one of the Internet’s top websites, and you enjoy the idea of working in a remote-first role, we may just be the right place for you.You are responsible for:Performing day-to-day operational/DevOps tasks on Wikimedia’s public facing infrastructure (deployment, maintenance, configuration, troubleshooting)Implementing and utilizing configuration management and deployment tools (Puppet, Kubernetes)Leading continuous improvement, by automating the installation, configuration and maintenance of services on our platformWork closely with product teams helping them bring scalable functionality to our users by assisting in the architectural design of new services and making them operate at scaleParticipating in a 24/7 on-call rotation shared across the broader SRE team. This includes taking part in incident response, diagnosis and follow-up on system outages or alerts across Wikimedia’s production infrastructure.Collaborating with a global, cross-functional team in an asynchronous communication environmentMentoring peers in your areas of technical and operational strengthAbility and willingness to travel 1-2 times a year for in-person events and team meetingsMost importantly, share our values and work in accordance with themSkills and Experience:6+ years of experience in an SRE/Operations/DevOps role as part of a teamExperience with shell and any scripting languages used in an SRE context (Python, Go, Bash, Ruby; we primarily use Python) and configuration management tools (Puppet, Ansible; we use Puppet)Experience designing and managing infrastructure security for large fleets of diverse servicesExperience with technical response during security incidentsExperience with package management on Linux systems (we use Debian)Strong Linux system-level troubleshooting skillsHistory of automating tasks and processes, identifying process gaps, and finding automation opportunitiesStrong English language skills (verbal and written) and ability to work independently, as an effective part of a globally distributed team working across multiple time zonesExperience leading and participating in incident response and post-incident review rituals, with the goal of conducting root cause analysis and implementing preventive measures Additionally, we’d love it if you have:Experience setting and implementing fleet-wide security policiesExperience with software supply chain securityAwareness of the current open source infrastructure security landscapeExperience working together with software security teamsExperience with credential management systemsExperience implementing immutable logging and auditingExperience with the use, maintenance and configuration of monitoring, metrics and logging infrastructure (Prometheus, Grafana, etc.)Developing/contributing to Free and Open Source software, or being part of an open-source community (share your favourite pull requests!)Experience with LAMP stack technologies (PHP/HHVM, memcached/Redis) -- MediaWiki experience is a definite plusExperience with defining cross-team SLOs and their implementationAbout the Wikimedia FoundationThe Wikimedia Foundation is the nonprofit organization that operates Wikipedia and the other Wikimedia free knowledge projects. Our vision is a world in which every single human can freely share in the sum of all knowledge. We believe that everyone has the potential to contribute something to our shared knowledge, and that everyone should be able to access that knowledge freely. We host Wikipedia and the Wikimedia projects, build software experiences for reading, contributing, and sharing Wikimedia content, support the volunteer communities and partners who make Wikimedia possible, and advocate for policies that enable Wikimedia and free knowledge to thrive. The Wikimedia Foundation is a charitable, not-for-profit organization that relies on donations. We receive donations from millions of individuals around the world, with an average donation of about $15. We also receive donations through institutional grants and gifts. The Wikimedia Foundation is a United States 501(c)(3) tax-exempt organization with offices in San Francisco, California, USA.As an equal opportunity employer, the Wikimedia Foundation values having a diverse workforce and continuously strives to maintain an inclusive and equitable workplace. We encourage people with a diverse range of backgrounds to apply. We do not discriminate against any person based upon their race, traits historically associated with race, religion, color, national origin, sex, pregnancy or related medical conditions, parental status, sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, or any other legally protected characteristics.The Wikimedia Foundation is a remote-first organization with staff members including contractors based 40+ countries. Salaries at the Wikimedia Foundation are set in a way that is competitive, equitable, and consistent with our values and culture. The anticipated annual pay range of this position for applicants based within the United States is US$113,082 to US$175,725 with multiple individualized factors, including cost of living in the location, being the determinants of the offered pay. For applicants located outside of the US, the pay range will be adjusted to the country of hire. We neither ask for nor take into consideration the salary history of applicants. The compensation for a successful applicant will be based on their skills, experience and location.Please note that we are currently able to hire in the following:US States: Arizona, California, Colorado, Connecticut, District of Columbia, Florida, Georgia, Idaho, Illinois, Indiana, Iowa, Maryland, Massachusetts, Michigan, Minnesota, Missouri, New Jersey, New Mexico, New York, North Carolina, Ohio, Oklahoma, Oregon, Pennsylvania, Puerto Rico, Rhode Island, Tennessee, Texas, Utah, Vermont, Virginia, Washington, West Virginia, Wisconsin and Wyoming (US Territory or Federal District)Countries: Brazil, Canada, Colombia, France, Germany, Ghana, India, Indonesia, Italy, Kenya, Mexico, Morocco, Netherlands, Poland, Singapore, South Africa, Spain, Switzerland and the United Kingdom. Our non-US employees are hired through a local third party Employer of Record (EOR) and must have current work authorization in their location. (citizens/permanent residents only)We periodically review this list to streamline to ensure alignment with our hiring requirements.All applicants can reach out to their recruiter to understand more about the specific pay range for their location during the interview process.If you are a qualified applicant requiring assistance or an accommodation to complete any step of the application process due to a disability, you may contact us at recruiting@wikimedia.org or +1 (415) 839-6885.More informationU.S. Benefits & PerksApplicant Privacy PolicyWikimedia FoundationWhat does the Wikimedia Foundation do?What makes Wikipedia different from social media platforms?Our ProjectsOur Tech StackNews from across the Wikimedia movementWikimedia BlogWikimedia 2030Originally posted on Himalayas

SummaryThe Wikimedia Foundation is looking for a Senior Site Reliability Engineer to support and develop the platform serving the world’s favorite encyclopedia, Wikipedia, to millions of people around the globe. Wikimedia’s Site Reliability Engineering (SRE) team is principally responsible for ensuring our global top-10 website and its underlying infrastructure is healthy and developing further in support of Wikimedia’s mission: to help everyone share in the sum of all knowledge.The SRE team at Wikimedia is a globally distributed and diverse team of engineers with a drive to explore, experiment, and embrace new technologies. We work in the open by publishing all of our documentation, code, and configuration as open source, and all our production systems are powered by open source software. We invite you to go through our documentation and code -- no login required.If you find what we do interesting, if you are up to the challenge of improving the reliability and delivery of one of the Internet’s top websites, and you enjoy the idea of working in a remote-first role, we may just be the right place for you.You are responsible for:Performing day-to-day operational/DevOps tasks on Wikimedia’s public facing infrastructure (deployment, maintenance, configuration, troubleshooting)Implementing and utilizing configuration management and deployment tools (Puppet, Kubernetes)Leading continuous improvement, by automating the installation, configuration and maintenance of services on our platformWork closely with product teams helping them bring scalable functionality to our users by assisting in the architectural design of new services and making them operate at scaleParticipating in a 24/7 on-call rotation shared across the broader SRE team. This includes taking part in incident response, diagnosis and follow-up on system outages or alerts across Wikimedia’s production infrastructure.Collaborating with a global, cross-functional team in an asynchronous communication environmentMentoring peers in your areas of technical and operational strengthAbility and willingness to travel 1-2 times a year for in-person events and team meetingsMost importantly, share our values and work in accordance with themSkills and Experience:6+ years of experience in an SRE/Operations/DevOps role as part of a teamExperience with shell and any scripting languages used in an SRE context (Python, Go, Bash, Ruby; we primarily use Python) and configuration management tools (Puppet, Ansible; we use Puppet)Experience designing and managing infrastructure security for large fleets of diverse servicesExperience with technical response during security incidentsExperience with package management on Linux systems (we use Debian)Strong Linux system-level troubleshooting skillsHistory of automating tasks and processes, identifying process gaps, and finding automation opportunitiesStrong English language skills (verbal and written) and ability to work independently, as an effective part of a globally distributed team working across multiple time zonesExperience leading and participating in incident response and post-incident review rituals, with the goal of conducting root cause analysis and implementing preventive measures Additionally, we’d love it if you have:Experience setting and implementing fleet-wide security policiesExperience with software supply chain securityAwareness of the current open source infrastructure security landscapeExperience working together with software security teamsExperience with credential management systemsExperience implementing immutable logging and auditingExperience with the use, maintenance and configuration of monitoring, metrics and logging infrastructure (Prometheus, Grafana, etc.)Developing/contributing to Free and Open Source software, or being part of an open-source community (share your favourite pull requests!)Experience with LAMP stack technologies (PHP/HHVM, memcached/Redis) -- MediaWiki experience is a definite plusExperience with defining cross-team SLOs and their implementationAbout the Wikimedia FoundationThe Wikimedia Foundation is the nonprofit organization that operates Wikipedia and the other Wikimedia free knowledge projects. Our vision is a world in which every single human can freely share in the sum of all knowledge. We believe that everyone has the potential to contribute something to our shared knowledge, and that everyone should be able to access that knowledge freely. We host Wikipedia and the Wikimedia projects, build software experiences for reading, contributing, and sharing Wikimedia content, support the volunteer communities and partners who make Wikimedia possible, and advocate for policies that enable Wikimedia and free knowledge to thrive. The Wikimedia Foundation is a charitable, not-for-profit organization that relies on donations. We receive donations from millions of individuals around the world, with an average donation of about $15. We also receive donations through institutional grants and gifts. The Wikimedia Foundation is a United States 501(c)(3) tax-exempt organization with offices in San Francisco, California, USA.As an equal opportunity employer, the Wikimedia Foundation values having a diverse workforce and continuously strives to maintain an inclusive and equitable workplace. We encourage people with a diverse range of backgrounds to apply. We do not discriminate against any person based upon their race, traits historically associated with race, religion, color, national origin, sex, pregnancy or related medical conditions, parental status, sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, or any other legally protected characteristics.The Wikimedia Foundation is a remote-first organization with staff members including contractors based 40+ countries. Salaries at the Wikimedia Foundation are set in a way that is competitive, equitable, and consistent with our values and culture. The anticipated annual pay range of this position for applicants based within the United States is US$113,082 to US$175,725 with multiple individualized factors, including cost of living in the location, being the determinants of the offered pay. For applicants located outside of the US, the pay range will be adjusted to the country of hire. We neither ask for nor take into consideration the salary history of applicants. The compensation for a successful applicant will be based on their skills, experience and location.Please note that we are currently able to hire in the following:US States: Arizona, California, Colorado, Connecticut, District of Columbia, Florida, Georgia, Idaho, Illinois, Indiana, Iowa, Maryland, Massachusetts, Michigan, Minnesota, Missouri, New Jersey, New Mexico, New York, North Carolina, Ohio, Oklahoma, Oregon, Pennsylvania, Puerto Rico, Rhode Island, Tennessee, Texas, Utah, Vermont, Virginia, Washington, West Virginia, Wisconsin and Wyoming (US Territory or Federal District)Countries: Brazil, Canada, Colombia, France, Germany, Ghana, India, Indonesia, Italy, Kenya, Mexico, Morocco, Netherlands, Poland, Singapore, South Africa, Spain, Switzerland and the United Kingdom. Our non-US employees are hired through a local third party Employer of Record (EOR) and must have current work authorization in their location. (citizens/permanent residents only)We periodically review this list to streamline to ensure alignment with our hiring requirements.All applicants can reach out to their recruiter to understand more about the specific pay range for their location during the interview process.If you are a qualified applicant requiring assistance or an accommodation to complete any step of the application process due to a disability, you may contact us at recruiting@wikimedia.org or +1 (415) 839-6885.More informationU.S. Benefits & PerksApplicant Privacy PolicyWikimedia FoundationWhat does the Wikimedia Foundation do?What makes Wikipedia different from social media platforms?Our ProjectsOur Tech StackNews from across the Wikimedia movementWikimedia BlogWikimedia 2030Originally posted on Himalayas