Senior Systems Development Engineer

What we need 

We are looking for a Senior System Development Engineer to join our IT Infrastructure Systems team within our Enterprise IT organization. The ideal candidate has a strong background in Linux systems administration, deep knowledge of distributed storage and file systems, and proficiency in programming and scripting to automate tasks and build durable solutions. Operational expectations include but are not limited to technical stewardship in the areas of research and development, automated implementations, infrastructure support and escalation, policy documentation, supporting security and compliance processes, small project management, and leveraging third party services when appropriate. 

What we do 

As a Sr. Systems Developemnt Engineer, you will be an integral part of the team that designs, builds, automates, and maintains the distributed compute and storage architecture powering Symbotic’s solutions.  You'll have a lead role in ensuring the reliability, performance, and scalability of systems at massive, worldwide scale. Your work will involve building and maintaining automation tools, designing fault-tolerant systems, and optimizing our storage solutions to handle massive data throughput. You'll use your expertise to proactively identify and resolve performance bottlenecks, implement robust monitoring and alerting, and participate in an on-call rotation to quickly address production incidents. 

What you’ll do 

• Ensure the reliability, performance, and scalability of our compute and storage systems at a global scale. 

• Design, build, and maintain automation tools for infrastructure deployment, configuration, and management. 

• Architect fault-tolerant systems and disaster recovery strategies for on-premise edge and public cloud environments. 

• Proactively identify and resolve performance bottlenecks and system inefficiencies through comprehensive monitoring and alerting. 

• Provide day-to-day technical leadership for our server and storage infrastructure, ensuring system availability, performance, and security compliance. 

• Standardize systems by developing and documenting policies and standard operating procedures (SOPs) for handoff to scaled operations teams. 

• Conduct research on new technologies and provide recommendations for system improvements, cost-effectiveness, and flexibility. Review new and existing system designs, providing critical feedback to improve architecture and operational efficiency. 

• Participate in an on-call rotation as an escalation point for major site incidents. Drive incident management processes from detection and triage to resolution and blameless post-mortems, focusing on root cause analysis and continuous improvement. 

What you’ll need 

• Bachelor’s degree in computer science or a related field 

• Minimum of 10 years of experience in architecting IT infrastructure solutions in enterprise environments  

• Minimum of 5 years of experience in infrastructure automation and configuration management using Ansible, Terraform, and similar tools. 

• Coding/scripting proficiency in Python, Go, shell scripting, or similar. 

• Experience in designing, implementing, and maintaining scalable, secure, and highly available public cloud infrastructure. 

• Significant experience building or maintaining bare metal K8S container infrastructure at the edge. 

• Experience in deploying and maintaining modern distributed storage systems (Ceph, etc). 

• Experience in distributed version control systems like GitHub, Gitlab etc. 

• Proficiency with modern monitoring solutions including Grafana, Prometheus, and Loki. 

• Experience with capacity/performance management, monitoring, and tuning 

• Able to contribute to system design/decisions and the technical direction of projects. 

• Available for on-call support on a rotating basis. 

Our environment