Senior Systems Engineer (4 - 7 years of experience in Hadoop DevOps / Operations, Python, SQL, Shell)

About UsVisa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.Job DescriptionRole OverviewWe are seeking a Systems Engineer with strong experience in Hadoop and Big Data platform operations. The ideal candidate will have hands-on expertise with Hadoop ecosystem components, automation using Shell/Bash and Python, and experience supporting large-scale data pipelines and distributed systems.This role will be responsible for provisioning, maintaining, monitoring, scaling, and troubleshooting Hadoop clusters, as well as supporting automation, CI/CD processes, QA validation triggers, and operational improvements across Big Data platforms.ResponsibilitiesDevelop and maintain Shell/Bash scripts and Python-based automation scripts to streamline platform operations and improve overall efficiency.Automate recurring platform and data operations, including: Pipeline executionData validation triggersJob scheduling and orchestrationLog collection and monitoringAlerting and notification workflowsEnvironment health checksData archival processesDeployment activitiesDesign and implement automation solutions for new data job onboarding, configuration updates, infrastructure maintenance, and routine operational tasks.Support the automation, deployment, and operational management of ETL pipelines, data processing jobs, and Big Data workloads.Integrate automated QA validation checks into pipeline execution workflows to ensure data accuracy, completeness, and reliability.Capture, publish, and share QA validation results with engineering, data, and QA teams to improve visibility and accelerate issue resolution.Collaborate with data engineering teams to troubleshoot job failures, data quality issues, pipeline execution errors, and performance bottlenecks.Ensure data pipelines adhere to operational standards for reliability, observability, scalability, repeatability, and maintainability.Support migration initiatives for Big Data workloads from on-premises Hadoop environments to cloud platforms, preferably AWS.Assist with containerization and deployment of Big Data applications and services using Docker and Kubernetes.Work with CI/CD tools to automate build, test, and deployment processes, with hands-on experience in at least one of the following: JenkinsGitLab CIGitHub Actions  This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager.  Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.QualificationsBasic Qualifications2+ years of relevant work experience and a Bachelors degree, OR 5+ years of relevant work experience Preferred Qualifications3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD)3 - 6 years of hands-on experience supporting Hadoop, Big Data platforms, ETL pipelines, and distributed data systemsExperience with automation, scripting, CI/CD, and cloud migration initiatives, preferably involving AWSVisa is an EEO EmployerQualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.