Job Description

At U.S. Bank, we're passionate about helping customers and the communities where we live and work. The fifth-largest bank in the United States, were one of the country's most respected, innovative and successful financial institutions. U.S. Bank is an equal opportunity employer committed to creating a diverse workforce. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability or veteran status, among other factors.

Job Description

Senior Big Data Engineer will execute true end-to-end development and testing of software products in an agile lifecycle. Partnering with key technical and business stakeholders, Senior Big Data Engineer will help refine the product vision, estimate and design a solution, create, purchase, or customize the requisite hardware and software to create the solution, ensure the quality of the final product through manual and automated tests, and support the new software as it is moved to production.

Primary Responsibilities:

Design and build large scale data processing system (real-time and batch) to address growing AI/ML and Data needs of a Fortune 500 company
Build a product to process large amount data/events for AI/ML and Data consumption
Automate test coverage (90+%) for data pipelines. Best practices and frameworks for unit, functional and integration tests.
Automate CI and deployment processes and best practices for the production data pipelines.
Build AI/ML model based alert mechanism and anomaly detection system for the product. The goal is have a self-annealing product

Basic Qualifications
Bachelors degree or equivalent work experience.
5+ years of relevant experience.

Preferred Skills/Experience
10+ years of overall experience in software development with 5-6 years of relevant experience in designing, developing, deploying and operating large data processing data pipelines at scale.
3-4 years experience with Apache Kafka and Apache Spark Streaming or Apache Flink
Strong background in programming (Scala Must, good to have knowledge on Java, Python)
Experience on building reusable data frameworks/modules
Experience on Airflow scheduler
Experience with Containers, Kubernetes and scaling elastically

Knowledge of ReactJS, GraphQL and API Development
Proficiency in working with Kafka
Knowledge front end, back end services, or full stack engineering
Demonstrated ability to tackle tough coding challenges independently and work closely with others on a highly productive coding team
Continuously develop and acquire new technical skills
Apache Flink experience

Strong background in algorithms and data structures
Strong analytical and problem solving skills
Strong bent towards engineering solutions which increase productivity of data consumers
Strong bent toward completely automated code deployment/testing (DevOps, CI/CD)
Passion for data engineering and for enabling others by making their data easier to access.
Some experience with working with and operating workflow or orchestration frameworks, including open source tools like Activiti, Spring Boot, Airflow and Luigi or commercial enterprise tools.
Excellent communication (writing, conversation, presentation) skills, consensus builder

Required Skills Summary: Apache Spark, Apache Kafka, Scala/Java/Python, NoSQL Databases, Elasticsearch & Kibana, Kubernetes, Docker Containers

Benefits:
Take care of yourself and your family with U.S. Bank employee benefits. We know that healthy employees are happy employees, and we believe that work/life balance should be easy to achieve. That's why we share the cost of benefits and offer a variety of programs, resources and support you need to bring your full self to work and stay present and committed to the people who matter most - your family.

Learn all about U.S. Bank employee benefits, including tuition reimbursement, retirement plans and more, by visiting usbank.com/careers.

EEO is the Law
Applicants can learn more about the companys status as an equal opportunity employer by viewing the federal EEO is the Law poster.

E-Verify

U.S. Bank participates in the U.S. Department of Homeland Security E-Verify program in all facilities located in the United States and certain U.S. territories. The E-Verify program is an Internet-based employment eligibility verification system operated by the U.S. Citizenship and Immigration Services. Learn more about the E-Verify program.