Software Engineer, Data Infrastructure
Posted on: 9 Dec 2021
San Francisco, CA
Job Description
What You'll Do
You are responsible for building & managing our cloud infrastructure(AWS)with code first mindset and security as top priority.
Design, implement & maintain our mission critical data processing services like Hive, Spark, Kafka, Presto, Airflow, etc.
Design, implement & maintain our ML experimentation platform enabling our teams to quickly test and iterate on their ML hypothesis via ML training capabilities, first class notebook solutions, pipeline infrastructure, etc.
Provide infrastructure for serving ML models in production ensuring performance, reliability and ease of use.
Continuously improve our operations by automating manual processes, optimizing cloud infrastructure costs, improving reliability, etc.
About You
You’re passionate about enabling others by building tools & services.
You have excellent listening skills and empathetic to others.
You believe in simple and elegant solutions and give paramount importance to quality.
You’ve a track record of shipping working software fast and reliably.
B.S., M.S. or Ph.D. degree in computer science or a related field or equivalent work experience.
At least 5+ years of professional coding experience writing production quality code, preferably Python or Java.
Solid experience in building and running production services at scale on any public cloud platform, preferably AWS.
Strong knowledge and implementation history of Terraform, Packer, Ansible, Chef, Jenkins or other similar tooling.
Solid knowledge and working experience with distributed data processing services like Hive, Spark, Kafka, Presto, etc.
Experience with data pipelines and pipeline orchestration services like Airflow.
Working knowledge of open-source ML frameworks and end-to-end model development life cycle.
Previous working experience with running containers (Docker/LXC) in a production environment using one of the container orchestration services (Kubernetes, Docker Swarm, AWS ECS, AWS EKS).
LendingClub
San Francisco, CA
LendingClub is a US peer-to-peer lending company, headquartered in San Francisco, California. It was the first peer-to-peer lender to register its offerings as securities with the Securities and Exchange Commission (SEC), and to offer loan trading on a secondary market. LendingClub is the world's largest peer-to-peer lending platform. The company claims that $15.98 billion in loans had been originated through its platform up to December 31, 2015.
LendingClub enables borrowers to create unsecured personal loans between $1,000 and $40,000. The standard loan period is three years. Investors can search and browse the loan listings on LendingClub website and select loans that they want to invest in based on the information supplied about the borrower, amount of loan, loan grade, and loan purpose. Investors make money from interest. LendingClub makes money by charging borrowers an origination fee and investors a service fee.
LendingClub also makes traditional direct to consumer loans, including automobile refinance transactions, through WebBank, an FDIC-insured, state-chartered industrial bank that is headquartered in Salt Lake City Utah. The loans are not funded by investors but are assigned to other financial institutions.
The company raised $1 billion in what became the largest technology IPO of 2014 in the United States. Though viewed as a pioneer in the fintech industry and one of the largest such firms, LendingClub experienced problems in early 2016, with difficulties in attracting investors, a scandal over some of the firm's loans and concerns by the board over CEO Renaud Laplanche's disclosures leading to a large drop in its share price and Laplanche's resignation.
-
IndustryPublic Services
-
No. of Employees1,837
-
Website
-
Jobs Posted181
