Senior Big Data Engineer - Remote
Posted on: 2 Mar 2021
Emeryville, CA
Job Description
Job Description
Senior Big Data Platform Engineer
Join us as we build a next-generation Enterprise Analytics Platform to reengineer a real estate enterprise. As a Senior Big Data Platform Engineer, you will be joining our Enterprise Analytics Platform Team to build EAP platform from ground up to serve agents, brokers, home buyers and sellers.
What were looking for:
Youre a talented, creative, and motivated Data Platform Engineer who loves to build data platform tools and ready to work with a team of individuals who share your passion. With a related degree under your belt--and relevant experience--youre ready to take your programming and data knowledge to the next level. You enjoy building tools such as Data Ingestion Platform to ingest data from diverse sources to Data Lake, building data lake tools to ingest data, monitor pipelines, and grant access to data. With your unwavering commitment to quality, excellent data/cloud skills, and collaborative work ethic, youll do great things here at Realogy AI Lab.
What youll do:
* Youll be responsible for designing and building high performance, scalable data solutions that meet the needs of millions of agents, brokers, home buyers, and sellers.
* Youll work with other Data Engineers for build out of Next Generation Data Ingestion Platform.
* Youll design and develop data ingestion pipelines for batch and real-time streaming of data from in-house OLTP systems and third-party data.
* Youll work with team to design and develop Data Lake to store and process 10s of terabyte of data.
* Youll work with team to design Data Lake CLI to manage Data Lake Storage and Access.
* You will design and develop ETL pipelines to process data in data lake for descriptive and prescriptive reporting.
* Youll develop ETL data pipelines to build Enterprise Data Models for Property, Agent, Broker, office and other master entities.
* You will design and develop CI/CD process for continuous delivery in AWS Cloud.
* Youll design, develop, and test robust, scalable data platform components.
* Youll work with a variety of teams and individuals, including product engineers to understand their data pipeline needs and come up with innovative solutions.
EDUCATION AND EXPERIENCE/SPECIAL SKILLS/TECHNOLOGIES/TOOLS REQUIREMENTS: (include travel and/or foreign language requirements) (if applicable). When using experience as a requirement, please quantify the number of years required.
* Bachelors in Computer Science, Engineering, or related technical discipline or equivalent combination of training and experience.
* 10+ years programming experience: building business logic layers and back-end systems for high-volume pipelines.
* 2 years' experience with Golang.
* 2 years' experience with Spark, Spark SQL, and Scala.
* 2 years' experience using AWS Data Services: any combination of DMS, EMR, Glue, Athena, S3, CloudWatch, Lambda or IAM.
* 2 years' experience with high-speed messaging frameworks and streaming (Kafka).
* 1-year exp. with data architecture, ETL and processing of structured and unstructured data.
* 2 years' experience with DevOps tools (any combination of GitHub, Travis CI or Jira) and methodologies (Lean, Agile, Scrum, Test Driven Development)
* Excellent written and verbal communication skills in English.
* This position can be performed anywhere except Colorado.
LI-KD1
LI-Remote
Realogy Holdings Corp.
Madison, New Jersey
Realogy is a global provider of real estate services with a singular mission: We serve agents. This strategy is aimed at growing the base of high-performing independent sales agents at our company-owned and franchisee brokerages, providing services to make them more productive and their businesses more profitable.
While you won’t see our name on For Sale signs, you will see those of our industry-leading brands: Better Homes and Gardens Real Estate, Century 21, Citi Habitats, Climb Real Estate, Coldwell Banker Real Estate, Corcoran, ERA Franchise Systems and Sotheby’s International Realty to name just a few. Our four business units work together to provide a full-service solution to meet the needs of agents and their homebuying clients, from the initial listing until the keys are turned over.
Realogy was recently designated a Great Place to Work® for the second consecutive year, recognizing the company’s commitment to providing meaningful work and an environment where employees can grow and succeed. Realogy has 16,600 offices and approximately 302,000 affiliated brokers and agents worldwide. We’re the leader in residential real estate sales, with $6.1 billion in revenue in 2018, nearly 1.4 million real estate transactions and approximately 16 percent of market share of the U.S. residential real estate market. We’re there to serve agents who help people find and buy houses, move, and finance their dream.
Powered by its network of over 92,000 affiliated sales professionals in 3,000 offices across 44 countries and territories, the Coldwell Banker® organization is a leading provider of full-service residential and commercial real estate brokerage services. The brand’s mission is to empower its people to leave their mark on the world of real estate. The Coldwell Banker brand prides itself on its history of expertise and honesty since its beginnings in 1906. The brand embraces four core values: home, awesomeness, ingenuity and excellence. Coldwell Banker Real Estate is committed to providing its network of sales professionals with the tools and insights needed to excel in today’s marketplace and is known for its bold leadership and dedication to driving the industry forward with big data and smart home expertise. Coldwell Banker Real Estate was the first real estate brand to harness the power of big data; the CBx Technology Suite uses predictive analytics and machine learning to analyze markets, target buyers and sellers and provide agents with a simple platform to create unique and effective marketing plans for each listing. The brand was named among the 2018 and 2019 Women’s Choice Award® Most Recommended brands for customer experience and overall quality. Blue is bold and the integrity and values of Coldwell Banker Real Estate give the Gen Blue® network an unbeatable edge. Coldwell Banker®, the Coldwell Banker logo, Gen Blue® and the Gen Blue Experience® are registered services marks owned by Coldwell Banker Real Estate LLC. Coldwell Banker Real Estate LLC fully supports the principles of the Fair Housing Act and the Equal Opportunity Act. Each office is independently owned and operated.
-
IndustryReal Estate Services
-
No. of Employees11,800+
-
Website
-
Jobs Posted585
