At Facebook, we have many opportunities to work with data each and every day. In this role as a Data Engineer on the Facebook Data Centers Data Science team, your primary responsibility will be to partner with key stakeholders, data scientists and software engineers to support and enable the continued growth critical to Facebook's Data Center organization. You will be responsible for creating the technology and data architecture that moves and translates data used to inform our most critical strategic and real-time decisions. You will also help translate business needs into requirements and identify efficiency opportunities. In addition to extracting and transforming data, you will be expected to use your expertise to build extensible data models, provide meaningful recommendations and actionable strategies to partnering data scientist for performance enhancements and development of best practices, including streamlining of data sources and related programmatic initiatives. The ideal candidate will have a passion for working in white space and creating impact from the ground up in a fast-paced environment. This position is part of the Infrastructure Data Center team.
Data Engineer Responsibilities
* Partner with leadership, engineers, program managers and data scientists to understand data needs.
* Apply proven expertise and build high-performance scalable data warehouses.
* Design, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts).
* Securely source external data from numerous partners.
* Intelligently design data models for optimal storage and retrieval.
* Deploy inclusive data quality checks to ensure high quality of data.
* Optimize existing pipelines and maintain of all domain-related data pipelines.
* Ownership of the end-to-end data engineering component of the solution.
* Support on-call shift as needed to support the team.
* Design and develop new systems in partnership with software engineers to enable quick and easy consumption of data.
Minimum Qualifications
* BS/MS in Computer Science or a related technical field.
* 5+ years of Python or other modern programming language development experience.
* 5+ years of SQL and relational databases experience.
* 5+ years experience in custom ETL design, implementation and maintenance.
* 3+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).
* 3+ years experience with Data Modeling.
* Experience working with cloud or on-prem Big Data/MPP analytics platform(i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar).
* 2+ years experience working with enterprise DE tools and experience learning in-house DE tools.
Preferred Qualifications
* Experience with more than one coding language.
* Designing and implementing real-time pipelines.
* Experience with data quality and validation.
* Experience with SQL performance tuning and e2e process optimization.
* Experience with anomaly/outlier detection.
* Experience with notebook-based Data Science workflow.
* Experience with Airflow.
* Experience querying massive datasets using Spark, Presto, Hive, Impala, etc.
Locations
About the Facebook company
Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities we're just getting started.
Facebook is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or who are neurodivergent, and to candidates with sincerely held religious beliefs or requiring pregnancy related support. If you need support, please reach out to accommodations-ext@fb.com.
Menlo Park, CA
Facebook, Inc. provides various products to connect and share through mobile devices, personal computers, and other surfaces worldwide. The company’s products include Facebook that enables people to connect, share, discover, and communicate with each other on mobile devices and personal computers; Instagram, a community for sharing photos, videos, and messages; Messenger, a messaging application for people to connect with friends, family, groups, and businesses across platforms and devices; and WhatsApp, a messaging application for use by people and businesses to communicate in a private way. It also provides Oculus, a hardware, software, and developer ecosystem, which allows people to come together and connect with each other through its Oculus virtual reality products. As of December 31, 2018, it had approximately 1.52 billion daily active users. The company was founded in 2004 and is headquartered in Menlo Park, California.