Job Description

The Facebook Reality Labs (FRL) Research Team brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as universal and essential as smartphones and personal computers are today. The Surreal Vision research group at FRL Research is seeking exceptional engineers and technical leads to solve the next generation of research challenges on the path to building future machine perception enabled technologies. This Surreal LiveMaps Index team role focuses on formulating, architecting and building a new generation of end-to-end real-time on-device and large-scale cloud 3D scene understanding systems, working across novel mobile sensor design, sensor fusion, state estimation, computer vision, large-scale reconstruction, localization, semantics, and rendering as well as large-scale online inference and optimization. This role is for the candidate to provide excellent technical leadership for a small team of 3-7 in Surreal Index Pillar working on engineering/tooling/research incubation and focus the remainder of their time on technical contributions.

Software Engineer, CV & Machine Perception Responsibilities

* Plan and execute innovative engineering development to advance the state-of-the-art in machine perception, mapping, reconstruction and localization, as well as 3D scene understanding in AR/VR systems

* Collaborate closely with researchers and engineers across both machine and human perception teams at Facebook to design prototypes, and concepts related to large-scale, multi-user, systems distributed across cloud and embedded devices at scale

* Establish a comprehensive and deep technical understanding of Livemaps Index and existing infrastructures within FB and industry, to help the Index team to make informed decisions

* Architect and communicate designs for Index services running both on embedded devices and cloud

* Set the direction and goals for team, in terms of project impact, product quality, and engineering efficiency

* Lead design/technical direction, quality efforts, code reviews with the team and give clear and actionable feedback on a timely basis

* Gather use cases from both internal research teams and cross-functional partners to have a clear picture of the requirements for the Index platform

* Given the set of requirements, help formulate a coherent roadmap that delivers features in a progressive, incremental fashion

* Work closely with Index EMs and across the whole Surreal team to form dynamic virtual teams to pull together research features on the roadmap into end-to-end systems

* Concrete goals, priorities with ranked features needs to be set as clear expectations for the team to execute on

* Recruit new members to grow the team from bootcamp, industry and academia

* Onboard new members into the team, by mentoring them and making it easy to ramp up in the team's codebases and infra

* Communicate proactively, effectively, and efficiently, both vertically within the Surreal Index, and horizontally across different teams not only within Surreal, but also in cross-functional collaborations

* Proactively learn the bigger context, and bring the right level of context wherever necessary to increase the Index teams clarity and visibility

* The candidate will be responsible for helping Index EMs drive/orchestrate cross-functional collaborations, to understand their requirements and roadmap, identify commonalities, and further influence their development to accelerate the goals for the overall LiveMaps mission

* The candidate should help the cross-functional collaboration establish alignment on those investments and help the Surreal team to negotiate tech transfer, consolidation and long-term support plans wherever there is opportunity

Minimum Qualifications

* 6+ years of experience with real world system building, including design, coding (C++) and evaluation/testing (C++/Python)

* Bachelors degree in the following fields: Computer Science, Software Engineering, Computer Vision, Robotics, 3D Reconstruction, Mapping & Localization, or a related field

* 4+ years of hands-on experience implementing cloud services, distributed systems, depth sensor algorithms, 3D computer vision algorithms, Sensor Fusion, SLAM, Reconstruction, Mapping, Localization and Image Processing, or Deep Learning Frameworks

* 2+ years experience managing or leading small teams

Preferred Qualifications

* Experience with designing (products or open-source) software for inertial/optical/acoustic sensing devices or AR/VR devices

* Experience in real-time computer graphics or modern GPU programming (CUDA, OpenGL, OpenCL)

* Experience designing or developing complex architectures across devices and cloud

* Experience in embedded devices

* Experience working in a Unix environment

Locations

About the Facebook company

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities we're just getting started.

Facebook is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or who are neurodivergent, and to candidates with sincerely held religious beliefs or requiring pregnancy related support. If you need support, please reach out to accommodations-ext@fb.com.