Software Engineer, CV & Machine Perception

The Facebook Reality Labs (FRL) Research Team brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as universal and essential as smartphones and personal computers are today. The Surreal Vision research group at FRL Research is seeking exceptional engineers and technical leads to solve the next generation of research challenges on the path to building future machine perception enabled technologies. This Surreal LiveMaps Index team role focuses on formulating, architecting and building a new generation of end-to-end Real Time on-device and large-scale cloud 3D scene understanding systems, working across novel mobile sensor design, sensor fusion, state estimation, computer vision, large-scale reconstruction, localization, semantics, and rendering as well as large-scale online inference and optimization. This role is for the candidate to provide excellent technical leadership for a small team of 3-7 in Surreal Index Pillar working on engineering/tooling/research incubation and focus the remainder of their time on technical contributions.

Software Engineer, CV & Machine Perception Responsibilities

• Plan and execute innovative engineering development to advance the state-of-the-art in machine perception, mapping, reconstruction and localization, as well as 3D scene understanding in AR/VR systems

• Collaborate closely with researchers and engineers across both machine and human perception teams at Facebook to design prototypes, and concepts related to large-scale, multi-user, systems distributed across cloud and Embedded devices at scale

• Establish a comprehensive and deep technical understanding of Livemaps Index and existing infrastructures within FB and industry, to help the Index team to make informed decisions

• Architect and communicate designs for Index services running both on Embedded devices and cloud

• Set the direction and goals for team, in terms of project impact, product quality, and engineering efficiency

• Lead design/technical direction, quality efforts, code reviews with the team and give clear and actionable feedback on a timely basis

• Gather use cases from both internal research teams and cross-functional partners to have a clear picture of the requirements for the Index platform

• Given the set of requirements, help formulate a coherent roadmap that delivers features in a progressive, incremental fashion

• Work closely with Index EMs and across the whole Surreal team to form dynamic virtual teams to pull together research features on the roadmap into end-to-end systems

• Concrete goals, priorities with ranked features needs to be set as clear expectations for the team to execute on

• Recruit new members to grow the team from bootcamp, industry and academia

• Onboard new members into the team, by mentoring them and making it easy to ramp up in the teams codebases and infra

• Communicate proactively, effectively, and efficiently, both vertically within the Surreal Index, and horizontally across different teams not only within Surreal, but also in cross-functional collaborations

• Proactively learn the bigger context, and bring the right level of context wherever necessary to increase the Index team's clarity and visibility

• The candidate will be responsible for helping Index EMs drive/orchestrate cross-functional collaborations, to understand their requirements and roadmap, identify commonalities, and further influence their development to accelerate the goals for the overall LiveMaps mission

• The candidate should help the cross-functional collaboration establish alignment on those investments and help the Surreal team to negotiate tech transfer, consolidation and long-term support plans wherever there is opportunity

Minimum Qualifications

• 6+ years of experience with real world system building, including design, coding (C++) and evaluation/testing (C++/Python)

• Bachelors degree in the following fields: Computer Science, Software Engineering, Computer Vision, Robotics, 3D Reconstruction, Mapping & Localization, or a related field

• 4+ years of hands-on experience implementing cloud services, distributed systems, depth sensor algorithms, 3D computer vision algorithms, Sensor Fusion, SLAM, Reconstruction, Mapping, Localization and Image Processing, or Deep Learning Frameworks

• 2+ years experience managing or leading small teams

Preferred Qualifications

• Experience with designing (products or open-source) software for inertial/optical/acoustic sensing devices or AR/VR devices

• Experience in Real Time computer graphics or modern GPU programming (CUDA, OpenGL, OpenCL)

• Experience designing or developing complex architectures across devices and cloud

• Experience in Embedded devices

• Experience working in a Unix environment