Job Description

Are you excited about the possibility of changing the world with Big Data by working on the largest Object Storage service in the world? Come join the Azure Storage team in building Azure Data Lake Storage and revolutionize the way Cloud Storage supports Big Data!

The Azure Storage team is currently chartered with building, managing, and running the Persistent Cloud Storage for Microsoft Azure Cloud. Azure Storage consists of a Storage Platform which currently powers five different storage services - Azure Data Lake Storage, Blob Storage, Table Storage (NoSql Key Value store), Queue Storage, File Storage (SMB based File Storage) and Disk Storage. We are one of the foundational services in the Azure Cloud. This service hosts data from some of the largest companies in the world plus supports all of Microsoft's largest online businesses including Xbox, One Drive, Skype and Bing, and has scaled to store exabytes of customer data with the roadmap looking even better in terms of growth. We have built a new foundational Storage service with ADLS (Azure Data Lake Storage) Gen 2 and one of the underpinnings of that is a scalable Hierarchical Namespace technology stack which this position is for.

You can read more about the Azure Storage Service architecture here: https://blogs.msdn.microsoft.com/windowsazurestorage/2011/11/20/sosp-paper-windows-azure-storage-a-highly-available-cloud-storage-service-with-strong-consistency/
and about the current storage offerings here: https://azure.microsoft.com/en-us/services/storage/
and watch an overview specifically about Azure Storage's Hierarchical Namespace here: Building File System Semantics for an Exabyte Scale Object Storage System

Storage is divided into four layers. This position is with the Hierarchical Namespace team, which forms the heart of File System semantics that are provided for Azure Data Lake Storage and is a critical part of Azure Storage's Analytics strategy. The Hierarchical Namespace provides: horizontally scalable hierarchical file system topology and capabilities, distributed transaction support, distributed caching of the hierarchy and namespace metadata, support for a variety of interfaces/protocols and Interoperability between them, geo replication, partitioning, multi tenancy, and many other capabilities. Additionally, the work for this position will cross many layers of the Azure Storage system and Azure as a whole, presenting unique engineering challenges for which we need top-notch talent. Right now is an exciting time for the team as we are working on expanding the range of supported scenarios for the service while working on the next version architecture of the storage service to support the next 100X growth. If you are excited about large scale data management problems, this is a unique opportunity to have an impact in a team unlike any other.

This role focuses on the Hierarchical Namespace layer and sits in a team in Azure Storage that is focused on Big Data, Analytics, and File Systems for Microsoft's Cloud Storage.

To be successful, you must thrive on solving problems related with data durability, availability and concurrency issues in a multi-tenant environment. You must have passion for storage and distributed systems. You will be challenged on a daily basis as you build the largest storage solution Microsoft has.

An ideal candidate will bring:
Strong distributed systems knowledge
Hands on development experience including designing and writing code
Proven ability to plan, schedule, and deliver high quality software
Passion for customers
Excellent collaboration skills
Namespace and/or Index Management experience is a plus but not strictly required
Big Data experience a plus (especially in the Hadoop and/or HPC ecosystem) but not strictly required

Basic Requirements:
5 years of building scalable system software and/or services in C/C++, C or Java.
BS/MS/PhD in Computer Science, Computer Engineering, Electrical Engineering or equivalent industry experience.

Cloud Background check:

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.