Job Description

If you like challenges and want to learn and practice how to build data capabilities to support large-scale machine learning solutions, this is your unique opportunity.

The Data4ML team inside Azure Machine Learning is hiring an extremely talented, highly motivated and productive Engineering Manager, working on building the data capabilities to support large-scale machine learning solutions. The interest and adoption of AI technologies in industry has grown tremendously in last several years. Azure Machine Learning provides a platform solution to support building large-scale machine learning solutions. One of the key challenges with machine learning, is how to prepare, process, manage and connect the data sets used for machine learning. Largely speaking, the quality and performance of data sets decide the effectiveness of machine learning models. The Data4ML team is tasked for this challenge.

As the scale of machine learning workload grows, it is a common practice that users need to cache the dataset for better training performance and reliability. Data caching is a challenging problem which involves careful system design and tremendous operational cost. Putting those efforts on user's plate leads to user frictions and pains. The Managed Data Cache in Azure Machine Learning is targeting to address such challenges and pains. It provides a fully transparent and managed layer of data cache for the machine learning users. It enables users to easily manage the data cache operations through policies and relieve them from the heavy manual operations. It also aims to provide high speed cache solutions by integrating with both 1st party and 3rd party cache solutions (lustre, alluxio, Azure premium blob).

The area also provides challenges from different fronts. The solution involves building UX experience, large-scale backend services, and Open Source software. The scale of data, and variety of caching solutions, provides great technical challenges. We need talents with strong system architecture, design and implementation skills to build a scalable system, as well as experience in state-of-art machine learning practice to understand and design the best experience.

You will be part of a very strong and fun team, developing advanced and practical large-scale service and Azure solution. Here, you have the right environment and strong support to drive your favorite features to solution. You are empowered to influence millions of end users. You will have opportunities to work together with world class developers and researchers to stay in the forefront of advancing technologies, such as machine learning, big data, deep learning, online experimentation, cloud computing.

* Leading a team to build large-scale data services and best user experience.
* Leading the architectural design about how Managed data cache integrated with the whole AzureML framework, and other Azure infrastructure.
* Set the vision in these areas.
* Understand the user scenario and business drivers, making resource calls.
* Work very closely with other teams in AzureML, as well as the Azure Storage and HPC teams.
* Help to build and grow talent in these areas.

Required Qualifications:

* 8+ years' experience working in design and development of platforms and systems.
* 8+ years of software design and development skills/experience
* A minimum of a Bachelor's degree in Computer Science, or a related field, or equivalent alternative education, skills, and/or practical experience is required.
* 5+ years of experience in Python, .NET. Open source experience a plus.
* 3+ years of experience on leading projects cross multiple people or teams.

Preferred Qualifications:

* Experience on running high reliable service a strong plus.
* Ability to drive technical investigations and prototyping in a fast-paced startup environment
* Experience with test driven software design/development is a plus.
* Superior communication skills, both verbal and written.
* Passionate, self-motivated, strong driving skills.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.