PhD position on Sparse Training for Energy-Efficient Deep Learning

The main goals of this PhD project are:

• Develop novel sparse training algorithms that improve the scalability and energy efficiency of deep neural networks.
• Investigate the mathematical underpinnings of sparsity in deep learning and its effects on learning dynamics, and generalization.
• Implement and benchmark sparse training methods to scale up deep learning.
• Publish and present research findings in top-tier conferences (e.g., NeurIPS, ICLR, ICML, IJCAI, AAMAS, ECMLPKDD) and journals (e.g., Machine Learning, JMLR).
• Collaborate with an international team of researchers and industry partners.

The successful candidate will be embedded in the DMB research group, and the supervision will be ensured by Dr. Elena Mocanu and Prof.dr. Maurice van Keulen. This PhD position is part of the Modular Integrated Sustainable Datacenter (MISD) project and will have ample collaboration opportunities. As part of the MISD project effort led by Elena Mocanu, we are opening multiple positions (two Ph.D. candidates and one PostDoc) to join us and work at the interplay of dynamic sparse training in neural networks on various tasks.

Useful links:

• Elena Mocanu webpage
• DMB research group
• MISD project
• Sample of our work on sparsity

Requirements:

• You are a scientific curiosity driven researcher;
• You have, or will shortly, acquire a master degree in the field of Computer Science, Mathematics, or a related field;
• You have excellent analytical, problem-solving, and communication skills.
• You have excellent coding and math skills (or the willingness and capacity to learn);
• You have the desire to conduct outstanding research and publish in high-quality Artificial Intelligence conferences and journals;
• You have a good team spirit and like to work in an interdisciplinary and internationally oriented environment.
• You are proficient in English

Salary Benefits:

• As a PhD candidate at UT, you will be appointed to a full-time position for four years, with a qualifier in the first year, within a very stimulating and exciting scientific environment;
• The University offers a dynamic ecosystem with enthusiastic colleagues;
• Your salary and associated conditions are in accordance with the collective labour agreement for Dutch universities (CAO-NU);
• You will receive a gross monthly salary ranging from € 2.770,- (first year) to € 3.539,- (fourth year);
• There are excellent benefits including a holiday allowance of 8% of the gross annual salary, an end-of-year bonus of 8.3%, and a solid pension scheme;
• The flexibility to work (partially) from home;
• A minimum of 232 leave hours in case of full-time employment based on a formal workweek of 38 hours. A full-time employment in practice means 40 hours a week, therefore resulting in 96 extra leave hours on an annual basis.
• Free access to sports facilities on campus
• A family-friendly institution that offers parental leave (both paid and unpaid);
• You will have a training programme as part of the Twente Graduate School where you and your supervisors will determine a plan for a suitable education and supervision;
• We encourage a high degree of responsibility and independence, while collaborating with close colleagues, researchers and other staff.

40 hours per week

Drienerlolaan 5