Neural Architecture Search

DiffusionNAG: Predictor-guided Neural Architecture Generation with Diffusion Models
Existing NAS methods suffer from either an excessive amount of time for repetitive sampling and training of many task-irrelevant …
Sohyun An*, Hayeon Lee*, Jaehyeong Jo, Seanie Lee, Sung Ju Hwang
Cite PDF Code
Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets
Distillation-aware Neural Architecture Search (DaNAS) aims to search for an optimal student architecture that obtains the best …
Hayeon Lee*, Sohyun An*, Minseon Kim, Sung Ju Hwang
Cite PDF Code
Lightweight Neural Architecture Search with Parameter Remapping and Knowledge Distillation
Designing diverse neural architectures taking into account resource constraints or datasets is one of the main challenges in Neural …
Hayeon Lee*, Sohyun An*, Minseon Kim, Sung Ju Hwang
Cite PDF