Analytical Guarantees for Hyperparameter Free RFF Based Deep Learning in the Low-Data Regime

Analytical Guarantees for Hyperparameter Free RFF Based Deep Learning in the Low-Data Regime

R. Mitra, G. Kaddoum and G. Poitau, “Analytical Guarantees for Hyperparameter Free RFF Based Deep Learning in the Low-Data Regime,” in IEEE Transactions on Circuits and Systems II: Express Briefs, vol. 69, no. 2, pp. 634-638, Feb. 2022, doi: 10.1109/TCSII.2021.3096805.

Abstract or Summary

Deep-learning (DL) has emerged as promising for diverse signal-processing tasks concerning the next-generation of communication-systems, Internet of Things (IoT), and in circuit-design. However, existing DL based signal-processing methods are well-known to require large datasets to achieve good generalization. Moreover, the existing DL-based solutions are known for their sensitivity to the hyperparameter-choices and the DL-architecture. In this regard, existing DL-paradigms, such as meta-learning are useful to find optimal hyperparameter-values and architectures. In this work, generalized analytical results are provided for random Fourier feature-based DL (RFF-DL) that guarantee a degree of hyperparameter-independence and significantly improved generalization under data-limited applications. The benefits of RFF-DL promised by the presented analytical contributions are validated by a case study that improves low-pilot training for the next-generation IoT using the hyperparameter-free RFF based DL.

Implications of the Research

Visuals

Supplementary Materials

Acknowledgements

Citations and References

Other Publications

Back to top Drag