Curriculum Learning for mmWave Beam Selection
Curriculum Learning Curriculum Learning [1] is a biologically inspired procedure to train machine learning models. While it is usual practice to train Neural Networks (NNs) using batches of data sampled uniformly in random from the training dataset, curriculum learning mimics the way humans learn, starting from simpler training samples that unveil general and raw concepts,…
More humanoid agents with Hierarchical Reinforcement Learning
As you may have guessed from its name, Hierarchical Reinforcement Learning (HRL) is a family of Reinforcement Learning algorithms that decompose the problem into different hierarchies of subproblems or subtasks, and the higher-qlevel tasks invoke the primitive lower-level tasks. The goal of HRL is to learn a multilayer policy to perform control at different levels…
Collaborative Sensing in Cellular Networks
One of the potential solutions for tackling the problem of RF congestion is integrating sensing and communication infrastructures in a manner where they use the same frequency band in a controlled way. In our last paper, which is submitted to Journal of Selected Areas in Communications (JSAC), we have proposed a mechanism to perform multi-radar…
Grassmann Manifolds – Subspace Comparisons
In this article we will review the basic concepts related to Grassmann Manifolds and how they are applied in subspace comparison. The original motivation for this post can be found in the field of clustering of multi-antenna wireless communication [1], which is the focus of my research in the context of the Windmill project. Quick…
What is Open-RAN and How ML Plays a Big Role in its Development?
In this post we will be talking about the following topics: What is Open RAN? Open RAN and 5G. Current challenges and its limitations. The importance of AI/ML for Open-RAN. Open RAN vs Legacy network architecture To start talking about open-RAN we can first have a look of how a traditional network architecture is designed:…
Far from Home: A travel for PhD
My life experiences have taught me one thing: always expect the unexpected. I am Anay Ajit Deshpande, pursuing my PhD in University of Padova, Italy. But this story is not about my time in Italy, it is about the moments leading up to it. Scene 1: Scrawny Little Child Born and raised slightly outside of…