Research

Channel Charting based beam selection

Channel Charting based beam selection

Millimeter Wave (mmWave) communication, offering wide bands, is a key enabling technology of Fifth Generation (5G) and Beyond 5G (B5G) communication systems to handle the explosive demand for high data rates. Beamforming and Massive Multiple-Input-MultipleOutput (mMIMO) antenna arrays at the Base Stations (BSs) are expected to provide directionality and beamforming gain to combat the high…

Curriculum Learning for mmWave Beam Selection

Curriculum Learning for mmWave Beam Selection

Curriculum Learning Curriculum Learning [1] is a biologically inspired procedure to train machine learning models. While it is usual practice to train Neural Networks (NNs) using batches of data sampled uniformly in random from the training dataset, curriculum learning mimics the way humans learn, starting from simpler training samples that unveil general and raw concepts,…

Anomaly Detection

Anomaly Detection

Managing and monitoring the performance of Internet of things (IoT) systems is a chore, albeit a necessary one in today’s life. With hundreds of thousands of things to monitor anomaly detection can aid in identifying where an error is occurring, improving root cause investigation and allowing for faster tech assistance. Anomaly detection aids in monitoring…

More humanoid agents with Hierarchical Reinforcement Learning

More humanoid agents with Hierarchical Reinforcement Learning

As you may have guessed from its name, Hierarchical Reinforcement Learning (HRL) is a family of Reinforcement Learning algorithms that decompose the problem into different hierarchies of subproblems or subtasks, and the higher-qlevel tasks invoke the primitive lower-level tasks. The goal of HRL is to learn a multilayer policy to perform control at different levels…

Collaborative Sensing in Cellular Networks

Collaborative Sensing in Cellular Networks

One of the potential solutions for tackling the problem of RF congestion is integrating sensing and communication infrastructures in a manner where they use the same frequency band in a controlled way. In our last paper, which is submitted to Journal of Selected Areas in Communications (JSAC), we have proposed a mechanism to perform multi-radar…

Grassmann Manifolds – Subspace Comparisons

In this article we will review the basic concepts related to Grassmann Manifolds and how they are applied in subspace comparison. The original motivation for this post can be found in the field of clustering of multi-antenna wireless communication [1], which is the focus of my research in the context of the Windmill project.  Quick…