new research areas for machine learning

Suggestions or feedback?

MIT News | Massachusetts Institute of Technology

Machine learning.

• Social justice
• Black holes
• Classes and programs

Departments

• Aeronautics and Astronautics
• Brain and Cognitive Sciences
• Architecture
• Political Science
• Mechanical Engineering

Centers, Labs, & Programs

• Abdul Latif Jameel Poverty Action Lab (J-PAL)
• Picower Institute for Learning and Memory
• Lincoln Laboratory
• School of Architecture + Planning
• School of Engineering
• School of Humanities, Arts, and Social Sciences
• Sloan School of Management
• School of Science
• MIT Schwarzman College of Computing

Download RSS feed: News Articles / In the Media / Audio

A first-ever complete map for elastic strain engineering

New research by a team of MIT engineers offers a guide for fine-tuning specific material properties.

March 29, 2024

Read full story →

Second round of seed grants awarded to MIT scholars studying the impact and applications of generative AI

The 16 finalists — representing every school at MIT — will explore generative AI’s impact on privacy, art, drug discovery, aging, and more.

March 28, 2024

MIT-derived algorithm helps forecast the frequency of extreme weather

The new approach “nudges” existing climate simulations closer to future reality.

March 26, 2024

Engineering household robots to have a little common sense

With help from a large language model, MIT engineers enabled robots to self-correct after missteps and carry on with their chores.

March 25, 2024

Large language models use a surprisingly simple mechanism to retrieve some stored knowledge

Researchers demonstrate a technique that can be used to probe a model to see what it knows about new subjects.

AI generates high-quality images 30 times faster in a single step

Novel method makes tools like Stable Diffusion and DALL-E-3 faster by simplifying the image-generating process to a single step while maintaining or enhancing image quality.

March 21, 2024

New algorithm unlocks high-resolution insights for computer vision

FeatUp, developed by MIT CSAIL researchers, boosts the resolution of any deep network or visual foundation for computer vision systems.

March 18, 2024

Five MIT faculty members take on Cancer Grand Challenges

Joining three teams backed by a total of $75 million, MIT researchers will tackle some of cancer’s toughest challenges.

3 Questions: What you need to know about audio deepfakes

MIT CSAIL postdoc Nauman Dawalatabad explores ethical considerations, challenges in spear-phishing defense, and the optimistic future of AI-created voices across various sectors.

March 15, 2024

Exploring the cellular neighborhood

Software allows scientists to model shapeshifting proteins in native cellular environments.

March 11, 2024

Researchers enhance peripheral vision in AI models

By enabling models to see the world more like humans do, the work could help improve driver safety and shed light on human behavior.

March 8, 2024

Using generative AI to improve software testing

MIT spinout DataCebo helps companies bolster their datasets by creating synthetic data that mimic the real thing.

March 5, 2024

Startup accelerates progress toward light-speed computing

Lightmatter, founded by three MIT alumni, is using photonic technologies to reinvent how chips communicate and calculate.

March 1, 2024

Dealing with the limitations of our noisy world

Tamara Broderick uses statistical approaches to understand and quantify the uncertainty that can affect study results.

New AI model could streamline operations in a robotic warehouse

By breaking an intractable problem into smaller chunks, a deep-learning technique identifies the optimal areas for thinning out traffic in a warehouse.

February 27, 2024

Massachusetts Institute of Technology 77 Massachusetts Avenue, Cambridge, MA, USA

• Map (opens in new window)
• Events (opens in new window)
• People (opens in new window)
• Careers (opens in new window)
• Accessibility
• Social Media Hub
• MIT on Facebook
• MIT on YouTube
• MIT on Instagram

Advancements in machine learning for machine learning

With the recent and accelerated advances in machine learning (ML), machines can understand natural language , engage in conversations , draw images , create videos and more. Modern ML models are programmed and trained using ML programming frameworks, such as TensorFlow , JAX , PyTorch , among many others. These libraries provide high-level instructions to ML practitioners, such as linear algebra operations (e.g., matrix multiplication, convolution, etc.) and neural network layers (e.g., 2D convolution layers , transformer layers ). Importantly, practitioners need not worry about how to make their models run efficiently on hardware because an ML framework will automatically optimize the user's model through an underlying compiler . The efficiency of the ML workload, thus, depends on how good the compiler is. A compiler typically relies on heuristics to solve complex optimization problems, often resulting in suboptimal performance.

In this blog post, we present exciting advancements in ML for ML. In particular, we show how we use ML to improve efficiency of ML workloads! Prior works, both internal and external, have shown that we can use ML to improve performance of ML programs by selecting better ML compiler decisions. Although there exist a few datasets for program performance prediction, they target small sub-programs, such as basic blocks or kernels. We introduce “ TpuGraphs: A Performance Prediction Dataset on Large Tensor Computational Graphs ” (presented at NeurIPS 2023 ), which we recently released to fuel more research in ML for program optimization. We hosted a Kaggle competition on the dataset, which recently completed with 792 participants on 616 teams from 66 countries. Furthermore, in “ Learning Large Graph Property Prediction via Graph Segment Training ”, we cover a novel method to scale graph neural network (GNN) training to handle large programs represented as graphs. The technique both enables training arbitrarily large graphs on a device with limited memory capacity and improves generalization of the model.

ML compilers

ML compilers are software routines that convert user-written programs (here, mathematical instructions provided by libraries such as TensorFlow) to executables (instructions to execute on the actual hardware). An ML program can be represented as a computation graph, where a node represents a tensor operation (such as matrix multiplication ), and an edge represents a tensor flowing from one node to another. ML compilers have to solve many complex optimization problems, including graph-level and kernel-level optimizations. A graph-level optimization requires the context of the entire graph to make optimal decisions and transforms the entire graph accordingly. A kernel-level optimization transforms one kernel (a fused subgraph) at a time, independently of other kernels.

To provide a concrete example, imagine a matrix (2D tensor):

It can be stored in computer memory as [A B C a b c] or [A a B b C c], known as row- and column-major memory layout , respectively. One important ML compiler optimization is to assign memory layouts to all intermediate tensors in the program. The figure below shows two different layout configurations for the same program. Let’s assume that on the left-hand side, the assigned layouts (in red) are the most efficient option for each individual operator. However, this layout configuration requires the compiler to insert a copy operation to transform the memory layout between the add and convolution operations. On the other hand, the right-hand side configuration might be less efficient for each individual operator, but it doesn’t require the additional memory transformation. The layout assignment optimization has to trade off between local computation efficiency and layout transformation overhead.

If the compiler makes optimal choices, significant speedups can be made. For example, we have seen up to a 32% speedup when choosing an optimal layout configuration over the default compiler’s configuration in the XLA benchmark suite.

TpuGraphs dataset

Given the above, we aim to improve ML model efficiency by improving the ML compiler. Specifically, it can be very effective to equip the compiler with a learned cost model that takes in an input program and compiler configuration and then outputs the predicted runtime of the program.

With this motivation, we release TpuGraphs , a dataset for learning cost models for programs running on Google’s custom Tensor Processing Units (TPUs). The dataset targets two XLA compiler configurations: layout (generalization of row- and column-major ordering, from matrices, to higher dimension tensors) and tiling (configurations of tile sizes). We provide download instructions and starter code on the TpuGraphs GitHub . Each example in the dataset contains a computational graph of an ML workload, a compilation configuration, and the execution time of the graph when compiled with the configuration. The graphs in the dataset are collected from open-source ML programs, featuring popular model architectures, e.g., ResNet , EfficientNet , Mask R-CNN , and Transformer . The dataset provides 25× more graphs than the largest (earlier) graph property prediction dataset (with comparable graph sizes), and graph size is 770× larger on average compared to existing performance prediction datasets on ML programs. With this greatly expanded scale, for the first time we can explore the graph-level prediction task on large graphs, which is subject to challenges such as scalability, training efficiency, and model quality.

We provide baseline learned cost models with our dataset (architecture shown below). Our baseline models are based on a GNN since the input program is represented as a graph. Node features, shown in blue below, consist of two parts. The first part is an opcode id , the most important information of a node, which indicates the type of tensor operation. Our baseline models, thus, map an opcode id to an opcode embedding via an embedding lookup table. The opcode embedding is then concatenated with the second part, the rest of the node features, as inputs to a GNN. We combine the node embeddings produced by the GNN to create the fixed-size embedding of the graph using a simple graph pooling reduction (i.e., sum and mean). The resulting graph embedding is then linearly transformed into the final scalar output by a feedforward layer.

Furthermore we present Graph Segment Training (GST), a method for scaling GNN training to handle large graphs on a device with limited memory capacity in cases where the prediction task is on the entire-graph (i.e., graph-level prediction). Unlike scaling training for node- or edge-level prediction, scaling for graph-level prediction is understudied but crucial to our domain, as computation graphs can contain hundreds of thousands of nodes. In a typical GNN training (“Full Graph Training”, on the left below), a GNN model is trained using an entire graph, meaning all nodes and edges of the graph are used to compute gradients. For large graphs, this might be computationally infeasible. In GST, each large graph is partitioned into smaller segments, and a random subset of segments is selected to update the model; embeddings for the remaining segments are produced without saving their intermediate activations (to avoid consuming memory). The embeddings of all segments are then combined to generate an embedding for the original large graph, which is then used for prediction. In addition, we introduce the historical embedding table to efficiently obtain graph segments’ embeddings and segment dropout to mitigate the staleness from historical embeddings. Together, our complete method speeds up the end-to-end training time by 3×.

Kaggle competition

Finally, we ran the “ Fast or Slow? Predict AI Model Runtime ” competition over the TpuGraph dataset. This competition ended with 792 participants on 616 teams. We had 10507 submissions from 66 countries. For 153 users (including 47 in the top 100), this was their first competition. We learned many interesting new techniques employed by the participating teams, such as:

• Graph pruning / compression : Instead of using the GST method, many teams experimented with different ways to compress large graphs (e.g., keeping only subgraphs that include the configurable nodes and their immediate neighbors).
• Feature padding value : Some teams observed that the default padding value of 0 is problematic because 0 clashes with a valid feature value, so using a padding value of -1 can improve the model accuracy significantly.
• Node features : Some teams observed that additional node features (such as dot general’s contracting dimensions ) are important. A few teams found that different encodings of node features also matter.
• Cross-configuration attention : A winning team designed a simple layer that allows the model to explicitly "compare" configs against each other. This technique is shown to be much better than letting the model infer for each config individually.

We will debrief the competition and preview the winning solutions at the competition session at the ML for Systems workshop at NeurIPS on December 16, 2023. Finally, congratulations to all the winners and thank you for your contributions to advancing research in ML for systems!

NeurIPS expo

If you are interested in more research about structured data and artificial intelligence, we hosted the NeurIPS Expo panel Graph Learning Meets Artificial Intelligence on December 9, which covered advancing learned cost models and more!

Acknowledgements

Sami Abu-el-Haija (Google Research) contributed significantly to this work and write-up. The research in this post describes joint work with many additional collaborators including Mike Burrows, Kaidi Cao, Bahare Fatemi, Jure Leskovec, Charith Mendis, Dustin Zelle, and Yanqi Zhou.

Frequently Asked Questions

Journal of Machine Learning Research

The Journal of Machine Learning Research (JMLR), established in 2000 , provides an international forum for the electronic and paper publication of high-quality scholarly articles in all areas of machine learning. All published papers are freely available online.

• 2024.02.18 : Volume 24 completed; Volume 25 began.
• 2023.01.20 : Volume 23 completed; Volume 24 began.
• 2022.07.20 : New special issue on climate change .
• 2022.02.18 : New blog post: Retrospectives from 20 Years of JMLR .
• 2022.01.25 : Volume 22 completed; Volume 23 began.
• 2021.12.02 : Message from outgoing co-EiC Bernhard Schölkopf .
• 2021.02.10 : Volume 21 completed; Volume 22 began.
• More news ...

Latest papers

Trained Transformers Learn Linear Models In-Context Ruiqi Zhang, Spencer Frei, Peter L. Bartlett , 2024. [ abs ][ pdf ][ bib ]

Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees Nachuan Xiao, Xiaoyin Hu, Xin Liu, Kim-Chuan Toh , 2024. [ abs ][ pdf ][ bib ]

Efficient Modality Selection in Multimodal Learning Yifei He, Runxiang Cheng, Gargi Balasubramaniam, Yao-Hung Hubert Tsai, Han Zhao , 2024. [ abs ][ pdf ][ bib ]

A Multilabel Classification Framework for Approximate Nearest Neighbor Search Ville Hyvönen, Elias Jääsaari, Teemu Roos , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Probabilistic Forecasting with Generative Networks via Scoring Rule Minimization Lorenzo Pacchiardi, Rilwan A. Adewoyin, Peter Dueben, Ritabrata Dutta , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Multiple Descent in the Multiple Random Feature Model Xuran Meng, Jianfeng Yao, Yuan Cao , 2024. [ abs ][ pdf ][ bib ]

Mean-Square Analysis of Discretized Itô Diffusions for Heavy-tailed Sampling Ye He, Tyler Farghly, Krishnakumar Balasubramanian, Murat A. Erdogdu , 2024. [ abs ][ pdf ][ bib ]

Invariant and Equivariant Reynolds Networks Akiyoshi Sannai, Makoto Kawano, Wataru Kumagai , 2024. (Machine Learning Open Source Software Paper) [ abs ][ pdf ][ bib ]      [ code ]

Personalized PCA: Decoupling Shared and Unique Features Naichen Shi, Raed Al Kontar , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Survival Kernets: Scalable and Interpretable Deep Kernel Survival Analysis with an Accuracy Guarantee George H. Chen , 2024. [ abs ][ pdf ][ bib ]      [ code ]

On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control Amrit Singh Bedi, Anjaly Parayil, Junyu Zhang, Mengdi Wang, Alec Koppel , 2024. [ abs ][ pdf ][ bib ]

Convergence for nonconvex ADMM, with applications to CT imaging Rina Foygel Barber, Emil Y. Sidky , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithms T. Tony Cai, Hongji Wei , 2024. [ abs ][ pdf ][ bib ]

Sparse NMF with Archetypal Regularization: Computational and Robustness Properties Kayhan Behdin, Rahul Mazumder , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Deep Network Approximation: Beyond ReLU to Diverse Activation Functions Shijun Zhang, Jianfeng Lu, Hongkai Zhao , 2024. [ abs ][ pdf ][ bib ]

Effect-Invariant Mechanisms for Policy Generalization Sorawit Saengkyongam, Niklas Pfister, Predrag Klasnja, Susan Murphy, Jonas Peters , 2024. [ abs ][ pdf ][ bib ]

Pygmtools: A Python Graph Matching Toolkit Runzhong Wang, Ziao Guo, Wenzheng Pan, Jiale Ma, Yikai Zhang, Nan Yang, Qi Liu, Longxuan Wei, Hanxue Zhang, Chang Liu, Zetian Jiang, Xiaokang Yang, Junchi Yan , 2024. (Machine Learning Open Source Software Paper) [ abs ][ pdf ][ bib ]      [ code ]

Heterogeneous-Agent Reinforcement Learning Yifan Zhong, Jakub Grudzien Kuba, Xidong Feng, Siyi Hu, Jiaming Ji, Yaodong Yang , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Sample-efficient Adversarial Imitation Learning Dahuin Jung, Hyungyu Lee, Sungroh Yoon , 2024. [ abs ][ pdf ][ bib ]

Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent Benjamin Gess, Sebastian Kassing, Vitalii Konarovskyi , 2024. [ abs ][ pdf ][ bib ]

Rates of convergence for density estimation with generative adversarial networks Nikita Puchkin, Sergey Samsonov, Denis Belomestny, Eric Moulines, Alexey Naumov , 2024. [ abs ][ pdf ][ bib ]

Additive smoothing error in backward variational inference for general state-space models Mathis Chagneux, Elisabeth Gassiat, Pierre Gloaguen, Sylvain Le Corff , 2024. [ abs ][ pdf ][ bib ]

Optimal Bump Functions for Shallow ReLU networks: Weight Decay, Depth Separation, Curse of Dimensionality Stephan Wojtowytsch , 2024. [ abs ][ pdf ][ bib ]

Numerically Stable Sparse Gaussian Processes via Minimum Separation using Cover Trees Alexander Terenin, David R. Burt, Artem Artemev, Seth Flaxman, Mark van der Wilk, Carl Edward Rasmussen, Hong Ge , 2024. [ abs ][ pdf ][ bib ]      [ code ]

On Tail Decay Rate Estimation of Loss Function Distributions Etrit Haxholli, Marco Lorenzi , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Deep Nonparametric Estimation of Operators between Infinite Dimensional Spaces Hao Liu, Haizhao Yang, Minshuo Chen, Tuo Zhao, Wenjing Liao , 2024. [ abs ][ pdf ][ bib ]

Post-Regularization Confidence Bands for Ordinary Differential Equations Xiaowu Dai, Lexin Li , 2024. [ abs ][ pdf ][ bib ]

On the Generalization of Stochastic Gradient Descent with Momentum Ali Ramezani-Kebrya, Kimon Antonakopoulos, Volkan Cevher, Ashish Khisti, Ben Liang , 2024. [ abs ][ pdf ][ bib ]

Pursuit of the Cluster Structure of Network Lasso: Recovery Condition and Non-convex Extension Shotaro Yagishita, Jun-ya Gotoh , 2024. [ abs ][ pdf ][ bib ]

Iterate Averaging in the Quest for Best Test Error Diego Granziol, Nicholas P. Baskerville, Xingchen Wan, Samuel Albanie, Stephen Roberts , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Nonparametric Inference under B-bits Quantization Kexuan Li, Ruiqi Liu, Ganggang Xu, Zuofeng Shang , 2024. [ abs ][ pdf ][ bib ]

Black Box Variational Inference with a Deterministic Objective: Faster, More Accurate, and Even More Black Box Ryan Giordano, Martin Ingram, Tamara Broderick , 2024. [ abs ][ pdf ][ bib ]      [ code ]

On Sufficient Graphical Models Bing Li, Kyongwon Kim , 2024. [ abs ][ pdf ][ bib ]

Localized Debiased Machine Learning: Efficient Inference on Quantile Treatment Effects and Beyond Nathan Kallus, Xiaojie Mao, Masatoshi Uehara , 2024. [ abs ][ pdf ][ bib ]      [ code ]

On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks Sebastian Neumayer, Lénaïc Chizat, Michael Unser , 2024. [ abs ][ pdf ][ bib ]

Improving physics-informed neural networks with meta-learned optimization Alex Bihlo , 2024. [ abs ][ pdf ][ bib ]

A Comparison of Continuous-Time Approximations to Stochastic Gradient Descent Stefan Ankirchner, Stefan Perko , 2024. [ abs ][ pdf ][ bib ]

Critically Assessing the State of the Art in Neural Network Verification Matthias König, Annelot W. Bosman, Holger H. Hoos, Jan N. van Rijn , 2024. [ abs ][ pdf ][ bib ]

Estimating the Minimizer and the Minimum Value of a Regression Function under Passive Design Arya Akhavan, Davit Gogolashvili, Alexandre B. Tsybakov , 2024. [ abs ][ pdf ][ bib ]

Modeling Random Networks with Heterogeneous Reciprocity Daniel Cirkovic, Tiandong Wang , 2024. [ abs ][ pdf ][ bib ]

Exploration, Exploitation, and Engagement in Multi-Armed Bandits with Abandonment Zixian Yang, Xin Liu, Lei Ying , 2024. [ abs ][ pdf ][ bib ]

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models Yangjing Zhang, Ying Cui, Bodhisattva Sen, Kim-Chuan Toh , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Decorrelated Variable Importance Isabella Verdinelli, Larry Wasserman , 2024. [ abs ][ pdf ][ bib ]

Model-Free Representation Learning and Exploration in Low-Rank MDPs Aditya Modi, Jinglin Chen, Akshay Krishnamurthy, Nan Jiang, Alekh Agarwal , 2024. [ abs ][ pdf ][ bib ]

Seeded Graph Matching for the Correlated Gaussian Wigner Model via the Projected Power Method Ernesto Araya, Guillaume Braun, Hemant Tyagi , 2024. [ abs ][ pdf ][ bib ]      [ code ]

Fast Policy Extragradient Methods for Competitive Games with Entropy Regularization Shicong Cen, Yuting Wei, Yuejie Chi , 2024. [ abs ][ pdf ][ bib ]

Power of knockoff: The impact of ranking algorithm, augmented design, and symmetric statistic Zheng Tracy Ke, Jun S. Liu, Yucong Ma , 2024. [ abs ][ pdf ][ bib ]

Lower Complexity Bounds of Finite-Sum Optimization Problems: The Results and Construction Yuze Han, Guangzeng Xie, Zhihua Zhang , 2024. [ abs ][ pdf ][ bib ]

On Truthing Issues in Supervised Classification Jonathan K. Su , 2024. [ abs ][ pdf ][ bib ]

machine learning Recently Published Documents

Total documents.

• Latest Documents
• Most Cited Documents
• Contributed Authors
• Related Sources
• Related Keywords

An explainable machine learning model for identifying geographical origins of sea cucumber Apostichopus japonicus based on multi-element profile

A comparison of machine learning- and regression-based models for predicting ductility ratio of rc beam-column joints, alexa, is this a historical record.

Digital transformation in government has brought an increase in the scale, variety, and complexity of records and greater levels of disorganised data. Current practices for selecting records for transfer to The National Archives (TNA) were developed to deal with paper records and are struggling to deal with this shift. This article examines the background to the problem and outlines a project that TNA undertook to research the feasibility of using commercially available artificial intelligence tools to aid selection. The project AI for Selection evaluated a range of commercial solutions varying from off-the-shelf products to cloud-hosted machine learning platforms, as well as a benchmarking tool developed in-house. Suitability of tools depended on several factors, including requirements and skills of transferring bodies as well as the tools’ usability and configurability. This article also explores questions around trust and explainability of decisions made when using AI for sensitive tasks such as selection.

Automated Text Classification of Maintenance Data of Higher Education Buildings Using Text Mining and Machine Learning Techniques

Data-driven analysis and machine learning for energy prediction in distributed photovoltaic generation plants: a case study in queensland, australia, modeling nutrient removal by membrane bioreactor at a sewage treatment plant using machine learning models, big five personality prediction based in indonesian tweets using machine learning methods.

<span lang="EN-US">The popularity of social media has drawn the attention of researchers who have conducted cross-disciplinary studies examining the relationship between personality traits and behavior on social media. Most current work focuses on personality prediction analysis of English texts, but Indonesian has received scant attention. Therefore, this research aims to predict user’s personalities based on Indonesian text from social media using machine learning techniques. This paper evaluates several machine learning techniques, including <a name="_Hlk87278444"></a>naive Bayes (NB), K-nearest neighbors (KNN), and support vector machine (SVM), based on semantic features including emotion, sentiment, and publicly available Twitter profile. We predict the personality based on the big five personality model, the most appropriate model for predicting user personality in social media. We examine the relationships between the semantic features and the Big Five personality dimensions. The experimental results indicate that the Big Five personality exhibit distinct emotional, sentimental, and social characteristics and that SVM outperformed NB and KNN for Indonesian. In addition, we observe several terms in Indonesian that specifically refer to each personality type, each of which has distinct emotional, sentimental, and social features.</span>

Compressive strength of concrete with recycled aggregate; a machine learning-based evaluation

Temperature prediction of flat steel box girders of long-span bridges utilizing in situ environmental parameters and machine learning, computer-assisted cohort identification in practice.

The standard approach to expert-in-the-loop machine learning is active learning, where, repeatedly, an expert is asked to annotate one or more records and the machine finds a classifier that respects all annotations made until that point. We propose an alternative approach, IQRef , in which the expert iteratively designs a classifier and the machine helps him or her to determine how well it is performing and, importantly, when to stop, by reporting statistics on a fixed, hold-out sample of annotated records. We justify our approach based on prior work giving a theoretical model of how to re-use hold-out data. We compare the two approaches in the context of identifying a cohort of EHRs and examine their strengths and weaknesses through a case study arising from an optometric research problem. We conclude that both approaches are complementary, and we recommend that they both be employed in conjunction to address the problem of cohort identification in health research.

Export Citation Format

Share document.

• Skip to primary navigation
• Skip to main content
• Skip to primary sidebar
• Skip to footer

PyImageSearch

You can master Computer Vision, Deep Learning, and OpenCV - PyImageSearch

Algorithms Artificial Intelligence Data Science Deep Learning Machine Learning

Exploring the Landscape of Machine Learning: Techniques, Applications, and Insights

by Hector Martinez on April 1, 2024

Table of Contents

Introduction: the power of machine learning in modern industries, what is machine learning, understanding the core types of machine learning techniques, supervised learning: from basics to real-world applications explained, unsupervised learning explained: discovering hidden patterns, bridging the gap with semi-supervised learning: enhancing data understanding, core machine learning techniques for business innovation, deep learning: unleashing the power of neural networks, leveraging transfer learning for efficient ai development, federated learning: privacy-preserving machine learning, meta-learning: teaching ai to learn more effectively, deep learning breakthroughs, generative adversarial networks (gans): innovations in synthetic data, transformers in nlp: beyond conventional models, reinforced learning: strategies for a model to learn from interaction, machine learning for solving real-world problems, understanding different machine learning problem types, solving classification problems with machine learning, solving regression problems through machine learning techniques, clustering problems: unsupervised learning approaches, detecting anomalies: unsupervised learning for anomaly detection, optimizing decision-making with reinforcement learning: strategies and applications, leveraging machine learning for strategic advantages across industries, exploring the backbone of ai: a guide to machine learning algorithms, comprehensive guide to machine learning algorithms, decision trees: key to classification and regression, random forests for enhanced prediction accuracy, support vector machines (svm) in machine learning.

• Neural Networks: The Brain Behind AI’s Decision-Making

K-Nearest Neighbors (KNN): A Go-To Algorithm for Precision

Principal component analysis (pca): simplifying data with dimensionality reduction, clustering algorithms: grouping data with machine learning, the critical role of labels in machine learning algorithms, harnessing semi-supervised learning to reduce labeling costs, exploring unsupervised learning: beyond labels, maximizing rewards with reinforcement learning, leveraging analytical learning for data-driven decisions, high-dimensional data with analytical models, summary: mastering machine learning for real-world solutions.

The field of machine learning is taking the world by storm, revolutionizing various industries that range from healthcare to finance to transportation. With the massive amounts of data that businesses and organizations now generate, machine learning algorithms have become a critical tool for extracting insights and making informed decisions. There are different types of machine learning available, each with its own unique advantages and drawbacks. In this article, we’ll delve into the four primary forms of machine learning: supervised learning, unsupervised learning, semi-supervised learning, and reinforced learning.

Note: This blog post is meant to be a guide to the ever-changing landscape of AI and Machine Learning. If you already have some familiarity with fundamental topics, you probably don’t need this, and can check out some of our more advanced blog posts here .

Machine learning (ML) is a type of artificial intelligence (AI) that’s focused on creating algorithms that can learn from data and improve their performance over time. Instead of explicitly programming them for every task, machine learning algorithms are designed to automatically identify patterns in data and use those patterns to make predictions or decisions.

To get a more grounded, code-first introduction to machine learning, read here .

This is the most common type of machine learning, and it is used when the data is labeled. In this case, the algorithm learns to map inputs to outputs based on examples of labeled data. The input data is referred to as features, and the output data is referred to as the label or target. Supervised learning aims to use these labeled examples to train the algorithm to make accurate predictions on new, unlabeled data.

There are two main types of supervised learning: classification and regression. Classification is used when the output is a categorical variable, and the algorithm needs to predict the category where the input data belongs. Examples of classification tasks include image recognition, sentiment analysis, and spam detection. Regression is used when the output is a continuous variable, and the algorithm needs to predict a numerical value. Examples of regression tasks include predicting housing prices, weather forecasting, and stock market analysis.

Unsupervised learning is used when the data is unlabeled. In this case, the algorithm learns to find patterns and relationships in the data without explicit guidance. Unsupervised learning aims to explore the data structure and discover any hidden patterns or groupings.

Several types of unsupervised learning include clustering, dimensionality reduction, and anomaly detection. Clustering is used to group similar data points based on their similarities, while dimensionality reduction is used to reduce the number of features in the data to simplify the problem. Finally, anomaly detection is used to identify unusual data points that do not fit the normal patterns of the data.

Semi-supervised learning is used when the data is partially labeled. In this case, the algorithm uses labeled and unlabeled data to make predictions. Semi-supervised learning aims to use the labeled data to guide the learning process and improve the accuracy of the predictions.

Semi-supervised learning is often used when data labeling is expensive or time-consuming, such as in medical imaging or natural language processing. By using the available labeled data to guide the learning process, semi-supervised learning can achieve high levels of accuracy with less labeled data than would be required for supervised learning.

Machine learning is a powerful tool that can help businesses and organizations make better decisions and gain new insights into their data. Understanding the different types of machine learning is essential for choosing the right approach for a given problem. Whether you are working with labeled or unlabeled data, or whether you need to learn through trial and error, there is a type of machine learning that can help you achieve your goals.

The field of machine learning is advancing rapidly, and new techniques and algorithms are being developed at an ever-increasing rate. In this blog post, we will explore some of the latest and cutting-edge machine learning techniques that are currently making waves in the industry.

Some of our tutorials provide you with the tools and techniques required for business innovation in the field of Deep Learning and Computer Vision.

1. Deep Learning

• Self-Driving Cars: Deep learning algorithms excel at object detection and recognition, which is crucial for self-driving cars to navigate safely. They can identify pedestrians, vehicles, traffic signs, and more in real-time.
• Medical Diagnosis: Deep learning can analyze medical images like X-rays, mammograms, and MRIs to detect abnormalities or diseases, aiding doctors in diagnosis and treatment planning.
• Facial Recognition: Deep learning powers facial recognition systems used for security purposes, access control, and even personalized marketing.

2. Embedded Systems

• Internet of Things (IoT): Embedded systems equipped with computer vision capabilities can be used in smart homes for tasks like object recognition (security cameras) or facial recognition (smart door locks).
• Industrial Automation: Embedded systems with machine learning can perform real-time quality control in factories, identify defects in products, or predict equipment maintenance needs.
• Robotics: Embedded systems with computer vision allow robots to navigate their environment, identify objects for manipulation, and interact with the physical world more intelligently.

3. Optical Character Recognition (OCR)

• Document Automation: OCR can automate data entry tasks by extracting text from scanned documents, invoices, or receipts, saving time and reducing errors.
• Self-Service Systems: Libraries and banks use OCR scanners to automate book check-in/out or process checks for deposit.
• Accessibility Tools: OCR technology can convert printed text into audio for visually impaired individuals, making documents and information more accessible.

4. Machine Learning

• Recommendation Systems: Machine-learning algorithms power recommendation systems on e-commerce platforms or streaming services, suggesting products or content users might be interested in.
• Fraud Detection: Machine learning can analyze financial transactions to identify fraudulent activity in real-time, protecting users from financial harm.
• Spam Filtering: Machine learning algorithms can analyze email content to identify and filter spam messages, keeping your inbox clean and organized.

These are just a few examples, and the potential applications of these technologies continue to grow as computer vision and machine learning advancements accelerate. Explore these resources on PyImageSearch to delve deeper into the practical implementations of these techniques in various real-world scenarios.

Deep learning is a subset of machine learning based on artificial neural networks. It has been a hot topic in the machine-learning community for several years. It has been used in a wide range of applications, from speech recognition to image classification to natural language processing.

The key advantage of deep learning is its ability to learn and extract features from large, complex datasets. This is achieved by building a hierarchy of neural networks, where each layer extracts increasingly complex features from the input data. Deep learning has also been shown to outperform traditional machine learning algorithms in many tasks.

Transfer learning is a technique that allows a pre-trained model to be used for a new task with minimal additional training. This is achieved by leveraging the knowledge that the pre-trained model has already learned and transferring it to the new task. Read more about the practical aspects of Transfer Learning in the tutorial from Figure 1 .

Transfer learning has become popular in recent years because it can significantly reduce the data and training time required for a new task. It has been used in a wide range of applications, including natural language processing, image recognition, and speech recognition. Here’s how it can be applied to various applications:

1. Object Detection

• Pre-trained Models: Popular choices include VGG16, ResNet50, or InceptionV3 trained on ImageNet (a massive image dataset with thousands of object categories).
• Freeze the initial layers of the pre-trained model (these layers learn generic features like edges and shapes).
• Add new layers on top specifically designed for object detection (like bounding box prediction).
• Train the new layers with your custom object detection dataset.
• Benefits: Significantly reduces training time compared to training from scratch and leverages pre-learned features for better object detection accuracy.

2. OCR (Optical Character Recognition)

• Pre-trained Models: These are trained on large text datasets like MNIST (handwritten digits) or COCO-Text (images with text captions).
• Freeze the initial layers responsible for extracting low-level image features.
• Add new layers (e.g., convolutional layers) specifically designed for character recognition.
• Train the new layers with your custom dataset, which contains images of the specific text format you want to recognize (e.g., invoices, receipts, license plates).
• Benefits: Faster training and improved accuracy for recognizing specific text formats compared to training from scratch.

3. Image Classification

• Pre-trained Models: Similar to object detection, models like VGG16 or ResNet50 can be used.
• Freeze the initial layers of the pre-trained model.
• Add a new fully connected layer at the end with the number of neurons matching your classification categories.
• Train the new layer with your custom image dataset labeled for your specific classification task (e.g., classifying types of flowers and different breeds of dogs).
• Benefits: Reduces training time and leverages pre-learned features for improved image classification accuracy on new datasets.

Additional Points:

• Fine-tuning the Model: To achieve optimal results, you can adjust the learning rate of the newly added layers compared to the frozen pre-trained layers.
• Transfer Learning Limitations: While powerful, transfer learning might not be ideal for entirely new visual concepts not present in the pre-trained model’s training data. In such cases, custom model training from scratch might be necessary.

By leveraging transfer learning, we can achieve significant performance improvements in various computer vision tasks with less training data and computational resources.

Federated learning is a technique that allows multiple devices to collaboratively learn a model without sharing their data. This is achieved by training the model locally on each device and then aggregating the results to create a global model.

Federated learning has become popular in applications where data privacy is a concern, such as healthcare and finance. It allows models to be trained on data that cannot be centralized, such as data stored on individual devices or in different geographic locations.

Meta-learning is a technique that allows a model to learn how to learn. This is achieved by training the model on a variety of tasks and environments so it can quickly adapt to new tasks and environments.

Meta-learning has been used in a wide range of applications, from computer vision to natural language processing. It has the potential to significantly reduce the amount of training data and time required for a new task, making it a powerful tool for machine learning.

These are just a few of the many new and cutting-edge machine-learning techniques being developed. As the field of machine learning continues to advance, we can expect to see many more exciting developments in the coming years. By staying up-to-date with the latest trends and techniques, you can stay ahead of the curve and unlock the full potential of machine learning in your organization.

Generative Adversarial Networks (GANs) are a type of deep learning model that has gained a lot of attention in recent years. GANs consist of two neural networks: a generator and a discriminator. The generator creates synthetic data that is similar to the real data, and the discriminator tries to distinguish between the real and synthetic data.

The goal of GANs is to train the generator to create synthetic data that is indistinguishable from real data. This data can be used for tasks such as image synthesis and data augmentation. GANs have also been used in other applications, such as generating realistic 3D models and creating deepfakes.

Transformers are a type of deep learning model that has gained a lot of attention in recent years, particularly in the field of natural language processing (NLP). The transformer architecture was introduced by Vaswani et al. (2017) and has since become a popular choice for a wide range of NLP tasks.

Traditional NLP models, such as recurrent neural networks (RNNs) and convolutional neural networks (CNNs), process input sequences in a linear fashion. This can lead to difficulties in modeling long-range dependencies and capturing relationships between words that are far apart in the input sequence. Transformers, on the other hand, transformers use a self-attention mechanism to process input sequences in a parallel fashion, allowing them to model long-range dependencies more effectively.

In a transformer, the input sequence is first embedded into a high-dimensional vector space. Then, multiple layers of self-attention and feedforward neural networks are applied to the input sequence in parallel. The self-attention mechanism allows the model to focus on different parts of the input sequence and learn to associate words that are far apart in the sequence. The feedforward neural networks will enable the model to learn more complex interactions between the words.

At PyImageSearch, we have crafted a three-part tutorial on Transformers (shown in Figure 2 ) to take you from the basics of attention mechanism to creating your own transformer for Neural Machine Translation.

One of the transformers’ key advantages is their ability to handle variable-length input sequences. This is particularly useful in NLP, where input sequences can vary greatly in length. In addition, transformers have been shown to outperform traditional NLP models on a wide range of tasks, including language modeling, machine translation, and text classification.

One of the most popular implementations of transformers is the BERT (Bidirectional Encoder Representations from Transformers) model, which was introduced by Google in 2018. BERT uses a transformer-based architecture to generate contextualized word embeddings, which are then used as input to downstream NLP tasks. BERT has achieved state-of-the-art performance on many NLP tasks, including sentiment analysis, question answering, and named entity recognition.

Another popular implementation of transformers is the GPT (Generative Pre-training Transformer) model, which was introduced by OpenAI in 2018. GPT uses a transformer-based architecture to generate text, and it has been used to generate realistic, human-like text in a wide range of applications, from chatbots to creative writing.

Transformers are a powerful type of deep learning model that has revolutionized the field of NLP. Their ability to handle variable-length input sequences and model long-range dependencies has made them a popular choice for a wide range of NLP tasks. As the field of NLP continues to advance, we can expect to see many more exciting developments in the area of transformer-based models.

Reinforced learning is used when the algorithm needs to learn through trial and error. In this case, the algorithm interacts with an environment and receives rewards or penalties for its actions. Reinforced learning aims to learn the optimal policy, or set of actions, that maximizes the cumulative reward over time.

Reinforced learning is often used in robotics, gaming, and autonomous vehicles. In these cases, the algorithm must learn how to navigate a complex environment and make decisions that lead to the desired outcome. By receiving feedback in rewards or penalties, the algorithm can learn from its mistakes and improve over time.

Machine learning is a powerful tool for solving a wide range of problems in many different industries. By analyzing large datasets and extracting patterns and insights, machine learning algorithms can help businesses and organizations make better decisions, improve efficiency, and reduce costs. In this blog post, we will explore some of the types of problems that can be solved with machine learning.

Classification problems are one of the most common types of problems that can be solved with machine learning. In a classification problem, the goal is to assign a label to an input based on its features. For example, a machine learning algorithm could be used to classify emails as spam or not spam or to classify images as dogs or cats.

Classification problems are often solved using supervised learning algorithms, such as decision trees, support vector machines, and neural networks. These algorithms learn to map input features to output labels by analyzing examples of labeled data.

Regression problems are another common type of problem that can be solved with machine learning. In a regression problem, the goal is to predict a continuous output value based on the input features. For example, a machine learning algorithm could be used to predict housing prices based on features such as square footage, number of bedrooms, and location.

Regression problems are also often solved using supervised learning algorithms, such as linear regression, decision trees, and neural networks. These algorithms learn to map input features to output values by analyzing examples of labeled data.

Clustering problems are a type of unsupervised learning problem. In a clustering problem, the goal is to group similar items based on their features. For example, a machine learning algorithm could be used to cluster customers based on their purchasing habits, or to group documents based on their content.

Clustering problems are often solved using unsupervised learning algorithms, such as k-means clustering, hierarchical clustering, and density-based clustering. These algorithms learn to identify patterns in the data by analyzing examples of unlabeled data.

Anomaly detection problems are another type of unsupervised learning problem. In an anomaly detection problem, the goal is to identify unusual data points that do not fit the normal patterns of the data. For example, a machine learning algorithm could be used to detect fraudulent credit card transactions based on patterns in the transaction data.

Anomaly detection problems are often solved using unsupervised learning algorithms, such as density-based clustering and autoencoders. These algorithms learn to identify patterns in the data by analyzing examples of unlabeled data.

Reinforcement learning problems are a type of machine learning problem where the goal is to learn a policy, or set of actions, that maximizes a reward signal over time. For example, a machine learning algorithm could be used to learn to play a game or navigate a robot through a maze.

Reinforcement learning problems are often solved using reinforcement learning algorithms, such as Q-learning and policy gradient methods. These algorithms learn to optimize a policy by exploring the environment and receiving feedback in the form of rewards or penalties.

Machine learning can solve a wide range of problems in many different industries. By using machine learning algorithms to analyze large datasets, businesses, and organizations can gain new insights and make better decisions, leading to improved efficiency and reduced costs.

Machine learning algorithms are the backbone of many artificial intelligence (AI) applications. Several types of algorithms are commonly used in machine learning, each with its own strengths and weaknesses. In this blog post, we will explore some of the different types of algorithms in machine learning.

Decision trees are a type of supervised learning algorithm that is commonly used for classification and regression tasks. The algorithm works by recursively splitting the data based on the values of the input features until each leaf node contains a single output value. Decision trees are easy to interpret and can handle both categorical and continuous data.

Random forests are a type of ensemble learning algorithm that combines multiple decision trees to improve the accuracy of the predictions. The algorithm works by creating a set of decision trees, each trained on a random subset of the data and features. Random forests are often used for classification and regression tasks and can handle large datasets with high-dimensional features.

Support vector machines (SVMs) are a type of supervised learning algorithm that is commonly used for classification and regression tasks. The algorithm works by finding a hyperplane that maximally separates the data into different classes or predicts a continuous output value. SVMs can handle both linear and nonlinear data and are effective for high-dimensional data with a small number of training examples.

Neural Networks: The Brain Behind AI’s Decision-Making

Neural networks are a type of supervised learning algorithm that is commonly used for classification and regression tasks. The algorithm works by simulating the function of the human brain with a network of interconnected nodes that process the input data. Neural networks are effective for high-dimensional data with complex relationships between the input features.

K-nearest neighbors (KNN) is a type of supervised learning algorithm that is commonly used for classification and regression tasks. The algorithm works by finding the k nearest neighbors to a given data point and using their labels or values to predict the output for the new data point. KNN can handle both continuous and categorical data and is effective for small datasets with low-dimensional features.

Principal component analysis is an unsupervised learning algorithm that is commonly used for dimensionality reduction. The algorithm works by finding the principal components of the data, which are the linear combinations of the input features that capture the most variance in the data. PCA can be used to reduce the dimensionality of the data, making it easier to visualize and analyze.

Clustering algorithms are unsupervised learning algorithms that group similar data points based on their features. There are several types of clustering algorithms, including k-means, hierarchical clustering, and density-based clustering. Clustering algorithms can be used to identify patterns in the data and find hidden structures.

As you can see, many different types of algorithms are used in machine learning. Each algorithm has its own strengths and weaknesses, and the choice of algorithm depends on the type of data and the specific task at hand. By using the right algorithm for the job, businesses and organizations can gain new insights and make better decisions based on the analysis of their data.

Labels are an essential component of many machine-learning algorithms. In supervised learning, labels are used to train a model to predict output values based on input features. The process of labeling data is time-consuming and requires expertise, but it is a necessary step in building effective machine-learning models.

In supervised learning, labels are attached to each data point in the training set, indicating the correct output value for that data point. For example, if the input is an image, the label might indicate whether the image contains a dog or a cat. If the input is a sentence, the label might indicate the sentiment of the sentence (positive, negative, or neutral).

Labeling data is typically done manually, either by humans or by using other machine learning algorithms. Human labeling can be time-consuming and expensive, especially for large datasets. However, it is often necessary to ensure high-quality labels, particularly for complex tasks or tasks that require human expertise.

One way to reduce the cost and time required for labeling is through semi-supervised learning. In semi-supervised learning, a small portion of the data is labeled, and the rest of the data is left unlabeled. The model is then trained on the labeled data, and the knowledge gained from this training is used to make predictions for the unlabeled data. This can be a cost-effective way to train a machine learning model, particularly for large datasets.

In addition to supervised learning, labels are also used in unsupervised learning algorithms. In clustering algorithms, for example, the goal is to group similar data points based on their features. While the data points may not have explicit labels, the clusters themselves can be used to infer labels or insights about the data.

Labels are also used in reinforcement learning, where the goal is to learn a policy that maximizes a reward signal over time. In this case, the reward signal acts as a label, indicating the correct action to take in a given situation.

You probably noticed by now that labels are an essential component of many machine learning algorithms. While the process of labeling data can be time-consuming and expensive, it is necessary to train effective machine learning models. By using labeled data, businesses and organizations can gain new insights and make better decisions based on the analysis of their data.

Analytical learning is a type of machine learning that involves using mathematical models and statistical analysis to make predictions or decisions based on data. It is one of the most common approaches to machine learning and is used in a wide range of applications, from business analytics to healthcare to autonomous vehicles.

Analytical learning is often used in supervised learning, where the goal is to predict output values based on input features. In analytical learning, a model is trained on a set of labeled data using statistical methods and mathematical models. The model then uses this knowledge to make predictions on new, unseen data.

Tabular data remains a significant and crucial format. Here are some reasons why:

• Structured and Organized: Tabular data is inherently organized in rows and columns, making it easy for humans and computers to understand and analyze.
• Legacy Systems: Many businesses and organizations still rely on databases and spreadsheets that store information in a tabular format.
• Analysis Foundation: Tabular data serves as the foundation for many machine learning algorithms, making it a vital tool for extracting insights.

Several types of analytical learning models are commonly used in machine learning. These include linear regression, logistic regression, decision trees, random forests, support vector machines (SVMs), and artificial neural networks (ANNs). Each type of model has its own strengths and weaknesses, and the choice of model depends on the specific problem and the characteristics of the data. In reality, a variety of neural network architectures can be employed to understand heterogeneous tabular data, as shown in Figure 3 .

In addition to supervised learning, analytical learning can also be used in unsupervised learning, where the goal is to identify patterns and relationships in the data. In unsupervised learning, the model is not given explicit output labels, but instead, it is used to group or cluster similar data points based on their features. Common unsupervised learning algorithms include k-means clustering, hierarchical clustering, and principal component analysis (PCA).

One key advantage of analytical learning is its ability to handle large datasets and complex relationships between the input features. By using statistical methods and mathematical models, analytical learning can extract patterns and insights from the data that may not be obvious to humans.

However, analytical learning also has limitations. For example, it may need help to handle high-dimensional data with many input features and be sensitive to outliers and noise in the data. In addition, analytical learning may not be suitable for tasks that require human expertise or judgment.

Analytical learning is a powerful tool in machine learning that can be used to make predictions or decisions based on data. It is a widely used approach that involves using mathematical models and statistical analysis to extract patterns and insights from the data. By using analytical learning, businesses and organizations can gain new insights and make better decisions based on the analysis of their data.

What's next? We recommend PyImageSearch University .

I strongly believe that if you had the right teacher you could master computer vision and deep learning.

Do you think learning computer vision and deep learning has to be time-consuming, overwhelming, and complicated? Or has to involve complex mathematics and equations? Or requires a degree in computer science?

That’s not the case.

All you need to master computer vision and deep learning is for someone to explain things to you in simple, intuitive terms. And that’s exactly what I do . My mission is to change education and how complex Artificial Intelligence topics are taught.

If you're serious about learning computer vision, your next stop should be PyImageSearch University, the most comprehensive computer vision, deep learning, and OpenCV course online today. Here you’ll learn how to successfully and confidently apply computer vision to your work, research, and projects. Join me in computer vision mastery.

Inside PyImageSearch University you'll find:

• ✓ 84 courses on essential computer vision, deep learning, and OpenCV topics
• ✓ 84 Certificates of Completion
• ✓ 114+ hours of on-demand video
• ✓ Brand new courses released regularly , ensuring you can keep up with state-of-the-art techniques
• ✓ Pre-configured Jupyter Notebooks in Google Colab
• ✓ Run all code examples in your web browser — works on Windows, macOS, and Linux (no dev environment configuration required!)
• ✓ Access to centralized code repos for all 536+ tutorials on PyImageSearch
• ✓ Easy one-click downloads for code, datasets, pre-trained models, etc.
• ✓ Access on mobile, laptop, desktop, etc.

Click here to join PyImageSearch University

In this post, we learned about various types of machine learning, such as supervised, unsupervised, and reinforcement learning, as well as insights into deep learning and its applications (e.g., GANs and transfer learning). Additionally, we also introduced different problem types, including classification, regression, clustering, and anomaly detection, and explored algorithms like decision trees, random forests, and neural networks. Now, you’re ready to dive deeper and start training your own machine-learning models to solve interesting problems. Be sure to check out our other blogs or, even better, join PyImageSearch University , where you’ll get videos, code downloads, and all the help you need to be successful in machine learning.

Unleash the potential of computer vision with Roboflow - Free!

• Step into the realm of the future by signing up or logging into your Roboflow account . Unlock a wealth of innovative dataset libraries and revolutionize your computer vision operations.
• Jumpstart your journey by choosing from our broad array of datasets, or benefit from PyimageSearch’s comprehensive library, crafted to cater to a wide range of requirements.
• Transfer your data to Roboflow in any of the 40+ compatible formats. Leverage cutting-edge model architectures for training, and deploy seamlessly across diverse platforms, including API, NVIDIA, browser, iOS, and beyond. Integrate our platform effortlessly with your applications or your favorite third-party tools.
• Equip yourself with the ability to train a potent computer vision model in a mere afternoon. With a few images, you can import data from any source via API, annotate images using our superior cloud-hosted tool, kickstart model training with a single click, and deploy the model via a hosted API endpoint. Tailor your process by opting for a code-centric approach, leveraging our intuitive, cloud-based UI, or combining both to fit your unique needs.
• Embark on your journey today with absolutely no credit card required. Step into the future with Roboflow.

Join Roboflow Now

Join the PyImageSearch Newsletter and Grab My FREE 17-page Resource Guide PDF

Enter your email address below to join the PyImageSearch Newsletter and download my FREE 17-page Resource Guide PDF on Computer Vision, OpenCV, and Deep Learning.

About the Author

Hey, I'm Hector. I love CV/DL and I'm also a cat lover. I love dark coffee and deep learning.

Previous Article:

Step-by-Step Guide to Open-Source Implementation of Generative Fill: Part 2

Next Article:

Comment section

Hey, Adrian Rosebrock here, author and creator of PyImageSearch. While I love hearing from readers, a couple years ago I made the tough decision to no longer offer 1:1 help over blog post comments.

At the time I was receiving 200+ emails per day and another 100+ blog post comments. I simply did not have the time to moderate and respond to them all, and the sheer volume of requests was taking a toll on me.

Instead, my goal is to do the most good for the computer vision, deep learning, and OpenCV community at large by focusing my time on authoring high-quality blog posts, tutorials, and books/courses.

If you need help learning computer vision and deep learning, I suggest you refer to my full catalog of books and courses — they have helped tens of thousands of developers, students, and researchers just like yourself learn Computer Vision, Deep Learning, and OpenCV.

Click here to browse my full catalog.

Similar articles

Implementing rootsift in python and opencv, convolution and cross-correlation in neural networks, how to (quickly) build a deep learning image dataset.

You can learn Computer Vision, Deep Learning, and OpenCV.

Get your FREE 17 page Computer Vision, OpenCV, and Deep Learning Resource Guide PDF. Inside you’ll find our hand-picked tutorials, books, courses, and libraries to help you master CV and DL.

• Deep Learning
• Dlib Library
• Embedded/IoT and Computer Vision
• Face Applications
• Image Processing
• OpenCV Install Guides
• Machine Learning and Computer Vision
• Medical Computer Vision
• Optical Character Recognition (OCR)
• Object Detection
• Object Tracking
• OpenCV Tutorials
• Raspberry Pi

Books & Courses

• PyImageSearch University
• FREE CV, DL, and OpenCV Crash Course
• Practical Python and OpenCV
• Deep Learning for Computer Vision with Python
• PyImageSearch Gurus Course
• Raspberry Pi for Computer Vision
• Get Started
• Privacy Policy

Research Group

Machine learning.

We study a range of research areas related to machine learning and their applications for robotics, health care, language processing, information retrieval and more. Among these subjects include precision medicine, motion planning, computer vision, Bayesian inference, graphical models, statistical inference and estimation. Our work is interdisciplinary and deeply rooted in systems and computer science theory.

Many of our researchers have affiliations with other groups at MIT, including the  Institute for Medical Engineering & Science  (IMES) and the Institute for Data, Systems and Society (IDSS).

Related Links

If you would like to contact us about our work, please refer to our members below and reach out to one of the group leads directly.

Last updated Jun 20 '18

Research Areas

Impact areas.

Tamara Broderick

Tommi Jaakkola

Stefanie Jegelka

Leslie Kaelbling

David Sontag

Optimal transport for statistics and machine learning.

Justin Solomon

Sensible deep learning for 3d data, interpretability in complex machine learning models, diversity-inducing probability measures, geometry in large-scale machine learning, robust optimization in machine learning and data mining, structured prediction through randomization, andreea gane, tamir hazan, finite approximations of infinite models, tractable models of sparse networks, scalable bayesian inference via adaptive data summaries, learning optimal interventions.

Learning Strategic Games

Scalable bayesian inference with optimization, learning from streaming network data, different types of approximations for fast and accurate probabilistic inference,   12 more.

Automated method helps researchers quantify uncertainty in their predictions

How symmetry can come to the aid of machine learning

Explained: Generative AI

Two CSAILers within School of Engineering granted tenure in 2023

Unpacking the “black box” to build better AI models

Avoiding shortcut solutions in artificial intelligence.

Using artificial intelligence to improve early breast cancer detection

  4 more.

Exploring 250+ Machine Learning Research Topics

In recent years, machine learning has become super popular and grown very quickly. This happened because technology got better, and there’s a lot more data available. Because of this, we’ve seen lots of new and amazing things happen in different areas. Machine learning research is what makes all these cool things possible. In this blog, we’ll talk about machine learning research topics, why they’re important, how you can pick one, what areas are popular to study, what’s new and exciting, the tough problems, and where you can find help if you want to be a researcher.

Why Does Machine Learning Research Matter?

Table of Contents

Machine learning research is at the heart of the AI revolution. It underpins the development of intelligent systems capable of making predictions, automating tasks, and improving decision-making across industries. The importance of this research can be summarized as follows:

Advancements in Technology

The growth of machine learning research has led to the development of powerful algorithms, tools, and frameworks. Numerous industries, including healthcare, banking, autonomous cars, and natural language processing, have found use for these technology.

As researchers continue to push the boundaries of what’s possible, we can expect even more transformative technologies to emerge.

Real-world Applications

Machine learning research has brought about tangible changes in our daily lives. Voice assistants like Siri and Alexa, recommendation systems on streaming platforms, and personalized healthcare diagnostics are just a few examples of how this research impacts our world. 

By working on new research topics, scientists can further refine these applications and create new ones.

Economic and Industrial Impacts

The economic implications of machine learning research are substantial. Companies that harness the power of machine learning gain a competitive edge in the market. 

This creates a demand for skilled machine learning researchers, driving job opportunities and contributing to economic growth.

How to Choose the Machine Learning Research Topics?

Selecting the right machine learning research topics is crucial for your success as a machine learning researcher. Here’s a guide to help you make an informed decision:

• Understanding Your Interests

Start by considering your personal interests. Machine learning is a broad field with applications in virtually every sector. By choosing a topic that aligns with your passions, you’ll stay motivated and engaged throughout your research journey.

• Reviewing Current Trends

Stay updated on the latest trends in machine learning. Attend conferences, read research papers, and engage with the community to identify emerging research topics. Current trends often lead to exciting breakthroughs.

• Identifying Gaps in Existing Research

Sometimes, the most promising research topics involve addressing gaps in existing knowledge. These gaps may become evident through your own experiences, discussions with peers, or in the course of your studies.

• Collaborating with Experts

Collaboration is key in research. Working with experts in the field can help you refine your research topic and gain valuable insights. Seek mentors and collaborators who can guide you.

250+ Machine Learning Research Topics: Category-wise

Supervised learning.

• Explainable AI for Decision Support
• Few-shot Learning Methods
• Time Series Forecasting with Deep Learning
• Handling Imbalanced Datasets in Classification
• Regression Techniques for Non-linear Data
• Transfer Learning in Supervised Settings
• Multi-label Classification Strategies
• Semi-Supervised Learning Approaches
• Novel Feature Selection Methods
• Anomaly Detection in Supervised Scenarios
• Federated Learning for Distributed Supervised Models
• Ensemble Learning for Improved Accuracy
• Automated Hyperparameter Tuning
• Ethical Implications in Supervised Models
• Interpretability of Deep Neural Networks.

Unsupervised Learning

• Unsupervised Clustering of High-dimensional Data
• Semi-Supervised Clustering Approaches
• Density Estimation in Unsupervised Learning
• Anomaly Detection in Unsupervised Settings
• Transfer Learning for Unsupervised Tasks
• Representation Learning in Unsupervised Learning
• Outlier Detection Techniques
• Generative Models for Data Synthesis
• Manifold Learning in High-dimensional Spaces
• Unsupervised Feature Selection
• Privacy-Preserving Unsupervised Learning
• Community Detection in Complex Networks
• Clustering Interpretability and Visualization
• Unsupervised Learning for Image Segmentation
• Autoencoders for Dimensionality Reduction.

Reinforcement Learning

• Deep Reinforcement Learning in Real-world Applications
• Safe Reinforcement Learning for Autonomous Systems
• Transfer Learning in Reinforcement Learning
• Imitation Learning and Apprenticeship Learning
• Multi-agent Reinforcement Learning
• Explainable Reinforcement Learning Policies
• Hierarchical Reinforcement Learning
• Model-based Reinforcement Learning
• Curriculum Learning in Reinforcement Learning
• Reinforcement Learning in Robotics
• Exploration vs. Exploitation Strategies
• Reward Function Design and Ethical Considerations
• Reinforcement Learning in Healthcare
• Continuous Action Spaces in RL
• Reinforcement Learning for Resource Management.

Natural Language Processing (NLP)

• Multilingual and Cross-lingual NLP
• Contextualized Word Embeddings
• Bias Detection and Mitigation in NLP
• Named Entity Recognition for Low-resource Languages
• Sentiment Analysis in Social Media Text
• Dialogue Systems for Improved Customer Service
• Text Summarization for News Articles
• Low-resource Machine Translation
• Explainable NLP Models
• Coreference Resolution in NLP
• Question Answering in Specific Domains
• Detecting Fake News and Misinformation
• NLP for Healthcare: Clinical Document Understanding
• Emotion Analysis in Text
• Text Generation with Controlled Attributes.

Computer Vision

• Video Action Recognition and Event Detection
• Object Detection in Challenging Conditions (e.g., low light)
• Explainable Computer Vision Models
• Image Captioning for Accessibility
• Large-scale Image Retrieval
• Domain Adaptation in Computer Vision
• Fine-grained Image Classification
• Facial Expression Recognition
• Visual Question Answering
• Self-supervised Learning for Visual Representations
• Weakly Supervised Object Localization
• Human Pose Estimation in 3D
• Scene Understanding in Autonomous Vehicles
• Image Super-resolution
• Gaze Estimation for Human-Computer Interaction.

Deep Learning

• Neural Architecture Search for Efficient Models
• Self-attention Mechanisms and Transformers
• Interpretability in Deep Learning Models
• Robustness of Deep Neural Networks
• Generative Adversarial Networks (GANs) for Data Augmentation
• Neural Style Transfer in Art and Design
• Adversarial Attacks and Defenses
• Neural Networks for Audio and Speech Processing
• Explainable AI for Healthcare Diagnosis
• Automated Machine Learning (AutoML)
• Reinforcement Learning with Deep Neural Networks
• Model Compression and Quantization
• Lifelong Learning with Deep Learning Models
• Multimodal Learning with Vision and Language
• Federated Learning for Privacy-preserving Deep Learning.

Explainable AI

• Visualizing Model Decision Boundaries
• Saliency Maps and Feature Attribution
• Rule-based Explanations for Black-box Models
• Contrastive Explanations for Model Interpretability
• Counterfactual Explanations and What-if Analysis
• Human-centered AI for Explainable Healthcare
• Ethics and Fairness in Explainable AI
• Explanation Generation for Natural Language Processing
• Explainable AI in Financial Risk Assessment
• User-friendly Interfaces for Model Interpretability
• Scalability and Efficiency in Explainable Models
• Hybrid Models for Combined Accuracy and Explainability
• Post-hoc vs. Intrinsic Explanations
• Evaluation Metrics for Explanation Quality
• Explainable AI for Autonomous Vehicles.

Transfer Learning

• Zero-shot Learning and Few-shot Learning
• Cross-domain Transfer Learning
• Domain Adaptation for Improved Generalization
• Multilingual Transfer Learning in NLP
• Pretraining and Fine-tuning Techniques
• Lifelong Learning and Continual Learning
• Domain-specific Transfer Learning Applications
• Model Distillation for Knowledge Transfer
• Contrastive Learning for Transfer Learning
• Self-training and Pseudo-labeling
• Dynamic Adaption of Pretrained Models
• Privacy-Preserving Transfer Learning
• Unsupervised Domain Adaptation
• Negative Transfer Avoidance in Transfer Learning.

Federated Learning

• Secure Aggregation in Federated Learning
• Communication-efficient Federated Learning
• Privacy-preserving Techniques in Federated Learning
• Federated Transfer Learning
• Heterogeneous Federated Learning
• Real-world Applications of Federated Learning
• Federated Learning for Edge Devices
• Federated Learning for Healthcare Data
• Differential Privacy in Federated Learning
• Byzantine-robust Federated Learning
• Federated Learning with Non-IID Data
• Model Selection in Federated Learning
• Scalable Federated Learning for Large Datasets
• Client Selection and Sampling Strategies
• Global Model Update Synchronization in Federated Learning.

Quantum Machine Learning

• Quantum Neural Networks and Quantum Circuit Learning
• Quantum-enhanced Optimization for Machine Learning
• Quantum Data Compression and Quantum Principal Component Analysis
• Quantum Kernels and Quantum Feature Maps
• Quantum Variational Autoencoders
• Quantum Transfer Learning
• Quantum-inspired Classical Algorithms for ML
• Hybrid Quantum-Classical Models
• Quantum Machine Learning on Near-term Quantum Devices
• Quantum-inspired Reinforcement Learning
• Quantum Computing for Quantum Chemistry and Drug Discovery
• Quantum Machine Learning for Finance
• Quantum Data Structures and Quantum Databases
• Quantum-enhanced Cryptography in Machine Learning
• Quantum Generative Models and Quantum GANs.

Ethical AI and Bias Mitigation

• Fairness-aware Machine Learning Algorithms
• Bias Detection and Mitigation in Real-world Data
• Explainable AI for Ethical Decision Support
• Algorithmic Accountability and Transparency
• Privacy-preserving AI and Data Governance
• Ethical Considerations in AI for Healthcare
• Fairness in Recommender Systems
• Bias and Fairness in NLP Models
• Auditing AI Systems for Bias
• Societal Implications of AI in Criminal Justice
• Ethical AI Education and Training
• Bias Mitigation in Autonomous Vehicles
• Fair AI in Financial and Hiring Decisions
• Case Studies in Ethical AI Failures
• Legal and Policy Frameworks for Ethical AI.

Meta-Learning and AutoML

• Neural Architecture Search (NAS) for Efficient Models
• Transfer Learning in NAS
• Reinforcement Learning for NAS
• Multi-objective NAS
• Automated Data Augmentation
• Neural Architecture Optimization for Edge Devices
• Bayesian Optimization for AutoML
• Model Compression and Quantization in AutoML
• AutoML for Federated Learning
• AutoML in Healthcare Diagnostics
• Explainable AutoML
• Cost-sensitive Learning in AutoML
• AutoML for Small Data
• Human-in-the-Loop AutoML.

AI for Healthcare and Medicine

• Disease Prediction and Early Diagnosis
• Medical Image Analysis with Deep Learning
• Drug Discovery and Molecular Modeling
• Electronic Health Record Analysis
• Predictive Analytics in Healthcare
• Personalized Treatment Planning
• Healthcare Fraud Detection
• Telemedicine and Remote Patient Monitoring
• AI in Radiology and Pathology
• AI in Drug Repurposing
• AI for Medical Robotics and Surgery
• Genomic Data Analysis
• AI-powered Mental Health Assessment
• Explainable AI in Healthcare Decision Support
• AI in Epidemiology and Outbreak Prediction.

AI in Finance and Investment

• Algorithmic Trading and High-frequency Trading
• Credit Scoring and Risk Assessment
• Fraud Detection and Anti-money Laundering
• Portfolio Optimization with AI
• Financial Market Prediction
• Sentiment Analysis in Financial News
• Explainable AI in Financial Decision-making
• Algorithmic Pricing and Dynamic Pricing Strategies
• AI in Cryptocurrency and Blockchain
• Customer Behavior Analysis in Banking
• Explainable AI in Credit Decisioning
• AI in Regulatory Compliance
• Ethical AI in Financial Services
• AI for Real Estate Investment
• Automated Financial Reporting.

AI in Climate Change and Sustainability

• Climate Modeling and Prediction
• Renewable Energy Forecasting
• Smart Grid Optimization
• Energy Consumption Forecasting
• Carbon Emission Reduction with AI
• Ecosystem Monitoring and Preservation
• Precision Agriculture with AI
• AI for Wildlife Conservation
• Natural Disaster Prediction and Management
• Water Resource Management with AI
• Sustainable Transportation and Urban Planning
• Climate Change Mitigation Strategies with AI
• Environmental Impact Assessment with Machine Learning
• Eco-friendly Supply Chain Optimization
• Ethical AI in Climate-related Decision Support.

Data Privacy and Security

• Differential Privacy Mechanisms
• Federated Learning for Privacy-preserving AI
• Secure Multi-Party Computation
• Privacy-enhancing Technologies in Machine Learning
• Homomorphic Encryption for Machine Learning
• Ethical Considerations in Data Privacy
• Privacy-preserving AI in Healthcare
• AI for Secure Authentication and Access Control
• Blockchain and AI for Data Security
• Explainable Privacy in Machine Learning
• Privacy-preserving AI in Government and Public Services
• Privacy-compliant AI for IoT and Edge Devices
• Secure AI Models Sharing and Deployment
• Privacy-preserving AI in Financial Transactions
• AI in the Legal Frameworks of Data Privacy.

Global Collaboration in Research

• International Research Partnerships and Collaboration Models
• Multilingual and Cross-cultural AI Research
• Addressing Global Healthcare Challenges with AI
• Ethical Considerations in International AI Collaborations
• Interdisciplinary AI Research in Global Challenges
• AI Ethics and Human Rights in Global Research
• Data Sharing and Data Access in Global AI Research
• Cross-border Research Regulations and Compliance
• AI Innovation Hubs and International Research Centers
• AI Education and Training for Global Communities
• Humanitarian AI and AI for Sustainable Development Goals
• AI for Cultural Preservation and Heritage Protection
• Collaboration in AI-related Global Crises
• AI in Cross-cultural Communication and Understanding
• Global AI for Environmental Sustainability and Conservation.

Emerging Trends and Hot Topics in Machine Learning Research

The landscape of machine learning research topics is constantly evolving. Here are some of the emerging trends and hot topics that are shaping the field:

As AI systems become more prevalent, addressing ethical concerns and mitigating bias in algorithms are critical research areas.

Interpretable and Explainable Models

Understanding why machine learning models make specific decisions is crucial for their adoption in sensitive areas, such as healthcare and finance.

Meta-learning algorithms are designed to enable machines to learn how to learn, while AutoML aims to automate the machine learning process itself.

Machine learning is revolutionizing the healthcare sector, from diagnostic tools to drug discovery and patient care.

Algorithmic trading, risk assessment, and fraud detection are just a few applications of AI in finance, creating a wealth of research opportunities.

Machine learning research is crucial in analyzing and mitigating the impacts of climate change and promoting sustainable practices.

Challenges and Future Directions

While machine learning research has made tremendous strides, it also faces several challenges:

• Data Privacy and Security: As machine learning models require vast amounts of data, protecting individual privacy and data security are paramount concerns.
• Scalability and Efficiency: Developing efficient algorithms that can handle increasingly large datasets and complex computations remains a challenge.
• Ensuring Fairness and Transparency: Addressing bias in machine learning models and making their decisions transparent is essential for equitable AI systems.
• Quantum Computing and Machine Learning: The integration of quantum computing and machine learning has the potential to revolutionize the field, but it also presents unique challenges.
• Global Collaboration in Research: Machine learning research benefits from collaboration on a global scale. Ensuring that researchers from diverse backgrounds work together is vital for progress.

Resources for Machine Learning Researchers

If you’re looking to embark on a journey in machine learning research topics, there are various resources at your disposal:

• Journals and Conferences

Journals such as the “Journal of Machine Learning Research” and conferences like NeurIPS and ICML provide a platform for publishing and discussing research findings.

• Online Communities and Forums

Platforms like Stack Overflow, GitHub, and dedicated forums for machine learning provide spaces for collaboration and problem-solving.

• Datasets and Tools

Open-source datasets and tools like TensorFlow and PyTorch simplify the research process by providing access to data and pre-built models.

• Research Grants and Funding Opportunities

Many organizations and government agencies offer research grants and funding for machine learning projects. Seek out these opportunities to support your research.

Machine learning research is like a superhero in the world of technology. To be a part of this exciting journey, it’s important to choose the right machine learning research topics and keep up with the latest trends.

Machine learning research makes our lives better. It powers things like smart assistants and life-saving medical tools. It’s like the force driving the future of technology and society.

But, there are challenges too. We need to work together and be ethical in our research. Everyone should benefit from this technology. The future of machine learning research is incredibly bright. If you want to be a part of it, get ready for an exciting adventure. You can help create new solutions and make a big impact on the world.

Related Posts

Tips on How To Tackle A Machine Learning Project As A Beginner

Here in this blog, CodeAvail experts will explain to you tips on how to tackle a machine learning project as a beginner step by step…

Artificial Intelligence and Machine Learning Basics for Beginners

Here in this blog, CodeAvail experts will explain to you Artificial Intelligence and Machine Learning basics for beginners in detail step by step. What is…

Machine Learning Optimization Techniques: A Survey, Classification, Challenges, and Future Research Issues

• Review article
• Published: 29 March 2024

Cite this article

• Kewei Bian 1 &
• Rahul Priyadarshi   ORCID: orcid.org/0000-0001-5725-9812 2  

19 Accesses

Explore all metrics

Optimization approaches in machine learning (ML) are essential for training models to obtain high performance across numerous domains. The article provides a comprehensive overview of ML optimization strategies, emphasizing their classification, obstacles, and potential areas for further study. We proceed with studying the historical progression of optimization methods, emphasizing significant developments and their influence on contemporary algorithms. We analyse the present research to identify widespread optimization algorithms and their uses in supervised learning, unsupervised learning, and reinforcement learning. Various common optimization constraints, including non-convexity, scalability issues, convergence problems, and concerns about robustness and generalization, are also explored. We suggest future research should focus on scalability problems, innovative optimization techniques, domain knowledge integration, and improving interpretability. The present study aims to provide an in-depth review of ML optimization by combining insights from historical advancements, literature evaluations, and current issues to guide future research efforts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

Machine Learning: Algorithms, Real-World Applications and Research Directions

Iqbal H. Sarker

A review of predictive uncertainty estimation with machine learning

Hristos Tyralis & Georgia Papacharalampous

A survey of transfer learning

Karl Weiss, Taghi M. Khoshgoftaar & DingDing Wang

Adams R (2013) Active Queue Management: a Survey. IEEE Commun Surv Tutorials 15(3):1425–1476. https://doi.org/10.1109/SURV.2012.082212.00018

Article   Google Scholar  

Alsheikh M, Abu S, Lin D, Niyato, and Hwee Pink Tan (2014) Machine learning in Wireless Sensor networks: algorithms, strategies, and applications. IEEE Commun Surv Tutorials 16(4):1996–2018. https://doi.org/10.1109/COMST.2014.2320099

Anurag A, Priyadarshi R, Goel A, Gupta B (2020) 2-D Coverage Optimization in WSN Using a Novel Variant of Particle Swarm Optimisation. In 2020 7th International Conference on Signal Processing and Integrated Networks, SPIN 2020, 663–68. https://doi.org/10.1109/SPIN48934.2020.9070978

Badarla V, Siva Ram Murthy C (2010) A novel learning based solution for Efficient Data Transport in Heterogeneous Wireless Networks. Wireless Netw 16(6):1777–1798. https://doi.org/10.1007/s11276-009-0228-4

Priyadarshi R, Gupta B, and Amulya Anurag (2020) Wireless Sensor Networks Deployment: a result oriented analysis. Wireless Pers Commun 113(2):843–866. https://doi.org/10.1007/s11277-020-07255-9

Auld T, Moore AW, Gull SF (2007) Bayesian neural networks for internet traffic classification. IEEE Trans Neural Networks 18(1):223–239. https://doi.org/10.1109/TNN.2006.883010

Priyadarshi R, Gupta B, and Amulya Anurag (2020) Deployment techniques in Wireless Sensor networks: a Survey, classification, challenges, and Future Research Issues. J Supercomputing 76(9):7333–7373. https://doi.org/10.1007/s11227-020-03166-5

Priyadarshi R (2021) and Ravi Ranjan Kumar. An Energy-Efficient LEACH Routing Protocol for Wireless Sensor Networks. In Lecture Notes in Electrical Engineering, edited by Vijay Nath and J K Mandal, 673:423–30. Singapore: Springer Singapore. https://doi.org/10.1007/978-981-15-5546-6_35

Ayoubi S, Limam N, Salahuddin MA, Shahriar N, Boutaba R, Estrada-Solano F, Caicedo OM (2018) Machine Learning for Cognitive Network Management. IEEE Commun Mag 56(1):158–165. https://doi.org/10.1109/MCOM.2018.1700560

Priyadarshi R, Nath V (2019) A Novel Diamond–Hexagon Search Algorithm for Motion Estimation. Microsyst Technol 25(12):4587–4591. https://doi.org/10.1007/s00542-019-04376-5

Rosenblatt F (1960) Perceptron simulation experiments. Proceedings of the IRE 48.3:301–309

Werbos PJ (1994) The roots of backpropagation: from ordered derivatives to neural networks and political forecasting, vol 1. Wiley

Nouretdinov I et al (2011) Machine learning classification with confidence: application of transductive conformal predictors to MRI-based diagnostic and prognostic markers in depression. NeuroImage 56(2):809–813

Vandenberghe L, Boyd S (1996) Semidefinite programming. SIAM Rev 38(1):49–95

Article   MathSciNet   Google Scholar  

LeCun Y, Bengio Y, Hinton G (2015) Deep Learn Nat 521:436–444

Google Scholar  

Priyadarshi R, Rana H, Srivastava A, Nath V (2023) A Novel Approach for Sink Route in Wireless Sensor Network. In Lecture Notes in Electrical Engineering, edited by Vijay Nath and Jyotsna Kumar Mandal, 887:695–703. Singapore: Springer Nature Singapore. https://doi.org/10.1007/978-981-19-1906-0_58

Bkassiny M, Li Y, Jayaweera SK (2013) A Survey on Machine-Learning techniques in Cognitive Radios. IEEE Commun Surv Tutorials 15(3):1136–1159. https://doi.org/10.1109/SURV.2012.100412.00017

Qiu Y, Ma L, and Rahul Priyadarshi (2024) Deep Learning challenges and prospects in Wireless Sensor Network Deployment. Arch Comput Methods Eng. https://doi.org/10.1007/s11831-024-10079-6

Chabaa S, Zeroual A, and Jilali Antari (2010) Identification and prediction of internet traffic using Artificial neural networks. J Intell Learn Syst Appl 02(03):147–155. https://doi.org/10.4236/jilsa.2010.23018

Chang C, Chung, Chih Jen Lin (2011) LIBSVM: a Library for Support Vector machines. ACM Trans Intell Syst Technol 2(3). https://doi.org/10.1145/1961189.1961199

Claeys M, Latre S, Famaey J, and Filip De Turck (2014) Design and evaluation of a self-learning http adaptive video streaming client. IEEE Commun Lett 18(4):716–719. https://doi.org/10.1109/LCOMM.2014.020414.132649

Claeys M, Latré S, Famaey J, Wu T, Van Leekwijck W, and Filip De Turck (2014) Design and optimisation of a (FA)Q-Learning-based HTTP adaptive streaming client. Connection Sci 26(1):25–43. https://doi.org/10.1080/09540091.2014.885273

Randheer SK, Soni S, Kumar, and Rahul Priyadarshi (2020). Energy-Aware Clustering in Wireless Sensor Networks BT - Nanoelectronics, Circuits and Communication Systems. In, edited by Vijay Nath and J K, Mandal 453–61. Singapore: Springer Singapore

Dowling J, Curran E, Cunningham R, and Vinny Cahill (2005) Using feedback in collaborative reinforcement learning to adaptively optimize MANET Routing. IEEE Trans Syst Man Cybernetics Part A:Systems Hum 35(3):360–372. https://doi.org/10.1109/TSMCA.2005.846390

Priyadarshi R, Gupta B (2023) 2-D Coverage optimization in obstacle-based FOI in WSN using modified PSO. J Supercomputing 79(5):4847–4869. https://doi.org/10.1007/s11227-022-04832-6

Edalat Y, Ahn JS, and Katia Obraczka (2016) Smart experts for Network State Estimation. IEEE Trans Netw Serv Manage 13(3):622–635. https://doi.org/10.1109/TNSM.2016.2586506

Este A, Gringoli F, and Luca Salgarelli (2009) Support Vector machines for TCP Traffic classification. Comput Netw 53(14):2476–2490. https://doi.org/10.1016/j.comnet.2009.05.003

Rawat P, Chauhan S, Priyadarshi R (2021) A novel heterogeneous clustering protocol for lifetime maximization of Wireless Sensor Network. Wireless Pers Commun 117(2):825–841. https://doi.org/10.1007/s11277-020-07898-8

García-Teodoro P, Díaz-Verdejo J, Maciá-Fernández G, and E. Vázquez (2009) Anomaly-based network intrusion detection: techniques, systems and challenges. Computers Secur 28(1–2):18–28. https://doi.org/10.1016/j.cose.2008.08.003

Priyadarshi R, and Bharat Gupta (2021) Area Coverage optimization in three-Dimensional Wireless Sensor Network. Wireless Pers Commun 117(2):843–865. https://doi.org/10.1007/s11277-020-07899-7

Yin, F., Lin, Z., Kong, Q., Xu, Y., Li, D., Theodoridis, S.,… Cui, S. R. (2020). FedLoc:Federated Learning Framework for Data-Driven Cooperative Localization and Location Data Processing. IEEE Open Journal of Signal Processing, 1:187–215. https://doi.org/10.1109/OJSP.2020.3036276

Yin F, Fritsche C, Jin D, Gustafsson F, Zoubir AM (2015) Cooperative localization in WSNs using Gaussian Mixture modeling: distributed ECM algorithms. IEEE Trans Signal Process 63(6):1448–1463. https://doi.org/10.1109/TSP.2015.2394300

Xu G, Zhang Q, Song Z, Ai B (2023) Relay-assisted Deep Space Optical Communication System over coronal fading channels. IEEE Trans Aerosp Electron Syst 59(6):8297–8312. https://doi.org/10.1109/TAES.2023.3301463

Yan, A., Li, Z., Gao, Z., Zhang, J., Huang, Z., Ni, T.,… Wen, X. (2024). MURLAV: A Multiple-Node-Upset Recovery Latch and Algorithm-Based Verification Method. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems. https://doi.org/10.1109/TCAD.2024.3357593

Yan, A., Cao, A., Huang, Z., Cui, J., Ni, T., Girard, P.,… Zhang, J. (2023). Two Double-Node-Upset-Hardened Flip-Flop Designs for High-Performance Applications. IEEE Transactions on Emerging Topics in Computing, 11(4):1070–1081. https://doi.org/10.1109/TETC.2023.3317070

Dai M, Luo L, Ren J, Yu H, Sun G (2022) PSACCF: prioritized online slice Admission Control considering Fairness in 5G/B5G networks. IEEE Trans Netw Sci Eng 9(6):4101–4114. https://doi.org/10.1109/TNSE.2022.3195862

Sun G, Xu Z, Yu H, Chang V (2021) Dynamic network function provisioning to Enable Network in Box for Industrial Applications. IEEE Trans Industr Inf 17(10):7155–7164. https://doi.org/10.1109/TII.2020.3042872

Sun, G., Zhu, G., Liao, D., Yu, H., Du, X.,… Guizani, M. (2019). Cost-Efficient Service Function Chain Orchestration for Low-Latency Applications in NFV Networks. IEEE Systems Journal, 13(4):3877–3888. https://doi.org/10.1109/JSYST.2018.2879883

Ma X, Dong Z, Quan W, Dong Y, Tan Y (2023) Real-time assessment of asphalt pavement moduli and traffic loads using monitoring data from Built-in Sensors: Optimal sensor placement and identification algorithm.Mech Syst Signal Process 187:109930. https://doi.org/10.1016/j.ymssp.2022.109930

Qu J, Mao B, Li Z, Xu Y, Zhou K, Cao X, Wang X (2023) Recent progress in Advanced Tactile Sensing technologies for Soft Grippers. Adv Funct Mater 33(41):2306249. https://doi.org/10.1002/adfm.202306249

Priyadarshi R, Bhardwaj P, Gupta P, and Vijay Nath (2023) Utilization of smartphone-based Wireless sensors in Agricultural Science: a state of art. Lecture Notes Electr Eng 887:681–688. https://doi.org/10.1007/978-981-19-1906-0_56

Li R, Peng B (2022) Implementing Monocular Visual-Tactile sensors for Robust Manipulation. Cyborg Bionic Syst 2022. https://doi.org/10.34133/2022/9797562

Aibin Y, Feng X, Zhao X, Zhou H, Cui J, Ying Z, Girard P, Wen X HITTSFL: Design of a Cost-Effective HIS-Insensitive TNU-Tolerant and SET-Filtering Latch for Safety-Critical Applications, IEEE/ACM Design Automation Conference (DAC2020), Oral, pp. 1–6, 2020/7/19–23, San Francisco, USA

J., X., S., H. P., X., Z., & J., H. (2022) The improvement of Road Driving Safety guided by visual Inattentional blindness. IEEE Trans Intell Transp Syst, 23(6):4972–4981. https://doi.org/10.1109/TITS.2020.3044927

Priyadarshi R, and Bharat Gupta (2020) Coverage Area Enhancement in Wireless Sensor Network. Microsyst Technol 26(5):1417–1426. https://doi.org/10.1007/s00542-019-04674-y

Dai X, Xiao Z, Jiang H, Alazab M, Lui JCS, Dustdar S, Liu J (2023) Task Co-offloading for D2D-Assisted Mobile Edge Computing in Industrial Internet of things. IEEE Trans Industr Inf 19(1):480–490. https://doi.org/10.1109/TII.2022.3158974

Jiang H, Dai X, Xiao Z, Iyengar AK (2022) Joint Task Offloading and Resource Allocation for Energy-Constrained Mobile Edge Computing. IEEE Trans Mob Comput. https://doi.org/10.1109/TMC.2022.3150432

Dai X, Xiao Z, Jiang H, Lui JCS (2023) UAV-Assisted Task Offloading in Vehicular Edge Computing Networks. IEEE Trans Mob Comput. https://doi.org/10.1109/TMC.2023.3259394

Sun L, Liang J, Zhang C, Wu D, Zhang Y (2023) Meta-transfer Metric Learning for Time Series classification in 6G-Supported Intelligent Transportation systems. IEEE Trans Intell Transp Syst. https://doi.org/10.1109/TITS.2023.3250962

Mao Y, Sun R, Wang J, Cheng Q, Kiong L, Ochieng C, Y. W (2022) New time-differenced carrier phase approach to GNSS/INS integration. GPS Solutions 26(4):122. https://doi.org/10.1007/s10291-022-01314-3

Mao Y, Zhu Y, Tang Z, Chen Z (2022) A Novel Airspace Planning Algorithm for Cooperative Target localization. Electronics 11(18):2950. https://doi.org/10.3390/electronics11182950

Xie Y, Wang X, Shen Z, Sheng Y, Wu G (2023) A two-stage estimation of distribution Algorithm with Heuristics for Energy-Aware Cloud Workflow Scheduling. IEEE Trans Serv Comput 16(6):4183–4197. https://doi.org/10.1109/TSC.2023.3311785

Shang M, Luo J (2021) The Tapio Decoupling Principle and Key strategies for changing factors of Chinese urban Carbon Footprint based on Cloud Computing. Int J Environ Res Public Health 18(4):2101. https://doi.org/10.3390/ijerph18042101

Luo J, Zhao C, Chen Q, Li G (2022) Using deep belief network to construct the agricultural information system based on internet of things. J Supercomputing 78(1):379–405. https://doi.org/10.1007/s11227-021-03898-y

Cao B, Zhao J, Yang P, Gu Y, Muhammad K, Rodrigues J, C P J, V de Albuquerque, C H (2020) Multiobjective 3-D Topology Optimization of Next-Generation Wireless Data Center Network. IEEE Trans Industr Inf 16(5):3597–3605. https://doi.org/10.1109/TII.2019.2952565

Yu J, Lu L, Chen Y, Zhu Y, Kong L (2021) An indirect eavesdropping attack of keystrokes on Touch screen through Acoustic Sensing. IEEE Trans Mob Comput 20(2):337–351. https://doi.org/10.1109/TMC.2019.2947468

Li K, Ji L, Yang S, Li H, Liao X (2022) Couple-Group Consensus of Cooperative–competitive heterogeneous Multiagent systems: a fully distributed event-triggered and Pinning Control Method. IEEE Trans Cybernetics 52(6):4907–4915. https://doi.org/10.1109/TCYB.2020.3024551

Min H, Lei X, Wu X, Fang Y, Chen S, Wang W, Zhao X (2024) Toward interpretable anomaly detection for autonomous vehicles with denoising variational transformer. Eng Appl Artif Intell 129:107601. https://doi.org/10.1016/j.engappai.2023.107601

Hou X, Zhang L, Su Y, Gao G, Liu Y, Na Z, Chen T (2023) A space crawling robotic bio-paw (SCRBP) enabled by triboelectric sensors for surface identification. Nano Energy 105:108013. https://doi.org/10.1016/j.nanoen.2022.108013

Hou X, Xin L, Fu Y, Na Z, Gao G, Liu Y, Chen T (2023) A self-powered biomimetic mouse whisker sensor (BMWS) aiming at terrestrial and space objects perception. Nano Energy 118:109034. https://doi.org/10.1016/j.nanoen.2023.109034

Liang X, Chen Z, Deng Y, Liu D, Liu X, Huang Q, Arai T (2023) Field-controlled microrobots fabricated by Photopolymerization. Cyborg Bionic Syst 4:9. https://doi.org/10.34133/cbsystems.0009

Ma S, Chen Y, Yang S, Liu S, Tang L, Li B, Li Y (2023) The Autonomous Pipeline Navigation of a Cockroach Bio-robot with enhanced walking stimuli. Cyborg Bionic Syst 4:67. https://doi.org/10.34133/cbsystems.0067

Cai Z, Zhu X, Gergondet P, Chen X, Yu Z (2023) A friction-driven strategy for Agile Steering Wheel Manipulation by Humanoid Robots. Cyborg Bionic Syst 4:64. https://doi.org/10.34133/cbsystems.0064

Li X, Sun Y (2021) Application of RBF neural network optimal segmentation algorithm in credit rating. Neural Comput Appl 33(14):8227–8235. https://doi.org/10.1007/s00521-020-04958-9

Long X, Mao M, Su T, Su Y, Tian M (2023) Machine learning method to predict dynamic compressive response of concrete-like material at high strain rates. Def Technol 23:100–111. https://doi.org/10.1016/j.dt.2022.02.003

Long X, Lu C, Su Y, Dai Y (2023) Machine learning framework for predicting the low cycle fatigue life of lead-free solders. Eng Fail Anal 148:107228. https://doi.org/10.1016/j.engfailanal.2023.107228

Hu J, Wu Y, Li T, Ghosh BK (2019) Consensus Control of General Linear Multiagent Systems with Antagonistic Interactions and communication noises. IEEE Trans Autom Control 64(5):2122–2127. https://doi.org/10.1109/TAC.2018.2872197

Chen B, Hu J, Zhao Y, Ghosh BK (2022) Finite-Time velocity-free Rendezvous Control of multiple AUV Systems with Intermittent Communication. IEEE Trans Syst Man Cybernetics: Syst 52(10):6618–6629. https://doi.org/10.1109/TSMC.2022.3148295

Bo C, Jiangping H, Bijoy G (2023) Finite-Time Observer Based Tracking Control of Heterogeneous Multi-AUV Systems with Partial Measurements and Intermittent Communication. Science China Information Sciences. https://doi.org/10.1007/s11432-023-3903-6

Jiang Y, Li X (2022) Broadband cancellation method in an adaptive co-site interference cancellation system. Int J Electron 109(5):854–874. https://doi.org/10.1080/00207217.2021.1941295

Zhang, X., Deng, H., Xiong, Z., Liu, Y., Rao, Y., Lyu, Y.,… Li, Y. (2024). Secure Routing Strategy Based on Attribute-Based Trust Access Control in Social-Aware Networks.Journal of Signal Processing Systems. https://doi.org/10.1007/s11265-023-01908-1

Lyu T, Xu H, Zhang L, Han Z (2024) Source selection and resource allocation in Wireless-Powered Relay networks: an adaptive dynamic programming-based Approach. IEEE Internet Things J 11(5):8973–8988. https://doi.org/10.1109/JIOT.2023.3321673

Liu G (April 2021) Data Collection in MI-Assisted Wireless Powered Underground Sensor networks: directions, recent advances, and challenges. IEEE Commun Mag 59(4):132–138. https://doi.org/10.1109/MCOM.001.2000921

Zhao L, Qu S, Xu H, Wei Z, Zhang C (2024) Energy-efficient trajectory design for secure SWIPT systems assisted by UAV-IRS. Veh Commun 45:100725. https://doi.org/10.1016/j.vehcom.2023.100725

Hou M, Zhao Y, Ge X (2017) Optimal scheduling of the plug-in electric vehicles aggregator energy and regulation services based on grid to vehicle. Int Trans Electr Energy Syst 27(6):e2364. https://doi.org/10.1002/etep.2364

Lei Y, Yanrong C, Hai T, Ren G, Wenhuan W (2023) DGNet: an adaptive lightweight defect detection model for New Energy Vehicle Battery Current Collector. IEEE Sens J 23(23):29815–29830. https://doi.org/10.1109/JSEN.2023.3324441

Xu Y, Wang E, Yang Y, Chang Y (2022) A unified collaborative representation learning for neural-network based Recommender systems. IEEE Trans Knowl Data Eng 34(11):5126–5139. https://doi.org/10.1109/TKDE.2021.3054782

Liu X, Lou S, Dai W (2023) Further results on System identification of nonlinear state-space models. Automatica 148:110760. https://doi.org/10.1016/j.automatica.2022.110760

Wang Q, Dai W, Zhang C, Zhu J, Ma X (2023) A Compact Constraint Incremental Method for Random Weight Networks and its application. IEEE transactions on neural networks and Learning systems. https://doi.org/10.1109/TNNLS.2023.3289798

Zhang, H., Mi, Y., Liu, X., Zhang, Y., Wang, J.,… Tan, J. (2023). A differential game approach for real-time security defense decision in scale-free networks. Computer Networks, 224, 109635. https://doi.org/10.1016/j.comnet.2023.109635

Cao K, Ding H, Li W, Lv L, Gao M, Gong F, Wang B (2022) On the Ergodic Secrecy Capacity of Intelligent reflecting surface aided Wireless Powered Communication systems. IEEE Wirel Commun Lett PP(1). https://doi.org/10.1109/LWC.2022.3199593

Cheng, B., Wang, M., Zhao, S., Zhai, Z., Zhu, D.,… Chen, J. (2017). Situation-Aware Dynamic Service Coordination in an IoT Environment. IEEE/ACM Transactions on Networking,25(4), 2082–2095. https://doi.org/10.1109/TNET.2017.2705239

Zheng, W., Lu, S., Cai, Z., Wang, R., Wang, L.,… Yin, L. (2023). PAL-BERT: An Improved Question Answering Model. Computer Modeling in Engineering & Sciences. https://doi.org/10.32604/cmes.2023.046692

Cao B, Li Z, Liu X, Lv Z, He H (2023) Mobility-aware Multiobjective Task Offloading for Vehicular Edge Computing in Digital Twin Environment. IEEE J Sel Areas Commun 41(10):3046–3055. https://doi.org/10.1109/JSAC.2023.3310100

Geurts P, Ernst D, and Louis Wehenkel (2006) Extremely randomized trees. Mach Learn 63(1):3–42. https://doi.org/10.1007/s10994-006-6226-1

Giacinto G, Perdisci R, Rio MD, and Fabio Roli (2008) Intrusion detection in computer networks by a modular ensemble of one-class classifiers. Inform Fusion 9(1):69–82. https://doi.org/10.1016/j.inffus.2006.10.002

Goldberger AS (2004) Econometric Computing by Hand. J Econ Soc Meas 29(1–3):115–117. https://doi.org/10.3233/jem-2004-0213

Ha S, Rhee I, Xu L (2008) CUBIC: a new TCP-Friendly high-speed TCP variant. Operating Syst Rev (ACM) 42(5):64–74. https://doi.org/10.1145/1400097.1400105

Hajji H (2005) Statistical Analysis of Network Traffic for Adaptive Faults Detection. IEEE Trans Neural Networks 16(5):1053–1063. https://doi.org/10.1109/TNN.2005.853414

Hariri B, Sadati N (2007) NN-RED: an AQM mechanism based on neural networks. Electron Lett 43(19):1053–1055. https://doi.org/10.1049/el:20071791

Hu T, and Yunsi Fei (2010) QELAR: a machine-learning-based adaptive routing protocol for energy-efficient and lifetime-extended underwater Sensor Networks. IEEE Trans Mob Comput 9(6):796–809. https://doi.org/10.1109/TMC.2010.28

Hu W, Wei Hu, and Steve Maybank (2008) AdaBoost-Based algorithm for Network Intrusion Detection. IEEE Trans Syst Man Cybernetics Part B: Cybernetics 38(2):577–583. https://doi.org/10.1109/TSMCB.2007.914695

Jain V, Randheer R, Priyadarshi, and Ankush Thakur (2019) Performance analysis of Block Matching algorithms. Lecture Notes Electr Eng 556:73–82 Springer Singapore. https://doi.org/10.1007/978-981-13-7091-5_7

Jayaraj A, Venkatesh T, Siva Ram C Murthy (2008) Loss classification in Optical Burst switching networks using machine learning techniques: improving the performance of TCP. IEEE J Sel Areas Commun 26(6):45–54. https://doi.org/10.1109/JSACOCN.2008.033508

Khanafer RM, Solana B, Triola J, Barco R, Moltsen L, Altman Z, Lázaro P (2008) Automated diagnosis for UMTS Networks using bayesian Network Approach. IEEE Trans Veh Technol 57(4):2451–2461. https://doi.org/10.1109/TVT.2007.912610

Kiciman E, and Armando Fox (2005) Detecting application-level failures in component-based internet services. IEEE Trans Neural Networks 16(5):1027–1041. https://doi.org/10.1109/TNN.2005.853411

Klaine P, Valente MA, Imran O, Onireti, and Richard Demo Souza (2017) A Survey of Machine Learning techniques Applied to Self-Organizing Cellular Networks. IEEE Commun Surv Tutorials 19(4):2392–2431. https://doi.org/10.1109/COMST.2017.2727878

Kumar S, Soni SK, Randheer, and Rahul Priyadarshi (2020) Performance Analysis of Novel Energy Aware Routing in Wireless Sensor Network. Lecture Notes Electr Eng 642:503–511 Springer Singapore. https://doi.org/10.1007/978-981-15-2854-5_44

Kumar S, Soni SK, Randheer (2020) and Rahul Priyadarshi. Performance Analysis of Novel Energy Aware Routing in Wireless Sensor Network. In Lecture Notes in Electrical Engineering, edited by Vijay Nath and J K Mandal, 642:503–11. Singapore: Springer Singapore. https://doi.org/10.1007/978-981-15-2854-5_44

Lemaître G, Nogueira F, Aridas CK (2017) Imbalanced-Learn: a Python Toolbox to tackle the curse of Imbalanced datasets in Machine Learning. J Mach Learn Res 18:1–5

Mirza M, Sommers J, Barford P, Zhu X (2010) A Machine Learning Approach to TCP Throughput Prediction. IEEE/ACM Trans Networking 18(4):1026–1039. https://doi.org/10.1109/TNET.2009.2037812

Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A et al (2015) Human-level control through deep reinforcement learning. Nature 518(7540):529–533. https://doi.org/10.1038/nature14236

Priyadarshi R, Yadav S, and Deepika Bilyan (2019) Performance and comparison analysis of MIEEP Routing Protocol over adapted LEACH Protocol. Smart Comput Strategies: Theoretical Practical Aspects 237–245. https://doi.org/10.1007/978-981-13-6295-8_20

Moustapha AI, and Rastko R. Selmic (2008) Wireless Sensor Network modeling using modified recurrent neural networks: application to Fault Detection. IEEE Trans Instrum Meas 57(5):981–988. https://doi.org/10.1109/TIM.2007.913803

Muniyandi A, Prabakar R, Rajeswari, Rajaram R (2012) Network Anomaly detection by cascading K-Means clustering and C4.5 decision Tree Algorithm. Procedia Eng 30:174–182. https://doi.org/10.1016/j.proeng.2012.01.849

Nguyen TTT, Armitage G, Philip Branch, and Sebastian Zander (2012) Timely and continuous machine-learning-based classification for interactive IP traffic. IEEE/ACM Trans Networking 20(6):1880–1894. https://doi.org/10.1109/tnet.2012.2187305

Nguyen TTT, and Grenville Armitage (2008) A survey of techniques for internet traffic classification using machine learning. IEEE Commun Surv Tutorials 10(4):56–76. https://doi.org/10.1109/SURV.2008.080406

Nichols K, and Van Jacobson (2012) Controlling Queue Delay. Queue 10(5):20–34. https://doi.org/10.1145/2208917.2209336

Nunes BA, Arouche K, Veenstra W, Ballenthin S, Lukin, Obraczka K (2014) A Machine Learning Framework for TCP Round-Trip Time Estimation. Eurasip Journal on Wireless Communications and Networking 2014. https://doi.org/10.1186/1687-1499-2014-47

Panda M, Abraham A, and Manas Ranjan Patra (2012) A hybrid Intelligent Approach for Network Intrusion Detection. Procedia Eng 30:1–9. https://doi.org/10.1016/j.proeng.2012.01.827

Pandey A, Kumar D, Priyadarshi R (2023) and Vijay Nath. Development of Smart Village for Better Lifestyle of Farmers by Crop and Health Monitoring System. In Lecture Notes in Electrical Engineering, edited by Vijay Nath and Jyotsna Kumar Mandal, 887:689–94. Singapore: Springer Nature Singapore. https://doi.org/10.1007/978-981-19-1906-0_57

Pandey A, Kumar D, Priyadarshi R, and Vijay Nath (2023) Development of Smart Village for Better Lifestyle of Farmers by Crop and Health Monitoring System. Lecture Notes Electr Eng 887:689–694. https://doi.org/10.1007/978-981-19-1906-0_57 . Springer Nature Singapore Singapore

Peddabachigari S, Abraham A, Grosan C, and Johnson Thomas (2007) Modeling intrusion detection system using hybrid Intelligent systems. J Netw Comput Appl 30(1):114–132. https://doi.org/10.1016/j.jnca.2005.06.003

Pinson MH, Wolf S (2004) A new standardized method for objectively measuring Video Quality. IEEE Trans Broadcast 50(3):312–322. https://doi.org/10.1109/TBC.2004.834028

Priyadarshi R, Rawat P, and Vijay Nath (2019) Energy dependent cluster formation in heterogeneous Wireless Sensor Network. Microsyst Technol 25(6):2313–2321. https://doi.org/10.1007/s00542-018-4116-7

Jiang H, Luo Y, Zhang QY, Yin MY, and Chun Wu (2017) TCP-Gvegas with prediction and adaptation in Multi-hop Ad Hoc Networks. Wireless Netw 23(5):1535–1548. https://doi.org/10.1007/s11276-016-1242-y

Priyadarshi R, Rawat P, Nath V, Acharya B, Shylashree N (2020) Three Level Heterogeneous Clustering Protocol for Wireless Sensor Network. Microsyst Technol 26(12):3855–3864. https://doi.org/10.1007/s00542-020-04874-x

Jiang S, Song X, Wang H, Han JJ, Li QH (2006) A clustering-based method for unsupervised intrusion detections. Pattern Recognit Lett 27(7):802–810. https://doi.org/10.1016/j.patrec.2005.11.007

Priyadarshi R, Singh L, Kumar S, Sharma I (2018) A Hexagonal Network Division Approach for Reducing Energy Hole Issue in WSN. Eur J Pure Appl Math 118 (March)

Jin Y, Duffield N, Erman J, Haffner P, Sen S, and Zhi Li Zhang (2012) A modular machine Learning System for Flow-Level Traffic classification in large networks. ACM Trans Knowl Discovery Data 6(1). https://doi.org/10.1145/2133360.2133364

Karagiannis T, Papagiannaki K, Faloutsos M (2005) BLINC: Multilevel Traffic classification in the Dark. Comput Communication Rev 35(4):229–240. https://doi.org/10.1145/1090191.1080119

Karami A (2015) ACCPndn: adaptive congestion control protocol in named data networking by learning capacities using optimized time-lagged feedforward neural network. J Netw Comput Appl 56:1–18. https://doi.org/10.1016/j.jnca.2015.05.017

Priyadarshi R, Soni SK, and Prashant Sharma (2019) An enhanced GEAR Protocol for Wireless Sensor Networks. Lecture Notes Electr Eng 511:289–297 Springer Singapore. https://doi.org/10.1007/978-981-13-0776-8_27

Rao S (2006) Operational Fault detection in Cellular Wireless Base-stations. IEEE Trans Netw Serv Manage 3(2):1–11. https://doi.org/10.1109/TNSM.2006.4798311

Rawat P, Chauhan S, and Rahul Priyadarshi (2020) Energy-efficient clusterhead selection Scheme in Heterogeneous Wireless Sensor Network. J Circuits Syst Computers 29(13):2050204. https://doi.org/10.1142/S0218126620502047

Reddy EK (2017) Comparative Analysis of Clustering Techniques in Data Mining. Int J Adv Sci Technol Eng Manage Sci 9028(1):2454–2356. www.ijastems.org

Ross DA, Lim J, Lin RS, Ming HY (2008) Incremental learning for Robust Visual Tracking. Int J Comput Vision 77(1–3):125–141. https://doi.org/10.1007/s11263-007-0075-7

Sateesh V, Anugrahith A, Kumar R, Priyadarshi, Nath V (2021) A Novel Deployment Scheme to Enhance the Coverage in Wireless Sensor Network. In Lecture Notes in Electrical Engineering, edited by Vijay Nath and J K Mandal, 673:985–93. Singapore: Springer Singapore. https://doi.org/10.1007/978-981-15-5546-6_82

Shon T, and Jongsub Moon (2007) A Hybrid Machine Learning Approach to Network Anomaly Detection. Inf Sci 177(18):3799–3821. https://doi.org/10.1016/j.ins.2007.03.025

Singh L, Kumar A (2020) and Rahul Priyadarshi. Performance and Comparison Analysis of Image Processing Based Forest Fire Detection. In Lecture Notes in Electrical Engineering, edited by Vijay Nath and J K Mandal, 642:473–79. Singapore: Springer Singapore. https://doi.org/10.1007/978-981-15-2854-5_41

Sun J, Chan S, Zukerman M (2012) IAPI: An Intelligent adaptive PI active Queue Management Scheme. Comput Commun 35(18):2281–2293. https://doi.org/10.1016/j.comcom.2012.07.013

Priyadarshi R, and Raj Vikram (2023) A triangle-based localization Scheme in Wireless Multimedia Sensor Network. Wireless Pers Commun 133(1):525–546. https://doi.org/10.1007/s11277-023-10777-7

Tesauro G (2007) Reinforcement learning in Autonomic Computing: a Manifesto and Case studies. IEEE Internet Comput 11(1):22–30. https://doi.org/10.1109/MIC.2007.21

Tsai C, Fong YF, Hsu CY, Lin, Wei YL (2009) Intrusion detection by machine learning: a review. Expert Syst Appl 36(10):11994–11990. https://doi.org/10.1016/j.eswa.2009.05.029

Priyadarshi R, Yadav S (2019) and Deepika Bilyan. Performance Analysis of Adapted Selection Based Protocol over LEACH Protocol. In Smart Computational Strategies: Theoretical and Practical Aspects, edited by Ashish Kumar Luhach, Kamarul Bin Ghazali Hawari, Ioan Cosmin Mihai, Pao-Ann Hsiung, and Ravi Bhushan Mishra, 247–56. Singapore: Springer Singapore. https://doi.org/10.1007/978-981-13-6295-8_21

Wang M, Cui Y, Wang X, Shihan Xiao, and Junchen Jiang (2018) Machine learning for networking: Workflow, advances and opportunities. IEEE Network 32(2):92–99. https://doi.org/10.1109/MNET.2017.1700200

Priyadarshi R (2024) Energy-efficient routing in Wireless Sensor networks: a Meta-heuristic and Artificial Intelligence-Based Approach: a Comprehensive Review. Arch Comput Methods Eng. https://doi.org/10.1007/s11831-023-10039-6

Stigler SM (2007) Gauss and the invention of least squares. Annals Stat 9(3). https://doi.org/10.1214/aos/1176345451

Priyadarshi R (2024) Exploring machine learning solutions for overcoming challenges in IoT-Based Wireless Sensor Network Routing: a Comprehensive Review. Wireless Netw. https://doi.org/10.1007/s11276-024-03697-2

Thakkar Mansi K, Patel MM (2018) Energy Efficient Routing in Wireless Sensor Network. Proceedings of the International Conference on Inventive Research in Computing Applications, ICIRCA 2018 118(20):264–68. https://doi.org/10.1109/ICIRCA.2018.8597353

Priyadarshi R (2017) and Abhyuday Bhardwaj. Node Non-Uniformity for Energy Effectual Coordination in Wsn. International Journal on Information Technologies & Security, № 4(4):2017. https://ijits-bg.com/contents/IJITS-No4-2017/2017-N4-01.pdf

Wang Y, Martonosi M, and Li-Shiuan Peh (2007) Predicting Link Quality using supervised learning in Wireless Sensor Networks. ACM SIGMOBILE Mob Comput Commun Rev 11(3):71–83. https://doi.org/10.1145/1317425.1317434

Priyadarshi R, Bhardwaj P, Gupta P (2023) and Vijay Nath. Utilization of Smartphone-Based Wireless Sensors in Agricultural Science: A State of Art. In Lecture Notes in Electrical Engineering, edited by Vijay Nath and Jyotsna Kumar Mandal, 887:681–88. Singapore: Springer Nature Singapore. https://doi.org/10.1007/978-981-19-1906-0_56

Xu K, Tian Y, and Nirwan Ansari (2004) TCP-Jersey for Wireless IP communications. IEEE J Sel Areas Commun 22(4):747–756. https://doi.org/10.1109/JSAC.2004.825989

Zhang C, Jiang J, and Mohamed Kamel (2005) Intrusion detection using hierarchical neural networks. Pattern Recognit Lett 26(6):779–791. https://doi.org/10.1016/j.patrec.2004.09.045

Priyadarshi R, Singh L, Randheer, Singh A (2018) A Novel HEED Protocol for Wireless Sensor Networks. In 2018 5th International Conference on Signal Processing and Integrated Networks, SPIN 2018, 296–300. https://doi.org/10.1109/SPIN.2018.8474286

Yi C, Afanasyev A, Moiseenko I, Wang L, Zhang B, Zhang L (2013) A case for Stateful Forwarding Plane. Comput Commun 36(7):779–791. https://doi.org/10.1016/j.comcom.2013.01.005

Priyadarshi R, Singh L, Singh A, Thakur A (2018) SEEN: Stable Energy Efficient Network for Wireless Sensor Network. In 2018 5th International Conference on Signal Processing and Integrated Networks, SPIN 2018, 338–42. https://doi.org/10.1109/SPIN.2018.8474228

Williams N, Zander S, Armitage G (2006) A Preliminary Performance Comparison of Five Machine Learning Algorithms for practical IP Traffic Flow classification. Comput Communication Rev 36(5):7–15. https://doi.org/10.1145/1163593.1163596

Priyadarshi R, Soni SK, Bhadu R, Nath V (2018) Performance Analysis of Diamond Search Algorithm over full search algorithm. Microsyst Technol 24(6):2529–2537. https://doi.org/10.1007/s00542-017-3625-0

Wang Z, Zhang M, Wang D, Song C, Liu M, Li J, Lou L, and Zhuo Liu (2017) Failure prediction using machine learning and Time Series in Optical Network. Opt Express 25(16):18553. https://doi.org/10.1364/oe.25.018553

Priyadarshi R, Soni SK, and Vijay Nath (2018) Energy efficient cluster head formation in Wireless Sensor Network. Microsyst Technol 24(12):4775–4784. https://doi.org/10.1007/s00542-018-3873-7

Zhang J, Chen C, Xiang Y, Wanlei Zhou, and Yong Xiang (2013) Internet traffic classification by aggregating correlated naive bayes predictions. IEEE Trans Inf Forensics Secur 8(1):5–15. https://doi.org/10.1109/TIFS.2012.2223675

Download references

Author information

Authors and affiliations.

College of Department of Linguistics and Translation, City University of Hong Kong, 83 Tat Chee Ave, Kowloon Tong, Hong Kong, 999077, China

Faculty of Engineering & Technology, ITER, Siksha ‘O’ Anusandhan University, Bhubaneswar, 751030, India

Rahul Priyadarshi

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Rahul Priyadarshi .

Ethics declarations

Conflict of interest.

The authors have no conflict of interest to declare that are relevant to the content of this article.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Bian, K., Priyadarshi, R. Machine Learning Optimization Techniques: A Survey, Classification, Challenges, and Future Research Issues. Arch Computat Methods Eng (2024). https://doi.org/10.1007/s11831-024-10110-w

Download citation

Received : 25 December 2023

Accepted : 18 March 2024

Published : 29 March 2024

DOI : https://doi.org/10.1007/s11831-024-10110-w

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Find a journal
• Publish with us
• Track your research

Machine Learning Area

Machine Learning

• Causal learning-Inference
• Fast Pretraining
• Offline Reinforcement Learning
• Optimization in Deep Learning
• Language & Speech Pretraining
• Privacy-preserving Deep Learning
• Robust Machine Learning
• Reinforcement Learning for Combinatorial Optimization
• Generalization in Deep Learning
• Learn the Dynamics

Application

• AI for Finance
• Bio Embedding
• Drug Discovery
• Game Testing
• Neural Machine Translation
• Precision Medicine
• Protein Folding
• Text to Speech
• Reinforcement Learning for Logistics

AI for Science

• Molecular Dynamics
• Enhancer-Promoter Pair
• Learning to Decode the Immune System to Diagnose Disease
• Microbiome-based Diagnostics and Therapeutics
• The Antigen Map Project

Sustainability

• Crystal Structure Design
• Carbon Neutrality
• LordNet Neural PDE Solver
• Low Carbon Transformation Pathway
• Physics-based Sustainability
• Simulation of Crystallization Process of Hydrate in CCS

AI for Industry

Supply chain.

• Follow on Twitter
• Like on Facebook
• Follow on LinkedIn
• Subscribe on Youtube
• Follow on Instagram
• Subscribe to our RSS feed

Share this page:

• Share on Twitter
• Share on Facebook
• Share on LinkedIn
• Share on Reddit

Top 7 Machine Learning Trends in 2023

From predictive text in our smartphones to recommendation engines on our favorite shopping websites, machine learning (ML) is already embedded in our daily routines. But ML isn’t standing still – the field is in a state of constant evolution. In recent years, it has progressed rapidly , largely thanks to improvements in data gathering, processing power, and the development of more sophisticated algorithms. 

Now, as we enter the second half of 2023, these technological advancements have paved the way for new and exciting trends in machine learning. These trends not only reflect the ongoing advancement in machine learning technology but also highlight its growing accessibility and the increasingly crucial role of ethics in its applications. From no-code machine learning to tinyML, these seven trends are worth watching in 2023. 

1. Automated Machine Learning 

Automated machine learning , or AutoML, is one of the most significant machine learning trends we’re witnessing. Roughly 61% of decision makers in companies utilizing AI said they’ve adopted autoML , and another 25% were planning to implement it that year. This innovation is reshaping the process of building ML models by automating some of its most complex aspects.

AutoML is not about eliminating the need for coding, as is the case with no-code ML platforms. Instead, AutoML focuses on the automation of tasks that often require a high level of expertise and a significant time investment. These tasks include data preprocessing, feature selection, and hyperparameter tuning, to name a few.

In a typical machine learning project, these steps are performed manually by engineers or data scientists who have to iterate several times to optimize the model. However, AutoML can help automate these steps, thereby saving time and effort and allowing employees to focus on higher-level problem-solving.

Furthermore, AutoML can provide significant value to non-experts or those who are in the early stages of their ML journey. By removing some of the complexities associated with ML, AutoML allows these individuals to leverage the power of machine learning without needing a deep understanding of every intricate detail.

2. Tiny Machine Learning 

Tiny machine learning, commonly known as TinyML, is another significant trend that’s worth our attention. It’s predicted that tinyML device installs will increase from nearly 2 billion in 2022 to over 11 billion in 2027. Driving this trend is tinyML’s power to bring machine learning capabilities to small, low-power devices, often referred to as edge devices .

The idea behind TinyML is to run machine learning algorithms on devices with minimal computational resources, such as microcontrollers in small appliances, wearable devices, and Internet of Things (IoT) devices. This represents a shift away from cloud-based computation toward local, on-device computation, providing benefits such as speed, privacy, and reduced power consumption.

It’s also worth mentioning that TinyML opens up opportunities for real-time, on-device decision making. For instance, a wearable health tracker could leverage TinyML to analyze a user’s vital signs and alert them to abnormal readings without the need to constantly communicate with the cloud, thereby saving bandwidth and preserving privacy.

3. Generative AI

Generative AI has dominated the headlines in 2023. Since the release of OpenAI’s ChatGPT in November 2022, we’ve seen a wave of new generative AI technologies from major tech companies like Microsoft , Google , Adobe , Qualcomm , as well as countless other innovations from companies of every size. These sophisticated models have unlocked unprecedented possibilities in numerous fields, from art and design to data augmentation and beyond.

Generative AI , as a branch of machine learning, is focused on creating new content. It’s akin to giving an AI a form of imagination. These algorithms, through various techniques, learn the underlying patterns of the data they are trained on and can generate new, original content that mirrors those patterns.

Perhaps the most renowned form of generative AI is the generative adversarial network (GAN). GANs work by pitting two neural networks against each other — a generator network that creates new data instances, and a discriminator network that attempts to determine whether the data is real or artificial. The generator continuously improves its outputs in an attempt to fool the discriminator, resulting in the creation of incredibly realistic synthetic data.

However, the field has expanded beyond just GANs. Other approaches, such as variational autoencoders (VAEs) and transformer-based models , have shown impressive results. For example, VAEs are now being used in fields like drug discovery, where they generate viable new molecular structures . Transformer-based models, inspired by architectures like GPT-3 (now GPT-4), are being used to generate human-like text, enabling more natural conversational AI experiences.

In 2023, one of the most notable advancements in generative AI is the refinement and increased adoption of these models in creative fields. AI is now capable of composing music, generating unique artwork, and even writing convincing prose, broadening the horizons of creative expression.

Yet, along with the fascinating potential, the rapid advancements in generative AI bring notable challenges. As generative models become increasingly capable of producing realistic outputs, ensuring these powerful tools are used responsibly and ethically is paramount. The potential misuse of this technology, such as creating deepfakes or other deceptive content, is a significant concern that will need to be addressed.

Explore verified tech roles & skills

The definitive directory of tech roles, backed by machine learning and skills intelligence.

Explore all roles

4. No-Code Machine Learning

Interest in and demand for AI technology, combined with a growing AI skills gap , has driven more and more companies toward no-code machine learning solutions. These platforms are revolutionizing the field by making machine learning more accessible to a wider audience, including those without a background in programming or data science.

No-code platforms are designed to enable users to build, train, and deploy machine learning models without writing any code. They typically feature intuitive, visual interfaces where users can manipulate pre-built components and utilize established machine learning algorithms.

The power of no-code ML lies in its ability to democratize machine learning. It opens the doors for business analysts, domain experts, and other professionals who understand their data and the problems they need to solve but might lack the coding skills typically required in traditional machine learning.

These platforms make it possible for users to leverage the predictive power of machine learning to generate insights, make data-driven decisions, and even develop intelligent applications, all without needing to write or understand complex code.

However, it’s crucial to highlight that while no-code ML platforms have done wonders to increase the accessibility of machine learning, they aren’t a complete replacement for understanding machine learning principles. While they reduce the need for coding, the interpretation of results, the identification and addressing of potential biases, and the ethical use of ML models still necessitate a solid understanding of machine learning concepts.

5. Ethical and Explainable Machine Learning

Another crucial machine learning trend in 2023 that needs highlighting is the increasing focus on ethical and explainable machine learning. As machine learning models become more pervasive in our society, understanding how they make their decisions and ensuring those decisions are made ethically has become paramount.

Explainable machine learning, often known as interpretable machine learning or explainable AI (XAI), is about developing models that make transparent, understandable predictions. Traditional machine learning models, especially complex ones like deep neural networks, are often seen as “black boxes” because their internal workings are difficult to understand. XAI aims to make the decision-making process of these models understandable to humans.

The growing interest in XAI is driven by the need for accountability and trust in machine learning models. As these models are increasingly used to make decisions that directly affect people’s lives, such as loan approvals, medical diagnoses, or job applications, it’s important that we understand how they’re making those decisions and that we can trust their accuracy and fairness.

Alongside explainability, the ethical use of machine learning is gaining increased attention. Ethical machine learning involves ensuring that models are used responsibly, that they are fair, unbiased, and that they respect users’ privacy. It also involves thinking about the potential implications and consequences of these models, including how they could be misused.

In 2023, the rise of explainable and ethical machine learning reflects a growing awareness of the social implications of machine learning (as well as the rapidly evolving legislation regulating how machine learning is used). It’s an acknowledgment that while machine learning has immense potential, it must be developed and used responsibly, transparently, and ethically.

Another trend shaping the machine learning landscape is the rising emphasis on machine learning operations, or MLOps . A recent report found that the global MLOps market is predicted to grow from $842 million in 2021 to nearly $13 billion by 2028.

In essence, MLOps is the intersection of machine learning, DevOps, and data engineering, aiming to standardize and streamline the lifecycle of machine learning model development and deployment. The central goal of MLOps is to bridge the gap between the development of machine learning models and their operation in production environments. This involves creating a robust pipeline that enables fast, automated, and reproducible production of models, incorporating steps like data collection, model training, validation, deployment, monitoring, and more.

One significant aspect of MLOps is the focus on automation . By automating repetitive and time-consuming tasks in the ML lifecycle, MLOps can drastically accelerate the time from model development to deployment. It also ensures consistency and reproducibility, reducing the chances of errors and discrepancies.

Another important facet of MLOps is monitoring. It’s not enough to simply deploy a model; ongoing monitoring of its performance is crucial. MLOps encourages the continuous tracking of model metrics to ensure they’re performing as expected and to catch and address any drift or degradation in performance quickly.

In 2023, the growing emphasis on MLOps is a testament to the maturing field of machine learning. As organizations aim to leverage machine learning at scale, efficient and effective operational processes are more crucial than ever. MLOps represents a significant step forward in the journey toward operationalizing machine learning in a sustainable, scalable, and reliable manner.

7. Multimodal Machine Learning

The final trend that’s getting attention in the machine learning field in 2023 is multimodal machine learning . As the name suggests, multimodal machine learning refers to models that can process and interpret multiple types of data — such as text, images, audio, and video — in a single model.

Traditional machine learning models typically focus on one type of data. For example, natural language processing models handle text, while convolutional neural networks are great for image data. However, real-world data often comes in various forms, and valuable information can be extracted when these different modalities are combined. 

Multimodal machine learning models are designed to handle this diverse range of data. They can take in different types of inputs, understand the relationships between them, and generate comprehensive insights that wouldn’t be possible with single-mode models.

For example, imagine a model trained on a dataset of movies. A multimodal model could analyze the dialogue (text), the actors’ expressions and actions (video), and the soundtrack (audio) simultaneously. This would likely provide a more nuanced understanding of the movie compared to a model analyzing only one type of data.

As we continue through 2023, we’re seeing more and more applications leveraging multimodal machine learning. From more engaging virtual assistants that can understand speech and see images to healthcare models that can analyze disparate data streams to detect cardiovascular disease , multimodal learning is a trend that’s redefining what’s possible in the machine learning field.

Key Takeaways

In 2023, machine learning continues to evolve at an exciting pace, with a slew of trends reshaping the landscape. From AutoML simplifying the model development process to the rise of no-code ML platforms democratizing machine learning, technology is becoming increasingly accessible and efficient.

The trends we’re seeing in 2023 underscore a dynamic, rapidly evolving field. As we continue to innovate, the key will be balancing the pursuit of powerful new technologies with the need for ethical, transparent, and responsible AI. For anyone in the tech industry, whether a hiring manager seeking the right skills for your team or a professional looking to stay on the cutting edge, keeping an eye on these trends is essential. The future of machine learning looks promising, and it’s an exciting time to be part of this journey.

This article was written with the help of AI. Can you tell which parts?

Get started with HackerRank

Over 2,500 companies and 40% of developers worldwide use HackerRank to hire tech talent and sharpen their skills.

Recommended topics

• Machine Learning

Optimizing for Excellence: EY’s Modern Approaches to Streamlining Hiring Processes

• Automated reasoning
• Cloud and systems
• Computer vision
• Conversational AI
• Information and knowledge management

Machine learning

• Operations research and optimization
• Quantum technologies
• Search and information retrieval
• Security, privacy, and abuse prevention
• Sustainability
• News and features
• Publications
• Code and datasets
• Alexa Prize
• Academics at Amazon
• Amazon Research Awards
• Research collaborations
• Bayesian optimization
• Fairness, accountability, transparency, ethics
• Multi-armed bandits
• Reinforcement learning
• Time series

Recent publications

• Q-Tuning: Queue-based prompt tuning for lifelong few-shot language learning Yanhui Guo , Shaoyuan Xu , Jinmiao Fu , Jia (Kevin) Liu , Chaosheng Dong , Bryan Wang NAACL 2024 2024 This paper introduces Q-tuning, a novel approach for continual prompt tuning that enables the lifelong learning of a pre-trained language model. When learning a new task, Q-tuning trains a task-specific prompt by adding it to a prompt queue consisting of the prompts from older tasks. To better transfer the knowledge of old tasks, we design an adaptive knowledge aggregation technique that reweighs previous Conversational AI
• Quantifying intrinsic causal contributions via structure preserving interventions Dominik Janzing , Patrick Blöbaum , Atalanti Mastakouri , Philipp Faller , Lenon Minorics , Kailash Budhathoki AISTATS 2024 2024 We propose a notion of causal influence that describes the ‘intrinsic’ part of the contribution of a node on a target node in a DAG. By recursively writing each node as a function of the upstream noise terms, we separate the intrinsic information added by each node from the one obtained from its ancestors. To interpret the intrinsic information as a causal contribution, we consider ‘structure-preserving Machine learning
• Effect size estimation for duration recommendation in online experiments: Leveraging hierarchical models and objective utility approaches Yu Liu , Runzhe Wan , James McQueen , Doug Hains , Jinxiang Gu , Rui Song AAAI 2024 2024 The selection of the assumed effect size (AES) critically determines the duration of an experiment, and hence its accuracy and efficiency. Traditionally, experimenters determine AES based on domain knowledge. However, this method becomes impractical for online experimentation services managing numerous experiments, and a more automated approach is hence of great demand. We initiate the study of data-driven Machine learning
• Neural ode for multi-channel attribution Yudi Zhang , Oshry Ben-Harush , Siyu Zhu , Dennis Liang , Kent Ken , Daryl Hammett ICLR 2024 Workshop on AI4DifferentialEquations in Science 2024 Multi-Touch Attribution plays a crucial role in both marketing and advertising, offering insight into the complex series of interactions within customer journeys during transactions or impressions. This holistic approach empowers marketers to strategically allocate attribution credits for conversions across diverse channels, not only optimizing campaigns but also elevating overall marketplace strategies Machine learning
• Multi-modal hallucination control by visual information grounding Alessandro Favero , Luca Zancato , Matthew Trager , Siddharth Choudhary , Pramuditha Perera , Alessandro Achille , Ashwin Swaminathan , Stefano Soatto CVPR 2024 2024 Generative Vision-Language Models (VLMs) are prone to generate plausible-sounding textual answers that, however, are not always grounded in the input image. We investigate this phenomenon, usually referred to as “hallucination” and show that it stems from an excessive reliance on the language prior. In particular, we show that as more tokens are generated, the reliance on the visual prompt decreases, and Computer vision

Related content

Work with us

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Sensors (Basel)

Machine Learning for Industry 4.0: A Systematic Review Using Deep Learning-Based Topic Modelling

Associated data.

The dataset generated during the current study is not publicly available as it contains proprietary information that the authors acquired through a license. Information on how to obtain it and reproduce the analysis is available in the presented work or from the corresponding author on request.

Machine learning (ML) has a well-established reputation for successfully enabling automation through its scalable predictive power. Industry 4.0 encapsulates a new stage of industrial processes and value chains driven by smart connection and automation. Large-scale problems within these industrial settings are a prime example of an environment that can benefit from ML. However, a clear view of how ML currently intersects with industry 4.0 is difficult to grasp without reading an infeasible number of papers. This systematic review strives to provide such a view by gathering a collection of 45,783 relevant papers from Scopus and Web of Science and analysing it with BERTopic. We analyse the key topics to understand what industry applications receive the most attention and which ML methods are used the most. Moreover, we manually reviewed 17 white papers of consulting firms to compare the academic landscape to an industry perspective. We found that security and predictive maintenance were the most common topics, CNNs were the most used ML method and industry companies, at the moment, generally focus more on enabling successful adoption rather than building better ML models. The academic topics are meaningful and relevant but technology focused on making ML adoption easier deserves more attention.

1. Introduction

Industry 4.0, or the fourth industrial revolution, expresses the rapid changes to the industrial world due to the combined improvements of technologies that join the physical and digital worlds [ 1 ]. These technologies refer to the inter-connectivity of the internet of things (IoT), robotics and edge devices, as well as the smart automation brought by artificial intelligence [ 2 , 3 , 4 ]. Considering the large scale of industrial problems, the proven success in scalability and automation of Machine Learning’s (ML) predictive power holds a lot of potential to thrive here. Hence, in recent years, researchers and companies are exploring ML for industry 4.0 more and more, seeking these benefits [ 5 ]. Bertolini et al. put forward a review discussing the applications of Convolutional Neural Networks (CNNs) and Autoencoders to industry problems [ 6 ]. Similarly, Gupta and Farahat presented a tutorial at the 2020 ACM SIGKDD Conference on Knowledge Discovery and Data Mining, highlighting new methods for industrial AI such as deep Reinforcement Learning (RL) [ 7 ].

However, industrial applications of ML are a complicated space due to the number of different intersecting domains, and the spike in interest over recent years, while positive, has made it challenging to thoroughly follow the trends of published work. A clear view of the area at scale allows interested parties to see evidence of rapidly increasing interest and, more specifically, where the attention of the community lies. This information is critical because it allows one to infer key points such as what research direction can be of useful contribution or what solution directions might be practical and worth real use.

For analysing and extracting useful insights from large datasets of text, natural language processing (NLP) techniques have shown positive results [ 8 ]. Wang and Zhang reviewed different means of recognizing method entities in academic literature using NLP [ 9 ]. Firoozeh et al. also examine keyword extraction methods as a means of extracting knowledge from large text datasets [ 10 ]. Keyword extraction is a powerful means of understanding what an entire corpus is about. Topic modelling methods, on the other hand, can count and cluster important words in order to identify the major themes within the corpus [ 11 ]. An example of this is seen in the work by Jacobi et al. where they apply a topic modelling technique, Latent Dirichlet Allocation (LDA), to a news corpus [ 12 ]. This approach allows one to discover topics of semantic similarity with richer depth and less manual input than using keyword extraction or simple statistical counts on the corpus.

This paper aims to provide a clear view of how ML methods intersect with industry 4.0 problems by analysing academic publications using NLP techniques. Through topic modelling, we were able to extract the main subareas of research from a dataset of scientific publications relevant to ML in industrial settings. Further analysis also allowed us to compare the use of ML techniques within each identified topic. Through these extractions, we answered the following research questions:

• What are the industry 4.0 problems where ML solutions see the most discussion?
• Which ML methods are used the most in these areas?
• How do the areas focused on in the academic literature compare to the areas of focus in the white papers of top industrial companies?

Instead of a traditional manual review of papers, the focus of this review is on the automatic extraction of insights in the field from a large unreadable corpus of papers. However, brief descriptions of a subset of the well-known ML methods and industry 4.0 problems are still important for a thorough introduction. Hence, the remainder of the introduction section will highlight these areas, but the systematic review is not limited to them.

1.1. Machine Learning Methods

1.1.1. learning paradigms.

Before presenting specific methods, we must first clarify the major categories of learning paradigms they fall into.

• Supervised Learning. This refers to methods that are trained using labelled examples. They can be highly accurate and trustworthy if the inferences made in real use are similar enough to the examples used during training.
• Unsupervised Learning. This refers to methods that are used on unlabelled data. They are relatively less accurate but can be effective depending on the scenario and problem.
• Reinforcement Learning. This refers to methods that reward positive or correct behaviour and punishes incorrect behaviour. The difference is clarified here as it does not fall under the aforementioned learning paradigms but more on this type of learning is discussed in its relevant section below.

1.1.2. Neural Networks

An artificial neural network (ANN) is generally comprised of an input layer, one or many hidden layers of neurons and an output layer. An artificial neuron consists of input, weights applied to each input, a bias that is applied to the sum of the weighted inputs, and an activation function that converts the result to the expected form of the output (for example, the sigmoid function for a classification value of 0 or 1) [ 13 , 14 , 15 ].

A neural network with a single hidden layer is typically called a perceptron network, while networks with many hidden layers are referred to as Deep Neural Networks or Deep Learning and are at the core of many modern and popular ML methods [ 16 , 17 ]. The various ML techniques we are about to discuss are deep neural networks that use different structures of layers as well as specific mechanics relevant to their types of data and problems.

1.1.3. Convolutional Neural Networks

Convolutional Neural Networks (CNNs) are one of the most popular and successful deep learning architectures. Although based on Neural Networks, they are mainly used in the field of Computer Vision (CV), for image-based pattern recognition tasks such as image classification.

Aside from input and output, the CNN architecture is typically composed of these types of layers: convolutional layers, pooling layers and fully connected layers. A convolutional layer computes the scalar product between a small region of the input image or matrix and a set of learnable parameters known as a kernel or filter. These calculations are the bulk of the CNN’s computational cost. The rectified linear unit (ReLU) activation function is also applied to the output before the next layer. A pooling layer performs downsampling, by replacing some output with a statistic derived from close information. This reduces the amount of input for the next layer, therefore reducing computational load. A fully connected layer is where all neurons are connected as in a standard ANN. This followed by an activation function helps produce scores in the expected format of the output (i.e., a classification score). Despite being computationally expensive, CNNs have seen many successful applications in recent years [ 18 , 19 , 20 ].

1.1.4. Recurrent Neural Networks

Recurrent Neural Networks (RNNs) perform particularly well on problems with sequential data such as text or speech or instrument readings over time. This is because, unlike other deep learning algorithms, they have an internal memory that is meant to remember important aspects of the input. A feedback loop instead of forward-only neurons is what enables this memory. The output of some neurons can affect the following input to those neurons [ 21 , 22 ].

However, because of the vanishing and exploding gradient problems caused by the way the neurons affect many others through memory in RNNs, their ability to learn effectively becomes limited. Hence, the Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) methods aimed to solve this issue and rose to popularity as well. They do so by using gates to determine what information to retain [ 23 , 24 , 25 , 26 ].

1.1.5. Support Vector Machines

Support Vector Machines (SVMs) are linear models that can be used for both classification and regression problems. SVMs approximate the best lines or hyperplane for separating classes by maximising the margin between the line or hyperplane and the closest data points [ 27 , 28 , 29 ]. Although this best-fit separator can be used for regression, it is more commonly used for classification problems. It is considered to be a traditional ML method compared to its deep learning counterparts but can achieve good results with relatively lower compute and training data requirements.

1.1.6. Decision Trees and Random Forests

Decision trees are graphs comprised of nodes that branch off based on thresholds. They can be constructed by recursively evaluating nodes or features to find the best predictive features [ 30 , 31 ]. By itself, it can be used to make predictions, but to increase the performance of the method and mitigate overfitting, an aggregated collection of decision trees called a random forest can be used. Random forests as an ensemble learning method can accomplish this by training some trees on subsets of the data or features and aggregating the results [ 32 , 33 ]. The technique of training trees on different samples or subsets of data is called bootstrap aggregating or “bagging” [ 34 ].

They generally outperform decision trees but, depending on the data and problem, may not achieve an accuracy as high as gradient-boosted trees. Boosting is a technique where the random forest is an ensemble of weak learners or shallow decision trees that perform slightly better than guessing [ 35 ]. The intuition here is that weak learners are too simple to overfit and therefore their aggregated model is less likely to overfit. Gradient boosting builds on top of this by introducing gradient descent to minimize the loss in training [ 36 , 37 ]. An example of a popular and practical library implementation of gradient boosting is XGBoost [ 38 ].

Much like the aforementioned SVMs, algorithms based on decision trees are considered to be more traditional than deep learning methods and work especially well in situations with low compute and limited training data.

1.1.7. Autoencoders

Autoencoders are ANNs that follow the encoder–decoder architecture. They aim to learn efficient encodings of data in an unsupervised way. The encoder is responsible for learning how to produce these lower dimension representations from the input, while the decoder reconstructs the encodings to their original dimensions [ 39 , 40 , 41 ]. Autoencoders are commonly associated with dimensionality reduction, as a deep learning approach to the problem traditionally handled by methods such as Principal Component Analysis (PCA) [ 42 ]. Reconstruction by the decoder can be useful for evaluating the quality of encodings, generating new data or detecting anomalies if performance significantly differs from normal cases. So, generally, some common applications of autoencoders include anomaly detection, especially in cyber-security, facial recognition and image processing such as compression, denoising or feature detection [ 43 , 44 , 45 ].

1.1.8. Reinforcement Learning

Unlike the previously described supervised and unsupervised learning methods, Reinforcement Learning (RL) trains models by rewarding and punishing behaviour [ 46 , 47 ]. The intuition behind this is to let models explore and discover optimal behaviours instead of trying explicitly to train that behaviour with many samples. In RL, the model is defined as an agent that can choose actions from a predefined set of possible choices. The agent receives a sequence of observations from its environment as the basis or input for deciding on actions. Depending on the action chosen the agent is rewarded or punished for it to learn the desired behaviour.

This training is accomplished through defining concepts such as a policy, reward function and value function. A policy is a function that defines the agent’s behaviour, it maps the current observable state to an action and can be either deterministic or stochastic. A Value function estimates the expected return or reward of a certain state given a policy function. This allows the agent to assess different policies in a particular situation. The reward function returns a score based on the agent’s action in the environment’s state (i.e., a state–action pair).

Deep RL is attained when deep neural networks are used to approximate any of the prior mentioned functions [ 48 ]. Proximal Policy Optimization (PPO), Advantage Actor-Critic (A2C) and Deep Q Networks (DQN) are some examples of popular Deep RL algorithms. RL also sees successful practical use areas such as games, robotic control, finance, recommender systems and load allocation in telecommunications or energy grids [ 49 , 50 , 51 ].

1.1.9. Nearest Neighbour

The Nearest Neighbour (NN) method is a simple algorithm that finds a defined number of samples closest to the new input point [ 52 , 53 , 54 ]. It is often used as a method for classifying new points based on the closest stored points, where closeness as a metric of similarity can be defined but is usually standard euclidean distance. Computation of the nearest neighbours can be conducted by brute force, or by methods devised to address brute force’s shortcomings such as K-D tree or Ball Tree [ 55 , 56 ]. Despite being such a simple method, NN has shown to be effective even for complex problems.

1.1.10. Generative Adversarial Networks

Generative Adversarial Networks (GANs) are unsupervised models concerned with recognizing patterns in input data to produce new output samples that would pass as believable members of the original set. The GAN architecture consists of a generator, a DL model for producing new samples, and a discriminator, a DL model for discerning fake samples from real ones. The discriminator receives feedback based on the known labels of which samples are real and the generator receives feedback based on how well the discriminator discerns its output. Thus, the networks are trained in tandem [ 57 ]. Despite being the most recent of the discussed methods (first described in 2014), its adoption in real cases is growing rapidly given the high potential usefulness of generating data points to support meaningful problems with limited data availability. Direct applications aside from training data synthesis also include, among others, image processing such as restoration or superresolution, image-to-image translation, generating music and drug discovery [ 58 , 59 ].

1.2. Industry 4.0 Problems

1.2.1. fault detection and diagnosis in maintenance.

Considering the strong implications for safety, efficiency and cost, monitoring for machine malfunctions in an effective manner is a task that is both common and of high importance in the industrial world. Therefore, the scalable automation of these Fault Detection and Diagnosis (FDD) systems through ML techniques is one of the most popular types of ML applications in the field [ 60 , 61 , 62 ].

Given the nature of many faults such as signs of deterioration or surface defects on manufactured products, visual inspection is a regular and meaningful aspect of FDD systems. Hence, CNNs are regularly utilized in systems that aspire to automate this [ 63 , 64 , 65 , 66 , 67 , 68 ].

However, with the unique variety of the machines, products and components FDD systems must deal with, procuring large image datasets for each of them to leverage CNNs is no easy task. Time-series sensors that record metrics such as pressure, vibration or temperature are far more common in industry settings. So models that attempt to automate FDD through those relevant data types are also seen. With the success and popularity of CNNs, some still try to apply them to this data by using visualizations of the time-series data [ 69 ]. However, models that specifically focus on these data types such as RNNs, although not as commonly seen, are developed and deserve as much attention [ 70 , 71 , 72 ].

1.2.2. Predicting Remaining Useful Lifetime

In a similar vein to FDDs, the efficiency and planning of industry maintenance can be empowered by predicting how much useful time a machine or part has left. This can be applied to components that need regular replacement such as bearings or batteries [ 73 , 74 ], or in more challenging cases, can be sudden rapid failures in complex processes such as ion milling [ 75 ]. With the stronger temporal aspect to this problem, sequence models are more commonly seen [ 75 , 76 , 77 ] but creative approaches using other methods such as autoencoders [ 78 ], decision trees [ 79 ], RL [ 80 ] and GANs [ 81 ] have also been presented.

1.2.3. Autonomous Operation

Automation of repetitive operations is another impactful area for leveraging ML in industry 4.0. Robotic operation is one of the most direct approaches to this and most commonly makes use of CNNs or RL or both [ 82 , 83 , 84 ]. RL is an effective method for developing agents or models that are dynamic and adaptable to the same tasks in different environments, while CNNs are useful here for recognizing visual features in tasks such as object detection or aiding RL agents in observing the environment space. These applications can be as generic as automated pick and place [ 85 ] or as use-case specific as, for example, automating coastal cranes for shipping containers [ 86 ]. UAV navigation for smart agriculture is also another strong growing application worth mentioning [ 87 , 88 ].

However, autonomous operation also reaches other aspects of industrial businesses such as customer service or marketing operations [ 89 , 90 ]. As these domains are inherently more digital, they are a source of simpler and easier but still effective forms of automation.

1.2.4. Forecasting Load

Load forecasting refers to predicting changes in demand over time, typically regarding energy or electrical grids. Load forecasting is critical for adequate preparation to cater for increased demands. For example, consider a power company that may need to acquire additional materials such as natural gas to meet the expected demands. Accurate forecasting will not only result in better services but can significantly improve economic and environmental efficiency in their energy usage [ 91 , 92 ].

As a temporal regression problem, this industry 4.0 use case is one of the few where deep sequence models such as RNNs or LSTMs are used much more than alternative models [ 93 , 94 , 95 ]. Furthermore, while there is evidence that shows they do perform well, they are not exempt from common industrial challenges in adoption and practical use such as data availability or complex system integration.

1.2.5. Optimizing Energy Consumption

The case of optimizing energy consumption in industrial settings, in some ways, can be viewed as an extension of the previously described load forecasting problem. There is also some similar usage of ML, in that models are often designed for forecasting energy consumption [ 96 , 97 ].

These forecasts can be useful in supporting decisions to optimize the response to that demand. An example of this is seen in work conducted by [ 98 ], where they optimize demand responses through a rule and ML-based model for controlling and regulating a heat pump and thermal storage. Similarly, in [ 99 ], IoT-based data collection was used to optimize energy consumption for a food manufacturer by providing them with analysis results to support decisions. Other examples of specific approaches to optimizing energy consumption include offloading ML compute to the edge or fog [ 100 ], using RL for optimizing the trajectory of UAVs in intelligent transportation systems and smart agriculture [ 101 , 102 ] and using the ant colony optimization algorithm to improve routing performance and therefore energy consumption in wireless sensor networks [ 103 ].

1.2.6. Cyber-Security

One of the most general and common use cases faced in industry 4.0 regardless of the specific field is Cyber-Security. As digitization increases more and more so does the need to sufficiently protect those digital assets and processes. The importance and priority of security are also notably higher for supervisory control and data acquisition (SCADA) systems [ 104 ]. This is because SCADA is a category of applications for controlling industrial processes and therefore a digital interface to large-scale physical components. Furthermore, the historic ramifications of famous attacks such as Stuxnet act as evidence of the threat and dangers posed by poor security practices [ 105 ].

Malicious attacks can be viewed as very unusual behaviour the system does not expect in regular use, and because of this, from an ML standpoint it is often formulated as an anomaly detection problem. Traditional methods such as k-Nearest Neighbours-based clustering algorithms or decision trees can be used to approach this problem [ 106 , 107 , 108 ], but in recent years deep autoencoders have seen a lot of successful use [ 109 , 110 , 111 , 112 ]. This is performed by training on data, such as activity logs or network requests, that is almost all normal and non-malicious. If the malicious activity goes through the autoencoder then, because it is anomalous and unlike previous data, the decoder would reconstruct it more poorly than usual.

It must be noted however that although the formulation of anomaly detection is effective and popular, it is not perfect in the case of complex attack sequences trying to mimic normal behaviour. To that end, other methods for security and intrusion detection are still just as important. For example, RL has also seen use in vulnerability analysis by seeking to train agents to be both attackers and defenders for the system being evaluated and learn complex attack behaviours [ 113 , 114 , 115 ].

1.2.7. Localizing Assets

While the Global Positioning System (GPS) is often sufficient for determining location in outdoor environments, the indoor localization of assets is a more challenging problem due to the lack of line of sight to satellites. This is useful for several applications including security by tracking entry to unauthorized areas, factory safety by ensuring the right need number of people is maintained and data analytics by providing an additional means of monitoring processes and key performance indicators (KPIs) such as idle time or loading time [ 116 ].

For indoor localization Wi-Fi fingerprinting has become one of the most common technology choices as it does not require a line of sight and can work with any Wi-Fi-capable device without any additional hardware [ 117 ]. Deep learning has successfully supported this area by enabling cases such as self-calibrating fingerprint databases for localization with autoencoders [ 118 ] or recognizing received signal strength (RSS) patterns in device-free localization with autoencoders and CNNs [ 119 , 120 ].

1.2.8. Soft Sensors

The complexity of industrial processes, especially in cases such as the chemical, bioprocess or steel industries, is often reflected in a large number of sensor metrics and variables for monitoring, controlling and optimizing these processes. Soft Sensors are software-based data-driven ways to estimate, simplify and model these large numbers of physical sensors with varying constraints [ 121 , 122 ]. By having this representation of the process’s state, it becomes easier to detect faults, recognize changes in performance through tracking and optimize decisions in scheduling or supply chain management. Traditional statistical methods such as PCA or support vector machines (SVM) have often been applied to soft sensing [ 123 ], but modern methods such as autoencoders that can produce latent representations of data well have also seen use [ 111 , 124 ].

1.2.9. Logistics and Resource Allocation

The efficiency of logistical issues such as delivery schedules, manufacturing pipelines, raw material management and the allocation of resources throughout all processes are incredibly important to lowering costs and maximizing productivity in industrial companies [ 125 , 126 ], while these issues are still handled quite well by optimization algorithms such as particle swarm or ant colony optimization [ 127 , 128 , 129 , 130 , 131 ]. There has been increasing interest and usage of RL for these problems [ 132 , 133 ]. RL and its exploratory behaviour-driven means of solving problems can allow for greater flexibility in adapting to unforeseen circumstances, especially in the case of the ever-changing and unique needs some companies may have. That being said, RL solutions are complex to develop and implement as is, this becomes even more challenging when companies must find a way to integrate them into their already complex processes so optimization algorithms still stand as the stronger simpler source of solutions.

2. Related Works

There have been several reviews and surveys in the space of ML for industry 4.0. Some focus on specific ML application areas such as predictive maintenance [ 60 , 134 , 135 ], soft sensing [ 136 ] and fault detection [ 137 ]. Some try to be more comprehensive, looking at ML applied to an entire industry or common pipelines, such as manufacturing [ 138 , 139 , 140 , 141 , 142 ], transportation [ 143 , 144 ] and energy systems [ 145 , 146 ].

While others, in a similar vein to this paper, aim to cover the entire area of ML for industry 4.0. For example, the tutorial by Gupta and Farahat exemplified impactful industrial applications based on categories of ML methods [ 7 ]. Similarly, work in [ 142 ] and [ 147 ] provide an overview of how ML methods can enhance solutions to industrial problems. However, although a review based on manually read papers can provide an in-depth analysis, they are limited to amounts that can be feasibly read and only observe a limited sample of the industry 4.0 literature. The aforementioned reviews are useful and impactful works, but cannot provide insight on some questions, such as what industrial business functions receive the most attention or which receive too little, without quantitative results.

Hence, systematic reviews of this nature have also been explored, for example by Bertolini et al. [ 6 ]. They first curated a dataset of papers by querying the Scopus, Web of Science and Google Scholar databases. They then performed a series of restrictions to refine the dataset down to 147 papers which they manually reviewed. A similar approach was taken by Liao et al. by manually vetting papers included in their analysis [ 148 ]. Such an approach can extract highly relevant and representative papers for detailed insights, such as key applications and techniques, through manual review.

Even so, larger-scale insights can be attained by working with the bigger datasets that are possible given the massive trustworthy databases available. Lee and Lim explore an industry 4.0 review based on text-mining and provided insightful clarity on the state of the field [ 149 ]. Nonetheless, their method was only semi-automated and included a limited dataset of 660 articles up to 2018. Advanced NLP methods, specifically Topic Modelling, enable the automated analysis of large-scale document sets that are infeasible for manual reading. The effectiveness of Topic Modelling for analysing research fields was exemplified by the work of Mazzei et al. surveying Social Robotics [ 150 ] and Atzeni et al. observing ML and Wi-Fi [ 151 ]. This approach can be useful for understanding the space at large by allowing the insights to be truly data-centric rather than heavily influenced by the sampling method. That is, its benefit over manual reviews is that it can cover a vast number of publications, infeasible for manual reading, and discover its topics. To the best of our knowledge, at the time of writing, there are no systematic reviews such as this for ML in industry 4.0.

3. Methodology

This section will detail the steps behind obtaining, preparing and analysing our data with respect to our goals and previously discussed approach. We break down the methodology into the steps of paper gathering, preprocessing, meta-analysis, topic modelling and topic analysis.

3.1. Paper Gathering

Our dataset curation follows the structure provided by the PRISMA statement for reporting on systematic reviews. Figure 1 illustrates the structure followed. Note that all of the report screening was completed after retrieving the data due to the limitations of the database APIs used.

PRISMA flow diagram of dataset curation. ** Count includes exclusions by both humans and automated tools.

The papers retrieved for this study were sourced from Scopus and Web of Science via their respective APIs. These databases are commonly used for systematic reviews and their comprehensiveness has been studied [ 152 , 153 ]. The query presented in Listing 1 was used for both sources. The query constrains results to mention both a term referring to industrial settings as well as a term strongly relevant to machine learning or some of its most popular methods. Due to the limitations of the database providers, only paper titles, abstracts and metadata were collected.

Scopus returned 42,072 papers and Web of Science returned 71,989. After removing duplicates, the dataset had 71,074 papers with 21,283 and 49,825 coming from Scopus and Web of Science, respectively. We then restricted the dataset to papers from the most recent 6 years because changes in the trends of ML and data analytics are rapid, and we are more interested in the currently prevailing topics than those of a decade ago.

Figure 2 shows Google Trends’ interests over time for Machine Learning and industry 4.0. There was a substantial increase in interest for both topics beginning in January 2016. Furthermore, Figure 3 shows the publications over time from the initial papers retrieved, and there is a clear spike in the number of papers from 2016 onward. These observations further support our decision to restrict our analysis to the last 6 years. Hence, the final corpus consisted of 45,783 papers from January 2016 to February 2022.

Google Trends’ interest over time for Machine Learning and industry 4.0.

ML in industry 4.0 publications and citations since 1999.

3.2. Preprocessing

Data cleaning tasks firstly consisted of catering for the differences in the fields returned by the two databases in order the merge paper sets for analysis. Secondly, the main text corpus to be analyzed was prepared. This included the following: combining the title, keywords and abstract fields, converting all characters to lowercase, lemmatization and lastly, removing punctuation, digits and stopwords.

3.3. Meta-Analysis

The preliminary analysis was aimed at supporting our attempt to answer the research questions targeted in Section 1 . This meta-analysis included: a plot of papers over time, a count and comparison of paper source types, and counts of papers that directly reference key popular ML methods.

3.4. Topic Modelling

The topic modelling performed on the corpus utilized the BERTopic algorithm [ 154 ]. This technique was chosen over others such as LDA [ 155 ] or NMF [ 156 ] because BERTopic requires less effort in hyperparameter tuning and it trampolines off of the successful transformer-based model, BERT [ 157 ]. It also empirically showed better results in topic coherence and topic diversity on benchmark datasets [ 154 ].

As described in its original article, the BERTopic algorithm comprises the following major steps:

• Paper Embeddings with BERT . Converting the text of the input papers to a numerical representation is the first step. BERT is used for this because it extracts embeddings according to the context of the words and the number of available pre-trained models makes it easier to obtain more accurate extractions. The Sentence-BERT implementation and pre-trained models are commonly used and were used in this case as well [ 158 ].
• Embedding Dimensionality Reduction with UMAP . Before clustering the embeddings to discover topics, dimensionality reduction is performed using UMAP because many clustering algorithms perform poorly on high-dimension data. UMAP was chosen because of its good performance in retaining information [ 159 ].
• Paper Clustering with HDBSCAN . With the dimensionality reduced to a reasonable amount, the embeddings are then clustered. HDBSCAN is chosen by the author because it does not force data points into clusters. It instead considers them outliers and it works well with UMAP since UMAP maintains structure well even in a low dimensional space [ 160 ].
• Topic Representation with c-TF-IDF . For deriving important representative words for the clusters of documents, a class-based variant of TF-IDF [ 161 ] that generalizes the method to a group of documents is used. Thus, resulting in a list of words representing a topic for each cluster. This representation is also used to give greater control over the number of clusters by merging similar and uncommon topics.

3.5. Topic Analysis

Upon the generation of the topic words by the prior step, we assessed the quality of the result by observing approximate visualizations of the clusters and manually vetting small random samples of each topic. If the quality of the result was deemed subpar, we adjusted the HDBSCAN hyperparameters, such as m i n _ c l u s t e r _ s i z e (the minimum size of clusters) and m i n _ s a m p l e s (how conservative the clusters should be when determining outliers), and repeated the process. The topic labels were manually determined based on the produced topic words and the sample vetting. We then analyzed each topic to observe: the percentage present in the corpus for each topic, the counts of papers referencing important ML methods within each topic and the keywords by count for each topic.

3.6. Garnering an Industry Perspective

Our third research question sought to examine a comparison between the areas focused on in the academic literature versus those in the white papers of top industrial companies. To that end, we manually gathered a small sample of such white papers and extracted the key ML for industry 4.0 topics. The query, “[company] white papers industry 4.0 machine learning ai”, was used on a popular search engine, Google, for a brief list of top professional consulting companies. The blogs and websites of these companies were also directly checked. The companies and their works included McKinsey & Company [ 162 , 163 , 164 , 165 , 166 ], Accenture [ 167 , 168 , 169 ], Microsoft [ 170 , 171 ], Bain & Company [ 172 ], Deloitte [ 173 ], PriceWaterhouseCoopers [ 174 , 175 ] and Boston Consulting Group [ 176 , 177 , 178 ]. The papers were manually vetted and selected for a similar degree of relevance and recency to our academic corpus, resulting in a set of 17 white papers. These papers were not included in the academic paper corpus or analyzed using the topic modelling procedure, they were manually reviewed and their main ML for industry 4.0 topics were extracted. The topics were extracted if the authors considered them to be of significant potential value to industrial companies.

3.7. Meta-Analysis Results

A comparison of paper source types is presented in Table 1 . Additionally, to gauge the presence of common ML techniques, we counted the papers that mention key popular ML methods in their title, abstract or keywords. This was conducted by writing lists of identifying terms for each ML method considered. The counts of papers referencing these ML methods are shown in Figure 4 ; however, “Neural Networks”, with a count of 36,229 papers, were excluded from that chart as it would overshadow the other results and affect readability.

ML Methods by paper count for corpus.

Paper sources for corpus.

4.1. Topic Modelling Results

Figure 5 shows plots of the topic words and c-TF-IDF scores produced by the topic modelling model after tuning the clustering hyperparameters. By further reducing the dimensions of the embeddings to two during the UMAP step, we produced a visualization of the topic clusters as shown in Figure 6 . This visualization as well as the sample vetting described in Section 3.4 allowed us to confirm that the topics cover the majority of the papers aside from outliers and capture their main themes. Based on reviewing the full lists of topic words and samples for each topic, the labels presented in Table 2 depict the primary topics found and their percentage of presence in the dataset.

Plots of topic words by c-TF-IDF scores from topic modelling entire corpus.

Visualization of topic clusters by further reducing embedding dimensions.

Top 10 results of topic modelling.

However, with the size of our corpus, the top 3 topics are wide-spanning branches of the ML for industry 4.0 subfields. They also encompass several thousands of papers, which helps emphasize the significance of those areas but impede our ability to examine specific research directions. Hence we further analyzed the top three results by repeating the topic modelling, tuning and labelling processes on them to produce their sub-topics, while considering sub-topics, the top 20 topics are put forward in Table 3 .

Top 20 results of topic modelling inclusive of sub-topics.

Furthermore, the counts by paper for ML methods were repeated for each topic. The resulting counts are reported in Figure 7 .

Count of papers by ML term mentions for each topic.

4.2. Industry Perspective Results

By manually reviewing the previously mentioned collection of white papers from consulting companies, we curated lists of high potential value areas in ML for industry 4.0 for each paper. These areas or topics were categorized, grouped and visualized in the mind map illustrated in Figure 8 .

Mind map of high potential value areas for ML in industry 4.0, by mentions in top consulting companies’ white papers.

5. Discussion

5.1. meta-analysis.

The meta-analysis results do not all directly contribute to answering our research questions, but they provide useful context on the state of the area and our data. The publications over time show the increasing interest in the area of ML for industry 4.0, with a strong spike in the last 6 years. By looking at the trend of publications with five or more citations, we see that the spike’s significance is less than 30% of its counterpart. This can be attributed to recency and the suddenness of the spike leading to many similar works competing. However, the trend of the spike in interest is maintained and allows us to estimate if the trend holds for impactful or popular papers.

The paper sources of our corpus are dominated by articles and conference papers, an expected result. Unexpectedly, the percentage of articles outshines the conference papers, a counter-intuitive result since Computer Science research findings tend to be published in conference papers [ 179 ]. Examining the results further we saw that for Scopus, the percentage of conference papers and articles were 67.9% and 25.5% respectively, while for Web of Science it was 20.8% and 73.3%. A likely contributor to this is that Scopus has better coverage of conference material, as previous work by Pranckutė has shown [ 180 ]. Hence, considering the Web of Science results outnumbered Scopus 33,632 to 12,151, it skews the final counts. Additionally, ML for industry 4.0 is much more interdisciplinary than the typical Computer Science sub-field so the tendency may not hold as well as usual.

5.2. RQ 1: What Are the Industry 4.0 Problems Where ML Solutions See the Most Discussion?

Towards answering this question we used topic modelling to extract insights from a large corpus and rationalized the choice of a deep learning-based approach in BERTopic. The modelling produced the top topic words for each cluster of papers, and we used the top 10 topic words in addition to manually vetted samples of clusters to assign final topic labels. The word scores in Figure 5 represent a quick look at what BERTopic produced. The topic words in that figure are the most common words in the topic defined by the algorithm. By themselves they clearly hint to what the topic is about, but to give accurate labels to each topic we also manually vetted random sample papers from each. The 2D visualization of the labelled corpus shown in Figure 6 makes it clear that the topics covered the corpus sufficiently with reasonable clusters. The clusters are cleanly separated and illustrate the differences in topic presence at a glance.

From Table 2 we can see that the top three topics are wide branches of the overall area. It is a useful observation to see their dominance at a general level but a closer inspection was deemed appropriate to meet the specificity of the remaining topics for a fairer comparison. The remaining 7 of that table were more specific cases of ML but the top 10 encapsulate the variety of the problems discussed in ML for industry 4.0.

Topics 0 and 1, “Predictive Models and Digital Systems for Industrial Machines” and “Robotic Automation”, are fairly general areas but show a significant focus on smart production applications. Topic 2, “Modelling for Agriculture and Water Treatment”, was a less expected observation. Smart agriculture is home to large branches of ML applications such as the classification of plants and crop health or using soil characteristics to inform decisions and actions. Hence it is understandable as a key topic. Water treatment on the other hand is a more specific class of industrial applications. The grouping of the two together is likely around the term “water” itself and can be construed as the model failing to distinguish the difference based on the implied context. This is a known limitation of BERTopic, where the topic representation stage is applied to bags-of-words and does not explicitly leverage the embedded representations in this step. This issue in addition to how wide of an area the top 3 topics cover, motivated further analysis on these three subsets by repeating the topic modelling procedure.

That process resulted in Table 3 where we see a similar degree of specificity across the topics. The general result of smart production being the most significant remained, but now we gain greater insight into the observation. Security and intrusion detection was the most prevalent area. taking into account the high potential costs and damage of cyber-attacks, the risks taken on by increasingly digitized systems and the regulatory compliances companies must meet, it is a logical finding that security is the most studied topic in the area. Similarly, another of the top 20 is gait recognition, a biometric authenticator often used as an added physical security measure [ 181 ]. Forecasting load and power demands, as well as optimization of job scheduling, are ultimately concerned with the goal of dynamically improving logistic processes in the supply chain. Sentiment analysis and recommender systems are a part of optimizing and personalizing customer service and are the only topic in the table concerned with this business function. The general theme of the remaining top 20 topics is of automating smart production tasks. Noteworthy inclusions among them, are “Fault diagnosis and detection” and “Predictive maintenance and RUL forecasting”. These are both focused on automating tasks that reduce the downtime of machines and are frequently a dominant topic in manual reviews.

5.3. RQ 2: Which ML Methods Are Used the Most in These Areas?

In a step toward answering the question “Which ML methods are the most common in the area?”, we counted the papers mentioning certain popular methods in their title, abstract and keywords. Across the entire corpus, Convolutional Neural Networks (CNNs) were the most common, with almost double the count of the second most common method. CNNs stand among the most popular deep learning methods given the recent string of successes in the computer vision domain. If we are to discuss how appropriate the choice of this model type is we must also consider the type of data most common in industrial settings for the problems many seek to solve. We cannot deduce this across the entire corpus easily, so we also look at the same count applied to each topic cluster of papers.

From Figure 7 we can see the method counts per topic. Convolutional neural networks (CNNs) are dominant in the top three topics but not by the magnitude the previous count figure alluded to. The clearest gap in usage is for the robotic automation topic. This is likely due to a combination of how much image data is present in that space and the popularity of computer vision applications in general.

Reinforcement learning (RL) is the second most popular for topic 1, “Robotic Automation”, which is interesting because the practical applications of this area are not as solidified as some of those in supervised learning. That result adds to the argument that robotic automation in industry 4.0 is a prime area for impactful real-world use of RL. This topic also has a higher than usual count for generative adversarial networks (GANs), which suggests that the space is often looked upon for the newer but exciting machine learning techniques. RL also has the highest count for the “optimization of job scheduling” topic but more traditional optimization techniques not covered in the scope of this review are more likely to be the standard solutions to this problem.

Recurrent neural networks (RNNs) see higher counts in topics where sequential or time-series data are more prominent, such as topic 3, “Forecasting load and power demands”, and topic 7, “Sentiment analysis and recommender systems”. However, it can be argued that for topic 0, “Predictive Models and Digital Systems for Industrial Machines”, one might expect to see RNNs over CNNs due to the heavy presence of multivariate time-series data in industrial machine sensors. The fact that autoencoders see a much higher count there than anywhere else attests to this. Thus, CNNs may be seeing more common use due to their popularity.

Meanwhile, the more traditional methods, support vector machines (SVMs) and decision trees see consistent mentions across all topics, likely due to their simplicity, lower computational demands and well-established reputations in the space of machine learning.

5.4. RQ 3: How Do the Areas Focused on in the Academic Literature Compare to the Areas of Focus in the White Papers of Top Industrial Companies?

Answering this question required a look at ML for industry 4.0 from the high-level perspective of top companies. To that end, we reviewed the recent and relevant white papers of top consulting companies to provide a foundation for comparing the academic literature’s focuses. We chose top consulting companies as they are often the ones providing guidance and insight to industry actors directly. These consulting companies can be considered leading experts in their practical domains, they also have an incentive to share their insights and trends publicly. The mind map shown in Figure 8 was the result.

If we categorize the topic modelling results presented similarly, each of the major categories in the mind map, such as smart production or connectivity, would be represented, while not every minor category, such as marketing or Virtual and Augmented Reality (VR/AR), is present in the topics extracted, this is understandable considering we look only at the top 20 specific topics. Moreover, some areas are inherently less “publishable” than others. For example, if a team were to discover a competitive edge in Product Development, publishing those findings could reduce that edge or eliminate it. Similarly, some areas provide more opportunities to publish by having a plethora of valuable use cases where ML models can be applied. Robotic automation and predictive maintenance are examples of such areas.

A limitation of the mind map is that it does not consider comparisons between the topics it covers when in reality not all of the high-potential areas shown are equal in impact and development complexity. So to gauge these aspects for our comparison, we also look at the specific results of the McKinsey & Company global survey on the state of AI in 2021 [ 166 ]. They surveyed 1843 participants, representing a full range of regions, industries, company sizes, functional specialities, and tenures, on their adoption and usage of AI. The survey shows that manufacturing use cases had the highest impact on decreasing costs. Hence, it makes sense that the academic literature would show a significant focus on smart production areas as well. Likewise, “Sentiment analysis and recommender systems” may seem like an inconsistent result among the other topics, but Customer Care and Personalization falls under Service Operations which, according to their survey, is the most commonly adopted AI use case category.

From this, we can posit that the academic literature generally aligns with the major focuses of industry experts. However, despite the aforementioned caveats, we believe that some areas still deserve more attention. Companies are focused not only on individual problems or use cases but also on the bigger picture of how they connect to the rest of their pipelines and how they integrate with existing systems. Therefore, we believe it would be worthwhile for future works to reflect this. Topics that lean towards this goal include democratized technology, Human–Machine-Interaction through digital twins and VR/AR, risk control concerning AI and ML in marketing.

6. Limitations and Promising Directions

One of the major limitations standing in the way of practical ML advancements that can help close the gaps between industry and academia is the availability of relevant data. Useful datasets certainly exist but given the variety of sources that occur from industry to industry, it is difficult to find truly comprehensive public datasets. The use of GANs to generate training samples for problems with limited data is therefore an interesting and useful direction of work, especially considering the large amounts of data DL methods require.

Another key issue is the complexity of deploying and integrating new ML systems. Large companies are likely to have capable teams and additional infrastructure in place to properly facilitate ML, but the vast majority of small to medium enterprises (SMEs) that do not have this would need to make an upfront investment for engineers or consultancy to explore the benefits of ML to their specific cases. Democratized technology and smart integration through IoT show great promise for simplifying the path to ML adoption. They enable general but useful ML solutions to be tried and built upon instead of upfront cost, thus smoothening the rate of investment required by SMEs.

Computer vision solutions have seen a lot of success and popularity in industry 4.0 and the attention it receives is well deserved. However, models that revolve around common existing sensors for machines (temperature, pressure, vibration etc.) and software (ERP, CRM, MES, etc.) would likely be cheaper in terms of computation and hardware. Therefore, time-series ML models relevant to these rich data sources are also a promising direction for advancing ML in industry 4.0.

7. Conclusions

Machine learning has a lot of potential value in industry 4.0 due to its scalable automation. This notion is supported by the spike in relevant publications over the last six years. With that much research activity, comprehensive reviews are needed to provide a foundation for guiding new studies and industry action plans, while there are several high-quality reviews in the field, not many attempt to review the area on a large scale and none utilize Topic Modelling to maximize the literature coverage. We aimed to do such a review by gathering papers from the Scopus and Web of Science databases, building a topic model using BERTopic, analysing the results and comparing it to a manually reviewed industry perspective.

We targeted our research towards three research questions, “What are the Industry 4.0 problems where ML solutions see the most discussion?”, “Which ML methods are used the most in these areas?” and “How do the areas focused on in the academic literature compare to the areas of focus in the white papers of top industrial companies?”. From reviewing the top 10 topics, we found that the most frequent problems fell under Security, Smart Production, IoT Connectivity, Service Optimization, Robotic Automation and Logistics Optimization. By counting the mentions of ML methods for each topic, we saw that CNNs were the most dominant despite the high presence of time-series data in industrial settings. We manually reviewed 17 company white papers to garner an industry perspective and compared them to our topics extracted from academic literature. In comparing the two, we observed that the coverage of areas generally aligned well, and the higher presence of smart production topics was justified given its real-world impact and the fact that some areas are more easily publishable than others.

However, we also recognized that companies are focused on higher-level goals rather than just individual ML use cases or improvements. Hence, we remarked that the topics supporting ML adoption and integration deserve attention and increased focus in future works. Examples of these areas include democratized technology, digital twins, human-AI-interaction and AI risk control.

Funding Statement

This work has been partially funded by Programme Erasmus+, Knowledge Alliances, Application No 621639-EPP-1-2020-1-IT-EPPKA2-KA, PLANET4: Practical Learning of Artificial iNtelligence on the Edge for indusTry 4.0. This research is supported by the Ministry of University and Research (MUR) as part of the PON 2014-2020 “Research and Innovation” resources—Green/Innovation Action—DM MUR 1061/2022.

Author Contributions

Conceptualization, D.M. and R.R.; methodology, D.M. and R.R.; software, R.R.; validation, D.M. and R.R.; formal analysis, R.R.; investigation, R.R.; resources, R.R.; data curation, R.R.; writing—original draft preparation, R.R.; writing—review and editing, D.M. and R.R.; visualization, R.R.; supervision, D.M.; project administration, D.M. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Data availability statement, conflicts of interest.

The authors declare no conflict of interest.

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.