Physical Sciences and Mathematics Commons^™

3d Point Cloud Classification With Acgan-3d And Vacwgan-Gp, Onur Ergün, Yusuf Sahi̇lli̇oğlu

Turkish Journal of Electrical Engineering and Computer Sciences

Machine learning and deep learning techniques are widely used to make sense of 3D point cloud data which became ubiquitous and important due to the recent advances in 3D scanning technologies and other sensors. In this work, we propose two networks to predict the class of the input 3D point cloud: 3D Auxiliary Classifier Generative Adversarial Network (ACGAN-3D) and Versatile Auxiliary Conditional Wasserstein Generative Adversarial Network with Gradient Penalty (VACWGAN-GP). Unlike other classifiers, we are able to enlarge the limited data set with the data produced by generative models. We consequently aim to increase the success of the model by …

Characterizing Location-Based Electromagnetic Leakage Of Computing Devices Using Convolutional Neural Networks To Increase The Effectiveness Of Side-Channel Analysis Attacks, Ian C. Heffron

Theses and Dissertations

SCA attacks aim to recover some sort of secret information, often in the form of a cipher key, from a target device. Some of these attacks focus on either power-based leakage, or EM-based leakage. Neural networks have recently gained in popularity as tools in SCA attacks. Near-field EM probes with high-spatial resolution enable attackers to isolate physical locations above a processor. This enables attackers to exploit the spatial dependencies of algorithms running on said processor. These spatial dependencies result in different physical locations above a chip emanating different signal strengths. The strengths of different locations can be mapped using the …

P-Adic Cellular Neural Networks, B. A. Zambrano-Luna, Wilson A. Zuniga-Galindo

School of Mathematical and Statistical Sciences Faculty Publications and Presentations

In this article we introduce the p-adic cellular neural networks which are mathematical generalizations of the classical cellular neural networks (CNNs) introduced by Chua and Yang. The new networks have infinitely many cells which are organized hierarchically in rooted trees, and also they have infinitely many hidden layers. Intuitively, the p-adic CNNs occur as limits of large hierarchical discrete CNNs. More precisely, the new networks can be very well approximated by hierarchical discrete CNNs. Mathematically speaking, each of the new networks is modeled by one integro-differential equation depending on several p-adic spatial variables and the time. We …

Wifi-Based Human Activity Recognition Using Attention-Based Bilstm, Amany Elkelany, Robert J. Ross, Susan Mckeever

Conference papers

Recently, significant efforts have been made to explore human activity recognition (HAR) techniques that use information gathered by existing indoor wireless infrastructures through WiFi signals without demanding the monitored subject to carry a dedicated device. The key intuition is that different activities introduce different multi-paths in WiFi signals and generate different patterns in the time series of channel state information (CSI). In this paper, we propose and evaluate a full pipeline for a CSI-based human activity recognition framework for 12 activities in three different spatial environments using two deep learning models: ABiLSTM and CNN-ABiLSTM. Evaluation experiments have demonstrated that the …

Plmsnosite: An Ensemble-Based Approach For Predicting Protein S-Nitrosylation Sites By Integrating Supervised Word Embedding And Embedding From Pre-Trained Protein Language Model, Pawel Pratyush, Suresh Pokharel, Hiroto Saigo, Dukka Kc

Michigan Tech Publications

Background: Protein S-nitrosylation (SNO) plays a key role in transferring nitric oxide-mediated signals in both animals and plants and has emerged as an important mechanism for regulating protein functions and cell signaling of all main classes of protein. It is involved in several biological processes including immune response, protein stability, transcription regulation, post translational regulation, DNA damage repair, redox regulation, and is an emerging paradigm of redox signaling for protection against oxidative stress. The development of robust computational tools to predict protein SNO sites would contribute to further interpretation of the pathological and physiological mechanisms of SNO. Results: Using an …

Enhanced Convolutional Neural Network For Non-Small Cell Lung Cancer Classification, Yahya Tashtoush, Rasha Obeidat, Abdallah Al-Shorman, Omar Darwish, Mohammad A. Al-Ramahi, Dirar Darweesh

Computer Information Systems Faculty Publications

Lung cancer is a common type of cancer that causes death if not detected
early enough. Doctors use computed tomography (CT) images to diagnose
lung cancer. The accuracy of the diagnosis relies highly on the doctor's
expertise. Recently, clinical decision support systems based on deep learning
valuable recommendations to doctors in their diagnoses. In this paper, we
present several deep learning models to detect non-small cell lung cancer in
CT images and differentiate its main subtypes namely adenocarcinoma,
large cell carcinoma, and squamous cell carcinoma. We adopted standard
convolutional neural networks (CNN), visual geometry group-16 (VGG16),
and VGG19. Besides, we …

Uncertaintyfusenet: Robust Uncertainty-Aware Hierarchical Feature Fusion Model With Ensemble Monte Carlo Dropout For Covid-19 Detection, Moloud Abdar, Soorena Salari, Sina Qahremani, Hak-Keung Lam, Fakhreddine (Fakhri) Karray, Sadiq Hussain, Abbas Khosravi, U. Rajendra Acharya, Vladimir Makarenkov, Saeid Nahavandi

Machine Learning Faculty Publications

The COVID-19 (Coronavirus disease 2019) pandemic has become a major global threat to human health and well-being Thus, the development of computer-aided detection (CAD) systems that are capable to accurately distinguish COVID-19 from other diseases using chest computed tomography (CT) and X-ray data is of immediate priority Such automatic systems are usually based on traditional machine learning or deep learning methods Differently from most of existing studies, which used either CT scan or X-ray images in COVID-19-case classification, we present a simple but efficient deep learning feature fusion model, called UncertaintyFuseNet, which is able to classify accurately large datasets of …

Deep Feature Meta-Learners Ensemble Models For Covid-19 Ct Scan Classification, Jibin B. Thomas, K. V. Shihabudheen, Sheik Mohammed Sulthan, Adel Al-Jumaily

Research outputs 2022 to 2026

The infectious nature of the COVID-19 virus demands rapid detection to quarantine the infected to isolate the spread or provide the necessary treatment if required. Analysis of COVID-19-infected chest Computed Tomography Scans (CT scans) have been shown to be successful in detecting the disease, making them essential in radiology assessment and screening of infected patients. Single-model Deep CNN models have been used to extract complex information pertaining to the CT scan images, allowing for in-depth analysis and thereby aiding in the diagnosis of the infection by automatically classifying the chest CT scan images as infected or non-infected. The feature maps …

A Non-Reference Evaluation Of Underwater Image Enhancement Methods Using A New Underwater Image Dataset, Ashraf Saleem, Sidike Paheding, Nathir Rawashdeh, Ali Awad, Navjot Kaur

Michigan Tech Publications

The rise of vision-based environmental, marine, and oceanic exploration research highlights the need for supporting underwater image enhancement techniques to help mitigate water effects on images such as blurriness, low color contrast, and poor quality. This paper presents an evaluation of common underwater image enhancement techniques using a new underwater image dataset. The collected dataset is comprised of 100 images of aquatic plants taken at a shallow depth of up to three meters from three different locations in the Great Lake Superior, USA, via a Remotely Operated Vehicle (ROV) equipped with a high-definition RGB camera. In particular, we use our …

Predicting Suicidal And Self-Injurious Events In A Correctional Setting Using Ai Algorithms On Unstructured Medical Notes And Structured Data, Hongxia Lu, Alex Barrett, Albert Pierce, Jianwei Zheng, Yun Wang, Chun Chiang, Cyril Rakovski

Mathematics, Physics, and Computer Science Faculty Articles and Research

Suicidal and self-injurious incidents in correctional settings deplete the institutional and healthcare resources, create disorder and stress for staff and other inmates. Traditional statistical analyses provide some guidance, but they can only be applied to structured data that are often difficult to collect and their recommendations are often expensive to act upon. This study aims to extract information from medical and mental health progress notes using AI algorithms to make actionable predictions of suicidal and self-injurious events to improve the efficiency of triage for health care services and prevent suicidal and injurious events from happening at California's Orange County Jails. …

A Bidirectional Deep Lstm Machine Learning Method For Flight Delay Modelling And Analysis, Desmond B. Bisandu, Irene Moulitsas

National Training Aircraft Symposium (NTAS)

Flight delays can be prevented by providing a reference point from an accurate prediction model because predicting flight delays is a problem with a specific space. Only a few algorithms consider predicted classes' mutual correlation during flight delay classification or prediction modelling tasks. None of these existing methods works for all scenarios. Therefore, the need to investigate the performance of more models in solving the problem of flight delay is vast and rapidly increasing. This paper presents the development and evaluation of LSTM and BiLSTM models by comparing them for a flight delay prediction. The LSTM does the feature extraction …

Modulation Recognition Method Of Mixed Signal Based On Intelligent Analysis Of Cyclic Spectrum Section, Yu Du, Xinquan Yang, Jianhua Zhang, Suchun Yuan, Huachao Xiao, Jingjing Yuan

Journal of System Simulation

Abstract: Aiming at the problems of low intelligence and poor adaptability for the existing mixed signal recognition methods, an intelligent recognition method based on cyclic spectral cross section and deep learning is proposed. For common mixed communication signals, the characteristics of zero frequency cross section of cyclic spectrum are theoretically deduced and analyzed. Two new pre-processing methods, nonlinear segmental mapping and directional pseudo-clustering are proposed, which can effectively improve the adaptability and consistency of cross section features. The pre-processed feature graph is combined with the residual network (ResNet), and the deep learning network is used to mine and analyze the …

Research On Intelligent Prediction Method Of Wargaming Air Mission, Dayong Zhang, Jingyu Yang, Xi Wu

Journal of System Simulation

Abstract: The efficient, accurate and automatic judgment of the combat mission or intention of the enemy's air targets in the battlefield is the basis of situation awareness and the key to the allocation of auxiliary combat resources. Combined with the calculation characteristics of feed forward deep neural network and long-term and short-term memory network model, two targeted basic index learners are designed, and then the weighted combination is carried out according to the cross entropy of the basic index, which can be used to further train the evaluation index of the learner. It can not only effectively prevent the model …

Digital Twin Of Atmospheric Environment: Sensory Data Fusion For High-Resolution Pm2.5 Estimation And Action Policies Recommendation, Kudaibergen Abutalip, Anas Al-Lahham, Abdulmotaleb Elsaddik

Computer Vision Faculty Publications

Particulate matter smaller than 2.5 microns (PM2.5) is one of the main pollutants that has considerable detrimental effects on human health. Estimating its concentration levels with ground monitors is inefficient for several reasons. In this study, we build a digital twin (DT) of an atmospheric environment by fusing remote sensing and observational data. Integral part of DT pipeline is a presence of feedback that can influence future input data. Estimated values of PM2.5 obtained from an ensemble of Random Forest and Gradient Boosting are used to provide recommendations for decreasing the agglomeration levels. A simple optimization problem is formulated for …

Channel-Resilient Deep-Learning-Driven Device Fingerprinting Through Multiple Data Streams, Nora Basha, Bechir Hamdaoui, Kathiravetpillai Sivanesan, Mohsen Guizani

Machine Learning Faculty Publications

Enabling accurate and automated identification of wireless devices is critical for allowing network access monitoring and ensuring data authentication for large-scale IoT networks. RF fingerprinting has emerged as a solution for device identification by leveraging the transmitters' inevitable hardware impairments that occur during manufacturing. Although deep learning is proven efficient in classifying devices based on hardware impairments, the performance of deep learning models suffers greatly from variations of the wireless channel conditions, across time and space. To the best of our knowledge, we are the first to propose leveraging MIMO capabilities to mitigate the channel effect and provide a channel-resilient …

An Empirical Study Of Pre-Trained Model Reuse In The Hugging Face Deep Learning Model Registry, Wenxin Jiang, Nicholas Synovic, Matt Hyatt, Taylor R. Schorlemmer, Rohan Sethi, Yung-Hsiang Lu, George K. Thiruvathukal, James C. Davis

Department of Electrical and Computer Engineering Faculty Publications

Deep Neural Networks (DNNs) are being adopted as components in software systems. Creating and specializing DNNs from scratch has grown increasingly difficult as state-of-the-art architectures grow more complex. Following the path of traditional software engineering, machine learning engineers have begun to reuse large-scale pre-trained models (PTMs) and fine-tune these models for downstream tasks. Prior works have studied reuse practices for traditional software packages to guide software engineers towards better package maintenance and dependency management. We lack a similar foundation of knowledge to guide behaviors in pre-trained model ecosystems.

In this work, we present the first empirical investigation of PTM reuse. …

Apt Adversarial Defence Mechanism For Industrial Iot Enabled Cyber-Physical System, Safdar Hussain Javed, Maaz Bin Ahmad, Muhammad Asif, Waseem Akram, Khalid Mahmood, Ashok Kumar Das, Sachin Shetty

VMASC Publications

The objective of Advanced Persistent Threat (APT) attacks is to exploit Cyber-Physical Systems (CPSs) in combination with the Industrial Internet of Things (I-IoT) by using fast attack methods. Machine learning (ML) techniques have shown potential in identifying APT attacks in autonomous and malware detection systems. However, detecting hidden APT attacks in the I-IoT-enabled CPS domain and achieving real-time accuracy in detection present significant challenges for these techniques. To overcome these issues, a new approach is suggested that is based on the Graph Attention Network (GAN), a multi-dimensional algorithm that captures behavioral features along with the relevant information that other methods …

Nudyclr: Nuclear Dynamic Co-Learned Representations, Víctor Samuel Pérez-Díaz

2023 REYES Proceedings

NuCLR (Nuclear Co-Learned Representations) is a cutting-edge multi-task deep learning framework designed to predict essential nuclear observables, including binding energies, decay energies, and nuclear charge radii. As part of the REYES Mentorship Program, we investigated the application of dynamic loss weighting to further refine NuCLR’s predictive performance. Our findings indicate that while weighting strategies can enhance accuracy in specific tasks, such as binding energy prediction, they may underperform in others. Equal Weighting (EW), the original method employed by NuCLR, demonstrated consistent performance across multiple tasks, affirming its robustness. This report succinctly presents the developments and results of the mentorship program …

An Explainable Deep Learning Model For Prediction Of Severity Of Alzheimer's Disease, Godwin Ekuma, Daniel B. Hier, Tayo Obafemi-Ajayi

Chemistry Faculty Research & Creative Works

Deep Convolutional Neural Networks (CNNs) have become the go-To method for medical imaging classification on various imaging modalities for binary and multiclass problems. Deep CNNs extract spatial features from image data hierarchically, with deeper layers learning more relevant features for the classification application. Despite the high predictive accuracy, usability lags in practical applications due to the black-box model perception. Model explainability and interpretability are essential for successfully integrating artificial intelligence into healthcare practice. This work addresses the challenge of an explainable deep learning model for the prediction of the severity of Alzheimer's disease (AD). AD diagnosis and prognosis heavily rely …

Skin Lesion Segmentation In Dermoscopic Images With Noisy Data, Norsang Lama, Jason Hagerty, Anand Nambisan, Ronald Joe Stanley, William Van Stoecker

Electrical and Computer Engineering Faculty Research & Creative Works

We Propose a Deep Learning Approach to Segment the Skin Lesion in Dermoscopic Images. the Proposed Network Architecture Uses a Pretrained Efficient Net Model in the Encoder and Squeeze-And-Excitation Residual Structures in the Decoder. We Applied This Approach on the Publicly Available International Skin Imaging Collaboration (ISIC) 2017 Challenge Skin Lesion Segmentation Dataset. This Benchmark Dataset Has Been Widely Used in Previous Studies. We Observed Many Inaccurate or Noisy Ground Truth Labels. to Reduce Noisy Data, We Manually Sorted All Ground Truth Labels into Three Categories — Good, Mildly Noisy, and Noisy Labels. Furthermore, We Investigated the Effect of Such …

A Deep Bilstm Machine Learning Method For Flight Delay Prediction Classification, Desmond B. Bisandu Phd, Irene Moulitsas Phd

Journal of Aviation/Aerospace Education & Research

This paper proposes a classification approach for flight delays using Bidirectional Long Short-Term Memory (BiLSTM) and Long Short-Term Memory (LSTM) models. Flight delays are a major issue in the airline industry, causing inconvenience to passengers and financial losses to airlines. The BiLSTM and LSTM models, powerful deep learning techniques, have shown promising results in a classification task. In this study, we collected a dataset from the United States (US) Bureau of Transportation Statistics (BTS) of flight on-time performance information and used it to train and test the BiLSTM and LSTM models. We set three criteria for selecting highly important features …

Online Sexual Predator Detection, Muhammad Khalid

Electronic Theses and Dissertations

Online sexual abuse is a concerning yet severely overlooked vice of modern society. With more children being on the Internet and with the ever-increasing advent of web-applications such as online chatrooms and multiplayer games, preying on vulnerable users has become more accessible for predators. In recent years, there has been work on detecting online sexual predators using Machine Learning and deep learning techniques. Such work has trained on severely imbalanced datasets, and imbalance is handled via manual trimming of over-represented labels. In this work, we propose an approach that first tackles the problem of imbalance and then improves the effectiveness …

Combating Fake News: A Gravity Well Simulation To Model Echo Chamber Formation In Social Media, Jeremy E. Thompson

Dartmouth College Ph.D Dissertations

Fake news has become a serious concern as distributing misinformation has become easier and more impactful. A solution is critically required. One solution is to ban fake news, but that approach could create more problems than it solves, and would also be problematic from the beginning, as it must first be identified to be banned. We initially propose a method to automatically recognize suspected fake news, and to provide news consumers with more information as to its veracity. We suggest that fake news is comprised of two components: premises and misleading content. Fake news can be condensed down to a …

An Explainable Deep Learning Prediction Model For Severity Of Alzheimer's Disease From Brain Images, Godwin O. Ekuma

MSU Graduate Theses

Deep Convolutional Neural Networks (CNNs) have become the go-to method for medical imaging classification on various imaging modalities for binary and multiclass problems. Deep CNNs extract spatial features from image data hierarchically, with deeper layers learning more relevant features for the classification application. The effectiveness of deep learning models are hampered by limited data sets, skewed class distributions, and the undesirable "black box" of neural networks, which decreases their understandability and usability in precision medicine applications. This thesis addresses the challenge of building an explainable deep learning model for a clinical application: predicting the severity of Alzheimer's disease (AD). AD …

Facial Expression Recognition Using Lightweight Deep Learning Modeling, Mubashir Ahmad, Saira, Omar Alfandi, Asad Masood Khattak, Syed Furqan Qadri, Iftikhar Ahmed Saeed, Salabat Khan, Bashir Hayat, Arshad Ahmad

All Works

Facial expression is a type of communication and is useful in many areas of computer vision, including intelligent visual surveillance, human-robot interaction and human behavior analysis. A deep learning approach is presented to classify happy, sad, angry, fearful, contemptuous, surprised and disgusted expressions. Accurate detection and classification of human facial expression is a critical task in image processing due to the inconsistencies amid the complexity, including change in illumination, occlusion, noise and the over-fitting problem. A stacked sparse auto-encoder for facial expression recognition (SSAE-FER) is used for unsupervised pre-training and supervised fine-tuning. SSAE-FER automatically extracts features from input images, and …

Lessons Learned From Interdisciplinary Efforts To Combat Covid-19 Misinformation: Development Of Agile Integrative Methods From Behavioral Science, Data Science, And Implementation Science, Sahiti Myneni, Paula Cuccaro, Sarah Montgomery, Vivek Pakanati, Jinni Tang, Tavleen Singh, Olivia Dominguez, Trevor Cohen, Belinda Reininger, Lara S Savas, Maria E Fernandez

Student and Faculty Publications

BACKGROUND: Despite increasing awareness about and advances in addressing social media misinformation, the free flow of false COVID-19 information has continued, affecting individuals' preventive behaviors, including masking, testing, and vaccine uptake.

OBJECTIVE: In this paper, we describe our multidisciplinary efforts with a specific focus on methods to (1) gather community needs, (2) develop interventions, and (3) conduct large-scale agile and rapid community assessments to examine and combat COVID-19 misinformation.

METHODS: We used the Intervention Mapping framework to perform community needs assessment and develop theory-informed interventions. To supplement these rapid and responsive efforts through large-scale online social listening, we developed a …

Causal Interventional Training For Image Recognition, Wei Qin, Hanwang Zhang, Richang Hong, Ee-Peng Lim, Qianru Sun

Research Collection School Of Computing and Information Systems

Deep learning models often fit undesired dataset bias in training. In this paper, we formulate the bias using causal inference, which helps us uncover the ever-elusive causalities among the key factors in training, and thus pursue the desired causal effect without the bias. We start from revisiting the process of building a visual recognition system, and then propose a structural causal model (SCM) for the key variables involved in dataset collection and recognition model: object, common sense, bias, context, and label prediction. Based on the SCM, one can observe that there are “good” and “bad” biases. Intuitively, in the image …

Adversarial Training Of Deep Neural Networks, Anabetsy Termini

CCE Theses and Dissertations

Deep neural networks used for image classification are highly susceptible to adversarial attacks. The de facto method to increase adversarial robustness is to train neural networks with a mixture of adversarial images and unperturbed images. However, this method leads to robust overfitting, where the network primarily learns to recognize one specific type of attack used to generate the images while remaining vulnerable to others after training. In this dissertation, we performed a rigorous study to understand whether combinations of state of the art data augmentation methods with Stochastic Weight Averaging improve adversarial robustness and diminish adversarial overfitting across a wide …

Detecting Patches On Road Pavement Images Acquired With 3d Laser Sensors Using Object Detection And Deep Learning, Ibrahim Hassan Syed, Dympna O'Sullivan, Susan Mckeever, David Power, Ray Mcgowan, Kieran Feighan

Academic Posters Collection

Regular pavement inspections are key to good road maintenance and road defect corrections. Advanced pavement inspection systems such as LCMS (Laser Crack Measurement System) can automatically detect the presence of different defects using 3D lasers. However, such systems still require manual involvement to complete the detection of pavement defects. This work proposes an automatic patch detection system using an object detection technique. Results show that the object detection model can successfully detect patches inside LCMS images and suggest that the proposed approach could be integrated into the existing pavement inspection systems.

Explaining Deep Learning Time Series Classification Models Using A Decision Tree, Ephrem T. Mekonnen, Pierpaolo Dondio, Luca Longo

Academic Posters Collection

This preliminary study proposes a new post hoc method to explain deep learning-based time series classification models using a decision tree. Our approach generates a decision tree graph or rulesets as an explanation, improving interpretability compared to saliency map-based methods. The method involves two phases: training and evaluating the deep learning-based time series classification model and extracting prototypical events from the evaluation set to train the decision tree classifier. We conducted experiments on artificial and real datasets, evaluating the explanations based on accuracy, fidelity, number of nodes, and depth. Our preliminary findings suggest that our post-hoc method improves the interpretability …