Physical Sciences and Mathematics Commons^™

Natural Language Processing And Neurosymbolic Ai: The Role Of Neural Networks With Knowledge-Guided Symbolic Approaches, Emily Barnes, James Hutson

Faculty Scholarship

Neurosymbolic AI (NeSy AI) represents a groundbreaking approach in the realm of Natural Language Processing (NLP), merging the pattern recognition of neural networks with the structured reasoning of symbolic AI to address the complexities of human language. This study investigates the effectiveness of neurosymbolic AI in providing nuanced understanding and contextually relevant responses, driven by the need to overcome the limitations of existing models in handling complex linguistic tasks and abstract reasoning. Employing a hybrid methodology that combines multimodal contextual modeling with rule-governed inferences and memory activations, the research delves into specific applications like Named Entity Recognition (NER), where architectures …

Continual Learning, Fast And Slow, Quang Anh Pham, Chenghao Liu, Steven C. H. Hoi

Research Collection School Of Computing and Information Systems

According to the Complementary Learning Systems (CLS) theory (McClelland et al. 1995) in neuroscience, humans do effective continual learning through two complementary systems: a fast learning system centered on the hippocampus for rapid learning of the specifics, individual experiences; and a slow learning system located in the neocortex for the gradual acquisition of structured knowledge about the environment. Motivated by this theory, we propose DualNets (for Dual Networks), a general continual learning framework comprising a fast learning system for supervised learning of pattern-separated representation from specific tasks and a slow learning system for representation learning of task-agnostic general representation via …

Simulation Of A Pick And Place System For Electronic Cards Using A Yumi Cobot, Derrick Sze, Rosula Sj Reyes, Patricia Angela R. Abu

Electronics, Computer, and Communications Engineering Faculty Publications

Collaborative Robots are one of the main drivers of Industry 4.0, which started as a vision focusing on industrial production. It addresses several challenges in the current manufacturing industry such as performing repetitive work and requiring highly skilled workers. The goal of the research is to be able to simulate a pick and place environment with electronic cards using a YuMi cobot and mobile platforms in Coppeliasim. The mobile robot is responsible for transporting the electronic cards to the target location through path planning implemented using the OMPL plug-in. After arriving at the target location, YuMi will then perform the …

Digital Resurrection Of Historical Figures: A Case Study On Mary Sibley Through Customized Chatgpt, James Hutson, Paul Huffman, Jeremiah Ratican

Faculty Scholarship

This study investigates the emerging realm of digital resurrection, focusing on Mary Sibley (1800–1878), the esteemed founder of Lindenwood University. The core objective was to demonstrate the capability of advanced artificial intelligence, specifically a customized version of ChatGPT, in revitalizing historical figures for educational and engagement purposes. By integrating comprehensive diaries from Sibley with Claude 2.0, the research utilized a substantial autobiographical dataset to develop a GPT beta version that replicates her distinct voice and tone. The incorporation of her official portrait and diaries into the GPT Builder was pivotal, creating an interactive platform that accurately reflects her perspectives on …

Infusing Machine Learning And Computational Linguistics Into Clinical Notes, Funke V. Alabi, Onyeka Omose, Omotomilola Jegede

Mathematics & Statistics Faculty Publications

Entering free-form text notes into Electronic Health Records (EHR) systems takes a lot of time from clinicians. A large portion of this paper work is viewed as a burden, which cuts into the amount of time doctors spend with patients and increases the risk of burnout. We will see how machine learning and computational linguistics can be infused in the processing of taking clinical notes. We are presenting a new language modeling task that predicts the content of notes conditioned on historical data from a patient's medical record, such as patient demographics, lab results, medications, and previous notes, with the …

Effect Of Resin Bleed Out On Compaction Behavior Of The Fiber Tow Gap Region During Automated Fiber Placement Manufacturing, Von Clyde Jamora, Virginia Rauch, Sergii G. Kravchenko, Oleksandr G. Kravchenko

Mechanical & Aerospace Engineering Faculty Publications

Automated fiber placement is a state-of-the-art manufacturing method which allows for precise control over layup design. However, AFP results in irregular morphology due to fiber tow deposition induced features such as tow gaps and overlaps. Factors such as the squeeze flow and resin bleed out, combined with large non-linear deformation, lead to morphological variability. To understand these complex interacting phenomena, a coupled multiphysics finite element framework was developed to simulate the compaction behavior around fiber tow gap regions, which consists of coupled chemo-rheological and flow-compaction analysis. The compaction analysis incorporated a visco-hyperelastic constitutive model with anisotropic tensorial prepreg viscosity, which …

Development Of A Two-Finger Haptic Robotic Hand With Novel Stiffness Detection And Impedance Control, Vahid Mohammadi, Ramin Shahbad, Mojtaba Hosseini, Mohammad Hossein Gholampour, Saeed Shiry Ghidary, Farshid Najafi, Ahad Behboodi

Mechanical & Aerospace Engineering Faculty Publications

Haptic hands and grippers, designed to enable skillful object manipulation, are pivotal for high-precision interaction with environments. These technologies are particularly vital in fields such as minimally invasive surgery, where they enhance surgical accuracy and tactile feedback: in the development of advanced prosthetic limbs, offering users improved functionality and a more natural sense of touch, and within industrial automation and manufacturing, they contribute to more efficient, safe, and flexible production processes. This paper presents the development of a two-finger robotic hand that employs simple yet precise strategies to manipulate objects without damaging or dropping them. Our innovative approach fused force-sensitive …

Improving The Robustness Of Neural Networks To Adversarial Patch Attacks Using Masking And Attribution Analysis, Atandra Mahalder

Honors Undergraduate Theses

Computer vision algorithms, including image classifiers and object detectors, play a pivotal role in various cyber-physical systems, spanning from facial recognition to self-driving vehicles and security surveillance. However, the emergence of real-world adversarial patches, which can be as simple as stickers, poses a significant threat to the reliability of AI models utilized within these systems. To address this challenge, several defense mechanisms such as PatchGuard, Minority Report, and (De)Randomized Smoothing have been proposed to enhance the resilience of AI models against such attacks. In this thesis, we introduce a novel framework that integrates masking with attribution analysis to robustify AI …

Physics-Informed Deep Learning With Kalman Filter Mixture For Traffic State Prediction, Niharika Deshpande, Hyoshin (John) Park

Engineering Management & Systems Engineering Faculty Publications

Accurate traffic forecasting is crucial for understanding and managing congestion for efficient transportation planning. However, conventional approaches often neglect epistemic uncertainty, which arises from incomplete knowledge across different spatiotemporal scales. This study addresses this challenge by introducing a novel methodology to establish dynamic spatiotemporal correlations that captures the unobserved heterogeneity in travel time through distinct peaks in probability density functions, guided by physics-based principles. We propose an innovative approach to modifying both prediction and correction steps of the Kalman Filter (KF) algorithm by leveraging established spatiotemporal correlations. Central to our approach is the development of a novel deep learning model …

The Educational Affordances And Challenges Of Chatgpt: State Of The Field, Helen Crompton, Diane Burke

STEMPS Faculty Publications

ChatGPT was released to the public in November 30, 2022. This study examines how ChatGPT can be used by educators and students to promote learning and what are the challenges and limitations. This study is unique in providing one of the first systematic reviews using peer review studies to provide an early examination of the field. Using PRISMA principles, 44 articles were selected for review. Grounded coding was then used to reveal trends in the data. The findings show that educators can use ChatGPT for teaching support, task automation, and professional development. These were further delineated further by axial sub …

Exploring Students' Perspectives On Generative Ai-Assisted Academic Writing, Jinhee Kim, Seongryeong Yu, Rita Detrick, Na Li

STEMPS Faculty Publications

The rapid development of generative artificial intelligence (GenAI), including large language models (LLM), has merged to support students in their academic writing process. Keeping pace with the technical and educational landscape requires careful consideration of the opportunities and challenges that GenAI-assisted systems create within education. This serves as a useful and necessary starting point for fully leveraging its potential for learning and teaching. Hence, it is crucial to gather insights from diverse perspectives and use cases from actual users, particularly the unique voices and needs of student-users. Therefore, this study explored and examined students' perceptions and experiences about GenAI-assisted academic …

Predicting The Need For Cardiovascular Surgery: A Comparative Study Of Machine Learning Models, Arman Ghavidel, Pilar Pazos, Rolando Del Aguila Suarez, Alireza Atashi

Engineering Management & Systems Engineering Faculty Publications

This research examines the efficacy of ensemble Machine Learning (ML) models, mainly focusing on Deep Neural Networks (DNNs), in predicting the need for cardiovascular surgery, a critical aspect of clinical decision-making. It addresses key challenges such as class imbalance, which is pivotal in healthcare settings. The research involved a comprehensive comparison and evaluation of the performance of previously published ML methods against a new Deep Learning (DL) model. This comparison utilized a dataset encompassing 50,000 patient records from a large hospital between 2015-2022. The study proposes enhancing the efficacy of these models through feature selection and hyperparameter optimization, employing techniques …

Identifying And Predicting Patterns Of Snowpack Ripening With Machine Learning Methods, Clement Cherblanc

Graduate Student Theses, Dissertations, & Professional Papers

The timing of water release from the snowpack plays key roles in ecosystem services, groundwater recharge, and water resource management. However, two internal barriers in a standing snowpack must be overcome before runoff can outflow from the base: 1) the cold content must be exhausted, and 2) the interconnected network of snow grains must be filled with liquid water to residual saturation. Expressing the liquid water as latent heat allows the two barriers to be grouped as an energy (J/m²) to define a snowpack’s Runoff Energy Hurdle (REH). The growth and loss of REH is driven by evolution of pore …

Active Discovering New Slots For Task-Oriented Conversation, Yuxia Wu, Tianhao Dai, Zhedong Zheng, Lizi Liao

Research Collection School Of Computing and Information Systems

Existing task-oriented conversational systems heavily rely on domain ontologies with pre-defined slots and candidate values. In practical settings, these prerequisites are hard to meet, due to the emerging new user requirements and ever-changing scenarios. To mitigate these issues for better interaction performance, there are efforts working towards detecting out-of-vocabulary values or discovering new slots under unsupervised or semi-supervised learning paradigms. However, overemphasizing on the conversation data patterns alone induces these methods to yield noisy and arbitrary slot results. To facilitate the pragmatic utility, real-world systems tend to provide a stringent amount of human labeling quota, which offers an authoritative way …

Dilf: Differentiable Rendering-Based Multi-View Image-Language Fusion For Zero-Shot 3d Shape Understanding, Xin Ning, Zaiyang Yu, Lusi Li, Weijun Li, Prayag Tiwari

Computer Science Faculty Publications

Zero-shot 3D shape understanding aims to recognize “unseen” 3D categories that are not present in training data. Recently, Contrastive Language–Image Pre-training (CLIP) has shown promising open-world performance in zero-shot 3D shape understanding tasks by information fusion among language and 3D modality. It first renders 3D objects into multiple 2D image views and then learns to understand the semantic relationships between the textual descriptions and images, enabling the model to generalize to new and unseen categories. However, existing studies in zero-shot 3D shape understanding rely on predefined rendering parameters, resulting in repetitive, redundant, and low-quality views. This limitation hinders the model’s …

A Chinese Power Text Classification Algorithm Based On Deep Active Learning, Song Deng, Qianliang Li, Renjie Dai, Siming Wei, Di Wu, Yi He, Xindong Wu

Computer Science Faculty Publications

The construction of knowledge graph is beneficial for grid production, electrical safety protection, fault diagnosis and traceability in an observable and controllable way. Highly-precision text classification algorithm is crucial to build a professional knowledge graph in power system. Unfortunately, there are a large number of poorly described and specialized texts in the power business system, and the amount of data containing valid labels in these texts is low. This will bring great challenges to improve the precision of text classification models. To offset the gap, we propose a classification algorithm for Chinese text in the power system based on deep …

Identifying Patterns For Neurological Disabilities By Integrating Discrete Wavelet Transform And Visualization, Soo Yeon Ji, Sampath Jayarathna, Anne M. Perrotti, Katrina Kardiasmenos, Dong Hyun Jeong

Computer Science Faculty Publications

Neurological disabilities cause diverse health and mental challenges, impacting quality of life and imposing financial burdens on both the individuals diagnosed with these conditions and their caregivers. Abnormal brain activity, stemming from malfunctions in the human nervous system, characterizes neurological disorders. Therefore, the early identification of these abnormalities is crucial for devising suitable treatments and interventions aimed at promoting and sustaining quality of life. Electroencephalogram (EEG), a non-invasive method for monitoring brain activity, is frequently employed to detect abnormal brain activity in neurological and mental disorders. This study introduces an approach that extends the understanding and identification of neurological disabilities …

Robots Still Outnumber Humans In Web Archives In 2019, But Less Than In 2015 And 2012, Himarsha R. Jayanetti, Kritika Garg, Sawood Alam, Michael L. Nelson, Michele C. Weigle

Computer Science Faculty Publications

The significance of the web and the crucial role of web archives in its preservation highlight the necessity of understanding how users, both human and robot, access web archive content, and how best to satisfy this disparate needs of both types of users. To identify robots and humans in web archives and analyze their respective access patterns, we used the Internet Archive’s (IA) Wayback Machine access logs from 2012, 2015, and 2019, as well as Arquivo.pt’s (Portuguese Web Archive) access logs from 2019. We identified user sessions in the access logs and classified those sessions as human or robot based …

Triphlapan: Predicting Hla Molecules Binding Peptides Based On Triple Coding Matrix And Transfer Learning, Meng Wang, Chuqi Lei, Jianxin Wang, Yaohang Li, Min Li

Computer Science Faculty Publications

Human leukocyte antigen (HLA) recognizes foreign threats and triggers immune responses by presenting peptides to T cells. Computationally modeling the binding patterns between peptide and HLA is very important for the development of tumor vaccines. However, it is still a big challenge to accurately predict HLA molecules binding peptides. In this paper, we develop a new model TripHLApan for predicting HLA molecules binding peptides by integrating triple coding matrix, BiGRU + Attention models, and transfer learning strategy. We have found the main interaction site regions between HLA molecules and peptides, as well as the correlation between HLA encoding and binding …

Data Science In Finance: Challenges And Opportunities, Xianrong Zheng, Elizabeth Gildea, Sheng Chai, Tongxiao Zhang, Shuxi Wang

Information Technology & Decision Sciences Faculty Publications

Data science has become increasingly popular due to emerging technologies, including generative AI, big data, deep learning, etc. It can provide insights from data that are hard to determine from a human perspective. Data science in finance helps to provide more personal and safer experiences for customers and develop cutting-edge solutions for a company. This paper surveys the challenges and opportunities in applying data science to finance. It provides a state-of-the-art review of financial technologies, algorithmic trading, and fraud detection. Also, the paper identifies two research topics. One is how to use generative AI in algorithmic trading. The other is …

Can Large Language Models Discern Evidence For Scientific Hypotheses? Case Studies In The Social Sciences, Sai Koneru, Jian Wu, Sarah Rajtmajer

Computer Science Faculty Publications

Hypothesis formulation and testing are central to empirical research. A strong hypothesis is a best guess based on existing evidence and informed by a comprehensive view of relevant literature. However, with exponential increase in the number of scientific articles published annually, manual aggregation and synthesis of evidence related to a given hypothesis is a challenge. Our work explores the ability of current large language models (LLMs) to discern evidence in support or refute of specific hypotheses based on the text of scientific abstracts. We share a novel dataset for the task of scientific hypothesis evidencing using community-driven annotations of studies …

Developing A Framework For Personalized Video-Based Quantum Information Science Education, Nikos Chrisochoides, Norou Diawara, Michail Giannakos

Computer Science Faculty Publications

This is a white paper on Workforce Development for Quantum Information Sciences (QIS) led by the Center for Real-Time Computing at Old Dominion University (ODU). We plan to investigate the potential of video lectures in supporting QIS. Specifically, we focus on following four objectives: (a) design a two-course series for both Master-level and PhD students; b) an upgrade of Experimental Lecture System (ELeSy) to test new, innovative, and transformative approaches for inclusive QIS education; c) design and implementation of a mixed-method systematic empirical study on the effects of video learning styles (in-person flipped classroom and voluntary video use) on graduate …

Enhancing Heart Disease Prediction With Reinforcement Learning And Data Augmentation, Gayathri R., Sangeetha S. K. B., Sandeep Kumar Mathivanan, Hariharan Rajadurai, Benjula Anbu Malar Mb, Saurav Mallik, Hong Qin

Computer Science Faculty Publications

The study presents a novel method to improve the prediction accuracy of cardiac disease by combining data augmentation techniques with reinforcement learning. The complex nature of cardiac data frequently presents challenges for traditional machine learning models, which results in subpar performance. In response, our fusion methodology improves predictive capabilities by augmenting data and utilizing reinforcement learning's skill at sequential decision-making. Our method predicts cardiac disease with an astounding 94 % accuracy rate, which is an outstanding result. This significant improvement outperforms existing techniques and shows a deeper comprehension of intricate data relationships. The amalgamation of reinforcement learning and data augmentation …

Bayesian Neural Netwok Variational Autoencoder Inverse Mapper (Bnn-Vaim) And Its Application In Compton Form Factors Extraction, Md Fayaz Bin Hossen, Tareq Alghamdi, Manal Almaeen, Yaohang Li

Computer Science Faculty Publications

We extend the Variational Autoencoder Inverse Mapper (VAIM) framework for the inverse problem of extracting Compton Form Factors (CFFs) from deeply virtual exclusive reactions, such as the unpolarized Deeply virtual exclusive scattering (DVCS) cross section. VAIM is an end-to-end deep learning framework to address the solution ambiguity issue in ill-posed inverse problems, which comprises of a forward mapper and a backward mapper to simulate the forward and inverse processes, respectively. In particular, we incorporate Bayesian Neural Network (BNN) into the VAIM architecture (BNN-VAIM) for uncertainty quantification. By sampling the weights and biases distributions of the BNN in the backward mapper …

Automatic Hemorrhage Segmentation In Brain Ct Scans Using Curriculum-Based Semi-Supervised Learning, Solayman H. Emon, Tzu-Liang (Bill) Tseng, Michael Pokojovy, Peter Mccaffrey, Scott Moen, Md Fashiar Rahman

Mathematics & Statistics Faculty Publications

One of the major neuropathological consequences of traumatic brain injury (TBI) is intracranial hemorrhage (ICH), which requires swift diagnosis to avert perilous outcomes. We present a new automatic hemorrhage segmentation technique via curriculum-based semi-supervised learning. It employs a pre-trained lightweight encoder-decoder framework (MobileNetV2) on labeled and unlabeled data. The model integrates consistency regularization for improved generalization, offering steady predictions from original and augmented versions of unlabeled data. The training procedure employs curriculum learning to progressively train the model at diverse complexity levels. We utilize the PhysioNet dataset to train and evaluate the proposed approach. The performance results surpass those of …

Learning Optimal Inter-Class Margin Adaptively For Few-Shot Class-Incremental Learning Via Neural Collapse-Based Meta-Learning, Hang Ran, Weijun Li, Lusi Li, Songsong Tian, Xin Ning, Prayag Tiwari

Computer Science Faculty Publications

Few-Shot Class-Incremental Learning (FSCIL) aims to learn new classes incrementally with a limited number of samples per class. It faces issues of forgetting previously learned classes and overfitting on few-shot classes. An efficient strategy is to learn features that are discriminative in both base and incremental sessions. Current methods improve discriminability by manually designing inter-class margins based on empirical observations, which can be suboptimal. The emerging Neural Collapse (NC) theory provides a theoretically optimal inter-class margin for classification, serving as a basis for adaptively computing the margin. Yet, it is designed for closed, balanced data, not for sequential or few-shot …

Autonomous Strike Uavs In Support Of Homeland Security Missions: Challenges And Preliminary Solutions, Meshari Aljohani, Ravi Mukkamala, Stephan Olariu

Computer Science Faculty Publications

Unmanned Aerial Vehicles (UAVs) are becoming crucial tools in modern homeland security applications, primarily because of their cost-effectiveness, risk reduction, and ability to perform a wider range of activities. This study focuses on the use of autonomous UAVs to conduct, as part of homeland security applications, strike missions against high-value terrorist targets. Owing to developments in ledger technology, smart contracts, and machine learning, activities formerly carried out by professionals or remotely flown UAVs are now feasible. Our study provides the first in-depth analysis of the challenges and preliminary solutions for the successful implementation of an autonomous UAV mission. Specifically, we …

Mosaic: A Prune-And-Assemble Approach For Efficient Model Pruning In Privacy-Preserving Deep Learning, Yifei Cai, Qiao Zhang, Rui Ning, Chunsheng Xin, Hongyi Wu

Computer Science Faculty Publications

To enable common users to capitalize on the power of deep learning, Machine Learning as a Service (MLaaS) has been proposed in the literature, which opens powerful deep learning models of service providers to the public. To protect the data privacy of end users, as well as the model privacy of the server, several state-of-the-art privacy-preserving MLaaS frameworks have also been proposed. Nevertheless, despite the exquisite design of these frameworks to enhance computation efficiency, the computational cost remains expensive for practical applications. To improve the computation efficiency of deep learning (DL) models, model pruning has been adopted as a strategic …

Identifying New Cancer Genes Based On The Integration Of Annotated Gene Sets Via Hypergraph Neural Networks, Chao Deng, Hong-Dong Li, Li-Shen Zhang, Yiwei Liu, Yaohang Li, Jianxin Wang

Computer Science Faculty Publications

Motivation

Identifying cancer genes remains a significant challenge in cancer genomics research. Annotated gene sets encode functional associations among multiple genes, and cancer genes have been shown to cluster in hallmark signaling pathways and biological processes. The knowledge of annotated gene sets is critical for discovering cancer genes but remains to be fully exploited.

Results

Here, we present the DIsease-Specific Hypergraph neural network (DISHyper), a hypergraph-based computational method that integrates the knowledge from multiple types of annotated gene sets to predict cancer genes. First, our benchmark results demonstrate that DISHyper outperforms the existing state-of-the-art methods and highlight the advantages of …

Different Visions From Biosview: A Brief Report, Lucas N. Potter, Xavier-Lewis Palmer

Electrical & Computer Engineering Faculty Publications

In this collaborative research endeavor at the intersection of biological safety and cybersecurity for BiosView labs, the authors highlight their engagement with a diverse student cohort. The chapter delves into the motivation behind collaborations extending beyond traditional academic research environments, emphasizing inclusivity. The meticulous examination of student demographics, including gender, self-reported ethnicity, and national origin, is detailed in the methodology. A student-centric approach is central to the exploration, focusing on aligning teaching and management styles with unique student needs. The chapter elaborates on effective teaching methodologies and management practices tailored for BiosView labs. A dedicated section emphasizes the purpose of …