Physical Sciences and Mathematics Commons^™

Interpretable Multimodal Retrieval For Fashion Products, Lizi Liao, Xiangnan He, Bo Zhao, Chong-Wah Ngo, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Deep learning methods have been successfully applied to fashion retrieval. However, the latent meaning of learned feature vectors hinders the explanation of retrieval results and integration of user feedback. Fortunately, there are many online shopping websites organizing fashion items into hierarchical structures based on product taxonomy and domain knowledge. Such structures help to reveal how human perceive the relatedness among fashion products. Nevertheless, incorporating structural knowledge for deep learning remains a challenging problem. This paper presents techniques for organizing and utilizing the fashion hierarchies in deep learning to facilitate the reasoning of search results and user intent. The novelty of …

Investigating Multimodal Affect Sensing In An Affective Tutoring System Using Unobtrusive Sensors, Hua Leong Fwa, Lindsay Marshall

Research Collection School Of Computing and Information Systems

Affect inextricably plays a critical role in the learning process. In this study, we investigate the multimodal fusion of facial, keystrokes, mouse clicks, head posture and contextual features for the detection of student’s frustration in an Affective Tutoring System. The results (AUC=0.64) demonstrated empirically that a multimodal approach offers higher accuracy and better robustness as compared to a unimodal approach. In addition, the inclusion of keystrokes and mouse clicks makes up for the detection gap where video based sensing modes (facial and head postures) are not available. The findings in this paper will dovetail to our end research objective of …

Knowledge-Aware Multimodal Fashion Chatbot, Lizi Liao, You Zhou, Yunshan Ma, Richang Hong, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Multimodal fashion chatbot provides a natural and informative way to fulfill customers’ fashion needs. However, making it ‘smart’ in generating substantive responses remains a challenging problem. In this paper, we present a multimodal domain knowledge enriched fashion chatbot. It forms a taxonomy-based learning module to capture the fine-grained semantics in images and leverages an endto-end neural conversational model to generate responses based on the conversation history, visual semantics, and domain knowledge. To avoid inconsistent dialogues, deep reinforcement learning method is used to further optimize the model.

Influence Maximization On Social Graphs: A Survey, Yuchen Li, Ju Fan, Yanhao Wang, Kian-Lee Tan

Research Collection School Of Computing and Information Systems

Influence Maximization (IM), which selects a set of k users (called seed set) from a social network to maximize the expected number of influenced users (called influence spread), is a key algorithmic problem in social influence analysis. Due to its immense application potential and enormous technical challenges, IM has been extensively studied in the past decade. In this paper, we survey and synthesize a wide spectrum of existing studies on IM from an algorithmic perspective, with a special focus on the following key aspects (1) a review of well-accepted diffusion models that capture information diffusion process and build the foundation …

I4s: Capturing Shopper’S In-Store Interactions, Sougata Sen, Archan Misra, Vigneshwaran Subbaraju, Karan Grover, Meeralakshmi Radhakrishnan, Rajesh K. Balan, Youngki Lee

Research Collection School Of Computing and Information Systems

In this paper, we present I4S, a system that identifies item interactions of customers in a retail store through sensor data fusion from smartwatches, smartphones and distributed BLE beacons. To identify these interactions, I4S builds a gesture-triggered pipeline that (a) detects the occurrence of “item picks”, and (b) performs fine-grained localization of such pickup gestures. By analyzing data collected from 31 shoppers visiting a mid-sized stationary store, we show that we can identify person-independent picking gestures with a precision of over 88%, and identify the rack from where the pick occurred with 91%+ precision (for popular racks).

Multiperspective Graph-Theoretic Similarity Measure, Dung D. Le, Hady W. Lauw

Research Collection School Of Computing and Information Systems

Determining the similarity between two objects is pertinent to many applications. When the basis for similarity is a set of object-to-object relationships, it is natural to rely on graph-theoretic measures. One seminal technique for measuring the structural-context similarity between a pair of graph vertices is SimRank, whose underlying intuition is that two objects are similar if they are connected by similar objects. However, by design, SimRank as well as its variants capture only a single view or perspective of similarity. Meanwhile, in many real-world scenarios, there emerge multiple perspectives of similarity, i.e., two objects may be similar from one perspective, …

Measuring Program Comprehension: A Large-Scale Field Study With Professionals, Xin Xia, Lingfeng Bao, David Lo, Zhengchang Xing, Ahmed E. Hassan, Shanping Li

Research Collection School Of Computing and Information Systems

During software development and maintenance, developers spend a considerable amount of time on program comprehension activities. Previous studies show that program comprehension takes up as much as half of a developer's time. However, most of these studies are performed in a controlled setting, or with a small number of participants, and investigate the program comprehension activities only within the IDEs. However, developers' program comprehension activities go well beyond their IDE interactions. In this paper, we extend our ActivitySpace framework to collect and analyze Human-Computer Interaction (HCI) data across many applications (not just the IDEs). We follow Minelli et al.'s approach …

Exploring Experiential Learning Model And Risk Management Process For An Undergraduate Software Architecture Course, Eng Lieh Ouh, Yunghans Irawan

Research Collection School Of Computing and Information Systems

This paper shares our insights on exploring theexperiential learning model and risk management process todesign an undergraduate software architecture course. The keychallenge for undergraduate students to appreciate softwarearchitecture design is usually their limited experience in thesoftware industry. In software architecture, the high-level designprinciples are heuristics lacking the absoluteness of firstprinciples which for inexperienced undergraduate students, thisis a frustrating divergence from what they used to value. From aneducator's perspective, teaching software architecture requirescontending with the problem of how to express this level ofabstraction practically and also make the learning realistic. Inthis paper, we propose a model adapting the concepts ofexperiential learning …

Climate Change And Curtailment: Evaluating Water Management Practices In The Context Of Changing Runoff Regimes In A Snowmelt-Dominated Basin, Amy L. Steimke, Bangshuai Han, Jodi S. Brandt, Alejandro N. Flores

Geosciences Faculty Publications and Presentations

Hydrologic scientists and water resource managers often focus on different facets of flow regimes in changing climates. The objective of this work is to examine potential hydrological changes in the Upper Boise River Basin, Idaho, USA in the context of biophysical variables and their impacts a key variable governing administration of water resources in the region in an integrated way. This snowmelt-dominated, mountainous watershed supplies water to a semi-arid, agriculturally intensive, but rapidly urbanizing, region. Using the Envision integrated modeling framework, we created a hydrological model to simulate hydrological response to the year 2100 using six alternative future climate trajectories. …

Reverse-Time Migration From Rugged Topography To Image Ground-Penetrating Radar Data In Complex Environments, John H. Bradford, Janna Privette, David Wilkins, Richard Ford

Geosciences Faculty Publications and Presentations

In ground-penetrating radar (GPR) imaging, it is common for the depth of investigation to be on the same order as the variability in surface topography. In such cases, migration fails when it is carried out from a datum after the application of elevation statics. We introduce a reverse-time migration (RTM) algorithm based on the second-order decoupled form of Maxwell’s equations, which requires computation of only the electric field. The wavefield extrapolation is computed directly from the acquisition surface without the need for datuming. In a synthetic case study, the algorithm significantly improves image accuracy over a processing sequence in which …

The Optical/Nir Afterglow Of Grb 111209a: Complex Yet Not Unprecedented, D. A. Kann, P. Schady, E. F. Olivares, S. Klose, A. Rossi, D. A. Perley, Bing Zhang, T. Krühler, J. Greiner, A. Nicuesa Guelbenzu, J. Elliott, F. Knust, Z. Cano, R. Filgas, E. Pian, P. Mazzali, J. P. U. Fynbo, G. Leloudas, P. M. J. Afonso, C. Delvaux, J. F. Graham, A. Rau, S. Schmidl, S. Schulze, M. Tanga, A. C. Updike, K. Varela

Physics & Astronomy Faculty Research

Context. Afterglows of gamma-ray bursts (GRBs) are simple in the most basic model, but can show many complex features. The ultra-long duration GRB 111209A, one of the longest GRBs ever detected, also has the best-monitored afterglow in this rare class of GRBs. Aims. We want to address the question whether GRB 111209A was a special event beyond its extreme duration alone, and whether it is a classical GRB or another kind of high-energy transient. The afterglow may yield significant clues. Methods. We present afterglow photometry obtained in seven bands with the GROND imager as well as in further seven bands …

Time-Dependent Radiation-Driven Winds, Sergei Dyda, Daniel Proga

Physics & Astronomy Faculty Research

We study temporal variability of radiation-driven winds using one-dimensional, time-dependent simulations and an extension of the classic theory of line-driven winds developed by Castor Abbott & Klein. We drive the wind with a sinusoidally varying radiation field and find that after a relaxation time, determined by the propagation time for waves to move out of the acceleration zone of the wind, the solution settles into a periodic state. Winds driven at frequencies much higher than the dynamical frequency behave like stationary winds with time averaged radiation flux, whereas winds driven at much lower frequencies oscillate between the high and low …

An Interval-Censored Proportional Hazards Model, John M. Williamson, Hung-Mo Lin, Hae-Young Kim

NYMC Faculty Publications

We fit a Cox proportional hazards (PH) model to interval-censored survival data by first subdividing each individual's failure interval into non-overlapping sub-intervals. Using the set of all interval endpoints in the data set, those that fall into the individual's interval are then used as the cut points for the sub-intervals. Each sub-interval has an accompanying weight calculated from a parametric Weibull model based on the current parameter estimates. A weighted PH model is then fit with multiple lines of observations corresponding to the sub-intervals for each individual, where the lower end of each sub-interval is used as the observed failure …

New Insights Into Carboniferous Cyclothems. The Fourth Biennial Field Conference Of The American Association Of Petroleum Geologists (Aapg) Midcontinent Section Fourth Biennial Field Conference Abstracts And Guidebook, Robert Matthew Joeckel, Christopher R. Fielding

Conservation and Survey Division

The term “cyclothem” was coined by Wanless & Weller (1932) to describe repetitive stratigraphic successions of Carboniferous age in Illinois. Nonetheless, comparable rhythmicity had been identified in Carboniferous rocks both in the central and eastern USA, and in Europe during the preceding century. Cyclothems were found to comprise repetitive vertical successions of sandstones, heterolithic (thinly interbedded) sandstones and mudrocks, mudrocks, limestones, and coals, in many cases with pedogenic overprinting of these lithologies. As usage of the term “cyclothem” increased, so did the diversity of successions to which the term was applied, to the point where many geologists advocated abandonment of …

Electrostatic Design And Conditioning Of A Triple Point Junction Shield For A −200 Kv Dc High Voltage Photogun, G. Palacios-Serrano, F. Hannon, C. Hernandez-Garcia, M. Poelker, H. Baumgart

Electrical & Computer Engineering Faculty Publications

Nuclear physics experiments performed at the Continuous Electron Beam Accelerator Facility (CEBAF) at the Jefferson Lab require a DC high voltage photogun to generate polarized electron beams from GaAs photocathodes. The photogun uses a tapered ceramic insulator that extends into the vacuum chamber and mechanically holds the cathode electrode. Increasing the operating voltage from nominal −130 kV to −200 kV will provide lower beam emittance, better transmission through injector apertures, and improved photocathode lifetime. This desire to increase the photogun operating voltage led to the design of a triple-point-junction shield electrode which minimizes the electric field at the delicate insulator-metal-vacuum …

Wireless Sensor Networks For Smart Communications, Mu Zhou, Qilian Liang, Hongyi Wu, Weixiao Meng, Kunjie Xu

Electrical & Computer Engineering Faculty Publications

(First paragraph) In the first edition of the special issue titled “Wireless Sensor Networks for Smart Communications”, a total of 22 manuscripts were received and 6 of these were accepted. This issue demonstrated that network congestion, user mobility, and adjacent spectrum interference are the main reasons for the degradation ofcommunication quality inWireless Sensor Networks (WSNs).

Non-Stationary Platform Inverse Synthetic Aperture Radar Maneuvering Target Imaging Based On Phase Retrieval, Hongyin Shi, Saixue Xia, Qi Qin, Ting Yang, Zhijun Qiao

School of Mathematical and Statistical Sciences Faculty Publications and Presentations

As a powerful signal processing tool for imaging moving targets, placing radar on a non-stationary platform (such as an aerostat) is a future direction of Inverse Synthetic Aperture Radar (ISAR) systems. However, more phase errors are introduced into the received signal due to the instability of the radar platform, making it difficult for popular algorithms to accurately perform motion compensation, which leads to severe effects in the resultant ISAR images. Moreover, maneuvering targets may have complex motion whose motion parameters are unknown to radar systems. To overcome the issue of non-stationary platform ISAR autofocus imaging, a high-resolution imaging method based …

Self-Powered Gesture Recognition With Ambient Light, Yichen Li, Tianxing Li, Ruchir Patel, Xia Zhou, Xing-Dong Yang

Dartmouth Scholarship

We present a self-powered module for gesture recognition that utilizes small, low-cost photodiodes for both energy harvesting and gesture sensing. Operating in the photovoltaic mode, photodiodes harvest energy from ambient light. In the meantime, the instantaneously harvested power from individual photodiodes is monitored and exploited as a clue for sensing finger gestures in proximity. Harvested power from all photodiodes are aggregated to drive the whole gesture-recognition module including a micro-controller running the recognition algorithm. We design robust, lightweight algorithm to recognize finger gestures in the presence of ambient light fluctuations. We fabricate two prototypes to facilitate user’s interaction with smart …

Orecchio: Extending Body-Language Through Actuated Static And Dynamic Auricular Postures, Da-Yuan Huang, Teddy Seyed, Jun Gong, Zhihao Yao, Yuchen Jiao, Xiang Anthony Chen, Xing-Dong Yang

Dartmouth Scholarship

In this paper, we propose using the auricle – the visible part of the ear – as a means of expressive output to extend body language to convey emotional states. With an initial exploratory study, we provide an initial set of dynamic and static auricular postures. Using these results, we examined the relationship between emotions and auricular postures, noting that dynamic postures involving stretching the top helix in fast (e.g., 2Hz) and slow speeds (1Hz) conveyed intense and mild pleasantness while static postures involving bending the side or top helix towards the center of the ear were associated with intense …

Battery-Free Eye Tracker On Glasses, Tianxing Li, Xia Zhou

Dartmouth Scholarship

This paper presents a battery-free wearable eye tracker that tracks both the 2D position and diameter of a pupil based on its light absorption property. With a few near-infrared (NIR) lights and photodiodes around the eye, NIR lights sequentially illuminate the eye from various directions while photodiodes sense spatial patterns of reflected light, which are used to infer pupil’s position and diameter on the fly via a lightweight inference algorithm. The system also exploits characteristics of different eye movement stages and adjusts its sensing and computation accordingly for further energy savings. A prototype is built with off-the-shelf hardware components and …

Thermodynamically Consistent Hydrodynamic Phase Field Models And Numerical Approximation For Multi-Component Compressible Viscous Fluid Mixtures, Xueping Zhao

Theses and Dissertations

Material systems comprising of multi-component, some of which are compressible, are ubiquitous in nature and industrial applications. In the compressible fluid flow, the material compressibility comes from two sources. One is the material compressibility itself and another is the mass-generating source. For example, the compressibility in the binary fluid flows of non-hydrocarbon (e.g. Carbon dioxide) and hydrocarbons encountered in the enhanced oil recovery (EOR) process, comes from the compressibility of the gas-liquid mixture itself. Another example of the mixture of compressible fluids is growing tissue, in which cell proliferation and cell migration make the material volume changes so that it …

Algorithms For Robot Coverage Under Movement And Sensing Constraints, Jeremy S. Lewis

Theses and Dissertations

This thesis explores the problem of generating coverage paths—that is, paths that pass within some sensor footprint of every point in an environment—for mobile robots. It both considers models for which navigation is a solved problem but motions are constrained, as well for models in which navigation must be considered along with coverage planning because of the robot’s unreliable sensing and movements.

The motion constraint we adopt for the former is a common constraint, that of a Dubins vehicle. We extend previous work that solves this coverage problem as a traveling salesman problem (TSP) by introducing a practical heuristic algorithm …

Development Of A Fluorescence Imaging Photometer-Based Method For Characterization Of Phytoplankton Communities, Cameron Maxwell Rekully

Theses and Dissertations

The development of methods for real-time characterization of phytoplankton community structure has important implications for environmental monitoring and the prediction of harmful algal blooms. Our research group has developed an instrument, the Fluorescence Imaging Photometer (FIP), which is capable of rapid classification of phytoplankton via imaging single-cell chlorophyll a fluorescence under different excitation conditions. Discrimination of cells from different taxonomic groups is achieved using optical bandpass filters that have been chosen to selectively excite pigments which occur in characteristic ratios that vary from one group to the next. The relative fluorescence intensity emitted by cells under these different excitation conditions …

Hierarchical Corannulene-Based Materials, Allison M. Rice

Theses and Dissertations

Merging the intrinsic properties of fullerene (buckyball) and corannulene (buckybowl) derivatives with the inherent properties of crystalline metal- and covalent- organic frameworks (MOFs and COFs), including their modularity, porosity, versatility, high surface area, and structural tunability, opens a pathway to unlock a novel class of fulleretic materials. Despite the great interest in MOFs and COFs, as well as fullerene derivatives, this dissertation is focused on crystalline fullerene- and corannulene- containing frameworks, highlighting their potential contributions in the fields of optoelectronic devices, electrodes, and photosensitizers. We have revealed a dual role of fullerene- and corannulene-containing building blocks showing their versatility to …

Galaxy And Mass Assembly (Gama): The Environmental Dependence Of The Galaxy Main Sequence, L. Wang, P. Norberg, S. Brough, M. J.I. Brown, E. Da Cunha, L. J. Davies, S. P. Driver, Benne W. Holwerda, A. M. Hopkins, M. A. Lara-Lopez, J. Liske, J. Loveday, M. W. Grootes, C. C. Popescu, A. H. Wright

Faculty and Staff Scholarship

Aims: We aim to investigate if the environment (characterised by the host dark matter halo mass) plays any role in shaping the galaxy star formation main sequence (MS). Methods: The Galaxy and Mass Assembly project (GAMA) combines a spectroscopic survey with photometric information in 21 bands from the far-ultraviolet (FUV) to the far-infrared (FIR). Stellar masses and dust-corrected star-formation rates (SFR) are derived from spectral energy distribution (SED) modelling using MAGPHYS. We use the GAMA galaxy group catalogue to examine the variation of the fraction of star-forming galaxies (SFG) and properties of the MS with respect to the environment. Results: …

A Comparison Of Pre-College Enrichment Program Participants And Non-Participants: College Academic Performance Measures, Sherron Mckendall, Alan Mckendall, Ann Chester

Faculty & Staff Scholarship

This paper analyzes College Grade Point Averages (CGPAs), American College Testing Composite (ACTC) scores and Scholastic Assessment Test Total (SATT) scores of over 1,300 undergraduates at West Virginia University (WVU) who participated in the Health Sciences and Technology Academy (HSTA) to those students who did not (Non-HSTA). Traditionally, pre-college enrichment programs provide academic enrichment to underrepresented youth with the intent of increasing their chances for post-secondary entry and success. Factorial design determined if HSTA participants were better prepared to pursue postsecondary study. Overall, the results reveal that HSTA students outperformed their Non-HSTA counterparts in that there were significant differences in …

Diuretic, Glucosuric And Natriuretic Effect Of Pantoyltaurine In Diabetic Sprague-Dawley Rats, Ripal P. Amin, Sanket N. Patel, Sunil Kumar, S. William Zito, Sue Ford, Michael A. Barletta

Faculty Works: BCES (1999-2023)

Sodium-glucose co-transporter (SGLT) inhibitors offer a novel tool to control hyperglycemia and its complications. We present preliminary findings of pantoyltaurine, N-substituted analog of taurine, as diuretic, glucosuric and natriuretic agent in streptozotocin (60 mg/kg/mL, i.p.)-induced type 1 diabetic Sprague-Dawley rats and whether pantoyltaurine has an effect on regulation of SGLT isoforms that may further help in reducing hyperglycemia and improving renal function. After 14 days of persistent diabetes, phlorizin (0.4 g/kg/day, s.c.) or pantoyltaurine (2.4 mM/kg/day, p.o.) was administered for three weeks, days 15 - 35. As expected, diabetic rats showed persistent hyperglycemia, hyperphagia and weight loss. Pantoyltaurine and phlorizin-treated …

Unroofing History Of The Northwestern Ethiopian Plateau: Insights From Low-Temperature Apatite Thermochronology, Shelby Bowden

Masters Theses & Specialist Projects

The geology of Ethiopia is dominated by the Ethiopian Plateau that is similar in elevation to, but aerially larger than, the Colorado Plateau. Several rivers have incised through the plateau, creating gorges that reach up to 1.5 km in depth. The plateau uplifted to its current elevation and was subsequently incised sometime after the Oligocene flood basalt event that signaled the arrival of the African Superplume below Kenya and Ethiopia. Due to its size and extent, published climate modeling has indicated that Late Cenozoic plateau formation could have been a driving force in the East African Cenozoic climate changes. Although …

Indirect Greenhouse Gas Dynamics In Karst Groundwater Systems Under Agricultural Land Use, Stacy Wayne Antle

Masters Theses & Specialist Projects

Greenhouse gases (GHGs) are a major global environmental concern, because their concentrations have continuously increased over the past few centuries, due to global population growth, fossil fuel dependency, and the Industrial Revolution. Since these gases are naturally occurring phenomena, they will never be completely eliminated. Efforts to reduce them span numerous scientific attempts, with minimal improvements in reducing their atmospheric concentrations. In agricultural land practices, greenhouse gases are common byproducts that affect the atmosphere and, potentially, the groundwater where livestock and fertilizers are key contributors. Little is known about the fate of such greenhouse gases in dissolved form, known as …

Synthesis Of A Platinum Triamine Complex And Its Interactions With Guanosine 5’- Monophosphate And N-Acetylmethionine, Manal El Masri

Masters Theses & Specialist Projects

Cisplatin (cis-diamminedichloroplatinum(II)) and its analogs are known to form 1,2-intrastrand cross-links with guanine bases that lead to DNA distortion and are responsible for cytotoxicity. Reaction with proteins, especially at methionine residues, could also be responsible for cytotoxicity (Sandlin, R. D. et al. 2010). A new tridentate platinum(II) complex with a piperazine ring was successfully designed and synthesized. In this complex, the platinum is coordinating to all three nitrogens of (1,2- dimethylaminoethylpiperazine), which makes it a Platinum triamine compound. A series of chemical reactions of this compound with guanosine 5’-monophosphate (5’-GMP) and N-acetylmethionine (N-AcMet) were conducted under different conditions. Reactions with …