Physical Sciences and Mathematics Commons^™

On Binaural Spatialization And The Use Of Gpgpu For Audio Processing, Davide Andrea Mauro Phd

Davide Andrea Mauro

3D recordings and audio, namely techniques that aim to create the perception of sound sources placed anywhere in 3 dimensional space, are becoming an interesting resource for composers, live performances and augmented reality. This thesis focuses on binaural spatialization techniques.

We will tackle the problem from three different perspectives. The first one is related to the implementation of an engine for audio convolution, this is a real implementation problem where we will confront with a number of already available systems trying to achieve better results in terms of performances. General Purpose computing on Graphic Processing Units (GPGPU) is a promising …

Growing The Practice Of Vocal Sketching, S. Delle Monache, D. Rocchesso, S. Baldan, Davide Andrea Mauro Phd

Davide Andrea Mauro

Sketch-thinking in the design domain is a complex representational activity, emerging from the reflective conversation with the sketch. A recent line of research on computational support for sound design has been focusing on the exploitation of voice, and especially vocal imitations, as effective representation strategy for the early stage of the design process. A set of introductory exercises on vocal sketching, to probe the communication effectiveness of vocal imitations for design purposes, are presented and discussed, in the scope of the research-through-design workshop activities of the EU project SkAT-VG.

Peridynamic Modeling Of Ruptures In Biomembranes, Michael Taylor, Irep Gözen, Samir Patel, Aldo Jesorka, Katia Bertoldi

Michael Taylor

We simulate the formation of spontaneous ruptures in supported phospholipid double bilayer membranes, using peridynamic modeling. Experiments performed on spreading double bilayers typically show two distinct kinds of ruptures, floral and fractal, which form spontaneously in the distal (upper) bilayer at late stages of double bilayer formation on high energy substrates. It is, however, currently unresolved which factors govern the occurrence of either rupture type. Variations in the distance between the two bilayers, and the occurrence of interconnections (“pinning sites”) are suspected of contributing to the process. Our new simulations indicate that the pinned regions which form, presumably due to …

Marim: Mobile Augmented Reality For Interactive Manuals, Tam Nguyen, Dorothy Tan, Bilal Mirza, Jose Sepulveda

Tam Nguyen

In this work, we present a practical system which uses mobile devices for interactive manuals. In particular, there are two modes provided in the system, namely, expert/trainer and trainee modes. Given the expert/trainer editor, experts design the step-by-step interactive manuals. For each step, the experts capture the images by using phones/tablets and provide visual instructions such as interest regions, text, and action animations. In the trainee mode, the system utilizes the existing object detection and tracking algorithms to identify the step scene and retrieve the respective instruction to be displayed on the mobile device. The trainee then follows the displayed …

Static Saliency Vs. Dynamic Saliency: A Comparative Study, Tam Nguyen, Mengdi Xu, Guangyu Gao, Mohan Kankanhalli, Qi Tian, Shuicheng Yan

Tam Nguyen

Recently visual saliency has attracted wide attention of researchers in the computer vision and multimedia field. However, most of the visual saliency-related research was conducted on still images for studying static saliency. In this paper, we give a comprehensive comparative study for the first time of dynamic saliency (video shots) and static saliency (key frames of the corresponding video shots), and two key observations are obtained: 1) video saliency is often different from, yet quite related with, image saliency, and 2) camera motions, such as tilting, panning or zooming, affect dynamic saliency significantly.

Motivated by these observations, we propose a …

Seeing Human Weight From A Single Rgb-D Image, Tam Nguyen, Jiashi Feng, Shuicheng Yan

Tam Nguyen

Human weight estimation is useful in a variety of potential applications, e.g., targeted advertisement, entertainment scenarios and forensic science. However, estimating weight only from color cues is particularly challenging since these cues are quite sensitive to lighting and imaging conditions. In this article, we propose a novel weight estimator based on a single RGB-D image, which utilizes the visual color cues and depth information. Our main contributions are three-fold.

First, we construct the W8-RGBD dataset including RGB-D images of different people with ground truth weight.

Second, the novel sideview shape feature and the feature fusion model are proposed to facilitate …

Salient Object Detection Via Objectness Proposals, Tam Nguyen

Tam Nguyen

Salient object detection has gradually become a popular topic in robotics and computer vision research. This paper presents a real-time system that detects salient objects by integrating objectness, foreground, and compactness measures. Our algorithm consists of four basic steps. First, our method generates the objectness map via object proposals. Based on the objectness map, we estimate the background margin and compute the corresponding foreground map which prefers the foreground objects. From the objectness map and the foreground map, the compactness map is formed to favor the compact objects. We then integrate those cues to form a pixel-accurate saliency map which …

Salient Object Detection Via Augmented Hypotheses, Tam Nguyen, Jose Sepulveda

Tam Nguyen

In this paper, we propose using augmented hypotheses which consider objectness, foreground, and compactness for salient object detection. Our algorithm consists of four basic steps. First, our method generates the objectness map via objectness hypotheses. Based on the objectness map, we estimate the foreground margin and compute the corresponding foreground map which prefers the foreground objects. From the objectness map and the foreground map, the compactness map is formed to favor the compact objects. We then derive a saliency measure that produces a pixel-accurate saliency map which uniformly covers the objects of interest and consistently separates foreground and background.

We …

Towards Decrypting Attractiveness Via Multi-Modality Cue, Tam Nguyen, Si Liu, Bingbing Ni, Jun Tan, Yong Rui, Shuicheng Yan

Tam Nguyen

Decrypting the secret of beauty or attractiveness has been the pursuit of artists and philosophers for centuries. To date, the computational model for attractiveness estimation has been actively explored in the computer vision and multimedia community, yet with the focus mainly on facial features. In this article, we conduct a comprehensive study on female attractiveness conveyed by single/multiple modalities of cues, that is, face, dressing and/or voice; the aim is to discover how different modalities individually and collectively affect the human sense of beauty. To extensively investigate the problem, we collect the Multi-Modality Beauty (M2B) dataset, which is annotated with …

Adaptive Nonparametric Image Parsing, Tam Nguyen, Canyi Lu, Jose Sepulveda, Shuicheng Yan

Tam Nguyen

In this paper, we present an adaptive nonparametric solution to the image parsing task, namely, annotating each image pixel with its corresponding category label. For a given test image, first, a locality-aware retrieval set is extracted from the training data based on superpixel matching similarities, which are augmented with feature extraction for better differentiation of local superpixels. Then, the category of each superpixel is initialized by the majority vote of the k -nearest-neighbor superpixels in the retrieval set. Instead of fixing k as in traditional nonparametric approaches, here, we propose a novel adaptive nonparametric approach that determines the sample-specific k …

Gecka3d: A 3d Game Engine For Commonsense Knowledge Acquisition, Erik Cambria, Tam Nguyen, Brian Cheng, Kenneth Kwok, Jose Sepulveda

Tam Nguyen

Commonsense knowledge representation and reasoning is key for tasks such as artificial intelligence and natural language understanding. Since commonsense consists of information that humans take for granted, gathering it is an extremely difficult task. In this paper, we introduce a novel 3D game engine for commonsense knowledge acquisition (GECKA3D) which aims to collect commonsense from game designers through the development of serious games. GECKA3D integrates the potential of serious games and games with a purpose. This provides a platform for the acquisition of reusable and multi-purpose knowledge and also enables the development of games that can provide entertainment value and …

Hi, Magic Closet, Tell Me What To Wear!, Si Liu, Tam Nguyen, Jiashi Feng, Meng Wang, Shuicheng Yan

Tam Nguyen

In this demo, we present a practical system, "magic closet," for automatic occasion-oriented clothing pairing. Given a user-input occasion, e.g., wedding or shopping, the magic closet intelligently and automatically pairs the user-specified reference clothing (upper body or lower body) with the most suitable one from online shops. Two key criteria are explicitly considered for the magic closet system. One criterion is to dress properly, e.g., compared to suit pants, it is more decent to wear a cocktail dress for a banquet occasion. The other criterion is to dress aesthetically, e.g., a red T-shirt matches better with white pants than with …

Fluctuations In A Cosmology With A Spacelike Singularity And Their Gauge Theory Dual Description, Robert H. Brandenberger, Elisa G.M. Ferreira, Ian A. Morrison, Yi-Fu Cai, Sumit R. Das, Yi Wang

Ian Morrison

We consider a time-dependent deformation of anti–de Sitter (AdS) space-time which contains a spacelike “singularity”—a spacelike region of high curvature. Making use of the AdS/CFT correspondence we can map the bulk dynamics onto the boundary. The boundary theory has a time dependent coupling constant which becomes small at times when the bulk space-time is highly curved. We investigate the propagation of small fluctuations of a test scalar field from early times before the bulk singularity to late times after the singularity. Under the assumption that the AdS/CFT correspondence extends to deformed AdS space-times, we can map the bulk evolution of …

Hybrid Spatiotemporal Coherent Pulse Addition Of A Picosecond Flashlamp-Pumped Ndyag Laser.Pdf, Ahmad Azim

Ahmad Azim

Recommended Practice For Use Of Electrostatic Analyzers In Electric Propulsion Testing Read More: Http://Arc.Aiaa.Org/Doi/Abs/10.2514/1.B35413, Shawn C. Farnell

Shawn C Farnell

Electrostatic analyzers are used in electric propulsion to measure the energy per unit charge E/q" role="presentation" style="display: inline; line-height: normal; font-size: 16px; word-wrap: normal; white-space: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; padding: 0px 2px 0px 0px; margin: 0px; font-family: "Lucida Grande", "Lucida Sans", Arial, Helvetica, sans-serif; background-color: rgb(37, 79, 98); position: relative;">E/qE/q distribution of ion and electron beams: in the downstream region of thrusters, for example. This paper serves to give an overview of the most fundamental, yet most widely used, types of electrostatic analyzer designs. Analyzers are grouped into …

Algorithms For An Automatic Transcription Of Live Music Performances Into Symbolic Format, Stefano Baldan, Luca A. Ludovico, Davide Andrea Mauro

Davide Andrea Mauro

This paper addresses the problem of the real-time automatic transcription of a live music performance into a symbolic format. The source data are given by any music instrument or other device able to communicate through a performance protocol. During a performance, music events are parsed and their parameters are evaluated thanks to rhythm and pitch detection algorithms. The final step is the creation of a well-formed XML document, validated against the new international standard known as IEEE 1599. This work will shortly describe both the software environment and the XML format, but the main analysis will involve the real-time recognition …

"Musica Sull'acqua": A Motion Tracking Based Sonification Of An Aquarium In Real Time, Stefano Baldan, Luca A. Ludovico, Davide Andrea Mauro

Davide Andrea Mauro

This paper presents a temporary multimedia installation set up at the Civic Aquarium of Milan. Thanks to four web cameras located in front of the tropical fishpond, fish are tracked and their movements are used to control a number of music-related parameters in real time. In order to process multiple video streams, the open-source programming language Processing has been employed. Then, the sonification is implemented by a Pure Data patch. The communication among the parts of the system has been realized through Open Sound Control (OSC) messages. This paper describes the key concepts, the musical idea, the design phase and …

To "Sketch-A-Scratch", A. Del Piccolo, S. Delle Monache, D. Rocchesso, S. Papetti, Davide Andrea Mauro

Davide Andrea Mauro

A surface can be harsh and raspy, or smooth and silky, and everything in between. We are used to sense these features with our fingertips as well as with our eyes and ears: the exploration of a surface is a multisensory experience. Tools, too, are often employed in the interaction with surfaces, since they augment our manipulation capabilities. “Sketch-a-Scratch” is a tool for the multisensory exploration and sketching of surface textures. The user’s actions drive a physical sound model of real materials’ response to interactions such as scraping, rubbing or rolling. Moreover, different input signals can be converted into 2D …

Managing Multiple Media Streams In Html5: The Ieee 1599-2008 Case Study, S. Baldan, L. A. Ludovico, Davide Andrea Mauro

Davide Andrea Mauro

This paper deals with the problem of managing multiple multimedia streams in a Web environment. Multimedia types to support are pure audio, video with no sound, and audio/video. Data streams refer to the same event or performance, consequently they both have and should maintain mutual synchronization. Besides, a Web player should be able to play different multimedia streams simultaneously, as well as to switch from one to another in real time. The clarifying example of a music piece encoded in IEEE 1599 format will be presented as a case study.

Audio Convolution By The Mean Of Gpu: Cuda And Opencl Implementations, Davide Andrea Mauro

Davide Andrea Mauro

This paper focuses on the use of GPGPU (General-Purpose computing on Graphics Processing Units) for audio processing. This is a promising approach to problems where a high parallelization of tasks is desirable. Within the context of binaural spatialization we will develop a convolution engine having in mind both offline and real-time scenarios, and the support for multiple sound sources. Details on implementations and strategies used with both dominant technologies, namely CUDA and OpenCL, will be presented highlighting both advantages and issues. Comparisons between this approach and typical CPU implementations will be presented as well as between frequency (FFT) and time-domain …

Continuous Brightness Estimation (Cobe): Implementation And Its Possible Applications, G. Presti, Davide Andrea Mauro

Davide Andrea Mauro

This paper presents a time-domain technique based solely on simple operations, like filtering and scaling, to continuously track a sound descriptor correlated to brightness and pitch. In opposition to existing algorithms this approach does not rely on input framing or frequencydomain transforms, ensuring a better temporal resolution and the possibility to model analog-like implementations. In the first part of the document we present the details of our approach to brightness estimation; then we will compare CoBE to the brightness estimation implemented in MIR Toolbox; we introduce and define the concept of “Equivalent Brightness Frequency” (EBF) and finally we show how …

Visualization And Manipulation Of Stereophonic Audio Signals By Means Of Iid And Ipd, Giorgio Presti, Goffredo Haus, Davide Andrea Mauro

Davide Andrea Mauro

In this paper we will discuss a model aimed at improving the spectral data representation of stereophonic audio in a way that allows efficient stereophonic data visualization and linear manipulation of arbitrary parts of the stereo image. The stereo pair is here interpreted as a single spectrum with additional dimensions, expressing the Interaural Intensity Difference (IID) and Interaural Phase Difference (IPD) for each FFT bin. These dimensions are evaluated assuming that the stereo signal is an instantaneous mixture with a residual amount of convolutive phenomena. Even if this assumption is not generally true for the majority of music signals it …

Music-Related Media-Contents Synchronization Over Theweb: The Ieee 1599 Initiative, Adriano Baratè, Goffredo Haus, Luca A. Ludovico, Stefano Baldan, Davide Andrea Mauro

Davide Andrea Mauro

IEEE 1599 is an international standard originally conceived for music, which aims at providing a comprehensive description of the media contents related to a music piece within a multi-layer and synchronized environment. A number of o_- line and stand-alone software prototypes has been realized after its standardization, occurred in 2008. Recently, thanks to some technological advances (e.g. the release of HTML5), the engine of the IEEE 1599 parser has been ported on the Web. Some non-trivial problems have been solved, e.g. the management of multiple simultaneous media streams in a client-server architecture. After providing an overview of the IEEE 1599 …

Analysis Of Biofilm Communities For Legionella Pneumophila, Sarah C. Dusenbury, Sandra Bediako, Uma Mahajan, Tamara L. Mcnealy

H. Sandra Pelle

2012 S.C. Water Resources Conference - Exploring Opportunities for Collaborative Water Research, Policy and Management

Hilbe Mcd E-Book2016 Errata 03nov2016, Joseph M. Hilbe

Joseph M Hilbe

Correlates Of Hiv Acquisition In A Cohort Of Black Men Who Have Sex With Men In The United States: Hiv Prevention Trials Network (Hptn) 061, Beryl A. Koblin, Kenneth H. Mayer, Susan H. Eshleman, Lei Wang, Sharon B. Mannheimer, Carlos Del Rio, Steve Shoptaw, Manya Magnus, Susan Buchbinder, Leo Wilton, Ting-Yuan Liu, Vanessa Cummings, Estelle Piwowar-Manning, Sheldon D. Fields, Sam Griffith, Vanessa Elharrar, Darrell Wheeler

Leo Wilton

Background

Black men who have sex with men (MSM) in the United States (US) are affected by HIV at disproportionate rates compared to MSM of other race/ethnicities. Current HIV incidence estimates in this group are needed to appropriately target prevention efforts.

Methods

From July 2009 to October 2010, Black MSM reporting unprotected anal intercourse with a man in the past six months were enrolled and followed for one year in six US cities for a feasibility study of a multi-component intervention to reduce HIV infection. HIV incidence based on HIV seroconversion was calculated as number of events/100 person-years. Multivariate proportional …

Calculating Odds Ratios From Probabillities, Joseph M. Hilbe

Joseph M Hilbe

A Language-Based Model For Specifying And Staging Mixed-Initiative Dialogs, Saverio Perugini, Joshua W. Buck

Saverio Perugini

Specifying and implementing flexible human-computer dialogs, such as those used in kiosks, is complex because of the numerous and varied directions in which each user might steer a dialog. The objective of this research is to improve dialog specification and implementation. To do so we developed a model for specifying and staging mixed-initiative dialogs. The model involves a dialog authoring notation, based on concepts from programming languages, for specifying a variety of unsolicited reporting, mixed-initiative dialogs in a concise representation that serves as a design for dialog implementation. Guided by this foundation, we built a dialog staging engine which operationalizes …

Mining Mixed-Initiative Dialogs, Saverio Perugini

Saverio Perugini

Human-computer dialogs are an important vehicle through which to produce a rich and compelling form of human-computer interaction. We view the specification of a human-computer dialog as a set of sequences of progressive interactions between a user and a computer system, and mine partially ordered sets, which correspond to mixing dialog initiative, embedded in these sets of sequences—a process we refer to as dialog mining—because partially ordered sets can be advantageously exploited to reduce the control complexity of a dialog implementation. Our mining losslessly compresses the specification of a dialog. We describe our mining algorithm and report the results of …

Introduction, Tracy Mitrano

Tracy Mitrano

No abstract provided.