Skip to main content

Showing 1–50 of 66 results for author: Romero, D

  1. arXiv:2406.05967  [pdf, other

    cs.CV cs.AI cs.CL cs.LG

    CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark

    Authors: David Romero, Chenyang Lyu, Haryo Akbarianto Wibowo, Teresa Lynn, Injy Hamed, Aditya Nanda Kishore, Aishik Mandal, Alina Dragonetti, Artem Abzaliev, Atnafu Lambebo Tonja, Bontu Fufa Balcha, Chenxi Whitehouse, Christian Salamea, Dan John Velasco, David Ifeoluwa Adelani, David Le Meur, Emilio Villa-Cueva, Fajri Koto, Fauzan Farooqui, Frederico Belcavello, Ganzorig Batnasan, Gisela Vallejo, Grainne Caulfield, Guido Ivetta, Haiyue Song , et al. (50 additional authors not shown)

    Abstract: Visual Question Answering (VQA) is an important task in multimodal AI, and it is often used to test the ability of vision-language models to understand and reason on knowledge present in both visual and textual data. However, most of the current VQA models use datasets that are primarily focused on English and a few major world languages, with images that are typically Western-centric. While recen… ▽ More

    Submitted 9 June, 2024; originally announced June 2024.

  2. arXiv:2402.15683  [pdf, other

    cs.SI cs.CY physics.soc-ph

    Exit Ripple Effects: Understanding the Disruption of Socialization Networks Following Employee Departures

    Authors: David Gamba, Yulin Yu, Yuan Yuan, Grant Schoenebeck, Daniel M. Romero

    Abstract: Amidst growing uncertainty and frequent restructurings, the impacts of employee exits are becoming one of the central concerns for organizations. Using rich communication data from a large holding company, we examine the effects of employee departures on socialization networks among the remaining coworkers. Specifically, we investigate how network metrics change among people who historically inter… ▽ More

    Submitted 23 February, 2024; originally announced February 2024.

    Comments: Published in proceedings of the ACM Web Conference 2024 (WWW '24), May 13--17, 2024, Singapore, Singapore

    ACM Class: J.4; I.5.1

  3. arXiv:2402.10698  [pdf, other

    cs.CV

    Question-Instructed Visual Descriptions for Zero-Shot Video Question Answering

    Authors: David Romero, Thamar Solorio

    Abstract: We present Q-ViD, a simple approach for video question answering (video QA), that unlike prior methods, which are based on complex architectures, computationally expensive pipelines or use closed models like GPTs, Q-ViD relies on a single instruction-aware open vision-language model (InstructBLIP) to tackle videoQA using frame descriptions. Specifically, we create captioning instruction prompts th… ▽ More

    Submitted 16 February, 2024; originally announced February 2024.

  4. arXiv:2402.05024  [pdf, other

    cs.DL cs.SI econ.GN

    Does the Use of Unusual Combinations of Datasets Contribute to Greater Scientific Impact?

    Authors: Yulin Yu, Daniel M. Romero

    Abstract: Scientific datasets play a crucial role in contemporary data-driven research, as they allow for the progress of science by facilitating the discovery of new patterns and phenomena. This mounting demand for empirical research raises important questions on how strategic data utilization in research projects can stimulate scientific advancement. In this study, we examine the hypothesis inspired by th… ▽ More

    Submitted 8 February, 2024; v1 submitted 7 February, 2024; originally announced February 2024.

  5. arXiv:2402.00641  [pdf, other

    cs.CR

    Testing side-channel security of cryptographic implementations against future microarchitectures

    Authors: Gilles Barthe, Marcel Böhme, Sunjay Cauligi, Chitchanok Chuengsatiansup, Daniel Genkin, Marco Guarnieri, David Mateos Romero, Peter Schwabe, David Wu, Yuval Yarom

    Abstract: How will future microarchitectures impact the security of existing cryptographic implementations? As we cannot keep reducing the size of transistors, chip vendors have started developing new microarchitectural optimizations to speed up computation. A recent study (Sanchez Vicarte et al., ISCA 2021) suggests that these optimizations might open the Pandora's box of microarchitectural attacks. Howeve… ▽ More

    Submitted 1 February, 2024; originally announced February 2024.

  6. arXiv:2312.12223  [pdf, other

    cs.CV cs.LG

    Self-Supervised Detection of Perfect and Partial Input-Dependent Symmetries

    Authors: Alonso Urbano, David W. Romero

    Abstract: Group equivariance can overly constrain models if the symmetries in the group differ from those observed in data. While common methods address this by determining the appropriate level of symmetry at the dataset level, they are limited to supervised settings and ignore scenarios in which multiple levels of symmetry co-exist in the same dataset. In this paper, we propose a method able to detect the… ▽ More

    Submitted 3 July, 2024; v1 submitted 19 December, 2023; originally announced December 2023.

  7. arXiv:2312.04470  [pdf, other

    cs.HC cs.CR

    GaitGuard: Towards Private Gait in Mixed Reality

    Authors: Diana Romero, Ruchi Jagdish Patel, Athina Markopoulou, Salma Elmalaki

    Abstract: Augmented/Mixed Reality (AR/MR) technologies offers a new era of immersive, collaborative experiences, distinctively setting them apart from conventional mobile systems. However, as we further investigate the privacy and security implications within these environments, the issue of gait privacy emerges as a critical yet underexplored concern. Given its uniqueness as a biometric identifier that can… ▽ More

    Submitted 4 June, 2024; v1 submitted 7 December, 2023; originally announced December 2023.

    Comments: 21 pages, 17 figures

  8. arXiv:2311.17068  [pdf, other

    cs.CE cs.LG

    Deep convolutional encoder-decoder hierarchical neural networks for conjugate heat transfer surrogate modeling

    Authors: Takiah Ebbs-Picken, David A. Romero, Carlos M. Da Silva, Cristina H. Amon

    Abstract: Conjugate heat transfer (CHT) models are vital for the design of many engineering systems. However, high-fidelity CHT models are computationally intensive, which limits their use in applications such as design optimization, where hundreds to thousands of model evaluations are required. In this work, we develop a modular deep convolutional encoder-decoder hierarchical (DeepEDH) neural network, a no… ▽ More

    Submitted 24 November, 2023; originally announced November 2023.

  9. arXiv:2310.18780  [pdf, other

    cs.LG cs.AI eess.SP

    Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions

    Authors: Stefano Massaroli, Michael Poli, Daniel Y. Fu, Hermann Kumbong, Rom N. Parnichkun, Aman Timalsina, David W. Romero, Quinn McIntyre, Beidi Chen, Atri Rudra, Ce Zhang, Christopher Re, Stefano Ermon, Yoshua Bengio

    Abstract: Recent advances in attention-free sequence models rely on convolutions as alternatives to the attention operator at the core of Transformers. In particular, long convolution sequence models have achieved state-of-the-art performance in many domains, but incur a significant cost during auto-regressive inference workloads -- naively requiring a full pass (or caching of activations) over the input se… ▽ More

    Submitted 28 October, 2023; originally announced October 2023.

  10. arXiv:2310.15106  [pdf, other

    cs.IT eess.SP

    Theoretical Analysis of the Radio Map Estimation Problem

    Authors: Daniel Romero, Tien Ngoc Ha, Raju Shrestha, Massimo Franceschetti

    Abstract: Radio maps provide radio frequency metrics, such as the received signal strength, at every location of a geographic area. These maps, which are estimated using a set of measurements collected at multiple positions, find a wide range of applications in wireless communications, including the prediction of coverage holes, network planning, resource allocation, and path planning for mobile robots. Alt… ▽ More

    Submitted 23 March, 2024; v1 submitted 23 October, 2023; originally announced October 2023.

  11. arXiv:2310.11043  [pdf, other

    eess.SP cs.AI

    Spoofing Attack Detection in the Physical Layer with Robustness to User Movement

    Authors: Daniel Romero, Tien Ngoc Ha, Peter Gerstoft

    Abstract: In a spoofing attack, an attacker impersonates a legitimate user to access or modify data belonging to the latter. Typical approaches for spoofing detection in the physical layer declare an attack when a change is observed in certain channel features, such as the received signal strength (RSS) measured by spatially distributed receivers. However, since channels change over time, for example due to… ▽ More

    Submitted 17 October, 2023; originally announced October 2023.

    Comments: WCNC. arXiv admin note: text overlap with arXiv:2211.04269

  12. arXiv:2310.11036  [pdf, other

    eess.SP cs.AI physics.app-ph

    Radio Map Estimation: Empirical Validation and Analysis

    Authors: Raju Shrestha, Tien Ngoc Ha, Pham Q. Viet, Daniel Romero

    Abstract: Radio maps quantify magnitudes such as the received signal strength at every location of a geographical region. Although the estimation of radio maps has attracted widespread interest, the vast majority of works rely on simulated data and, therefore, cannot establish the effectiveness and relative performance of existing algorithms in practice. To fill this gap, this paper presents the first compr… ▽ More

    Submitted 22 January, 2024; v1 submitted 17 October, 2023; originally announced October 2023.

    Comments: 13 pages, Journal version, submitted to the IEEE Transactions on Wireless Communications

  13. arXiv:2310.02970  [pdf, other

    cs.LG math.GR

    Fast, Expressive SE$(n)$ Equivariant Networks through Weight-Sharing in Position-Orientation Space

    Authors: Erik J Bekkers, Sharvaree Vadgama, Rob D Hesselink, Putri A van der Linden, David W Romero

    Abstract: Based on the theory of homogeneous spaces we derive geometrically optimal edge attributes to be used within the flexible message-passing framework. We formalize the notion of weight sharing in convolutional networks as the sharing of message functions over point-pairs that should be treated equally. We define equivalence classes of point-pairs that are identical up to a transformation in the group… ▽ More

    Submitted 15 March, 2024; v1 submitted 4 October, 2023; originally announced October 2023.

    Comments: Our code is publicly available at https://github.com/ebekkers/ponita . Published at ICLR 2024

  14. arXiv:2308.09270  [pdf, other

    cs.SI

    Profile Update: The Effects of Identity Disclosure on Network Connections and Language

    Authors: Minje Choi, Daniel M. Romero, David Jurgens

    Abstract: Our social identities determine how we interact and engage with the world surrounding us. In online settings, individuals can make these identities explicit by including them in their public biography, possibly signaling a change to what is important to them and how they should be viewed. Here, we perform the first large-scale study on Twitter that examines behavioral changes following identity si… ▽ More

    Submitted 17 August, 2023; originally announced August 2023.

  15. arXiv:2307.14354  [pdf, other

    cs.CV cs.LG

    Learned Gridification for Efficient Point Cloud Processing

    Authors: Putri A. van der Linden, David W. Romero, Erik J. Bekkers

    Abstract: Neural operations that rely on neighborhood information are much more expensive when deployed on point clouds than on grid data due to the irregular distances between points in a point cloud. In a grid, on the other hand, we can compute the kernel only once and reuse it for all query positions. As a result, operations that rely on neighborhood information scale much worse for point clouds than for… ▽ More

    Submitted 22 July, 2023; originally announced July 2023.

  16. arXiv:2306.13250  [pdf, other

    cs.SI cs.CY

    Emergent Influence Networks in Good-Faith Online Discussions

    Authors: Henry K. Dambanemuya, Daniel Romero, Emőke-Ágnes Horvát

    Abstract: Town hall-type debates are increasingly moving online, irrevocably transforming public discourse. Yet, we know relatively little about crucial social dynamics that determine which arguments are more likely to be successful. This study investigates the impact of one's position in the discussion network created via responses to others' arguments on one's persuasiveness in unfacilitated online debate… ▽ More

    Submitted 22 June, 2023; originally announced June 2023.

    ACM Class: J.4

  17. Analyzing the Engagement of Social Relationships During Life Event Shocks in Social Media

    Authors: Minje Choi, David Jurgens, Daniel M. Romero

    Abstract: Individuals experiencing unexpected distressing events, shocks, often rely on their social network for support. While prior work has shown how social networks respond to shocks, these studies usually treat all ties equally, despite differences in the support provided by different social relationships. Here, we conduct a computational analysis on Twitter that examines how responses to online shocks… ▽ More

    Submitted 15 February, 2023; originally announced February 2023.

    Comments: Accepted to ICWSM 2023. 12 pages, 5 figures, 5 tables

  18. arXiv:2302.05400  [pdf, other

    cs.LG stat.ML

    DNArch: Learning Convolutional Neural Architectures by Backpropagation

    Authors: David W. Romero, Neil Zeghidour

    Abstract: We present Differentiable Neural Architectures (DNArch), a method that jointly learns the weights and the architecture of Convolutional Neural Networks (CNNs) by backpropagation. In particular, DNArch allows learning (i) the size of convolutional kernels at each layer, (ii) the number of channels at each layer, (iii) the position and values of downsampling layers, and (iv) the depth of the network… ▽ More

    Submitted 22 July, 2023; v1 submitted 10 February, 2023; originally announced February 2023.

  19. arXiv:2301.11429  [pdf, other

    cs.SI cs.CY

    Just Another Day on Twitter: A Complete 24 Hours of Twitter Data

    Authors: Juergen Pfeffer, Daniel Matter, Kokil Jaidka, Onur Varol, Afra Mashhadi, Jana Lasser, Dennis Assenmacher, Siqi Wu, Diyi Yang, Cornelia Brantner, Daniel M. Romero, Jahna Otterbacher, Carsten Schwemmer, Kenneth Joseph, David Garcia, Fred Morstatter

    Abstract: At the end of October 2022, Elon Musk concluded his acquisition of Twitter. In the weeks and months before that, several questions were publicly discussed that were not only of interest to the platform's future buyers, but also of high relevance to the Computational Social Science research community. For example, how many active users does the platform have? What percentage of accounts on the site… ▽ More

    Submitted 11 April, 2023; v1 submitted 26 January, 2023; originally announced January 2023.

  20. arXiv:2301.10540  [pdf, other

    cs.CV

    Modelling Long Range Dependencies in $N$D: From Task-Specific to a General Purpose CNN

    Authors: David M. Knigge, David W. Romero, Albert Gu, Efstratios Gavves, Erik J. Bekkers, Jakub M. Tomczak, Mark Hoogendoorn, Jan-Jakob Sonke

    Abstract: Performant Convolutional Neural Network (CNN) architectures must be tailored to specific tasks in order to consider the length, resolution, and dimensionality of the input data. In this work, we tackle the need for problem-specific CNN architectures. We present the Continuous Convolutional Neural Network (CCNN): a single CNN able to process data of arbitrary resolution, dimensionality and length w… ▽ More

    Submitted 16 April, 2023; v1 submitted 25 January, 2023; originally announced January 2023.

  21. arXiv:2301.05841  [pdf, ps, other

    eess.SY cs.MA

    Distributed Optimal Formation Control for an Uncertain Multiagent System in the Plane

    Authors: Clinton Enwerem, John Baras, Danilo Romero

    Abstract: In this paper, we present a distributed optimal multiagent control scheme for quadrotor formation tracking under localization errors. Our control architecture is based on a leader-follower approach, where a single leader quadrotor tracks a desired trajectory while the followers maintain their relative positions in a triangular formation. We begin by modeling the quadrotors as particles in the YZ-p… ▽ More

    Submitted 28 January, 2023; v1 submitted 14 January, 2023; originally announced January 2023.

    Comments: 6 pages, 7 figures

  22. arXiv:2211.04269  [pdf, other

    cs.LG cs.CR cs.NI

    Spoofing Attack Detection in the Physical Layer with Commutative Neural Networks

    Authors: Daniel Romero, Peter Gerstoft, Hadi Givehchian, Dinesh Bharadia

    Abstract: In a spoofing attack, an attacker impersonates a legitimate user to access or tamper with data intended for or produced by the legitimate user. In wireless communication systems, these attacks may be detected by relying on features of the channel and transmitter radios. In this context, a popular approach is to exploit the dependence of the received signal strength (RSS) at multiple receivers or a… ▽ More

    Submitted 8 November, 2022; originally announced November 2022.

  23. arXiv:2207.13815  [pdf, other

    cs.CY cs.IT

    Information Retention in the Multi-platform Sharing of Science

    Authors: Sohyeon Hwang, Emőke-Ágnes Horvát, Daniel M. Romero

    Abstract: The public interest in accurate scientific communication, underscored by recent public health crises, highlights how content often loses critical pieces of information as it spreads online. However, multi-platform analyses of this phenomenon remain limited due to challenges in data collection. Collecting mentions of research tracked by Altmetric LLC, we examine information retention in the over 4… ▽ More

    Submitted 12 March, 2023; v1 submitted 27 July, 2022; originally announced July 2022.

    Comments: 12 pages, 8 figures, accepted at the International AAAI Conference on Web and Social Media (ICWSM, 2023)

  24. arXiv:2206.05330  [pdf, other

    cs.DL cs.SI

    The Gender Gap in Scholarly Self-Promotion on Social Media

    Authors: Hao Peng, Misha Teplitskiy, Daniel M. Romero, Emőke-Ágnes Horvát

    Abstract: Self-promotion in science is ubiquitous but may not be exercised equally by men and women. Research on self-promotion in other domains suggests that, due to bias in self-assessment and adverse reactions to non-gender-conforming behaviors (``pushback''), women tend to self-promote less often than men. We test whether this pattern extends to scholars by examining self-promotion over six years using… ▽ More

    Submitted 10 October, 2023; v1 submitted 10 June, 2022; originally announced June 2022.

  25. arXiv:2206.03398  [pdf, other

    cs.LG cs.CV

    Towards a General Purpose CNN for Long Range Dependencies in $N$D

    Authors: David W. Romero, David M. Knigge, Albert Gu, Erik J. Bekkers, Efstratios Gavves, Jakub M. Tomczak, Mark Hoogendoorn

    Abstract: The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be tailored to specific tasks in order to incorporate considerations such as the input length, resolution, and dimentionality. In this work, we overcome the need… ▽ More

    Submitted 5 July, 2022; v1 submitted 7 June, 2022; originally announced June 2022.

    Comments: First two authors contributed equally to this work

  26. arXiv:2204.07178  [pdf, other

    cs.LG

    Relaxing Equivariance Constraints with Non-stationary Continuous Filters

    Authors: Tycho F. A. van der Ouderaa, David W. Romero, Mark van der Wilk

    Abstract: Equivariances provide useful inductive biases in neural network modeling, with the translation equivariance of convolutional neural networks being a canonical example. Equivariances can be embedded in architectures through weight-sharing and place symmetry constraints on the functions a neural network can represent. The type of symmetry is typically fixed and has to be chosen in advance. Although… ▽ More

    Submitted 13 November, 2022; v1 submitted 14 April, 2022; originally announced April 2022.

  27. arXiv:2202.08779  [pdf, other

    cs.RO

    Spiral Trajectories for Building Inspection with Quadrotors

    Authors: Juan Irving Vasquez, David E. Troncoso Romero, Mayra Antonio-Cruz, Erik Zamora

    Abstract: Inspection of large building is an important task since it can prevent material and human losses. A cheap and fast way to do the inspections is by sensors mounted on quadrotor vehicles. The challenge here is to compute a trajectory so that the building is completely observed while this same trajectory can be followed by the quadrotor in a smooth way. To address the problem, we propose a method tha… ▽ More

    Submitted 17 February, 2022; originally announced February 2022.

    Comments: In preparation for conference

  28. arXiv:2202.04842  [pdf, other

    cs.SI cs.CL cs.CY physics.soc-ph

    Networks and Identity Drive Geographic Properties of the Diffusion of Linguistic Innovation

    Authors: Aparna Ananthasubramaniam, David Jurgens, Daniel M. Romero

    Abstract: Adoption of cultural innovation (e.g., music, beliefs, language) is often geographically correlated, with adopters largely residing within the boundaries of relatively few well-studied, socially significant areas. These cultural regions are often hypothesized to be the result of either (i) identity performance driving the adoption of cultural innovation, or (ii) homophily in the networks underlyin… ▽ More

    Submitted 10 February, 2022; originally announced February 2022.

    ACM Class: J.4; I.6.3; K.4

  29. arXiv:2201.04125  [pdf, other

    eess.SP cs.LG

    Spectrum Surveying: Active Radio Map Estimation with Autonomous UAVs

    Authors: Raju Shrestha, Daniel Romero, Sundeep Prabhakar Chepuri

    Abstract: Radio maps find numerous applications in wireless communications and mobile robotics tasks, including resource allocation, interference coordination, and mission planning. Although numerous techniques have been proposed to construct radio maps from spatially distributed measurements, the locations of such measurements are assumed predetermined beforehand. In contrast, this paper proposes spectrum… ▽ More

    Submitted 13 January, 2022; v1 submitted 11 January, 2022; originally announced January 2022.

    Comments: 30 pages, 10 figures, submitted to the IEEE Transactions on Wireless Communications

  30. arXiv:2110.13059  [pdf, other

    cs.CV cs.AI

    Exploiting Redundancy: Separable Group Convolutional Networks on Lie Groups

    Authors: David M. Knigge, David W. Romero, Erik J. Bekkers

    Abstract: Group convolutional neural networks (G-CNNs) have been shown to increase parameter efficiency and model accuracy by incorporating geometric inductive biases. In this work, we investigate the properties of representations learned by regular G-CNNs, and show considerable parameter redundancy in group convolution kernels. This finding motivates further weight-tying by sharing convolution kernels over… ▽ More

    Submitted 4 April, 2022; v1 submitted 25 October, 2021; originally announced October 2021.

  31. arXiv:2110.10211  [pdf, other

    cs.CV cs.LG

    Learning Partial Equivariances from Data

    Authors: David W. Romero, Suhas Lohit

    Abstract: Group Convolutional Neural Networks (G-CNNs) constrain learned features to respect the symmetries in the selected group, and lead to better generalization when these symmetries appear in the data. If this is not the case, however, equivariance leads to overly constrained models and worse performance. Frequently, transformations occurring in data can be better represented by a subset of a group tha… ▽ More

    Submitted 14 January, 2023; v1 submitted 19 October, 2021; originally announced October 2021.

    Comments: Published at NeurIPS 2022

  32. arXiv:2110.08059  [pdf, other

    cs.CV cs.LG

    FlexConv: Continuous Kernel Convolutions with Differentiable Kernel Sizes

    Authors: David W. Romero, Robert-Jan Bruintjes, Jakub M. Tomczak, Erik J. Bekkers, Mark Hoogendoorn, Jan C. van Gemert

    Abstract: When designing Convolutional Neural Networks (CNNs), one must select the size\break of the convolutional kernels before training. Recent works show CNNs benefit from different kernel sizes at different layers, but exploring all possible combinations is unfeasible in practice. A more efficient approach is to learn the kernel size during training. However, existing works that learn the kernel size h… ▽ More

    Submitted 17 March, 2022; v1 submitted 15 October, 2021; originally announced October 2021.

    Comments: First two authors contributed equally to this work

  33. arXiv:2110.07798  [pdf, other

    cs.CY cs.DL physics.soc-ph

    Dynamics of Cross-Platform Attention to Retracted Papers

    Authors: Hao Peng, Daniel M. Romero, Emőke-Ágnes Horvát

    Abstract: Retracted papers often circulate widely on social media, digital news and other websites before their official retraction. The spread of potentially inaccurate or misleading results from retracted papers can harm the scientific community and the public. Here we quantify the amount and type of attention 3,851 retracted papers received over time in different online platforms. Comparing to a set of n… ▽ More

    Submitted 15 June, 2022; v1 submitted 14 October, 2021; originally announced October 2021.

  34. arXiv:2110.01399  [pdf, other

    cs.RO

    Aerial Base Station Placement: A Tutorial Introduction

    Authors: Pham Q. Viet, Daniel Romero

    Abstract: The deployment of Aerial Base Stations (ABSs) mounted on board Unmanned Aerial Vehicles (UAVs) is emerging as a promising technology to provide connectivity in areas where terrestrial infrastructure is insufficient or absent. This may occur for example in remote areas, large events, emergency situations, or areas affected by a natural disaster such as a wildfire or a tsunami. To successfully mater… ▽ More

    Submitted 4 March, 2022; v1 submitted 30 September, 2021; originally announced October 2021.

  35. More than Meets the Tie: Examining the Role of Interpersonal Relationships in Social Networks

    Authors: Minje Choi, Ceren Budak, Daniel M. Romero, David Jurgens

    Abstract: Topics in conversations depend in part on the type of interpersonal relationship between speakers, such as friendship, kinship, or romance. Identifying these relationships can provide a rich description of how individuals communicate and reveal how relationships influence the way people share information. Using a dataset of more than 9.6M dyads of Twitter users, we show how relationship types infl… ▽ More

    Submitted 12 May, 2021; originally announced May 2021.

    Comments: Accepted to ICWSM 2021

  36. arXiv:2102.02611  [pdf, other

    cs.LG

    CKConv: Continuous Kernel Convolution For Sequential Data

    Authors: David W. Romero, Anna Kuzina, Erik J. Bekkers, Jakub M. Tomczak, Mark Hoogendoorn

    Abstract: Conventional neural architectures for sequential data present important limitations. Recurrent networks suffer from exploding and vanishing gradients, small effective memory horizons, and must be trained sequentially. Convolutional networks are unable to handle sequences of unknown size and their memory horizon must be defined a priori. In this work, we show that all these problems can be solved b… ▽ More

    Submitted 17 March, 2022; v1 submitted 4 February, 2021; originally announced February 2021.

  37. arXiv:2010.00977  [pdf, other

    cs.CV stat.ML

    Group Equivariant Stand-Alone Self-Attention For Vision

    Authors: David W. Romero, Jean-Baptiste Cordonnier

    Abstract: We provide a general self-attention formulation to impose group equivariance to arbitrary symmetry groups. This is achieved by defining positional encodings that are invariant to the action of the group considered. Since the group acts on the positional encoding directly, group equivariant self-attention networks (GSA-Nets) are steerable by nature. Our experiments on vision benchmarks demonstrate… ▽ More

    Submitted 18 March, 2021; v1 submitted 2 October, 2020; originally announced October 2020.

    Comments: Proceedings of the 9th International Conference on Learning Representations (ICLR), 2021

    Journal ref: Proceedings of the International Conference on Learning Representations, 2021

  38. arXiv:2006.05259  [pdf, other

    cs.LG stat.ML

    Wavelet Networks: Scale-Translation Equivariant Learning From Raw Time-Series

    Authors: David W. Romero, Erik J. Bekkers, Jakub M. Tomczak, Mark Hoogendoorn

    Abstract: Leveraging the symmetries inherent to specific data domains for the construction of equivariant neural networks has lead to remarkable improvements in terms of data efficiency and generalization. However, most existing research focuses on symmetries arising from planar and volumetric data, leaving a crucial data source largely underexplored: time-series. In this work, we fill this gap by leveragin… ▽ More

    Submitted 21 January, 2024; v1 submitted 9 June, 2020; originally announced June 2020.

  39. arXiv:2002.11500  [pdf, other

    eess.SP cs.IT

    Robust Underlay Device-to-Device Communications on Multiple Channels

    Authors: Mohamed Elnourani, Siddharth Deshmukh, Baltasar Beferull-Lozano, Daniel Romero

    Abstract: Most recent works in device-to-device (D2D) underlay communications focus on the optimization of either power or channel allocation to improve the spectral efficiency, and typically consider uplink and downlink separately. Further, several of them also assume perfect knowledge of channel-stateinformation (CSI). In this paper, we formulate a joint uplink and downlink resource allocation scheme, whi… ▽ More

    Submitted 26 February, 2020; originally announced February 2020.

    Comments: 30 pages, 7 figures, 2 table. Submitted to IEEE Transactions on Wireless Communications

  40. arXiv:2002.03830  [pdf, other

    cs.CV cs.LG stat.ML

    Attentive Group Equivariant Convolutional Networks

    Authors: David W. Romero, Erik J. Bekkers, Jakub M. Tomczak, Mark Hoogendoorn

    Abstract: Although group convolutional networks are able to learn powerful representations based on symmetry patterns, they lack explicit means to learn meaningful relationships among them (e.g., relative positions and poses). In this paper, we present attentive group equivariant convolutions, a generalization of the group convolution, in which attention is applied during the course of convolution to accent… ▽ More

    Submitted 30 June, 2020; v1 submitted 7 February, 2020; originally announced February 2020.

    Comments: Proceedings of the 37th International Conference on Machine Learning (ICML), 2020

  41. arXiv:2001.08199  [pdf, other

    cs.DL cs.SI physics.soc-ph

    Neural Embeddings of Scholarly Periodicals Reveal Complex Disciplinary Organizations

    Authors: Hao Peng, Qing Ke, Ceren Budak, Daniel M. Romero, Yong-Yeol Ahn

    Abstract: Understanding the structure of knowledge domains is one of the foundational challenges in science of science. Here, we propose a neural embedding technique that leverages the information contained in the citation network to obtain continuous vector representations of scientific periodicals. We demonstrate that our periodical embeddings encode nuanced relationships between periodicals as well as th… ▽ More

    Submitted 20 February, 2021; v1 submitted 22 January, 2020; originally announced January 2020.

  42. arXiv:1911.07849  [pdf, other

    cs.CV cs.LG stat.ML

    Co-Attentive Equivariant Neural Networks: Focusing Equivariance On Transformations Co-Occurring In Data

    Authors: David W. Romero, Mark Hoogendoorn

    Abstract: Equivariance is a nice property to have as it produces much more parameter efficient neural architectures and preserves the structure of the input through the feature mapping. Even though some combinations of transformations might never appear (e.g. an upright face with a horizontal nose), current equivariant architectures consider the set of all possible transformations in a transformation group… ▽ More

    Submitted 10 February, 2020; v1 submitted 18 November, 2019; originally announced November 2019.

    Comments: Proceedings of the 8th International Conference on Learning Representations (ICLR), 2020

    Journal ref: Proceedings of the International Conference on Learning Representations, 2020

  43. arXiv:1910.05870  [pdf, other

    physics.soc-ph cs.SI

    Network Modularity Controls the Speed of Information Diffusion

    Authors: Hao Peng, Azadeh Nematzadeh, Daniel M. Romero, Emilio Ferrara

    Abstract: The rapid diffusion of information and the adoption of social behaviors are of critical importance in situations as diverse as collective actions, pandemic prevention, or advertising and marketing. Although the dynamics of large cascades have been extensively studied in various contexts, few have systematically examined the impact of network topology on the efficiency of information diffusion. Her… ▽ More

    Submitted 30 July, 2020; v1 submitted 13 October, 2019; originally announced October 2019.

  44. Are All Successful Communities Alike? Characterizing and Predicting the Success of Online Communities

    Authors: Tiago Cunha, David Jurgens, Chenhao Tan, Daniel Romero

    Abstract: The proliferation of online communities has created exciting opportunities to study the mechanisms that explain group success. While a growing body of research investigates community success through a single measure -- typically, the number of members -- we argue that there are multiple ways of measuring success. Here, we present a systematic study to understand the relations between these success… ▽ More

    Submitted 18 March, 2019; originally announced March 2019.

    Comments: To appear at The Web Conference 2019

  45. arXiv:1804.03763  [pdf, other

    cs.SI

    Network Structure, Efficiency, and Performance in WikiProjects

    Authors: Edward L. Platt, Daniel M. Romero

    Abstract: The internet has enabled collaborations at a scale never before possible, but the best practices for organizing such large collaborations are still not clear. Wikipedia is a visible and successful example of such a collaboration which might offer insight into what makes large-scale, decentralized collaborations successful. We analyze the relationship between the structural properties of WikiProjec… ▽ More

    Submitted 10 April, 2018; originally announced April 2018.

    Comments: 11 pages, 5 figures, to appear in ICWSM 2018

  46. arXiv:1711.10353  [pdf, other

    stat.ML cs.LG eess.SP

    Kernel-based Inference of Functions over Graphs

    Authors: Vassilis N. Ioannidis, Meng Ma, Athanasios N. Nikolakopoulos, Georgios B. Giannakis, Daniel Romero

    Abstract: The study of networks has witnessed an explosive growth over the past decades with several ground-breaking methods introduced. A particularly interesting -- and prevalent in several fields of study -- problem is that of inferring a function defined over the nodes of a network. This work presents a versatile kernel-based framework for tackling this inference problem that naturally subsumes and gene… ▽ More

    Submitted 10 April, 2018; v1 submitted 28 November, 2017; originally announced November 2017.

    Comments: To be published as a chapter in `Adaptive Learning Methods for Nonlinear System Modeling', Elsevier Publishing, Eds. D. Comminiello and J.C. Principe (2018). This chapter surveys recent work on kernel-based inference of functions over graphs including arXiv:1612.03615 and arXiv:1605.07174 and arXiv:1711.09306

  47. arXiv:1711.09306  [pdf, other

    cs.LG eess.SP stat.ML

    Inference of Spatio-Temporal Functions over Graphs via Multi-Kernel Kriged Kalman Filtering

    Authors: Vassilis N. Ioannidis, Daniel Romero, Georgios B. Giannakis

    Abstract: Inference of space-time varying signals on graphs emerges naturally in a plethora of network science related applications. A frequently encountered challenge pertains to reconstructing such dynamic processes, given their values over a subset of vertices and time instants. The present paper develops a graph-aware kernel-based kriged Kalman filter that accounts for the spatio-temporal variations, an… ▽ More

    Submitted 25 November, 2017; originally announced November 2017.

    Comments: Submitted to IEEE Transactions on Signal processing, Nov. 2017

  48. arXiv:1706.04546  [pdf, other

    cs.IT cs.LG stat.ML

    Reinforcement Learning with Budget-Constrained Nonparametric Function Approximation for Opportunistic Spectrum Access

    Authors: Theodoros Tsiligkaridis, David Romero

    Abstract: Opportunistic spectrum access is one of the emerging techniques for maximizing throughput in congested bands and is enabled by predicting idle slots in spectrum. We propose a kernel-based reinforcement learning approach coupled with a novel budget-constrained sparsification technique that efficiently captures the environment to find the best channel access actions. This approach allows learning an… ▽ More

    Submitted 20 June, 2018; v1 submitted 14 June, 2017; originally announced June 2017.

    Comments: 6 pages, submitted

  49. arXiv:1704.02426  [pdf, other

    cs.CR cs.NI

    Towards Attack-Tolerant Networks: Concurrent Multipath Routing and the Butterfly Network

    Authors: Edward L. Platt, Daniel M. Romero

    Abstract: Targeted attacks against network infrastructure are notoriously difficult to guard against. In the case of communication networks, such attacks can leave users vulnerable to censorship and surveillance, even when cryptography is used. Much of the existing work on network fault-tolerance focuses on random faults and does not apply to adversarial faults (attacks). Centralized networks have single po… ▽ More

    Submitted 7 April, 2017; originally announced April 2017.

  50. arXiv:1704.00412  [pdf, other

    cs.SI

    Shocking the Crowd: The Effect of Censorship Shocks on Chinese Wikipedia

    Authors: Ark Fangzhou Zhang, Danielle Livneh, Ceren Budak, Lionel P. Robert Jr., Daniel M. Romero

    Abstract: Collaborative crowdsourcing has become a popular approach to organizing work across the globe. Being global also means being vulnerable to shocks -- unforeseen events that disrupt crowds -- that originate from any country. In this study, we examine changes in collaborative behavior of editors of Chinese Wikipedia that arise due to the 2005 government censor- ship in mainland China. Using the exoge… ▽ More

    Submitted 2 April, 2017; originally announced April 2017.

    Journal ref: Proc. 11th International AAAI Conference on Web and Social Media (ICWSM), 2017