-
A Joint Approach Towards Data-Driven Virtual Testing for Automated Driving: The AVEAS Project
Authors:
Leon Eisemann,
Mirjam Fehling-Kaschek,
Silke Forkert,
Andreas Forster,
Henrik Gommel,
Susanne Guenther,
Stephan Hammer,
David Hermann,
Marvin Klemp,
Benjamin Lickert,
Florian Luettner,
Robin Moss,
Nicole Neis,
Maria Pohle,
Dominik Schreiber,
Cathrina Sowa,
Daniel Stadler,
Janina Stompe,
Michael Strobelt,
David Unger,
Jens Ziehn
Abstract:
With growing complexity and responsibility of automated driving functions in road traffic and growing scope of their operational design domains, there is increasing demand for covering significant parts of development, validation, and verification via virtual environments and simulation models.
If, however, simulations are meant not only to augment real-world experiments, but to replace them, qu…
▽ More
With growing complexity and responsibility of automated driving functions in road traffic and growing scope of their operational design domains, there is increasing demand for covering significant parts of development, validation, and verification via virtual environments and simulation models.
If, however, simulations are meant not only to augment real-world experiments, but to replace them, quantitative approaches are required that measure to what degree and under which preconditions simulation models adequately represent reality, and thus allow their usage for virtual testing of driving functions. Especially in research and development areas related to the safety impacts of the "open world", there is a significant shortage of real-world data to parametrize and/or validate simulations - especially with respect to the behavior of human traffic participants, whom automated vehicles will meet in mixed traffic.
This paper presents the intermediate results of the German AVEAS research project (www.aveas.org) which aims at developing methods and metrics for the harmonized, systematic, and scalable acquisition of real-world data for virtual verification and validation of advanced driver assistance systems and automated driving, and establishing an online database following the FAIR principles.
△ Less
Submitted 10 May, 2024;
originally announced May 2024.
-
TicTacToes: Assessing Toe Movements as an Input Modality
Authors:
Florian Müller,
Daniel Schmitt,
Andrii Matviienko,
Dominik Schön,
Sebastian Günther,
Thomas Kosch,
Martin Schmitz
Abstract:
From carrying grocery bags to holding onto handles on the bus, there are a variety of situations where one or both hands are busy, hindering the vision of ubiquitous interaction with technology. Voice commands, as a popular hands-free alternative, struggle with ambient noise and privacy issues. As an alternative approach, research explored movements of various body parts (e.g., head, arms) as inpu…
▽ More
From carrying grocery bags to holding onto handles on the bus, there are a variety of situations where one or both hands are busy, hindering the vision of ubiquitous interaction with technology. Voice commands, as a popular hands-free alternative, struggle with ambient noise and privacy issues. As an alternative approach, research explored movements of various body parts (e.g., head, arms) as input modalities, with foot-based techniques proving particularly suitable for hands-free interaction. Whereas previous research only considered the movement of the foot as a whole, in this work, we argue that our toes offer further degrees of freedom that can be leveraged for interaction. To explore the viability of toe-based interaction, we contribute the results of a controlled experiment with 18 participants assessing the impact of five factors on the accuracy, efficiency and user experience of such interfaces. Based on the findings, we provide design recommendations for future toe-based interfaces.
△ Less
Submitted 6 April, 2023; v1 submitted 28 March, 2023;
originally announced March 2023.
-
Understanding Stationary and Moving Direct Skin Vibrotactile Stimulation on the Palm
Authors:
Hesham Elsayed,
Martin Weigel,
Florian Müller,
George Ibrahim,
Jan Gugenheimer,
Martin Schmitz,
Sebastian Günther,
Max Mühlhäuser
Abstract:
Palm-based tactile displays have the potential to evolve from single motor interfaces (e.g., smartphones) to high-resolution tactile displays (e.g., back-of-device haptic interfaces) enabling richer multi-modal experiences with more information. However, we lack a systematic understanding of vibrotactile perception on the palm and the influence of various factors on the core design decisions of ta…
▽ More
Palm-based tactile displays have the potential to evolve from single motor interfaces (e.g., smartphones) to high-resolution tactile displays (e.g., back-of-device haptic interfaces) enabling richer multi-modal experiences with more information. However, we lack a systematic understanding of vibrotactile perception on the palm and the influence of various factors on the core design decisions of tactile displays (number of actuators, resolution, and intensity). In a first experiment (N=16), we investigated the effect of these factors on the users' ability to localize stationary sensations. In a second experiment (N=20), we explored the influence of resolution on recognition rate for moving tactile sensations.Findings show that for stationary sensations a 9 actuator display offers a good trade-off and a $3\times3$ resolution can be accurately localized. For moving sensations, a $2\times4$ resolution led to the highest recognition accuracy, while $5\times10$ enables higher resolution output with a reasonable accuracy.
△ Less
Submitted 17 February, 2023;
originally announced February 2023.
-
Spline parameterization of neural network controls for deep learning
Authors:
Stefanie Günther,
Will Pazner,
Dongping Qi
Abstract:
Based on the continuous interpretation of deep learning cast as an optimal control problem, this paper investigates the benefits of employing B-spline basis functions to parameterize neural network controls across the layers. Rather than equipping each layer of a discretized ODE-network with a set of trainable weights, we choose a fixed number of B-spline basis functions whose coefficients are the…
▽ More
Based on the continuous interpretation of deep learning cast as an optimal control problem, this paper investigates the benefits of employing B-spline basis functions to parameterize neural network controls across the layers. Rather than equipping each layer of a discretized ODE-network with a set of trainable weights, we choose a fixed number of B-spline basis functions whose coefficients are the trainable parameters of the neural network. Decoupling the trainable parameters from the layers of the neural network enables us to investigate and adapt the accuracy of the network propagation separated from the optimization learning problem. We numerically show that the spline-based neural network increases robustness of the learning problem towards hyperparameters due to increased stability and accuracy of the network propagation. Further, training on B-spline coefficients rather than layer weights directly enables a reduction in the number of trainable parameters.
△ Less
Submitted 27 February, 2021;
originally announced March 2021.
-
Mastering Music Instruments through Technology in Solo Learning Sessions
Authors:
Karola Marky,
Andreas Weiß,
Julien Gedeon,
Sebastian Günther
Abstract:
Mastering a musical instrument requires time-consuming practice even if students are guided by an expert. In the overwhelming majority of the time, the students practice by themselves and traditional teaching materials, such as videos or textbooks, lack interaction and guidance possibilities. Adequate feedback, however, is highly important to prevent the acquirement of wrong motions and to avoid p…
▽ More
Mastering a musical instrument requires time-consuming practice even if students are guided by an expert. In the overwhelming majority of the time, the students practice by themselves and traditional teaching materials, such as videos or textbooks, lack interaction and guidance possibilities. Adequate feedback, however, is highly important to prevent the acquirement of wrong motions and to avoid potential health problems. In this paper, we envision musical instruments as smart objects to enhance solo learning sessions. We give an overview of existing approaches and setups and discuss them. Finally, we conclude with recommendations for designing smart and augmented musical instruments for learning purposes.
△ Less
Submitted 27 December, 2020;
originally announced December 2020.
-
Multilevel Initialization for Layer-Parallel Deep Neural Network Training
Authors:
Eric C. Cyr,
Stefanie Günther,
Jacob B. Schroder
Abstract:
This paper investigates multilevel initialization strategies for training very deep neural networks with a layer-parallel multigrid solver. The scheme is based on the continuous interpretation of the training problem as a problem of optimal control, in which neural networks are represented as discretizations of time-dependent ordinary differential equations. A key goal is to develop a method able…
▽ More
This paper investigates multilevel initialization strategies for training very deep neural networks with a layer-parallel multigrid solver. The scheme is based on the continuous interpretation of the training problem as a problem of optimal control, in which neural networks are represented as discretizations of time-dependent ordinary differential equations. A key goal is to develop a method able to intelligently initialize the network parameters for the very deep networks enabled by scalable layer-parallel training. To do this, we apply a refinement strategy across the time domain, that is equivalent to refining in the layer dimension. The resulting refinements create deep networks, with good initializations for the network parameters coming from the coarser trained networks. We investigate the effectiveness of such multilevel "nested iteration" strategies for network training, showing supporting numerical evidence of reduced run time for equivalent accuracy. In addition, we study whether the initialization strategies provide a regularizing effect on the overall training process and reduce sensitivity to hyperparameters and randomness in initial network parameters.
△ Less
Submitted 18 December, 2019;
originally announced December 2019.
-
Galois Field Arithmetics for Linear Network Coding using AVX512 Instruction Set Extensions
Authors:
Stephan M. Günther,
Nicolas Appel,
Georg Carle
Abstract:
Linear network coding requires arithmetic operations over Galois fields, more specifically over finite extension fields. While coding over GF(2) reduces to simple XOR operations, this field is less preferred for practical applications of random linear network coding due to high chances of linear dependencies and therefore redundant coded packets. Coding over larger fields such as GF(16) and GF(256…
▽ More
Linear network coding requires arithmetic operations over Galois fields, more specifically over finite extension fields. While coding over GF(2) reduces to simple XOR operations, this field is less preferred for practical applications of random linear network coding due to high chances of linear dependencies and therefore redundant coded packets. Coding over larger fields such as GF(16) and GF(256) does not have that issue, but is significantly slower. SIMD vector extensions of processors such as AVX2 on x86-based systems or NEON on ARM-based devices offer the potential to increase performance by orders of magnitude.
In this paper we present an implementation of different algorithms and Galois fields based on the AVX512 instruction set extension and integrate it into the finite field library libmoepgf. We compare the performance of the new implementation to the reference implementation based on AVX2, showing a significant increase in throughput. In addition, we provide a survey of the best possible coding performance offered by a variety of different platforms.
△ Less
Submitted 4 September, 2019;
originally announced September 2019.
-
Layer-Parallel Training of Deep Residual Neural Networks
Authors:
S. Günther,
L. Ruthotto,
J. B. Schroder,
E. C. Cyr,
N. R. Gauger
Abstract:
Residual neural networks (ResNets) are a promising class of deep neural networks that have shown excellent performance for a number of learning tasks, e.g., image classification and recognition. Mathematically, ResNet architectures can be interpreted as forward Euler discretizations of a nonlinear initial value problem whose time-dependent control variables represent the weights of the neural netw…
▽ More
Residual neural networks (ResNets) are a promising class of deep neural networks that have shown excellent performance for a number of learning tasks, e.g., image classification and recognition. Mathematically, ResNet architectures can be interpreted as forward Euler discretizations of a nonlinear initial value problem whose time-dependent control variables represent the weights of the neural network. Hence, training a ResNet can be cast as an optimal control problem of the associated dynamical system. For similar time-dependent optimal control problems arising in engineering applications, parallel-in-time methods have shown notable improvements in scalability. This paper demonstrates the use of those techniques for efficient and effective training of ResNets. The proposed algorithms replace the classical (sequential) forward and backward propagation through the network layers by a parallel nonlinear multigrid iteration applied to the layer domain. This adds a new dimension of parallelism across layers that is attractive when training very deep networks. From this basic idea, we derive multiple layer-parallel methods. The most efficient version employs a simultaneous optimization approach where updates to the network parameters are based on inexact gradient information in order to speed up the training process. Using numerical examples from supervised classification, we demonstrate that the new approach achieves similar training performance to traditional methods, but enables layer-parallelism and thus provides speedup over layer-serial methods through greater concurrency.
△ Less
Submitted 25 July, 2019; v1 submitted 11 December, 2018;
originally announced December 2018.
-
The Open Energy Modelling Framework (oemof) - A new approach to facilitate open science in energy system modelling
Authors:
Simon Hilpert,
Cord Kaldemeyer,
Uwe Krien,
Stefan Günther,
Clemens Wingenbach,
Guido Plessmann
Abstract:
Energy system models have become indispensable tools for planning future energy systems by providing insights into different development trajectories. However, sustainable systems with high shares of renewable energy are characterized by growing cross-sectoral interdependencies and decentralized structures. To capture important properties of increasingly complex energy systems, sophisticated and f…
▽ More
Energy system models have become indispensable tools for planning future energy systems by providing insights into different development trajectories. However, sustainable systems with high shares of renewable energy are characterized by growing cross-sectoral interdependencies and decentralized structures. To capture important properties of increasingly complex energy systems, sophisticated and flexible modelling tools are needed. At the same time, open science is becoming increasingly important in energy system modelling. This paper presents the Open Energy Modelling Framework (oemof) as a novel approach to energy system modelling, representation and analysis. The framework provides a toolbox to construct comprehensive energy system models and has been published open source under a free licence. Through collaborative development based on open processes, the framework supports a maximum level of participation, transparency and open science principles in energy system modelling. Based on a generic graph-based description of energy systems, it is well-suited to flexibly model complex cross-sectoral systems and incorporate various modelling approaches. This makes the framework a multi-purpose modelling environment for modelling and analyzing different systems at scales ranging from urban to transnational.
△ Less
Submitted 24 August, 2018;
originally announced August 2018.
