Estimation of the mean of a stochastic variable observed in noise with positive support is considered. It is well known from the literature that order statistics gives one order of magnitude lower estimation variance compared to the best linear unbiased estimator (BLUE). We provide a systematic survey of some common distributions with positive support, and provide derivations of minimum variance unbiased estimators (MVUE) based on order statistics, including BLUE for comparison. The estimators are derived with or without knowledge of the hyperparameters of the underlying noise distribution. Though the uniform, exponential and Rayleigh distributions, respectively, we consider are standard in literature, the problem of estimating the location parameter with additive noise from these distribution seems less studied, and we have not found any explicit expressions for BLUE and MVUE for these cases. In addition to additive noise with positive support, we also consider the mixture of uniform and normal noise distribution for which an order statistics-based unbiased estimator is derived. Finally, an iterative global navigation satellite system (GNSS) localization algorithm with uncertain pseudorange measurements is proposed which relies on the derived estimators for receiver clock bias estimation. Simulation data for GNSS time estimation and experimental GNSS data for joint clock bias and position estimation are used to evaluate the performance of the proposed methods.

Background Optical coherence tomography (OCT) could be complementary to magnetic resonance imaging (MRI) of the brain in monitoring course of multiple sclerosis (MS) and clinically isolated syndrome (CIS). Thinning of neurons in ganglion cell-inner plexiform layer (GCIPL) measured by OCT is assumed to be associated with brain atrophy. Objectives To evaluate association of GCIPL with brain parameters detected by quantitative MRI (qMRI) and MR-spectroscopy (MRS) in early MS and CIS. Methods Seventeen newly diagnosed MS and 18 CIS patients were prospectively included. The patients were assessed at baseline as well as at 1 year follow-up by OCT, qMRI and MRS. Brain parenchymal and myelin volumes (BPV, MYV respectively) and the corresponding fractions (BPF, MYF) were measured with qMRI. Metabolites including myo-inositol (myo-Ins) were measured in the normal-appearing white matter (NAWM) using MRS. T-tests and ANOVA were used to analyze group differences, and linear regression models to evaluate association of GCIPL with BPV, MYV and myo-Ins after correlation analysis. Results Disease activity reflected by lesions on MRI and presence of CSF oligoclonal IgG bands were more prominent in MS compared to CIS. GCIPL, BPV, MYV, BPF and MYF were reduced, while concentration of myo-Ins was increased in MS compared to CIS. Follow-up showed consistency of thinner GCIPL in MS compared to CIS. GCIPL thinning correlated with reduced BPV and MYV (P < .05 for both), but with increased myo-Ins (P < .01). Conclusions Significant GCIPL thinning occurs in early MS and is associated with enhanced brain inflammation and atrophy.

The constrained consensus problem considered in this paper, denoted interval consensus, is characterized by the fact that each agent can impose a lower and upper bound on the achievable consensus value. Such constraints can be encoded in the consensus dynamics by saturating the values that an agent transmits to its neighboring nodes. We show in the paper that when the intersection of the intervals imposed by the agents is nonempty, the resulting constrained consensus problem must converge to a common value inside that intersection. In our algorithm, convergence happens in a fully distributed manner, and without need of sharing any information on the individual constraining intervals. When the intersection of the intervals is an empty set, the intrinsic nonlinearity of the network dynamics raises new challenges in understanding the node state evolution. Using Brouwer fixed-point theorem we prove that in that case there exists at least one equilibrium, and in fact the possible equilibria are locally stable if the constraints are satisfied or dissatisfied at the same time among all nodes. For graphs with sufficient sparsity it is further proven that there is a unique equilibrium that is globally attractive if the constraint intervals are pairwise disjoint.

We propose a Bayesian framework for the received-signal-strength-based cooperative localization problem with unknown path loss exponent. Our purpose is to infer the marginal posterior of each unknown parameter: the position or the path loss exponent. This probabilistic inference problem is solved using message passing algorithms that update messages and beliefs iteratively. For numerical tractability, we combine the variable discretization and Monte-Carlo-based numerical approximation schemes. To further improve computational efficiency, we develop an auxiliary importance sampler that updates the beliefs with the help of an auxiliary variable. An important ingredient of the proposed auxiliary importance sampler is the ability to sample from a normalized likelihood function. To this end, we develop a stochastic sampling strategy that mathematically interprets and corrects an existing heuristic strategy. The proposed message passing algorithms are analyzed systematically in terms of computational complexity, demonstrating the computational efficiency of the proposed auxiliary importance sampler. Various simulations are conducted to validate the overall good performance of the proposed algorithms.

An Informed Path Planning algorithm for multiple agents is presented. It can be used to efficiently utilize available agents when surveying large areas, when total coverage is unattainable. Internally the algorithm has a Probability Hypothesis Density (PHD) representation, inspired by modern multi-target tracking methods, to represent unseen objects. Using the PHD, the expected number of observed objects is optimized. In a sequential manner, each agent maximizes the number of observed new targets, taking into account the probability of undetected objects due to previous agents actions and the probability of detection, which yields a scalable algorithm. Algorithm properties are evaluated in simulations, and shown to outperform a greedy base line method. The algorithm is also evaluated by applying it to a sea ice tracking problem, using two datasets collected in the Arctic, with reasonable results. An implementation is provided under an Open Source license.

System identification is a mature research area with well established paradigms, mostly based on classical statistical methods. Recently, there has been considerable interest in so called kernel-based regularisation methods applied to system identification problem. The recent literature on this is extensive and at times difficult to digest. The purpose of this contribution is to provide an accessible account of the main ideas and results of kernel-based regularisation methods for system identification. The focus is to assess the impact of these new techniques on the field and traditional paradigms.

People with hearing impairment typically have difficulties following conversations in multi-talker situations. Previous studies have shown that utilizing eye gaze to steer audio through beamformers could be a solution for those situations. Recent studies have shown that in-ear electrodes that capture electrooculography in the ear (EarEOG) can estimate the eye-gaze relative to the head, when the head was fixed. The head movement can be estimated using motion sensors around the ear to create an estimate of the absolute eye-gaze in the room. In this study, an experiment was designed to mimic a multi-talker situation in order to study and model the EarEOG signal when participants attempted to follow a conversation. Eleven hearing impaired participants were presented speech from the DAT speech corpus (Bo Nielsen et al., 2014), with three targets positioned at -30 degrees, 0 degrees and +30 degrees azimuth. The experiment was run in two setups: one where the participants had their head fixed in a chinrest, and the other where they were free to move their head. The participants task was to focus their visual attention on an LED-indicated target that changed regularly. A model was developed for the relative eye-gaze estimation, taking saccades, fixations, head movement and drift from the electrode-skin half-cell into account. This model explained 90.5% of the variance of the EarEOG when the head was fixed, and 82.6% when the head was free. The absolute eye-gaze was also estimated utilizing that model. When the head was fixed, the estimation of the absolute eye-gaze was reliable. However, due to hardware issues, the estimation of the absolute eye-gaze when the head was free had a variance that was too large to reliably estimate the attended target. Overall, this study demonstrated the potential of estimating absolute eye-gaze using EarEOG and motion sensors around the ear.

In this paper, we introduce an optimal average cost learning framework to solve output regulation problem for linear systems with unknown dynamics. Our optimal framework aims to design the controller to achieve output tracking and disturbance rejection while minimizing the average cost. We derive the Hamilton-Jacobi-Bellman (HJB) equation for the optimal average cost problem and develop a reinforcement algorithm to solve it. Our proposed algorithm is an off-policy routine which learns the optimal average cost solution completely model-free. We rigorously analyze the convergence of the proposed algorithm. Compared to previous approaches for optimal tracking controller design, we elevate the need for judicious selection of the discounting factor and the proposed algorithm can be implemented completely model-free. We support our theoretical results with a simulation example. (C) 2019 Elsevier Ltd. All rights reserved.

This letter deals with the issue of obtaining consistent parameter estimators in nonlinear regression models where the regressors are second-order modulus functions, which is a structure that is often used in models of marine vessels. It is shown that the accuracy of an instrumental variable estimator can be improved by conducting experiments where the input signal has a static offset of sufficient amplitude and the instruments are forced to have zero mean. The proposed method is then evaluated in a simulation example.

System Identification is about estimating models of dynamical systems from measured input-output data. Its traditional foundation is basic statistical techniques, such as maximum likelihood estimation and asymptotic analysis of bias and variance and the like. Maximum likelihood estimation relies on minimization of criterion functions that typically are non-convex, and may cause numerical search problems and estimates trapped in local minima. Recent interest in identification algorithms has focused on techniques that are centered around convex formulations. This is partly the result of developments in semidefinite programming, machine learning and statistical learning theory. The development concerns issues of regular-ization for sparsity and for better tuned bias/variance trade-offs. It also involves the use of subspace methods as well as nuclear norms as proxies to rank constraints. A special approach is to look for difference-of-convex programming (DCP) formulations, in case a pure convex criterion is not found. Other techniques are based on Lagrangian relaxation and contraction theory. A quite different route to convexity is to use algebraic techniques to manipulate the model parameterizations. This article will illustrate all this recent development.

The problem of estimating continuous-time model parameters of linear dynamical systems using sampled time-domain input and output data has received considerable attention over the past decades and has been approached by various methods. The research topic also bears practical importance due to both its close relation to first principles modelling and equally to linear model-based control design techniques, most of them carried in continuous time. Nonetheless, as the performance of the existing algorithms for continuous-time model identification has seldom been assessed and, as thus far, it has not been considered in a comprehensive study, this practical potential of existing methods remains highly questionable. The goal of this brief paper is to bring forward a first study on this issue and to factually highlight the main aspects of interest. As such, an analysis is performed on a benchmark designed to be consistent both from a system identification viewpoint and from a control-theoretic one. It is concluded that robust initialization aspects require further research focus towards reliable algorithm development. (C) 2019 Elsevier Ltd. All rights reserved.

Model predictive control (MPC) is one of the most widely spread advanced control schemes in industry today. In MPC, a constrained finite-time optimal control (CFTOC) problem is solved at each iteration in the control loop. The CFTOC problem can be solved using, for example, second-order methods, such as interior-point or active-set methods, where the computationally most demanding part often consists of computing the sequence of second-order search directions. Each search direction can be computed by solving a set of linear equations that corresponds to solving an unconstrained finite-time optimal control (UFTOC) problem. In this paper, different direct (noniterative) parallel algorithms for solving UFTOC problems are presented. The parallel algorithms are all based on a recursive variable elimination and solution propagation technique. Numerical evaluations of one of the parallel algorithms indicate that a significant boost in performance can be obtained, which can facilitate high-performance second-order MPC solvers.

Some controllability aspects for iterative learning control (ILC) are discussed. Via a batch (lifted) description of the problem a state space model of the system to be controlled is formulated in the iteration domain. This model provides insight and enables analysis of the conditions for and relationships between controllability, output controllability and target path controllability. In addition, the property miminum lead target path controllability is introduced. This property, which is connected to the number of time delays, plays an important role in the design of ILC algorithms. The properties are illustrated by a numerical example.

To optimally compensate for time-varying phase aberrations with adaptive optics, a model of the dynamics of the aberrations is required to predict the phase aberration at the next time step. We model the time-varying behavior of a phase aberration, expressed in Zernike modes, by assuming that the temporal dynamics of the Zernike coefficients can be described by a vector-valued autoregressive (VAR) model. We propose an iterative method based on a convex heuristic for a rank-constrained optimization problem, to jointly estimate the parameters of the VAR model and the Zernike coefficients from a time series of measurements of the point-spread function (PSF) of the optical system. By assuming the phase aberration is small, the relation between aberration and PSF measurements can be approximated by a quadratic function. As such, our method is a blind identification method for linear dynamics in a stochastic Wiener system with a quadratic nonlinearity at the output and a phase retrieval method that uses a time-evolution-model constraint and a single image at every time step. (c) 2019 Optical Society of America.

In this paper, a robotic arm moving along a user-defined trajectory is used to calibrate a short-range magnetic positioning system (MPS). Such system estimates the position and attitude of an active transmitting coil by measuring the induced voltage on a set of fixed receiving coils, with known position and orientation. This estimate is obtained by solving an optimization problem that can be decomposed into a linear and a reduced nonlinear problem. Then, a Kalman Filter is used to process the estimated positions and obtain smooth trajectories. Data acquisition and processing are performed in real time by the MPS. In this context, the robotic arm is used to provide ground truth, i.e., to move the active coil along a known trajectory, while simultaneously the MPS estimates the position of the active coil. Such ground-truth information is then used to calibrate the MPS and improve its accuracy. To align the robotic arm with the MPS, a preliminary calibration procedure of the robot is performed. Then, a wide ground-truth trajectory is used to estimate the calibration parameters of the MPS itself, namely, the positions and orientation of the fixed coils. To validate the efficiency of the calibration procedure, the accuracy of the MPS is evaluated across several trajectories. The results show that the mean positioning error is less than 3 mm. Finally, an on-the-fly calibration method simultaneously estimating positions and attitudes of both the active coil and all the receivers is investigated.

Auditory attention identification methods attempt to identify the sound source of a listeners interest by analyzing measurements of electrophysiological data. We present a tutorial on the numerous techniques that have been developed in recent decades, and we present an overview of current trends in multivariate correlation-based and model-based learning frameworks. The focus is on the use of linear relations between electrophysiological and audio data. The way in which these relations are computed differs. For example, canonical correlation analysis (CCA) finds a linear subset of electrophysiological data that best correlates to audio data and a similar subset of audio data that best correlates to electrophysiological data. Model-based (encoding and decoding) approaches focus on either of these two sets. We investigate the similarities and differences between these linear model philosophies. We focus on (1) correlation-based approaches (CCA), (2) encoding/decoding models based on dense estimation, and (3) (adaptive) encoding/decoding models based on sparse estimation. The specific focus is on sparsity-driven adaptive encoding models and comparing the methodology in state-of-the-art models found in the auditory literature. Furthermore, we outline the main signal processing pipeline for how to identify the attended sound source in a cocktail party environment from the raw electrophysiological data with all the necessary steps, complemented with the necessary MATLAB code and the relevant references for each step. Our main aim is to compare the methodology of the available methods, and provide numerical illustrations to some of them to get a feeling for their potential. A thorough performance comparison is outside the scope of this tutorial.

Complex eukaryotic promoters normally contain multiple cis-regulatory sequences for different transcription factors (TFs). The binding patterns of the TFs to these sites, as well as the way the TFs interact with each other and with the RNA polymerase (RNAp), lead to combinatorial problems rarely understood in detail, especially under varying epigenetic conditions. The aim of this paper is to build a model describing how the main regulatory cluster of the olfactory receptor Or59b drives transcription of this gene in Drosophila. The cluster-driven expression of this gene is represented as the equilibrium probability of RNAp being bound to the promoter region, using a statistical thermodynamic approach. The RNAp equilibrium probability is computed in terms of the occupancy probabilities of the single TFs of the cluster to the corresponding binding sites, and of the interaction rules among TFs and RNAp, using experimental data of Or59b expression to tune the model parameters. The model reproduces correctly the changes in RNAp binding probability induced by various mutation of specific sites and epigenetic modifications. Some of its predictions have also been validated in novel experiments.

Recently, the measurement of the pupil dilation response has been applied in many studies to assess listening effort. Meanwhile, the mechanisms underlying this response are still largely unknown. We present the results of a method that separates the influence of the parasympathetic and sympathetic branches of the autonomic nervous system on the pupil response during speech perception. This is achieved by changing the background illumination level. In darkness, the influence of the parasympathetic nervous system on the pupil response is minimal, whereas in light, there is an additional component from the parasympathetic nervous system. Nineteen hearing-impaired and 27 age-matched normal-hearing listeners performed speech reception threshold tests targeting a 50% correct performance level while pupil responses were recorded. The target speech was masked with a competing talker. The test was conducted twice, once in dark and once in a light condition. Need for Recovery and Checklist Individual Strength questionnaires were acquired as indices of daily-life fatigue. In dark, the peak pupil dilation (PPD) did not differ between the two groups, but in light, the normal-hearing group showed a larger PPD than the hearing-impaired group. Listeners with better hearing acuity showed larger differences in dilation between dark and light. These results indicate a larger effect of parasympathetic inhibition on the pupil dilation response of listeners with better hearing acuity, and a relatively high parasympathetic activity in those with worse hearing. Previously observed differences in PPD between normal and impaired listeners are probably not solely because of differences in listening effort.

Electrophysiological feedback on activity in the auditory pathway may potentially advance the next generation of hearing aids. Conventional electroencephalographic (EEG) systems are, however, impractical during daily life and incompatible with hearing aids. Ear-EEG is a method in which the EEG is recorded from electrodes embedded in a hearing aid like earpiece. The method therefore provides an unobtrusive way of measuring neural activity suitable for use in everyday life. This study aimed to determine whether ear-EEG could be used to estimate hearing thresholds in subjects with sensorineural hearing loss. Specifically, ear-EEG was used to determine physiological thresholds at 0.5, 1, 2, and 4 kHz using auditory steady-state response measurements. To evaluate ear-EEG in relation to current methods, thresholds were estimated from a concurrently recorded conventional scalp EEG. The threshold detection rate for ear-EEG was 20% lower than the detection rate for scalp EEG. Thresholds estimated using in-ear referenced ear-EEG were found to be elevated at an average of 5.9, 2.3, 5.6, and 1.5 dB relative to scalp thresholds at 0.5, 1, 2, and 4 kHz, respectively. No differences were found in the variance of means between in-ear ear-EEG and scalp EEG. In-ear ear-EEG, auditory steady-state response thresholds were found at 12.1 to 14.4 dB sensation level with an intersubject variation comparable to that of behavioral thresholds. Collectively, it is concluded that although further refinement of the method is needed to optimize the threshold detection rate, ear-EEG is a feasible method for hearing threshold level estimation in subjects with sensorineural hearing impairment.

Input design is an important issue for classical system identification methods but has not been investigated for the kernel-based regularization method (KRM) until very recently. In this paper, we consider the input design problem of KRMs for LTI system identification. Different from the recent result, we adopt a Bayesian perspective and in particular make use of scalar measures (e.g., the A-optimality, D-optimality, and E-optimality) of the Bayesian mean square error matrix as the design criteria subject to power-constraint on the input. Instead of solving the optimization problem directly, we propose a two-step procedure. In the first step, by making suitable assumptions on the unknown input, we construct a quadratic map (transformation) of the input such that the transformed input design problems are convex, and the global minima of the transformed input design problem can thus be found efficiently by applying well-developed convex optimization software packages. In the second step, we derive the characterization of the optimal input based on the global minima found in the first step by solving the inverse image of the quadratic map. In addition, we derive analytic results for some special types of kernels, which provide insights on the input design and also its dependence on the kernel structure. (C) 2018 Elsevier Ltd. All rights reserved.

In this paper. we develop new methods to automatically detect the onset and duration of freezing of gait (FOG) in people with Parkinson disease (PD) in real time, using inertial sensors. We first build a physical model that describes the trembling motion during the FOG events. Then, we design a generalized likelihood ratio test framework to develop a two-stage detector for determining the zero-velocity and trembling events during gait. Thereafter, to filter out falsely detected FOG events, we develop a point-process filter that combines the output of the detectors with information about the speed of the foot, provided by a foot-mounted inertial navigation system. We computed the probability of FOG by using the point-process filter to determine the onset and duration of the FOG event. Finally, we validate the performance of the proposed system design using real data obtained from people with PD who performed a set of gait tasks. We compare our FOG detection results with an existing method that only uses accelerometer data. The results indicate that our method yields 81.03% accuracy in detecting FOG events and a threefold decrease in the false-alarm rate relative to the existing method.

This work investigates the energy consumption of industrial robots in the context of automotive industry. The purpose is to identify the most influencing parameters and variables and to propose best practices with focus on energy efficiency. The analysis approach is composed of three experiments performed in a simulation environment that test different values of programming parameters and variables, such as joint speed, acceleration, robot payload. The first experiment focuses on energy consumption of robots at standstill. The second one considers the robot moving along different paths. Finally, the third one analyses how the joint friction is affected by load, speed and temperature and how it influences the energy consumption. Results show that at standstill, it is important to reduce dwell time, select an energy efficient position and reduce the programmed value of the timer responsible for turning off the servomotors. While moving, it is important to select maximum continuous termination for intermediate points and avoid low speeds. Regarding friction variation, results show that at high motor speed, low temperatures increase energy consumption. In order to evaluate the contribution of the best practices in a real environment, they are applied to a welding robotic cell of an automotive industry.

Model predictive control (MPC) represents nowadays one of the main methods employed for process control in industry. Its strong suits comprise a simple algorithm based on a straightforward formulation and the flexibility to deal with constraints. On the other hand, it can be questioned its robustness regarding model uncertainties and external noises. Thus, a lot of efforts have been spent in the past years into the search of methods to address these shortcomings. In this study, the authors propose a robust MPC controller which stems from the idea of adding robustness in the prediction phase of the algorithm while leaving the core of MPC untouched. More precisely, they consider a robust Kalman filter that has been recently introduced and they further extend its usability to feedback control systems. Overall the proposed control algorithm allows to maintain all of the advantages of MPC with an additional improvement in performance and without any drawbacks in terms of computational complexity. To test the actual reliability of the algorithm, they apply it to control a servomechanism system characterised by non-linear dynamics.

The aim of this paper is to modify continuous-time bounded confidence opinion dynamics models so that "changes of opinion" (intended as changes of the sign of the initial states) are never induced during the evolution. Such sign invariance can be achieved by letting opinions of different sign localized near the origin interact negatively, or neglect each other, or even repel each other. In all cases, it is possible to obtain sign-preserving bounded confidence models with state-dependent connectivity and with a clustering behavior similar to that of a standard bounded confidence model. (C) 2018 Elsevier Ltd. All rights reserved.

Sleep scoring is used as a diagnostic technique in the diagnosis and treatment of sleep disorders. Automated sleep scoring is crucial, since the large volume of data should be analyzed visually by the sleep specialists which is burdensome, time-consuming tedious, subjective, and error prone. Therefore, automated sleep stage classification is a crucial step in sleep research and sleep disorder diagnosis. In this paper, a robust system, consisting of three modules, is proposed for automated classification of sleep stages from the single-channel electroencephalogram (EEG). In the first module, signals taken from Pz-Oz electrode were denoised using multiscale principal component analysis. In the second module, the most informative features are extracted using discrete wavelet transform (DWT), and then, statistical values of DWT subbands are calculated. In the third module, extracted features were fed into an ensemble classifier, which can be called as rotational support vector machine (RotSVM). The proposed classifier combines advantages of the principal component analysis and SVM to improve classification performances of the traditional SVM. The sensitivity and accuracy values across all subjects were 84.46% and 91.1%, respectively, for the five-stage sleep classification with Cohens kappa coefficient of 0.88. Obtained classification performance results indicate that, it is possible to have an efficient sleep monitoring system with a single-channel EEG, and can be used effectively in medical and home-care applications.

Distributed algorithms for solving coupled semidefinite programs commonly require many iterations to converge. They also put high computational demand on the computational agents. In this paper, we show that in case the coupled problem has an inherent tree structure, it is possible to devise an efficient distributed algorithm for solving such problems. The proposed algorithm relies on predictor- corrector primal-dual interior-point methods, where we use a message-passing algorithm to compute the search directions distributedly. Message passing here is closely related to dynamic programming over trees. This allows us to compute the exact search directions in a finite number of steps. This is because computing the search directions requires a recursion over the tree structure and, hence, terminates after an upward and downward pass through the tree. Furthermore, this number can be computed a priori and only depends on the coupling structure of the problem. We use the proposed algorithm for analyzing robustness of large-scale uncertain systems distributedly. We test the performance of this algorithm using numerical examples.

The commercial interest in proximity services is increasing. Application examples include location-based information and advertisements, logistics, social networking, file sharing, etc. In this paper, we consider positioning of devices based on a time series of proximity reports from a mobile device to a network node. This corresponds to nonlinear measurements with respect to the device position in relation to the network nodes. Motion model will be needed together with the measurements to determine the position of the device. Therefore, sequential Monte Carlo methods, namely particle filtering and smoothing, are applicable for positioning. Positioning performance is evaluated in a typical office area with Bluetooth-low-energy beacons deployed for proximity detection and report, and is further compared to parametric Cramér-Rao lower bounds. Finally, the position accuracy is also evaluated with real experimental data.

Identification of structured state-space (gray-box) model is popular for modeling physical and network systems. Due to the non-convex nature of the gray-box identification problem, good initial parameter estimates are crucial for successful applications. In this paper, the non-convex gray-box identification problem is reformulated as a structured low-rank matrix factorization problem by exploiting the rank and structured properties of a block Hankel matrix constructed by the system impulse response. To address the low-rank optimization problem, it is first transformed into a difference-of-convex (DC) formulation and then solved using the sequentially convex relaxation method. Compared with the classical gray-box identification methods like the prediction-error method (PEM), the new approach turns out to be more robust against converging to non-global minima, as supported by a simulation study. The developed identification can either be directly used for gray-box identification or provide an initial parameter estimate for the PEM. (C) 2018 Elsevier Ltd. All rights reserved.

The aim of this paper is to shed light on the problem of controlling a complex network with minimal control energy. We show first that the control energy depends on the time constant of the modes of the network, and that the closer the eigenvalues are to the imaginary axis of the complex plane, the less energy is required for complete controllability. In the limit case of networks having all purely imaginary eigenvalues (e.g. networks of coupled harmonic oscillators), several constructive algorithms for minimum control energy driver node selection are developed. A general heuristic principle valid for any directed network is also proposed: the overall cost of controlling a network is reduced when the controls are concentrated on the nodes with highest ratio of weighted outdegree vs indegree.

In Model Predictive Control (MPC), the control input is computed by solving a constrained finite-time optimal control (CFTOC) problem at each sample in the control loop. The main computational effort when solving the CFTOC problem using an active-set (AS) method is often spent on computing the search directions, which in MPC corresponds to solving unconstrained finite-time optimal control (UFTOC) problems. This is commonly performed using Riccati recursions or generic sparsity exploiting algorithms. In this work the focus is efficient search direction computations for AS type methods. The system of equations to be solved at each AS iteration is changed only by a low-rank modification of the previous one, and exploiting this structured change is important for the performance of AS type solvers. In this paper, theory for how to exploit these low-rank changes by modifying the Riccati factorization between AS iterations in a structured way is presented. A numerical evaluation of the proposed algorithm shows that the computation time can be significantly reduced by modifying, instead of re-computing, the Riccati factorization. This speed-up can be important for AS type solvers used for linear, nonlinear and hybrid MPC.

Merge scenarios confront drivers with some of the most complicated driving maneuvers in every day driving, requiring anticipatory reasoning of positions of other vehicles, and the own vehicles future trajectory. In congested traffic it might be impossible to merge without cooperation of up-stream vehicles, therefore, it is essential to gauge the effect of our own trajectory when planning a merge maneuver. For an autonomous vehicle to perform a merge maneuver in congested traffic similar capabilities are required. This includes a model describing the future evolution of the scene that allows for optimizing the autonomous vehicle's planned trajectory with respect to risk, comfort, and dynamical limitations. We present a probabilistic model that explicitly models interaction between vehicles and allows for evaluating the utility of a large number of candidate trajectories of an autonomous vehicle using a receding horizon approach in order to select an appropriate merge maneuver. The model is an extension of the intelligent driver model and the modeled behavior of other vehicles are adjusted using on-line model parameter estimation in order to give better predictions. The prediction model is evaluated using naturalistic traffic data and the merge maneuver planner is evaluated in simulation.

State-space smoothing has found many applications in science and engineering. Under linear and Gaussian assumptions, smoothed estimates can be obtained using efficient recursions, for example Rauch Tung Striebel and Mayne Fraser algorithms. Such schemes are equivalent to linear algebraic techniques that minimize a convex quadratic objective function with structure induced by the dynamic model. These classical formulations fall short in many important circumstances. For instance, smoothers obtained using quadratic penalties can fail when outliers are present in the data, and cannot track impulsive inputs and abrupt state changes. Motivated by these shortcomings, generalized Kalman smoothing formulations have been proposed in the last few years, replacing quadratic models with more suitable, often nonsmooth, convex functions. In contrast to classical models, these general estimators require use of iterated algorithms, and these have received increased attention from control, signal processing, machine learning, and optimization communities. In this survey we show that the optimization viewpoint provides the control and signal processing community great freedom in the development of novel modeling and inference frameworks for dynamical systems. We discuss general statistical models for dynamic systems, making full use of nonsmooth convex penalties and constraints, and providing links to important models in signal processing and machine learning. We also survey optimization techniques for these formulations, paying close attention to dynamic problem structure. Modeling concepts and algorithms are illustrated with numerical examples. (C) 2017 Elsevier Ltd. All rights reserved.

Predicting the sign of press perturbation responses in ecological networks is challenging, due to the poor knowledge of the strength of the direct interactions among the species, and to the entangled coexistence of direct and indirect effects. We show in this paper that, for a class of networks that includes mutualistic and monotone networks, the sign of press perturbation responses can be qualitatively determined based only on the sign pattern of the community matrix, without any knowledge of parameter values. For other classes of networks, we show that a semi-qualitative approach yields sufficient conditions for community matrices with a given sign pattern to exhibit mutualistic responses to press perturbations; quantitative conditions can be provided as well for community matrices that are eventually nonnegative. We also present a computational test that can be applied to any class of networks so as to check whether the sign of the responses to press perturbations is constant in spite of parameter variations.

n/a

In this paper, we study the problem of controlling complex networks with unilateral controls, i.e., controls which can assume only positive or negative values, not both. Given a complex network represented by the adjacency matrix A, an algorithm is developed that constructs an input matrix B such that the resulting system (A, B) is controllable with a near minimal number of unilateral control inputs. This is made possible by a reformulation of classical conditions for controllability that casts the minimal unilateral input selection problem into well known optimization problems. We identify network properties that make unilateral controllability relatively easy to achieve as compared to unrestricted controllability. The analysis of the network topology for instance allows us to establish theoretical bounds on the minimal number of controls required. For various categories of random networks as well as for a number of real-world networks these lower bounds are often achieved by our heuristics.

We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured decomposition of the model of interest, turning the overall inferential task into a collection of recursively solved subproblems. The proposed method is applicable to a broad class of probabilistic graphical models, including models with loops. Unlike a standard SMC sampler, the proposed divide-and-conquer SMC employs multiple independent populations of weighted particles, which are resampled, merged, and propagated as the method progresses. We illustrate empirically that this approach can outperform standard methods in terms of the accuracy of the posterior expectation and marginal likelihood approximations. Divide-and-conquer SMC also opens up novel parallel implementation options and the possibility of concentrating the computational effort on the most challenging subproblems. We demonstrate its performance on a Markov random field and on a hierarchical logistic regression problem. Supplementary materials including proofs and additional numerical results are available online.

A platform for sensor fusion consisting of a standard smartphone equipped with the specially developed Sensor Fusion appis presented. The platform enables real-time streaming of data over WiFi to a computer where signal processingalgorithms, e.g., the Kalman filter, can be developed and executed in a Matlab framework. The platform is an excellenttool for educational purposes and enables learning activities where methods based on advanced theory can be implementedand evaluated at low cost. The article describes the app and a laboratory exercise developed around these new technologicalpossibilities. The laboratory session is part of a course in sensor fusion, a signal processing continuation course focused onmultiple sensor signal applications, where the goal is to give the students hands on experience of the subject. This is done byestimating the orientation of the smartphone, which can be easily visualized and also compared to the built-in filters in thesmartphone. The filter can accept any combination of sensor data from accelerometers, gyroscopes, and magnetometers toexemplify their importance. This way different tunings and tricks of important methods are easily demonstrated andevaluated on-line. The presented framework facilitates this in a way previously impossible.

Bayesian nonparametric approaches have been recently introduced in system identification scenario where the impulse response is modeled as the realization of a zero-mean Gaussian process whose covariance (kernel) has to be estimated from data. In this scheme, quality of the estimates crucially depends on the parametrization of the covariance of the Gaussian process. A family of kernels that have been shown to be particularly effective in the system identification framework is the family of Diagonal/Correlated (DC) kernels. Maximum entropy properties of a related family of kernels, the Tuned/Correlated (TC) kernels, have been recently pointed out in the literature. In this technical note, we show that maximum entropy properties indeed extend to the whole family of DC kernels. The maximum entropy interpretation can be exploited in conjunction with results on matrix completion problems in the graphical models literature to shed light on the structure of the DC kernel. In particular, we prove that the DC kernel admits a closed-form factorization, inverse, and determinant. These results can be exploited both to improve the numerical stability and to reduce the computational complexity associated with the computation of the DC estimator.

In this paper the main goal is to compare the instrumental variables and the least squares methods applied to parameter estimation in continuous-time systems, avoiding any preliminary discretization of the process, and to analyse which method is more suitable for estimation in continuous-time under stochastic perturbations. A numerical example illustrates the effectiveness of the algorithms.

n/a

The general Simultaneous Localisation and Mapping (SLAM) problem aims at estimating the state of a moving platform simultaneously with building a map of the local environment. There are essentially three classes of algorithms. EKF- SLAM and FastSLAM solve the problem on-line, while Nonlinear Least Squares (NLS) is a batch method. All of them scales badly with either the state dimension, the map dimension or the batch length. We investigate the EM algorithm for solving a generalized version of the NLS problem. This EM-SLAM algorithm solves two simpler problems iteratively, hence it scales much better with dimensions. The iterations switch between state estimation, where we propose an Extended Rauch-Tung-Striebel smoother, and map estimation, where a quasi-Newton method is suggested. The proposed method is evaluated in real experiments and also in simulations on a platform with a monocular camera attached to an inertial measurement unit. It is demonstrated to produce lower RMSE than with a standard Levenberg-Marquardt solver of NLS problem, at a computational cost that increases considerably slower. 

This paper reviews the vast literature on static output feedback design for linear time-invariant systems including classical results and recent developments. In particular, we focus on static output feedback synthesis with performance specifications, structured static output feedback, and robustness. The paper provides a comprehensive review on existing design approaches including iterative linear matrix inequalities heuristics, linear matrix inequalities with rank constraints, methods with decoupled Lyapunov matrices, and non-Lyapunov-based approaches. We describe the main difficulties of dealing with static output feedback design and summarize the main features, advantages, and limitations of existing design methods. (C) 2016 International Federation of Automatic Control. Published by Elsevier Ltd. All rights reserved.

Todays 4G LTE systems bring unprecedented mobile broadband performance to over a billion of users across the globe. Recently, work on a 5G mobile communication system has begun, and next to a new 5G air interface, LTE will be an essential component. The evolution of LTE will therefore strive to meet 5G requirements and to address 5G use cases. In this article, we provide an overview of foreseen key technology areas and components for LTE Release 14, including latency reductions, enhancements for machine-type communication, operation in unlicensed spectrum, massive multi-antenna systems, broadcasting, positioning, and support for intelligent transportation systems.

The identification of multivariable state space models in innovation form is solved in a subspace identification framework using convex nuclear norm optimization. The convex optimization approach allows to include constraints on the unknown matrices in the data-equation characterizing subspace identification methods, such as the lower triangular block-Toeplitz of weighting matrices constructed from the Markov parameters of the unknown observer. The classical use of instrumental variables to remove the influence of the innovation term on the data equation in subspace identification is avoided. The avoidance of the instrumental variable projection step has the potential to improve the accuracy of the estimated model predictions, especially for short data length sequences. (C) 2016 Elsevier Ltd. All rights reserved.

This paper presents a data-driven receding horizon fault estimation method for additive actuator and sensor faults in unknown linear time-invariant systems, with enhanced robustness to stochastic identification errors. State-of-the-art methods construct fault estimators with identified state-space models or Markov parameters, without compensating for identification errors. Motivated by this limitation, we first propose a receding horizon fault estimator parameterized by predictor Markov parameters. This estimator provides (asymptotically) unbiased fault estimates as long as the subsystem from faults to outputs has no unstable transmission zeros. When the identified Markov parameters are used to construct the above fault estimator, stochastic identification errors appear as model uncertainty multiplied with unknown fault signals and online system inputs/outputs (I/O). Based on this fault estimation error analysis, we formulate a mixed-norm problem for the offline robust design that regards online I/O data as unknown. An alternative online mixed-norm problem is also proposed that can further reduce estimation errors at the cost of increased computational burden. Based on a geometrical interpretation of the two proposed mixed-norm problems, systematic methods to tune the user-defined parameters therein are given to achieve desired performance trade-offs. Simulation examples illustrate the benefits of our proposed methods compared to recent literature. (C) 2016 Elsevier Ltd. All rights reserved.

Nonlinear Kalman filters are algorithms that approximately solve the Bayesian filtering problem by employing the measurement update of the linear Kalman filter (KF). Numerous variants have been developed over the past decades, perhaps most importantly the popular sampling based sigma point Kalman filters.In order to make the vast literature accessible, we present nonlinear KF variants in a common framework that highlights the computation of mean values and covariance matrices as the main challenge. The way in which these moment integrals are approximated distinguishes, for example, the unscented KF from the divided difference KF.With the KF framework in mind, a moment computation problem is defined and analyzed. It is shown how structural properties can be exploited to simplify its solution. Established moment computation methods, and their basics and extensions, are discussed in an extensive survey. The focus is on the sampling based rules that are used in sigma point KF. More specifically, we present three categories of methods that use sigma-points 1) to represent a distribution (as in the UKF); 2) for numerical integration (as in Gauss-Hermite quadrature); 3) to approximate nonlinear functions (as in interpolation). Prospective benefits and downsides are listed for each of the categories and methods, including accuracy statements. Furthermore, the related KF publications are listed.The theoretical discussion is complemented with a comparative simulation study on instructive examples.

In this study, Random Forests (RF) classifier is proposed for ECG heartbeat signal classification in diagnosis of heart arrhythmia. Discrete wavelet transform (DWT) is used to decompose ECG signals into different successive frequency bands. A set of different statistical features were extracted from the obtained frequency bands to denote the distribution of wavelet coefficients. This study shows that RF classifier achieves superior performances compared to other decision tree methods using 10-fold cross-validation for the ECG datasets and the obtained results suggest that further significant improvements in terms of classification accuracy can be accomplished by the proposed classification system. Accurate ECG signal classification is the major requirement for detection of all arrhythmia types. Performances of the proposed system have been evaluated on two different databases, namely MIT-BIH database and St. -Petersburg Institute of Cardiological Technics 12-lead Arrhythmia Database. For MIT-BIH database, RF classifier yielded an overall accuracy 99.33 % against 98.44 and 98.67 % for the C4.5 and CART classifiers, respectively. For St. -Petersburg Institute of Cardiological Technics 12-lead Arrhythmia Database, RF classifier yielded an overall accuracy 99.95 % against 99.80 % for both C4.5 and CART classifiers, respectively. The combined model with multiscale principal component analysis (MSPCA) de-noising, discrete wavelet transform (DWT) and RF classifier also achieves better performance with the area under the receiver operating characteristic (ROC) curve (AUC) and F- measure equal to 0.999 and 0.993 for MIT-BIH database and 1 and 0.999 for and St. Petersburg Institute of Cardiological Technics 12-lead Arrhythmia Database, respectively. Obtained results demonstrate that the proposed system has capacity for reliable classification of ECG signals, and to assist the clinicians for making an accurate diagnosis of cardiovascular disorders (CVDs).

The first order stable spline (SS-1) kernel (also known as the tunedcorrelated kernel) is used extensively in regularized system identification, where the impulse response is modeled as a zero-mean Gaussian process whose covariance function is given by well designed and tuned kernels. In this paper, we discuss the maximum entropy properties of this kernel. In particular, we formulate the exact maximum entropy problem solved by the SS-1 kernel without Gaussian and uniform sampling assumptions. Under general sampling assumption, we also derive the special structure of the SS-1 kernel (e.g. its tridiagonal inverse and factorization have closed form expression), also giving to it a maximum entropy covariance completion interpretation.

This note presents an efficient approach for the evaluation of multi-parametric mixed integer quadratic programming (mp-MIQP) solutions, occurring for instance in control problems involving discrete time hybrid systems with quadratic cost. Traditionally, the online evaluation requires a sequential comparison of piecewise quadratic value functions. We introduce a lifted parameter space in which the piecewise quadratic value functions become piecewise affine and can be merged to a single value function defined over a single polyhedral partition without any overlaps. This enables efficient point location approaches using a single binary search tree. Numerical experiments with a power electronics application demonstrate an online speedup up to an order of magnitude. We also show how the achievable online evaluation time can be traded off against the offline computational time.

Safety and security applications benefit from better situational awareness. Radar micro-Doppler signatures from an observed target carry information about the target's activity, and have potential to improve situational awareness. This article describes, compares, and discusses two methods to classify human activity based on radar micro-Doppler data. The first method extracts physically interpretable features from the time-velocity domain such as the main cycle time and properties of the envelope of the micro-Doppler spectra and use these in the classification. The second method derives its features based on the components with the most energy in the cadence-velocity domain (obtained as the Fourier transform of the time-velocity domain). Measurements from a field trial show that the two methods have similar activity classification performance. It is suggested that target base velocity and main limb cadence frequency are indirect features of both methods, and that they do often alone suffice to discriminate between the studied activities. This is corroborated by experiments with a reduced feature set. This opens up for designing new more compact feature sets. Moreover, weaknesses of the methods and the impact of non-radial motion are discussed.

Tracking human body motions using inertial sensors has become a well-accepted method in ambulatory applications since the subject is not confined to a lab-bounded volume. However, a major drawback is the inability to estimate relative body positions over time because inertial sensor information only allows position tracking through strapdown integration, but does not provide any information about relative positions. In addition, strapdown integration inherently results in drift of the estimated position over time. We propose a novel method in which a permanent magnet combined with 3-D magnetometers and 3-D inertial sensors are used to estimate the global trunk orientation and relative pose of the hand with respect to the trunk. An Extended Kalman Filter is presented to fuse estimates obtained from inertial sensors with magnetic updates such that the position and orientation between the human hand and trunk as well as the global trunk orientation can be estimated robustly. This has been demonstrated in multiple experiments in which various hand tasks were performed. The most complex task in which simultaneous movements of both trunk and hand were performed resulted in an average rms position difference with an optical reference system of 19.7 +/- 2.2 mm whereas the relative trunk-hand and global trunk orientation error was 2.3 +/- 0.9 and 8.6 +/- 8.7 deg respectively.

The particle Gibbs sampler is a systematic way of using a particle filter within Markov chain Monte Carlo. This results in an off-the-shelf Markov kernel on the space of state trajectories, which can be used to simulate from the full joint smoothing distribution for a state space model in a Markov chain Monte Carlo scheme. We show that the particle Gibbs Markov kernel is uniformly ergodic under rather general assumptions, which we will carefully review and discuss. In particular, we provide an explicit rate of convergence, which reveals that (i) for fixed number of data points, the convergence rate can be made arbitrarily good by increasing the number of particles and (ii) under general mixing assumptions, the convergence rate can be kept constant by increasing the number of particles superlinearly with the number of observations. We illustrate the applicability of our result by studying in detail a common stochastic volatility model with a non-compact state space.

In this paper, we propose using Gaussian processes to track an extended object or group of objects, that generates multiple measurements at each scan. The shape and the kinematics of the object are simultaneously estimated, and the shape is learned online via a Gaussian process. The proposed algorithm is capable of tracking different objects with different shapes within the same surveillance region. The shape of the object is expressed analytically, with well-defined confidence intervals, which can be used for gating and association. Furthermore, we use an efficient recursive implementation of the algorithm by deriving a state space model in which the Gaussian process regression problem is cast into a state estimation problem.

Filtering and smoothing algorithms for linear discrete-time state-space models with skewed and heavy-tailed measurement noise are presented. The algorithms use a variational Bayes approximation of the posterior distribution of models that have normal prior and skew-t-distributed measurement noise. The proposed filter and smoother are compared with conventional low-complexity alternatives in a simulated pseudorange positioning scenario. In the simulations the proposed methods achieve better accuracy than the alternative methods, the computational complexity of the filter being roughly 5 to 10 times that of the Kalman filter.

Today, the workflows that are involved in industrial assembly and production activities are becoming increasingly complex. To efficiently and safely perform these workflows is demanding on the workers, in particular when it comes to infrequent or repetitive tasks. This burden on the workers can be eased by introducing smart assistance systems. This article presents a scalable concept and an integrated system demonstrator designed for this purpose. The basic idea is to learn workflows from observing multiple expert operators and then transfer the learnt workflow models to novice users. Being entirely learning-based, the proposed system can be applied to various tasks and domains. The above idea has been realized in a prototype, which combines components pushing the state of the art of hardware and software designed with interoperability in mind. The emphasis of this article is on the algorithms developed for the prototype: 1) fusion of inertial and visual sensor information from an on-body sensor network (BSN) to robustly track the user’s pose in magnetically polluted environments; 2) learning-based computer vision algorithms to map the workspace, localize the sensor with respect to the workspace and capture objects, even as they are carried; 3) domain-independent and robust workflow recovery and monitoring algorithms based on spatiotemporal pairwise relations deduced from object and user movement with respect to the scene; and 4) context-sensitive augmented reality (AR) user feedback using a head-mounted display (HMD). A distinguishing key feature of the developed algorithms is that they all operate solely on data from the on-body sensor network and that no external instrumentation is needed. The feasibility of the chosen approach for the complete action-perception-feedback loop is demonstrated on three increasingly complex datasets representing manual industrial tasks. These limited size datasets indicate and highlight the potential of the chosen technology as a combined entity as well as point out limitations of the system.

We study cooperative sensor network localization in a realistic scenario where 1) the underlying measurement errors more probably follow a non-Gaussian distribution; 2) the measurement error distribution is unknown without conducting massive offline calibrations; and 3) non-line-of-sight identification is not performed due to the complexity constraint and/or storage limitation. The underlying measurement error distribution is approximated parametrically by a Gaussian mixture with finite number of components, and the expectation-conditional maximization (ECM) criterion is adopted to approximate the maximum-likelihood estimator of the unknown sensor positions and an extra set of Gaussian mixture model parameters. The resulting centralized ECM algorithms lead to easier inference tasks and meanwhile retain several convergence properties with a proof of the "space filling" condition. To meet the scalability requirement, we further develop two distributed ECM algorithms where an average consensus algorithm plays an important role for updating the Gaussian mixture model parameters locally. The proposed algorithms are analyzed systematically in terms of computational complexity and communication overhead. Various computer based tests are also conducted with both simulation and experimental data. The results pin down that the proposed distributed algorithms can provide overall good performance for the assumed scenario even under model mismatch, while the existing competing algorithms either cannot work without the prior knowledge of the measurement error statistics or merely provide degraded localization performance when the measurement error is clearly non-Gaussian.

For communities of agents which are not necessarily cooperating, distributed processes of opinion forming are naturally represented by signed graphs, with positive edges representing friendly and cooperative interactions and negative edges the corresponding antagonistic counterpart. Unlike for nonnegative graphs, the outcome of a dynamical system evolving on a signed graph is not obvious and it is in general difficult to characterize, even when the dynamics are linear. In this paper, we identify a significant class of signed graphs for which the linear dynamics are however predictable and show many analogies with positive dynamical systems. These cases correspond to adjacency matrices that are eventually positive, for which the Perron-Frobenius property still holds and implies the existence of an invariant cone contained inside the positive orthant. As examples of applications, we determine cases in which it is possible to anticipate or impose unanimity of opinion in decision/voting processes even in presence of stubborn agents, and show how it is possible to extend the PageRank algorithm to include negative links.

In optimization algorithms used for on-line Model Predictive Control (MPC), linear systems of equations are often solved in each iteration. This is true both for Active Set methods as well as for Interior Point methods, and for linear MPC as well as for nonlinear MPC and hybrid MPC. The main computational effort is spent while solving these linear systems of equations, and hence, it is of greatest interest to solve them efficiently. Classically, the optimization problem has been formulated in either of two ways. One leading to a sparse linear system of equations involving relatively many variables to compute in each iteration and another one leading to a dense linear system of equations involving relatively few variables. In this work, it is shown that it is possible not only to consider these two distinct choices of formulations. Instead it is shown that it is possible to create an entire family of formulations with different levels of sparsity and number of variables, and that this extra degree of freedom can be exploited to obtain even better performance with the software and hardware at hand. This result also provides a better answer to a recurring question in MPC; should the sparse or dense formulation be used.

This paper addresses one of the main challenges in physical activity monitoring, as indicated by recent benchmark results: The difficulty of the complex classification problems exceeds the potential of existing classifiers. Therefore, this paper proposes the ConfAdaBoost.M1 algorithm. This algorithm is a variant of the AdaBoost.M1 that incorporates well-established ideas for confidence-based boosting. ConfAdaBoost.M1 is compared to the most commonly used boosting methods using benchmark datasets from the UCI machine learning repository.  Moreover, it is evaluated on an activity recognition and an intensity estimation problem, including a large number of physical activities from the recently released PAMAP2 dataset. The presented results indicate that the proposed ConfAdaBoost.M1 algorithm significantly improves the classification performance on most of the evaluated datasets, especially for larger and more complex classification tasks. Finally, two empirical studies are designed and carried out to investigate the feasibility of ConfAdaBoost.M1 for physical activity monitoring applications in mobile systems.

Particle Metropolis-Hastings (PMH) allows for Bayesian parameter inference in nonlinear state space models by combining MCMC and particle filtering. The latter is used to estimate the intractable likelihood. In its original formulation, PMH makes use of a marginal MCMC proposal for the parameters, typically a Gaussian random walk. However, this can lead to a poor exploration of the parameter space and an inefficient use of the generated particles.

We propose two alternative versions of PMH that incorporate gradient and Hessian information about the posterior into the proposal. This information is more or less obtained as a byproduct of the likelihood estimation. Indeed, we show how to estimate the required information using a fixed-lag particle smoother, with a computational cost growing linearly in the number of particles. We conclude that the proposed methods can: (i) decrease the length of the burn-in phase, (ii) increase the mixing of the Markov chain at the stationary phase, and (iii) make the proposal distribution scale invariant which simplifies tuning.

A method for fusing Synthetic Aperture Radar (SAR) images with opticalaerial images is presented. This is done in a navigation framework, where the absolute position and orientation of the flying platform, as computed from the inertial navigation system, is corrected based on the aerial image coordinates taken as ground truth. The method is suitable for new low-price SAR systems for small unmanned vehicles. The primary application is remote sensing, where the SAR image provides one further "colour" channel revealing reflectivity to radio waves. The method is based on first applying an edge detection algorithm to the images and then optimising the most important navigation states by matching the two binary images. To get a measure of the estimation uncertainty, we embed the optimisation in a least squares framework, where an explicit method to estimate the (relative) size of the errors is presented. The performance is demonstrated on real SAR and aerial images, leading to an error of only a few pixels.

Localization is an enabling technology in many applications and services today and in the future. Satellite navigation often works fine for navigation, infotainment and location based services, and it is today the dominating solution in commercial products. A nice exception is the localization in Google Maps, where radio signal strength from WiFi and cellular networks are used as complementary information to increase accuracy and integrity. With the on-going trend with more autonomous functions being introduced in our vehicles and with all our connected devices, most of them operated in indoor enviroments where satellite signals are not available,there is an acute need for new solutions.

At the same time, our smartphones are getting more sophisticated in their sensor configuration. Therefore, in this chapter we present a freely available Sensor Fusion app developed in-house, how it works, how it has been used, and how it can be used based on a variety of applications in our research and student projects.

It is a well-known fact that exercising helps people improve their overall well-being; both physiological and psychological health. Regular moderate physical activity improves the risk of disease progression, improves the chances for successful rehabilitation, and lowers the levels of stress hormones. Physical fitness can be categorized in cardiovascular fitness, and muscular strength and endurance. A proper balance between aerobic activities and strength exercises are important to maximize the positive effects. This balance is not always easily obtained, so assistance tools are important. Hence, ambient assisted living (AAL) systems that support and motivate balanced training are desirable. This chapter presents methods to provide this, focusing on the methodologies and concepts implemented by the authors in the physical activity monitoring for aging people (PAMAP) platform. The chapter sets the stage for an architecture to provide personalized activity monitoring using a network of wearable sensors, mainly inertial measurement units (IMU). The main focus is then to describe how to do this in a personalizable way: (1) monitoring to provide an estimate of aerobic activities performed, for which a boosting based method to determine activity type, intensity, frequency, and duration is given; (2) supervise and coach strength activities. Here, methodologies are described for obtaining the parameters needed to provide real-time useful feedback to the user about how to exercise safely using the right technique.

Lidar-based positioning in a 2D map is analyzed as a method to provide a robust, high accuracy, and infrastructure-free positioning system required by the automation development in underground mining. Expressions are derived that highlight separate information contributions to the obtained position accuracy. This is used to develop two new methods that efficiently select which subset of available lidar rays to use to reduce the computational complexity and allow for online processing with minimal loss of accuracy. The results are verified in simulations of a mid-articulated underground loader in a mine. The methods are shown to be able to reduce the number of rays needed without considerably affecting the performance, and to be competitive with currently used methods. Furthermore, simulations highlight the effects of errors in the map and other map properties, and how imperfect maps degrades the performance of different selection strategies.

We consider a decentralized sensor network of multiple nodes with limited communication capability where the cross-correlations between local estimates are unknown. To reduce the bandwidth the individual nodes determine which subset of local information is the most valuable from a global perspective. Three information selection methods (ISM) are derived. The proposed ISM require no other information than the communicated estimates. The simulation evaluation shows that by using the proposed ISM it is possible to determine which subset of local information is globally most valuable such that both reduced bandwidth and high performance are achieved.

For a given radar system on an unmanned air vehicle, this work proposes a method to find the optimal tracking rangeand the optimal beamwidth for tracking a maneuvering target.  An inappropriate optimal range or beamwidth is indicative ofthe need for a redesign of the radar system. An extended Kalman filter (EKF) is employed to estimate the state of the target using measurements of the range and bearing from the sensor to the target. The proposed method makes use of an alpha-beta filter to predict the expected tracking performanceof the EKF. Using an assumption of the maximum acceleration of the target, the optimal tracking range (or beamwidth) is determined as the one that minimizes the maximum mean squared error (MMSE) of the position estimates while satisfying a user-defined constraint on the probability of losing track of the target.The applicability of the design method is verified using Monte Carlo simulations.

Alzheimer disease is one of the most prevalent dementia types affecting elder population. On-time detection of the Alzheimer disease (AD) is valuable for finding new approaches for the AD treatment. Our primary interest lies in obtaining a reliable, but simple and fast model for automatic AD detection. The approach we introduced in the present contribution to identify AD is based on the application of machine learning (ML) techniques. For the first step, we use histogram to transform brain images to feature vectors, containing the relevant "brain" features, which will later serve as the inputs in the classification step. Next, we use the ML algorithms in the classification task to identify AD. The model presented and elaborated in the present contribution demonstrated satisfactory performances. Experimental results suggested that the Random Forest classifier can discriminate the AD subjects from the control subjects. The presented modeling approach, consisting of the histogram as the feature extractor and Random Forest as the classifier, yielded to the sufficiently high overall accuracy rate of 85.77%.

A method to calibrate the geometries of hydrophone arrays using the sound emitted from nearby ships, is presented. The calibration problem is formulated as a simultaneous localization and mapping (SLAM) estimation problem, where the locations and geometries of the arrays are viewed as unknown map states and the position of the source is viewed as the unknown dynamic state. Two models for the geometry of the arrays are presented. The first model does not impose any constraint on array geometry, whereas the second model takes into account the known maximum distance between the hydrophones. The performance of the proposed calibration method is evaluated using data from two PASS-2447 Omnitech Electronics Inc. 56-element hydrophone arrays. Tests with three data sets show that array geometries in the north-east plane can be consistently estimated. Only the second model provides consistent results in the depth direction. The calibration of the array geometries is shown to increase source localization accuracy significantly.

This paper studies the time-optimal path tracking problem for a cooperative robotic system. The considered system is composed of two two-link planar manipulators with non-actuated end-effectors rigidly grasping a bar. Given a predefined geometric path, the objective is to cooperatively move the bar along the path in minimum time subject to inequality constraints on the joint torques. We show that this problem can be cast as a convex optimization problem by using the existing results for a single manipulator, and also the fact that the desired motion of the bar can be achieved by incorporating its dynamics into the manipulators dynamics. We illustrate our results in simulation. (C) 2019, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

In this paper we show that chordal structure can be used to devise efficient optimization methods for robust model predictive control problems. To this end, first the problem is converted to an equivalent robust quadratic programming formulation. We then illustrate how the chordal structure can be used to distribute the computations in a primal-dual interior-point method among computational agents, which in turn allows us to accelerate the algorithm by efficient parallel computations. We investigate performance of the framework in Julia using numerical examples.

The topic of this paper is the CDIO Standards, specifically the formulation of CDIO Standards version 3.0. The paper first reviews the potential change drivers that motivate a revision of the Standards. Such change drivers are identified both externally (i.e., from outside of the CDIO community) and internally. It is found that external change drivers have affected the perceptions of what problems engineers should address, what knowledge future engineers should possess and what are the most effective teaching practices in engineering education. Internally, the paper identifies criticism of the Standards, as well as ideas for development, that have been codified as proposed additional CDIO Standards. With references to these change drivers, five areas are identified for the revision: sustainability, digitalization of teaching and learning; service; and faculty competence. A revised version of the Standards is presented. In addition, it is proposed that a new category of Standards is established, “optional standards”. Optional Standards are a complement to the twelve “basic” Standards, and serve to guide educational development and profiling beyond the current Standards. A selected set of proposed optional Standards are recommended for further evaluation and possibly acceptance by the CDIO community

It has been shown lately that any "standard" Bayesian lower bound (BLB) on the mean squared error (MSE) of the Weiss-Weinstein family (WWF) admits a "tighter" form which upper bounds the "standard" form. Applied to the Bayesian Cramer-Rao bound (BCRB), this result suggests to redefine the concept of efficient estimator relatively to the tighter form of the BCRB, an update supported by a noteworthy example. This paper lays the foundation to revisit some Bayesian estimation problems where the BCRB is not tight in the asymptotic region.

In this paper, we propose a framework for generating motion primitives for lattice-based motion planners automatically. Given a family of systems, the user only needs to specify which principle types of motions, which are here denoted maneuvers, that are relevant for the considered system family. Based on the selected maneuver types and a selected system instance, the algorithm not only automatically optimizes the motions connecting pre-defined boundary conditions, but also simultaneously optimizes the end-point boundary conditions as well. This significantly reduces the time consuming part of manually specifying all boundary value problems that should be solved, and no exhaustive search to generate feasible motions is required. In addition to handling static a priori known system parameters, the framework also allows for fast automatic re-optimization of motion primitives if the system parameters change while the system is in use, e.g, if the load significantly changes or a trailer with a new geometry is picked up by an autonomous truck. We also show in several numerical examples that the framework can enhance the performance of the motion planner in terms of total cost for the produced solution.

An initial work has been performed to implement a sequential Monte Carlo method to solve the data association problem. The main motivation is to overcome the incorrect association when the state estimates are inaccurate. The solution is based on modeling the data association as a stochastic variable and estimated with a bootstrap particle filter. Two variants of the proposal function are evaluated, one with the uniform distribution over possible associations, and the other one with the distribution depending on the measurements and state estimates. The performance of both proposals is evaluated on the small simulation example, and compared to a purely deterministic approach, Nearest-Neighbour, as well. The obtained initial results are quite promising, and more evaluation and expansion to more examples and real data sets is suggested for the future work.

The unscented Kalman filter (UKF) is a very popular solution for estimation of the state in nonlinear systems. Similar to the extended Kalman filter (EKF) and contrary to the Kalman filter (KF) for linear systems, the UKF provides no guarantees that the filter updates will improve the filtered state estimate. In the past, the iterated EKF (IEKF) has been suggested as a way to online monitor the filter performance and try to improve it using optimization techniques. In this paper we do the same for the UKF, deriving six iterated UKF (IUKF) variations based on two cost functions and three optimization algorithms. The methods are evaluated and compared to IEKF versions and to two versions of the iterative posterior linearization filter (IPLF) in three benchmark simulation studies. The results show that IUKF algorithms can be used as a derivative free alternative to IEKF, and provide insights about the different design choices available in IUKF algorithms.

This paper investigates the problem of controlling a complex network with reduced control energy. Two centrality measures are defined, one related to the energy that a control, placed on a node, can exert on the entire network, and the other related to the energy that the network exerts on a node. We show that by combining these two centrality measures conflicting control energy requirements, like minimizing the average energy needed to steer the state in any direction and the energy needed for the worst direction, can be simultaneously taken into account. From an algebraic point of view, the node ranking that we obtain from the combination of our centrality measures is related to the non-normality of the adjacency matrix of the graph.

By arranging a large number of inertial sensors in an array and fusing their measurements, it is possible to create inertial sensor assemblies with a high performance-to-price ratio. Recently, a maximum likelihood estimator for fusing inertial array measurements collected at a given sampling instance was developed. In this paper, the maximum likelihood estimator is extended by introducing a motion model and deriving a maximum a posteriori estimator that jointly estimates the array dynamics at multiple sampling instances. Simulation examples are used to demonstrate that the proposed sensor fusion method have the potential to yield significant improvements in estimation accuracy. Further, by including the motion model, we resolve the sign ambiguity of gyro-free implementations, and thereby open up for implementations based on accelerometer-only arrays.

We present a technique for kernel-based identification of Wiener systems. We model the impulse response of the linear block with a Gaussian process. The static nonlinearity is modeled with a combination of basis functions. The coefficients of the static nonlinearity are estimated, together with the hyperparameters of the covariance function of the Gaussian process model, using an iterative algorithm based on the expectation-maximization method combined with elliptical slice sampling to sample from the posterior distribution of the impulse response given the data. The same sampling method is then used to find the posterior-mean estimate of the impulse response. We test the proposed algorithm on a benchmark of randomly-generated Wiener systems.

In Massive MIMO, the pilot contamination effect reduces the spectral efficiency (SE) gains and superimposed pilot (SP) transmission has been proposed to mitigate this effect. SP is based on transmitting pilot and data symbols simultaneously to allow for longer pilots and no pilot overhead. This work studies the optimal power control strategies in the uplink of a Massive MIMO system with SP and detection based on maximum ratio combining The optimization objectives arc maximum product of SINRs and max-min fairness, and these problems are reformulated as geometric programs which allow for efficient implementations. The numerical results indicate that the SE gains from the optimal power control with respect to the heuristic statistical channel inversion power control, are more significant when the interference from pilot symbols is subtracted before data detection.

The main idea in this paper is to implement a distributed primal-dual interior-point algorithm for loosely coupled Quadratic Programming problems. We implement this in Julia and show how can we exploit parallelism in order to increase the computational speed. We investigate the performance of the algorithm on a Model Predictive Control problem.

In this work we consider a nonlinear interconnected system describing a decision-making process in a community of agents characterized by the coexistence of collaborative and antagonistic interactions. The resulting signed graph is in general not structurally balanced. It is shown in the paper that the decision-making process is affected by the frustration of the signed graph, in the sense that a nontrivial decision can be reached only if the social commitment of the agents is high enough to win the disorder introduced by the frustration in the network. The higher the frustration of the graph, the higher the commitment strength required from the agents.

We explore the problem of identification of LPV models when the scheduling variables are not known in advance and the model parameters exhibit a dynamic dependence on them. We consider an affine ARX model structure whose parameters vary with time. We solve for the models parameters and scheduling variables in two steps. In the first step, we use the measured input-output data to realize a parameter trajectory by solving a regularized Hankel matrix rank minimization problem. The regularization penalty is guided by the prior knowledge regarding the nature of systems time variation. In the second step, the scheduling variables are estimated as parameters of a sparse ARX structure relating the models parameters to the measured input-output variables. The effectiveness of the proposed approach is illustrated with two practical examples. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

The demand for fuel-efficient transport solutions are steadily increasing with the goal of reducing environmental impact and increasing efficiency. Heavy-Duty Vehicle (HDV) platooning is a promising concept where multiple HDVs drive together in a convoy with small intervehicular spacing. By doing this, the aerodynamic drag is reduced which in turn lowers fuel consumption. We propose a novel Model Predictive Control (MPC) framework for longitudinal control of the follower vehicle in a platoon consisting of two HDVs when no vehicle-to-vehicle communication is available. In the framework, the preceding vehicle's velocity profile is predicted using artificial neural networks which uses a topographic map of the road as input and is trained offline using synthetic data. The gear shifting and mass of consumed fuel for the controlled follower vehicle is modeled and used within the MPC controller. The efficiency of the proposed framework is verified in simulation examples and is benchmarked with a currently available control solution.  

In this work, we study the multiple kernel based regularized system identification with the hyper-parameter estimated by using the Steins unbiased risk estimators (SURE). To approach the problem, a QR factorization is first employed to compute SUREs objective function and its gradient in an efficient and accurate way. Then we propose an algorithm to solve the SURE problem, which contains two parts: the outer optimization part and the inner optimization part. For the outer optimization part, the coordinate descent algorithm is used and for the inner optimization part, the projection gradient algorithm is used. Finally, the efficacy of the proposed algorithm is demonstrated by numerical simulations. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

In this paper, we study the asymptotic properties of the generalized cross validation (GCV) hyperparameter estimator and establish its connection with the Steins unbiased risk estimators (SURE) as well as the mean squared error (MSE). It is shown that as the number of data goes to infinity, the GCV has the same asymptotic property as the SURE does and both of them converge to the best hyperparameter in the MSE sense. We illustrate the efficacy of the result by Monte Carlo simulations. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

Because of the increased demand on fault detection, monitoring and predictive maintenance, online or recursive identification is playing a more important role in systems engineering. In the recent releases of System Identification Toolbox (TM) for MATLAB (R), this has been reflected in a more substantial support for online techniques. This contribution gives an account of these improvements. It covers the addition of nonlinear filtering algorithms, such as the extended Kalman filter, the unscented Kalman filter and particle filters. The traditional recursive estimation techniques for polynomial models have also been enhanced with a more versatile syntax. Several new Simulink (R) blocks have been developed to support Simulink (R) models with online estimation. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

Using Maximum Likelihood (or Prediction Error) methods to identify linear state space model is a prime technique. The likelihood function is a nonconvex function and care must be exercised in the numerical maximization. Here the focus will be on affine parameterizations which allow some special techniques and algorithms. Three approaches to formulate and perform the maximization are described in this contribution: (1) The standard and well known Gauss Newton iterative search, (2) a scheme based on the EM (expectation-maximization) technique, which becomes especially simple in the affine parameterization case, and (3) a new approach based on lifting the problem to a higher dimension in the parameter space and introducing rank constraints. (C) 2018, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

This paper concerns the estimation of a dynamic model from two measured signals when it is not clear which signal should be used as input to the model. In this case, both a forward and an inverse model can be estimated. Here, a basic instrumental variable approach is used and it is shown that the forward and inverse model estimators give identical parameter estimates provided that corresponding model structures have been used. Furthermore, it is shown that this scenario occurs when properties of a quadcopter are estimated from accelerometer and gyro signals and, hence, that it does not matter which signal is used as input.

In this paper we show how to synthesize simple explicit MPC controllers based on approximate dynamic programming. Here, a given MPC optimization problem over a finite horizon is solved iteratively as a series of problems of size one. The optimal cost function of each subproblem is approximated by a quadratic function that serves as a cost-to-go function for the subsequent iteration. The approximation is designed in such a way that closed-loop stability and recursive feasibility is maintained. Specifically, we show how to employ sum-of-squares relaxations to enforce that the approximate cost-to-go function is bounded from below and from above for all points of its domain. By resorting to quadratic approximations, the complexity of the resulting explicit MPC controller is considerably reduced both in terms of memory as well as the on-line computations. The procedure is applied to control an inverted pendulum and experimental data are presented to demonstrate viability of such an approach.

In this paper, Bayesian lower bounds (BLBs) are obtained via a general form of the Pythagorean theorem where the inner product derives from the joint or the a-posteriori probability density function (pdf). When joint pdf is considered, the BLBs obtained encompass the Weiss-Weinstein family (WWF). When a-posteriori pdf is considered, by resorting to an embedding between two ad hoc subspaces, it is shown that any ”standard” BLBs of the WWF admits a ”tighter” form which upper bounds the ”standard” form. Interestingly enough, this latter result may explain why the ”standard” BLBs of the WWF are not always as tight as expected, as exemplified in the case of the Bayesian Cram´er-Rao Bound. As a consequence an updated definition of efficiency is proposed, as well as the introduction of an updated class of efficient estimators.

This paper presents a systematic approach for computing local solutions to motion planning problems in non-convex environments using numerical optimal control techniques. It extends the range of use of state-of-the-art numerical optimal control tools to problem classes where these tools have previously not been applicable. Today these problems are typically solved using motion planners based on randomized or graph search. The general principle is to define a homotopy that transforms, or preferably relaxes, the original problem to an easily solved problem. In this work, it is shown that by combining a Sequential Quadratic Programming (SQP) method with a homotopy approach that gradually transforms the problem from a relaxed one to the original one, practically relevant locally optimal solutions to the motion planning problem can be computed. The approach is demonstrated in motion planning problems in challenging 2D and 3D environments, where the presented method significantly outperforms both a state-of-the-art numerical optimal control method and a state-of-the-art open-source optimizing sampling-based planner commonly used as benchmark. 

An experimental comparison of two feed-forward based frictioncompensation methods is presented. The first method is based on theLuGre friction model, using identified friction model parameters, andthe second method is based on B-spline network, where the networkweights are learned from experiments. The methods are evaluated andcompared via experiments using a six axis industrial robot carryingout circular movements of different radii. The experiments show thatthe learning-based friction compensation gives an error reduction ofthe same magnitude as for the LuGre-based friction compensation.

The number of sensors used in tracking scenariosis constantly increasing, this puts high demands on the trackingmethods to handle these data streams. Central processing (ideallyoptimal) puts high demands on the central node, is sensitive toinaccurate sensor parameters, and suffers from the single pointof failure problem. Decentralizing the tracking can improve this,but may give considerable performance loss. The newly presentedinverse covariance intersection method, proven to be consistent,even under unknown track cross correlations, is benchmarkedagainst alternatives. Different track-to-track methods, includingsmoothed association over a window, are compared. A scenariowith objects tracked in multiple cameras, not necessarily opti-mized for tracking, are used to give realism to the evaluations.

In this paper, marginal versions of the Bayesian Bhattacharyya lower bound (BBLB), which is a tighter alternative to the classical Bayesian Cramer-Rao bound, for discrete-time filtering are proposed. Expressions for the second and third-order marginal BBLBs are obtained and it is shown how these can be approximately calculated using particle filtering. A simulation example shows that the proposed bounds predict the achievable performance of the filtering algorithms better.

We report the results of a series of numerical studies examining the convergence rate for some approximate representations of alpha-stable distributions, which are a highly intractable class of distributions for inference purposes. Our proposed representation turns the intractable inference for an infinite-dimensional series of parameters into an (approximately) conditionally Gaussian representation, to which standard inference procedures such as Expectation-Maximization (EM), Markov chain Monte Carlo (MCMC) and Particle Filtering can be readily applied. While we have previously proved the asymptotic convergence of this representation, here we study the rate of this convergence for finite values of a truncation parameter, c. This allows the selection of appropriate truncations for different parameter configurations and for the accuracy required for the model. The convergence is examined directly in terms of cumulative distribution functions and densities, through the application of the Berry theorems and Parseval theorems. Our results indicate that the behaviour of our representations is significantly superior to that of representations that simply truncate the series with no Gaussian residual term.

With ever-increasing productivity targets in mining operations, there is a growing interest in mining automation. In future mines, remote controlled and autonomous haulers will operate underground guided by LiDAR (Light Detection And Ranging) sensors. We envision reusing LiDAR measurements to maintain accurate mine maps that would contribute to both safety and productivity. Extrapolating from a pilot project on reliable wireless communication in Bolidens Kankberg mine, we propose establishing a System-of-Systems (SoS) with LiDAR-equipped haulers and existing mapping solutions as constituent systems. SoS requirements engineering inevitably adds a political layer, as independent actors are stakeholders both on the system and SoS levels. We present four SoS scenarios representing different business models, discussing how development and operations could be distributed among Boliden and external stakeholders, e.g., the vehicle suppliers, the hauling company, and the developers of the mapping software. Based on eight key variation points, we compare the four scenarios from both technical and business perspectives. Finally, we validate our findings in a seminar with participants from the relevant stakeholders. We conclude that to determine which scenario is the most promising for Boliden, trade-offs regarding control, costs, risks, and innovation must be carefully evaluated.

In this paper we provide necessary conditions for the existence of multiple equilibrium points for a class of non-linear cooperative networked systems with saturating interactions which describe models of collective decision-making. The multiple steady states of the dynamics represent the possible outcomes of a decision process, and, except for one positive and one negative, have all mixed signs. The conditions we obtain can be formulated in terms of the algebraic connectivity of the network and are inspired by Perron-Frobenius arguments. It is also shown that the mixed-sign equilibria are contained in a ball of radius given by the norm of the positive equilibrium point and centered in the origin. Numerical examples are given to illustrate the results.

In this paper, we study the problem of controlling complex networks with unilateral controls, i.e., controls which can assume only positive or negative values, not both. Given a network with linear dynamics represented by the adjacency matrix A, we seek to understand the minimal number of unilateral controls that renders the network controllable. This problem has structural properties that for instance allows us to establish theoretical bounds and identify key topological properties that makes a network relatively easy to control with unilateral controls as compared to unrestricted controls. We find that the structure of the left null space of A is particularly important to this end. In a computational study we find that the network topology largely determines the number of unilateral controls and that the derived lower bounds often are achieved with heuristic methods. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

Gray-box identification is prevalent in modeling physical and networked systems. However, due to the non-convex nature of the gray-box identification problem, good initial parameter estimates are crucial for a successful application. In this paper, a new identification method is proposed by exploiting the low-rank and structured Hankel matrix of impulse response. This identification problem is recasted into a difference-of-convex programming problem, which is then solved by the sequential convex programming approach with the associated initialization obtained by nuclear-norm optimization. The presented method aims to achieve the maximum impulse-response fitting while not requiring additional (non-convex) conditions to secure non-singularity of the similarity transformation relating the given state space matrices to the gray-box parameterized ones. This overcomes a persistent shortcoming in a number of recent contributions on this topic, and the new method can be applied for the structured state-space realization even if the involved system parameters are unidentifiable. The method can be used both for directly estimating the gray-box parameters and for providing initial parameter estimates for further iterative search in a conventional gray-box identification setup. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

The interest for system identification in dynamic networks has increased recently with a wide variety of applications. In many cases, it is intractable or undesirable to observe all nodes in a network and thus, to estimate the complete dynamics. Furthermore, it might even be challenging to estimate a subset of the network if key nodes are unobservable due to correlation between the nodes. In this contribution, we will discuss an approach to treat this problem. The approach relies on additional measurements that are dependent on the unobservable nodes and thus indirectly contain information about them. These measurements are used to form an alternative indirect model that is only dependent on observed nodes. The purpose of estimating this indirect model can be either to recover information about modules in the original network or to make accurate predictions of variables in the network. Examples are provided for both recovery of the original modules and prediction of nodes. (C) 2017, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.

Motion planning for a general 2-trailer system poses a hard problem for any motion planning algorithm and previous methods have lacked any completeness or optimality guarantees. In this work we present a lattice-based motion planning framework for a general 2-trailer system that is resolution complete and resolution optimal. The solution will satisfy both differential and obstacle imposed constraints and is intended either as a part of an autonomous system or as a driver support system to automatically plan complicated maneuvers in backward and forward motion. The proposed framework relies on a precomputing step that is performed offline to generate a finite set of kinematically feasible motion primitives. These motion primitives are then used to create a regular state lattice that can be searched for a solution using standard graph-search algorithms. To make this graph-search problem tractable for real-time applications a novel parametrization of the reachable state space is proposed where each motion primitive moves the system from and to a selected set of circular equilibrium configurations. The approach is evaluated over three different scenarios and impressive real-time performance is achieved.

This paper considers the input design of kernelbased regularization methods for LTI system identification. We first derive the Bayesian mean squared error matrix under the Bayesian perspective, and then use some typical scalar measures (e.g., the A-optimality, D-optimality, and E-optimality) as optimization criteria for the input design problem. Instead of directly solving the nonconvex optimization problem, we propose a two-step procedure. The first step is to solve a convex optimization and the second one is to determine the inverse image of a quadratic map. Both of these two steps can be solved efficiently by the proposed method and hence all the globally optimal inputs are found. In particular, we show that for some kernels, the optimal input under the D-optimality has an explicit expression.

The continuous-time subspace identification using state-variable filtering has been investigated for a long time. Due to the simple orthogonal basis functions that were adopted by the existing methods, the identification performance is quite sensitive to the selection of the system-dynamic parameter associated with an orthogonal basis. To cope with this problem, a subspace identification method using generalized orthonormal(Takenaka-Malmquist) basis functions is developed, which has the potential to perform better than the existing state-variable filtering methods since the adopted Takenaka-Malmquist basis has more degree of freedom in selecting the system-dynamic parameters. As a price for the flexibility of the generalized orthonormal bases, the transformed state-space model is time-varying or parameter-varying which cannot be identified using traditional subspace identification methods. To this end, a new subspace identification algorithm is developed by exploiting the structural properties of the time-variant system matrices, which is then validated by numerical simulations.

Network reconstruction has become particularly important in systems biology, and is now expected to deliver information on causality. Systems in nature are inherently nonlinear. However, for nonlinear dynamical systems with hidden states, how to give a useful definition of dynamic networks is still an open question. This paper presents a useful definition of Boolean dynamic networks for a large class of nonlinear systems. Moreover, a robust inference method is provided. The well-known Millar-10 model in systems biology is used as a numerical example, which provides the ground truth of causal networks for key mRNAs involved in eukaryotic circadian clocks. In addition, as second contribution of this paper, we suggest definitions of linear network identifiability, which helps to unify the available work on network identifiability.

One-dimensional Bayesian filtering and smoothing problems can be solved numerically using a number of algorithms, even in nonlinear and non-Gaussian cases. In this educational paper we advocate for the benefits of visualizing the obtained posterior densities as complement to, e.g., estimation error analysis. In addition to a review of Bayesian filtering and smoothing and the respective point mass and particle solutions, we devise a novel algorithm for filtering when the likelihood cannot be evaluated. Several instructive examples are discussed and easily adjustable matlab code is provided as complement to this paper.

In this paper, the derivation of the Bayesian Bhattacharyya bound for discrete-time filtering as proposed ina paper by Reece and Nicholson is revisited. It turns out that the results presented in the aforementioned contribution are incorrect, as some expectations appearing in the information matrix recursions are missing. This paper gives a generalized derivation of the N-th order Bayesian Bhattacharyya bound and presents corrected expressions for the case N = 2. A nonlinear toy example is used to illustrate the results

Classification of motion mode (walking, running, standing still) and device mode (hand-held, in pocket, in back-pack) is an enabler in personal navigation systems for the purpose of saving energy and design parameter settings and also for its own sake. Our main contribution is to publish one of the most extensive datasets for this problem, including inertial data from eight users, each one performing three pre-defined trajectories carrying four smartphones and seventeen inertial measurement units on the body. All kind of metadata is available such as the ground truth of all modes and position. A second contribution is the first study on a joint classifier of motion and device mode, respectively, where preliminary but promising results are presented.

Many positioning systems rely on accuratetime of arrival measurements. In this paper, we addressnot only the accuracy but also the relevance of Time ofArrival (TOA) measurement error modeling. We discusshow better knowledge of these errors can improve relativedistance estimation, and compare the impact of differentlydetailed measurement error information. These models arecompared in simulations based on models derived froman Ultra Wideband (UWB) measurement campaign. Theconclusion is that significant improvements can be madewithout providing detailed received signal information butwith a generic and relevant measurement error model.

Advances in sensor systems have resulted in the availability of high resolution sensors, capable of generating massive amounts of data. For complex systems to run online, the primary focus is on computationally efficient filters for the estimation of latent states related to the data. In this paper a novel method for efficient state estimation with the unscented Kalman Filter is proposed. The focus is on applications consisting of a massive amount of data. From a modelling perspective, this amounts to a measurement vector with dimensionality significantly greater than the dimensionality of the state vector. The efficiency of the filter is derived from a parallel filter structure which is enabled by the expectation propagation algorithm. A novel parallel measurement processing expectation propagation unscented Kalman filter is developed. The primary advantage of the novel algorithm is in the ability to achieve computational improvements with negligible loses in filter accuracy. An example of robot localization with a high resolution laser rangefinder sensor is presented. A 47.53% decrease in computational time was exhibited for a scenario with a processing platform consisting of 4 processors, with a negligible loss in accuracy.

In polar region operations, drift sea ice positioning and tracking is useful for both scientific and safety reasons. Modeling ice movements has proven difficult, not least due to the lack of information of currents and winds of high enough resolution. Thus, observations of drift ice is essential to an up-to-date ice-tracking estimate.

Recent years have seen the rise of Unmanned Aerial Systems (UAS) as a platform for geoobservation, and so too for the tracking of sea ice. Being a mobile platform, the research on UAS path-planning is extensive and usually involves an objective-function to minimize. For the purpose of observation however, the objective-function typically changes as observations are made along the path.

Further, the general problem involves multiple UAS and—in the case of sea ice tracking—vast geographical areas.

In this paper we discuss the architectural outline of a system capable of fusing data from multiple sources—UAS’s and others—as well as incorporating that data for both path-planning, sea ice movement prediction and target initialization. The system contains tracking of sea ice objects, situation map logic and is expandable as discussed with path-planning capabilities for closing the loop of optimizing paths for information acquisition.

Assessing the fundamental performance limitationsin Bayesian filtering can be carried out using the parametricCram´er-Rao bound (CRB). The parametric CRB puts a lowerbound on mean square error (MSE) matrix conditioned on aspecific state trajectory realization. In this work, we derive theparametric CRB for state-space models, where the measurementequation is modeled by a Gaussian process regression.These models appear, for instance in proximity report-basedpositioning, where proximity reports are obtained by hardthresholding of received signal strength (RSS) measurements, thatare modeled through Gaussian process regression. The proposedparametric CRB is evaluated on selected state trajectories andfurther compared with the positioning performance obtained bythe particle filter. The results corroborate that the positioningaccuracy achieved in this framework is close to the parametricCRB.

 In this work an Inertial Measurement Unit is used to improve tool position estimates for an ABB IRB 4600 industrial robot, starting from estimates based on motor angle forward kinematics. A Complementary Filter and an Extended Kalman Filter are investigated. The Complementary Filter is found to perform on par with the Extended Kalman Filter while having lower complexity both in the tuning process and the filtering computations.

Acoustic frequency tracking of a harmonic signalwith continuously varying frequency is considered. The Rao-Blackwellized point mass filter (RBPMF), previously proposed bythe authors for mechanical vibration tracking, is applied to the problem. The RBPMF is compared with two periodogram-based methods, and the similarities and differences between them are explained. Both experimental and simulation results in a Doppler frequency tracking scenario are presented, and the results show that the RBPMF can have significantly less estimation error than the competing methods.

In polar region operations, drift ice positioning and tracking is useful for both scientific and safety reasons. At its core is a Multi-Target Tracking (MTT) problem in which currents and winds make motion modeling difficult. One recent algorithm in the MTT field, employed in this paper, is the Labeled Multi-Bernoulli (LMB) filter. In particular, a proposed reformulation of the LMB equations exposes a structure which is exploited to propose a compact algorithm for the generation of the filter's posterior distribution. Further, spatial indexing is applied to the clustering process of the filter, allowing efficient separation of the filter into smaller, independent parts with lesser total complexity than that of an unclustered filter. Many types of sensors can be employed to generate detections of sea ice, and in this paper a recorded dataset from a Terrestrial Radar Interferometer (TRI) is used to demonstrate the application of the Spatially Indexed Labeled Multi-Bernoulli filter to estimate the currents of an observed area in Kongsfjorden, Svalbard.

Modern fighter aircraft require maximum control performance in order to have the upper hand in a dogfight or when they have to outmaneuver an enemy missile. Therefore pilots must be able to maneuver the aircraft very close to the limit of what it is capable of while at the same time focus on the tactical tasks of the mission. To enable this, modern flight control systems have automatic systems for angle of attack and load factor limiting.

One such design technique is reference or command governors. In this paper we investigate different ways of designing command governors for angle of attack and load factor limiting in in fighter aircraft flight control systems. We discuss different design approaches and their properties and implement one selected design in Saab's JAS 39 Gripen fighter aircraft simulation environment. 

We introduce interacting particle Markov chain Monte Carlo (iPMCMC), a PMCMC method based on an interacting pool of standard and conditional sequential Monte Carlo samplers. Like related methods, iPMCMC is a Markov chain Monte Carlo sampler on an extended space. We present empirical results that show significant improvements in mixing rates relative to both non-interacting PMCMC samplers and a single PMCMC sampler with an equivalent memory and computational budget. An additional advantage of the iPMCMC method is that it is suitable for distributed and multi-core architectures.

The stable spline kernel and the diagonal correlated kernel are two kernels that have been tested extensively in kernel-based regularization methods for LTI system identification. As shown in our recent works, although these two kernels are introduced in different ways, they share some common features, e.g., they all belong to the class of exponentially convex locally stationary kernels, and state-space model induced kernels. In this work, we further show that similar to the derivation of the stable spline kernel, the continuous-time diagonal correlated kernel can be derived by applying the same "stable" coordinate change to a "generalized" first order spline kernel, and thus can be interpreted as a stable generalized first order spline kernel. This interpretation provides new facets to understand the properties of the diagonal correlated kernel. Due to this interpretation, new eigendecompositions, explicit expression of the norm, and new maximum entropy interpretation of the diagonal correlated kernel are derived accordingly.

Contractive interference functions are a subclass of the standard interference functions used in the design and analysis of distributed power control algorithms for wireless networks. Their peculiarity is that for the resulting positive system the existence and global asymptotic stability of a unique positive equilibrium point is guaranteed. In this paper we give an infinitesimal characterization of nonlinear contractiveinterference functions in terms of the spectral radius of the Jacobian linearization at any point in the positive orthant. The condition we obtain, that the spectral radius is always less than 1, extends to the nonlinear case an equivalent property of linear interference functions, and leads to a Jacobian characterization similar to the one commonly used in contraction analysis of nonlinear systems.

It is a well known fact that finite time optimal controllers, such as MPC do not necessarily result in closed loop stable systems. Within the MPC community it is common practice to add a final state constraint and/or a final state penalty in order to obtain guaranteed stability. However, for more advanced controller structures it can be difficult to show stability using these techniques. Additionally in some cases the final state constraint set consists of so many inequalities that the complexity of the MPC problem is too big for use in certain fast and time critical applications. In this paper we instead focus on deriving a tool for a-postiori analysis of the closed loop stability for linear systems controlled with MPC controllers. We formulate an optimisation problem that gives a sufficient condition for stability of the closed loop system and we show that the problem can be written as a Mixed Integer Linear Programming Problem (MILP).

Reversing with a dolly steered trailer configura- tion is a hard task for any driver without extensive training. In this work we present a motion planning and control framework that can be used to automatically plan and execute complicated manoeuvres. The unstable dynamics of the reversing general 2- trailer configuration with off-axle hitching is first stabilised by an LQ-controller and then a pure pursuit path tracker is used on a higher level giving a cascaded controller that can track piecewise linear reference paths. This controller together with a kinematic model of the trailer configuration is then used for forward simulations within a Closed-Loop Rapidly Exploring Random Tree framework to generate motion plans that are not only kinematically feasible but also include the limitations of the controller’s tracking performance when reversing. The approach is evaluated over a series of Monte Carlo simulations on three different scenarios and impressive success rates are achieved. Finally the approach is successfully tested on a small scale test platform where the motion plan is calculated and then sent to the platform for execution. 

The aim of this paper is to suggest a modification to the usual bounded confidence model of opinion dynamics, so that “changes of opinion” (intended as changes of the sign of the initial state) of an agent are never induced by the dynamics. In order to do so, a bipartite consensus model is used, endowing it with a confidence range. The resulting signed bounded confidence model has a state-dependent connectivity and a behavior similar to its standard counterpart, but in addition it preserves the sign of the opinions by “repelling away” opinions localized near the origin but on different sides with respect to 0.

The safe fusion algorithm is benchmarked againstthree other methods in distributed target tracking scenarios. Safefusion is a fairly unknown method similarly to, e.g., covarianceintersection, that can be used to fuse potentially dependentestimates without double counting data. This makes it suitablefor distributed target tracking, where dependencies are oftenunknown or difficult to derive. The results show that safe fusionis a very competitive alternative in five evaluated scenarios, whileat the same time easy to implement and compute compared tothe other evaluated methods. Hence, safe fusion is an attractivealternative in track to track fusion systems.

This paper is concerned with cooperative Terrain Aided Navigation of a network of aircraft using fusion of Radar Altimeter and inter-node range measurements. State inference is performed using a Rao-Blackwellized Particle Filter with online measurement noise statistics estimation. For terrain coverage measurement noise parameter identification, an online Expectation Maximization algorithm is proposed, where local sufficient statistics at each node are calculated in the E-step, which are then distributed to neighboring nodes using a random gossip algorithm to perform the M-step at each node. Simulation results show that improvement on positioning and calibration performance can be achieved compared to a non-cooperative approach.

In this paper, we study the problem of controlling large scale networks with controls which can assume only positive values. Given an adjacency matrix A, an algorithm is developed that constructs an input matrix B with a minimal number of columns such that the resulting system (A, B) is positively controllable. The algorithm combines the graphical methods used for structural controllability analysis with the theory of positive linear dependence. The number of control inputs guaranteeing positive controllability is near optimal.

In this paper, a calibration method for a triaxial accelerometer using a triaxial gyroscope is presented. The method uses a sensor fusion approach, combining the information from the accelerometers and gyroscopes to find an optimal calibration using Maximum likelihood. The method has been tested by using real sensors in smartphones to perform orientation estimation and verified through Monte Carlo simulations. In both cases, the method is shown to provide a proper calibration, reducing the effect of sensor errors and improving orientation estimates.

This paper presents a batch estimation method for Simultaneous Localization and Mapping (SLAM) using the Prediction Error Method (PEM). The estimation problem considers landmarks as parameter while treating dynamics using state space models. The gradient needed for parameter estimation is computed recursively using an Extended Kalman Filter (EKF). Results using simulations with a monocular camera and inertial sensors are presented and compared to a Nonlinear Least- Squares (NLS) estimator. The presented method produce both lower RMSE’s and scale better to the batch length. 

We consider a target tracking problem where, in addition to the usual sensor measurements, accurate observations with uncertain timestamps are available. Such observations could, \eg, come from traces left by a target or from witnesses of an event, and have the potential in some scenarios to improve the accuracy of an estimate significantly. The Bayesian solution to the smoothing problem for one observation with uncertain timestamp is derived for a linear Gaussian state space model. The joint and marginal distributions of the states and uncertain time are derived, as well as the minimum mean squared error (MMSE) and maximum a posteriori (MAP) estimators. To attain an intuition for the problem in consideration a simple first-order example is presented and its posterior distributions and point estimators are compared and examined in some depth.

This paper presents a feasibility study on smartphone localization of missing persons in Search And Rescue(SAR) operations using widely available Commercial-Off-The-Shelf (COTS) products. We assume (1) that the missing person wears an enabled smartphone and (2) that messages transmitted by this smartphone can be intercepted by mobile agents at known positions. We present a proof-of-concept that consists of several mobile agents carrying smartphones that measure the Received Signal Strength (RSS) of Wi-fi messages transmitted by the smartphone of the missing person. The positions of the mobile agents are determined using the GPS unit on the smartphones.The mobile agents send the collected RSS and GPS data to a central processing unit, which processes the data in real-time and guides mobile agents in SAR operations by estimating the position of the missing person. Our central processing unit runs a localization algorithm that requires no calibration, because rescue operations usually take place in unknown environments with unknown hardware. Our experiments in an 250x130m2 outdoor field shows that our localization system provides an average localization performance of roughly 15 meters, which is sufficient for most SAR operations of interest. In addition, we performed several successful tests with a Quadcopter to show the feasibility of using unmanned vehicles in SAR operations.

We consider personal navigation systems in devices equipped with inertial sensors and GPS, where we propose an improved Pedestrian Dead Reckoning (PDR) algorithm that learns gait parameters in time intervals when position estimates are available, for instance from GPS or an indoor positioning system (IPS). A novel filtering approach is proposed that is able to learn internal gait parameters in the PDR algorithm, such as the step length and the step detection threshold. Our approach is based on a multi-rate Kalman filter bank that estimates the gait parameters when position measurements are available, which improves PDR in time intervals when the position is not available, for instance when passing from outdoor to indoor environments where IPS is not available. The effectiveness of the new approach is illustrated on several real world experiments. 

We introduce interacting particle Markov chain Monte Carlo (iPMCMC), a PMCMC method based on an interacting pool of standard and conditional sequential Monte Carlo samplers. Like related methods, iPMCMC is a Markov chain Monte Carlo sampler on an extended space. We present empirical results that show significant improvements in mixing rates relative to both non-interacting PMCMC samplers and a single PMCMC sampler with an equivalent memory and computational budget. An additional advantage of the iPMCMC method is that it is suitable for distributed and multi-core architectures.

The speed of a wheeled vehicle is usually estimatedusing wheel speed sensors (WSS) or GPS. If these signals are unavailable, other methods must be used. We propose a novelapproach exploiting the fact that vibrations from rotating axles,with fundamental frequency proportional to vehicle speed, aretransmitted via the vehicle chassis. Using an accelerometer, these vibrations can be tracked to estimate vehicle speed whileother sources of vibrations act as disturbances. A state-space model for the dynamics of the harmonics is presented andformulated such that there is a conditional linear-Gaussiansubstructure, enabling efficient Rao-Blackwellized methods. Avariant of the Rao-Blackwellized point-mass filter is derived, significantly reducing computational complexity, and reducingthe memory requirements from quadratic to linear in thenumber of grid points. It is applied to experimental data from the sensor cluster of a car and validated using therotational frequency from WSS data. The proposed methodshows improved performance and robustness in comparisonto a Rao-Blackwellized particle filter implementation and afrequency spectrum maximization method.

A first course in Automatic control is presented.  A main objective of the course is to put most of the emphasis on the Implement and Operate phases in the process of developing a control system for a process. The course is built around a large amount of student active learning based on three extensive laboratory exercises, where each laboratory exercise can have duration of up to two weeks. For each of the laboratory exercises there is a sequence of learning activities supporting the students’ learning: Introductory lecture, problem solving session, preparation work, help-desk session, independent work in the laboratory, and a final demonstration of the control system. In addition there is a small project where the task is to write a manual for a process operator. The laboratory tasks involve implementation of a control system in an industrial PLC (Programmable Logic Controller) and development of an operator interface.

Parametric Cramer-Rao lower bounds (CRLBs) are given for discrete-time systems with non-zero process noise. Recursive expressions for the conditional bias and mean-square-error (MSE) (given a specific state sequence) are obtained for Kalman filter estimating the states of a linear Gaussian system. It is discussed that Kalman filter is conditionally biased with a non-zero process noise realization in the given state sequence. Recursive parametric CRLBs are obtained for biased estimators for linear state estimators of linear Gaussian systems. Simulation studies are conducted where it is shown that Kalman filter is not an efficient estimator in a conditional sense.

This paper investigates the usefulness of multi-frequency received signal strength (RSS) for indoor localization. Acollected set of data from four sites containing 7 frequencies fromdual receivers and a high accuracy reference positioning systemis presented. The collected data is also made publicly availablethrough ResearchGate. The data is analyzed with respect tospatial variations using Gaussian processes ( GP ). The resultsshow that there are more rapid signal variations across corridorsthan along them. The uniqueness of RSS fingerprints is analyzedsuggesting that sequences of measurements in smoothing, orsmoothing-like, algorithms that can handle temporary positionambiguities are likely the best choice for localization applications.

In many practical applications of system identification, it is not feasible to measure both the inputs applied to the system as well as the output. In such situations, it is desirable to estimate both the inputs and the dynamics of the system simultaneously; this is known as the blind identification problem. In this paper, we provide a novel extension of subspace methods to the blind identification of multiple-input multiple-output linear systems. We assume that our inputs lie in a known subspace, and we are able to formulate the identification problem as rank constrained optimization, which admits a convex relaxation. We show the efficacy of this formulation with a numerical example.