The ensemble Kalman filter (EnKF) is a Monte Carlo-based implementation of the Kalman filter (KF) for extremely high-dimensional, possibly nonlinear, and non-Gaussian state estimation problems. Its ability to handle state dimensions in the order of millions has made the EnKF a popular algorithm in different geoscientific disciplines. Despite a similarly vital need for scalable algorithms in signal processing, e.g., to make sense of the ever increasing amount of sensor data, the EnKF is hardly discussed in our field. This self-contained review is aimed at signal processing researchers and provides all the knowledge to get started with the EnKF. The algorithm is derived in a KF framework, without the often encountered geoscientific terminology. Algorithmic challenges and required extensions of the EnKF are provided, as well as relations to sigma point KF and particle filters. The relevant EnKF literature is summarized in an extensive survey and unique simulation examples, including popular benchmark problems, complement the theory with practical insights. The signal processing perspective highlights new directions of research and facilitates the exchange of potentially beneficial ideas, both for the EnKF and high-dimensional nonlinear and non-Gaussian filtering in general.

Passive magnetic sensors measure the magnetic field density in three axes and are often integrated on a single chip. These low-cost sensors are widely used in car navigation as well as in battery powered navigation equipment such as smartphones as part of an electronic compass. We focus on a train localization application with multiple, exclusively onboard sensors and a track map. This approach is considered as a base technology for future railway applications such as collision avoidance systems or autonomous train driving. In this paper, we address the following question: how beneficial are passive magnetic measurements for train localization? We present and analyze measurements of two different magnetometers recorded on a regional train at regular passenger service. We show promising correlations of the measurements with the track positions and the traveled switch way. The processed data reveals that the railway environment has repeatable, location-dependent magnetic signatures. This is considered as a novel approach to train localization, as the use of these magnetic signals at first view is not obvious. The proposed methods based on passive magnetic measurements show a high potential to be integrated in new and existing train localization approaches.

Devising the planar routes of minimal length that are required to pass through predefined neighborhoods of target points plays an important role in reducing the missions operating cost. Two versions of the problem are considered. The first one assumes that the ordering of the targets is fixed a priori. In such a case, the optimal route is devised by solving a convex optimization problem formulated either as a second-order cone program or as a sum-of-squares optimization problem. Additional route properties, such as continuity and minimal curvature, are considered as well. The second version allows the ordering of the targets to be optimized to further reduce the route length. We show that such a problem can be solved by introducing additional binary variables, which allows the route to be designed using off-the-shelf mixed-integer solvers. A case study that shows that the proposed strategy is computationally tractable is presented.

This paper proposes a decentralized control strategy for the voltage regulation of islanded inverter-interfaced microgrids. We show that an inverter-interfaced microgrid under plug-and-play (PnP) functionality of distributed generations (DGs) can be cast as a linear time-invariant system subject to polytopic-type uncertainty. Then, by virtue of this novel description and use of the results from theory of robust control, the microgrid control system guarantees stability and a desired performance even in the case of PnP operation of DGs. The robust controller is a solution of a convex optimization problem. The main properties of the proposed controller are that: 1) it is fully decentralized and local controllers of DGs that use only local measurements; 2) the controller guarantees the stability of the overall system; 3) the controller allows PnP functionality of DGs in microgrids; and 4) the controller is robust against microgrid topology change. Various case studies, based on time-domain simulations in MATLAB/SimPowerSystems Toolbox, are carried out to evaluate the performance of the proposed control strategy in terms of voltage tracking, microgrid topology change, PnP capability features, and load changes.

A common issue with many system identification problems is that the true input to the system is unknown. This paper extends a previously presented indirect modelling framework that deals with identification of systems where the input is partially or fully unknown. In this framework, unknown inputs are eliminated by using additional measurements that directly or indirectly contain information about the unknown inputs. The resulting indirect predictor model is only dependent on known and measured signals and can be used to estimate the desired dynamics or properties. Since the input of the indirect model contains both known inputs and measurements that could all be correlated with the same disturbances as the output, estimation of the indirect model has similar challenges as a closed-loop estimation problem. In fact, due to the generality of the indirect modelling framework, it unifies a number of already existing system identification problems that are contained as special cases. For completeness, the paper is concluded with one method that can be used to estimate the indirect model as well as an experimental verification to show the applicability of the framework.

Most navigation systems today rely on global navigation satellite systems (gnss), including in cars. With support from odometry and inertial sensors, this is a sufficiently accurate and robust solution, but there are future demands. Autonomous cars require higher accuracy and integrity. Using the car as a sensor probe for road conditions in cloud-based services also sets other kind of requirements. The concept of the Internet of Things requires stand-alone solutions without access to vehicle data. Our vision is a future with both invehicle localization algorithms and after-market products, where the position is computed with high accuracy in gnss-denied environments. We present a localization approach based on a prior that vehicles spend the most time on the road, with the odometer as the primary input. When wheel speeds are not available, we present an approach solely based on inertial sensors, which also can be used as a speedometer. The map information is included in a Bayesian setting using the particle filter (PF) rather than standard map matching. In extensive experiments, the performance without gnss is shown to have basically the same quality as utilizing a gnss sensor. Several topics are treated: virtual measurements, dead reckoning, inertial sensor information, indoor positioning, off-road driving, and multilevel positioning.

There is a big trend nowadays to use event-triggered proximity report for indoor positioning. This paper presents a generic received-signal-strength (RSS) threshold optimization framework for generating informative proximity reports. The proposed framework contains five main building blocks, namely the deployment information, RSS model, positioning metric selection, optimization process and management. Among others, we focus on Gaussian process regression (GPR)-based RSS models and positioning metric computation. The optimal RSS threshold is found through minimizing the best achievable localization root-mean-square-error formulated with the aid of fundamental lower bound analysis. Computational complexity is compared for different RSS models and different fundamental lower bounds. The resulting optimal RSS threshold enables enhanced performance of new fashioned low-cost and low-complex proximity report-based positioning algorithms. The proposed framework is validated with real measurements collected in an office area where bluetooth-low-energy (BLE) beacons are deployed.

The general Simultaneous Localisation and Mapping (SLAM) problem aims at estimating the state of a moving platform simultaneously with building a map of the local environment. There are essentially three classes of algorithms. EKF- SLAM and FastSLAM solve the problem on-line, while Nonlinear Least Squares (NLS) is a batch method. All of them scales badly with either the state dimension, the map dimension or the batch length. We investigate the EM algorithm for solving a generalized version of the NLS problem. This EM-SLAM algorithm solves two simpler problems iteratively, hence it scales much better with dimensions. The iterations switch between state estimation, where we propose an Extended Rauch-Tung-Striebel smoother, and map estimation, where a quasi-Newton method is suggested. The proposed method is evaluated in real experiments and also in simulations on a platform with a monocular camera attached to an inertial measurement unit. It is demonstrated to produce lower RMSE than with a standard Levenberg-Marquardt solver of NLS problem, at a computational cost that increases considerably slower. 

This paper presents a novel multi-sensor framework to efficiently identify, track, localise and map every piece of fruit in a commercial mango orchard. A multiple viewpoint approach is used to solve the problem of occlusion, thus avoiding the need for labour-intensive field calibration to estimate actual yield. Fruit are detected in images using a state-of-the-art faster R-CNN detector, and pair-wise correspondences are established between images using trajectory data provided by a navigation system. A novel LiDAR component automatically generates image masks for each canopy, allowing each fruit to be associated with the corresponding tree. The tracked fruit are triangulated to locate them in 3D, enabling a number of spatial statistics per tree, row or orchard block. A total of 522 trees and 71,609 mangoes were scanned on a Calypso mango orchard near Bundaberg, Queensland, Australia, with 16 trees counted by hand for validation, both on the tree and after harvest. The results show that single, dual and multi-view methods can all provide precise yield estimates, but only the proposed multi-view approach can do so without calibration, with an error rate of only 1.36% for individual trees.

1 Migratory songbirds carry an inherited capacity to migrate several thousand kilometers each year crossing continental landmasses and barriers between distant breeding sites and wintering areas. How individual songbirds manage with extreme precision to find their way is still largely unknown. The functional characteristics of biological compasses used by songbird migrants has mainly been investigated by recording the birds directed migratory activity in circular cages, so-called Emlen funnels. This method is 50 years old and has not received major updates over the past decades. The aim of this work was to compare the results from newly developed digital methods with the established manual methods to evaluate songbird migratory activity and orientation in circular cages. 2 We performed orientation experiments using the European robin (Erithacus rubecula) using modified Emlen funnels equipped with thermal paper and simultaneously recorded the songbird movements from above. We evaluated and compared the results obtained with five different methods. Two methods have been commonly used in songbirds orientation experiments; the other three methods were developed for this study and were based either on evaluation of the thermal paper using automated image analysis, or on the analysis of videos recorded during the experiment. 3 The methods used to evaluate scratches produced by the claws of birds on the thermal papers presented some differences compared with the video analyses. These differences were caused mainly by differences in scatter, as any movement of the bird along the sloping walls of the funnel was recorded on the thermal paper, whereas video evaluations allowed us to detect single takeoff attempts by the birds and to consider only this behavior in the orientation analyses. Using computer vision, we were also able to identify and separately evaluate different behaviors that were impossible to record by the thermal paper. 4 The traditional Emlen funnel is still the most used method to investigate compass orientation in songbirds under controlled conditions. However, new numerical image analysis techniques provide a much higher level of detail of songbirds migratory behavior and will provide an increasing number of possibilities to evaluate and quantify specific behaviors as new algorithms will be developed.

Geometric phases describe how in a continuous-time dynamical system the displacement of a variable (called phase variable) can be related to other variables (shape variables) undergoing a cyclic motion, according to an area rule. The aim of this paper is to show that geometric phases can exist also for discrete-time systems, and even when the cycles in shape space have zero area. A context in which this principle can be applied is stock trading. A zero-area cycle in shape space represents the type of trading operations normally carried out by high-frequency traders (entering and exiting a position on a fast time-scale), while the phase variable represents the cash balance of a trader. Under the assumption that trading impacts stock prices, even zero-area cyclic trading operations can induce geometric phases, i.e., profits or losses, without affecting the stock quote.

Background: The mode of action of a drug on its targets can often be classified as being positive (activator, potentiator, agonist, etc.) or negative (inhibitor, blocker, antagonist, etc.). The signed edges of a drug-target network can be used to investigate the combined mechanisms of action of multiple drugs on the ensemble of common targets. Results: In this paper it is shown that for the signed human drug-target network the majority of drug pairs tend to have synergistic effects on the common targets, i.e., drug pairs tend to have modes of action with the same sign on most of the shared targets, especially for the principal pharmacological targets of a drug. Methods are proposed to compute this synergism, as well as to estimate the influence of the drugs on the side effect of another drug. Conclusions: Enriching a drug-target network with information of functional nature like the sign of the interactions allows to explore in a systematic way a series of network properties of key importance in the context of computational drug combinatorics.

Inspired by ideas taken from the machine learning literature, new regularization techniques have been recently introduced in linear system identification. In particular, all the adopted estimators solve a regularized least squares problem, differing in the nature of the penalty term assigned to the impulse response. Popular choices include atomic and nuclear norms (applied to Hankel matrices) as well as norms induced by the so called stable spline kernels. In this paper, a comparative study of estimators based on these different types of regularizers is reported. Our findings reveal that stable spline kernels outperform approaches based on atomic and nuclear norms since they suitably embed information on impulse response stability and smoothness. This point is illustrated using the Bayesian interpretation of regularization. We also design a new class of regularizers defined by "integral" versions of stable spline/TC kernels. Under quite realistic experimental conditions, the new estimators outperform classical prediction error methods also when the latter are equipped with an oracle for model order selection. (C) 2016 Elsevier Ltd. All rights reserved.

It is a well-known fact that externally positive linear systems may fail to have a minimal positive realization. In order to investigate these cases, we introduce the notion of minimal eventually positive realization, for which the state update matrix becomes positive after a certain power. Eventually positive realizations capture the idea that in the impulse response of an externally positive system the state of a minimal realization may fail to be positive, but only transiently. As a consequence, we show that in discrete-time it is possible to use downsampling to obtain minimal positive realizations matching decimated sequences of Markov coefficients of the impulse response. In continuous-time, instead, if the sampling time is chosen sufficiently long, a minimal eventually positive realization leads always to a sampled realization which is minimal and positive.

In this letter, numerical algorithms for computing the marginal version of the Bayesian Cramér–Rao bound (M-BCRB) for jump Markov nonlinear systems and jump Markov linear Gaussian systems are proposed. Benchmark examples for both systems illustrate that the M-BCRB is tighter than three other recently proposed BCRBs

In this work we present a practical calibration algorithm that calibrates a magnetometer using inertial sensors. The calibration corrects for magnetometer sensor errors, for the presence of magnetic disturbances and for misalignment between the magnetometer and the inertial sensor axes. It is based on a maximum likelihood formulation and is formulated as an offline method. It is shown to give good results using data from two different commercially available sensor units. Using the calibrated magnetometer measurements in combination with the inertial sensors to determine orientation, is shown to lead to significantly improved heading estimates.

This study presents a new approach for optimal placement of synchronised phasor measurement units (PMUs) to ensure complete power system observability in the presence of non-synchronous conventional measurements and zero injections. Currently, financial or technical restrictions prohibit the deployment of PMUs on every bus, which in turn motivates their strategic placement across the power system. PMU allocation is optimised here based on measurement observability criteria for achieving solvability of the power system state estimation. Most of the previous work has proposed topological observability based methods for optimal PMU placement (OPP), which may not always ensure numerical observability required for successful execution of state estimation. The proposed OPP method finds out the minimum number and the optimal locations of PMUs required to make the power system numerically observable. The problem is formulated as a binary semi-definite programming (BSDP) model, with binary decision variables, minimising a linear objective function subject to linear matrix inequality observability constraints. The BSDP problem is solved using an outer approximation scheme based on binary integer linear programming. The developed method is conducted on IEEE standard test systems. A large-scale system with 3120 buses is also analysed to exhibit the applicability of proposed model to practical power system cases.

In simple organisms like E. coli, the metabolic response to an external perturbation passes through a transient phase in which the activation of a number of latent pathways can guarantee survival at the expenses of growth. Growth is gradually recovered as the organism adapts to the new condition. This adaptation can be modeled as a process of repeated metabolic adjustments obtained through the resilencings of the non-essential metabolic reactions, using growth rate as selection probability for the phenotypes obtained. The resulting metabolic adaptation process tends naturally to steer the metabolic fluxes towards high growth phenotypes. Quite remarkably, when applied to the central carbon metabolism of E. coli, it follows that nearly all flux distributions converge to the flux vector representing optimal growth, i.e., the solution of the biomass optimization problem turns out to be the dominant attractor of the metabolic adaptation process.

We present an adaptive smoother for linear state-space models with unknown process and measurement noise covariances. The proposed method utilizes the variational Bayes technique to perform approximate inference. The resulting smoother is computationally efficient, easy to implement, and can be applied to high dimensional linear systems. The performance of the algorithm is illustrated on a target tracking example.

Rod photoreceptors consist of an outer segment (OS) and an inner segment. Inside the OS a biochemical machinery transforms the rhodopsin photoisomerization into electrical signal. This machinery has been treated as and is thought to be homogenous with marginal inhomogeneities. To verify this assumption, we developed a methodology based on special tapered optical fibers (TOFs) to deliver highly localized light stimulations. By using these TOFs, specific regions of the rod OS could be stimulated with spots of light highly confined in space. As the TOF is moved from the OS base toward its tip, the amplitude of saturating and single photon responses decreases, demonstrating that the efficacy of the transduction machinery is not uniform and is 5–10 times higher at the base than at the tip. This gradient of efficacy of the transduction machinery is attributed to a progressive depletion of the phosphodiesterase along the rod OS. Moreover we demonstrate that, using restricted spots of light, the duration of the photoresponse along the OS does not increase linearly with the light intensity as with diffuse light.

In this paper, we propose using Gaussian processes to track an extended object or group of objects, that generates multiple measurements at each scan. The shape and the kinematics of the object are simultaneously estimated, and the shape is learned online via a Gaussian process. The proposed algorithm is capable of tracking different objects with different shapes within the same surveillance region. The shape of the object is expressed analytically, with well-defined confidence intervals, which can be used for gating and association. Furthermore, we use an efficient recursive implementation of the algorithm by deriving a state space model in which the Gaussian process regression problem is cast into a state estimation problem.

Filtering and smoothing algorithms for linear discrete-time state-space models with skewed and heavy-tailed measurement noise are presented. The algorithms use a variational Bayes approximation of the posterior distribution of models that have normal prior and skew-t-distributed measurement noise. The proposed filter and smoother are compared with conventional low-complexity alternatives in a simulated pseudorange positioning scenario. In the simulations the proposed methods achieve better accuracy than the alternative methods, the computational complexity of the filter being roughly 5 to 10 times that of the Kalman filter.

Today, the workflows that are involved in industrial assembly and production activities are becoming increasingly complex. To efficiently and safely perform these workflows is demanding on the workers, in particular when it comes to infrequent or repetitive tasks. This burden on the workers can be eased by introducing smart assistance systems. This article presents a scalable concept and an integrated system demonstrator designed for this purpose. The basic idea is to learn workflows from observing multiple expert operators and then transfer the learnt workflow models to novice users. Being entirely learning-based, the proposed system can be applied to various tasks and domains. The above idea has been realized in a prototype, which combines components pushing the state of the art of hardware and software designed with interoperability in mind. The emphasis of this article is on the algorithms developed for the prototype: 1) fusion of inertial and visual sensor information from an on-body sensor network (BSN) to robustly track the user’s pose in magnetically polluted environments; 2) learning-based computer vision algorithms to map the workspace, localize the sensor with respect to the workspace and capture objects, even as they are carried; 3) domain-independent and robust workflow recovery and monitoring algorithms based on spatiotemporal pairwise relations deduced from object and user movement with respect to the scene; and 4) context-sensitive augmented reality (AR) user feedback using a head-mounted display (HMD). A distinguishing key feature of the developed algorithms is that they all operate solely on data from the on-body sensor network and that no external instrumentation is needed. The feasibility of the chosen approach for the complete action-perception-feedback loop is demonstrated on three increasingly complex datasets representing manual industrial tasks. These limited size datasets indicate and highlight the potential of the chosen technology as a combined entity as well as point out limitations of the system.

We study cooperative sensor network localization in a realistic scenario where 1) the underlying measurement errors more probably follow a non-Gaussian distribution; 2) the measurement error distribution is unknown without conducting massive offline calibrations; and 3) non-line-of-sight identification is not performed due to the complexity constraint and/or storage limitation. The underlying measurement error distribution is approximated parametrically by a Gaussian mixture with finite number of components, and the expectation-conditional maximization (ECM) criterion is adopted to approximate the maximum-likelihood estimator of the unknown sensor positions and an extra set of Gaussian mixture model parameters. The resulting centralized ECM algorithms lead to easier inference tasks and meanwhile retain several convergence properties with a proof of the "space filling" condition. To meet the scalability requirement, we further develop two distributed ECM algorithms where an average consensus algorithm plays an important role for updating the Gaussian mixture model parameters locally. The proposed algorithms are analyzed systematically in terms of computational complexity and communication overhead. Various computer based tests are also conducted with both simulation and experimental data. The results pin down that the proposed distributed algorithms can provide overall good performance for the assumed scenario even under model mismatch, while the existing competing algorithms either cannot work without the prior knowledge of the measurement error statistics or merely provide degraded localization performance when the measurement error is clearly non-Gaussian.

For communities of agents which are not necessarily cooperating, distributed processes of opinion forming are naturally represented by signed graphs, with positive edges representing friendly and cooperative interactions and negative edges the corresponding antagonistic counterpart. Unlike for nonnegative graphs, the outcome of a dynamical system evolving on a signed graph is not obvious and it is in general difficult to characterize, even when the dynamics are linear. In this paper, we identify a significant class of signed graphs for which the linear dynamics are however predictable and show many analogies with positive dynamical systems. These cases correspond to adjacency matrices that are eventually positive, for which the Perron-Frobenius property still holds and implies the existence of an invariant cone contained inside the positive orthant. As examples of applications, we determine cases in which it is possible to anticipate or impose unanimity of opinion in decision/voting processes even in presence of stubborn agents, and show how it is possible to extend the PageRank algorithm to include negative links.

In optimization algorithms used for on-line Model Predictive Control (MPC), linear systems of equations are often solved in each iteration. This is true both for Active Set methods as well as for Interior Point methods, and for linear MPC as well as for nonlinear MPC and hybrid MPC. The main computational effort is spent while solving these linear systems of equations, and hence, it is of greatest interest to solve them efficiently. Classically, the optimization problem has been formulated in either of two ways. One leading to a sparse linear system of equations involving relatively many variables to compute in each iteration and another one leading to a dense linear system of equations involving relatively few variables. In this work, it is shown that it is possible not only to consider these two distinct choices of formulations. Instead it is shown that it is possible to create an entire family of formulations with different levels of sparsity and number of variables, and that this extra degree of freedom can be exploited to obtain even better performance with the software and hardware at hand. This result also provides a better answer to a recurring question in MPC; should the sparse or dense formulation be used.

This paper addresses one of the main challenges in physical activity monitoring, as indicated by recent benchmark results: The difficulty of the complex classification problems exceeds the potential of existing classifiers. Therefore, this paper proposes the ConfAdaBoost.M1 algorithm. This algorithm is a variant of the AdaBoost.M1 that incorporates well-established ideas for confidence-based boosting. ConfAdaBoost.M1 is compared to the most commonly used boosting methods using benchmark datasets from the UCI machine learning repository.  Moreover, it is evaluated on an activity recognition and an intensity estimation problem, including a large number of physical activities from the recently released PAMAP2 dataset. The presented results indicate that the proposed ConfAdaBoost.M1 algorithm significantly improves the classification performance on most of the evaluated datasets, especially for larger and more complex classification tasks. Finally, two empirical studies are designed and carried out to investigate the feasibility of ConfAdaBoost.M1 for physical activity monitoring applications in mobile systems.

Particle Metropolis-Hastings (PMH) allows for Bayesian parameter inference in nonlinear state space models by combining MCMC and particle filtering. The latter is used to estimate the intractable likelihood. In its original formulation, PMH makes use of a marginal MCMC proposal for the parameters, typically a Gaussian random walk. However, this can lead to a poor exploration of the parameter space and an inefficient use of the generated particles.

We propose two alternative versions of PMH that incorporate gradient and Hessian information about the posterior into the proposal. This information is more or less obtained as a byproduct of the likelihood estimation. Indeed, we show how to estimate the required information using a fixed-lag particle smoother, with a computational cost growing linearly in the number of particles. We conclude that the proposed methods can: (i) decrease the length of the burn-in phase, (ii) increase the mixing of the Markov chain at the stationary phase, and (iii) make the proposal distribution scale invariant which simplifies tuning.

A method for fusing Synthetic Aperture Radar (SAR) images with opticalaerial images is presented. This is done in a navigation framework, where the absolute position and orientation of the flying platform, as computed from the inertial navigation system, is corrected based on the aerial image coordinates taken as ground truth. The method is suitable for new low-price SAR systems for small unmanned vehicles. The primary application is remote sensing, where the SAR image provides one further "colour" channel revealing reflectivity to radio waves. The method is based on first applying an edge detection algorithm to the images and then optimising the most important navigation states by matching the two binary images. To get a measure of the estimation uncertainty, we embed the optimisation in a least squares framework, where an explicit method to estimate the (relative) size of the errors is presented. The performance is demonstrated on real SAR and aerial images, leading to an error of only a few pixels.

We propose a method for model reduction on a given frequency range, without the use of input and output filter weights. The method uses a nonlinear optimization approach to minimize a frequency limited H2 like cost function. An important contribution of the paper is the derivation of the gradient of the proposed cost function. The fact that we have a closed form expression for the gradient and that considerations have been taken to make the gradient computationally efficient to compute enables us to efficiently use off-the-shelf optimization software to solve the optimization problem. © 2014 Elsevier B.V. All rights reserved.

Model estimation and structure detection with short data records are two issues that receive increasing interests in System Identification. In this paper, a multiple kernel-based regularization method is proposed to handle those issues. Multiple kernels are conic combinations of fixed kernels suitable for impulse response estimation, and equip the kernel-based regularization method with three features. First, multiple kernels can better capture complicated dynamics than single kernels. Second, the estimation of their weights by maximizing the marginal likelihood favors sparse optimal weights, which enables this method to tackle various structure detection problems, e. g., the sparse dynamic network identification and the segmentation of linear systems. Third, the marginal likelihood maximization problem is a difference of convex programming problem. It is thus possible to find a locally optimal solution efficiently by using a majorization minimization algorithm and an interior point method where the cost of a single interior-point iteration grows linearly in the number of fixed kernels. Monte Carlo simulations show that the locally optimal solutions lead to good performance for randomly generated starting points.

This paper presents a new prediction update for extended targets whose extensions are modeled as random matrices. The prediction is based on several minimizations of the Kullback-Leibler divergence (KL-div) and allows for a kinematic state dependent transformation of the target extension. The results show that the extension prediction is a significant improvement over the previous work carried out on the topic.

In this paper we describe an approach to maximum likelihood estimation of linear single input single output (SISO) models when both input and output data are missing. The criterion minimised in the algorithms is the Euclidean norm of the prediction error vector scaled by a particular function of the covariance matrix of the observed output data. We also provide insight into when simpler and in general sub-optimal schemes are indeed optimal. The algorithm has been prototyped in MATLAB, and we report numerical results that support the theory.

In this paper, we consider robust stability analysis of large-scale sparsely interconnected uncertain systems. By modeling the interconnections among the subsystems with integral quadratic constraints, we show that robust stability analysis of such systems can be performed by solving a set of sparse linear matrix inequalities. We also show that a sparse formulation of the analysis problem is equivalent to the classical formulation of the robustness analysis problem and hence does not introduce any additional conservativeness. The sparse formulation of the analysis problem allows us to apply methods that rely on efficient sparse factorization techniques, and our numerical results illustrate the effectiveness of this approach compared to methods that are based on the standard formulation of the analysis problem.

The effects of wear to friction are studied based on constant-speed friction data collected from dedicated experiments during accelerated wear tests. It is shown how the effects of temperature and load uncertainties produce larger changes to friction than those caused by wear, motivating the consideration of these effects. Based on empirical observations, an extended friction model is proposed to describe the effects of speed, load, temperature, and wear. Assuming the availability of such a model and constant-speed friction data, a maximum likelihood wear estimator is proposed. The performance of the wear estimator under load and temperature uncertainties is found by means of simulations and verified under three case studies based on real data. Practical issues related to experiment length are considered based on an optimal selection of speed points to collect friction data, improving the achievable performance bound for any unbiased wear estimator. As it is shown, reliable wear estimates can be achieved even under load and temperature uncertainties, making condition-based maintenance of industrial robots possible.

Anomaly detection in large populations is a challenging but highly relevant problem. It is essentially a multi-hypothesis problem, with a hypothesis for every division of the systems into normal and anomalous systems. The number of hypothesis grows rapidly with the number of systems and approximate solutions become a necessity for any problem of practical interest. In this paper we take an optimization approach to this multi-hypothesis problem. It is first shown to be equivalent to a non-convex combinatorial optimization problem and then is relaxed to a convex optimization problem that can be solved distributively on the systems and that stays computationally tractable as the number of systems increase. An interesting property of the proposed method is that it can under certain conditions be shown to give exactly the same result as the combinatorial multi-hypothesis problem and the relaxation is hence tight.

In this paper, we address the problem of multi-target detection and tracking over a network of separately located Doppler-shift measuring sensors. For this challenging problem, we propose to use the probability hypothesis density (PHD) filter and present two implementations of the PHD filter, namely the sequential Monte Carlo PHD (SMC-PHD) and the Gaussian mixture PHD (GM-PHD) filters. Performances of both filters are carefully studied and compared for the considered challenging tracking problem. Simulation results show that both PHD filter implementations successfully track multiple targets using only Doppler shift measurements. Moreover, as a proof-of-concept, an experimental setup consisting of a network of microphones and a loudspeaker was prepared. Experimental study results reveal that it is possible to track multiple ground targets using acoustic Doppler shift measurements in a passive multi-static scenario. We observed that the GM-PHD is more effective, efficient and easy to implement than the SMC-PHD filter.

Most of the currently used techniques for linear system identification are based on classical estimation paradigms coming from mathematical statistics. In particular, maximum likelihood and prediction error methods represent the mainstream approaches to identification of linear dynamic systems, with a long history of theoretical and algorithmic contributions. Parallel to this, in the machine learning community alternative techniques have been developed. Until recently, there has been little contact between these two worlds. The first aim of this survey is to make accessible to the control community the key mathematical tools and concepts as well as the computational aspects underpinning these learning techniques. In particular, we focus on kernel-based regularization and its connections with reproducing kernel Hilbert spaces and Bayesian estimation of Gaussian processes. The second aim is to demonstrate that learning techniques tailored to the specific features of dynamic systems may outperform conventional parametric approaches for identification of stable linear systems.

Random set based methods have provided a rigorous Bayesian framework and have been used extensively in the last decade for point object estimation. In this paper, we emphasize that the same methodology offers an equally powerful approach to estimation of so called extended objects, i.e., objects that result in multiple detections on the sensor side. Building upon the analogy between Bayesian state estimation of a single object and random finite set estimation for multiple objects, we give a tutorial on random set methods with an emphasis on multiple extended object estimation. The capabilities are illustrated on a simple yet insightful real life example with laser range data containing several occlusions.

We consider robust geolocation in mixed line-of-sight (LOS)/non-LOS (NLOS) environments in cellular radio networks. Instead of assuming known propagation channel states (LOS or NLOS), we model the measurement error with a general two-mode mixture distribution although it deviates from the underlying error statistics. To avoid offline calibration, we propose to jointly estimate the geographical coordinates and the mixture model parameters. Two iterative algorithms are developed based on the well-known expectation-maximization (EM) criterion and joint maximum a posteriori-maximum likelihood (JMAP-ML) criterion to approximate the ideal maximum-likelihood estimator (MLE) of the unknown parameters with low computational complexity. Along with concrete examples, we elaborate the convergence analysis and the complexity analysis of the proposed algorithms. Moreover, we numerically compute the Cramer-Rao lower bound (CRLB) for our joint estimation problem and present the best achievable localization accuracy in terms of the CRLB. Various simulations have been conducted based on a real-world experimental setup, and the results have shown that the ideal MLE can be well approximated by the JMAP-ML algorithm. The EM estimator is inferior to the JMAP-ML estimator but outperforms other competitors by far.

An important class of optimisation problems in control and signal processing involves the constraint that a Popov function is non-negative on the unit circle or the imaginary axis. Such a constraint is convex in the coefficients of the Popov function. It can be converted to a finite-dimensional linear matrix inequality via the Kalman-Yakubovich-Popov lemma. However, the linear matrix inequality reformulation requires an auxiliary matrix variable and often results in a very large semidefinite programming problem. Several recently published methods exploit problem structure in these semidefinite programmes to alleviate the computational cost associated with the large matrix variable. These algorithms are capable of solving much larger problems than general-purpose semidefinite programming packages. In this paper, we address the same problem by presenting an alternative to the linear matrix inequality formulation of the non-negative Popov function constraint. We sample the constraint to obtain an equivalent set of inequalities of low dimension, thus avoiding the large matrix variable in the linear matrix inequality formulation. Moreover, the resulting semidefinite programme has constraints with low-rank structure, which allows the problems to be solved efficiently by existing semidefinite programming packages. The sampling formulation is obtained by first expressing the Popov function inequality as a sum-of-squares condition imposed on a polynomial matrix and then converting the constraint into an equivalent finite set of interpolation constraints. A complexity analysis and numerical examples are provided to demonstrate the performance improvement over existing techniques.

We present an approach for computing the driving direction of a vehicle by processing measurements from one 2-axis magnetometer. The proposed method relies on a non-linear transformation of the measurement data comprising only two inner products. Deterministic analysis of the signal model reveals how the driving direction affects the measurement signal and the proposed classifier is analyzed in terms of its statistical properties. The method is compared with a model based likelihood test using both simulated and experimental data. The experimental verification indicates that good performance is achieved under the presence of saturation, measurement noise, and near field effects.

This paper considers the problem of dynamic modeling and identification of robot manipulators with respect to their elasticities. The so-called flexible joint model, modeling only the torsional gearbox elasticity, is shown to be insufficient for modeling a modern industrial manipulator accurately. The extended flexible joint model, where non-actuated joints are added to model the elasticity of the links and bearings, is used to improve the model accuracy. The unknown elasticity parameters are estimated using a frequency domain gray-box identification method. The conclusion is that the obtained model describes the movements of the motors and the tool mounted on the robot with significantly higher accuracy. Similar elasticity model parameters are obtained when using two different output variables for the identification, the motor position and the tool acceleration.

The classical shift retrieval problem considers two signals in vector form that are related by a shift. This problem is of great importance in many applications and is typically solved by maximizing the cross-correlation between the two signals. Inspired by compressive sensing, in this paper, we seek to estimate the shift directly from compressed signals. We show that under certain conditions, the shift can be recovered using fewer samples and less computation compared to the classical setup. We also illustrate the concept of superresolution for shift retrieval. Of particular interest is shift estimation from Fourier coefficients. We show that under rather mild conditions only one Fourier coefficient suffices to recover the true shift.

Monte Carlo methods, in particular those based on Markov chains and on interacting particle systems, are by now tools that are routinely used in machine learning. These methods have had a profound impact on statistical inference in a wide range of application areas where probabilistic models are used. Moreover, there are many algorithms in machine learning which are based on the idea of processing the data sequentially, first in the forward direction and then in the backward direction. In this tutorial we will review a branch of Monte Carlo methods based on the forward-backward idea, referred to as backward simulators. These methods are useful for learning and inference in probabilistic models containing latent stochastic processes. The theory and practice of backward simulation algorithms have undergone a significant development in recent years and the algorithms keep finding new applications. The foundation for these methods is sequential Monte Carlo (SMC). SMC-based backward simulators are capable of addressing smoothing problems in sequential latent variable models, such as general, nonlinear/non-Gaussian state-space models (SSMs). However, we will also clearly show that the underlying backward simulation idea is by no means restricted to SSMs. Furthermore, backward simulation plays an important role in recent developments of Markov chain Monte Carlo (MCMC) methods. Particle MCMC is a systematic way of using SMC within MCMC. In this framework, backward simulation gives us a way to significantly improve the performance of the samplers. We review and discuss several related backward-simulation-based methods for state inference as well as learning of static parameters, both using a frequentistic and a Bayesian approach.

Boundary effects in iterative learning control (ILC) algorithms are considered in this article. ILC algorithms involve filtering of input and error signals over finite-time intervals, often using non-causal filters, and it is important that the boundary effects of the filtering operations are handled in an appropriate way. The topic is studied using both a proposed theoretical framework and simulations, and it is shown that the method for handling the boundary effects has impact on the stability and convergence properties of the ILC algorithm.

This paper gives an overview of the identificationof linear systems. It covers the classical approach ofparametric methods by means of maximum likelihood andpredicion error methods, as well all classical non-parametricmethods through spectral analysis. It also covers very recenttechniques dealing with convex formulations by regularizationof FIR and ARX models, as well as new alternatives tospectral analysis, through local linear models. An example of identification of aircraft dynamics illustrates the approaches.

We present a novel method for Wiener system identification. The method relies on a semiparametric, i.e. a mixed parametric/nonparametric, model of a Wiener system. We use a state-space model for the linear dynamical system and a nonparametric Gaussian process model for the static nonlinearity. We avoid making strong assumptions, such as monotonicity, on the nonlinear mapping. Stochastic disturbances, entering both as measurement noise and as process noise, are handled in a systematic manner. The nonparametric nature of the Gaussian process allows us to handle a wide range of nonlinearities without making problem-specific parameterizations. We also consider sparsity-promoting priors, based on generalized hyperbolic distributions, to automatically infer the order of the underlying dynamical system. We derive an inference algorithm based on an efficient particle Markov chain Monte Carlo method, referred to as particle Gibbs with ancestor sampling. The method is profiled on two challenging identification problems with good results. Blind Wiener system identification is handled as a special case.

This paper presents a cardinalized probability hypothesis density (CPHD) filter for extended targets that can result in multiple measurements at each scan. The probability hypothesis density (PHD) filter for such targets has been derived by Mahler, and different implementations have been proposed recently. To achieve better estimation performance this work relaxes the Poisson assumptions of the extended target PHD filter in target and measurement numbers. A gamma Gaussian inverse Wishart mixture implementation, which is capable of estimating the target extents and measurement rates as well as the kinematic state of the target, is proposed, and it is compared to its PHD counterpart in a simulation study. The results clearly show that the CPHD filter has a more robust cardinality estimate leading to smaller OSPA errors, which confirms that the extended target CPHD filter inherits the properties of its point target counterpart.

In many applications, design or analysis is performed over a finite-frequency range of interest. The importance of the H₂ norm highlights the necessity of computing this norm accordingly. This paper provides different methods for computing upper bounds of the robust finite-frequency H₂ norm for systems with structured uncertainties. An application of the robust finite-frequency H₂ norm for a comfort analysis problem of an aero-elastic model of an aircraft is also presented.

This paper proposes a general convex framework for the identification of switched linear systems. The proposed framework uses over-parameterization to avoid solving the otherwise combinatorially forbidding identification problem, and takes the form of a least-squares problem with a sum-of-norms regularization, a generalization of the ℓ₁-regularization. The regularization constant regulates the complexity and is used to trade off the fit and the number of submodels.

The Quantization Theorem I (QT I) implies that the likelihood function can be reconstructed from quantized sensor observations, given that appropriate dithering noise is added before quantization. We present constructive algorithms to generate such dithering noise. The application to maximum likelihood estimation (mle) is studied in particular. In short, dithering has the same role for amplitude quantization as an anti-alias filter has for sampling, in that it enables perfect reconstruction of the dithered but unquantized signal’s likelihood function. Without dithering, the likelihood function suffers from a kind of aliasing expressed as a counterpart to Poisson’s summation formula which makes the exact mle intractable to compute. With dithering, it is demonstrated that standard mle algorithms can be re-used on a smoothed likelihood function of the original signal, and statistically efficiency is obtained. The implication of dithering to the Cramér–Rao Lower Bound (CRLB) is studied, and illustrative examples are provided.

This paper develops and illustrates a new maximum-likelihood based method for the identification of Hammerstein-Wiener model structures. A central aspect is that a very general situation is considered wherein multivariable data, non-invertible Hammerstein and Wiener nonlinearities, and colored stochastic disturbances both before and after the Wiener nonlinearity are all catered for. The method developed here addresses the blind Wiener estimation problem as a special case.

This paper presents a model-based phase-only predistortion method suitable for outphasing radio frequency (RF) power amplifiers (PA). The predistortion method is based on a model of the amplifier with a constant gain factor and phase rotation for each outphasing signal, and a predistorter with phase rotation only. Exploring the structure of the outphasing PA, the problem can be reformulated from a nonconvex problem into a convex least-squares problem, and the predistorter can be calculated analytically. The method has been evaluted for 5MHz Wideband Code-Division Multiple Access (WCDMA) and Long Term Evolution (LTE) uplink signals with Peak-to-Average Power Ratio (PAPR) of 3.5 dB and 6.2 dB, respectively, applied to a fully integrated Class-D outphasing RF PA in 65nm CMOS. At 1.95 GHz for a 5.5V supply voltage, the measured output power of the PA was +29.7dBm with a power-added efficiency (PAE) of 26.6 %. For the WCDMA signal with +26.0dBm of channel power, the measured Adjacent Channel Leakage Ratio (ACLR) at 5MHz and 10MHz offsets were -46.3 dBc and -55.6 dBc with predistortion, compared to -35.5 dBc and -48.1 dBc without predistortion. For the LTE signal with +23.3dBm of channel power, the measured ACLR at 5MHz offset was -43.5 dBc with predistortion, compared to -34.1 dBc without predistortion.

Received signal strength (RSS) can be used in sensor networks as a ranging measurement for positioning and localization applications. This contribution studies the realistic situation where neither the emitted power nor the power law decay exponent be assumed to be known. The application in mind is a rapidly deployed network consisting of a number of sensor nodes with low-bandwidth communication, each node measuring RSS of signals traveled through air (microphones) and ground (geophones). The first contribution concerns validation of a model in logarithmic scale, that is, linear in the unknown nuisance parameters (emitted power and power loss constant). The parameter variation is studied over time and space. The second contribution is a localization algorithm based on this model, where the separable least squares principle is applied to the non-linear least squares (NLS) cost function, after which a cost function of only the unknown position is obtained. Results from field trials are presented to illustrate the method, together with fundamental performance bounds. The ambition is to pave the way for sensor configuration design and more thorough performance evaluations as well as filtering and target tracking aspects.

We consider the smoothing problem for a general state space system using sequential Monte Carlo(SMC) methods. The marginal smoother is assumed to be available in the form of weighted randomparticles from the SMC output. New algorithms are developed to extract the smoothed marginal maximuma posteriori (MAP) estimate of the state from the existing marginal particle smoother. Our method doesnot need any kernel fitting to obtain the posterior density from the particle smoother. The proposedestimator is then successfully applied to find the unknown initial state of a dynamical system and toaddress the issue of parameter estimation problem in state space models

In this paper we derive the maximum likelihood problem for missing data from a Gaussian model. We present in total eight different equivalent formulations of the resulting optimization problem, four out of which are nonlinear least squares formulations. Among these formulations are also formulations based on the expectation-maximization algorithm. Expressions for the derivatives needed in order to solve the optimization problems are presented. We also present numerical comparisons for two of the formulations for an ARMAX model.

This paper presents a Gaussian-mixture implementation of the phd filter for tracking extended targets. The exact filter requires processing of all possible measurement set partitions, which is generally infeasible to implement. A method is proposed for limiting the number of considered partitions and possible alternatives are discussed. The implementation is used on simulated data and in experiments with real laser data, and the advantage of the filter is illustrated. Suitable remedies are given to handle spatially close targets and target occlusion.

Intrigued by some recent results on impulse response estimation by kernel and nonparametric techniques, we revisit the old problem of transfer function estimation from input-output measurements. We formulate a classical regularization approach, focused on finite impulse response (FIR) models, and find that regularization is necessary to cope with the high variance problem. This basic, regularized least squares approach is then a focal point for interpreting other techniques, like Bayesian inference and Gaussian process regression. The main issue is how to determine a suitable regularization matrix (Bayesian prior or kernel). Several regularization matrices are provided and numerically evaluated on a data bank of test systems and data sets. Our findings based on the data bank are as follows. The classical regularization approach with carefully chosen regularization matrices shows slightly better accuracy and clearly better robustness in estimating the impulse response than the standard approach - the prediction error method/maximum likelihood (PEM/ML) approach. If the goal is to estimate a model of given order as well as possible, a low order model is often better estimated by the PEM/ML approach, and a higher order model is often better estimated by model reduction on a high order regularized FIR model estimated with careful regularization. Moreover, an optimal regularization matrix that minimizes the mean square error matrix is derived and studied. The importance of this result lies in that it gives the theoretical upper bound on the accuracy that can be achieved for this classical regularization approach.

In optimization routines used for on-line Model Predictive Control (MPC), linear systems of equations are solved in each iteration. This is true both for Active Set (AS) solvers as well as for Interior Point (IP) solvers, and for linear MPC as well as for nonlinear MPC and hybrid MPC. The main computational effort is spent while solving these linear systems of equations, and hence, it is of great interest to solve them efficiently. In high performance solvers for MPC, this is performed using Riccati recursions or generic sparsity exploiting algorithms. To be able to get this performance gain, the problem has to be formulated in a sparse way which introduces more variables. The alternative is to use a smaller formulation where the objective function Hessian is dense. In this work, it is shown that it is possible to exploit the structure also when using the dense formulation. More specifically, it is shown that it is possible to efficiently compute a standard Cholesky factorization for the dense formulation. This results in a computational complexity that grows quadratically in the prediction horizon length instead of cubically as for the generic Cholesky factorization.

The presence of abrupt changes, such as impulsive and load disturbances, commonly occur in applications, but make the state estimation problem considerably more difficult than in the standard setting with Gaussian process disturbance. Abrupt changes often introduce a jump in the state, and the problem is therefore readily and often treated by change detection techniques. In this paper, we take a different approach. The state smoothing problem for linear state space models is here formulated as a constrained least-squares problem with sum-of-norms regularization, a generalization of l1-regularization. This novel formulation can be seen as a convex relaxation of the well known generalized likelihood ratio method by Willsky and Jones. Another nice property of the suggested formulation is that it only has one tuning parameter, the regularization constant which is used to trade off fit and the number of jumps. Good practical choices of this parameter along with an extension to nonlinear state space models are given. 

Localization is an enabling technology in many applications and services today and in the future. Satellite navigation often works fine for navigation, infotainment and location based services, and it is today the dominating solution in commercial products. A nice exception is the localization in Google Maps, where radio signal strength from WiFi and cellular networks are used as complementary information to increase accuracy and integrity. With the on-going trend with more autonomous functions being introduced in our vehicles and with all our connected devices, most of them operated in indoor enviroments where satellite signals are not available,there is an acute need for new solutions.

At the same time, our smartphones are getting more sophisticated in their sensor configuration. Therefore, in this chapter we present a freely available Sensor Fusion app developed in-house, how it works, how it has been used, and how it can be used based on a variety of applications in our research and student projects.

It is a well-known fact that exercising helps people improve their overall well-being; both physiological and psychological health. Regular moderate physical activity improves the risk of disease progression, improves the chances for successful rehabilitation, and lowers the levels of stress hormones. Physical fitness can be categorized in cardiovascular fitness, and muscular strength and endurance. A proper balance between aerobic activities and strength exercises are important to maximize the positive effects. This balance is not always easily obtained, so assistance tools are important. Hence, ambient assisted living (AAL) systems that support and motivate balanced training are desirable. This chapter presents methods to provide this, focusing on the methodologies and concepts implemented by the authors in the physical activity monitoring for aging people (PAMAP) platform. The chapter sets the stage for an architecture to provide personalized activity monitoring using a network of wearable sensors, mainly inertial measurement units (IMU). The main focus is then to describe how to do this in a personalizable way: (1) monitoring to provide an estimate of aerobic activities performed, for which a boosting based method to determine activity type, intensity, frequency, and duration is given; (2) supervise and coach strength activities. Here, methodologies are described for obtaining the parameters needed to provide real-time useful feedback to the user about how to exercise safely using the right technique.

In this chapter parallel implementations of hybrid MPC will be discussed. Different methods for achieving parallelism at different levels of the algorithms will be surveyed. It will be seen that there are many possible ways of obtaining parallelism for hybrid MPC, and it is by no means clear which possibilities that should be utilized to achieve the best possible performance. To answer this question is a challenge for future research.

The Military Institute of Engineering (IME) is a Brazilian Army higher education institution, located in Rio de Janeiro – Brazil. Every three years, the Brazilian government evaluates the engineering bachelor´s degree programs and IME is always among the best Brazilian engineering schools. Despite the excellent results, the CDIO framework was chosen, at the end of 2014, as a reference framework to improve the education process, reorganize the programs and promote the development of intra and interpersonal skills. The objective of this work is to show the initial steps of the CDIO  implementation. In the beginning of the process, the idea was to start only with the Mechanical Engineering program. However, after the initial promotion seminars presented for faculty, staff and students, a sense of commitment was created, and four of ten undergraduate programs also decided to participate. One of the first step was the formation of the team responsible to coordinate the implementation of this set of best practices. The Kotter framework has been used to drive this transformation process. The CDIO syllabus was translated into Portuguese, and it was compared with some of the Brazilian regulatory requirements for engineering education and has been used as a reference for future curriculum changes. This paper also highlights the process for change management, the remodeling of the first year and the introduction of an entrepreneurship course in partnership with an outstanding Brazilian business school.

In this paper, an approach to estimate the mass of a quadcopter using only inertial measurements and pilot commands is presented. For this purpose, a lateral dynamic model describing the relation between the roll rate and the lateral acceleration is formulated. Due to the quadcopter’s inherent instability, a controller is used to stabilize the system and the data is collected in closed loop. Under the effect of feedback and disturbances, the inertial measurements used as input and output are correlated with the disturbances, which complicates the parameter estimation. The parameters of the model are estimated using several methods. The simulation and experimental results show that the instrumental-variable method has the best potential to estimate the mass of the quadcopter in this setup.

This paper presents three iterative methods for orientation estimation. The first two are based on iterated Extended Kalman filter (IEKF) formulations with different state representations. The first is using the well-known unit quaternion as state (q-IEKF) while the other is using orientation deviation which we call IMEKF. The third method is based on nonlinear least squares (NLS) estimation of the angular velocity which is used to parametrise the orientation. The results are obtained using Monte Carlo simulations and the comparison is done with the non-iterative EKF and multiplicative EKF (MEKF) as baseline. The result clearly shows that the IMEKF and the NLS-based method are superior to q-IEKF and all three outperform the non-iterative methods.

The CDIO framework for development of engineering education is presented, including the overall ideas, the fundamental documents, and some development tools. The automatic control subject and its role in engineering education is studied using the CDIO Standards as reference. Some examples from the engineering education at Linköping University are presented with special focus on the control education.

Chronic kidney disease (CKD) is a global public health problem, affecting approximately 10% of the population worldwide. Yet, there is little direct evidence on how CKD can be diagnosed in a systematic and automatic manner. This paper investigates how CKD can be diagnosed by using machine learning (ML) techniques. ML algorithms have been a driving force in detection of abnormalities in different physiological data, and are, with a great success, employed in different classification tasks. In the present study, a number of different ML classifiers are experimentally validated to a real data set, taken from the UCI Machine Learning Repository, and our findings are compared with the findings reported in the recent literature. The results are quantitatively and qualitatively discussed and our findings reveal that the random forest (RF) classifier achieves the near-optimal performances on the identification of CKD subjects. Hence, we show that ML algorithms serve important function in diagnosis of CKD, with satisfactory robustness, and our findings suggest that RF can also be utilized for the diagnosis of similar diseases.

In order to meet the requirements for autonomous systems in real world applications, reliable path following controllers have to be designed to execute planned paths despite the existence of disturbances and model errors. In this paper we propose a Linear Quadratic controller for stabilizing a 2-trailer system with possible off-axle hitching around preplanned paths in backward motion. The controller design is based on a kinematic model of a general 2-trailer system including the possibility for off-axle hitching. Closed-loop stability is proved around a set of paths, typically chosen to represent the possible output from the path planner, using theory from linear differential inclusions. Using convex optimization tools a single quadratic Lyapunov function is computed for the entire set of paths.

The identification of continuous-time models of dynamical systems based on sampled measurements of input and output signals is a research topic that has received much attention during the past decades. However, a framework for the correct assessment of the performance of various estimation methods, as well as their numerical reliability, is still missing due to a number of benchmarking difficulties, equally applicable to both discrete-and continuous-time identification problems. This paper revisits this topic, reports new numerical results, highlights several fundamental aspects regarding the definition of an appropriate benchmark for the evaluation of continuous-time linear model identification algorithms and discusses several means of addressing the related existing problems.

In a continuous-time nonlinear driftless control system, a geometric phase is a consequence of nonintegrability of the vector fields, and it describes how cyclic trajectories in shape space induce non-periodic motion in phase space, according to an area rule. The aim of this paper is to shown that geometric phases exist also for discrete-time driftless nonlinear control systems, but that unlike their continuous-time counterpart, they need not obey any area rule, i.e., even zero-area cycles in shape space can lead to nontrivial geometric phases. When the discrete-time system is obtained through Euler discretization of a continuous-time system, it is shown that the zero-area geometric phase corresponds to the gap between the Euler discretization and an exact discretization of the continuous-time system.

When an aircraft is flying and burning fuel the center of gravity (c.g.) of the aircraft shifts slowly. The c.g. can also be shifted abruptly when e.g. a ghter aircraft releases a weapon. The shift in c.g. is difficult to measure or estimate so the flight control systems need to be robustly designed to cope with this variation. However for fighter aircrafts with high manoeuvrability there is room for improvements. In this paper we investigate if the use of adaptive control law augmentation can be used to better cope with the change in c.g. We augment a baseline controller with a robust Model Reference Adaptive Control (MRAC) design and analyse its benets and possible issues.

In many traffic situations there are times where interaction with other drivers is necessary and unavoidable in order to safely progress towards an intended destination. This is especially true for merge manoeuvres into dense traffic, where drivers sometimes must be somewhat aggressive and show the intention of merging in order to interact with the other driver and make the driver open the gap needed to execute the manoeuvre safely. Many motion planning frameworks for autonomous vehicles adopt a reactive approach where simple models of other traffic participants are used and therefore need to adhere to large margins in order to behave safely. However, the large margins needed can sometimes get the system stuck in congested traffic where time gaps between vehicles are too small. In other situations, such as a highway merge, it can be significantly more dangerous to stop on the entrance ramp if the gaps are found to be too small than to make a slightly more aggressive manoeuvre and let the driver behind open the gap needed. To remedy this problem, this work uses the Intelligent Driver Model (IDM) to explicitly model the interaction of other drivers and evaluates the risk by their required deceleration in a similar manner as the Minimum Overall Breaking Induced by Lane change (MOBIL) model that has been used in large scale traffic simulations before. This allows the algorithm to evaluate the effect on other drivers depending on our own trajectory plans by simulating the nearby traffic situation. Finding a globally optimal solution is often intractable in these situations so instead a large set of candidate trajectories are generated that are evaluated against the traffic scene by forward simulations of other traffic participants. By discretization and using an efficient trajectory generator together with efficient modelling of the traffic scene real-time demands can be met.

In multiparametric programming an optimization problem which is dependent on a parameter vector is solved parametrically. In control, multiparametric quadratic programming (mp-QP) problems have become increasingly important since the optimization problem arising in Model Predictive Control (MPC) can be cast as an mp-QP problem, which is referred to as explicit MPC. One of the main limitations with mp-QP and explicit MPC is the amount of memory required to store the parametric solution and the critical regions. In this paper, a method for exploiting low rank structure in the parametric solution of an mp-QP problem in order to reduce the required memory is introduced. The method is based on ideas similar to what is done to exploit low rank modifications in generic QP solvers, but is here applied to mp-QP problems to save memory. The proposed method has been evaluated experimentally, and for some examples of relevant problems the relative memory reduction is an order of magnitude compared to storing the full parametric solution and critical regions.

The safe fusion algorithm is benchmarked againstthree other methods in distributed target tracking scenarios. Safefusion is a fairly unknown method similarly to, e.g., covarianceintersection, that can be used to fuse potentially dependentestimates without double counting data. This makes it suitablefor distributed target tracking, where dependencies are oftenunknown or difficult to derive. The results show that safe fusionis a very competitive alternative in five evaluated scenarios, whileat the same time easy to implement and compute compared tothe other evaluated methods. Hence, safe fusion is an attractivealternative in track to track fusion systems.

This paper is concerned with cooperative Terrain Aided Navigation of a network of aircraft using fusion of Radar Altimeter and inter-node range measurements. State inference is performed using a Rao-Blackwellized Particle Filter with online measurement noise statistics estimation. For terrain coverage measurement noise parameter identification, an online Expectation Maximization algorithm is proposed, where local sufficient statistics at each node are calculated in the E-step, which are then distributed to neighboring nodes using a random gossip algorithm to perform the M-step at each node. Simulation results show that improvement on positioning and calibration performance can be achieved compared to a non-cooperative approach.

In this paper, we study the problem of controlling large scale networks with controls which can assume only positive values. Given an adjacency matrix A, an algorithm is developed that constructs an input matrix B with a minimal number of columns such that the resulting system (A, B) is positively controllable. The algorithm combines the graphical methods used for structural controllability analysis with the theory of positive linear dependence. The number of control inputs guaranteeing positive controllability is near optimal.

In this paper, a calibration method for a triaxial accelerometer using a triaxial gyroscope is presented. The method uses a sensor fusion approach, combining the information from the accelerometers and gyroscopes to find an optimal calibration using Maximum likelihood. The method has been tested by using real sensors in smartphones to perform orientation estimation and verified through Monte Carlo simulations. In both cases, the method is shown to provide a proper calibration, reducing the effect of sensor errors and improving orientation estimates.

This paper presents a batch estimation method for Simultaneous Localization and Mapping (SLAM) using the Prediction Error Method (PEM). The estimation problem considers landmarks as parameter while treating dynamics using state space models. The gradient needed for parameter estimation is computed recursively using an Extended Kalman Filter (EKF). Results using simulations with a monocular camera and inertial sensors are presented and compared to a Nonlinear Least- Squares (NLS) estimator. The presented method produce both lower RMSE’s and scale better to the batch length. 

We consider a target tracking problem where, in addition to the usual sensor measurements, accurate observations with uncertain timestamps are available. Such observations could, \eg, come from traces left by a target or from witnesses of an event, and have the potential in some scenarios to improve the accuracy of an estimate significantly. The Bayesian solution to the smoothing problem for one observation with uncertain timestamp is derived for a linear Gaussian state space model. The joint and marginal distributions of the states and uncertain time are derived, as well as the minimum mean squared error (MMSE) and maximum a posteriori (MAP) estimators. To attain an intuition for the problem in consideration a simple first-order example is presented and its posterior distributions and point estimators are compared and examined in some depth.

This paper presents a feasibility study on smartphone localization of missing persons in Search And Rescue(SAR) operations using widely available Commercial-Off-The-Shelf (COTS) products. We assume (1) that the missing person wears an enabled smartphone and (2) that messages transmitted by this smartphone can be intercepted by mobile agents at known positions. We present a proof-of-concept that consists of several mobile agents carrying smartphones that measure the Received Signal Strength (RSS) of Wi-fi messages transmitted by the smartphone of the missing person. The positions of the mobile agents are determined using the GPS unit on the smartphones.The mobile agents send the collected RSS and GPS data to a central processing unit, which processes the data in real-time and guides mobile agents in SAR operations by estimating the position of the missing person. Our central processing unit runs a localization algorithm that requires no calibration, because rescue operations usually take place in unknown environments with unknown hardware. Our experiments in an 250x130m2 outdoor field shows that our localization system provides an average localization performance of roughly 15 meters, which is sufficient for most SAR operations of interest. In addition, we performed several successful tests with a Quadcopter to show the feasibility of using unmanned vehicles in SAR operations.

We consider personal navigation systems in devices equipped with inertial sensors and GPS, where we propose an improved Pedestrian Dead Reckoning (PDR) algorithm that learns gait parameters in time intervals when position estimates are available, for instance from GPS or an indoor positioning system (IPS). A novel filtering approach is proposed that is able to learn internal gait parameters in the PDR algorithm, such as the step length and the step detection threshold. Our approach is based on a multi-rate Kalman filter bank that estimates the gait parameters when position measurements are available, which improves PDR in time intervals when the position is not available, for instance when passing from outdoor to indoor environments where IPS is not available. The effectiveness of the new approach is illustrated on several real world experiments. 

We introduce interacting particle Markov chain Monte Carlo (iPMCMC), a PMCMC method based on an interacting pool of standard and conditional sequential Monte Carlo samplers. Like related methods, iPMCMC is a Markov chain Monte Carlo sampler on an extended space. We present empirical results that show significant improvements in mixing rates relative to both non-interacting PMCMC samplers and a single PMCMC sampler with an equivalent memory and computational budget. An additional advantage of the iPMCMC method is that it is suitable for distributed and multi-core architectures.

Kernel-based machine learning methods are gaining increasing interest in flow modeling and prediction in recent years. Gaussian process (GP) is one example of such kernelbased methods, which can provide very good performance for nonlinear problems. In this work, we apply GP regression to flow modeling and prediction of athletes in ski races, but the proposed framework can be generally applied to other use cases with device trajectories of positioned data. Some specific aspects can be addressed when the data is periodic, like in sports where the event is split up over multiple laps along a specific track. Flow models of both the individual skier and a cluster of skiers are derived and analyzed. Performance has been evaluated using data from the Falun Nordic World Ski Championships 2015, in particular the Men’s cross country 4 × 10 km relay. The results show that the flow models vary spatially for different skiers and clusters. We further demonstrate that GP regression provides powerful and accurate models for flow prediction.

This paper describes the motivation, the current state and the further actions of an improvement process of the engineering education at the Military Institute of Engineering (IME) in Brazil. Based on the reasons for why and how to change, the CDIO framework has been chosen as the kernel of this improvement process. The activities realized the plan of the further actions and the open questions are presented in this paper. The paper is a condensed presentation of the report (Cerqueira et. al., 2016), where a thorough background and more details can be found.

We study severely quantized received signal strength (RSS)-based cooperative localization in wireless sensor networks. We adopt the well-known sum-product algorithm over a wireless network (SPAWN) framework in our study. To address the challenge brought by severely quantized measurements, we adopt the principle of importance sampling and design appropriate proposal distributions. Moreover, we propose a parametric SPAWN in order to reduce both the communication overhead and the computational complexity. Experiments with real data corroborate that the proposed algorithms can achieve satisfactory localization accuracy for severely quantized RSS measurements. In particular, the proposed parametric SPAWN outperforms its competitors by far in terms of communication cost. We further demonstrate that knowledge about non-connected sensors can further improve the localization accuracy of the proposed algorithms.

The commercial interest in proximity services is increasing. Application examples include location-based information and advertisements, logistics, social networking, file sharing, etc. In this paper, we consider network-based positioning based on times series of proximity reports from a mobile device, either only a proximity indicator, or a vector of RSS from observed nodes. Such positioning corresponds to a latent and nonlinear observation model. To address these problems, we combine two powerful tools, namely particle filtering and Gaussian process regression (GPR) for radio signal propagation modeling. The latter also provides some insights into the spatial correlation of the radio propagation in the considered area. Radio propagation modeling and positioning performance are evaluated in a typical office area with Bluetooth-Low-Energy (BLE) beacons deployed for proximity detection and reports. Results show that the positioning accuracy can be improved by using GPR.

Drive cycle following is important for concept comparisons when evaluating vehicle concepts, but it can be time consuming to develop good driver models that can achieve accurate following of a specific velocity profile. Here, a new approach is proposed where a simple driver model based on a PID controller is extended with an Iterative Learning Control (ILC) algorithm. Simulation results using a nonlinear vehicle and control system model show that it is possible to achieve very good cycle following in a few iterations with little tuning effort. It is also possible to utilize the repetitive behavior in the drive cycle to accelerate the convergence of the ILC algorithm even further.

System identification with regularization methods has attracted increasing attention recently and is a complement to the current standard maximum likelihood/ prediction error method. In this paper, we focus on the kernel-based regularization method and give a spectral analysis of the so-called diagonal correlated (DC) kernel, one family of kernel structures that has been proven useful for linear time-invariant system identification. In particular, using the theory of Bessel functions, we derive the eigenvalues and corresponding eigenfunctions of the DC kernel. Accordingly, we derive the Karhunen-Loeve expansion of the stochastic process whose covariance function is the DC kernel.

In this paper, the maximum entropy property of the discrete-time first-order stable spline kernel is studied. The advantages of studying this property in discrete-time domain instead of continuous-time domain are outlined. One of such advantages is that the differential entropy rate is well-defined for discrete-time stochastic processes. By formulating the maximum entropy problem for discrete-time stochastic processes we provide a simple and self-contained proof to show what maximum entropy property the discrete-time first-order stable spline kernel has.

We present algorithm evaluations for ATR of small sea vessels. The targets are at km distance from the sensors, which means that the algorithms have to deal with images affected by turbulence and mirage phenomena. We evaluate previously developed algorithms for registration of 3D-generating laser radar data. The evaluations indicate that some robustness to turbulence and mirage induced uncertainties can be handled by our probabilistic-based registration method.

We also assess methods for target classification and target recognition on these new 3D data. An algorithm for detecting moving vessels in infrared image sequences is presented; it is based on optical flow estimation. Detection of moving target with an unknown spectral signature in a maritime environment is a challenging

problem due to camera motion, background clutter, turbulence and the presence of mirage. First, the optical flow caused by the camera motion is eliminated by estimating the global flow in the image. Second, connected regions containing significant motions that differ from camera motion is extracted. It is assumed that motion caused by a moving vessel is more temporally stable than motion caused by mirage or turbulence. Furthermore, it is assumed that the motion caused by the vessel is more homogenous with respect to both magnitude and orientation, than motion caused by mirage and turbulence. Sufficiently large connected regions with a flow of acceptable magnitude and orientation are considered target regions. The method is evaluated on newly collected sequences of SWIR and MWIR images, with varying targets, target ranges and background clutter.

Finally we discuss a concept for combining passive and active imaging in an ATR process. The main steps are passive imaging for target detection, active imaging for target/background segmentation and a fusion of passive and active imaging for target recognition.

We provide conditions that guarantee existence, uniqueness and stability of strictly positive equilibria for nonlinear cooperative systems associated to vector fields that are concave or subhomogeneous. This class of positive systems describes well interconnected dynamics that are of key interest for communication, biological, economical and neural network applications. These conditions can be formulated directly in terms of the spectral radius of the Jacobian of the system, and do not require to use constant inputs to move the equilibrium point from the origin to the interior of the positive orthant.

To estimate the smoothing distribution in a nonlinear state space model, we apply the conditional particle filter with ancestor sampling. This gives an iterative algorithm in a Markov chain Monte Carlo fashion, with asymptotic convergence results. The computational complexity is analyzed, and our proposed algorithm is successfully applied to the challenging problem of sensor fusion between ultrawideband and accelerometer/gyroscope measurements for indoor positioning. It appears to be a competitive alternative to existing nonlinear smoothing algorithms, in particular the forward filtering-backward simulation smoother. 

We study maximum likelihood (ML) position estimation using quantized received signal strength measurements. In order to mitigate the undesired quantization effect in the observations, the dithering technique is adopted. Various dither noise distributions are considered and the corresponding likelihood functions are derived. Simulation results show that the proposed ML estimator with dithering is able to generate a significantly reduced bias but a modestly increased mean-square error as compared to the conventional ML estimator without dithering.

Particle Metropolis-Hastings enables Bayesian parameter inference in general nonlinear state space models (SSMs). However, in many implementations a random walk proposal is used and this can result in poor mixing if not tuned correctly using tedious pilot runs. Therefore, we consider a new proposal inspired by quasi-Newton algorithms that may achieve similar (or better) mixing with less tuning. An advantage compared to other Hessian based proposals, is that it only requires estimates of the gradient of the log-posterior. A possible application is parameter inference in the challenging class of SSMs with intractable likelihoods.We exemplify this application and the benefits of the new proposal by modelling log-returns offuture contracts on coffee by a stochastic volatility model with alpha-stable observations.

Maximum likelihood (ML) estimation using Newton’s method in nonlinear state space models (SSMs) is a challenging problem due to the analytical intractability of the log- likelihood and its gradient and Hessian. We estimate the gradient and Hessian using Fisher’s identity in combination with a smoothing algorithm. We explore two approximations of the log-likelihood and of the solution of the smoothing problem. The first is a linearization approximation which is computationally cheap, but the accuracy typically varies between models. The second is a sampling approximation which is asymptotically valid for any SSM but is more computationally costly. We demonstrate our approach for ML parameter estimation on simulated data from two different SSMs with encouraging results. 

Vi belyser olikheter och likheter i hur grundutbildningen styrs på fyra svenska tekniska högskolor. Vi jämför hur lärare och examinatorer väljs ut, hur medel fördelas och vilken roll programansvariga (eller motsvarande) har. De strukturella skillnaderna är relativt stora med störst autonomi för programansvariga på Chalmers tekniska högskola vilket delvis har att göra med att detta lärosäte lyder under aktiebolagslagen.

Modeling dynamical systems is important in many disciplines, such as control, robotics, or neurotechnology. Commonly the state of these systems is not directly observed, but only available through noisy and potentially high-dimensional observations. In these cases, system identification, i.e., finding the measurement mapping and the transition mapping (system dynamics) in latent space can be challenging. For linear system dynamics and measurement mappings efficient solutions for system identification are available. However, in practical applications, the linearity assumptions does not hold, requiring nonlinear system identification techniques. If additionally the observations are high-dimensional (e.g., images), nonlinear system identification is inherently hard. To address the problem of nonlinear system identification from high-dimensional observations, we combine recent advances in deep learning and system identification. In particular, we jointly learn a low-dimensional embedding of the observation by means of deep auto-encoders and a predictive transition model in this low-dimensional space. We demonstrate that our model enables learning good predictive models of dynamical systems from pixel information only.

A common issue with many system identification problems is that the true input to the system is unknown. In this paper, a framework, based on indirect input measurements, is proposed to solve the problem when the input is partially or fully unknown, and cannot be measured directly. The approach relies on measurements that indirectly contain information about the unknown input. The resulting indirect model formulation, with both direct and indirect input measurements as inputs, can be used to estimate the desired model of the original system. Due to the similarities with closed-loop system identification, an iterative instrumental variable method is proposed to estimate the indirect model. To show the applicability of the proposed method, it is applied to data from an inverted pendulum experiment with good results. 

This paper presents a method for matching spotlight Synthetic Aperture Radar (SAR) images with a georeferenced 3D-map as means for navigational aid. A hypothesis of the flying platform's absolute position, velocity and direction - which later can be used to correct the inertial navigation system - is attained by image matching and optimization. A projective model with 6 DoF is used to create a simulated SAR image from a 3D map. The parameters of the projective model represents the most important of the platform's navigation state, and these are adjusted by Chamfer matching the captured SAR image to simulated ones. The performance is demonstrated on real spotlight SAR images and 3D-map, and the error is shown to be only a few pixels in average, which in our case is about 3 meters.

This paper presents a distributed online method for joint state and parameter estimation in a Jump Markov NonLinear System based on a distributed recursive Expectation Maximization algorithm. State inference is enabled via the use of Rao-Blackwellized Particle Filter and, for the parameter estimation, the E-step is performed independently at each sensor with the calculation of local sufficient statistics. An average consensus algorithm is used to diffuse local sufficient statistics to neighbors and approximate the global sufficient statistics throughout the network. The evaluation of the proposed algorithm is carried out on a Terrain Based Navigation problem where the unknown parameters of the observation noise model contain relevant information about the terrain properties.

Cramér-Rao lower bounds (CRLBs) are proposed for deterministic parameter estimation under model mismatch conditions where the assumed data model used in the design of the estimators differs from the true data model. The proposed CRLBs are defined for the family of estimators that may have a specified bias (gradient) with respect to the assumed model. The resulting CRLBs are calculated for a linear Gaussian measurement model and compared to the performance of the maximum likelihood estimator for the corresponding estimation problem.

The Ensemble Kalman filter (EnKF) is a standard algorithm in oceanography and meteorology, where it has got thousands of citations. It is in these communities appreciated since it scales much better with state dimension n than the standard Kalman filter (KF). In short, the EnKF propagates ensembles with N state realizations instead of mean values and covariance matrices and thereby avoids the computational and storage burden of working on n×n matrices. Perhaps surprising, very little attention has been devoted to the EnKF in the signal processing community. In an attempt to change this, we present the EnKF in a Kalman filtering context. Furthermore, its application to nonlinear problems is compared to sigma point Kalman filters and the particle filter, so as to reveal new insights and improvements for high-dimensional filtering algorithms in general. A simulation example shows the EnKF performance in a space debris tracking application.

A ship's roll dynamics is very sensitive to changes in the loading conditions and a worst-case scenario is the loss of stability.  This paper proposes an approach for online estimation of a ship's mass and center of mass. Instead of focusing on a sensor-rich environment where all possible signals on a ship can be measured and a complete model of the ship can be estimated, a minimal approach is adopted. A model of the roll dynamics is derived from a well-established model in literature and it is assumed that only motion measurements from an inertial measurement unit together with measurements of the rudder angle are available. Furthermore, identifiability properties and disturbance characteristics of the model are presented. Due to the properties of the model, the parameters are estimated with an iterative instrumental variable approach to mitigate the influence of the disturbances and it uses multiple datasets simultaneously to overcome identifiability issues. Finally, a simulation study is presented to investigate the sensitivity to the initial conditions and it is shown that the sensitivity is low for the desired parameters.

In this paper an extension to the sampling based motion planning framework CL-RRT is presented. The framework uses a system model and a stabilizing controller to sample the perceived environment and build a tree of possible trajectories that are evaluated for execution. Complex system models and constraints are easily handled by a forward simulation making the framework widely applicable. To increase operational safety we propose a sampling recovery scheme that performs a deterministic brake profile regeneration using collision information from the forward simulation. This greatly increases the number of safe trajectories and also reduces the number of samples that produce infeasible results. We apply the framework to a Scania G480 mining truck and evaluate the algorithm in a simple yet challenging obstacle course and show that our approach greatly increases the number of feasible paths available for execution.

A local series expansion of a received signal is pro-posed for computing direction of arrival (DOA) in sensor arrays. The advantages compared to classical DOA estimation methods include general sensor configurations, ultra-slow sampling, smalldimension of the arrays, and that it applies for both narrowbandand wideband signals without prior knowledge of the signals. This makes the method well suited for DOA estimation in sensor networks where size and energy consumption have to be small. We generalize the common far-field assumption of the target toalso include the near-field, which enables target tracking usinga network of sensor arrays in one framework.

Micro unmanned aerial vehicles are becoming increasingly interesting for aiding and collaborating with human agents in myriads of applications, but in particular they are useful for monitoring inaccessible or dangerous areas. In order to interact with and monitor humans, these systems need robust and real-time computer vision subsystems that allow to detect and follow persons.

In this work, we propose a low-level active vision framework to accomplish these challenging tasks. Based on the LinkQuad platform, we present a system study that implements the detection and tracking of people under fully autonomous flight conditions, keeping the vehicle within a certain distance of a person. The framework integrates state-of-the-art methods from visual detection and tracking, Bayesian filtering, and AI-based control. The results from our experiments clearly suggest that the proposed framework performs real-time detection and tracking of persons in complex scenarios

This paper presents identification of both network connected systems as well as distributed systems governed by PDEs in the framework of distributed optimization via the Alternating Direction Method of Multipliers. This approach opens first the possibility to identify distributed models in a global manner using all available data sequences and second the possibility for a distributed implementation. The latter will make the application to large scale complex systems possible. In addition to outlining a new large scale identification method, illustrations are shown for identifying both network connected systems and discretized PDEs.

A class of continuous-time dynamical systems able to sort a list of real numbers is introduced in this paper. The dynamical sorting is achieved in a completely distributed manner, by modifying a consensus problem, namely right multiplying a Laplacian matrix by a diagonal matrix of weights that represents the desired order. The sorting obtained is relative, i.e., a conservation law is imposed on the dynamics. It is shown that sorting can be achieved in finite-time even in a globally smooth way.

In this paper, an instrumental variable (IV) method for estimating the mass and center of mass (CM) of a ship using IMU data has been further investigated. Here, this IV method, which was proposed in an earlier paper, has been analyzed from a closed-loop point of view. This new perspective reveals the properties of the system and dependencies of the signals used in the estimation procedure. Due to similarities with closed-loop identification, previous results in the closed-loop identification field have been used as an inspiration to improve the IV estimator. Since the roll dynamics of a ship is well described by a pendulum model, a pendulum experiment has been carried out to validate the performance both of the original and the improved IV estimators. The experiments gave good results for the improved IV estimator with significantly lower variances and relative errors than the previous IV estimator.

There is strong interest in positioing in wireless networks, partly to support end user service needs, but also to support network management with network-based network information. The focus in this paper is on the latter, while using measurements that are readily available in wireless networks. We show how thesignal direction of departure and inter-distance between the base station and the mobile terminal can be estimated, and how particle filters and smoothers can be used to post-process the measurements. The methods are evaluated in a live 3GPP LTE network with promising results inlcuding position error medians of less than 100 m.

In this paper, we aim to relate different Bayesian Cramér-Rao bounds which appear in the discrete-time nonlinear filtering literature in a single framework. A comparative theoretical analysis of the bounds is provided in order to relate their tightness. The results can be used to provide a lower bound on the mean square error in nonlinear filtering. The findings are illustrated and verified by numerical experiments where the tightness of the bounds are compared.

We propose a new framework for how to use sequential Monte Carlo (SMC) algorithms for inference in probabilistic graphical models (PGM). Via a sequential decomposition of the PGM we find a sequence of auxiliary distributions defined on a monotonically increasing sequence of probability spaces. By targeting these auxiliary distributions using SMC we are able to approximate the full joint distribution defined by the PGM. One of the key merits of the SMC sampler is that it provides an unbiased estimate of the partition function of the model. We also show how it can be used within a particle Markov chain Monte Carlo framework in order to construct high-dimensional block-sampling algorithms for general PGMs.

This paper presents a system which combines a zero-velocity-update-(ZUPT-)aided inertial navigation system (INS), using a foot-mounted inertial measurement unit (IMU), with opportunistic use of multi-frequency received signal strength (RSS) measurements. The system does not rely on maps or pre-collected data from surveys of the radio-frequency (RF) environment. Instead it builds its own database of collected RSS measurements during the course of the operation. New RSS measurements are continuously compared with the stored values in the database, and when the user returns to a previously visited area this can thus be detected. This enables loop-closures to be detected online and used for error drift correction. The system utilises a distributed particle simultaneous localization and mapping (DP-SLAM) algorithm which provides a flexible 2D navigation platform that can be extended with more sensors. The experimental results presented in this paper indicates that the developed RSS SLAM algorithm can, in many cases, significantly improve the positioning performance of a foot-mounted INS. 

In inertial human motion capture, a multitude of body segments are equipped with inertial measurement units, consisting of 3D accelerometers, 3D gyroscopes and 3D magnetometers. Relative position and orientation estimates can be obtained using the inertial data together with a biomechanical model. In this work we present an optimization-based solution to magnetometer-free inertial motion capture. It allows for natural inclusion of biomechanical constraints, for handling of nonlinearities and for using all data in obtaining an estimate. As a proof-of-concept we apply our algorithm to a lower body configuration, illustrating that the estimates are drift-free and match the joint angles from an optical reference system.

In this paper, multiobjective optimization is applied to an optimal control problem for a grab-shift unloader crane. The crane is modeled as a cart-pendulum system with varying rope length and the trajectory of the grab is limited by the ship, the quay, and the crane structure. The objectives to minimize are chosen as time, energy and maximal instantaneous power. The optimal control problem is solved using a direct simultaneous optimal control method. The study shows that MOO can be an efficient tool when choosing a good compromise between conflicting objectives such as time and energy. Furthermore, navigation among the Pareto optimal solutions has proven to be very useful when a user wants to learn how the control variables interact with the process. 

The use of Model Predictive Control is steadily increasing in industry as more complicated problems can be addressed. Due to that online optimization is usually performed, the main bottleneck with Model Predictive Control is the relatively high computational complexity. Hence, much research has been performed to find efficient algorithms that solve the optimization problem. As parallel hardware is becoming more commonly available, the demand of efficient parallel solvers for Model Predictive Control has increased. In this paper, a tailored parallel algorithm that can adopt different levels of parallelism for solving the Newton step is presented. With sufficiently many processing units, it is capable of reducing the computational growth to logarithmic in the prediction horizon. Since the Newton step computation is where most computational effort is spent in both interior-point and active-set solvers, this new algorithm can significantly reduce the computational complexity of highly relevant solvers for Model Predictive Control.

Being able to predict the outcome of an opinion forming process is an important problem in social network theory. However, even for linear dynamics, this becomes a difficult task as soon as non-cooperative interactions are taken into account. Such interactions are naturally modeled as negative weights on the adjacency matrix of the social network. In this paper we show how the Perron-Frobenius theorem can be used for this task also beyond its standard formulation for cooperative systems. In particular we show how it is possible to associate the achievement of unanimous opinions with the existence of invariant cones properly contained in the positive orthant. These cases correspond to signed adjacency matrices having the eventual positivity property, i.e., such that in sufficiently high powers all negative entries have disappeared. More generally, we show how for social networks the achievement of a, possibily non-unanimous, opinion can be associated to the existence of an invariant cone fully contained in one of the orthants of ℝless thansupgreater thannless than/supgreater than.

In this paper, we put forth distributed algorithms for solving loosely coupled unconstrained and constrained optimization problems. Such problems are usually solved using algorithms that are based on a combination of decomposition and first order methods. These algorithms are commonly very slow and require many iterations to converge. In order to alleviate this issue, we propose algorithms that combine the Newton and interior-point methods with proximal splitting methods for solving such problems. Particularly, the algorithm for solving unconstrained loosely coupled problems, is based on Newton's method and utilizes proximal splitting to distribute the computations for calculating the Newton step at each iteration. A combination of this algorithm and the interior-point method is then used to introduce a distributed algorithm for solving constrained loosely coupled problems. We also provide guidelines on how to implement the proposed methods efficiently and briefly discuss the properties of the resulting solutions.

The Kalman filter has been the work horse in model based filtering for five decades, and basic knowledge and understanding of it is an important part of the curriculum in many Master of Science programs. It is therefore important to combine theoretical studies with practical experience to allow the students to deepen their understanding of the filter. We have developed a lab where the students implement a Kalman filter in a real-time Matlab framework, to which data are streamed from the smartphone over WiFi. The goal of the lab is to estimate the orientation of the smartphone, which can be nicely visualized graphically and also be compared to the built-in filters in the smartphone. The filter can accept any combination of sensor data from accelerometers, gyroscopes, and magnetometer, with different performance.  Different tunings and tricks in the Kalman filter are easily evaluated on-line. The smartphone app is also a stand-alone tool to visualize the sensor data graphically. So far the lab seems tohave been successful in reaching the pedagogic goals and to engage the students.

Fault detection algorithms (FDAs) process data to generate a test quantity. Test quantities are used to determine presence of a fault in a monitored system, despite disturbances. Because only limited knowledge of the system can be embedded in an FDA, it is important to evaluate it in scenarios relevant in practice. In this paper, simulation based approaches are proposed in an attempt to determine: i) which disturbances affect the output of an FDA the most; ii) how to compare the performance of dierent FDAs; and iii) which combinations of fault change size and disturbances variations are allowed to achieve satisfactory performance. The ideas presented are inspired by the literature of design of experiments, surrogate models, sensitivity analysis and change detection. The approaches are illustrated for the problem of wear diagnosis in manipulators where three FDAs are considered. The application study reveals that disturbances caused by variations in temperature and payload mass error affect the FDAs the most. It is also shown how the size of these disturbances delimit the capacity of an FDA to relate to wear changes. Further comparison of the FDAs reveal which performs "best" in average.

Nonlinear Kalman filter adaptations such as extended Kalman filters (EKF) or unscented Kalman filters (UKF) provide approximate solutions to state estimation problems in nonlinear models. The algorithms utilize mean values and covariance matrices to represent the probability densities in the otherwise intractable Bayesian filtering equations. As a consequence, their estimation performance can show significant dependence on the choice of state coordinates. The here considered problem of tracking maneuvering targets using coordinated turn (CT) models is one practically relevant example: The velocity in the target state can either be formulated in Cartesian or polar coordinates. We extend a previous study to a broader range of CT models that allow for changes in target speed and turn rate, and investigate UKF as well as EKF variants in terms of their performance and sensitivity to noise parameters. The results advocate for the use of polar CT models.

The recent introduction of HDR video cameras has enabled the development of image based lighting techniques for rendering virtual objects illuminated with temporally varying real world illumination. A key challenge in this context is that rendering realistic objects illuminated with video environment maps is computationally demanding. In this work, we present a GPU based rendering system based on the NVIDIA OptiX framework, enabling real time raytracing of scenes illuminated with video environment maps. For this purpose, we explore and compare several Monte Carlo sampling approaches, including bidirectional importance sampling, multiple importance sampling and sequential Monte Carlo samplers. While previous work have focused on synthetic data and overly simple environment maps sequences, we have collected a set of real world dynamic environment map sequences using a state-of-art HDR video camera for evaluation and comparisons.

We consider an application of Bayesian signal processing to the energy trading problem. In particular, we address the problem of calibrating the Schwartz-Smith Model using the observed electricity futures prices traded on the markets. As compared with the other financial markets, basic electricity derivatives such as futures are more complicated, as these products are based not on the spot prices themselves but on the arithmetic averages of the spot prices during the delivery period. As a result, the (log) futures prices are no longer affine function of the model factors and as such, an approach based on Kalman filtering, to estimate the latent model factors and the parameters seems meaningless. Here, we envisage a Bayesian approach using the particle marginal Metropolis Hastings (PMMH) algorithm for this challenging estimation task. We demonstrate the efficacy of our approach on simulated data.

In this paper we propose a new type of particle smoother with linear computational complexity. The smoother is based on running a sequential Monte Carlo sampler backward in time after an initial forward filtering pass. While this introduces dependencies among the backward trajectories we show through simulation studies that the new smoother can outperform existing forward-backward particle smoothers when targeting the marginal smoothing densities.

We propose a novel method for maximum-likelihood-based parameter inference in nonlinear and/or non-Gaussian state space models. The method is an iterative procedure with three steps. At each iteration a particle filter is used to estimate the value of the log-likelihood function at the current parameter iterate. Using these log-likelihood estimates, a surrogate objective function is created by utilizing a Gaussian process model. Finally, we use a heuristic procedure to obtain a revised parameter iterate, providing an automatic trade-off between exploration and exploitation of the surrogate model. The method is profiled on two state space models with good performance both considering accuracy and computational cost.

Control of a flexible joint of an industrial manipulator using H_∞ design methods is presented. The considered design methods are i) mixed-H_∞ design, and ii) H_∞ loop shaping design. Two different controller configurations are examined: one uses only the actuator position, while the other uses the actuator position and the acceleration of end-effector. The four resulting controllers are compared to a standard PID controller where only the actuator position is measured. The choices of the weighting functions are discussed in details. For the loop shaping design method, the acceleration measurement is required to improve the performance compared to the PID controller. For the mixed-H_∞ method it is enough to have only the actuator position to get an improved performance. Model order reduction of the controllers is briefly discussed, which is important for implementation of the controllers in the robot control system.

The detection and classification of small surface targets at long ranges is a growing need for naval security. This paper will discuss simulations of a laser radar at 1.5 μm aimed for search, detect and recognition of small maritime targets.

The data for the laser radar system will be based on present and realistic future technology. The simulations will incorporate typical target movements at different sea states, vessel courses, effects of the atmosphere and for given laser system parameters also include different beam jitter. The laser pulse energy, repetition rate as well as the receiver and detector parameters have not been changed during the simulations.

A discussion of the classification potential based on information in 1D, 2D and 3D data separately and in combination will be made vs. different environmental conditions and system parameters. System issues when combining the laser radar with IR/TV and a range-Doppler radar will also be commented.

We study received signal strength-based cooperative localization in wireless sensor networks. We assume that the measurement noise fits a contaminated Gaussian model so as to take into account some outlier conditions. In addition, some environment-dependent parameters are assumed to be unknown. We propose an expectation-maximization based algorithm for robust centralized network localization without offline training. As benchmark for comparison, we express the best achievable localization accuracy in terms of the Cramér-Rao bound. Experimental results demonstrate the advantages of the proposed algorithm as compared to some representative algorithms.

The problem of estimating heading is central in the indoor positioning problem based on measurements from inertial measurement and magnetic units, Integrating rate of turn angular rate gives the heading with unknown initial condition and a linear drift over time, while the magnetometer gives absolute heading, but m here long segments of data are useless in practice because of magnetic disturbances. A basic Kalman filter approach with outlier rejection has turned out to be difficult to use with high integrity. Here, we propose an approach based on convex optimization, where segments of good magnetometer data are separated from disturbed data and jointly fused with the yaw rate measurements. The optimization framework is flexible with many degrees of freedom in the modeling phase, and we outline one design. A recursive solution to the optimization is derived, which has a computational complexity comparable to the simplest possible Kalman filter. The performance is evaluated using data from a handheld smartphone for a large amount of indoor trajectories, and the result demonstrates that the method effectively resolves the magnetic disturbances.

A Wiener model is a fairly simple, well known, and often used nonlinear block- oriented black-box model. A possible generalization of the class of Wiener models lies in the parallel Wiener model class. This paper presents a method to estimate the linear time-invariant blocks of such parallel Wiener models from input/output data only. The proposed estimation method combines the knowledge obtained by estimating the best linear approximation of a nonlinear system with the MAVE dimension reduction method to estimate the linear time- invariant blocks present in the model. The estimation of the static nonlinearity boils down to a standard static nonlinearity estimation problem starting from input-output data once the linear blocks are known.