Change search
Link to record
Permanent link

Direct link
Publications (10 of 60) Show all publications
Fu, J., Wu, Y., Chen, Y., Peng, K., Zhang, X., Cevher, V., . . . Holst, A. (2026). Diffusion-based Cumulative Adversarial Purification for Vision Language Models. Transactions on Machine Learning Research, 2026-June
Open this publication in new window or tab >>Diffusion-based Cumulative Adversarial Purification for Vision Language Models
Show others...
2026 (English)In: Transactions on Machine Learning Research, E-ISSN 2835-8856, Vol. 2026-JuneArticle in journal (Refereed) Published
Abstract [en]

Vision Language Models (VLMs) have shown remarkable capabilities in multimodal under-standing, yet their susceptibility to adversarial perturbations poses a significant threat to their reliability in real-world applications. Despite often being imperceptible to humans, these perturbations can drastically alter model outputs, leading to erroneous interpretations and decisions. This paper introduces DiffCAP, a novel diffusion-based purification strategy that can effectively neutralize adversarial corruptions in VLMs. We theoretically establish a provable recovery region in the forward diffusion process and meanwhile quantify the convergence rate of semantic variation with respect to VLMs. These findings manifest that adversarial effects monotonically fade as diffusion unfolds. Guided by this principle, DiffCAP leverages noise injection with a similarity threshold of VLM embeddings as an adaptive criterion, before reverse diffusion restores a clean and reliable representation for VLM inference. Through extensive experiments across six datasets with three VLMs under varying attack strengths in three task scenarios, we show that DiffCAP outperforms existing defense techniques by a substantial margin. Notably, DiffCAP significantly reduces both hyperparameter tuning complexity and the required diffusion time, thereby accelerating the denoising process. Equipped with theorems and empirical support, DiffCAP provides a robust and practical solution for securely deploying VLMs in adversarial environments. The source code is available at https://github.com/JasonFu1998/DiffCAP

Place, publisher, year, edition, pages
Transactions on Machine Learning Research, 2026
National Category
Computer graphics and computer vision
Identifiers
urn:nbn:se:ri:diva-81839 (URN)2-s2.0-105041547155 (Scopus ID)
Note

QC 20260625

Available from: 2026-06-25 Created: 2026-06-25 Last updated: 2026-06-25Bibliographically approved
Vincent, N., Srinivasan, A., Holst, A. & Pashami, S. (2026). NTS-DAGMA: A Score-Based Causal Discovery for Anomaly Detection. In: Lecture Notes in Computer Science: . Paper presented at 4th International Symposium on Intelligent Data Analysis, IDA 2026, Leiden, The Netherlands, April 22-24, 2026 (pp. 113-125). Springer Nature, 16513 LNCS
Open this publication in new window or tab >>NTS-DAGMA: A Score-Based Causal Discovery for Anomaly Detection
2026 (English)In: Lecture Notes in Computer Science, Springer Nature , 2026, Vol. 16513 LNCS, p. 113-125Conference paper, Published paper (Refereed)
Abstract [en]

Anomaly detection is an essential component for ensuring the safety and reliability of critical systems. Currently, most machine learning-based anomaly detection approaches rely purely on correlations among sensor signals, rather than causal relations, making them susceptible to spurious associations. This limitation can lead to poor generalization and unreliable anomaly detection in practical scenarios. To address this, we propose an anomaly detection approach which leverages score-based causal discovery, NTS-DAGMA. This causal discovery method advances over prior work by combining the network architecture from NTS-NOTEARS with the acyclicity constraint from DAGMA. Like other prediction-based anomaly detection methods, it can predict future states; however, it does this by learning and utilizing causal relations in the time series data. Through comprehensive experiments, we demonstrate that: (i) on causal discovery tasks NTS-NOTEARS and NTS-DAGMA achieve similar performances; (ii) on anomaly detection tasks NTS-NOTEARS and NTS-DAGMA also perform similar to each other, and have comparable performance to state-of-the-art ML approaches; and (iii) most importantly, our results show that NTS-DAGMA provides causally meaningful models: detects anomalies which propagate through child nodes in agreement with the inferred causal graph. Incorporating causal structure into the model enables improved interpretability and aligns anomaly detection with the physical dynamics of the system

Place, publisher, year, edition, pages
Springer Nature, 2026
Keywords
anomaly detection, causal discovery, NTS-DAGMA
National Category
Computer Sciences
Identifiers
urn:nbn:se:ri:diva-81626 (URN)10.1007/978-3-032-23833-7_9 (DOI)2-s2.0-105037443508 (Scopus ID)
Conference
4th International Symposium on Intelligent Data Analysis, IDA 2026, Leiden, The Netherlands, April 22-24, 2026
Note

QC 20260520

Available from: 2026-05-20 Created: 2026-05-20 Last updated: 2026-05-20Bibliographically approved
Fu, J., Zhang, X., Pashami, S., Rahimian, F. & Holst, A. (2025). DiffPAD: Denoising Diffusion-Based Adversarial Patch Decontamination. In: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV): . Paper presented at 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) (pp. 6602-6611). Institute of Electrical and Electronics Engineers Inc.
Open this publication in new window or tab >>DiffPAD: Denoising Diffusion-Based Adversarial Patch Decontamination
Show others...
2025 (English)In: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Institute of Electrical and Electronics Engineers Inc. , 2025, p. 6602-6611Conference paper, Published paper (Refereed)
Abstract [en]

In the ever-evolving adversarial machine learning landscape, developing effective defenses against patch attacks has become a critical challenge, necessitating reliable solutions to safeguard real-world AI systems. Although diffusion models have shown remarkable capacity in image synthesis and have been recently utilized to counter lp-norm bounded attacks, their potential in mitigating localized patch attacks remains largely underexplored. In this work, we propose DiffPAD, a novel framework that harnesses the power of diffusion models for adversarial patch decontamination. DiffPAD first performs super-resolution restoration on downsampled input images, then adopts binarization, dynamic thresholding scheme and sliding window for effective localization of adversarial patches. Such a design is inspired by the theoretically derived correlation between patch size and diffusion restoration error that is generalized across diverse patch attack scenarios. Finally, DiffPAD applies inpainting techniques to the original input images with the estimated patch region being masked. By integrating closed-form solutions for super-resolution restoration and image inpainting into the conditional reverse sampling process of a pre-trained diffusion model, DiffPAD obviates the need for text guidance or fine-tuning. Through comprehensive experiments, we demonstrate that DiffPAD not only achieves state-of-the-art adversarial robustness against patch attacks but also excels in recovering naturalistic images without patch remnants. The source code is available at https://github.com/JasonFu1998/DiffPAD. 

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc., 2025
Keywords
Adversarial machine learning; Image coding; Photointerpretation; Adversarial defense; AI systems; Critical challenges; De-noising; Diffusion model; Input image; Machine-learning; Patch attack; Real-world; Super-resolution restoration; Decontamination
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-78562 (URN)10.1109/WACV61041.2025.00643 (DOI)2-s2.0-105003628690 (Scopus ID)
Conference
2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Available from: 2025-09-16 Created: 2025-09-16 Last updated: 2026-01-22Bibliographically approved
Jarl, S., Sjölund, J., Frost, R. J. .., Holst, A. & Scragg, J. J. .. (2025). Machine learning for in-situ composition mapping in a self-driving magnetron sputtering system. Materials & design, 260
Open this publication in new window or tab >>Machine learning for in-situ composition mapping in a self-driving magnetron sputtering system
Show others...
2025 (English)In: Materials & design, ISSN 0264-1275, E-ISSN 1873-4197, Vol. 260Article in journal (Refereed) Published
Abstract [en]

Self-driving labs (SDLs) employing automation and machine learning (ML) offer great promise for accelerating materials discovery and optimisation. However, in thin film science, SDLs are mainly restricted to solution-based methods which are easier to automate, restricting access to the broader chemical space of inorganic materials. This work advances an SDL based on magnetron co-sputtering, addressing a key challenge: rapidly generating accurate composition maps of multi-element, compositionally graded thin films. Traditional ex-situ methods are slow and error-prone; instead, we present a fast, calibration-free, in-situ ML approach to predict the deposition rate using quartz-crystal microbalance (QCM) sensors. For each sputtering source, deposition rates are sequentially learned as a function of pressure and power via active learning with Gaussian processes (GPs). The final GPs are combined with a geometric flux model to interpolate deposition rates across the sample. Among several acquisition functions with random query as the baseline, the Bayesian active learning MacKay (BALM) approach yielded the best performance, requiring as few as 10 experiments per source. The model predictions for co-sputtering composition distributions were validated against external composition measurements. This framework significantly increases throughput in combinatorial sputtering studies and highlights the potential of ML-guided SDLs to surpass traditional Edisonian methods

Place, publisher, year, edition, pages
Elsevier, 2025
Keywords
Active learning, Bayesian optimization, Combinatorial thin films, Gaussian processes, PVD, Self-driving lab
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
urn:nbn:se:ri:diva-79957 (URN)10.1016/j.matdes.2025.115087 (DOI)2-s2.0-105022599115 (Scopus ID)9781856174978 (ISBN)
Note

The authors thank Carl Hvarfner for helpful discussions and Corrado Comparotto and Younes Lablali for assisting with RBS measurements. This work is supported by Swedish Foundation for Strategic Research (SSF), the strategic research area STandUP for Energy, and the Wallenberg AI, Autonomous Systems and Software Program (WASP) funded by the Knut and Alice Wallenberg Foundation . The work made use of the Myfab clean-room at Uppsala University, part of a VR and KAW funded national infrastructure, and the National Academic Infrastructure for Supercomputing in Sweden (NAISS). Operation of the accelerator, used for RBS measurements, is supported by the Swedish Research Council VR-RFI (Contracts 2019_00191 & 2023_00155 ).

Available from: 2025-12-11 Created: 2025-12-11 Last updated: 2025-12-11Bibliographically approved
Svenson, P., Holst, A., Wallberg, A., Nevalainen, P., Farahnakian, F., Álamo, A., . . . Markkanen, M. (2024). AI-ARC Baltic Demo: Detecting Illegal Activities at Sea. In: FUSION 2024 - 27th International Conference on Information Fusion: . Paper presented at 27th International Conference on Information Fusion, FUSION 2024. Venice. 7 July 2024 through 11 July 2024. Institute of Electrical and Electronics Engineers Inc.
Open this publication in new window or tab >>AI-ARC Baltic Demo: Detecting Illegal Activities at Sea
Show others...
2024 (English)In: FUSION 2024 - 27th International Conference on Information Fusion, Institute of Electrical and Electronics Engineers Inc. , 2024Conference paper, Published paper (Refereed)
Abstract [en]

We describe the AI-ARC (Artificial Intelligence-based Virtual Control Room for the Arctic) system, which aims to enhance maritime domain awareness and surveillance. The system is micro-service based and fuses data from various sources, utilizing AI-driven micro-services and an advanced visualization platform to increase the situation awareness of maritime surveillance operators. The results of the Baltic sea demonstration, aiding in the detection of illegal activities, environmental protection, are presented. The system was evaluated using historical data from real criminal incidents. The resultsshow that the AI-ARC approach could help increase the situation awareness of law enforcement operators. 

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc., 2024
Keywords
Anomaly detection; Anomaly detection; Arctic system; Illegal activities; Infrastructure protection; Intent detection; Maritime domain awareness; Micro services; Situation awareness; Smuggling; Virtual control; Crime
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:ri:diva-76161 (URN)10.23919/FUSION59988.2024.10706447 (DOI)2-s2.0-85207691521 (Scopus ID)
Conference
27th International Conference on Information Fusion, FUSION 2024. Venice. 7 July 2024 through 11 July 2024
Available from: 2024-11-28 Created: 2024-11-28 Last updated: 2025-09-23Bibliographically approved
Eskilsson, C., Pashami, S., Holst, A. & Palm, J. (2023). A hybrid linear potential flow - machine learning model for enhanced prediction of WEC performance. In: Proceedings of the 15th European Wave and Tidal Energy Conference: . Paper presented at The 15th European Wave and Tidal Energy Conference.
Open this publication in new window or tab >>A hybrid linear potential flow - machine learning model for enhanced prediction of WEC performance
2023 (English)In: Proceedings of the 15th European Wave and Tidal Energy Conference, 2023Conference paper, Published paper (Refereed)
Abstract [en]

Linear potential flow (LPF) models remain the tools-of-the trade in marine and ocean engineering despite their well-known assumptions of small amplitude waves and motions. As of now, nonlinear simulation tools are still too computationally demanding to be used in the entire design loop, especially when it comes to the evaluation of numerous irregular sea states. In this paper we aim to enhance the performance of the LPF models by introducing a hybrid LPF-ML (machine learning) approach, based on identification of nonlinear force corrections. The corrections are defined as the difference in hydrodynamic force (vis- cous and pressure-based) between high-fidelity CFD and LPF models. Using prescribed chirp motions with different amplitudes, we train a long short-term memory (LSTM) network to predict the corrections. The LSTM network is then linked to the MoodyMarine LPF model to provide the nonlinear correction force at every time-step, based on the dynamic state of the body and the corresponding forces from the LPF model. The method is illustrated for the case of a heaving sphere in decay, regular and irregular waves – including passive control. The hybrid LPF-model is shown to give significant improvements compared to the baseline LPF model, even though the training is quite generic.

Keywords
Linear potential flow, machine learning, recurrent neural network, floating bodies, wave energy
National Category
Marine Engineering
Identifiers
urn:nbn:se:ri:diva-72107 (URN)10.36688/ewtec-2023-321 (DOI)
Conference
The 15th European Wave and Tidal Energy Conference
Funder
Swedish Energy Agency, 50196-1
Available from: 2024-03-02 Created: 2024-03-02 Last updated: 2025-09-23Bibliographically approved
Eskilsson, C., Pashami, S., Holst, A. & Palm, J. (2023). Estimation of nonlinear forces acting on floating bodies using machine learning. In: J. W. Ringsberg, C. Guedes Soares (Ed.), Advances in the Analysis and Design of Marine Structures: (pp. 63-72). Boca Raton: CRC Press
Open this publication in new window or tab >>Estimation of nonlinear forces acting on floating bodies using machine learning
2023 (English)In: Advances in the Analysis and Design of Marine Structures / [ed] J. W. Ringsberg, C. Guedes Soares, Boca Raton: CRC Press, 2023, p. 63-72Chapter in book (Other academic)
Abstract [en]

Numerical models used in the design of floating bodies routinely rely on linear hydrodynamics. Extensions for hydrodynamic nonlinearities can be approximated using e.g. Morison type drag and nonlinear Froude-Krylov forces. This paper aims to improve the approximation of nonlinear forces acting on floating bodies by using machine learning (ML). Many ML models are general function approximators and therefore suitable for representing such nonlinear correction terms. A hierarchical modelling approach is used to build mappings between higher-fidelity simulations and the linear method. The ML corrections are built up for FNPF, Euler and RANS simulations. Results for decay tests of a sphere in model scale using recurrent neural networks (RNN) are presented. The RNN algorithm is shown to satisfactory predict the correction terms if the most nonlinear case is used as training data. No difference in the performance of the RNN model is seen for the different hydrodynamic models.

Place, publisher, year, edition, pages
Boca Raton: CRC Press, 2023
National Category
Marine Engineering
Identifiers
urn:nbn:se:ri:diva-72114 (URN)10.1201/9781003399759 (DOI)9781003399759 (ISBN)
Funder
Swedish Energy Agency, 50196-1
Available from: 2024-03-02 Created: 2024-03-02 Last updated: 2025-09-23Bibliographically approved
Eskilsson, C., Pashami, S., Holst, A. & Palm, J. (2023). Hierarchical Approaches to Train Recurrent Neural Networks for Wave-Body Interaction Problems. In: The Proceedings of the 33rd International Ocean and Polar Engineering Conference: . Paper presented at The 33rd International Ocean and Polar Engineering Conference. , 33, Article ID 307.
Open this publication in new window or tab >>Hierarchical Approaches to Train Recurrent Neural Networks for Wave-Body Interaction Problems
2023 (English)In: The Proceedings of the 33rd International Ocean and Polar Engineering Conference, 2023, Vol. 33, article id 307Conference paper, Published paper (Refereed)
Abstract [en]

We present a hybrid linear potential flow - machine learning (LPF-ML) model for simulating weakly nonlinear wave-body interaction problems. In this paper we focus on using hierarchical modelling for generating training data to be used with recurrent neural networks (RNNs) in order to derive nonlinear correction forces. Three different approaches are investigated: (i) a baseline method where data from a Reynolds averaged Navier Stokes (RANS) model is directly linked to data from a LPF model to generate nonlinear corrections; (ii) an approach in which we start from high-fidelity RANS simulations and build the nonlinear corrections by stepping down in the fidelity hierarchy; and (iii) a method starting from low-fidelity, successively moving up the fidelity staircase. The three approaches are evaluated for the simple test case of a heaving sphere. The results show that the baseline model performs best, as expected for this simple test case. Stepping up in the fidelity hierarchy very easily introduce errors that propagate through the hierarchical modelling via the correction forces. The baseline method was found to accurately predict the motion of the heaving sphere. The hierarchical approaches struggled with the task, with the approach that steps down in fidelity performing somewhat better of the two.

Keywords
Wave-body interaction; hierarchical modelling; linear potential flow; hybrid modeling; machine learning; recurrent neural net- work.
National Category
Marine Engineering
Identifiers
urn:nbn:se:ri:diva-72110 (URN)
Conference
The 33rd International Ocean and Polar Engineering Conference
Funder
Swedish Energy Agency, 50196-1
Available from: 2024-03-02 Created: 2024-03-02 Last updated: 2025-09-23Bibliographically approved
Kans, M., Ingwald, A., Strömberg, A.-B., Patriksson, M., Ekman, J., Holst, A. & Rudström, Å. (2022). Data Driven Maintenance: A Promising Way of Action for Future Industrial Services Management. In: Lecture Notes in Mechanical Engineering: . Paper presented at International Congress and Workshop on Industrial AI, IAI 2021, Virtual, Online, 6 October 2021 through 7 October 2021 (pp. 212-223). Springer Science and Business Media Deutschland GmbH
Open this publication in new window or tab >>Data Driven Maintenance: A Promising Way of Action for Future Industrial Services Management
Show others...
2022 (English)In: Lecture Notes in Mechanical Engineering, Springer Science and Business Media Deutschland GmbH , 2022, p. 212-223Conference paper, Published paper (Refereed)
Abstract [en]

Maintenance and services of products as well as processes are pivotal for achieving high availability and avoiding catastrophic and costly failures. At the same time, maintenance is routinely performed more frequently than necessary, replacing possibly functional components, which has negative economic impact on the maintenance. New processes and products need to fulfil increased environmental demands, while customers put increasing demands on customization and coordination. Hence, improved maintenance processes possess very high potentials, economically as well as environmentally. The shifting demands on product development and production processes have led to the emergency of new digital solutions as well as new business models, such as integrated product-service offerings. Still, the general maintenance problem of how to perform the right service at the right time, taking available information and given limitations is valid. The project Future Industrial Services Management (FUSE) project was a step in a long-term effort for catalysing the evolution of maintenance and production in the current digital era. In this paper, several aspects of the general maintenance problem are discussed from a data driven perspective, spanning from technology solutions and organizational requirements to new business opportunities and how to create optimal maintenance plans. One of the main results of the project, in the form of a simulation tool for strategy selection, is also described.

Place, publisher, year, edition, pages
Springer Science and Business Media Deutschland GmbH, 2022
Keywords
Data driven maintenance, Maintenance planning, Service-related business models, Simulation tool
National Category
Computer Sciences
Identifiers
urn:nbn:se:ri:diva-59768 (URN)10.1007/978-3-030-93639-6_18 (DOI)2-s2.0-85125283057 (Scopus ID)9783030936389 (ISBN)
Conference
International Congress and Workshop on Industrial AI, IAI 2021, Virtual, Online, 6 October 2021 through 7 October 2021
Available from: 2022-07-07 Created: 2022-07-07 Last updated: 2025-09-23Bibliographically approved
Eriksson, J., Nelson, D., Holst, A., Hellgren, E., Friman, O. & Oldner, A. (2021). Temporal patterns of organ dysfunction after severe trauma. Critical Care, 25(1), Article ID 165.
Open this publication in new window or tab >>Temporal patterns of organ dysfunction after severe trauma
Show others...
2021 (English)In: Critical Care, ISSN 1364-8535, E-ISSN 1466-609X, Vol. 25, no 1, article id 165Article in journal (Refereed) Published
Abstract [en]

Background: Understanding temporal patterns of organ dysfunction (OD) may aid early recognition of complications after trauma and assist timing and modality of treatment strategies. Our aim was to analyse and characterise temporal patterns of OD in intensive care unit-admitted trauma patients. Methods: We used group-based trajectory modelling to identify temporal trajectories of OD after trauma. Modelling was based on the joint development of all six subdomains comprising the sequential organ failure assessment score measured daily during the first two weeks post trauma. Further, the time for trajectories to stabilise and transition to final group assignments were evaluated. Results: Six-hundred and sixty patients were included in the final model. Median age was 40 years, and median ISS was 26 (IQR 17–38). We identified five distinct trajectories of OD. Group 1, mild OD (n = 300), median ISS of 20 (IQR 14–27), had an early resolution of OD and a low mortality. Group 2, moderate OD (n = 135), and group 3, severe OD (n = 87), were fairly similar in admission characteristics and initial OD but differed in subsequent OD trajectories, the latter experiencing an extended course and higher mortality. In group 3, 56% of the patients developed sepsis as compared with 19% in group 2. Group 4, extreme OD (n = 40), received most blood transfusions, had the highest proportion of shock at admission and a median ISS of 41 (IQR 29–50). They experienced significant and sustained OD affecting all organ systems and a 28-day mortality of 30%. Group 5, traumatic brain injury with OD (n = 98), had the highest mortality of 35% and the shortest time to death for non-survivors, median 3.5 (IQR 2.4–4.8) days. Groups 1 and 5 reached their final group assignment early, > 80% of the patients within 48 h. In contrast, groups 2 and 3 had a prolonged time to final group assignment. Conclusions: We identified five distinct trajectories of OD after severe trauma during the first two weeks post-trauma. Our findings underline the heterogeneous course after trauma and describe some potentially important clinical insights that are suggested by the groupings and temporal trajectories. © 2021, The Author(s).

Place, publisher, year, edition, pages
BioMed Central Ltd, 2021
Keywords
Clustering, Critical care, Data modelling, Multiple organ dysfunction, Trauma
National Category
Clinical Medicine
Identifiers
urn:nbn:se:ri:diva-53006 (URN)10.1186/s13054-021-03586-6 (DOI)2-s2.0-85105237671 (Scopus ID)
Note

Funding details: Karolinska Institutet, KI; Funding text 1: The Swedish Carnegie Hero Funds and funds from Karolinska Institute supported the study. Financial support was also provided through the regional agreement on medical and clinical research (ALF) between Stockholm County Council and Karolinska Institute. None of the funding agents were involved in the study design, data collection, data analysis, manuscript preparation, or publication decisions.

Available from: 2021-05-26 Created: 2021-05-26 Last updated: 2025-09-23Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-8577-6745

Search in DiVA

Show all publications