Workflow management system ≈ Workflow management system
View article
Cirrus Open
Machine learning (ML) workflows are extremely complex. The typical workflow consists of distinct stages of user interaction, such as preprocessing, training, and tuning, that are repeatedly executed by users but have heterogeneous computat…
View article
The future of scientific workflows Open
Today’s computational, experimental, and observational sciences rely on computations that involve many related tasks. The success of a scientific mission often hinges on the computer automation of these workflows. In April 2015, the US Dep…
View article
Cost and makespan-aware workflow scheduling in hybrid clouds Open
Benefiting from rich resources and virtualization technologies, hybrid cloud has emerged as a promising solution to processing large-scale scientific workflow applications for users in a pay-as-you-go manner. However, considering the compl…
View article
Predicting Workflow Task Execution Time in the Cloud Using A Two-Stage Machine Learning Approach Open
Many techniques such as scheduling and resource provisioning rely on performance prediction of workflow tasks for varying input data. However, such estimates are difficult to generate in the cloud. This paper introduces a novel two-stage m…
View article
YesWorkflow: A User-Oriented, Language-Independent Tool for Recovering Workflow Information from Scripts Open
Scientific workflow management systems offer features for composing complex computational pipelines from modular building blocks, executing the resulting automated workflows, and recording the provenance of data products resulting from wor…
View article
Cross-Organizational Workflow Management Using Blockchain Technology - Towards Applicability, Auditability, and Automation Open
Bringing Blockchain technology and business process management together, we follow the Design Science Research approach and design, implement, and evaluate a Blockchain prototype for cross-organizational workflow management together with a…
View article
Scientific Workflows Open
Modern scientific collaborations have opened up the opportunity to solve complex problems that require both multidisciplinary expertise and large-scale computational experiments. These experiments typically consist of a sequence of process…
View article
The Evolution of the Pegasus Workflow Management Software Open
Since 2001 the Pegasus Workflow Management System has evolved into a robust and scalable system that automates the execution of a number of complex applications running on a variety of heterogeneous, distributed high-throughput, and high-p…
View article
Fluctuation-Aware and Predictive Workflow Scheduling in Cost-Effective Infrastructure-as-a-Service Clouds Open
Cloud computing is becoming an increasingly popular platform for the execution of scientific applications such as scientific workflows. In contrast to grids and other traditional high-performance computing systems, clouds provide a customi…
View article
OTP: An automatized system for managing and processing NGS data Open
The One Touch Pipeline (OTP) is an automation platform managing Next-Generation Sequencing (NGS) data and calling bioinformatic pipelines for processing these data. OTP handles the complete digital process from import of raw sequence data …
View article
Scheduling Scientific Workflow Using Multi-Objective Algorithm With Fuzzy Resource Utilization in Multi-Cloud Environment Open
The provision of resources and services for scientific workflow applications using a multi-cloud architecture and a pay-per-use rule has recently gained popularity within the cloud computing research domain. This is because workflow applic…
View article
RASflow: an RNA-Seq analysis workflow with Snakemake Open
Background With the cost of DNA sequencing decreasing, increasing amounts of RNA-Seq data are being generated giving novel insight into gene expression and regulation. Prior to analysis of gene expression, the RNA-Seq data has to be proces…
View article
Failure Management for Reliable Cloud Computing: A Taxonomy, Model, and Future Directions Open
The next generation of cloud computing must be reliable to fulfil the end-user requirements, which are changing dynamically. Presently, cloud providers are facing challenges to ensure the reliability of their services. In this paper, we pr…
View article
MyQueue: Task and workflow scheduling system Open
Task scheduling and workload management on high-performance computing environments is usually done with tools such as SLURM (Jette, Yoo, & Grondona, 2002).MyQueue is a front-end for schedulers that makes handling of tasks easy.It has a com…
View article
WORCS: A workflow for open reproducible code in science Open
Adopting open science principles can be challenging, requiring conceptual education and training in the use of new tools. This paper introduces the Workflow for Open Reproducible Code in Science (WORCS): A step-by-step procedure that resea…
View article
Scientific Workflows Management and Scheduling in Cloud Computing: Taxonomy, Prospects, and Challenges Open
Cloud computing provides solutions to a large number of organizations in terms of hosting systems and services. The services provided by cloud computing are broadly used for business and scientific applications. Business applications are t…
View article
Artificial Intelligence (AI) Workflow for Catalyst Design and Optimization Open
In the pursuit of novel catalyst development to address pressing\nenvironmental concerns and energy demand, conventional design and optimization\nmethods often fall short due to the complexity and vastness of the catalyst\nparameter space.…
View article
Middleware Building Blocks for Workflow Systems Open
This paper describes a building blocks approach to the design of scientific\nworkflow systems. We discuss RADICAL-Cybertools as one implementation of the\nbuilding blocks concept, showing how they are designed and developed in\naccordance …
View article
Task Duplication-Based Scheduling Algorithm for Budget-Constrained Workflows in Cloud Computing Open
Workflow scheduling is crucial to the efficient operation of cloud platforms, and has attracted a lot of attention. Up to now, many algorithms have been reported to schedule workflows with budget constraints, so as to optimize workflows' m…
View article
OVarFlow: a resource optimized GATK 4 based Open source Variant calling workFlow Open
Background The advent of next generation sequencing has opened new avenues for basic and applied research. One application is the discovery of sequence variants causative of a phenotypic trait or a disease pathology. The computational task…
View article
Quality of Service (QoS) Aware Workflow Scheduling (WFS) in Cloud Computing: A Systematic Review Open
Workflow scheduling concerns the mapping of complex tasks to cloud resources by taking into account various Quality of Service requirements. In virtue of continuous proliferation in the exploration of cloud computing, it has become stringe…
View article
Principled workflow-centric tracing of distributed systems Open
Workflow-centric tracing captures the workflow of causally-related events (e.g., work done to process a request) within and among the components of a distributed system. As distributed systems grow in scale and complexity, such tracing is …
View article
Applying MAPE-K control loops for adaptive workflow management in smart factories Open
Monitoring the state of currently running processes and reacting to ad-hoc situations during runtime is a key challenge in Business Process Management (BPM) . This is especially the case in cyber-physical environments that are characterize…
View article
A Novel Workflow-Level Data Placement Strategy for Data-Sharing Scientific Cloud Workflows Open
Cloud computing can provide a more cost-effective way to deploy scientific workflows than traditional distributed computing environments such as cluster and grid. Due to the large size of scientific datasets, data placement plays an import…
View article
A Hybrid Algorithm for Multi-Objective Scientific Workflow Scheduling in IaaS Cloud Open
With the increase in deployment of scientific workflow applications on an IaaS cloud computing environment, the distribution of workflow tasks to particular cloud instances to decrease runtime and cost has emerged as an important challenge…
View article
SciPipe: A workflow library for agile development of complex and dynamic bioinformatics pipelines Open
SciPipe provides a solution for agile development of complex and dynamic pipelines, especially in machine learning, through a flexible application programming interface suitable for scientists used to programming or scripting.
View article
A Reproducible Data Analysis Workflow Open
In this tutorial, we describe a workflow to ensure long-term reproducibility of R-based data analyses. The workflow leverages established tools and practices from software engineering. It combines the benefits of various open-source softwa…
View article
Challenges and Benefits of Digital Workflow Implementation in Aerospace Manufacturing Engineering Open
Companies who operate in highly regulated industries have further challenges to the usual competition, continuous cost reduction and product development challenges. To address these requirements companies optimise their business processes …
View article
Workflow-Net Based Service Composition Using Mobile Edge Nodes Open
Content delivery through cloud networks has gained popularity due to the cloud's ability to provide on-demand services. However, composite services, such as customized multimedia content, introduce both delays and resource limitations if t…
View article
Cloud Workflow Scheduling with Deadlines and Time Slot Availability Open
[EN] Allocating service capacities in cloud computing is based on the assumption that they are unlimited and can be used at any time. However, available service capacities change with workload and cannot satisfy users' requests at any time…