A Negotiation Protocol for Fine-Grained Accountable Resource Provisioning and Sharing in e-Science

  • PDF / 1,202,789 Bytes
  • 20 Pages / 547.044 x 736.903 pts Page_size
  • 16 Downloads / 195 Views

DOWNLOAD

REPORT


A Negotiation Protocol for Fine-Grained Accountable Resource Provisioning and Sharing in e-Science Zeqian Meng · John Brooke · Junyi Han · Rizos Sakellariou

Received: 20 December 2018 / Accepted: 21 February 2020 © The Author(s) 2020

Abstract With the increasing demand for dynamic and customised resource provisioning for computational experiments in e-Science, solutions are required to mediate different participants’ varied demands for such resource provision. This paper presents a novel negotiation protocol based on a new collaboration model. The protocol allows e-Scientists, the manager of an e-Scientist’s collaboration, and resource providers to reach resource provisioning agreements. By considering the manager of an e-Scientist collaboration for negotiation decisions, the protocol enables fine-grained accountable resource provision on a per job basis for e-Scientist collaborations, without binding the e-Scientist collaboration to resource providers. A testbed built with the protocol is also presented, making use of a production e-Science gateway, use cases, and infrastructures. The testbed is experimentally evaluated, via designed scenarios and comparison with existing production tools. It demonstrates that the proposed negotiation protocol can facilitate accountable resource provision per job, based on resource sharing rules defined and managed by e-Scientist collaborations.

Z. Meng () · J. Han · R. Sakellariou University of Manchester, Manchester, UK e-mail: [email protected] J. Brooke Freelance Consultant and Researcher, Manchester, UK

Keywords Negotiation protocol · e-Science · Resource sharing · Fine-grained accounting

1 Introduction E-Science is a collaborative, computationally- or data-intensive research activity across all disciplines, throughout the research lifecycle, facilitated by infrastructures [1]. As a collaborative activity, e-Science inherently enables e-Scientists, often from different universities, institutions, or companies to share resources, data, and expertise. This sharing activity requires e-Scientist collaborations, which can be in the form of research groups. A research group requires a group manager to manage distributed resource sharing among distributed members [2], while resources can be provided by different infrastructures, e.g., Clouds, Grids, local Clusters. In such e-Science collaborations, resource management for computational experiments involves: (i) resource sharing management for members in a research group; and (ii) resource provisioning management for infrastructures as resource providers. To satisfy the demands of dynamic and customised resource provisioning, Cloud computing has been increasingly employed by e-Science computational experiments. Open markets, such as the Helix Nebula Science Cloud (HNSciCloud) [3] and EGI Marketplace [4], have been proposed and established to

Z. Meng et al.

harness the power of Cloud platforms and offer highperformance computing for scientific experiments. Meanwhile, Clouds, Grids, and local Clusters have all bee