Go to Home Page
CHEP INFORMATION
Bulletins
Committees
Scientific Program
Docs by topics
Social events
Conference location
Secretariat
GRID INFORMATION
 • Grid WShop & Tutorial
 • Grid Program
USEFUL LINKS
 • Visiting Padova
 • INFN Padova
 • University of Padova
 • CHEP: '94 '95 '97 '98

Last update: Apr 1, 2000

to first abs  to previous absby abs number to next abs  to last abs

 

to first abs on this KT  to previous abs on this KTon same keytopic to next abs on this KT  to last abs on this KT


E191

Farms Batch System and Fermi Inter-Process Communication toolkit

Mark Breitung, James Fromm, Tanya Levshina, Igor Mandrichenko, Marilyn Schweitzer
 Fermi National Accelerator Laboratory

Speaker: Igor Mandrichenko

  Farms Batch System (FBS) was developed as a batch process management system for off-line Run II data processing at Fermilab. FBS will manage PC farms composed of up to 1000 nodes with disk capacity of up to several TB. It is designed to sustain up to 200 simultaneously running jobs and release 20 to 200 jobs per hour. FBS allows users to start arrays of parallel processes on multiple computers. It uses a simplified "process counting" method for load balancing between computers. FBS has been successfully used for more than a year at Fermilab by fixed target experiments and will be used for collider experiment off-line data processing.
  Fermi Inter-Process Communication toolkit (FIPC) was designed as a supplement product for FBS that helps establish synchronization and communication between processes running in a distributed batch environment. However, FIPC is an independent package, and can be used with other batch systems, as well as in a non-batch environment. FIPC provides users with a variety of global distributed objects: Binary semaphores (Locks) Counted semaphores (Flags and Gates) Queues Text Variables Other types of objects can be easily added to FIPC. FIPC is based on a Ring protocol that provides an atomic test-and-set operation over global text variables. Key features of FIPC are: Distributed nature of IPC objects High level of robustness with respect to crash and recovery of one or more nodes An ability to recover after unexpected client shutdown Shell- as well as programming language access to FIPC objects FIPC has been running on several PC farms at Fermilab for half a year and is going to be used by CDF for off-line data processing.

Presentation:  PowerPoint Long Paper:  Adobe Acrobat pdf 



  | Top | Home | Bulletins | Committees | Scientific Program | Docs by topics | Social Event | Conference Location | Secretariat |